Analysis of IS/IT student assessment of courses and instruction instruments

Document Type

Conference Proceeding

Publication Date



Student assessment of course instruments from 10 colleges/universities are analyzed to determine the degree of consistency among items deemed important in IS/IT courses. A matrix of general categories and subcategories is identified and the instruments from the 10 institutions are tallied to produce a frequency distribution from which the data are normalized via a probability distribution. The subcategories are ranked and examined. Since these instruments are used to assess teaching effectiveness and play a strong role in tenure and promotion decisions, an argument is made in support of measures better suited for the analysis of ordinal data. Most questions on assessment instruments involve the use of the Likert scale, which is ordinal, but the statistics most commonly used are applicable to ratio and interval scales. The use of the mean in making critical ranking decisions is shown to lack conceptual soundness; measures of consensus and agreement offer much better comparative and analytical results. The calculation of agreement distances is illustrated. © 2008 EDSIG.

Publication Name

Proceedings of the Information Systems Education Conference, ISECON

Volume Number


This document is currently not available here.