An investigation of a criterion- referenced test using G-theory, and factor and cluster analyses
dc.contributor.author | Kunnan, Antony | en_US |
dc.date.accessioned | 2010-04-14T13:58:26Z | |
dc.date.available | 2010-04-14T13:58:26Z | |
dc.date.issued | 1992 | en_US |
dc.identifier.citation | Kunnan, Antony (1992). "An investigation of a criterion- referenced test using G-theory, and factor and cluster analyses." Language Testing 9(1): 30-49. <http://hdl.handle.net/2027.42/68766> | en_US |
dc.identifier.issn | 0265-5322 | en_US |
dc.identifier.uri | https://hdl.handle.net/2027.42/68766 | |
dc.description.abstract | There has been relatively little research on analytical procedures for examin ing the dependability and validity of criterion-referenced tests especially when compared to similar investigations for norm-referenced ESL or EFL tests. This study used three analytical procedures, namely, G-theory, factor and cluster analyses, to investigate the dependability and validity of a criterion-referenced test developed at the University of California, Los Angeles in 1989. Dependability estimates showed that test scores are not equally depend able for all placement groups and are rather undependable for two out of the four placement groups. Factor analysis of test scores for the placement groups showed that though two-factor solutions were the best solutions for the different groups, there were differences in the way the subtests loaded in the different groups, with progressively fewer subtests loading on the second factor as ability increased. This finding led to the extension study with cluster analysis which showed that a number of students might have been differently placed if subtest scores were used to place them. | en_US |
dc.format.extent | 3108 bytes | |
dc.format.extent | 1026272 bytes | |
dc.format.mimetype | text/plain | |
dc.format.mimetype | application/pdf | |
dc.publisher | Sage Publications | en_US |
dc.title | An investigation of a criterion- referenced test using G-theory, and factor and cluster analyses | en_US |
dc.type | Article | en_US |
dc.subject.hlbsecondlevel | Education | en_US |
dc.subject.hlbsecondlevel | Linguistics | en_US |
dc.subject.hlbtoplevel | Humanities | en_US |
dc.subject.hlbtoplevel | Social Sciences | en_US |
dc.description.peerreviewed | Peer Reviewed | en_US |
dc.contributor.affiliationum | The University of Michigan | en_US |
dc.description.bitstreamurl | http://deepblue.lib.umich.edu/bitstream/2027.42/68766/2/10.1177_026553229200900104.pdf | |
dc.identifier.doi | 10.1177/026553229200900104 | en_US |
dc.identifier.source | Language Testing | en_US |
dc.identifier.citedreference | Aldenderfer, M.S. and Blashfield, R.K. 1984: Cluster analysis Newbury Park, CA: Sage Publications. | en_US |
dc.identifier.citedreference | Berk, R.A., editor, 1980: Criterion-referenced measurement: the state of the art. Baltimore: The Johns Hopkins University Press. | en_US |
dc.identifier.citedreference | — 1984: A guide to criterion-referenced measurement Baltimore: The Johns Hopkins University Press. | en_US |
dc.identifier.citedreference | Brennan, R.L. 1980: Applications of generalizability theory In Berk, R.A., editor, Criterion-referenced measurement: the state of the art. Baltimore: The Johns Hopkins University Press, 186-232. | en_US |
dc.identifier.citedreference | — 1983: Elements of generalizability theory Iowa City: American College Testing Program. | en_US |
dc.identifier.citedreference | — 1984: Estimating the dependability of the scores In Berk, R.A., editor, A guide to criterion-referenced test construction. Baltimore: The Johns Hopkins University Press, 292-334. | en_US |
dc.identifier.citedreference | Brown, J.D. 1989: Improving ESL placement tests using two perspectives TESOL Quarterly 23, 65-83. | en_US |
dc.identifier.citedreference | — 1990: Short-cut estimators of criterion-referenced test consistency Language Testing 7, 77-97. | en_US |
dc.identifier.citedreference | Cartier, F.A. 1968: Criterion-referenced testing of language skills TESOL Quarterly 1, 27-32. | en_US |
dc.identifier.citedreference | Carver, R.P. 1970: Special problems in measuring change with psychometric devices. In Evaluative research: strategies and methods Pittsburg: American Institute for Research, 48-63. | en_US |
dc.identifier.citedreference | Crick, J.E. and Brennan, R.L. 1982: GENOVA: A generalized analysis of variance system (FORTRAN IV computer program and manual) Dorchester, Mass.: Computer Facilities, University of Massachusetts at Boston. | en_US |
dc.identifier.citedreference | Cronbach, L.J., Gleser, G.C., Nanda, H. and Rajaratnam, N. 1972: The dependability of behavioral measurements: theory of generalizability for scores and profiles New York: Wiley. | en_US |
dc.identifier.citedreference | Davidson, F.G. 1988: An exploratory modeling survey of the trait structures of some existing language test data sets. Unpublished doctoral dissertation Los Angeles: UCLA. | en_US |
dc.identifier.citedreference | Glaser, R. and Nitko, A.J. 1971: Measurement in learning and instruction In Thorndike, R., editor, Educational measurement. Washington, DC: American Council of Education, 625-70. | en_US |
dc.identifier.citedreference | Hambelton, R.K. 1982: Advances in criterion-referenced testing technology In Reynolds, C.R. and Gutkin, T.B., editor, The handbook of school | en_US |
dc.identifier.citedreference | Hambelton, R.K. 1982: Advances in criterion-referenced testing technology In Reynolds, C.R. and Gutkin, T.B., editor, The handbook of school psychology. New York: John Wiley & Sons. | en_US |
dc.identifier.citedreference | Hambelton, R.K., Swaminathan, H., Algina, J. and Coulson, D.B. 1978: Criterion-referenced testing and measurement: A review of technical issues and developments Review of Educational Research 48, 1-47. | en_US |
dc.identifier.citedreference | Hudson, T. 1989: Measurement approaches in ability level functional language tests. Unpublished doctoral dissertation Los Angeles: UCLA. | en_US |
dc.identifier.citedreference | Hudson, T. and Lynch, B. 1984: A criterion-referenced approach to ESL achievement testing Language Testing 1, 171-201. | en_US |
dc.identifier.citedreference | Huynh, H. 1976: On the reliability of decisions in domain-referenced testing Journal of Educational Measurement 13, 253-64. | en_US |
dc.identifier.citedreference | Kaiser, H.F. 1974: An index of factorial simplicity Psychometrika 39, 31-36. | en_US |
dc.identifier.citedreference | Kaiser, H.F.. and Derflinger, G. 1990: Some contrasts between maximum likelihood factor analysis and alpha factor analysis Applied Psychological Measurement 14, 29-32. | en_US |
dc.identifier.citedreference | Kim, J.-O. and Mueller, C.W. 1978: Factor analysis: statistical methods and practical issues Newbury Park, CA: Sage. | en_US |
dc.identifier.citedreference | Kunnan, A.J. 1986: Making classroom testing useful to teachers and learners Indian Journal of Applied Linguistics 12, 101-17. | en_US |
dc.identifier.citedreference | 1990 : An investigation of the dependability and validity of the New ESLPE. Ph D qualifying paper. Department of TESL and applied linguistics Los Angeles: UCLA. | en_US |
dc.identifier.citedreference | Marshall, J.L. and Haertel, E.H. 1976: The mean split-half coefficient of agreement: a single administration index for reliability of mastery tests. Unpublished manuscript University of Wisconsin. | en_US |
dc.identifier.citedreference | Muthen, B.O. 1989: Factor structure in groups selected on observed scores British Journal of Psychological Society 42, 81-90. | en_US |
dc.identifier.citedreference | Nitko, A.J. 1984: Defining 'criterion-referenced test' In Berk, R.A., editor, A guide to criterion-referenced test construction. Baltimore: The Johns Hopkins University Press, 8-28. | en_US |
dc.identifier.citedreference | Oltman, P.K., Stricker, L.J. and Barrows, T. 1988: Native language, English proficiency, and the structure of the TOEFL. (TOEFL research report no. 27) Princeton, NJ: Educational Testing Service. | en_US |
dc.identifier.citedreference | Popham, W.J. 1978: Criterion-referenced measurement Englewood Cliffs, N.J.: Prentice Hall. | en_US |
dc.identifier.citedreference | Popham, W.J. and Husek, T.R. 1969: Implications of criterion-referenced measurement Journal of Educational Measurement 6, 1-9. | en_US |
dc.identifier.citedreference | Shavelson, R.J., Block, J.H. and Ravitch, M.M. 1972: Criterion-referenced testing: comments on reliability Journal of Educational Measurement 9, 133-37. | en_US |
dc.identifier.citedreference | Subkoviak, M.J. 1975: Estimating reliability from a single administration of a mastery test. (Occasional Paper no. 15) Madison: Laboratory of Experimental Design, University of Wisconsin. | en_US |
dc.identifier.citedreference | — 1980: Decision-consistency approaches In Berk, R.A., editor, Criterion-referenced measurement: the state of the art. Baltimore: The Johns Hopkins University Press, 129-85. | en_US |
dc.identifier.citedreference | — 1984: Estimating the reliability of mastery-nonmastery classifications In Berk, R.A., editor, 1984. A guide to criterion-referenced measurement Baltimore: The Johns Hopkins University Press, 267-91. | en_US |
dc.identifier.citedreference | — 1988: A practitioner's guide to computation and interpretation of reliability indices for mastery tests Journal of Educational Measurement 25, 47-55. | en_US |
dc.identifier.citedreference | Swaminathan, H., Hambelton, R.K. and Algina, J. 1973 : Reliability of criterion-referenced tests: A decision-theoretic formulation Journal of Educational Research 11, 263-67. | en_US |
dc.identifier.citedreference | Upshur, J.A. and Homburg, T.J. 1983: Some relations among tests at successive ability levels In Oller, J., editor, Issues in language testing research. Rowley: Newbury House, 188-202. | en_US |
dc.owningcollname | Interdisciplinary and Peer-Reviewed |
Files in this item
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.