Volume 21, Issue 3 (Pajouhan Scientific Journal, Summer 2023)
Pajouhan Sci J 2023, 21(3): 186-195 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Pakrad E, Salehi K, Meijer R, Izanloo B, Moghadamzadeh A. Investigating the Person Fit Statistics of Teenagers Participating in the Iranian University Entrance Exam 2022. Pajouhan Sci J 2023; 21 (3) :186-195
URL: http://psj.umsha.ac.ir/article-1-1020-en.html
URL: http://psj.umsha.ac.ir/article-1-1020-en.html
1- Faculty of Psychology and Education, University of Tehran, Tehran, Iran
2- Faculty of Psychology and Education, University of Tehran, Tehran, Iran ,keyvansalehi@ut.ac.ir
3- Faculty of Behavioral and Social Sciences, University of Groningen, Groningen, Netherlands
4- Faculty of Psychology and Education, Kharazmi University, Tehran, Iran
2- Faculty of Psychology and Education, University of Tehran, Tehran, Iran ,
3- Faculty of Behavioral and Social Sciences, University of Groningen, Groningen, Netherlands
4- Faculty of Psychology and Education, Kharazmi University, Tehran, Iran
Abstract: (756 Views)
Background and Objectives: Various factors can play a role in producing aberrant response. The presence of aberrant response has a significant effect on the validity of the test. If the test scores do not have adequate validity, the score does not reflect the true latent trait of the test. Individual person fit statistics are indicators for evaluating the compatibility of test scores with a certain measurement model or with a group of examinees. This research was conducted with the aim of investigating how to compute the person fit statistics of the biology course of the 2022 university entrance exam using the PerFit package in the R software.
Materials and Methods: In this descriptive study, the answer sheets of 1000 candidates aged 16 to 18 years of the national exam who answered 50 items in the biology course were examined. To compute individual person fit statistics, PerFit package was used in R software. Also, a number of its functions were also examined.
Results: The commands for compute individual person fit statistics, and were presented and the values of these statistics were calculated.
Conclusion: The PerFit package was introduced as a powerful tool for measuring individual person fit and it was shown that the individual person fit statistics can be easily used for academic achievement tests using this package.
Materials and Methods: In this descriptive study, the answer sheets of 1000 candidates aged 16 to 18 years of the national exam who answered 50 items in the biology course were examined. To compute individual person fit statistics, PerFit package was used in R software. Also, a number of its functions were also examined.
Results: The commands for compute individual person fit statistics, and were presented and the values of these statistics were calculated.
Conclusion: The PerFit package was introduced as a powerful tool for measuring individual person fit and it was shown that the individual person fit statistics can be easily used for academic achievement tests using this package.
Type of Study: Research Article |
Subject:
Biostatistic & Epidemiology
Received: 2023/05/20 | Accepted: 2023/06/6 | Published: 2023/09/22
Received: 2023/05/20 | Accepted: 2023/06/6 | Published: 2023/09/22
References
1. Meijer RR. Person-fit research: an introduction. Appl Meas Educ. 1996;9(1):3-8. [DOI:10.1207/s15324818ame0901_2]
2. Meijer RR, Egberink IJL, Emons WHM, Sijtsma K. Detection and validation of unscalable item score patterns using item response theory: an illustration with harter's self-perception profile for children. J Pers Assess. 2008;90(3):227-38. [DOI:10.1080/00223890701884921] [PMID]
3. Karabatsos G. Comparing the aberrant response detection performance of thirty-six person-fit statistics. Appl Meas Educ. 2003;16(4):277-98. [DOI:10.1207/S15324818AME1604_2]
4. Olson JF, Fremer J. TILSA test security guidebook preventing, detecting, and investigating test security irregularities. 2013.
5. Meijer RR, Tendeiro JN. The use of person-fit scores in high-stakes educational testing: how to use them and what they tell us. law school admission council. USA; 2014.
6. Conijn JM. Detecting and Explaining Person Misfit in Non-Cognitive Measurement. Netherlands: Tilburg University; 2013.
7. Meijer RR, Niessen AS, Tendeiro JN. A practical guide to check the consistency of item response patterns in clinical research through person-fit statistics: examples and a computer program. Assessment. 2016;23(1):52-62. [DOI:10.1177/1073191115577800] [PMID]
8. Tendeiro JN. PerFit: Person Fit. 2021.
9. Rupp AA. A systematic review of the methodology for person fit research in Item Response Theory: Lessons about generalizability of inferences from the design of simulation studies. Psychol Test Assess Model. 2013;55(1):3-8.
10. Santos KCP, de la Torre J, Von Davier M. Adjusting Person Fit Index for Skewness in Cognitive Diagnosis Modeling. J Classif. 2020;37:399-420. [DOI:10.1007/s00357-019-09325-5]
11. Meijer RR, Sijtsma K. Methodology review: evaluating person fit. Appl Psychol Meas. 2001;25(2):107-35. [DOI:10.1177/01466210122031957]
12. Drasgow F, Levine MV, Williams EA. Appropriateness measurement with polychotomous item response models and standardized indices. Br J Math Stat Psychol. 1985;38(1):67-86. [DOI:10.1111/j.2044-8317.1985.tb00817.x]
13. Snijders TA. Asymptotic null distribution of person fit statistics with estimated person parameter. Psychometrika. 2001;66:331-42. [DOI:10.1007/BF02294437]
14. Embretson SE, Reise SP. Item Response Theory. Psychology Press; 2013. [DOI:10.4324/9781410605269]
15. Mair P, Hatzinger R. Extended rasch modeling: the erm package for the application of irt models in R. J Stat Softw. 2007;20:1-20. [DOI:10.18637/jss.v020.i09]
16. Partchev I, Maris G, Hattori T. irtoys: A collection of functions related to item response theory (IRT). 2022.
17. Rizopoulos D. ltm : An R Package for Latent Variable Modeling and Item Response Theory Analyses. J Stat Softw. 2007;17:1-25. [DOI:10.18637/jss.v017.i05]
18. Reif M (2014). mcIRT: IRT Models for Multiple Choice Items. R package version 0.41
19. Robitzsch A, Kiefer T, Wu M. TAM: Test Analysis Modules. 2023.
20. Sijtsma K, Molenaar IW. Introduction to nonparametric item response theory. sage; 2002. [DOI:10.4135/9781412984676]
21. Chalmers RP. mirt : A multidimensional item response theory package for the r environment. J Stat Softw. 2012;48:1-29. [DOI:10.18637/jss.v048.i06]
22. Robitzsch A. sirt: Supplementary item response theory models. 2023.
23. Wright BD, Masters GN. Computation of OUTFIT and INFIT Statistics. Rasch Meas Trans. 1990;3(4):84-5.
24. Honaker J, King G, Blackwell M. Amelia II: A program for missing data. J Stat Softw. 2011;45:1-47. [DOI:10.18637/jss.v045.i07]
25. Su YS, Gelman A, Hill J, Yajima M. Multiple imputation with diagnostics ( mi ) in r : opening windows into the black box. J Stat Softw. 2011;45:1-31. [DOI:10.18637/jss.v045.i02]
26. Nering ML, Meijer RR. A comparison of the person response function and the lz person-fit statistic. Appl Psychol Meas. 1998;22(1):53-69. [DOI:10.1177/01466216980221004]
27. Cui Y, Mousavi A. Explore the usefulness of person-fit analysis on large-scale assessment. Int J Test. 2015;15(1):23-49. [DOI:10.1080/15305058.2014.977444]
28. Tendeiro JN, Meijer RR, Schakel L, Maij-de Meij AM. Using cumulative sum statistics to detect inconsistencies in unproctored internet testing. Educ Psychol Meas. 2013;73(1):143-61. [DOI:10.1177/0013164412444787]
Send email to the article author
| Rights and permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
Articles Copyright © The Author(s).
Owned by Hamadan University of Medical Sciences.
Published by UMSHA Press
Journal Tel: +98 81 38380090
Publisher Tel: +98 81 38382022
Website: https://psj.umsha.ac.ir/
Email: psj@umsha.ac.ir
