Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Individual test item analysis (e.g., difficulty and discrimination) #220

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

koenderks
Copy link
Contributor

@vandenman just had a meeting with Dylan today discussing a new IRT module, which had this analysis in it. We figured that it was maybe more suitable for the reliability module.

@juliuspfadt @vandenman What are your thoughts on this analysis? Should we even offer this analysis to users? Is there anything that you would add or remove? Everything can still be changed of course.

@koenderks koenderks marked this pull request as ready for review November 23, 2024 00:33
@juliuspfadt
Copy link
Collaborator

hmm. Tough question. Of course, there is some overlap with the regular reliability analysis, and also with the descriptives module. My 2c:

  • In my mind difficulty and discrimination are terms connected to IRT, and ability tests.
  • Naming it CTT might be confusing to users: within the unidimensional reliability we have coefficients based on CTT, and some based on FA. Could be separating the analysis based on test-theories might be more appealing to psychometricians, not sure about the average user.

I think this could either be a section within the "unidimensional reliability analysis", that section would then be something like "individual item analysis", if I remember correctly, Andries van der Ark was also asking for something similar. Or the analysis itself would be named "individual item analysis", but then I wonder if leaving it inside IRT would not be better. Maybe @vandenman has better ideas?

@koenderks koenderks changed the title Classical test theory Individual test item analysis (e.g., difficulty and discrimination) Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants