Open Source Psychometrics Projects

ShinyItemAnalysis is an R package including functions and interactive shiny application for the psychometric analysis of educational tests, psychological assessments, health-related and other types of multi-item measurements, or ratings from multiple raters. Exploration of total and standard scores. Analysis of measurement error and reliability. Analysis of correlation structure and validity. Traditional item analysis. Item analysis with regression models. Item analysis with IRT models. Detection of differential item functioning. Number of toy datasets is available, the interactive application also allows the users to upload and analyze their own data and to automatically generate PDF or HTML reports. All methods include sample R code which is ready to copy and paste into R and run locally. Several toy data sets are ready to use. You can also upload and analyze your own data. ShinyItemAnalysis provides model equations, parameter estimates and their interpretation.

blavaan is a free, open-source R package for Bayesian latent variable analysis. It relies on JAGS and Stan to estimate models via MCMC. The blavaan functions and syntax are similar to lavaan. The development version of blavaan (containing updates not yet on CRAN) can be installed via the command provided in the documentation. Compilation is required; this may be a problem for users who currently rely on a binary version of blavaan from CRAN. The blavaan package depends on the lavaan package for model specification and for some computations. This means that, if you already know lavaan, then you should already be able to do many things in blavaan. In particular, many blavaan commands add the letter “b” to the start of the lavaan command. It is also sometimes possible to use a lavaan command on a blavaan object, though the results may not always be what you expect.

The project will deliver tools, libraries and recipes (combinations of tools and algorithms) to allow end users the capability to conduct empirical analysis where the results can be used to support claims of validity associated with an assessment.

The Model Zoo of Cognitive Diagnosis Models, including classic Item Response Ranking (IRT), Multidimensional Item Response Ranking (MIRT), Deterministic Input, Noisy "And" model(DINA), and advanced Fuzzy Cognitive Diagnosis Framework (FuzzyCDF), Neural Cognitive Diagnosis Model (NCDM), Item Response Ranking framework (IRR), Incremental Cognitive Diagnosis (ICD) and Knowledge-association baesd extension of NeuralCD (KaNCD). Cognitive diagnosis model (CDM) for intelligent educational systems is a type of model that infers students' knowledge states from their learning behaviors (especially exercise response logs). Typically, the input of a CDM could be the students' response logs of items (i.e., exercises/questions), the Q-matrix that denotes the correlation between items and knowledge concepts (skills). The output is the diagnosed student knowledge states, such as students' abilities and students' proficiencies on each knowledge concepts.

Datasets in Education and convenient interface for downloading and preprocessing dataset in education. The CLI tools to quickly convert the "raw" data of the dataset into "mature" data for knowledge tracing task. The "mature" data is in json sequence format and can be modeled by XKT and TKT(TBA) The analysis dataset tool only supports the json sequence format. To check the following statical indexes of the dataset. In order to better verify the effectiveness of the model, the dataset is usually divided into train/valid/test or using kfold method. Each item in the sequence represents one interaction. The first element of the item is the exercise id (in some works, the exercise id is not one-to-one mapped to one knowledge unit(ku)/concept, but in junyi, one exercise contains one ku) and the second one indicates whether the learner correctly answers the exercise, 0 for wrongly while 1 for correctly.

Estimating G-DINA model and a variety of widely-used models subsumed by the G-DINA model, including the DINA model, DINO model, additive-CDM (A-CDM), linear logistic model (LLM), reduced reparametrized unified model (RRUM), multiple-strategy DINA model for dichotomous responses. Estimating models within the G-DINA model framework using user-specified design matrix and link functions. Estimating Bugs-DINA, DINO and G-DINA models for dichotomous responses. Estimating sequential G-DINA model for ordinal and nominal responses. Estimating the generalized multiple-strategy cognitive diagnosis models (experimental). Estimating the diagnostic tree model (experimental). Estimating multiple-choice models. Modelling independent, saturated, higher-order, loglinear smoothed, and structured joint attribute distribution. Accommodating multiple-group model analysis. Imposing monotonic constrained success probabilities. Accommodating binary and polytomous attributes.

The aim of the JQuizAPI project is to define a simple API to construct test that may be used in diferent areas: - Surveys - Psychometric tests - Polls

This project aims to develop open source psychometric data analysis software, including estimation software for Rasch and Item Response Theory (IRT) models for both dichotomous and polytomous test items.

This is a package for Structural Equation Modeling in development. It is written for extensibility, that is, you can easily define your own objective functions and other parts of the model. At the same time, it is (very) fast. We provide fast objective functions, gradients, and for some cases hessians as well as approximations thereof. As a user, you can easily define custom loss functions. For those, you can decide to provide analytical gradients or use finite difference approximation / automatic differentiation. You can choose to mix loss functions natively found in this package and those you provide. In such cases, you optimize over a sum of different objectives (e.g. ML + Ridge). This strategy also applies to gradients, where you may supply analytic gradients or opt for automatic differentiation or mixed analytical and automatic differentiation. You may consider using this package if you need extensibility and/or speed, and if you want to extend SEM.

This project aims at developing R-based Software for the analysis of typical neuroscientific data. These will include time resolved bootstrap tests and fitting and testing of psychometric functions.

The psychmeta package provides tools for computing bare-bones and psychometric meta-analyses and for generating psychometric data for use in meta-analysis simulations. Currently, the package supports bare-bones, individual-correction, and artifact-distribution methods for meta-analyzing correlations and d values. Please refer to the overview tutorial vignette for an introduction to psychmeta’s functions and workflows. psychmeta is hosted on both CRAN and GitHub. Documentation for psychmeta’s functions is available in the package’s PDF manual. Includes tools for converting effect sizes, computing sporadic artifact corrections, reshaping meta-analytic databases, computing multivariate corrections for range variation, and more.