Releases: EducationalTestingService/rsmtool
Releases · EducationalTestingService/rsmtool
Version 5.0.1
This is a hotfix release that fixes the following regression:
rsmcomparenow does not accidentally swap the old and the new experiments.
Version 5.0.0
New features
- Evaluations on the test set now include R2 and RMSE.
- The
rsmtoolreports now include model fit parameters (R2 and adjusted R2) for the training set. - It is now possible to exclude candidates with less than X responses from model training/evaluation.
rsmcomparecan now handle experiments which used SKLL models.rsmcomparenow includes a notebook for consistency between human raters (thanks @bndgyawali!)
Bug fixes
- Correct handling of repeated feature names in the feature .json file.
- Correct printing of feature coefficients for SKLL models.
- Correct handling of quoted boolean values in config .json file.
- Fixed rounding and highlighting in feature correlation table.
- And several dozen more.
Version 4.6.0
This is the first GitHub release for RSMTool. Before being open-sourced, RSMTool was an internal research project at the Educational Testing Service.