Skip to content

Releases: EducationalTestingService/rsmtool

Version 5.0.1

07 Jun 16:38

Choose a tag to compare

This is a hotfix release that fixes the following regression:

  • rsmcompare now does not accidentally swap the old and the new experiments.

Version 5.0.0

04 Jun 17:30

Choose a tag to compare

New features

  • Evaluations on the test set now include R2 and RMSE.
  • The rsmtool reports now include model fit parameters (R2 and adjusted R2) for the training set.
  • It is now possible to exclude candidates with less than X responses from model training/evaluation.
  • rsmcompare can now handle experiments which used SKLL models.
  • rsmcompare now includes a notebook for consistency between human raters (thanks @bndgyawali!)

Bug fixes

  • Correct handling of repeated feature names in the feature .json file.
  • Correct printing of feature coefficients for SKLL models.
  • Correct handling of quoted boolean values in config .json file.
  • Fixed rounding and highlighting in feature correlation table.
  • And several dozen more.

Version 4.6.0

06 Apr 14:22

Choose a tag to compare

This is the first GitHub release for RSMTool. Before being open-sourced, RSMTool was an internal research project at the Educational Testing Service.