v0.5.12

What's Changed

• fix: update TinyStories optimize to use item_loader=TokensLoader() by @bhimrazy in #2148
• [FEAT] Add Grouped Topk Routing to LLaMAMoE (Based on DeepseekV3MoE) by @ysjprojects in #2134
• Add timeout parameter to run_server. by @hv10 in #2157
• fix: chat prompt lowercasing bug by @bhimrazy in #2155
• chore: Drop Python 3.9 support from ci by @bhimrazy in #2161
• fix: handle gemma 3 weights prefix during hf conversion by @scascar in #2156
• Fix to avoid RuntimeError by @mseeger in #2138
• fix: pin lm-eval<0.4.9.1 for trust_remote_code issue by @bhimrazy in #2168
• Small refactorings by @mseeger in #2166
• docs: enhance Python API tutorial with fixes and new section by @carsch18 in #2169
• fix: sliding window KV cache for Gemma-3 models (issue #2145) by @Chelsi-create in #2153

New Contributors

• @lianakoleva made their first contribution in #2132
• @hv10 made their first contribution in #2157
• @scascar made their first contribution in #2156
• @carsch18 made their first contribution in #2169
• @Chelsi-create made their first contribution in #2153

Full Changelog: v0.5.11...v0.5.12