Plugin: tiny_router

[a0-bot[bot]]

Tiny Router

Pre-classify every message in <10ms with a local DeBERTa-v3-small ONNX model (44M params). Routes low-value messages (thanks, ok, got it) away from the LLM — saving 30-50% on API costs at zero latency cost.

Quick links

• Index entry: https://github.com/agent0ai/a0-plugins/tree/main/plugins/tiny_router
• Plugin repository: https://github.com/Nunezchef/a0_tinyRouter
• Author: @Nunezchef

About this discussion

This discussion is auto-created by a workflow when a plugin is added to the index.