-
-
Notifications
You must be signed in to change notification settings - Fork 8
Open
Labels
enhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomers
Description
Overview
Introduce a configurable auto-fallback mechanism when a given model fails to load or process an input (default: false).
Requirements
- If
fallback: true, when a model quantization fails to load or perform an inference, attempt falling back to another allowed quantization for that model. - Tests must prove compatibility for all of all changes across all impacted flows.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomers