Search results

fastllm是否可以Qwen3-Embedding-4B这个模型的推理？

Status: Open.

#654 In ztxz16/fastllm;

· jimmy-kuo opened on Mar 12, 2026

Issue with Model Qwen3.5 Dense FP8

Status: Open.

#653 In ztxz16/fastllm;

· lovedheart opened on Mar 10, 2026

Unsupported model type qwen3_5_moe

Status: Open.

#652 In ztxz16/fastllm;

· lovedheart opened on Mar 10, 2026

似乎提供的openai兼容接口有缺陷？

Status: Open.

#648 In ztxz16/fastllm;

· pdwfree opened on Mar 4, 2026

CMakeLists.txt中编译问题

Status: Open.

#646 In ztxz16/fastllm;

· skylerma1106 opened on Feb 11, 2026

Dockerfilec中无setup.py错误问题

Status: Open.

#645 In ztxz16/fastllm;

· skylerma1106 opened on Feb 11, 2026

【求助】MI50运行报错：Unbundle Objects Error: Failed to decompress input: Could not decompress embedded file contents: Unknown frame descriptor

Status: Open.

#644 In ztxz16/fastllm;

· pro518 opened on Feb 8, 2026

max_batch设置失效，alive>max_batch设置的值

Status: Open.

#643 In ztxz16/fastllm;

· ruoxiqq opened on Jan 27, 2026

请问近期有更新计划吗？

Status: Open.

#641 In ztxz16/fastllm;

· CodeZ-Hao opened on Jan 9, 2026

GLM-4.7 GGUF 多GPU运行缓慢

Status: Open.

#637 In ztxz16/fastllm;

· 344303947 opened on Dec 26, 2025

不支持Qwen3-32B-GPTQ-Int4模型的部署

Status: Open.

#636 In ztxz16/fastllm;

· zhaojc001 opened on Dec 7, 2025

DeepSeek 3.2 Speciale Support

Status: Open.

#634 In ztxz16/fastllm;

· artisankat2000 opened on Dec 3, 2025