Skip to content

Commit 44af3d4

Browse files
committed
skip gemma 27b on ada and blackwell
Signed-off-by: Xin He (SW-GPU) <[email protected]>
1 parent 60efe47 commit 44af3d4

File tree

2 files changed

+4
-3
lines changed

2 files changed

+4
-3
lines changed

tests/integration/defs/accuracy/test_llm_api_pytorch_multimodal.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
from tensorrt_llm import LLM
44
from tensorrt_llm.llmapi import CudaGraphConfig, KvCacheConfig, MoeConfig, SamplingParams
55

6-
from ..conftest import llm_models_root, skip_pre_blackwell
6+
from ..conftest import llm_models_root, skip_post_blackwell, skip_pre_blackwell, skip_pre_hopper
77
from .accuracy_core import MMMU, LlmapiAccuracyTestHarness
88

99

@@ -216,6 +216,8 @@ def test_auto_dtype(self):
216216
task.evaluate(llm, sampling_params=self.sampling_params)
217217

218218

219+
@skip_pre_hopper
220+
@skip_post_blackwell
219221
class TestGemma3_27BInstruct(LlmapiAccuracyTestHarness):
220222
MODEL_NAME = "google/gemma-3-27b-it"
221223
MODEL_PATH = f"{llm_models_root()}/gemma/gemma-3-27b-it/"

tests/integration/test_lists/waives.txt

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -519,5 +519,4 @@ disaggregated/test_disaggregated.py::test_disaggregated_benchmark_on_diff_backen
519519
disaggregated/test_disaggregated.py::test_disaggregated_benchmark_on_diff_backends[DeepSeek-V3-Lite-bf16] SKIP (https://nvbugs/5769890)
520520
accuracy/test_llm_api_pytorch_multimodal.py::TestMistralLarge3_675B::test_nvfp4_4gpus[latency_moe_trtllm] SKIP (TBD)
521521
accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[dp4-trtllm-fp8] SKIP (https://nvbugs/5772396)
522-
accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[dp4-trtllm-auto] SKIP (https://nvbugs/5772396)
523-
accuracy/test_llm_api_pytorch_multimodal.py::TestGemma3_27BInstruct::test_auto_dtype SKIP (https://nvbugs/5542138)
522+
full:sm100/accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[dp4-trtllm-auto] SKIP (https://nvbugs/5772396)

0 commit comments

Comments
 (0)