Skip to content

Commit 21cb289

Browse files
Uxito-Adalzx1413
authored andcommitted
Update quantization.md
1 parent d2a2492 commit 21cb289

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

docs/en/quantization.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,9 +36,9 @@ The scale can cover a tensor, an output channel, a token, or a small block. Smal
3636

3737
## Online Linear quantization
3838

39-
### TorchAO FP8: version-dependent
39+
### TorchAO FP8:
4040

41-
TeleFuser probes TorchAO's dynamic-activation and weight-only FP8 APIs. The first available API determines the mode:
41+
TorchAO automatically selects FP8 kernels depending on your hardware paltform, between dynamic-activation and weight-only FP8s. TeleFuser determines the mode according to the selection of TorchAO:
4242
dynamic activation and weight FP8 is W8A8, while `Float8WeightOnlyConfig` with BF16 inputs is W8A16. Check the
4343
conversion log and run a real forward instead of inferring the mode from `QuantType.TORCHAO_FP8`.
4444

0 commit comments

Comments
 (0)