Everything Quantization

Jump to bottom

Botchkarev edited this page Oct 17, 2023 · 6 revisions

Guides, Tutorials and Examples

FINN-hls4ml Guidelines for Quantization-Aware Training

Medium Blog about GPT-2 Optimization

[Repo transfomers-silicon-research, with lots of links]https://github.com/alimpk/transfomers-silicon-research

PyTorch Quantization Guide

PyTorch Quantization API Reference

PyTorch Quantized Inference on GPU

Deploying Int8 QAT Models on GPU with TensorRT

Papers

quantization-and-training-of-neural-networks
fasttextzip-compressing-text-classification