fp4

Here are 3 public repositories matching this topic...

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

An innovative library for efficient LLM inference via low-bit quantization

Add a description, image, and links to the fp4 topic page so that developers can more easily learn about it.

To associate your repository with the fp4 topic, visit your repo's landing page and select "manage topics."