Yandex

Yandex Research Introduces New LLM Compression Methods at ICML

AQLM leverages additive quantization, traditionally used for information retrieval, for LLM compression. The resulting method preserves and even improves model accuracy under extreme compression