FlattenQuant: Breaking Through the Inference Compute-bound for Large
Language Models with Per-tensor Quantization

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization

28 February 2024

Papers citing "FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization"

Title
No papers