RESEARCHMonitorNEXT 12 MONTHS
Target-Aware Calibration Data Selection for Preserving Uncertainty in Quantized Language Models
arXiv cs.CL — Computation and Language
Factual evidence
What the source reports
Research proposes a method to preserve model uncertainty and abstention behavior during LLM quantization using target-aware calibration data.
Open source