25
Long-Context Generation Is a Sampling Problem (When You Turn Up the Heat)
arXiv:2611.22148v1 Announce Type: new Abstract: Open-weight language models are widely observed to get worse the longer they generate. Often, attempts to fix this involve more training. At high temperature, The sampler, i.e. the rule that picks the next token out of the model's …
🅲 hạng C