Quantifying Long-Range Information for Long-Context LLM Pretraining Data

2 points | by PaulHoule 14 hours ago