We finished our project “DENIAHL: In-Context Features Influence LLM Needle-In-A-Haystack Abilities”, where we analyze factors beyond context length affecting LLMs’ abilities to recall information from long input context. Check our paper and code.