Research4d ago
Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
Researchers propose a novel residual vector-based reconstruction method for large language models that maintains near-constant GPU memory usage during…
#long-context#llm-memory#research#arxiv#LLM