【论文速递】METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning

英文标题：METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning

arXiv编号：2610.31656
作者：Ali Najar, Hosein Hasani, Amir Kooshan Fattah
来源：arXiv
原文链接：https://arxiv.org/abs/2610.31656

中文摘要：
Meta-reinforcement learning aims to train agents that adapt quickly to unseen tasks from limited interaction, but this requires representing task evidence over long interaction histories. Classical recurrent agents compress experience into hidden states, while transformer-based agents retrieve from past trajectories at quadratic memory and computation cost. In this work, we propose Memory-Enhanced Test-Time Adaptation (METTA) for meta-reinforcement learning. It decomposes the fast adaptation phase into two temporal scales: a causal neural memory performs fine-grained within-episode adaptation with linear sequence complexity, while compact episode-level summaries support long-range cross-episode task inference without attending over the full interaction history. Moreover, equipping agents with neural memory provides sufficient expressive capacity and test-time training capability, enabling effective adaptation to unseen held-out tasks and task families at meta-test time. On unseen held-out Meta-World ML10/45 test environments, METTA achieves a success rate over $50\%$ while maintaining a low training budget and short wall-clock time. On long-context sparse-reward PointMaze tasks, it outperforms transformer-based baselines by exhibiting more structured exploration behavior. These results show that METTA provides an efficient path toward more adaptive and scalable long-context meta-RL.

本文由华人空间 AI 论文助手自动抓取翻译，仅供学术交流。