Dual Robustness in an Agent with an Uncertain World Model
Abstract
An exploring agent's world model and dual dynamics protection require different evidence. Evaluation should independently check transition understanding and separately vary training and deployment shifts. A conservative value criterion cannot correct every missing grounded relation. Interactive outcomes under declared conditions provide practical evidence without establishing reliability in unexamined environments. This focused synthesis develops an empirical comparison that preserves the terminal action, observation process, and total verification cost. Its proposed tests are prospective; no new simulation run, model-training result, or intervention effect is reported.
References
S. Chen, T. Zhu, Z. Wang, J. Zhang, K. Wang, R. Zhou, S. Gao, T. Xiao, Y. W. Teh, J. He, and M. Li, “Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective,” Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, 2026.
Z. Qiao, R. Yang, J. Lyu, X. Li, Z. Dai, Z. Yang, S. Gao, and S. Qiu, “Dual-Robust Cross-Domain Offline Reinforcement Learning Against Dynamics Shifts,” Proceedings of the 2026 International Conference on Learning Representations, 2026.
Zhou, Yongxi, Junwei Yao, Yuanzhe Liu, Zihan Dong, Wenbo Ye, Jiaxi Wen, and Lai Yun Choi. “Single Canonical Prompts Underestimate LLM Safety's Surface-Form Sensitivity.” arXiv, 2026, arXiv:2608.02665. https://arxiv.org/abs/2608.02665.
Lewis, Patrick, et al. “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.” Advances in Neural Information Processing Systems, vol. 33, 2020, pp. 9459–9474. https://arxiv.org/abs/2005.11401.
Geifman, Yonatan, and Ran El-Yaniv. “Selective Classification for Deep Neural Networks.” Advances in Neural Information Processing Systems, vol. 30, 2017. https://arxiv.org/abs/1705.08500.
Ovadia, Yaniv, et al. “Can You Trust Your Model’s Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift.” Advances in Neural Information Processing Systems, vol. 32, 2019. https://arxiv.org/abs/1906.02530.
Bertsimas, Dimitris, and Melvyn Sim. “The Price of Robustness.” Operations Research, vol. 52, no. 1, 2004, pp. 35–53. https://doi.org/10.1287/opre.1030.0065.
Rasmussen, Carl Edward, and Christopher K. I. Williams. Gaussian Processes for Machine Learning. MIT Press, 2006. https://gaussianprocess.org/gpml/.
Hu, Edward J., et al. “LoRA: Low-Rank Adaptation of Large Language Models.” International Conference on Learning Representations, 2022. https://openreview.net/forum?id=nZeVKeeFYf9.
Guo, Chuan, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. “On Calibration of Modern Neural Networks.” Proceedings of the 34th International Conference on Machine Learning, PMLR, vol. 70, 2017, pp. 1321–1330. https://proceedings.mlr.press/v70/guo17a.html.
Sutton, Richard S., and Andrew G. Barto. Reinforcement Learning: An Introduction. 2nd ed., MIT Press, 2018. http://incompleteideas.net/book/the-book-2nd.html.
Published
Versions
- 2026-10-15 (2)
- 2025-12-23 (1)