<scp>Dadu‐E</scp> : Rethinking the Role of Large Language Model in Robotic Computing Pipelines

Abstract

ABSTRACT Performing complex tasks in open environments remains challenging for robots, even when using large language models (LLMs) as the core planner. Many LLM‐based planners are inefficient due to their large number of parameters and prone to inaccuracies because they operate in open‐loop systems. We think the reason is that only applying LLMs as planners is insufficient. In this study, we propose Dadu‐Embodied ( Dadu‐E) , a robust closed‐loop planning framework for embodied Artificial Intelligence (AI) robots. Specifically, Dadu‐E is equipped with a relatively lightweight LLM, a set of encapsulated robot skill instructions, a robust feedback system, and memory augmentation. Together, these components enable Dadu‐E to (i) actively perceive and adapt to dynamic environments, (ii) optimize computational costs while maintaining high performance, and (iii) recover from execution failures using its memory and feedback mechanisms. By seamlessly integrating a lightweight LLM, encapsulated robot skill instructions, closed‐loop feedback, and memory augmentation, Dadu‐E establishes a robust and extensible embodied AI robotic framework capable of stable operation in real‐world environments. Extensive experiments on real‐world and simulated tasks show that Dadu‐E achieves task success rates comparable to embodied AI robots with larger models as planners like COME‐Robot, while reducing computational requirements by . Users are encouraged to explore our system at https://rlc-lab.github.io/dadu-e/ .