Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely on dense 3D reconstruction and hand-crafted goal metrics, which limits their generalization across tasks and environments. Recent advances in vision–language navigation (VLN) and vision–language–action (VLA) models enable end-to-end policies conditioned on natural language, but typically require interactive training, large-scale data collection, or task-specific fine-tuning with a mobile agent. We formulate navigation as a sparse subgoal identification and reaching problem and observe that providing visual anchoring targets for high-level semantic priors enables highly efficient goal-conditioned navigation. Based on this insight, we select navigation frontiers as semantic anchors and propose OpenFrontier, a training-free navigation framework that seamlessly integrates diverse vision–language prior models. OpenFrontier enables efficient navigation with a lightweight system design, without dense 3D mapping, policy training, or model fine-tuning. We evaluate OpenFrontier across multiple navigation benchmarks and demonstrate strong zero-shot performance, as well as effective real-world deployment on a mobile robot.
The core idea of OpenFrontier is the visual frontier: a navigation frontier that is detected and reasoned about directly in the 2D image, without dense 3D semantic mapping. Given the current RGB observation, a natural-language goal, and the camera pose, OpenFrontier jointly detects candidate frontiers and evaluates them in image space, then lifts the chosen frontier into 3D to drive the robot. The system runs in a fully zero-shot manner, with no policy training, no fine-tuning, and no dense reconstruction.
The key insight is that a single representation, the visual frontier, can serve as the bridge between the sub-problems that open-world navigation usually treats separately:
Because every stage communicates through frontiers, each component (the detector, the VLM, and the planner) can be swapped independently, giving OpenFrontier a simple, flexible, and open-context design.
@inproceedings{padilla2026openfrontier,
title={OpenFrontier: General Navigation with Visual-Language Grounded Frontiers},
author={Padilla, Esteban and Sun, Boyang and Pollefeys, Marc and Blum, Hermann},
booktitle={Robotics: Science and Systems (RSS)},
year={2026}
}