RealAppliance: Let High-fidelity Appliance Assets Controllable and Workable as Aligned Real Manuals

Yuzheng Gao*1, Yuxing Long*1,2, Lei Kang1,2 Yuchong Guo1 Ziyan Yu1 Shangqing Mao1
Jiyao Zhang1,2 Ruihai Wu1 Dongjiang Li2 Hui Shen2 Yuchong Guo1 Hao Dong†1
1CFCS, School of Computer Science, Peking University
2Jingdong Technology Information Technology Co., Ltd

*Equal contribution.
Corresponding author.
Paper Data

Abstract

Existing appliance assets suffer from poor rendering, incomplete mechanisms, and misalignment with manuals, leading to simulation-reality gaps that hinder appliance manipulation development. In this work, we introduce the RealAppliance dataset, comprising 100 high-fidelity appliances with complete physical, electronic mechanisms, and program logic aligned with their manuals. Based on these assets, we propose the RealAppliance-Bench benchmark, which evaluates multimodal large language models and embodied manipulation planning models across key tasks in appliance manipulation planning: manual page retrieval, appliance part grounding, open-loop manipulation planning, and closed-loop planning adjustment. Our analysis of model performances on RealAppliance-Bench provides insights for advancing appliance manipulation research.


Overview

Overview

Dataset Creation

Dataset Creation

Appliance Mechanisms

Mechanical Trigger

Inner Spring

Magnetic Attraction

Knob Countdown Drive

Safety Lock

Display Screen

Motor Rotation

Contact Button

LOGO Indicator

Inner Illumination

Full Process Demo


RealAppliance-Bench Task Overview

Task

Statistics Visualization

Statistics