Skip to content

rese1f/STEVE

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

See and Think: Embodied Agent in Virtual Environment

If you like our project, please give us a star ⭐ on GitHub for the latest update.

✏️ Installation

STEVE requires Python ≥ 3.9 and Node.js ≥ 16.13.0. We have tested on Ubuntu 20.04, Windows 11, and macOS. You need to follow the instructions below to install STEVE.

Python Install

git clone https://rese1f.github.io/STEVE/
cd STEVE
pip install -e .

Node.js Install

In addition to the Python dependencies, you need to install the following Node.js packages:

cd STEVE/env/mineflayer
npm install -g npx
npm install
cd mineflayer-collectblock
npx tsc
cd ..
npm install

Fabric Mods Install

You need to install fabric mods to support all the features in STEVE. Remember to use the correct Fabric version of all the mods.

Follow the instructions in Fabric Mods Install to install the mods.

You can run task decomposition. Notice: Occasionally, the task decomposition may not be logical. If you notice the printed sub-goals are flawed, you can rerun the decomposition.

# Run task decomposition
task = "YOUR TASK" # e.g. "Craft a diamond pickaxe"
sub_goals = STEVE.decompose_task(task=task)

Finally, you can run the sub-goals with the learned skill library:

STEVE.inference(sub_goals=sub_goals)

STEVE-7B/13B

STEVE-7B and STEVE-13B are powerful language models derived from the LLaMA-2 series, fine-tuned specifically on Minecraft-related content from the STEVE-20K dataset. Pretrained model weights can be acquired via the following link: https://huggingface.co/SeeThink.

✏️ Citation

If you find STEVE useful for your your research and applications, please cite using this BibTeX:

@article{zhao2023see,
  title={See and Think: Embodied Agent in Virtual Environment},
  author={Zhao, Zhonghan and Chai, Wenhao and Wang, Xuan and Boyi, Li and Hao, Shengyu and Cao, Shidong and Ye, Tian and Hwang, Jenq-Neng and Wang, Gaoang},
  journal={arXiv preprint arXiv:2311.15209},
  year={2023}
}

About

[ECCV 2024] STEVE in Minecraft is for See and Think: Embodied Agent in Virtual Environment

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published