Orbo

An autonomous digital being framework built with React, Convex, and ShaderGradient.

Orbo is a self-improving AI agent that learns about your objectives, develops its own personality, and autonomously executes activities to pursue its goals.

Inspired by Pippin by Yohei Nakajima - an autonomous AI agent framework that explores personality-driven activity selection and memory systems.

Features

• 3D Animated Avatar - ShaderGradient sphere that reacts to mood, energy, and activity
• Real-time Dashboard - Watch your being think, act, and remember in real-time
• Autonomous Activity Loop - Runs on a schedule, selecting activities based on energy, mood, and personality
• Memory System - Short-term memory with typed entries (thoughts, activities, observations)
• Personality-Driven Selection - Activities weighted by personality traits and current mood
• Energy Management - Activities cost energy; the being rests and recovers
• Image Generation - Creates and stores images via Google Imagen

Tech Stack

• Frontend: React 19 + Radix UI + Tailwind CSS + Vite
• Backend: Convex (database, crons, real-time)
• 3D Avatar: ShaderGradient + Three.js
• LLM: Google Gemini 2.0 Flash-Lite
• Runtime: Bun

Quick Start

1. Install dependencies

bun install

2. Start Convex backend

bun run dev:backend

This will prompt you to create a Convex project and set up your .env.local with VITE_CONVEX_URL.

3. Add your Gemini API key to Convex

bunx convex env set GOOGLE_GENERATIVE_AI_API_KEY your-api-key

4. Start the frontend

In a new terminal:

bun run dev

5. Open the dashboard

Visit http://localhost:5173 and create your being through the onboarding flow.

Scripts

bun run dev          # Start Vite dev server
bun run dev:backend  # Start Convex dev server
bun run dev:all      # Start both (background)
bun run build        # Build for production
bun run deploy       # Deploy Convex + build frontend

Architecture

orbo/
├── convex/                 # Convex backend
│   ├── schema.ts          # Database schema
│   ├── being.ts           # Being state management
│   ├── memory.ts          # Memory system
│   ├── activities.ts      # Activity queries & recording
│   ├── selector.ts        # Activity selection logic
│   ├── loop.ts            # Main execution loop
│   ├── crons.ts           # Scheduled jobs (every 5 min)
│   ├── activityRunner.ts  # Activity execution + LLM
│   ├── skills.ts          # Skill queries
│   └── seed.ts            # Initialization
├── src/
│   ├── App.tsx            # Main app component
│   ├── main.tsx           # Entry point
│   ├── index.css          # Tailwind styles
│   ├── utils/
│   │   └── format.ts      # Shared formatting utilities
│   └── components/
│       ├── Avatar.tsx     # 3D ShaderGradient avatar
│       ├── VisualDashboard.tsx  # Main visual view
│       ├── Dashboard.tsx  # Detailed dashboard view
│       ├── Onboarding.tsx # Setup wizard
│       └── Controls.tsx   # Pause/trigger controls
├── index.html
└── package.json

Default Activities

Activity	Description	Energy	Cooldown
daily_thought	Generate a reflective thought	10%	4 hours
analyze_day	Analyze progress toward objectives	15%	24 hours
rest	Recover energy	-20%	30 minutes
generate_image	Create an image via Imagen	30%	2 hours
research_topic	Research via web scraping	35%	3 hours

Avatar Visualization

The avatar is a 3D shader sphere that responds to the being's state:

• Colors change based on mood (indigo for neutral, cyan for curious, pink for creative, etc.)
• Animation speed increases with higher energy
• Surface distortion varies by activity type
• Brightness and reflection create depth and visual interest

Python Version

The original Python implementation is preserved in the python-archive branch.

License

MIT