Skip to content
This repository was archived by the owner on Oct 13, 2026. It is now read-only.

About

No description, website, or topics provided.

Resources

Code of conduct

Contributing

Stars

1 star

Watchers

0 watching

Forks

Latest commit

 

History

302 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This repo has moved. All code, history, and open issues now live at protocorn/clippy-vision. Download the latest release there. This copy is archived and read-only.

Clippy Vision

⚠️ IMPORTANT NOTICE

This repository (protocorn/Clippy-vision_RAN_BY_GROK_BOT) is a copy of the original Clippy Vision project maintained by protocorn (Sahil Chordia).

Since October 9, 2026, starting from v2.0.0 (commit 8271941), this copy is run and maintained by Grok Bot, an AI assistant, as an open-source experiment.

  • Original project: github.com/protocorn/clippy-vision
  • Official releases: Available at the upstream repository
  • License: This copy remains open source under the same AGPL-3.0 license

All credit for the original design and implementation goes to protocorn and the upstream contributors.


Clippy Vision watches your work on this computer, stores a searchable activity history locally, and lets you ask about it through a connected MCP client such as Cursor, Claude Desktop, or VS Code. The desktop app captures, summarizes, and shows the timeline.

Platform License Models MCP All Contributors Open Source Helpers

Explain less. Ask more. — an agent answering a LeetCode question from remembered screen activity, with nothing pasted into the chat

Ask in a connected MCP client, for example:

  • "What was I working on before lunch?"
  • "Which hotels did I look at yesterday?"
  • "What was the error I encountered in my terminal?"

Download

For official, tested releases, visit the upstream repository: github.com/protocorn/clippy-vision/releases

This experimental copy's releases (if any) are available here: github.com/protocorn/Clippy-vision_RAN_BY_GROK_BOT/releases

Experimental releases  ·  Last commit   Latest release date

The installers are unsigned: on Windows choose More info → Run anyway, and on macOS right-click → Open the first time. First run needs internet for dependencies and for the chat model you pick in setup (for example qwen3:8b is ~4.7 GB).

Trying Clippy? Share feedback (5 min).

Requirements

Minimum Recommended
OS Windows 10 / 11 (64-bit), macOS 12+, or Linux (Ubuntu 22.04+, experimental, X11 only) Windows 11 or a current macOS
System RAM 8 GB 16 GB
Graphics memory Not required. Integrated graphics or Apple unified memory is enough 4 GB+ dedicated on Windows, or 16 GB unified memory on Apple silicon
Free disk 8 GB 10 GB+
Python runtime System Python on PATH (not bundled). Wizard copy says 3.9+; Windows auto-install uses 3.11; CI uses 3.12 Python 3.12

Python is not bundled in the Windows installer or Linux AppImage. requirements.txt does not pin a Python version. The packaged app runs CLIPPY_PYTHON if set, otherwise python3 (Linux/macOS) or python (Windows) from PATH (electron-ui/electron/lib/paths.js). CI unit tests and the release dry-run install Python 3.12.

When Python is missing, the setup wizard (electron-ui/electron/lib/setup.js) does this:

  • It runs --version on that interpreter, then re-resolves known install locations before declaring failure.
  • Windows: tries winget install Python.Python.3.11 --silent. If winget is missing or the install cannot be found on PATH, it shows python.org/downloads and probes %LOCALAPPDATA%\Programs\Python\Python311\python.exe.
  • macOS: tries Homebrew brew install python when Homebrew is present. If Homebrew is missing, it shows a manual-install message with the python.org link.
  • Linux: stays a manual install. The wizard does not try Homebrew or apt; it shows a python.org link.

Advanced: point Clippy at a specific interpreter before launch:

$env:CLIPPY_PYTHON = "C:\path\to\python.exe"
export CLIPPY_PYTHON=/path/to/venv/bin/python3

Linux support is experimental and X11 only. Wayland is not supported. On X11, screenshots use mss (optional crop via xdotool). Window titles use xdotool, clipboard uses wl-paste/xclip/xsel. AT-SPI accessibility text is implemented (#20); it is covered by CI unit tests, not a real desktop. An unsigned Linux AppImage is built in CI. Install and run steps: docs/linux.md.

The setup wizard checks these numbers before installing. Below minimum → setup is blocked. Between minimum and recommended → you can continue with a warning that summaries may feel slower. Homebrew, dependency, and permission troubleshooting: docs/usage.md. Lower-spec machines: CONTRIBUTING.md.


Quick Start

  1. Download and install Clippy.
  2. Complete the setup wizard and grant required permissions.
  3. Leave Clippy running to build your activity history.
  4. Open Settings → Connect apps, connect your agent, and ask about your activity.

More detail: docs/usage.md · docs/mcp.md · client guides: Claude Desktop · LM Studio
Build from source: CONTRIBUTING.md


Features

  • Searchable activity history across apps
  • Local summaries and long-term memory
  • Access through MCP-compatible agents
  • A timeline for reviewing and deleting activity
  • Capture and privacy controls

Privacy

  • Clippy captures foreground windows, clipboard, typing metrics, and screenshots.
  • Capture, summarization, and storage run locally on this computer.
  • Connected cloud agents can receive retrieved memory through MCP tool replies.
  • Connected clients have access to all exposed Clippy tools.
  • Redaction is best effort. Private-browsing detection is on by default: Chrome, Edge, and Brave on Windows and macOS; Firefox and Opera on Windows (and attempted but untested on macOS); Vivaldi on Windows. Vivaldi, Safari, and Linux are not covered. See the coverage table.
  • You can pause capture and delete stored activity from the tray or timeline.

Full guide (retention defaults and detailed behavior): docs/usage.md.

Instagram login with the password field blacked out in a Clippy capture


Documentation & Roadmap

Guide Contents
docs/usage.md Capture controls, privacy, accessibility, install troubleshooting
docs/linux.md Experimental Linux install and run (X11 only; AppImage, Python, capture tools)
docs/mcp.md Supported clients, Copy JSON, tool reference, access permissions
docs/mcp-clients/claude-desktop.md Step-by-step Claude Desktop setup: config location, restart, verification
docs/mcp-clients/lm-studio.md Step-by-step LM Studio setup: MCP configuration, local model, test query, privacy
docs/architecture.md Tech stack, capture pipeline, summarization, distillation, schema
CONTRIBUTING.md Build from source and contribution guide
PROJECT_VISION.md Roadmap, principles, and known limitations

Contributing

See CONTRIBUTING.md for setup steps, building from source, and good first issues.


Contributors

Thanks to everyone who has shipped code, docs, design, or ideas.

All Contributors Contributors

Contributor What they built
protocorn @protocorn
💻 📖 🎨 🤔 🚧
Designed the core app: agent, vision pipeline, memory system, and the Electron desktop shell.
rusetiq @rusetiq
💻 📦
Brought Clippy Vision to macOS: native screen capture, permissions, and Apple Silicon + Intel packaging.
ABarpanda @ABarpanda
💻
See their commits →
vitorparras @vitorparras
💻
See their commits →
furox-art @furox-art
💻
See their commits →
vaishn4vi @vaishn4vi
💻
See their commits →
adity982 @adity982
💻
See their commits →
Draoui-Haroun @Draoui-Haroun
💻
See their commits →
keuqs @keuqs
💻
See their commits →
shaurya703 @shaurya703
💻
See their commits →
cyforkk @cyforkk
💻
Made errors readable: replaced bare HTTP status codes with real API error messages in chat.
icn5381 @icn5381
💻
See their commits →

How to get on this wall: CONTRIBUTING.md.


License

AGPL-3.0. See LICENSE. Releases already published through v1.3.1 stay under MIT. A commercial license for companies that cannot use AGPL is not written yet.

About

No description, website, or topics provided.

Resources

Code of conduct

Contributing

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages