Releases: talmolab/sleap
SLEAP v1.6.0a2
SLEAP v1.6.0a2
About the v1.6 Pre-release Series
This is a pre-release for SLEAP v1.6.0. It contains many new features and improvements, but is not yet considered stable. For production use, see v1.5.2.
We are releasing a series of pre-releases that incrementally build towards the stable v1.6.0 release. Each pre-release adds new features and bug fixes:
| Version | Summary |
|---|---|
| v1.6.0a0 | Unified sleap CLI, redesigned training dialog (55x faster loading), bug fixes for adding instances from predictions |
| v1.6.0a1 | Label QC for automated error detection, 8 new CLI commands from sleap-io, video rendering with live preview |
| v1.6.0a2 (current) | Revamped installation docs, epoch-end evaluation metrics, content-based video matching, bug fix for export training package |
Note: Starting with SLEAP v1.5+, all deep learning functionality is powered by the PyTorch-based
sleap-nnbackend. TensorFlow models (withUNetbackbones) from earlier versions are still supported for inference. Refer to the Migrating to 1.5+ docs for more details!
How to Install
Step 1: Install uv (skip if already installed)
# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"
# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | shStep 2: Install SLEAP v1.6.0a2
uv tool install --python 3.13 "sleap[nn]==1.6.0a2" --with "sleap-io==0.6.2" --with "sleap-nn==0.1.0a2" --prerelease allow --torch-backend autoThat's it! SLEAP is now available system-wide. The --torch-backend auto flag automatically detects your GPU (NVIDIA, AMD, Intel, or CPU). Be sure to do a uv self update if you get an error about this flag.
Step 3: Verify installation
sleap doctorUpgrading from v1.6.0a1?
uv tool upgrade sleap --upgrade-package sleap-io --upgrade-package sleap-nnOr for a clean reinstall:
uv tool install --reinstall --python 3.13 "sleap[nn]==1.6.0a2" --with "sleap-io==0.6.2" --with "sleap-nn==0.1.0a2" --prerelease allow --torch-backend autoRollback to stable
If you encounter issues, rollback to the latest stable release:
uv tool install --python 3.13 "sleap[nn]==1.5.2" --torch-backend autoVersion compatibility
| SLEAP | sleap-io | sleap-nn |
|---|---|---|
| 1.6.0a2 | 0.6.2 | 0.1.0a2 |
| 1.6.0a1 | 0.6.1 | 0.1.0a1 |
| 1.6.0aN | 0.6.x | 0.1.0aN |
| 1.6.x | 0.6.x | 0.1.x |
| 1.5.x | 0.5.x | 0.0.x |
What's New in v1.6.0a2
-
Revamped Installation Documentation:
- Complete rewrite of installation docs with simplified workflow (#2567)
- Single universal install command for all platforms using
--torch-backend auto - Reduced from 8 installation paths to 2 (tool install + development setup)
- New
uvx sleap labels.slpoption for viewing data without permanent installation - Streamlined upgrade flow with
uv tool upgrade sleap
-
Python 3.13 Default:
- Python 3.13 is now the default recommended version (#2565)
- Python 3.12 remains supported
-
Bug Fixes:
-
- Content-Based Video Matching: Videos are now automatically matched by pose annotations or pixel content, enabling reliable cross-platform merges even when file paths differ
- New
Labels.match()API: Inspect matching results without merging — ideal for evaluation workflows - Video Color Mode Control: New
Labels.set_video_color_mode()method andsio fix --video-colorCLI option - Bug fixes for HDF5 dataset matching and provenance conflict handling
-
- Epoch-End Evaluation Metrics: Real-time mOKS, mAP, mAR, PCK, and distance metrics logged to WandB during training
- Robust Video Matching: Uses sleap-io's
Labels.match()API for better cross-platform evaluation - Bug fixes for embedded video handling and centroid model ground truth matching
Full Changelog
Enhancements
Fixes
Workflows
- Fix docs workflow race condition with concurrency group by @talmo in #2563
- Housekeeping: Python 3.13 default and sleap-support skill by @talmo in #2565
Dependencies
Full Changelog: v1.6.0a1...v1.6.0a2
SLEAP v1.6.0a1
SLEAP v1.6.0a1
About the v1.6 Pre-release Series
This is a pre-release for SLEAP v1.6.0. It contains many new features and improvements, but is not yet considered stable. For production use, see v1.5.2.
We are releasing a series of pre-releases that incrementally build towards the stable v1.6.0 release. Each pre-release adds new features and bug fixes:
| Version | Summary |
|---|---|
| v1.6.0a0 | Unified sleap CLI, redesigned training dialog (55x faster loading), bug fixes for adding instances from predictions |
| v1.6.0a1 (current) | Label QC for automated error detection, 8 new CLI commands from sleap-io, video rendering with live preview |
Note: Starting with SLEAP v1.5+, all deep learning functionality is powered by the PyTorch-based
sleap-nnbackend. TensorFlow models (withUNetbackbones) from earlier versions are still supported for inference. Refer to the Migrating to 1.5+ docs for more details!
How to Install
Step 1: Install uv (skip if already installed)
# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"
# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | shStep 2: Install SLEAP v1.6.0a1
Windows/Linux with NVIDIA GPU (CUDA 12.8)
uv tool install --reinstall --python 3.12 "sleap[nn]==1.6.0a1" --with "sleap-io==0.6.1" --with "sleap-nn==0.1.0a1" --prerelease allow --index https://download.pytorch.org/whl/cu128 --index https://pypi.org/simpleWindows/Linux with NVIDIA GPU (CUDA 13.0)
uv tool install --reinstall --python 3.12 "sleap[nn]==1.6.0a1" --with "sleap-io==0.6.1" --with "sleap-nn==0.1.0a1" --prerelease allow --index https://download.pytorch.org/whl/cu130 --index https://pypi.org/simpleWindows/Linux without GPU (CPU only)
uv tool install --reinstall --python 3.12 "sleap[nn]==1.6.0a1" --with "sleap-io==0.6.1" --with "sleap-nn==0.1.0a1" --prerelease allow --index https://download.pytorch.org/whl/cpu --index https://pypi.org/simplemacOS
uv tool install --reinstall --python 3.12 "sleap[nn]==1.6.0a1" --with "sleap-io==0.6.1" --with "sleap-nn==0.1.0a1" --prerelease allowStep 3: Verify installation
sleap doctorUpgrading from v1.6.0a0?
Use the same commands as above. The --reinstall flag will create a clean environment with the new dependencies.
Rollback to stable
If you encounter issues, rollback to the latest stable release:
# Windows/Linux (CUDA 12.8)
uv tool install --reinstall --python 3.12 "sleap[nn]==1.5.2" --index https://download.pytorch.org/whl/cu128 --index https://pypi.org/simple
# Windows/Linux (CPU only)
uv tool install --reinstall --python 3.12 "sleap[nn]==1.5.2" --index https://download.pytorch.org/whl/cpu --index https://pypi.org/simple
# macOS
uv tool install --reinstall --python 3.12 "sleap[nn]==1.5.2"Version compatibility
| SLEAP | sleap-io | sleap-nn |
|---|---|---|
| 1.6.0a1 | 0.6.1 | 0.1.0a1 |
| 1.6.0aN | 0.6.x | 0.1.0aN |
| 1.6.x | 0.6.x | 0.1.x |
| 1.5.x | 0.5.x | 0.0.x |
What's New in v1.6.0a1
-
Label Quality Control (QC):
- New
sleap.qcmodule with GMM-based anomaly detection to automatically identify annotation errors (#2547) - Detects 10+ error types: isolated misses, jitter, visibility errors, scale issues, left-right swaps, gross misses, missing instances, and duplicates
- Dockable GUI widget accessible via Analyze > Label QC... with score histograms and sensitivity controls
- Keyboard navigation (Space/Shift+Space) to quickly navigate flagged instances
- Export to CSV or add flagged instances to Suggestions for review
- New
-
Enhanced CLI:
- 8 new CLI commands from sleap-io:
sleap merge,sleap unsplit,sleap fix,sleap embed,sleap unembed,sleap trim,sleap reencode,sleap transform(#2559) - See the sleap-io CLI documentation for detailed usage
- 8 new CLI commands from sleap-io:
-
Video Rendering Overhaul:
- Now powered by sleap-io's rendering engine — see rendering documentation for details (#2558)
- Live preview of rendered frames with all style options before exporting
- 12+ new color palettes and 5 marker shapes with options to color by track, instance, or node
- Alpha transparency support for overlays
- Non-blocking video export with progress bar and cancel support
-
Training Dialog Improvements:
- Form state now persists after clicking Cancel (#2557)
- Device and worker settings default from user preferences instead of being overwritten by profiles (#2557)
- Updated all baseline profiles to use full ±180° rotation augmentation (#2557)
- Added Random Seed field for reproducible train/validation splits (#2557)
- New tooltips for Input Scaling, Batch Size, Predict On, and tracker fields (#2556)
-
Inference Improvements:
-
sleap doctorImprovements:- Consolidated, copy-paste-friendly diagnostic output (#2553)
- Git info display for editable installs (branch, commit hash) (#2553)
- Comprehensive UV and conda introspection with conflict warnings (#2553)
- System resources display (RAM and disk usage) (#2553)
- New
-o/--outputflag to save diagnostics to file (#2553) - Added spinner during PyTorch import to show command is working (#2551)
- Fixed path truncation in tables (#2551)
-
Bug Fixes:
- Fixed terminal spam from "Error processing frame" messages when scrubbing
.pkg.slpfiles (#2554)
- Fixed terminal spam from "Error processing frame" messages when scrubbing
-
- 8 new CLI commands:
merge,unsplit,fix,embed,unembed,trim,reencode,transform - CSV format support for MATLAB interoperability
- Coordinate-aware video transformations
- 23x faster
.pkg.slpsaves, 2.7x faster embedded video loading - Bug fixes for video matching, rendering, and embedded videos
- 8 new CLI commands:
-
- Training progress bar during dataset caching (no more apparent "freeze")
- Automatic WandB local log cleanup to save disk space
- Simplified log format for cleaner output
Full Changelog
Enhancements
- Add sleap.qc module for label quality control by @talmo in #2547
- Add sleap-io v0.6.1 CLI commands by @talmo in #2559
- Upgrade video rendering to use sleap-io API with live preview and non-blocking progress by @talmo in #2558
- Improve training config dialog UX by @talmo in #2557
- Add missing tooltips to training config and tracker form fields by @talmo in #2556
- Add "Random sample (current video)" inference target option by @talmo in #2555
- Improve sleap doctor with consolidated diagnostic output by @talmo in #2553
- Improve sleap doctor UX: add spinner and fix path truncation by @talmo in #2551
Fixes
- Suppress frame error spam when scrubbing pkg.slp files by @talmo in #2554
- Add --exclude_user_labeled flag to sleap-nn-track CLI shim by @talmo in #2552
Workflows
Dependencies
Full Changelog: v1.6.0a0...v1.6.0a1
SLEAP v1.6.0a0
SLEAP v1.6.0a0
About the v1.6 Pre-release Series
This is a pre-release for SLEAP v1.6.0. It contains many new features and improvements, but is not yet considered stable. For production use, see v1.5.2.
We are releasing a series of pre-releases that incrementally build towards the stable v1.6.0 release. Each pre-release adds new features and bug fixes:
| Version | Summary |
|---|---|
| v1.6.0a0 (current) | Unified sleap CLI, redesigned training dialog (55x faster loading), bug fixes for adding instances from predictions |
| v1.6.0a1 | Label QC for automated error detection, 8 new CLI commands from sleap-io, video rendering with live preview |
Note: Starting with SLEAP v1.5+, all deep learning functionality is powered by the PyTorch-based
sleap-nnbackend. TensorFlow models (withUNetbackbones) from earlier versions are still supported for inference. Refer to the Migrating to 1.5+ docs for more details!
How to Install
Step 1: Install uv (skip if already installed)
# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"
# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | shStep 2: Install SLEAP v1.6.0a0
Windows/Linux with NVIDIA GPU (CUDA 12.8)
uv tool install --force --python 3.12 "sleap[nn]==1.6.0a0" --with "sleap-io==0.6.0" --with "sleap-nn==0.1.0a0" --prerelease allow --index https://download.pytorch.org/whl/cu128 --index https://pypi.org/simpleWindows/Linux with NVIDIA GPU (CUDA 13.0 - NEW!)
uv tool install --force --python 3.12 "sleap[nn]==1.6.0a0" --with "sleap-io==0.6.0" --with "sleap-nn==0.1.0a0" --prerelease allow --index https://download.pytorch.org/whl/cu130 --index https://pypi.org/simpleWindows/Linux without GPU (CPU only)
uv tool install --force --python 3.12 "sleap[nn]==1.6.0a0" --with "sleap-io==0.6.0" --with "sleap-nn==0.1.0a0" --prerelease allow --index https://download.pytorch.org/whl/cpu --index https://pypi.org/simplemacOS
uv tool install --force --python 3.12 "sleap[nn]==1.6.0a0" --with "sleap-io==0.6.0" --with "sleap-nn==0.1.0a0" --prerelease allowStep 3: Verify installation
sleap doctorUpgrading from v1.5.x?
Use the same commands as above. The --force flag will replace your existing installation.
Rollback to stable
If you encounter issues, rollback to the latest stable release:
# Windows/Linux (CUDA 12.8)
uv tool install --force --python 3.12 "sleap[nn]==1.5.2" --index https://download.pytorch.org/whl/cu128 --index https://pypi.org/simple
# Windows/Linux (CPU only)
uv tool install --force --python 3.12 "sleap[nn]==1.5.2" --index https://download.pytorch.org/whl/cpu --index https://pypi.org/simple
# macOS
uv tool install --force --python 3.12 "sleap[nn]==1.5.2"Version compatibility
| SLEAP | sleap-io | sleap-nn |
|---|---|---|
| 1.6.0aN | 0.6.x | 0.1.0aN |
| 1.6.x | 0.6.x | 0.1.x |
| 1.5.x | 0.5.x | 0.0.x |
What's New in v1.6.0a0
-
Unified CLI:
-
Training GUI Overhaul:
- 55x faster config loading and much faster dialog startup (#2506, #2516)
- Completely redesigned training dialog with native Qt, unified frame targeting, and 356 new tests (#2519)
- New Frame Target Selector for flexible training/inference frame selection (#2519)
- Prediction handling modes: Keep, Replace, or Clear all predictions during inference (#2519)
- Smaller dialog that fits on 1280x720 screens (#2509, #2519)
- Augmentation controls simplified with on/off checkboxes and rotation presets (#2509)
- WandB integration improvements with run URL display and auto-browser-open (#2525)
-
Crop Size Visualization:
-
New Features:
- "Check for Updates" dialog showing versions for sleap, sleap-io, and sleap-nn (#2499)
- "Delete Predictions on User-Labeled Frames" for cleaning up duplicate instances (#2505)
- Startup banner with version info and branding when launching
sleap-label(#2517) - Progress dialog with cancel support for package export (#2522)
- Support for loading legacy SLEAP metrics from v1.4.1 and earlier (#2480)
-
Critical Bug Fixes:
- Fixed GUI freeze when editing predictions with NaN coordinates on Linux Qt 6.10+ (#2467)
- Fixed catastrophic data loss bug where removing a video could delete frames from ALL videos with the same resolution (#2535)
- Fixed prediction deletion incorrectly removing user-labeled instances (#2478)
- Fixed predictions not being fully converted to instances when adding from predictions (#2539)
-
- ~90x faster SLP loading with new lazy loading mode for large prediction files
- Pose rendering at ~50 FPS for publication-ready videos (
sleap render) - Data codecs for converting Labels to pandas DataFrames, NumPy arrays, and dictionaries
- Safe video matching prevents silent data corruption during merges
- Fixed package export losing videos without labeled frames (#282)
- Fixed video provenance breaking during merge operations (#302)
- Breaking: Merge API simplified (
video_matcher=→video=,frame_strategy=→frame=)
-
- Faster inference via GPU-accelerated normalization (17% for typical video, up to 50% for large RGB images)
- CUDA 13.0 support for latest NVIDIA GPUs
- Provenance tracking embeds full reproducibility metadata in output files
- Enhanced WandB with interactive visualizations and per-head loss logging
- Fixed crash on frames with empty instances (#385)
- Fixed
--exclude_user_labeledbeing ignored with--video_index(#397) - Fixed run folder cleanup when training canceled via GUI (#392)
- Breaking: Crop size semantics changed - top-down models now crop first, then resize
- Breaking: Output file naming changed (
labels_train_gt_0.slp→labels_gt.train.0.slp)
-
Other dependency changes:
- Removed 8 unused dependencies for faster installation (#2486)
Full Changelog
Enhancements
- Add unified CLI with
sleapcommand by @talmo in #2524 - Add sleap-io CLI command inheritance (
show,convert,split,filenames,render) by @talmo in #2541 - Add "Check for Updates" to Help menu and implement update checker by @jaw039 in #2499
- Refactor training/inference dialog with native Qt and unified frame targeting by @talmo in #2519
- Training GUI QOL improvements (augmentation checkboxes, rotation presets, overfit mode) by @talmo in #2509
- Improve training dialog startup performance (~55x faster config loading) by @talmo in #2506
- Add crop size visualization for top-down training pipelines by @gitttt-1234 in #2483
- Add Instance Size Distribution widget for crop size analysis by @talmo in #2528
- Add Delete Predictions on User-Labeled Frames feature by @talmo in #2505
- Add support for loading legacy SLEAP metrics (<=v1.4.1) by @gitttt-1234 in #2480
- Add progress dialog and completion notification for package export by @talmo in #2522
- Add startup banner with version info and branding by @talmo in #2517
- Improve baseline config display names in training config selector by @gitttt-1234 in #2471
- Fix WandB checkbox state and add run URL display by @talmo in #2525
Fixes
- Fix GUI freeze when editing predictions with NaN coordinates by @gitttt-1234 in #2467
- Fix remove_video() to use identity comparison instead of matches_content() by @talmo in #2535
- Fix prediction deletion to prevent removing labeled instances by @gitttt-1234 in #2478
- Add failing tests for predictions-not-fully-added bugs (and fix) by @talmo in #2539
- Fix GUI freeze during labeled video export by @gitttt-1234 in #2484
- Fix skeleton loading returning list instead of single Skeleton by @gitttt-1234 in #2493
- Fix missing file dialog for ImageVideo backend (list of frame paths) by @alicup29 in #2498
- Fix delete unused tracks crash with untracked instances by @talmo in #2503
- Fix plateau detection to use absolute threshold mode by @gitttt-1234 in #2469
- Update predictions output path for inference (multi-v...
SLEAP v1.5.2
What's Changed
SLEAP v1.5.2 – Bug Fixes & Dependency Updates
This release includes important bug fixes for GUI rendering and Windows compatibility, dependency updates for improved stability, and further documentation improvements.
Note: Starting with SLEAP v1.5+, all deep learning functionality is powered by the PyTorch-based
sleap-nnbackend. TensorFlow models (withUNetbackbones) from earlier versions are still supported for inference. Refer Migrating to 1.5+ docs for more details!
How to install?
You can now install SLEAP quickly using uv
Step 1: Install uv - an ultra-fast Python package manager
# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"
# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | shStep 2: Install sleap
# Windows/ Linux (CUDA)
uv tool install --python 3.13 "sleap[nn]==1.5.2" --index https://download.pytorch.org/whl/cu128 --index https://pypi.org/simple
# Windows/ Linux (CPU)
uv tool install --python 3.13 "sleap[nn]==1.5.2" --index https://download.pytorch.org/whl/cpu --index https://pypi.org/simple
# macOS
uv tool install --python 3.13 "sleap[nn]==1.5.2"
Check the full installation guide for platform-specific instructions and advanced options.
Once you've installed SLEAP, run the below command from anywhere in your terminal
sleap-labelThe GUI should open up!
Upgrading from v1.5.1?
If you already have SLEAP v1.5.1 installed, you can upgrade to v1.5.2 using the following commands based on your installation method:
If installed with uv tool install:
The simplest upgrade command (preserves your original Python version and index URLs):
uv tool upgrade sleapOr, if you want to ensure you're using Python 3.13 and refresh your installation:
uv tool uninstall sleap
# Then reinstall with the commands from the installation section aboveNote:
uv tool upgradeautomatically preserves the index URLs (CUDA/CPU) and Python version from your original installation. If you installed with--index https://download.pytorch.org/whl/cu128, the upgrade will continue using the CUDA 12.8 index.
If installed with pip in a conda environment:
conda activate sleap
pip install --upgrade "sleap[nn]"For platform-specific indexes (CUDA/CPU), add the appropriate --extra-index-url:
# CUDA 12.8
pip install --upgrade "sleap[nn]" --extra-index-url https://download.pytorch.org/whl/cu128 --index-url https://pypi.org/simple
# CPU
pip install --upgrade "sleap[nn]" --extra-index-url https://download.pytorch.org/whl/cpu --index-url https://pypi.org/simpleIf installed with uv add (project-based):
# Navigate to your project directory
uv sync --upgradeIf installed from source:
cd sleap
git pull
uv sync --upgradeAfter upgrading, verify the installation:
python -c "import sleap; sleap.versions()"You should see SLEAP: 1.5.2 in the output.
Highlights
-
Dependency updates:
- Updated minimum
sleap-ioversion to 0.5.7 - Updated minimum
sleap-nnversion to 0.0.4 - Removed
cattrsdependency for simplified dependency management - Added
--python 3.13flag to installation commands to prevent Python 3.14 compatibility issues
- Updated minimum
-
Bug fixes:
- Fixed color rendering in
sleap-render: Videos now display correct colors with proper BGR to RGB conversion (#2444) - Fixed Windows GUI crash: Resolved Qt widget attribute error when loading .slp files on Windows (#2440)
- Fixed instance coloring: Multiple instances in older SLEAP projects now display with distinct colors instead of the same color (#2434)
- Fixed color rendering in
-
Documentation improvements:
- Consolidated repetitive installation documentation (reduced by 55 lines while preserving all essential information)
- Improved
uv addinstallation workflow instructions with Windows troubleshooting tips - Clearer platform-specific installation guidance
Full Changelog: v1.5.1...v1.5.2
SLEAP v1.5.1
What's Changed
SLEAP v1.5.1 – Bug fixes & Documentation Improvements
This release focuses on a few bug fixes in the training pipeline, improving installation instructions, and updating documentation for a smoother user experience.
Note: Starting with SLEAP v1.5+, all deep learning functionality is powered by the PyTorch-based
sleap-nnbackend. TensorFlow models (withUNetbackbones) from earlier versions are still supported for inference. Refer Migrating to 1.5+ docs for more details!
How to install?
You can now install SLEAP quickly using uv
Step 1: Install uv - an ultra-fast Python package manager
# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"
# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | shStep 2: Install sleap
# Windows/ Linux (CUDA)
uv tool install "sleap[nn]" --index https://download.pytorch.org/whl/cu128 --index https://pypi.org/simple
# Windows/ Linux (CPU)
uv tool install "sleap[nn]" --index https://download.pytorch.org/whl/cpu --index https://pypi.org/simple
# macOS
uv tool install "sleap[nn]"
Check the full installation guide for platform-specific instructions and advanced options.
Once you've installed SLEAP, run the below command from anywhere in your terminal
sleap-labelThe GUI should open up!
Highlights
- Improved installation:
- Platform-specific dependency groups for sleap installation with CUDA support.
- Fixed CUDA installation issues on Windows.
- Updated installation instructions and options for clarity.
- Documentation updates:
- Fixed typos and broken links.
- Improved CLI docs with new options and guidance on legacy CLIs.
- Fixed MkDocs versioning and improved doc site structure.
- Error handling: sleap-nn import errors are now handled gracefully with clear user guidance.
- Bug fixes: Minor fixes across CLI and docs to improve stability.
Full Changelog: v1.5.0...v1.5.1
SLEAP v1.5.0
What's New in SLEAP 1.5
SLEAP 1.5 represents a major milestone with significant architectural improvements, performance enhancements, and new installation methods. Here are the key changes:
Major Changes
Updated dependencies
We have now updated to support Python 3.12+ and support many new versions of the many libraries that SLEAP uses. This should make it much easier to install on modern platforms, support new architectures, and make development much easier.
UV-Based Installation
SLEAP 1.5+ now uses uv for installation, making it much faster than previous methods. Get up and running in seconds with our streamlined installation process.
PyTorch Backend
Neural network backend switched from TensorFlow to PyTorch via sleap-nn, providing:
- Much faster training and inference speeds: Up to 2.5x faster training and inference times.
- Modern deep learning capabilities: PyTorch with upcoming integrations with a whole slew of modern deep learning models and packages.
- Improved developer experience: Check out the dedicated backend repo at https://github.com/talmolab/sleap-nn
- Multi-GPU training: Full support for using multiple GPUs for accelerated and larger scale training.
- Backwards compatibility: You are able to use your existing trained SLEAP models from v1.4.1 for the UNet backend with no changes (see notes below).
Refreshed Documentation Websites
- The new landing page is now live at: https://sleap.ai
- The new documentation is now live at: https://docs.sleap.ai
- The old docs (v1.4.1) are will remain available at: https://legacy.sleap.ai
Standalone Libraries
SLEAP GUI is now supported by two new packages for modular workflows:
SLEAP-IO
I/O backend for handling labels, processing .slp files, and data manipulation. Essential for any SLEAP workflow and can be used independently for data processing tasks.
SLEAP-NN
PyTorch-based neural network backend for training and inference. Perfect for custom training pipelines, remote processing, and headless server deployments.
Torch Backend Changes
New Backbones
SLEAP 1.5 introduces three powerful new backbone architectures (check here for more details):
- UNet - Classic encoder-decoder architecture for precise pose estimation
- SwinT - Swin Transformer for state-of-the-art performance
- ConvNeXt - Modern convolutional architecture with improved efficiency
Legacy Support
We've maintained full backward compatibility:
- GUI Support: SLEAP now uses a new YAML-based config file structure, but you can still upload and work with old SLEAP JSON files in the GUI. For details on converting legacy SLEAP 1.4 config/JSON files to the new YAML format, see our conversion guide.
- TensorFlow Model Inference: Continue to support running inference on old TensorFlow models (UNet backbone only). Check using legacy models for more details.
SLEAP v1.4.1
SLEAP 1.4.1 releases many new changes since the last big release 1.3.3. We hope users enjoy these long awaited new features and fixes!
From 1.3.2+, to install SLEAP through pip use pip install sleap[pypi] to ensure all dependencies are gathered.
As a reminder:
The 1.3.1 dependency update requires Mamba for faster dependency resolution. If you already have anaconda installed, then you can set the solver to libmamba in the base environment:
conda update -n base conda conda install -n base conda-libmamba-solver conda config --set solver libmambaAny subsequent
mambacommands in the docs will need to be replaced withcondaif you choose to use your existing Anaconda installation.Otherwise, follow the recommended installation instruction for Mamba.
Quick install
mamba (Windows/Linux/GPU):
mamba create -y -n sleap -c conda-forge -c nvidia -c sleap/label/dev -c sleap -c anaconda sleap=1.4.1
mamba (Mac):
mamba create -y -n sleap -c conda-forge -c anaconda -c sleap sleap=1.4.1
pip (any OS except Apple Silicon):
pip install sleap[pypi]==1.4.1
Highlights
- Add options to set background color when exporting video by @scott-yj-yang in #1328
- Add resize/scroll to training GUI by @KevinZ0217 in #1565
- Highlight instance box on hover by @talmo in #2055
- Enable touchpad pinch to zoom by @talmo in #2058
- Do not always color skeletons table black by @roomrys in #1952
- Make status bar dependent on UI mode by @7174Andy in #2063
- Graceful failing with seeking errors by @talmo in #1712
- Import DLC with uniquebodyparts, add Tracks by @getzze in #1562
- Fix GUI crash on scroll by @roomrys in #1883
Full Changelog
Enhancements
- Add options to set background color when exporting video by @scott-yj-yang in #1328
- Increase range on batch size by @roomrys in #1513
- Add resize/scroll to training GUI by @KevinZ0217 in #1565
- support loading slp files with non-compound types and str in metadata by @lambdaloop in #1566
- change inference pipeline option to tracking-only by @shrivaths16 in #1666
- Only propagate Transpose Tracks when propagate is checked by @vaibhavtrip29 in #1748
- Add batch size to GUI for inference by @shrivaths16 in #1771
- Add ZMQ support via GUI and CLI by @shrivaths16 in #1780
- Change menu name to match deleting predictions beyond max instance by @shrivaths16 in #1790
- Adding ragged metadata to
info.jsonby @shrivaths16 in #1765 - Add option to export to CSV via sleap-convert and API by @eberrigan in #1730
- Add
normalized_instance_similaritymethod by @gitttt-1234 in #1939 - Update installation docs 1.4.1 by @roomrys in #1810
- Option for Max Stride to be 128 by @MweinbergUmass in #1941
- Allow csv and text file support on sleap track by @emdavis02 in #1875
- Added Three Different Cases for Adding a New Instance by @7174Andy in #1859
- Generate suggestions using max point displacement threshold by @gqcpm in #1862
- Add object keypoint similarity method by @getzze in #1003
- Allowing inference on multiple videos via
sleap-trackby @emdavis02 in #1784 - Add
Keep visualizationscheckbox to training GUI by @hajin-park in #1824 - Menu option to open preferences directory and update to util functions to pathlib by @shrivaths16 in #1843
- Add tracking score as seekbar header options by @talmo in #2047
- Don't mark complete on instance scaling by @talmo in #2049
- Add check for instances with track assigned before training ID models by @talmo in #2053
- Add menu item for deleting instances beyond frame limit by @shrivaths16 in #1797
- Highlight instance box on hover by @talmo in #2055
- Make node marker and label sizes configurable via preferences by @talmo in #2057
- Enable touchpad pinch to zoom by @talmo in #2058
- Separate the video name and its filepath columns in
VideoTablesModelby @7174Andy in #2052 - Make status bar dependent on UI mode by @7174Andy in #2063
Fixes
- Graceful failing with seeking errors by @talmo in #1712
- Fix IndexError for hdf5 file import for single instance analysis files by @shrivaths16 in #1695
- Import DLC with uniquebodyparts, add Tracks by @getzze in #1562
- Make the hdf5 videos store as int8 format by @lambdaloop in #1559
- Scale new instances to new frame size by @ssrinath22 in #1568
- Fix package export by @talmo in #1619
- View Hyperparameter nonetype fix by @shrivaths16 in #1766
- Set selected instance to None after removal by @roomrys in #1808
- Fix zmq inference by @roomrys in #1800
- Remove no module named work error by @roomrys in #1956
- Use
tf.math.modinstead of%by @roomrys in #1931 - Do not always color skeletons table black by @roomrys in #1952
- Do not apply offset when double clicking a
PredictedInstanceby @roomrys in #1888 - Fix typo to allow rendering videos with mp4 (Mac) by @roomrys in #1892
- Fix GUI crash on scroll by @roomrys in #1883
- Handle case when no frame selection for trail overlay by @roomrys in #1832
- Fix COCO Dataset Loading for Invisible Keypoints by @felipe-parodi in #2035
- Fix import PySide2 -> qtpy by @talmo in #2065
Dependencies
- Replace imgaug with albumentations by @talmo in #1623
- Fix out of bounds albumentations issues and update dependencies by @eberrigan in #1724
- Update to new TensorFlow conda package by @eberrigan in #1726
- Fix conda builds by @eberrigan in #1776
- Handle skeleton encoding internally by @eberrigan in #1970
- Handle skeleton decoding internally by @roomrys in #1961
- Add imageio dependencies for pypi wheel by @roomrys in #1950
- Add missing imageio-ffmpeg to meta.ymls by @roomrys in #1943
- Manually handle
Instance.from_predictedstructuring when notNoneby @roomrys in #1930 - Refactor
LossViewerto use matplotlib by @eberrigan in #1899 - Replace all Video structuring with Video.cattr() by @roomrys in #1911
- Use positional argument for exception type by @roomrys in #1912
- Remove unsupported |= operand to prepare for PySide6 by @roomrys in #1910
- Replace QtDesktop widget in preparation for PySide6 by @roomrys in #1908
- Use | instead of + in key commands by @roomrys in #1907
- Use
Video.from_filenamewhen structuring videos by @roomrys in #1905 - Refactor video writer to use imageio instead of skvideo by @eberrigan in #1900
- Pin ndx-pose<0.2.0 by @talmo in #1978
Documentation
- Add bonsai guide for sleap docs by @croblesMed in #2050
- Add channels for pip conda env by @roomrys in #2067
Refactors
- Set default callable for
match_lists_functionby @roomrys in #1520 - Allow passing in
Labelstoapp.mainby @roomrys in #1524 - Replace (broken)
--unragwith--raggedby @roomrys in #1539 - Add function to create app by @roomrys in https://github.com/talmolab/s...
SLEAP v1.3.4
SLEAP 1.3.4 has no changes to the SLEAP source code, but adds constraints to the attrs and opencv versions being pulled in.
From 1.3.2+, to install SLEAP through pip use pip install sleap[pypi] to ensure all dependencies are gathered.
As a reminder:
The 1.3.1 dependency update requires Mamba for faster dependency resolution. If you already have anaconda installed, then you can set the solver to libmamba in the base environment:
conda update -n base conda conda install -n base conda-libmamba-solver conda config --set solver libmambaAny subsequent
mambacommands in the docs will need to be replaced withcondaif you choose to use your existing Anaconda installation.Otherwise, follow the recommended installation instruction for Mamba.
Quick install
mamba (Windows/Linux/GPU):
mamba create -y -n sleap -c conda-forge -c nvidia -c sleap -c anaconda sleap=1.3.4
mamba (Mac):
mamba create -y -n sleap -c conda-forge -c anaconda -c sleap sleap=1.3.4
pip (any OS except Apple Silicon):
pip install sleap[pypi]==1.3.4
Full Changelog
- Constrain attrs (mac) and opencv (linux) in 1.3.4 #1927
SLEAP v1.4.1a2
SLEAP v1.4.1a2 is a pre-release. See 1.3.3 for the latest stable release. The crucial change here is Fix zmq inference by @roomrys in #1800 since inference was not working in the pre-release v1.4.1a1 due to the addition of zmq port options for training in #1780 that were not being used for inference.
Quick install
mamba (Windows/Linux/GPU):
mamba create -y -n sleap_v1.4.1a2 -c conda-forge -c nvidia -c sleap/label/dev -c anaconda sleap=1.4.1a2
mamba (Mac):
mamba create -y -n sleap_v1.4.1a2 -c conda-forge -c anaconda -c sleap/label/dev sleap=1.4.1a2
pip (any OS except Apple Silicon):
pip install sleap[pypi]==1.4.1a2
What's Changed
Fixes
Workflow Changes
- Fix windows conda package upload and build ci by @eberrigan in #1792
- Bump to v1.4.1a2 by @eberrigan in #1835
Enhancements and Refactors
- Set selected instance to None after removal by @roomrys in #1808
- Add
InstancesListclass to handle backref toLabeledFrameby @roomrys in #1807
Full Changelog: v1.4.1a1...v1.4.1a2
SLEAP v1.4.1a1
SLEAP v1.4.1a1 is a pre-release. See 1.3.3 for the latest stable release. There are many changes to dependencies in this pre-release: if you are having installation issues with v1.3.3, you should try this version instead.
Quick install
mamba (Windows/Linux/GPU):
mamba create -y -n sleap_v1.4.1a1 -c conda-forge -c nvidia -c sleap/label/dev -c anaconda sleap=1.4.1a1
mamba (Mac):
mamba create -y -n sleap_v1.4.1a1 -c conda-forge -c anaconda -c sleap/label/dev sleap=1.4.1a1
pip (any OS except Apple Silicon):
pip install sleap[pypi]==1.4.1a1
What's Changed
Enhancements
- Add options to set background color when exporting video by @scott-yj-yang in #1328
- Increase range on batch size by @roomrys in #1513
- Add resize/scroll to training GUI by @KevinZ0217 in #1565
- support loading slp files with non-compound types and str in metadata by @lambdaloop in #1566
- change inference pipeline option to tracking-only by @shrivaths16 in #1666
- Only propagate Transpose Tracks when propagate is checked by @vaibhavtrip29 in #1748
- Add batch size to GUI for inference by @shrivaths16 in #1771
- Add ZMQ support via GUI and CLI by @shrivaths16 in #1780
- Change menu name to match deleting predictions beyond max instance by @shrivaths16 in #1790
- Adding ragged metadata to
info.jsonby @shrivaths16 in #1765 - Add option to export to CSV via sleap-convert and API by @eberrigan in #1730
Refactors
- Set default callable for
match_lists_functionby @roomrys in #1520 - Allow passing in
Labelstoapp.mainby @roomrys in #1524 - Replace (broken)
--unragwith--raggedby @roomrys in #1539 - Add function to create app by @roomrys in #1546
- Refactor
AddInstancecommand by @roomrys in #1561
Fixes
- Graceful failing with seeking errors by @talmo in #1712
- Fix IndexError for hdf5 file import for single instance analysis files by @shrivaths16 in #1695
- Import DLC with uniquebodyparts, add Tracks by @getzze in #1562
- Make the hdf5 videos store as int8 format by @lambdaloop in #1559
- Scale new instances to new frame size by @ssrinath22 in #1568
- Fix package export by @talmo in #1619
- View Hyperparameter nonetype fix by @shrivaths16 in #1766
Dependency Changes
- Replace imgaug with albumentations by @talmo in #1623
- Fix out of bounds albumentations issues and update dependencies by @eberrigan in #1724
- Update to new TensorFlow conda package by @eberrigan in #1726
- Fix conda builds by @eberrigan in #1776
Workflow Changes
- Fix CI on macosx-arm64 by @talmo in #1734
- Upgrade build actions for release by @eberrigan in #1779
- Fix website build and remove build cache across workflows by @eberrigan in #1786
- Bump to 1.4.1a1 by @eberrigan in #1791
Website Changes
New Contributors
- @scott-yj-yang made their first contribution in #1328
- @lambdaloop made their first contribution in #1559
- @ssrinath22 made their first contribution in #1568
Full Changelog: v1.3.3...v1.4.1a1