Feat/new model manager by grzegorz-roboflow · Pull Request #2251 · roboflow/inference

grzegorz-roboflow · 2026-04-21T14:33:00Z

What does this PR do?

Adding inference_model_manager

Type of Change

New feature (non-breaking change that adds functionality)

Testing

Initial suit of tests added

Checklist

My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code where necessary, particularly in hard-to-understand areas
My changes generate no new warnings or errors
I have updated the documentation accordingly (if applicable)

Additional Context

N/A

socket-security · 2026-05-12T17:30:09Z

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	pypi/pypdfium2@4.30.1
	pypi/easydict@1.13
	pypi/igraph@1.0.0
	pypi/onnxruntime-openvino@1.21.0
	pypi/opencv-contrib-python@4.12.0.88
	pypi/pyinstaller@6.22.3
	pypi/pymeshfix@0.18.1
	pypi/ultralytics@8.3.40
	pypi/opencv-python@4.10.0.84
	pypi/opencv-python@4.12.0.88
	pypi/orjson@3.13.0
	pypi/pynvvideocodec@2.1.0
	pypi/flash-attn@2.7.4.post1
	pypi/onnxruntime-gpu@1.29.0
	pypi/skypilot@0.8.0
	pypi/flash-attn@2.8.3.post1
	pypi/matplotlib@3.7.1
	pypi/roboflow-workflows@0.2.4rc3 ⏵ 0.2.11rc1
	pypi/astor@0.8.1
	pypi/elasticache-auto-discovery@1.0.0
	pypi/fastapi-cprofile@0.0.2
	pypi/pandas@2.0.2
	pypi/modal@1.6.2
	pypi/zensical@0.0.33
	pypi/wheel@0.45.1
	pypi/pillow-simd@12.1.1.post0
	pypi/spconv-cu121@2.3.8
	pypi/pillow@13.0.0
	pypi/dill@0.3.8
	pypi/cython@3.0.12
	pypi/diffusers@0.41.0
	pypi/xatlas@0.0.11
	pypi/rasterio@1.4.4
See 79 more rows in the dashboard

View full report

dkosowski87

1/6 with the pace I'm currently at ;)

socket-security · 2026-06-22T17:48:34Z

Warning

Review the following alerts detected in dependencies.

According to your organization's Security Policy, it is recommended to resolve "Warn" alerts. Learn more about Socket for GitHub.

Priority	Alert (click "▶" to expand/collapse)	Action
	Obfuscated code: pypi `openexr` is 72.0% likely obfuscated Confidence: 0.72 Location: Package overview From: requirements/requirements.sam3_3d.txt → `pypi/[email protected]` ℹ Read more on: This package \| This alert \| What is obfuscated code? Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at `[email protected]`. Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code. Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment `@SocketSecurity ignore pypi/[email protected]`. You can also ignore all packages with `@SocketSecurity ignore-all`. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.	Warn

View full report

…e payload helpers

…falling back to other backends

… entries under Unreleased

…nnxruntime install

…d roboflow-workflows 0.2.11rc1

github-actions · 2026-10-17T09:19:50Z

👋 Thanks for the pull request! Here is how automated Claude review works here, so you spend credits (and reviewer time) wisely.

🚦 This PR is marked Ready for review, so automated Claude review will run — and every pass spends real credits.

Warning

💸 The Claude reviewer bills in credits, not vibes

Automated review spins up a real agent that reads real code and spends real credits on every pass. It is glad to help — but it is not a rubber duck, a linter you poke in a loop, or a substitute for reading the contributing guide. Treat it like an expensive senior reviewer whose time you booked, and show up prepared.

Draft when unsure, Ready when you mean it:

🌱 Not sure the PR is in good shape yet? Keep it (or set it back) as a draft — drafts pause review, so you can push and iterate without burning credits on a moving target.
💪 Feel strong about the contents? Mark it Ready for review and the reviewer will take a look.

However you get there, arrive prepared:

🧱 Bring a SOLID, thorough PR. Point your local agent at our skills/ to tune it to our guidelines first — or, if you are one of those fabled carbon-based contributors, read them yourself. A half-baked diff costs exactly the same to review as a finished one.
✅ Resolve every comment before you re-request review. Re-requesting with threads still open means paying twice for the same conversation.
🔁 Do not use CI review as an inner loop for a local agent. The reviewer is not a step-by-step debugger — do the unfolding locally and arrive with the answer, not the search.
🙋 If something looks off, ask a human. One question to a maintainer is cheaper and faster than three rounds of agent re-review chasing a misread.

Reviews are not free. A draft costs nothing to review; a Ready PR is a promise that it is worth reviewing.

Prefer to skip automated review entirely? Add the skip-claude-review label.

github-actions · 2026-10-17T09:20:13Z

🤖 Claude review started at commit a6de2493a3e1a2fc438634ee3e8bcc22c1614c88.

New commits are not auto-reviewed. Add the claude-review label to request a re-review — the label is consumed when the review starts, so just add it again next time.

… serving image

github-advanced-security Bot found potential problems Apr 21, 2026

View reviewed changes

Comment thread inference_server/inference_server/app.py Fixed

github-advanced-security Bot found potential problems Apr 21, 2026

View reviewed changes

github-advanced-security Bot found potential problems Apr 22, 2026

View reviewed changes

Comment thread inference_server/inference_server/server.py Fixed

Comment thread inference_server/inference_server/server.py Fixed

grzegorz-roboflow force-pushed the feat/new-model-manager branch from b0de01d to c27b669 Compare April 22, 2026 22:05

github-advanced-security Bot found potential problems Apr 23, 2026

View reviewed changes

Comment thread inference_server/inference_server/auth.py Fixed