Skip to content

Fix default image on runpod and vllm execution as well#1438

Merged
deep1401 merged 5 commits intomainfrom
fix/default-image-runpod
Mar 3, 2026
Merged

Fix default image on runpod and vllm execution as well#1438
deep1401 merged 5 commits intomainfrom
fix/default-image-runpod

Conversation

@deep1401
Copy link
Copy Markdown
Member

@deep1401 deep1401 commented Mar 3, 2026

  • This fixes a bug with vllm where versions < 0.13 dont work

@sentry
Copy link
Copy Markdown

sentry bot commented Mar 3, 2026

Codecov Report

❌ Patch coverage is 0% with 1 line in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
api/transformerlab/compute_providers/runpod.py 0.00% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

@paragon-review
Copy link
Copy Markdown

paragon-review bot commented Mar 3, 2026

Paragon Summary

This pull request review identified 1 issue across 1 category in 2 files. The review analyzed code changes, potential bugs, security vulnerabilities, performance issues, and code quality concerns using automated analysis tools.

This PR fixes a compatibility bug where vLLM versions earlier than 0.13 failed to work properly on RunPod, correcting the default image configuration for vLLM execution.

Key changes:

  • Fixes vLLM compatibility bug for versions < 0.13
  • Updates default image configuration on RunPod compute provider
  • Modifies runpod.py compute provider implementation
  • Updates interactive-gallery.json configuration

Confidence score: 3/5

  • This PR has moderate risk due to 1 high-priority issue that should be addressed
  • Score reflects significant bugs, performance issues, or architectural concerns
  • Review high-priority findings carefully before merging

2 files reviewed, 1 comment

Severity breakdown: High: 1


Tip: @paragon-run <instructions> to chat with our agent or push fixes!

Dashboard


# Use GPU-enabled image
default_image = "runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04"
default_image = "runpod/pytorch:1.0.3-cu1281-torch290-ubuntu2204"
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bug: Docker image tag does not exist on Docker Hub

Docker image tag does not exist on Docker Hub. GPU pod launches will fail for all users. Verify tag exists or use a valid one like 1.0.3-cu1290-torch290-ubuntu2204.

View Details

Location: api/transformerlab/compute_providers/runpod.py (lines 356)

Analysis

Docker image tag does not exist on Docker Hub. GPU pod launches will fail for all users

What fails RunPod GPU pod creation fails because the Docker image tag runpod/pytorch:1.0.3-cu1281-torch290-ubuntu2204 does not exist on Docker Hub.
Result Pod fails to create with an image-not-found error because cu1281 variant only exists under v1.0.2, not v1.0.3.
Expected Pod should launch successfully using a valid, published Docker image tag.
Impact Complete regression of the RunPod GPU pod launch feature — every user without a custom template_id is affected.
How to reproduce
1. Launch a RunPod GPU pod without a custom template_id so it hits the default_image fallback.
2. Observe pod creation error due to image-not-found.
Patch Details
-            default_image = "runpod/pytorch:1.0.3-cu1281-torch290-ubuntu2204"
+            default_image = "runpod/pytorch:1.0.3-cu1290-torch290-ubuntu2204"
AI Fix Prompt
Fix this issue: Docker image tag does not exist on Docker Hub. GPU pod launches will fail for all users. Verify tag exists or use a valid one like 1.0.3-cu1290-torch290-ubuntu2204.

Location: api/transformerlab/compute_providers/runpod.py (lines 356)
Problem: RunPod GPU pod creation fails because the Docker image tag runpod/pytorch:1.0.3-cu1281-torch290-ubuntu2204 does not exist on Docker Hub.
Current behavior: Pod fails to create with an image-not-found error because cu1281 variant only exists under v1.0.2, not v1.0.3.
Expected: Pod should launch successfully using a valid, published Docker image tag.
Steps to reproduce: 1. Launch a RunPod GPU pod without a custom template_id so it hits the default_image fallback.
2. Observe pod creation error due to image-not-found.

Provide a code fix.


Tip: Reply with @paragon-run to automatically fix this issue

@deep1401 deep1401 merged commit c0d27ac into main Mar 3, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants