Skip to content

Enable workflows for remote inference#578

Merged
leszko merged 10 commits intomainfrom
mh/cloud-workflow
Mar 6, 2026
Merged

Enable workflows for remote inference#578
leszko merged 10 commits intomainfrom
mh/cloud-workflow

Conversation

@mjh1
Copy link
Copy Markdown
Contributor

@mjh1 mjh1 commented Mar 4, 2026

Proxy new API calls to cloud to enable new workflow import/export

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 4, 2026

🚀 fal.ai Preview Deployment

App ID daydream/scope-pr-578--preview
WebSocket wss://fal.run/daydream/scope-pr-578--preview/ws
Commit b4b5093

Testing

Connect to this preview deployment by running this on your branch:

uv run build && SCOPE_CLOUD_APP_ID="daydream/scope-pr-578--preview/ws" uv run daydream-scope

🧪 E2E tests will run automatically against this deployment.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 4, 2026

❌ E2E Tests failed

Status failed
fal App daydream/scope-pr-578--preview
Run View logs

Test Artifacts

Check the workflow run for screenshots, traces, and failure details.

@mjh1 mjh1 force-pushed the mh/cloud-workflow branch 3 times, most recently from 70d109c to 9c21411 Compare March 5, 2026 13:45
@mjh1 mjh1 marked this pull request as ready for review March 5, 2026 13:46
@mjh1 mjh1 requested a review from leszko March 5, 2026 13:46
mjh1 added 5 commits March 5, 2026 14:37
Signed-off-by: Max Holland <[email protected]>
Signed-off-by: Max Holland <[email protected]>
Signed-off-by: Max Holland <[email protected]>
Signed-off-by: Max Holland <[email protected]>
Signed-off-by: Max Holland <[email protected]>
@mjh1 mjh1 force-pushed the mh/cloud-workflow branch from 9c21411 to 5a4fc65 Compare March 5, 2026 14:37
mjh1 added 3 commits March 5, 2026 14:41
Signed-off-by: Max Holland <[email protected]>
Signed-off-by: Max Holland <[email protected]>
Signed-off-by: Max Holland <[email protected]>
@mjh1 mjh1 force-pushed the mh/cloud-workflow branch from 32f4ae7 to 40e6006 Compare March 5, 2026 16:01
echo "Deploying PR #${PR_NUMBER} to fal as ${APP_NAME}"

SCOPE_DEPLOY_TAG=$SHORT_SHA fal deploy \
fal deploy \
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tidied this up, it can just get the tag based on the checked out version itself

workflow: WorkflowRequest,
plugin_manager: PluginManager,
models_dir: Path,
lora_dir: Path,
Copy link
Copy Markdown
Contributor Author

@mjh1 mjh1 Mar 5, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in cloud we have loras stored separate to models so that they're not shared between users, so we need to use get_lora_dir() instead of models_dir / "lora"

lora_dir = get_lora_dir()
try:
return await download_lora(request, lora_dir)
return await download_lora(request, lora_dir, civitai_token=civitai_token)
Copy link
Copy Markdown
Contributor Author

@mjh1 mjh1 Mar 5, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ryanontheinside @leszko Not sure how you feel about doing it this way but in cloud mode I needed some way of passing the token from the user to the remote server, so it gets added to the request that gets proxied above in the if cloud_manager.is_connected: block, then it gets passed into download_lora here so that it can override get_civitai_token() on the remote side which will return nothing (we only store the api keys locally and send them along with the requests when they're proxied to remote).

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is good.

Signed-off-by: Max Holland <[email protected]>
@mjh1 mjh1 requested a review from ryanontheinside March 5, 2026 16:09
Co-Authored-By: Claude Opus 4.6 <[email protected]>
Signed-off-by: Rafał Leszko <[email protected]>
Copy link
Copy Markdown
Collaborator

@leszko leszko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pushed one small refactor. Other than that, LGTM.

@leszko leszko merged commit 3eb5df5 into main Mar 6, 2026
7 checks passed
@mjh1 mjh1 deleted the mh/cloud-workflow branch March 6, 2026 10:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants