Skip to content

feat(providers): add keyless Firecrawl scrape support#32

Merged
vincentkoc merged 1 commit into
mainfrom
feat/firecrawl-keyless-mode
Jun 18, 2026
Merged

feat(providers): add keyless Firecrawl scrape support#32
vincentkoc merged 1 commit into
mainfrom
feat/firecrawl-keyless-mode

Conversation

@vincentkoc

Copy link
Copy Markdown
Member

Summary

  • Adds Firecrawl as a manifest-driven web.scrape provider.
  • Supports Firecrawl starter access without a configured API key, while injecting FIRECRAWL_API_KEY when set for higher limits.
  • Adds provider readiness, smoke-plan coverage, fixtures, docs, and a catalog icon.

Verification

  • cargo test --workspace
  • pnpm test:scripts
  • pnpm provider:smoke-plan
  • cargo fmt --all -- --check
  • cargo clippy --workspace --all-targets -- -D warnings
  • cargo build -p clawrouter-edge --target wasm32-unknown-unknown
  • Live unauthenticated POST /v2/scrape returned 200 with success: true.

Deployment

  • Not deployed; the manifest is bundled into the Worker on the next deploy.

Risk

  • Firecrawl's generated API reference still marks auth required, while current feature documentation and the live endpoint support starter keyless scrape access. Upstream free-tier limits remain authoritative.

@vincentkoc
vincentkoc marked this pull request as ready for review June 18, 2026 09:42
@vincentkoc
vincentkoc merged commit 80344cf into main Jun 18, 2026
6 checks passed
@vincentkoc
vincentkoc deleted the feat/firecrawl-keyless-mode branch June 18, 2026 09:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant