Skip to content

fix: make onboarding not loop when error occurs in ingestion, fix double tasks for OpenRAG docs#1244

Merged
lucaseduoli merged 7 commits into
release-0.4.0from
fix/onboarding_failed
Mar 24, 2026
Merged

fix: make onboarding not loop when error occurs in ingestion, fix double tasks for OpenRAG docs#1244
lucaseduoli merged 7 commits into
release-0.4.0from
fix/onboarding_failed

Conversation

@lucaseduoli

Copy link
Copy Markdown
Collaborator

This pull request introduces significant improvements to the onboarding rollback process and document ingestion logic, with a focus on enhanced cleanup, configurability, and consistency in connector types. The main changes include allowing partial rollback of onboarding (embedding-only), ensuring knowledge filters are cleaned up during rollback, purging tasks more thoroughly, and standardizing connector types for document ingestion tasks. Additionally, the ingestion pipeline now consistently returns task IDs and supports reusing existing tasks.

Onboarding Rollback Improvements:

  • Added support for partial onboarding rollback (embedding-only) by introducing an embedding_only parameter in both the frontend (RollbackParams) and backend (RollbackBody), allowing users to roll back only the embedding step without resetting all onboarding progress. [1] [2] [3]
  • Enhanced backend rollback logic to clean up knowledge filters created during onboarding and to fully purge tasks from memory for both authenticated and anonymous users, improving system hygiene and preventing stale data. [1] [2]

Frontend Integration:

  • Updated all calls to the rollback mutation in the onboarding UI to pass the embedding_only flag, ensuring the correct rollback mode is triggered based on user context. [1] [2]

Document Ingestion Pipeline Enhancements:

  • Refactored ingestion functions to consistently return task IDs, enabling better tracking and chaining of ingestion steps. Added support for passing existing_task_id through the pipeline to reuse tasks when appropriate. [1] [2] [3] [4] [5] [6] [7] [8]
  • Standardized the connector_type used for document ingestion tasks to "openrag_docs" instead of "system_default" or "local", improving traceability and consistency across different ingestion methods. [1] [2] [3] [4] [5]

Other Improvements:

  • Minor UI logic fixes and code formatting for onboarding steps and error handling.
  • Ensured that error toasts for failed tasks are only shown if onboarding is not active, preventing redundant or confusing notifications.

These changes collectively make the onboarding and document ingestion flows more robust, maintainable, and user-friendly.

Closes #1243

@lucaseduoli lucaseduoli self-assigned this Mar 24, 2026
@github-actions github-actions Bot added frontend 🟨 Issues related to the UI/UX backend 🔷 Issues related to backend services (OpenSearch, Langflow, APIs) bug 🔴 Something isn't working. labels Mar 24, 2026
@lucaseduoli lucaseduoli linked an issue Mar 24, 2026 that may be closed by this pull request
2 tasks

@mfortman11 mfortman11 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did the trick 👍

@github-actions github-actions Bot added the lgtm label Mar 24, 2026
@lucaseduoli lucaseduoli merged commit 611b03c into release-0.4.0 Mar 24, 2026
9 checks passed
@github-actions github-actions Bot deleted the fix/onboarding_failed branch March 24, 2026 20:54
@mpawlow mpawlow removed their request for review March 24, 2026 21:01
lucaseduoli added a commit that referenced this pull request Mar 24, 2026
…ble tasks for OpenRAG docs (#1244)

* Fixed default docs being ingested in separate tasks

* Added embedding_only prop to only rollback what is needed

* fix tasks menu opening when an error occurs in onboarding

* Clean tasks, filters and etc on onboarding

* Fixed URL docs not being ingested with right type

* Fixed default openrag docs being ingested along with URL docs

* Fix delete knowledge on onboarding rollback
lucaseduoli added a commit that referenced this pull request Mar 24, 2026
…ble tasks for OpenRAG docs (#1244) (#1248)

* Fixed default docs being ingested in separate tasks

* Added embedding_only prop to only rollback what is needed

* fix tasks menu opening when an error occurs in onboarding

* Clean tasks, filters and etc on onboarding

* Fixed URL docs not being ingested with right type

* Fixed default openrag docs being ingested along with URL docs

* Fix delete knowledge on onboarding rollback
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend 🔷 Issues related to backend services (OpenSearch, Langflow, APIs) bug 🔴 Something isn't working. frontend 🟨 Issues related to the UI/UX lgtm

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Onboarding loops when an error occurs when ingesting

2 participants