Skip to content

fix(sling): validate row count correctly for multi-file imports to Pr…#59

Merged
yokofly merged 2 commits intomainfrom
bugfix/issue-multi-file-ingestion-count
Dec 10, 2025
Merged

fix(sling): validate row count correctly for multi-file imports to Pr…#59
yokofly merged 2 commits intomainfrom
bugfix/issue-multi-file-ingestion-count

Conversation

@yokofly
Copy link
Copy Markdown
Collaborator

@yokofly yokofly commented Dec 10, 2025

…oton

  • Track initial table row count before inserting data to handle appending to existing tables
  • Update count validation logic to compare against (initial_count + stream_count) instead of just stream_count
  • Add debug logging to track initial count, stream count, expected count, and actual table count for troubleshooting
  • Fix issue where multi-file imports (e.g., folder of CSVs) would fail validation when appending to non-empty Proton tables

fix #58

…oton

- Track initial table row count before inserting data to handle appending to existing tables
- Update count validation logic to compare against (initial_count + stream_count) instead of just stream_count
- Add debug logging to track initial count, stream count, expected count, and actual table count for troubleshooting
- Fix issue where multi-file imports (e.g., folder of CSVs) would fail validation when appending to non-empty Proton tables
Error handling - Now properly handles the GetCount error instead of silently discarding it
gofmt style - Fixed the space indentation to tabs
@yokofly yokofly merged commit 3a6b091 into main Dec 10, 2025
@yokofly yokofly deleted the bugfix/issue-multi-file-ingestion-count branch December 10, 2025 06:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fatal error when inserting exported data back to db

1 participant