Commits on Jun 4, 2026

1. feat: positional file arguments and multi-file joins (#162) …

   * feat: positional file arguments and multi-file joins (#155)
   
   Accept files as positional arguments. Each file becomes a table named
   after its basename (sans extension). Stdin remains table t.
   
   Examples:
     sql-pipe orders.csv 'SELECT * FROM orders WHERE amount > 100'
     sql-pipe orders.csv customers.csv 'SELECT ... FROM orders o JOIN customers c ...'
     cat events.csv | sql-pipe users.csv 'SELECT * FROM t JOIN users ON ...'
   
   Changes:
   - format.zig: Add InputFormat.fromExtension() for auto-detection
   - sqlite.zig: Parameterize createTable/prepareInsertStmt with table name
   - args.zig: Add FileInput struct, file-vs-query disambiguation, -- separator
   - loader.zig: Accept table_name and file_path parameters
   - json.zig/xml.zig: Parameterize loaders with table_name
   - main.zig: Orchestrate multi-file loading with poll()-based stdin detection
   - build.zig: Add integration tests 155a-155i
   - README.md, docs/sql-pipe.1.scd: Document file arguments
   
   * test: add fixture-based integration tests
   
   Add sample fixture files (CSV, JSON, NDJSON, XML) in tests/fixtures/
   and a new 'fixture-test' build step that exercises the binary end-to-end
   with realistic data across all supported formats.
   
   Tests cover:
   - CSV file arguments (basic queries, type inference, date functions)
   - Multi-file CSV joins
   - JSON/NDJSON/XML file arguments with auto-detection
   - Stdin + file argument mixing
   - --columns, --validate, --sample with fixture data
   - JSON output, --header, --output modes
   
   Run with: zig build fixture-test
   
   * chore: wire fixture-test into test step so CI runs it automatically
   
   * fix: improve stdin detection and empty input handling
   
   - Use std.Io.File.isTty() for cross-platform stdin detection
   - Loaders return 0 on empty input to handle /dev/null gracefully
   - main.zig checks if we have any data and fails if not
   - Updated AGENTS.md with stdin detection pitfalls
   
   Known issue: CI tests with file arguments fail when stdin is /dev/null.
   Needs further work to distinguish 'no input' from 'header-only input'.
   
   * fix: handle empty input gracefully in CI environments
   
   - Loaders now return 0 rows on empty input instead of calling fatal()
   - Removed empty input check from main.zig
   - Empty input results in 'no such table' error when querying, which is
     the expected SQLite behavior
   - Updated tests 56 and 107 to expect 'no such table' error instead of
     'empty input' error
   - Fixes CI failures where stdin is /dev/null (not a TTY but no data)
   - All 194 integration tests and unit tests pass
   
   * fix: address PR review feedback - TOCTOU, empty files, duplicate tables, special modes, test coverage
   
   Fix all blockers from PR #162 review:
   
   - Remove isReadableFile() TOCTOU race (args.zig): let loaders handle open errors
   - Add DuplicateTableName detection with clear error message (args.zig)
   - Add empty input file check with explicit error (main.zig)
   - Fix special modes (--columns, --validate, --sample) to accept file arguments
     instead of always reading stdin (modes/columns.zig, modes/validate.zig,
     modes/sample.zig)
   - Unify file handling: loadCsvInput now takes a reader like all other loaders
     (loader.zig, main.zig)
   - Use appendQuotedId consistently in all table_name quoting (sqlite.zig)
   - Remove dead delimiter field from FileInput struct (args.zig)
   - Update outdated comments referencing hardcoded table t (main.zig, loader.zig)
   - Fix dead fixture test 13 (referenced non-existent products.csv)
   - Fix fixture numbering duplication
   - Add fixture tests 21-23 for special modes with file arguments
   - Update existing integration tests for new error messages (build.zig)
   
   * fix: detect t.csv/stdin collision and remove dead InvalidFileArgument code

   

   vmvarela authored Jun 4, 2026
   Configuration menu

   • View commit details
   • Copy full SHA for a67bf1c
   • Browse repository at this point

   Copy the full SHA

   a67bf1c View commit details

   Browse the repository at this point in the history