Releases · PeerDB-io/peerdb

@ilidemi

What’s Changed

Clean up SSH error classification (#4610) @ilidemi
PEERDB_MYSQL_IGNORE_MISSING_GTID (#4601) @serprex
Fix zombie snapshot flows after the process restarts; fix a rare conn leak (#4603) @ilidemi
fix: respect clickhouse max_query_size (#4593) @dtunikov
maria: classify compressed columns errors + add validation to create mirror (#4559) @dtunikov
feat: add source/destination/e2e commit lag metrics (#4573) @dtunikov
Validate PARTITION BY expression with fake virtual table and Dynamic type for all columns (#4599) @pfcoperez
fix clippy update regression (#4602) @serprex
bug: CDC Date clamping consistent with initial load limits (#4600) @pfcoperez
ui: support table removal in edit mirror, show source table in snapshot view (#4594) @serprex
Include rust builder in renovate, fix script on mac (#4590) @ilidemi
Heartbeat to Temporal more often (#4591) @ilidemi
qrep: derive pull columns from source instead of catalog schema (#4583) @dtunikov

@dtunikov

What’s Changed

fix(pg): set idle_session_timeout=0 for pg connections (#4589) @dtunikov
fix(pg): classify conn closed explicitly as user notify error (#4587) @dtunikov
classify error as retryable when pipe closed in deadlineCappableConn (#4567) @jgao54
support filtering out deletion operation types for mongo (#4585) @jgao54
fix mongo transient tls error (#4569) @jgao54
Update github-actions dependencies (#4577) @renovate[bot]
fix(mysql): gofumpt formatting in cdc.go (#4586) @dtunikov
Update dockerfile dependencies (#4576) @renovate[bot]
chore: de noise type change logs (#4581) @dtunikov
fix: Add test for gh-ost/backup binlog metadata path ADD COLUMN for all types (#4557) @masterashu
Re-order error classification for MySQLExecuteError (#4555) @jgao54
Remove checks on pinned versions (#4579) @pfcoperez
Renovate check and simulation CI workflow (#4578) @pfcoperez
add filter to force pruning for getTableSchemaForTable query (#4580) @dtunikov
fetch disk spill metrics for pg 14/15 as well (#4575) @jgao54
mongodb: fix leaked changestream cursor (#4565) @jgao54
handle retriable ssh dial error (#4570) @jgao54
handle clickhouse znode error (#4568) @jgao54
gcs: add error classification (#4566) @jgao54
handle incomplete read of msg header transient error (#4571) @jgao54
classify neon transient error (#4563) @jgao54
.github: Fix deprecated workflow (#4574) @Jeremyyang920
DBI-798: Safer check on mirror validation with MySQL sources setting server_id (#4564) @pfcoperez
fix(ui): fix schema prefixing (#4562) @Amogh-Bharadwaj
fix(pg-pg): better tls wiring for pgdump command (#4540) @Amogh-Bharadwaj
feat: upgrade docker-compose.yml stable image tags (#4558) @github-actions[bot]
feat(api): add endpoint for pg-pg source and destination row count check (#4556) @Amogh-Bharadwaj
fix(mysql): pull INVISIBLE/GIPK columns during snapshot (#4553) @dtunikov
fix(mysql): consistent SET column replication between snapshot and cdc (#4551) @dtunikov
fix(mysql): align JSON representation between snapshot and CDC (#4535) @dtunikov
Renovate simulation script (#4548) @pfcoperez
address partition overflow bug (#4550) @jgao54

@dtunikov

What’s Changed

fix(tests): update peer config to avoid using stale config from previous local run (#4552) @dtunikov
fix: Add tests for non-pk table cdc works in append-only mode with Merge Tree (#4520) @masterashu
maria: require resync on partial row events (#4530) @dtunikov
mongoDB parallel snapshot follow-up (#4531) @jgao54
fix(mysql): fail fast on partial JSON binlog events (PARTIAL_JSON) (#4538) @dtunikov
Pin go-mysql digest as well (#4547) @ilidemi
clickhouse: fix date overflow for initial load (#4534) @dtunikov
fix(mysql): classify event checksum error (#4537) @dtunikov
fix(mysql): handle commit for non transactional mysql engines (#4539) @dtunikov
Update github-actions dependencies (#4542) @renovate[bot]
Make MySQL binlog staleness threshold configurable (#4453) @ilidemi
Enable mTLS for PG sources (#4468) @pfcoperez
Update gomod dependencies (#4545) @renovate[bot]
Update mysql Docker tag to v9.7.1 (#4543) @renovate[bot]
Update temporalio/ui Docker tag to v2.51.1 (#4544) @renovate[bot]
Deprecate non-ClickHouse / non-Postgres destination connectors (#4491) @Jeremyyang920
feat(ci): Last CI step checking for non-exercised tests (#4533) @pfcoperez
Lock file maintenance (#4536) @renovate[bot]
add clickhouse cluster in local tilt (#4527) @masterashu
fix(mysql): use gtid_binlog_pos for MariaDB CDC start position (#4523) @dtunikov
feat(mysql): add counter metric for parseSQL errors (#4498) @dtunikov
Workflow to tag flow-api-client versions (#4532) @pfcoperez
[DBI-798] MySQL Connector: Allow passing server_id as a peer configuration parameter (#4525) @pfcoperez
add more mysql/maria column type tests and support uuid/inet types (#4505) @dtunikov
Update gomod dependencies (#4399) @renovate[bot]
DBI-609: Add IAM auth support for CDC pipes with AWS Auruora' (#4495) @masterashu
mongo: partition snapshots for numeric and string _id collections (#4487) @andreyzhelnin-st
treat string partition ranges as sensitive data (#4501) @jgao54
fix: PG<15 fallback parameters (#4473) (#4509) @alikonhz
Fix e2e table schema asserts (#4506) @ilidemi
Classify CH access denied (#4528) @ilidemi
Fix claude review on fork PRs (#4502) @ilidemi
LogFlowError on mysql ConnectionActive failure (#4521) @serprex
Separate MySQL and MariaDB tests (#4517) @ilidemi
Disable PG CDC store for CH destinations by default (#4515) @ilidemi
Update dockerfile dependencies (#4514) @renovate[bot]
Constrain mysql-debug Renovate updates (#4512) @ilidemi
Lock file maintenance (#4420) @renovate[bot]
Update github-actions dependencies (#4511) @renovate[bot]
Add tag to support propagating pipe name (#4508) @jgao54
Add a user-facing log when processing large txn (#4500) @jgao54
error classification: add error code 192 (#4507) @jgao54
[DBI-829] Extended GTID e2e and UTs (#4493) @pfcoperez
Optimize encoding maps (#4494) @ilidemi
add online_schema_migrations metric (#4497) @dtunikov
Dedup sourcePeerType (#4499) @ilidemi
Support ANSI_QUOTES in MySQL/MariaDB DDL (#4452) @ilidemi
fix(mysql): handle transaction payload event (#4433) @dtunikov
observe mysql/postgres column type changes (#4488) @dtunikov

What’s Changed

Disable Postgres CDC store by default for ClickHouse destinations (commit)

@jgao54

What’s Changed

support parallel snapshotting for uuid partitioning (#4482) @jgao54
dbi 604 handle replication slot creation getting stuck (#4439) @masterashu
Decode BINARY(N) as Bytes on the binlog-metadata add-column path (#4457) @ilidemi
fix(clickhouse): drop orphaned shard table after mirror resync exchange (#4490) @andreyzhelnin-st
Support MariaDB VECTOR during CDC (#4454) @ilidemi
Update docker-compose dependencies (#4469) @renovate[bot]
Remove SNS and telemetry sender infra (#4492) @ilidemi
Support null-terminated strings in MySQL DDL (#4459) @ilidemi
Handle error cases from parsing filepos (#4462) @ilidemi
Remove incident.io telemetry (#4481) @ilidemi
fix(flowable): do not gate pg dest logic by pg source (#4483) @Amogh-Bharadwaj
Tilt environment: Fix ClickHouse docker image selection (#4486) @pfcoperez

@dtunikov

What’s Changed

ci: drive stable Docker/deploy builds off release publish (#4484) @dtunikov
mysql: transcode non-utf8 string/ENUM/SET columns to UTF-8 on CDC path (#4436) @dtunikov
Tilt flow: e2e test run using gotestsum outside Tilt (#4477) @pfcoperez
[DBI-829] CI e2e testing: Support different MariaDB versions and parameters (#4478) @pfcoperez
Update github-actions dependencies (#4471) @renovate[bot]
Log a warning when a replica idenity column changes (#4480) @ilidemi
support default primary key detection for mysql for int/temporal types (#4440) @jgao54
feat(mysql): introduce a testcontainer for binlog incident event (#4442) @ilidemi
fix(pg): filter by flow name in IsQRepPartitionSynced (#4479) @Amogh-Bharadwaj
Initial attempt to run Tilt environment in CI (#4474) @pfcoperez
feat(tilt): Add setup peerdb peers in Tilt (#4444) @masterashu
Explicitly specify PG client protocol (#4467) @pfcoperez

@masterashu

What’s Changed

feat(tilt): Add setup peerdb peers in Tilt (#4444) @masterashu
Explicitly specify PG client protocol (#4467) @pfcoperez
fix(clickhouse): add opt-out for staging cleanup after QRep flow (#4466) @dtunikov
Classify mid-CDC SSH tunnel failures as connectivity errors (#4443) @dtunikov
Fix lint issue on main (#4446) @ilidemi
[DBI-855] MySQL connector: Use binlog event type and meta to determine BINARY(N) actual length and padding (#4445) @pfcoperez
feat: upgrade docker-compose.yml stable image tags (#4421) @github-actions[bot]
fix(mysql): handle binlog incident event (resync required) (#4435) @dtunikov
Build a MySQL debug image (#4441) @ilidemi
Add a config to disable CDC store for ClickHouse (#4438) @ilidemi
Update github-actions dependencies (#4431) @renovate[bot]
Update dockerfile dependencies (#4427) @renovate[bot]
fix(clickhouse): keep IAM-role S3 test TTL within toDateTime range (#4434) @dtunikov

@dtunikov

What’s Changed

fix(clickhouse): add opt-out for staging cleanup after QRep flow (#4466) @dtunikov
Classify mid-CDC SSH tunnel failures as connectivity errors (#4443) @dtunikov
Fix lint issue on main (#4446) @ilidemi
[DBI-855] MySQL connector: Use binlog event type and meta to determine BINARY(N) actual length and padding (#4445) @pfcoperez
feat: upgrade docker-compose.yml stable image tags (#4421) @github-actions[bot]
fix(mysql): handle binlog incident event (resync required) (#4435) @dtunikov
Build a MySQL debug image (#4441) @ilidemi
Add a config to disable CDC store for ClickHouse (#4438) @ilidemi
Update github-actions dependencies (#4431) @renovate[bot]
Update dockerfile dependencies (#4427) @renovate[bot]
fix(clickhouse): keep IAM-role S3 test TTL within toDateTime range (#4434) @dtunikov
Update npm dependencies to ^0.45.0 (#4429) @renovate[bot]
Update github-actions dependencies (#4428) @renovate[bot]
fix(clickhouse): wrap raw table TTL expression in toDateTime for backward compatibility (#4412) (#4425) @jagannalla
Update docker-compose dependencies (#4426) @renovate[bot]
fix(clickhouse): fix avro substream send (#4422) @Amogh-Bharadwaj
mysql: convert BIT to UInt64 in binary type path for new mirrors (#4423) @dtunikov
mysql: fix invalid sequence number error (#4424) @dtunikov

@dtunikov

What’s Changed

feat(alerting): classify MySQL 1236 max_allowed_packet errors separately (#4417) @dtunikov
npm update, cargo update (#4419) @serprex
Classify deadlock avoided for CH ALTER as recoverable (#4418) @ilidemi
mysql: add syncer.EventCacheCount setting (#4413) @dtunikov
Edit Mirror: don't strip shared destination on table removal (#4414) @serprex
PG: clean up replication pings, unify wal_sender_timeout handling (#4363) @ilidemi
Classify PG could not rename snapshot file error (#4407) @ilidemi
Remove double-log during resync (#4410) @ilidemi
Use unique staging paths for BigQuery source (#4411) @ilidemi
hotpath optimization for AddRecord (#4415) @jgao54
restore async replication connection keepalive when PullRecords is not active (#4405) @jgao54
Validate CH DB engine (#4408) @ilidemi
Update dockerfile dependencies (#4397) @renovate[bot]
fix(ci): isolate dev docker PR builds from secrets (#4385) @Jeremyyang920
Slack scrub auth token in UI (#4391) @ilidemi
use "as binary" conversion to join info schema tables to resolve any collation issues (#4406) @dtunikov
add skip_validation flag to create cdc flow request (#4403) @dtunikov
use exact count when estimates fail (#4393) @jgao54
always ping on timeout (#4404) @jgao54
MongoDB connector: Add skip_cert_verification parameter to Peer Configuration (#4396) @pfcoperez
Update docker-compose dependencies to v2.50.0 (#4400) @renovate[bot]
Update github-actions dependencies (#4398) @renovate[bot]
Disable fieldalignment for test files (#4390) @ilidemi
Teach Claude CIDB (#4392) @ilidemi
Lock file maintenance (#4394) @renovate[bot]
Make PG SkipCertVerification take effect in PG-PG PGdump (#4395) @pfcoperez
DBI-782: PG Connector TLS settings unification (#4388) @pfcoperez
Clean up NoDeadlineConn (#4389) @ilidemi
fix: emit Slack alert members as <@userid> mentions (#4386) @kang8
Ensure ssh honors context deadlines (#4380) @jgao54
feat: upgrade docker-compose.yml stable image tags (#4384) @github-actions[bot]

@dtunikov

What’s Changed

add 'log_replica_updates' validation for mysql replica sources (#4371) @dtunikov
validation: classify error encountered during NeonWALPageRead (#4383) @jgao54
validation: add validation to block Yugabyte (#4382) @jgao54

Uh oh!

Releases: PeerDB-io/peerdb

Release list

v0.37.2

What’s Changed

Contributors

Uh oh!

v0.37.1

What’s Changed

Contributors

Uh oh!

v0.37.0

What’s Changed

Contributors

Uh oh!

v0.36.32

What’s Changed

Uh oh!

v0.36.31

What’s Changed

Contributors

Uh oh!

v0.36.30

What’s Changed

Contributors

Uh oh!

v0.36.29

What’s Changed

Contributors

Uh oh!

v0.36.28

What’s Changed

Contributors

Uh oh!

v0.36.27

What’s Changed

Contributors

Uh oh!

v0.36.26

What’s Changed

Contributors

Uh oh!