Skip to content

Conversation

@hermanschaaf
Copy link
Member

This adds:

  • support for testing decimal types
  • support for testing maps (only string and int keys for now)
  • randomization for values based on a given seed. Because a seed is used, the tests are still 100% reproducible, but it allows us to test values closer to the min/max of integer ranges and gives us different keys to test in maps

I found at least 4 surprising bugs in the Elasticsearch implementation through this. Destinations that don't want to support these features right now can still opt to skip the types.

@hermanschaaf hermanschaaf requested a review from yevgenypats as a code owner May 25, 2023 14:19
@github-actions github-actions bot added the fix label May 25, 2023
@github-actions
Copy link

github-actions bot commented May 25, 2023

⏱️ Benchmark results

  • DefaultConcurrencyDFS-2 resources/s: 10,492
  • DefaultConcurrencyRoundRobin-2 resources/s: 11,129
  • Glob-2 ns/op: 269.3
  • TablesWithChildrenDFS-2 resources/s: 23,431
  • TablesWithChildrenRoundRobin-2 resources/s: 23,474
  • TablesWithRateLimitingDFS-2 resources/s: 28.33
  • TablesWithRateLimitingRoundRobin-2 resources/s: 812

@codecov
Copy link

codecov bot commented May 25, 2023

Codecov Report

Patch coverage: 21.81% and project coverage change: -0.06 ⚠️

Comparison is base (ada8994) 47.62% compared to head (828216a) 47.57%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #905      +/-   ##
==========================================
- Coverage   47.62%   47.57%   -0.06%     
==========================================
  Files          55       55              
  Lines        5134     5171      +37     
==========================================
+ Hits         2445     2460      +15     
- Misses       2426     2448      +22     
  Partials      263      263              
Impacted Files Coverage Δ
schema/testdata.go 44.17% <21.81%> (-0.40%) ⬇️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@hermanschaaf hermanschaaf changed the title fix: Even more thorough tests for Arrow types fix: Test Decimal type, map type and larger number ranges May 30, 2023
@github-actions github-actions bot added fix and removed fix labels May 30, 2023
@kodiakhq kodiakhq bot merged commit 9a3b4ad into main May 30, 2023
@kodiakhq kodiakhq bot deleted the test-more-types branch May 30, 2023 08:32
candiduslynx pushed a commit that referenced this pull request May 30, 2023
🤖 I have created a release *beep* *boop*
---


##
[3.7.0](v3.6.7...v3.7.0)
(2023-05-30)


### Features

* **test:** Add `AllowNull` option for test data
([#913](#913))
([9b911eb](9b911eb))


### Bug Fixes

* Test Decimal type, map type and larger number ranges
([#905](#905))
([9a3b4ad](9a3b4ad))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants