Skip to content

Conversation

@shimonp21
Copy link
Contributor

@shimonp21 shimonp21 commented Dec 26, 2022

Closes cloudquery/cloudquery#5255 after we upgrade the sdk's in the dest-plugins

Summary

BEGIN_COMMIT_OVERRIDE
fix: Handle null bytes in text fields
END_COMMIT_OVERRIDE


Use the following steps to ensure your PR is ready to be reviewed

  • Read the contribution guidelines 🧑‍🎓
  • Run go fmt to format your code 🖊
  • Lint your changes via golangci-lint run 🚨 (install golangci-lint here)
  • Update or add tests 🧪
  • Ensure the status checks below are successful ✅

@shimonp21 shimonp21 marked this pull request as ready for review December 26, 2022 09:51
@github-actions github-actions bot added the test label Dec 26, 2022
Copy link
Member

@erezrokah erezrokah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good but is there anything else we should string? Not sure 🙃

@github-actions
Copy link

github-actions bot commented Dec 26, 2022

⏱️ Benchmark results

  • DefaultConcurrencyDFS-2 resources/s: 11,599
  • DefaultConcurrencyRoundRobin-2 resources/s: 12,251
  • Glob-2 ns/op: 181.9
  • TablesWithChildrenDFS-2 resources/s: 29,332
  • TablesWithChildrenRoundRobin-2 resources/s: 29,951
  • TablesWithRateLimitingDFS-2 resources/s: 28.45
  • TablesWithRateLimitingRoundRobin-2 resources/s: 839.5
  • BufferedScanner-2 ns/op: 9.296
  • LogReader-2 ns/op: 31.15

@shimonp21 shimonp21 changed the title test: Add null-in-test-field test test: Add null-in-text-field test Dec 26, 2022
@github-actions github-actions bot added test and removed test labels Dec 26, 2022
Copy link
Contributor

@yevgenypats yevgenypats left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe worth live discussion as don't understand the whole context but

return dst.Status == s.Status && strings.ReplaceAll(dst.Str, "\x00", "") == strings.ReplaceAll(s.Str, "\x00", "") seems a line that can cause issues in the future.

@codecov-commenter
Copy link

Codecov Report

Base: 47.15% // Head: 47.19% // Increases project coverage by +0.04% 🎉

Coverage data is based on head (5d970fd) compared to base (417c99d).
Patch coverage: 80.00% of modified lines in pull request are covered.

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #532      +/-   ##
==========================================
+ Coverage   47.15%   47.19%   +0.04%     
==========================================
  Files          70       70              
  Lines        6721     6727       +6     
==========================================
+ Hits         3169     3175       +6     
  Misses       3106     3106              
  Partials      446      446              
Impacted Files Coverage Δ
schema/types.go 68.67% <ø> (ø)
specs/spec_reader.go 68.12% <78.57%> (+1.24%) ⬆️
schema/text.go 29.41% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

Closes cloudquery/cloudquery#5255 after we upgrade the sdk's in the dest-plugins
@kodiakhq kodiakhq bot merged commit 8597f08 into cloudquery:main Feb 8, 2023
@github-actions github-actions bot added test and removed test labels Feb 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Verify handling of null bytes in strings in snowflake

5 participants