Skip to content

Conversation

@erezrokah
Copy link
Member

@erezrokah erezrokah commented Jun 23, 2023

Summary

Discovered while working on cloudquery/cloudquery#11719. Using UnixMicro() is incorrect as it doesn't account for the internal time unit of the arrow timestamp type.

AppendTime does https://github.com/cloudquery/arrow/blob/0d1f7234124e67b98b3aa0aa3e521d42c2f3165d/go/arrow/array/timestamp.go#L156 and does the correct conversion https://github.com/cloudquery/arrow/blob/8366a2241e66a53ee05ab4a832927e33e5f9c5a2/go/arrow/datatype_fixedwidth.go#L202


Use the following steps to ensure your PR is ready to be reviewed

  • Read the contribution guidelines 🧑‍🎓
  • Run go fmt to format your code 🖊
  • Lint your changes via golangci-lint run 🚨 (install golangci-lint here)
  • Update or add tests 🧪
  • Ensure the status checks below are successful ✅

@erezrokah erezrokah requested a review from yevgenypats as a code owner June 23, 2023 12:25
@github-actions github-actions bot added the fix label Jun 23, 2023
@github-actions
Copy link

⏱️ Benchmark results

Comparing with ade3b63

  • DefaultConcurrencyDFS-2 resources/s: 10,641 ⬆️ 2.73% increase vs. ade3b63
  • DefaultConcurrencyRoundRobin-2 resources/s: 10,970 ⬇️ 9.63% decrease vs. ade3b63
  • Glob-2 ns/op: 214.5 ⬇️ 17.30% decrease vs. ade3b63
  • TablesWithChildrenDFS-2 resources/s: 25,513 ⬆️ 5.46% increase vs. ade3b63
  • TablesWithChildrenRoundRobin-2 resources/s: 26,464 ⬆️ 10.07% increase vs. ade3b63
  • TablesWithRateLimitingDFS-2 resources/s: 28.17 ⬇️ 0.25% decrease vs. ade3b63
  • TablesWithRateLimitingRoundRobin-2 resources/s: 806.1 ⬇️ 5.99% decrease vs. ade3b63

@codecov
Copy link

codecov bot commented Jun 23, 2023

Codecov Report

Patch coverage: 100.00% and no project coverage change.

Comparison is base (8ce6e06) 52.81% compared to head (37a0114) 52.82%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #986   +/-   ##
=======================================
  Coverage   52.81%   52.82%           
=======================================
  Files          62       62           
  Lines        6337     6338    +1     
=======================================
+ Hits         3347     3348    +1     
  Misses       2685     2685           
  Partials      305      305           
Impacted Files Coverage Δ
scalar/scalar.go 71.06% <100.00%> (+0.14%) ⬆️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@disq
Copy link
Member

disq commented Jul 4, 2023

This fix was included in #1064 but not the new test.

kodiakhq bot pushed a commit that referenced this pull request Jul 4, 2023
Brings the test from #986 (fix was included in #1064)
@disq
Copy link
Member

disq commented Jul 4, 2023

Fully merged as of #1071

@disq disq closed this Jul 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants