Skip to content

Conversation

@yevgenypats
Copy link
Contributor

@yevgenypats yevgenypats commented Apr 6, 2023

This still wait for another sdkv2 release for tests to pass but should be ready for initial review.

@cq-bot cq-bot added the sqlite label Apr 6, 2023
@erezrokah erezrokah self-assigned this Apr 10, 2023
Copy link
Member

@erezrokah erezrokah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did a quick review of the code to make sure I get a general idea.
If you can update the go.mod to update to commit I can also test (or tell me which versions of SDK/Arrow to use).

@yevgenypats yevgenypats marked this pull request as ready for review April 11, 2023 13:56
@yevgenypats yevgenypats requested review from a team and disq and removed request for a team April 11, 2023 13:56
@yevgenypats yevgenypats changed the title feat(sqlite): Migrate to arrow feat(sqlite): Migrate to apache arrow type system Apr 11, 2023
@yevgenypats
Copy link
Contributor Author

Did a quick review of the code to make sure I get a general idea. If you can update the go.mod to update to commit I can also test (or tell me which versions of SDK/Arrow to use).

Thanks @erezrokah go.mod should be up to date now.

Copy link
Member

@erezrokah erezrokah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested this on multiple sources (AWS, GCP and Azure) and upgrading between major versions using forced migration mode. Looks great 🚀

@yevgenypats yevgenypats added the automerge Automatically merge once required checks pass label Apr 17, 2023
kodiakhq bot pushed a commit that referenced this pull request Apr 17, 2023
🤖 I have created a release *beep* *boop*
---


## [2.0.0](plugins-destination-sqlite-v1.3.6...plugins-destination-sqlite-v2.0.0) (2023-04-17)


### ⚠ BREAKING CHANGES

* This release introduces an internal change to our type system to use [Apache Arrow](https://arrow.apache.org/). This should not have any visible breaking changes, however due to the size of the change we are introducing it under a major version bump to communicate that it might have some bugs that we weren't able to catch during our internal tests. If you encounter an issue during the upgrade, please submit a [bug report](https://github.com/cloudquery/cloudquery/issues/new/choose).

### Features

* **sqlite:** Migrate to apache arrow type system ([#9751](#9751)) ([549a38e](549a38e))
* Update to use arrow type system ([a55e0fb](a55e0fb))


### Bug Fixes

* **deps:** Update module github.com/cloudquery/plugin-sdk to v1.45.0 ([#9863](#9863)) ([2799d62](2799d62))
* **sqlite:** Make arrow work with older sources ([#10141](#10141)) ([eef77bb](eef77bb))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automerge Automatically merge once required checks pass

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: Migrate plugin/destination/sqlite to github.com/cloudquery/plugin-sdk/v2

4 participants