Skip to content

Conversation

@disq
Copy link
Member

@disq disq commented Jul 19, 2023

Needs cloudquery/filetypes#245 to be tagged first

  • {{FORMAT}} now adds the compression format (ie. .json becomes .json.gz)

file plugin only:

  • Updated tests to have separate temp dir for each test
  • Since compressed data can't be read mid-write, using the custom test we use for parquet for compressed tests (which writes all data and then reads all back after closing)

@cq-bot cq-bot added the file label Jul 19, 2023
@disq disq changed the title feat(file): Better support compression, updated tests feat: Better support compression, updated tests Jul 19, 2023
@disq disq changed the title feat: Better support compression, updated tests feat: Better support compression Jul 19, 2023
@disq disq marked this pull request as ready for review July 21, 2023 10:43
@disq disq requested review from a team and bbernays and removed request for a team July 21, 2023 10:43
@disq disq changed the title feat: Better support compression feat: Support compression Jul 21, 2023
@cq-bot cq-bot added the website label Jul 21, 2023
@disq disq added the automerge Automatically merge once required checks pass label Jul 21, 2023
@kodiakhq kodiakhq bot merged commit 03fae6d into main Jul 21, 2023
@kodiakhq kodiakhq bot deleted the feat/file-dest-support-compression branch July 21, 2023 11:28
kodiakhq bot pushed a commit that referenced this pull request Jul 25, 2023
🤖 I have created a release *beep* *boop*
---


## [3.4.0](plugins-destination-azblob-v3.3.2...plugins-destination-azblob-v3.4.0) (2023-07-25)


### Features

* Support compression ([#12411](#12411)) ([03fae6d](03fae6d))


### Bug Fixes

* **deps:** Update github.com/cloudquery/arrow/go/v13 digest to 10df4b9 ([#12443](#12443)) ([e385283](e385283))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.2 ([#12388](#12388)) ([af71bb1](af71bb1))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.3 ([#12422](#12422)) ([96c6f27](96c6f27))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.1.0 ([#12433](#12433)) ([6f91a34](6f91a34))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
kodiakhq bot pushed a commit that referenced this pull request Jul 25, 2023
🤖 I have created a release *beep* *boop*
---


## [4.6.0](plugins-destination-s3-v4.5.2...plugins-destination-s3-v4.6.0) (2023-07-25)


### Features

* Support compression ([#12411](#12411)) ([03fae6d](03fae6d))


### Bug Fixes

* **deps:** Update github.com/cloudquery/arrow/go/v13 digest to 10df4b9 ([#12443](#12443)) ([e385283](e385283))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.2 ([#12388](#12388)) ([af71bb1](af71bb1))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.3 ([#12422](#12422)) ([96c6f27](96c6f27))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.1.0 ([#12433](#12433)) ([6f91a34](6f91a34))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
kodiakhq bot pushed a commit that referenced this pull request Jul 25, 2023
🤖 I have created a release *beep* *boop*
---


## [3.4.0](plugins-destination-file-v3.3.2...plugins-destination-file-v3.4.0) (2023-07-25)


### Features

* Support compression ([#12411](#12411)) ([03fae6d](03fae6d))


### Bug Fixes

* **deps:** Update github.com/cloudquery/arrow/go/v13 digest to 10df4b9 ([#12443](#12443)) ([e385283](e385283))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.2 ([#12388](#12388)) ([af71bb1](af71bb1))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.3 ([#12422](#12422)) ([96c6f27](96c6f27))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.1.0 ([#12433](#12433)) ([6f91a34](6f91a34))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
kodiakhq bot pushed a commit that referenced this pull request Jul 25, 2023
🤖 I have created a release *beep* *boop*
---


## [3.4.0](plugins-destination-gcs-v3.3.2...plugins-destination-gcs-v3.4.0) (2023-07-25)


### Features

* Support compression ([#12411](#12411)) ([03fae6d](03fae6d))


### Bug Fixes

* **deps:** Update github.com/cloudquery/arrow/go/v13 digest to 10df4b9 ([#12443](#12443)) ([e385283](e385283))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.2 ([#12388](#12388)) ([af71bb1](af71bb1))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.0.3 ([#12422](#12422)) ([96c6f27](96c6f27))
* **deps:** Update module github.com/cloudquery/filetypes/v4 to v4.1.0 ([#12433](#12433)) ([6f91a34](6f91a34))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automerge Automatically merge once required checks pass

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants