Skip to content

Conversation

@shimonp21
Copy link
Contributor

Because of the way writing to snowflake works (i.e. via a JSON file), for text arrays, strings with nulls become screwed up a little (which fails our tests..).

["abc", "def\x00"] becomes, in snowflake, [abc, def\u0000] i.e. a string of length 4 becomes a string of length 9).

This fix does exactly the same thing we do in postgresql.

Because of the way writing to snowflake works (i.e. via a JSON file),
for text arrays, strings with nulls become screwed up a little (which fails our tests..).

["abc", "def\x00"] becomes, in snowflake, [`abc`, `def\u0000`] i.e. a string of length 4 becomes a string of length 9).

This fix does exactly the same thing we do in postgresql.
@shimonp21 shimonp21 requested review from a team and yevgenypats February 9, 2023 08:39
@shimonp21 shimonp21 merged commit b5b02b0 into main Feb 9, 2023
@shimonp21 shimonp21 deleted the snowflake_strip_nulls branch February 9, 2023 08:43
erezrokah pushed a commit that referenced this pull request Feb 14, 2023
🤖 I have created a release *beep* *boop*
---


##
[1.1.11](plugins-destination-snowflake-v1.1.10...plugins-destination-snowflake-v1.1.11)
(2023-02-14)


### Bug Fixes

* **deps:** Update module github.com/cloudquery/plugin-sdk to v1.36.0
([#7809](#7809))
([c85a9cb](c85a9cb))
* **deps:** Update module github.com/cloudquery/plugin-sdk to v1.37.0
([#7933](#7933))
([dc9cffb](dc9cffb))
* **deps:** Update module github.com/cloudquery/plugin-sdk to v1.37.1
([#8008](#8008))
([c47aac0](c47aac0))
* Snowflake migration
([#7833](#7833))
([e738bdd](e738bdd))
* Snowflake migrations
([#7844](#7844))
([26f65bc](26f65bc))
* **snowflake:** Strip nulls
([#7836](#7836))
([b5b02b0](b5b02b0))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants