V0.40.18 by am6010 · Pull Request #36 · rudderlabs/airbyte

am6010 · 2022-11-09T17:03:14Z

What

Describe what the change is solving
It helps to add screenshots if it affects the frontend.

How

Describe the solution

🚨 User Impact 🚨

Are there any breaking changes? What is the end result perceived by the user? If yes, please merge this PR with the 🚨🚨 emoji so changelog authors can further highlight this if needed.

Pre-merge Checklist

Expand the relevant checklist and delete the others.

New Connector

Community member or Airbyter

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

Create a non-forked branch based on this PR and test the below items on it
Build is successful
If new credentials are required for use in CI, add them to GSM. Instructions.
/test connector=connectors/<name> command is passing
New Connector version released on Dockerhub by running the /publish command described here
After the connector is published, connector added to connector index as described here
Seed specs have been re-generated by building the platform and committing the changes to the seed spec files, as described here

Updating a connector

Community member or Airbyter

Grant edit access to maintainers (instructions)
Secrets in the connector's spec are annotated with airbyte_secret
Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
Code reviews completed
Documentation updated
- Connector's README.md
- Connector's bootstrap.md. See description and examples
- Changelog updated in docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

Create a non-forked branch based on this PR and test the below items on it
Build is successful
If new credentials are required for use in CI, add them to GSM. Instructions.
/test connector=connectors/<name> command is passing
New Connector version released on Dockerhub and connector version bumped by running the /publish command described here

Connector Generator

Issue acceptance criteria met
PR name follows PR naming conventions
If adding a new generator, add it to the list of scaffold modules being tested
The generator test modules (all connectors with -scaffold in their name) have been updated with the latest scaffold by running ./gradlew :airbyte-integrations:connector-templates:generator:testScaffoldTemplates then checking in your changes
Documentation which references the generator is updated as needed

Tests

Unit

Put your unit tests output here.

Integration

Put your integration tests output here.

Acceptance

Put your acceptance tests output here.

* test * fix * fix other modules * version bumps + changelog * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

…050) * properly propagate options * cleanup * turn into dataclass * rename * no need for deepcopy * fix test * bump * cleaner

* Update SpecActivityImpl to build a VersionedStreamFactory * Enable Protocol Version detection from Stream for SPEC * Print log before the action for better debugging * Fix buffer size for protocol detection * Improve detectVersion error handling * extract constan * Rename attribute for clarity

* remove extra check * simplify logic

* Bump version * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

…ounts which are not part of organization (#18111) * for adDirectSponsoredContents stream skip accounts which are part of organization * updated PR number * updated log message, added unit tests * additional formatting * updated connector version in source_definitions.yaml * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

* add schemaChange field to WebBackendConnectionRead and breakingChange to ConnectionRead

…18315)

Co-authored-by: edgao <[email protected]>

…does not exist (#18263) * Changes method from returning null to throwing Exception to match method structure * Added javadoc explaining that KeyPair should not be returning null * Moved ConnectionErrorException to commons package * Adds error handling for SshWrappedDestinations and markdown to include changes * Bumps version numbers for Postgres, MySQL, MSSQL * auto-bump connector version * auto-bump connector version * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

* Add new source: xkcd * Add documentation for xckd connector * Fix unit test test_parse_response * Fix xkcd changelog * Improve iteration method * Update tests test_next_page_token and test_parse_response * add timeout for full read * add seed config and eof * correct source def id * auto-bump connector version Co-authored-by: marcosmarxm <[email protected]> Co-authored-by: Octavia Squidington III <[email protected]>

Signed-off-by: Sergey Chvalyuk <[email protected]>

* fixed ConditionSection width * fixed relative scss colors import

Co-authored-by: xpuska513 <[email protected]> Co-authored-by: Kyryl Skobylko <[email protected]>

…t (#18282) * local datadog docker-compose * add datadog docker-compose * update comments

+ Adds a placeholder for 'Deploy Docs' Github Workflow.

* fix: add task to list all dependencies * fix: remove newline

* [11356] Destination-elasticsearch: added custom certificate support

* pagination fix on jira users stream * Update spec.json * Update spec.json * Update streams.py * bump docker version and changelog * Update spec.json * Update streams.py * update jsons and source * update source * Update source.py * auto-bump connector version Co-authored-by: Vincent Koc <[email protected]> Co-authored-by: Octavia Squidington III <[email protected]>

EU OAuth is not fully tested so adding a note to account for that.

* fix visual regression * remove unused prop

* mysql-source:fix tinyint unsigned handling * update doc * format * upgrade version * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

* Allow environment specific sections in docs * Change syntax to lower case

…809) * ci: replace GITHUB_OUTPUT with GITHUB_ENV on multiline variables * ci: replace github set-ouput with new syntax in ./tools/bin/

* Upgrade Husky * Upgrade Husky * Upgrade Husky * Upgrade Husky * Upgrade Husky

Version 0.40.18 # Conflicts: # airbyte-integrations/connectors/source-amplitude/source_amplitude/api.py # airbyte-integrations/connectors/source-amplitude/source_amplitude/spec.json # airbyte-integrations/connectors/source-chargebee/source_chargebee/spec.json # airbyte-integrations/connectors/source-freshdesk/source_freshdesk/spec.json # airbyte-integrations/connectors/source-google-analytics-data-api/source_google_analytics_data_api/spec.json # airbyte-integrations/connectors/source-google-analytics-v4/source_google_analytics_v4/spec.json # airbyte-integrations/connectors/source-google-search-console/source_google_search_console/spec.json # airbyte-integrations/connectors/source-intercom/source_intercom/spec.json # airbyte-integrations/connectors/source-iterable/source_iterable/spec.json # airbyte-integrations/connectors/source-klaviyo/source_klaviyo/spec.json # airbyte-integrations/connectors/source-salesforce/setup.py # airbyte-integrations/connectors/source-zendesk-support/source_zendesk_support/spec.json

github-actions · 2022-11-09T17:03:59Z

NOTE ⚠️ Changes in this PR affect the following connectors. Make sure to run corresponding integration tests:

Sources (95)

source-alloydb
source-prestashop
source-sftp
source-retently
source-facebook-pages
source-twilio
source-amazon-seller-partner
source-alloydb-strict-encrypt
source-postgres-strict-encrypt
source-zenloop
source-mailchimp
source-google-search-console
source-elasticsearch
source-strava
source-tidb
source-oracle
source-tplcentral
source-freshservice
source-linnworks
source-recharge
source-mysql-strict-encrypt
source-plaid
source-scaffold-java-jdbc
source-relational-db
source-clickhouse-strict-encrypt
source-outreach
source-freshsales
source-azure-table
source-openweather
source-amazon-ads
source-mssql-strict-encrypt
source-asana
source-sendgrid
source-freshcaller
source-appsflyer
source-monday
source-paystack
source-chargebee
source-notion
source-gitlab
source-braintree
source-drift
source-iterable
source-bigquery
source-youtube-analytics
source-onesignal
source-surveymonkey
source-mongodb-strict-encrypt
source-db2
source-redshift
source-cockroachdb
source-python-http-tutorial
source-confluence
source-posthog
source-github
source-cart
source-db2-strict-encrypt
source-google-ads
source-clickhouse
source-facebook-marketing
source-salesloft
source-salesforce
source-postgres
source-amplitude
source-sentry
source-e2e-test-cloud
source-cockroachdb-strict-encrypt
source-zendesk-sunshine
source-delighted
source-stock-ticker-api-tutorial
source-pipedrive
source-mysql
source-amazon-sqs
source-lever-hiring
source-kafka
source-greenhouse
source-lemlist
source-pinterest
source-klaviyo
source-harvest
source-instagram
source-mssql
source-mailgun
source-zendesk-talk
source-oracle-strict-encrypt
source-airtable
source-snowflake
source-mongodb-v2
source-okta
source-jdbc
source-commercetools
source-mongodb
source-pardot
source-e2e-test
source-quickbooks-singer

Destinations (43)

destination-dev-null
destination-pubsub
destination-bigquery
destination-aws-datalake
destination-postgres-strict-encrypt
destination-e2e-test
destination-redshift
destination-rockset
destination-dynamodb
destination-keen
destination-r2
destination-mssql
destination-jdbc
destination-yugabytedb
destination-mssql-strict-encrypt
destination-clickhouse
destination-csv
destination-tidb
destination-mariadb-columnstore
destination-azure-blob-storage
destination-snowflake
destination-elasticsearch
destination-mongodb-strict-encrypt
destination-mysql
destination-scylla
destination-kafka
destination-kinesis
destination-oracle-strict-encrypt
destination-mongodb
destination-redis
destination-gcs
destination-postgres
destination-local-json
destination-oracle
destination-pulsar
destination-clickhouse-strict-encrypt
destination-s3
destination-elasticsearch-strict-encrypt
destination-mqtt
destination-bigquery-denormalized
destination-cassandra
destination-databricks
destination-mysql-strict-encrypt

debanjan97 · 2022-11-10T13:00:38Z

Let's go

This reverts commit 221e7d4.

Joey Marshment-Howell and others added 30 commits October 21, 2022 16:27

Fix broken link to config in .env comment (#18287)

d6ce20f

Add message migration to discover schema (#18205)

cf28f7a

upgrade commons-text to 1.10.0 (#18275)

b347829

* test * fix * fix other modules * version bumps + changelog * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

[low-code] Propagate options to InterpolatedRequestInputProvider (#18…

76acfb8

…050) * properly propagate options * cleanup * turn into dataclass * rename * no need for deepcopy * fix test * bump * cleaner

only rm file if it exists (#18310)

0abc5f6

remove extra check (#10554)

0c5e6ba

* remove extra check * simplify logic

Google ads: Upgrade CDK to incorporate config error handling (#18309)

e1c220a

* Bump version * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

Add SchemaChange to WebBackendConnectionRead object (#17969)

5082ebf

* add schemaChange field to WebBackendConnectionRead and breakingChange to ConnectionRead

Destinations BigQuery and GCS: update docs about bucket encryption (#…

85e93cb

…18315)

Bump Airbyte version from 0.40.16 to 0.40.17 (#18316)

73336ff

Co-authored-by: edgao <[email protected]>

Source pinterest: Fix type of start_date (#18285)

e7bf365

Signed-off-by: Sergey Chvalyuk <[email protected]>

requester = MagicMock(use_cache=False) (#18289)

69092ed

Signed-off-by: Sergey Chvalyuk <[email protected]>

fix Connector Base build (#18351)

710c432

SAT: new test_strictness_level field in config (#18218)

a7fd147

🪟 🐛 Fixed static <ConditionSection /> width (#18233)

f06bd40

* fixed ConditionSection width * fixed relative scss colors import

🎉 Source Shopify: update API version to 2022-10 (#18298)

5e302e0

Update airbyte-db reference (#18368)

51cfebc

🪟 🐛 Load global CSS in storybook (#18353)

3524a8a

Bump helm chart version reference to 0.40.33 (#18371)

f61a420

Co-authored-by: xpuska513 <[email protected]> Co-authored-by: Kyryl Skobylko <[email protected]>

enable support for publishing datadog metrics from a local environmen…

08eb62d

…t (#18282) * local datadog docker-compose * add datadog docker-compose * update comments

Simplify the OSS documentation deploy system (#2670) (#18377)

2a2639a

+ Adds a placeholder for 'Deploy Docs' Github Workflow.

fix: add task to list all dependencies (#18304)

74defd1

* fix: add task to list all dependencies * fix: remove newline

remove useless json_size metric (#18247)

b23565e

🎉Destination-elasticsearch: added custom sertificate support (#18177)

5ab81e6

* [11356] Destination-elasticsearch: added custom certificate support

update spotbugs to latest (#18208)

6b5587d

YowanR and others added 10 commits November 2, 2022 11:13

Add notes about EU OAUth (#18835)

016907e

EU OAuth is not fully tested so adding a note to account for that.

🪟🐛 Fix: visual regression in ConnectorIcon (#18849)

2379876

* fix visual regression * remove unused prop

Add links to demo page (#18828)

5424099

mysql-source:fix tinyint unsigned handling (#18619)

0a37a8d

* mysql-source:fix tinyint unsigned handling * update doc * format * upgrade version * auto-bump connector version Co-authored-by: Octavia Squidington III <[email protected]>

🪟 🎉 Allow environment specific sections in docs (#18829)

4ddd414

* Allow environment specific sections in docs * Change syntax to lower case

ci: replace GITHUB_OUTPUT with GITHUB_ENV on multiline variables (#18…

b77d039

…809) * ci: replace GITHUB_OUTPUT with GITHUB_ENV on multiline variables * ci: replace github set-ouput with new syntax in ./tools/bin/

Add connection ID to span (#18852)

7c2c701

edited connector docs (#18855)

fbe16d1

🪟 🔧 Upgrade husky to 8.0.1 (#18719)

a44c841

* Upgrade Husky * Upgrade Husky * Upgrade Husky * Upgrade Husky * Upgrade Husky

github-actions bot added area/api area/connectors area/platform CDK normalization team/frontend area/server area/protocol area/worker kubernetes labels Nov 9, 2022

debanjan97 self-requested a review November 10, 2022 13:00

debanjan97 approved these changes Nov 10, 2022

View reviewed changes

am6010 merged commit 221e7d4 into main Nov 10, 2022

am6010 deleted the v0.40.18 branch November 10, 2022 14:53

am6010 added a commit that referenced this pull request Nov 11, 2022

Revert "V0.40.18 (#36)"

65c6c91

This reverts commit 221e7d4.

am6010 restored the v0.40.18 branch November 11, 2022 07:32

am6010 deleted the v0.40.18 branch November 11, 2022 07:39

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

V0.40.18#36

V0.40.18#36
am6010 merged 499 commits intomainfrom
v0.40.18

am6010 commented Nov 9, 2022

Uh oh!

github-actions bot commented Nov 9, 2022

Uh oh!

debanjan97 commented Nov 10, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Comments

Conversation

am6010 commented Nov 9, 2022

What

How

Recommended reading order

🚨 User Impact 🚨

Pre-merge Checklist

Community member or Airbyter

Airbyter

Community member or Airbyter

Airbyter

Tests

Uh oh!

github-actions bot commented Nov 9, 2022

Uh oh!

debanjan97 commented Nov 10, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants