Skip to content

Comments

🎉 New Source: Unleash [low-code CDK]#19923

Merged
sunny (sh4sh) merged 28 commits intoairbytehq:masterfrom
arnaudselva:arnaudselva-source-unleash
Mar 9, 2023
Merged

🎉 New Source: Unleash [low-code CDK]#19923
sunny (sh4sh) merged 28 commits intoairbytehq:masterfrom
arnaudselva:arnaudselva-source-unleash

Conversation

@arnaudselva
Copy link
Contributor

@arnaudselva arnaudselva commented Nov 30, 2022

What

How

Using the low-code CDK.

Recommended reading order

  1. docs\integrations\sources\unleash.md
  2. airbyte-integrations\connectors\source-the-guardian-api\source_unleash\spec.yaml
  3. airbyte-integrations\connectors\source-the-guardian-api\source_unleash\unleash.yaml
  4. airbyte-integrations\connectors\source-the-guardian-api\source_unleash\schemas\content.json

🚨 User Impact 🚨

No breaking change

Pre-merge Checklist

Expand the relevant checklist and delete the others.

New Connector

Community member or Airbyter

  • Community member? Grant edit access to maintainers (instructions)
  • Secrets in the connector's spec are annotated with airbyte_secret
  • Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
  • Code reviews completed
  • Documentation updated
    • Connector's README.md
    • Connector's bootstrap.md. See description and examples
    • docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
    • docs/integrations/README.md
    • airbyte-integrations/builds.md
  • PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

  • Create a non-forked branch based on this PR and test the below items on it
  • Build is successful
  • If new credentials are required for use in CI, add them to GSM. Instructions.
  • /test connector=connectors/<name> command is passing
  • New Connector version released on Dockerhub by running the /publish command described here
  • After the connector is published, connector added to connector index as described here
  • Seed specs have been re-generated by building the platform and committing the changes to the seed spec files, as described here

Tests

Integration

integration_tests

Acceptance

See above


sample_api_call

@CLAassistant
Copy link

CLAassistant commented Nov 30, 2022

CLA assistant check
All committers have signed the CLA.

Copy link
Contributor

@marcosmarxm Marcos Marx (marcosmarxm) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some comments, do you have a sandbox account to run integration tests?

@arnaudselva
Copy link
Contributor Author

Some comments, do you have a sandbox account to run integration tests?

Marcos Marx (@marcosmarxm) thanks! sure I can share with you an endpoint and a temporary api token, where do you want me to share them with you?

@sajarin Sajarin (sajarin) added the bounty-XL Maintainer program: claimable extra large bounty PR label Dec 5, 2022
@marcosmarxm
Copy link
Contributor

Hello 👋:skin-tone-2: and thank you for your contribution!

Airbyte has instituted a code freeze between 19 and 30 December, to make sure there are no disruptions during the holidays.
Because of this, reviewing and merging your contribution may take longer than usual.
We apologize for the delay, but we want everyone to have a quiet and happy holiday.

If you have any questions or need further clarification, please don't hesitate to ping via Slack.

@arnaudselva
Copy link
Contributor Author

hello hello, would it be possible to get an ETA on a possible review of this PR? Thanks in advance.

@igrankova
Copy link
Contributor

Iryna Grankova (igrankova) commented Jan 27, 2023

The Support team assigned a "PRO" instance in the US cluster, that is now set to not expire.
The API Token is generated and stored in the Notes area, the link to the screen: https://us.app.unleash-hosted.com/ushh0019/admin/api
LastPass name: Unleash Sandbox Account
cc Nataly Merezhuk (@natalyjazzviolin), I've closed the sandbox request issue as completed, let me know if I can help with anything else here. We have a full support from the Unleash team and I can contact them.

@igrankova
Copy link
Contributor

arnaudselva, I had a talk with the Unleash support and they are happy to provide any help and information for this integration.

@arnaudselva
Copy link
Contributor Author

arnaudselva, I had a talk with the Unleash support and they are happy to provide any help and information for this integration.

Iryna Grankova (@igrankova) nice, thanks. I think there is only an open question to know if the API has pagination or not (I did the implementation without any pagination logic).

@igrankova
Copy link
Contributor

arnaudselva I sent this question to the support, because I haven't find it in the docs. So I'll let you know when receive an answer.
Unleash team also asked me to let them know when we finish this connector. They want to test it.

@igrankova
Copy link
Contributor

arnaudselva, the answer from Unleash:
"Only a few of the APIs support pagination today (when it makes sense, eg.g. the event search API).

Do you happen to know which API endpoint is relevant?"

@arnaudselva
Copy link
Contributor Author

arnaudselva, the answer from Unleash: "Only a few of the APIs support pagination today (when it makes sense, eg.g. the event search API).

Do you happen to know which API endpoint is relevant?"

Iryna Grankova (@igrankova) we are only relying on the client API : https://docs.getunleash.io/reference/api/legacy/unleash/client/features.
I don't have any use case for the other APIs (as it has more to do with managing Unleash rather than reporting). But happy to consider those other APIs on a future iteration of the source (if some people arouse their interest).
For our use case no pagination then, thanks

@sh4sh
Copy link
Contributor

Changed refs and formatting to conform with breaking changes in airbyte-cdk 0.29.0 (changelog)

Copy link
Contributor

@sh4sh sunny (sh4sh) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments and suggestions, let me know if anything was unclear

@arnaudselva
Copy link
Contributor Author

sunny (@sh4sh) thank you for your feedback 🙏 I did the changes, let me know what you think

@arnaudselva arnaudselva requested review from sunny (sh4sh) and removed request for Marcos Marx (marcosmarxm) March 2, 2023 10:49
@sh4sh
Copy link
Contributor

Added creds to GSM, running integration tests here: #23394 (comment)

@sh4sh sunny (sh4sh) dismissed Marcos Marx (marcosmarxm)’s stale review March 8, 2023 20:01

Changes are resolved, dismissing review so we can publish and merge.

@sh4sh
Copy link
Contributor

sunny (sh4sh) commented Mar 8, 2023

/publish connector=connectors/source-unleash

🕑 Publishing the following connectors:
connectors/source-unleash
https://github.com/airbytehq/airbyte/actions/runs/4368104300


Connector Did it publish? Were definitions generated?
connectors/source-unleash

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@sh4sh sunny (sh4sh) enabled auto-merge (squash) March 8, 2023 20:27
@sh4sh sunny (sh4sh) disabled auto-merge March 8, 2023 21:17
@sh4sh sunny (sh4sh) enabled auto-merge (squash) March 9, 2023 13:34
@sh4sh sunny (sh4sh) merged commit 8324098 into airbytehq:master Mar 9, 2023
@sh4sh
Copy link
Contributor

arnaudselva thanks for your contribution!

Daniel Duckworth (danielduckworth) pushed a commit to danielduckworth/airbyte that referenced this pull request Mar 13, 2023
* 🎉 New Source: Unleash [low-code CDK]

* update unleash.md with pull request number

* add bootstrap.md

* remove "optional" mention in the spec descriptions

* fix formatting and update source-acceptance-test to connector-acceptance-test

* update to low-code framework update in airbyte-cdk 0.29.0

* Update airbyte-integrations/connectors/source-unleash/source_unleash/unleash.yaml

Co-authored-by: Sunny <[email protected]>

* Update airbyte-integrations/connectors/source-unleash/source_unleash/spec.yaml

Co-authored-by: Sunny <[email protected]>

* Update airbyte-integrations/connectors/source-unleash/source_unleash/unleash.yaml

Co-authored-by: Sunny <[email protected]>

* adjusting naming

* add source-unleash connector icon

* add icon to source_definitions.yaml

* auto-bump connector version

---------

Co-authored-by: Sajarin <[email protected]>
Co-authored-by: Sunny <[email protected]>
Co-authored-by: Octavia Squidington III <[email protected]>
Adrienne Vermorel (adriennevermorel) pushed a commit to adriennevermorel/airbyte that referenced this pull request Mar 17, 2023
* 🎉 New Source: Unleash [low-code CDK]

* update unleash.md with pull request number

* add bootstrap.md

* remove "optional" mention in the spec descriptions

* fix formatting and update source-acceptance-test to connector-acceptance-test

* update to low-code framework update in airbyte-cdk 0.29.0

* Update airbyte-integrations/connectors/source-unleash/source_unleash/unleash.yaml

Co-authored-by: Sunny <[email protected]>

* Update airbyte-integrations/connectors/source-unleash/source_unleash/spec.yaml

Co-authored-by: Sunny <[email protected]>

* Update airbyte-integrations/connectors/source-unleash/source_unleash/unleash.yaml

Co-authored-by: Sunny <[email protected]>

* adjusting naming

* add source-unleash connector icon

* add icon to source_definitions.yaml

* auto-bump connector version

---------

Co-authored-by: Sajarin <[email protected]>
Co-authored-by: Sunny <[email protected]>
Co-authored-by: Octavia Squidington III <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/connectors Connector related issues area/documentation Improvements or additions to documentation bounty bounty-XL Maintainer program: claimable extra large bounty PR community connectors/source/unleash

Projects

No open projects

Development

Successfully merging this pull request may close these issues.

8 participants