Skip to content

Conversation

@erezrokah
Copy link
Member

@erezrokah erezrokah commented Mar 15, 2023

Summary

Fixes #8929.

Notes

@github-actions
Copy link

github-actions bot commented Mar 15, 2023

This PR has the following changes to source plugin(s) tables:

  • Table azure_consumption_billing_account_balances was added
  • Table azure_consumption_billing_account_budgets was added
  • Table azure_consumption_billing_account_charges was added
  • Table azure_consumption_billing_account_events was added
  • Table azure_consumption_billing_account_legacy_usage_details was added
  • Table azure_consumption_billing_account_lots was added
  • Table azure_consumption_billing_account_marketplaces was added
  • Table azure_consumption_billing_account_modern_usage_details was added
  • Table azure_consumption_billing_account_reservation_recommendations was added
  • Table azure_consumption_billing_account_tags was added
  • Table azure_consumption_billing_profile_reservation_details was added
  • Table azure_consumption_billing_profile_reservation_recommendations was added
  • Table azure_consumption_billing_profile_reservation_summaries was added
  • Table azure_consumption_billing_profile_reservation_transactions was added
  • Table azure_consumption_subscription_budgets was added
  • Table azure_consumption_subscription_legacy_usage_details was added
  • Table azure_consumption_subscription_marketplaces was added
  • Table azure_consumption_subscription_price_sheets was added
  • Table azure_consumption_subscription_reservation_recommendations was added
  • Table azure_consumption_subscription_tags was added

@erezrokah erezrokah force-pushed the feat/azure_consumption_data branch from 80d63fb to a1121a5 Compare March 16, 2023 16:51
@erezrokah erezrokah force-pushed the feat/azure_consumption_data branch from a1121a5 to c2664ed Compare March 20, 2023 12:15
@erezrokah erezrokah marked this pull request as ready for review March 20, 2023 12:18
@erezrokah erezrokah requested a review from yevgenypats as a code owner March 20, 2023 12:18
@erezrokah erezrokah marked this pull request as draft March 20, 2023 16:38
@erezrokah
Copy link
Member Author

Moved back to draft, see #8929 (comment)

@erezrokah erezrokah force-pushed the feat/azure_consumption_data branch 2 times, most recently from 36286c9 to d3da081 Compare March 21, 2023 15:55
@erezrokah erezrokah force-pushed the feat/azure_consumption_data branch from d3da081 to c267d0f Compare April 10, 2023 18:23
@erezrokah erezrokah marked this pull request as ready for review April 10, 2023 18:23
@erezrokah
Copy link
Member Author

I'll do a bit more testing, but this is mostly ready. It's a bit hard to test as I don't have access to old account types (I did get some tables to work on my personal account).

It's mostly based on the Azure REST API docs and ensures we send the same requests

@erezrokah erezrokah force-pushed the feat/azure_consumption_data branch from df49e5d to 3424606 Compare April 20, 2023 16:09
@erezrokah
Copy link
Member Author

erezrokah commented Apr 20, 2023

Hi @yevgenypats and thanks for the review. I updated this PR with 3 additional commits:

  1. Multiplex over billing periods as requested here. See 07789ef
  2. Paginate over prices sheets as requested here. See 3424606. I also opened Question: How to paginate over armconsumption.PriceSheetResult.Properties.Pricesheets Azure/azure-sdk-for-go#20671 to see if there's a better way to do it.
  3. Don't fail the sync if discovery of accounts and billing periods fails. See 3ad5f9f. Since we can't really test this thoroughly on all account types, I'd rather not fail the sync, as the discovery happens regardless if you configure the relevant tables or not.

I'll update the issue to get more feedback so I suggest we wait on reviewing the new changes until we receive it.

@erezrokah erezrokah requested a review from yevgenypats April 23, 2023 09:52
@erezrokah erezrokah added the automerge Automatically merge once required checks pass label Apr 23, 2023
@kodiakhq kodiakhq bot merged commit 007421a into cloudquery:main Apr 23, 2023
kodiakhq bot pushed a commit that referenced this pull request Apr 23, 2023
🤖 I have created a release *beep* *boop*
---


## [7.2.0](plugins-source-azure-v7.1.1...plugins-source-azure-v7.2.0) (2023-04-23)


### This Release has the Following Changes to Tables
- Table `azure_consumption_billing_account_balances` was added
- Table `azure_consumption_billing_account_budgets` was added
- Table `azure_consumption_billing_account_charges` was added
- Table `azure_consumption_billing_account_events` was added
- Table `azure_consumption_billing_account_legacy_usage_details` was added
- Table `azure_consumption_billing_account_lots` was added
- Table `azure_consumption_billing_account_marketplaces` was added
- Table `azure_consumption_billing_account_modern_usage_details` was added
- Table `azure_consumption_billing_account_reservation_recommendations` was added
- Table `azure_consumption_billing_account_tags` was added
- Table `azure_consumption_billing_profile_reservation_details` was added
- Table `azure_consumption_billing_profile_reservation_recommendations` was added
- Table `azure_consumption_billing_profile_reservation_summaries` was added
- Table `azure_consumption_billing_profile_reservation_transactions` was added
- Table `azure_consumption_subscription_budgets` was added
- Table `azure_consumption_subscription_legacy_usage_details` was added
- Table `azure_consumption_subscription_marketplaces` was added
- Table `azure_consumption_subscription_price_sheets` was added
- Table `azure_consumption_subscription_reservation_recommendations` was added
- Table `azure_consumption_subscription_tags` was added

### Features

* **azure-resources:** Add Consumption Resources ([#9117](#9117)) ([007421a](007421a))
* **azure:** Add policy docs ([#10253](#10253)) ([e5b9ec7](e5b9ec7))
* **azure:** Upgrade to `github.com/cloudquery/plugin-sdk/v2` ([#9943](#9943)) ([11d98b3](11d98b3)), closes [#9942](#9942)


### Bug Fixes

* **azure:** Added missing character ([#10183](#10183)) ([cbd948d](cbd948d))
* **azure:** Fix detecting conditions in CIS Section 8 ([#9923](#9923)) ([612da16](612da16))
* **Azure:** Reduce duplicate results of Azure CIS v1.3.0 Section 9.1 ([#10013](#10013)) ([6539ee3](6539ee3))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.2.0 ([#10135](#10135)) ([cf33b89](cf33b89))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.2.2 ([#10143](#10143)) ([8f887e0](8f887e0))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.0 ([#10163](#10163)) ([9a7f214](9a7f214))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.1 ([#10175](#10175)) ([5b53423](5b53423))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.3 ([#10187](#10187)) ([b185248](b185248))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.4 ([#10196](#10196)) ([c6d2f59](c6d2f59))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.5 ([#10200](#10200)) ([5a33693](5a33693))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.6 ([#10208](#10208)) ([91c80a7](91c80a7))
* **deps:** Update module github.com/cloudquery/plugin-sdk/v2 to v2.3.8 ([#10213](#10213)) ([f358666](f358666))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
@erezrokah erezrokah deleted the feat/azure_consumption_data branch April 23, 2023 12:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automerge Automatically merge once required checks pass

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Azure Source Enhancement: Consumption Data

3 participants