Skip to content

Add collection of ethtool queue stats#11056

Merged
fanny-jiang merged 9 commits into
masterfrom
bonnefoa/queue_stats
May 2, 2022
Merged

Add collection of ethtool queue stats#11056
fanny-jiang merged 9 commits into
masterfrom
bonnefoa/queue_stats

Conversation

@bonnefoa

@bonnefoa bonnefoa commented Jan 7, 2022

Copy link
Copy Markdown
Collaborator

What does this PR do?

Add collection of rx/tx queue and cpu statistics from ethtool.

Motivation

We currently don't have visibility on queue balancing.
A kernel patch recently introduced imbalance in our setup without us being aware (see cilium/cilium#18311).
Having those metrics will allow to check for possible imbalance in the infrastructure and help when tuning NIC configuration.

Additional Notes

As ethtool statistics are drivers specific, I've separated metrics using the driver name
ena -> system.net.ena.queue.rx_cnt
virtio -> system.net.virtio_net.queue.rx_packets
hyperv -> system.net.hv_netvsc.cpu.rx_packets

The main reason is to avoid confusion on which metric to use (system.net.queue.rx_cnt or system.net.queue.rx_packets?) when creating dashboards.
Plus, the metric may have a different meaning depending on the driver.

Review checklist (to be filled by reviewers)

  • Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
  • PR title must be written as a CHANGELOG entry (see why)
  • Files changes must correspond to the primary purpose of the PR as described in the title (small unrelated changes should have their own PR)
  • PR must have changelog/ and integration/ labels attached

@github-actions

github-actions Bot commented Jan 7, 2022

Copy link
Copy Markdown
Contributor

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

@bonnefoa bonnefoa changed the title Bonnefoa/queue stats Add collect of ethtool queue stats Jan 7, 2022
@bonnefoa bonnefoa changed the title Add collect of ethtool queue stats Add collection of ethtool queue stats Jan 7, 2022
@github-actions

github-actions Bot commented Jan 7, 2022

Copy link
Copy Markdown
Contributor

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

@bonnefoa
bonnefoa force-pushed the bonnefoa/queue_stats branch 2 times, most recently from d417dd3 to 0f53555 Compare January 13, 2022 13:06
@bonnefoa
bonnefoa force-pushed the bonnefoa/queue_stats branch from ecac314 to b0a556f Compare March 30, 2022 08:36
@codecov

codecov Bot commented Mar 30, 2022

Copy link
Copy Markdown

Codecov Report

Merging #11056 (6d62c11) into master (ebb8e70) will increase coverage by 0.05%.
The diff coverage is 95.86%.

Flag Coverage Δ
network 84.71% <95.86%> (+6.82%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

@bonnefoa
bonnefoa force-pushed the bonnefoa/queue_stats branch from b0a556f to 003ee9a Compare April 25, 2022 12:04
Comment thread network/assets/configuration/spec.yaml Outdated
Comment thread network/assets/configuration/spec.yaml
@github-actions

Copy link
Copy Markdown
Contributor

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

@bonnefoa
bonnefoa force-pushed the bonnefoa/queue_stats branch from 3a97426 to 391939a Compare April 26, 2022 07:43
Comment thread network/datadog_checks/network/network.py Outdated
Comment thread network/datadog_checks/network/network.py Outdated
Comment thread network/datadog_checks/network/network.py Outdated
Comment thread network/metadata.csv Outdated
@bonnefoa
bonnefoa force-pushed the bonnefoa/queue_stats branch from 391939a to 0e40bb1 Compare April 28, 2022 13:18
@github-actions

Copy link
Copy Markdown
Contributor

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

@bonnefoa
bonnefoa force-pushed the bonnefoa/queue_stats branch from 0e40bb1 to 6d62c11 Compare April 28, 2022 13:24
@mx-psi

mx-psi commented Apr 28, 2022

Copy link
Copy Markdown
Member

Ping me on Slack once you merge this please, we need to sync the metadata

@bonnefoa

Copy link
Copy Markdown
Collaborator Author

I don't have permission to merge.

@mx-psi

mx-psi commented Apr 28, 2022

Copy link
Copy Markdown
Member

@fanny-jiang is this good to merge?

@fanny-jiang
fanny-jiang merged commit 030f5bf into master May 2, 2022
@fanny-jiang
fanny-jiang deleted the bonnefoa/queue_stats branch May 2, 2022 19:44
sarah-witt added a commit that referenced this pull request May 12, 2022
sarah-witt added a commit that referenced this pull request May 12, 2022
bonnefoa added a commit that referenced this pull request May 13, 2022
bonnefoa added a commit that referenced this pull request May 30, 2022
bonnefoa added a commit that referenced this pull request May 30, 2022
bkabrda pushed a commit that referenced this pull request Sep 12, 2022
* Revert "Revert "Add collection of ethtool queue stats (#11056)" (#12017)"
steveny91 pushed a commit that referenced this pull request Oct 27, 2022
* Revert "Revert "Add collection of ethtool queue stats (#11056)" (#12017)"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants