model/textparse: implement OM2 scrape format by rbizos · Pull Request #18606 · prometheus/prometheus

rbizos · 2026-04-29T10:01:08Z

Which issue(s) does the PR fix:

Release notes for end users (ALL commits must be considered).

Reviewers should verify clarity and quality.

[FEATURE] scrape: Implement OM2.0 scrape format

What this PR does / why we need it:

This PR introduces OpenMetrics2Parser from the specifications.

The implementation is heavily inspired from the OM1 implementation.

Benchstat

Then benchstat are split into 3 categories:

AllTypes: for a generic /metric
CT: to check the created timestamp performance gain
Histogram: to check histograms performance gain

    goos: linux
goarch: amd64
pkg: github.com/prometheus/prometheus/model/textparse
cpu: AMD Ryzen 7 3800X 8-Core Processor
                            │     OM1 (old)       │           OM2 (new)                 │
                            │       sec/op        │   sec/op     vs base                │
ParseOM1VsOM2_AllTypes-16            597.3µ ± 3%   103.3µ ± 2%  -82.70% (p=0.000 n=10)
ParseOM1VsOM2_CT-16                 111.81µ ± 2%   56.47µ ± 2%  -49.49% (p=0.000 n=10)
ParseOM1VsOM2_Histograms-16          944.5µ ± 2%   113.5µ ± 2%  -87.98% (p=0.000 n=10)
geomean                              398.1µ        87.16µ        -78.10%

                            │     OM1 (old)       │           OM2 (new)                 │
                            │        B/op         │     B/op      vs base               │
ParseOM1VsOM2_AllTypes-16           28.10Ki ± 0%   17.91Ki ± 0%  -36.24% (p=0.000 n=10)
ParseOM1VsOM2_CT-16                 14.00Ki ± 0%   11.54Ki ± 0%  -17.53% (p=0.000 n=10)
ParseOM1VsOM2_Histograms-16         39.22Ki ± 0%   24.01Ki ± 0%  -38.79% (p=0.000 n=10)
geomean                             24.89Ki        17.06Ki        -31.47%

                            │     OM1 (old)       │           OM2 (new)                 │
                            │     allocs/op       │ allocs/op   vs base                 │
ParseOM1VsOM2_AllTypes-16             794.0 ± 0%   437.0 ± 0%   -44.96% (p=0.000 n=10)
ParseOM1VsOM2_CT-16                   409.0 ± 0%   242.0 ± 0%   -40.83% (p=0.000 n=10)
ParseOM1VsOM2_Histograms-16           935.0 ± 0%   533.0 ± 0%   -42.99% (p=0.000 n=10)
geomean                               672.1        383.4         -42.95%

dashpole

We should add benchmarks as well.

dashpole · 2026-04-29T18:10:50Z

+		return nil, fmt.Errorf("composite value must be wrapped in {}: %q", raw)
+	}
+	inner := raw[1 : len(raw)-1]
+	m := map[string]string{}


We probably want to avoid allocating a new map for every composite value we parse.

I think this would look something like parseLVals in promparse.go, which also parses a bracketed, comma-separated structure. It appends the "offsets" into a pre-allocated slice, where offsets are pointers into the byte buffer.

The rest of the parsing code just operates on []bytes, using functions from the bytes package (e.g. bytes.Equal) instead of the string equivalents, and using yoloString when we need to (e.g. to call strconv.ParseFloat)

dashpole · 2026-04-29T18:13:54Z

+		return nil, nil
+	}
+	var deltas []int64
+	for part := range strings.SplitSeq(inner, ",") {


This allocates as well. We should avoid this if we can. See my comment above.

dashpole · 2026-04-29T18:14:03Z

+		return nil, nil
+	}
+	var deltas []float64
+	for part := range strings.SplitSeq(inner, ",") {


This allocates as well. Lets avoid this if we can. See my comment above.

Do we plan to address this @rbizos ?

I did not focus on that, rather fixing where the parser differed from the spec. I won't have time to work on it before my holidays.
On splitSeq was returning an iterator so its not as bad in term of allocations. Or you suggest that the buckets should return an iterator as well ?

Signed-off-by: Raphael Bizos <[email protected]>

Also adding test case for omitted buckets / span Signed-off-by: Raphael Bizos <[email protected]>

Signed-off-by: Raphael Bizos <[email protected]>

Before we would not check if buckets are floats or not, this ensures that we don't miss some edgecases Also adding test coverage on the different cases Signed-off-by: Raphael Bizos <[email protected]>

- converts parseBuckets/parseQuantile to iterators - reusing pending series Signed-off-by: Raphael Bizos <[email protected]>

krajorama

Looks like a good start, ~~but I think it needs to go behind feature flag until we make sure if stable and optimized.~~ Never mind, if it's not in Accept header, we fine.

krajorama

few more

bwplotka

Great work on this PR! Looking good so far. I think efficiency-wise we are getting closer to what we want, acceptable I think.

PR Housekeeping Reminders:

Let's switch PR title model/textparse: ... prefix.
Since this includes performance benchmarks, please include the benchstat comparison in the PR description for the latest values 🤗

renamed correctly the gauge histogram om encode buckets as positive absolutes count in stead of delta Signed-off-by: Raphael Bizos <[email protected]>

Several counters in the OM2 benchmark fixtures declared their MetricFamily via `# TYPE`/`# HELP`/`# UNIT` using a name without the `_total` suffix (e.g. `cache_hits`, `http_requests`) while sampling the `_total` name. OpenMetrics 2.0 removes implicit suffix stripping and requires a Metric name to exactly match its MetricFamily name, so those samples were treated as a different, metadata-less family and parsed as untyped (Unknown) instead of counters. Align the metadata names with the sampled `_total` names so the fixtures are valid OM2 and the counters parse as counters. Histogram, summary, gauge, info and stateset families already matched and are unchanged; histograms.bench.om2.txt needed no changes. Co-Authored-By: Claude Opus 4.8 <[email protected]> Signed-off-by: György Krajcsovits <[email protected]>

Several inline test snippets used OpenMetrics 1.0 naming conventions that are invalid under OpenMetrics 2.0, which removes implicit suffix stripping and requires a Metric name to exactly match its MetricFamily name: - Counters declared as `# TYPE foo counter` / `# TYPE requests counter` while sampling `foo_total` / `requests_total`. The mismatch made the parser treat the samples as a different, untyped family. Align the descriptor name with the `_total` sample. - The Info family `ii` did not end in `_info`; the spec mandates Info MetricFamily names MUST end in `_info`. Rename to `ii_info`. Expected entries are updated accordingly. The affected error cases still exercise the same errors (timestamp handling, missing exemplar timestamp), which are independent of the metric type. Co-Authored-By: Claude Opus 4.8 <[email protected]> Signed-off-by: György Krajcsovits <[email protected]>

Add a table-driven test contrasting the two OM2 naming outcomes under the exact-match rule (implicit suffix stripping is removed): - A sample whose name only suffix-extends the declared family (`foo_total` under `# TYPE foo counter`) does not belong to that family and is parsed as untyped (no __type__ label). - A sample whose name matches the descriptor exactly (`foo_total` under `# TYPE foo_total counter`) keeps the declared type, exposing __type__="counter". The existing family-reset test only covered a wholly unrelated undeclared name, not this OM1-style suffix case. Co-Authored-By: Claude Opus 4.8 <[email protected]> Signed-off-by: György Krajcsovits <[email protected]>

krajorama · 2026-07-14T13:42:51Z

+//
+// or a classic histogram:
+//
+//	{count:12,sum:5.5,bucket:[+Inf:12,1.0:3,2.0:7]}


nit:

Suggested change

// {count:12,sum:5.5,bucket:[+Inf:12,1.0:3,2.0:7]}

// {count:12,sum:5.5,bucket:[1.0:3,2.0:7,+Inf:12]}

krajorama · 2026-07-14T13:47:41Z

+		return nil, fmt.Errorf("composite value must be wrapped in {}: %q", raw)
+	}
+	inner := raw[1 : len(raw)-1]
+	m := map[string]string{}


Unfortunately this map makes it impossible to assert the order of fields dictated by the spec. So that's another point in favor of David's suggestion in https://github.com/prometheus/prometheus/pull/18606/changes#r3163175574

krajorama

I've been looking at the PR and it feels like we should just merge because it's getting too big, but I just tested it and even without specifying scrape_protocols in the config, scrape will just accept Open Metrics 2.0 and process it. So my assumption that using scrape_protocols to enable/disable it is wrong. It only impacts the Accept header. So I think we do need the feature-flag to make it abundantly clear that this is experimental and will change. I'd even document that we're going to make it more strict before stabilizing. So with the feature flag and taking rbizos#1, I'd be ok merging the current state.

bwplotka · 2026-07-24T13:53:24Z

I've been looking at the PR and it feels like we should just merge because it's getting too big, but I just tested it and even without specifying scrape_protocols in the config, scrape will just accept Open Metrics 2.0 and process it.

Well, but you did this by exposing OM 2 forcibly, ignoring accept header, right? It might be even a good idea to always validate what's the incoming content vs what's accepted, assuming it's not a breaking change 🙃 (so blocking things outside of scrape_protocols -- that was the intention a bit).

model/textparse: fix OM2 test failure and spec-align test data

bwplotka · 2026-08-11T12:44:51Z

As pointed by @rbizos explicit scrape_protocol flow is not possible due to default */* at the end, accepting all by default. Thus ff might be more clear.

Signed-off-by: Raphael Bizos <[email protected]>

rbizos · 2026-08-13T16:10:40Z

I added the feature flag, I also added the configuration to explicitly allow it. I added warnings in multiple places to state that its should not be considered compliance certification 🙂

dashpole

These are just edge cases. I'm still OK to merge this since it is feature-gated

dashpole · 2026-08-11T12:50:47Z

+				return
+			}
+			// Normalise le to OpenMetrics float format.
+			if lef, err := strconv.ParseFloat(le, 64); err == nil {


If strconv.ParseFloat fails here, the error is swallowed and the invalid threshold is emitted as-is. Also looks like NaN thresholds bypass the lef <= prevLe ordering check.

dashpole · 2026-08-11T12:50:48Z

+				return
+			}
+			// Normalise quantile label to OpenMetrics float format.
+			if qf, err := strconv.ParseFloat(q, 64); err == nil {


If q is non-numeric, the parse error is ignored and the raw string is yielded. Also might want to check for NaN and that quantiles stay within [0.0, 1.0].

dashpole · 2026-08-11T12:50:49Z

+	if err != nil {
+		return nil, nil, fmt.Errorf("invalid %s: %w", countKey, err)
+	}
+	if !ok {


Looks like count and zero_count are not checked for negative values before casting to uint64 on lines 1030-1031, which could underflow to a large uint64.

dashpole · 2026-08-11T12:50:50Z

+			curTStart++
+			curTI--
+		}
+		if !utf8.Valid(p.l.b[curTStart:curTI]) {


If a quoted label name is empty (like ""="val"), stripping quotes leaves curTStart == curTI without an empty check. Maybe check curTStart == curTI here?

dashpole · 2026-08-11T12:50:50Z

+	}
+	// Lex struggles with null bytes. If we are in a label value or help
+	// string, where they are allowed, consume them here immediately.
+	for l.b[l.i] == 0 && (l.state == sLValue || l.state == sMeta2 || l.state == sComment) {


Should sEValue also be included in this check so null bytes inside exemplar label values are consumed properly?

dashpole · 2026-08-11T12:50:51Z

+
+// NewOpenMetrics2Parser returns a new parser for the OpenMetrics 2.0 text
+// format.
+func NewOpenMetrics2Parser(b []byte, st *labels.SymbolTable, opts ParserOptions) Parser {


Looks like opts.IgnoreNativeHistograms is not retained or handled in OpenMetrics2Parser when parsing composite histograms.

rbizos · 2026-08-19T08:42:16Z

We can merge next week after the workgroup sync if all agree :) if I have time I'll check your last requests before then :)

krajorama

happy to merge as well behind the feature flag so we can iterate

Signed-off-by: r.bizos <[email protected]>

rbizos · 2026-08-26T14:05:47Z

I merged main so we should be able to merge whenever :)

krajorama · 2026-08-27T07:20:29Z

The benchmarktest is failing on windows, let me see if LLM can give a quick fix:

2026-08-27T07:06:53.6963835Z === RUN   TestOM1OM2BenchPairsEquivalent
2026-08-27T07:06:53.6964035Z === RUN   TestOM1OM2BenchPairsEquivalent/alltypes
2026-08-27T07:06:53.6964250Z     benchmark_test.go:453: 
2026-08-27T07:06:53.6964920Z         	Error Trace:	D:/a/prometheus/prometheus/model/textparse/benchmark_test.go:485
2026-08-27T07:06:53.6965899Z         	            				D:/a/prometheus/prometheus/model/textparse/benchmark_test.go:453
2026-08-27T07:06:53.6966214Z         	Error:      	Received unexpected error:
2026-08-27T07:06:53.6966706Z         	            	invalid metric type "counter\r"
2026-08-27T07:06:53.6967480Z         	Test:       	TestOM1OM2BenchPairsEquivalent/alltypes
2026-08-27T07:06:53.6967683Z === RUN   TestOM1OM2BenchPairsEquivalent/ct
2026-08-27T07:06:53.6967869Z     benchmark_test.go:453: 
2026-08-27T07:06:53.6968664Z         	Error Trace:	D:/a/prometheus/prometheus/model/textparse/benchmark_test.go:485
2026-08-27T07:06:53.6969677Z         	            				D:/a/prometheus/prometheus/model/textparse/benchmark_test.go:453
2026-08-27T07:06:53.6970084Z         	Error:      	Received unexpected error:
2026-08-27T07:06:53.6970562Z         	            	invalid metric type "counter\r"
2026-08-27T07:06:53.6970964Z         	Test:       	TestOM1OM2BenchPairsEquivalent/ct
2026-08-27T07:06:53.6971233Z === RUN   TestOM1OM2BenchPairsEquivalent/histograms
2026-08-27T07:06:53.6971414Z     benchmark_test.go:453: 
2026-08-27T07:06:53.6972038Z         	Error Trace:	D:/a/prometheus/prometheus/model/textparse/benchmark_test.go:485
2026-08-27T07:06:53.6973799Z         	            				D:/a/prometheus/prometheus/model/textparse/benchmark_test.go:453
2026-08-27T07:06:53.6974154Z         	Error:      	Received unexpected error:
2026-08-27T07:06:53.6974642Z         	            	invalid metric type "histogram\r"
2026-08-27T07:06:53.6975045Z         	Test:       	TestOM1OM2BenchPairsEquivalent/histograms
2026-08-27T07:06:53.6975259Z --- FAIL: TestOM1OM2BenchPairsEquivalent (0.00s)
2026-08-27T07:06:53.6975593Z     --- FAIL: TestOM1OM2BenchPairsEquivalent/alltypes (0.00s)
2026-08-27T07:06:53.6975879Z     --- FAIL: TestOM1OM2BenchPairsEquivalent/ct (0.00s)
2026-08-27T07:06:53.6976197Z     --- FAIL: TestOM1OM2BenchPairsEquivalent/histograms (0.00s)

Windows checkout (core.autocrlf=true) rewrites the new OM1/OM2 benchmark testdata fixtures to CRLF. The OpenMetrics/OM2 parsers treat "\r" as part of the token, which turns "counter" into "counter\r" and fails type validation, breaking TestOM1OM2BenchPairsEquivalent on the "Go tests on Windows" CI job. Pin these fixtures to LF via .gitattributes so checkout no longer mangles them. Signed-off-by: György Krajcsovits <[email protected]>

rbizos · 2026-08-27T07:48:12Z

Thanks @krajorama !

##### [\`v3.15.0\`](https://github.com/prometheus/prometheus/releases/tag/v3.15.0) - \[CHANGE] PromQL: A range query whose `end` was not aligned to `step` caused subqueries inside it to evaluate past the parent's last actual step, inflating `peakSamples` in the query stats and against the `query.max-samples` limit, and wasting storage I/O reading samples that were never used in the result. Add tests to prevent regression of the fix made in [#18081](prometheus/prometheus#18081). [#18598](prometheus/prometheus#18598) - \[CHANGE] PromQL: Do not register a start timestamp reset if the start timestamp hasn't changed between subsequent samples. [#19454](prometheus/prometheus#19454) - \[CHANGE] Logging: Deprecate `--log.level`; use `runtime.log_level` configuration to supply the default level. [#19511](prometheus/prometheus#19511) - \[FEATURE] Configuration: Allow changing the process log level through `runtime.log_level` on configuration reload. [#19511](prometheus/prometheus#19511) - \[FEATURE] Prometheus: Add `--auto-gomemlimit.refresh-interval` flag to periodically re-detect the container or system memory limit and update `GOMEMLIMIT` at runtime. [#18843](prometheus/prometheus#18843) - \[FEATURE] Scraping: Add support for scraping targets via Unix Domain Sockets. [#12024](prometheus/prometheus#12024). [#18091](prometheus/prometheus#18091) - \[FEATURE] scrape: Implement OM2.0 scrape format. [#18606](prometheus/prometheus#18606) - \[ENHANCEMENT] Reduce TSDB head CPU utilization when initializing. [#18001](prometheus/prometheus#18001) - \[ENHANCEMENT] Docker SD: Add labels `__meta_docker_container_image` and `__meta_docker_container_image_id`. [#19386](prometheus/prometheus#19386) - \[ENHANCEMENT] Mixin: Add a p95/p99 remote-write send-batch latency panel to the remote-write dashboard. [#19500](prometheus/prometheus#19500) - \[ENHANCEMENT] Mixin: Support native histograms in the remote-write send-batch latency panel. [#19522](prometheus/prometheus#19522) - \[ENHANCEMENT] PromQL/TSDB: The `--enable-feature=st-storage` flag now automatically enables XOR2 float chunk encoding and ST-capable histogram chunk encoding, so you no longer need to pass `xor2-encoding` and `histograms-st-encoding` alongside it. [#19518](prometheus/prometheus#19518) - \[ENHANCEMENT] Remote write / Alertmanager: upgrade sigv4 to v0.5.0, adding `session_name` and `tags` fields for STS AssumeRole sessions. The previously undocumented `service_name` field is now also documented. [#19569](prometheus/prometheus#19569) - \[ENHANCEMENT] Scraping: Support zstd-compressed scrape responses, enabled via feature flag `zstd-scrape`. [#19502](prometheus/prometheus#19502) - \[ENHANCEMENT] TSDB: Stabilize the XOR2 float chunk encoding. `--enable-feature=xor2-encoding` is deprecated; use `storage.tsdb.chunk_encoding.floats: xor2` instead. Check that other software reading the TSDB directly (e.g. Thanos sidecar) supports XOR2 before enabling. [#19461](prometheus/prometheus#19461) - \[ENHANCEMENT] TSDB: add `prometheus_tsdb_head_appenders_created_total` metric. [#19411](prometheus/prometheus#19411) - \[ENHANCEMENT] Tracing: add more spans to scrapes, API queries and rule evaluations. [#19410](prometheus/prometheus#19410) - \[ENHANCEMENT] UI: Show the effective configuration for each scrape pool on the Targets and Service Discovery pages. [#19384](prometheus/prometheus#19384) - \[ENHANCEMENT] scrape: Enable start time synthesis for summary `_count` and `_sum` series in scrape appender v2. [#19323](prometheus/prometheus#19323) - \[ENHANCEMENT] scrape: stop all pools in parallel for faster shutdowns. [#19295](prometheus/prometheus#19295) - \[ENHANCEMENT] storage/remote: Add undocumented failed\_request\_logging config field to debug log remote write V2 requests on send errors. [#19249](prometheus/prometheus#19249) - \[ENHANCEMENT] TSDB: Add fast path for XOR chunk decompression to speed up queries. [#18049](prometheus/prometheus#18049) - \[ENHANCEMENT] UI: Improve native histogram table formatting and add a background bar indicating the bucket count. [#19332](prometheus/prometheus#19332) - \[ENHANCEMENT] TSDB: Add `prometheus_tsdb_head_series_pending_commit_underflow_total` to report pending-sample reservation underflows. [#19470](prometheus/prometheus#19470) - \[PERF] AWS SD: Build RDS cluster labels once per cluster instead of once per instance. [#19504](prometheus/prometheus#19504) - \[PERF] AWS SD: Describe RDS instances of different clusters concurrently, bounded by `request_concurrency`. [#19506](prometheus/prometheus#19506) - \[PERF] AWS SD: Describe each ElastiCache resource once per refresh instead of twice. [#19585](prometheus/prometheus#19585) - \[PERF] Remote read: Avoid cloning labels for sampled reads when no external labels are configured. [#19503](prometheus/prometheus#19503) - \[PERF] Remote write: Reuse OTLP converter scratch state between requests. [#19388](prometheus/prometheus#19388) - \[PERF] scrape: conversion from classic to native histograms should only parse start times when enabled. [#19446](prometheus/prometheus#19446) - \[BUGFIX] PromQL: Fix `info()` enrichment for composite expressions with mixed `@`/offset references or selector-free vector branches, preventing metadata from being evaluated at an unrelated timestamp. [#19387](prometheus/prometheus#19387) - \[BUGFIX] PromQL: Fix info() enrichment when input series use different subsets of identifying labels. [#19557](prometheus/prometheus#19557) - \[BUGFIX] PromQL: Preserve metric-name dropping through the info function when delayed name removal is enabled. [#19413](prometheus/prometheus#19413) - \[BUGFIX] TSDB: Don't silently drop samples when head garbage collection removes a series while it is being appended to. [#19272](prometheus/prometheus#19272) - \[BUGFIX] TSDB: Keep series with uncommitted samples during selected- and stale-series compaction, including when appenders overlap. [#19470](prometheus/prometheus#19470) - \[BUGFIX] TSDB: Do not retain head series after a synthetic start-timestamp zero sample is rejected. [#19470](prometheus/prometheus#19470) - \[BUGFIX] TSDB: Prevent query panics during series eviction after WAL replay. [#19664](prometheus/prometheus#19664) - \[BUGFIX] TSDB: fix potential deadlock between mmapSeriesChunks and gcSeries. [#19460](prometheus/prometheus#19460) - \[BUGFIX] TSDB: fix default block reload interval for custom options. [#19368](prometheus/prometheus#19368) - \[BUGFIX] AWS SD: Do not crash on serverless MSK clusters or MSK clusters without Open Monitoring. [#19194](prometheus/prometheus#19194) - \[BUGFIX] AWS SD: Do not panic when the ElastiCache API omits optional fields of a serverless cache or cache cluster. [#19435](prometheus/prometheus#19435) - \[BUGFIX] AWS SD: Reject non-positive `request_concurrency` instead of hanging service discovery indefinitely. [#19524](prometheus/prometheus#19524) - \[BUGFIX] Discovery/AWS: Avoid a panic when discovering standalone ECS tasks with custom task groups. [#19302](prometheus/prometheus#19302) - \[BUGFIX] Discovery: Do not panic in AWS Lightsail service discovery when an instance is missing optional fields such as availability zone, blueprint, bundle, name, state or support code. [#19324](prometheus/prometheus#19324) - \[BUGFIX] Discovery: delete the stale `prometheus_sd_last_update_timestamp_seconds` series for a config that is removed on reload. [#19131](prometheus/prometheus#19131) - \[BUGFIX] HTTP: Avoid truncating compressed responses when handlers set Content-Length. [#19661](prometheus/prometheus#19661) - \[BUGFIX] IONOS SD: Do not panic when the API response omits the server, NIC or volume collections, or a server's properties. [#19438](prometheus/prometheus#19438) - \[BUGFIX] Metadata will not affect the number of Remote Write v2 shards. [#19218](prometheus/prometheus#19218) - \[BUGFIX] Mixins: Fix label mismatches that prevented PrometheusHAGroupNotIngestingSamples and PrometheusHAGroupCrashlooping from firing. [#19444](prometheus/prometheus#19444) - \[BUGFIX] Native histograms: `DetectReset` no longer misses a counter reset when a populated bucket behind an empty one disappears, which could make histogram `rate()`/`increase()` undercount. [#19367](prometheus/prometheus#19367) - \[BUGFIX] Never skip histogram buckets for histogram\_stddev and histogram\_stdvar functions. [#19521](prometheus/prometheus#19521) - \[BUGFIX] OTLP: Do not abort an entire OTLP payload ingestion if one metric has no datapoints. [#19343](prometheus/prometheus#19343) - \[BUGFIX] PromQL: Fix FastRegexMatcher false-positive match when a capturing group is directly adjacent to a literal (e.g. `.*\|(foo)\|.*`). [#19516](prometheus/prometheus#19516) - \[BUGFIX] PromQL: Fix a panic in range selectors using the experimental `anchored` or `smoothed` modifier when the selected series has no samples inside the query window, for example a query evaluated inside a scrape gap. [#19431](prometheus/prometheus#19431) - \[BUGFIX] PromQL: Fix empty results when a subquery with `@` is used as the matrix argument of a call that is not step-invariant (for example `quantile_over_time(scalar(x), metric[...:...] @ T)`). [#19187](prometheus/prometheus#19187) - \[BUGFIX] PromQL: Make the "found duplicate series for the match group" many-to-many matching error message deterministic by sorting the two duplicate labels. [#18810](prometheus/prometheus#18810) - \[BUGFIX] PromQL: Preserve parentheses around duration literals on Expr.String() round-trip. [#19403](prometheus/prometheus#19403) - \[BUGFIX] PromQL: Reject duration-expression offsets and `@ start()` / `@ end()` before range selectors, matching the existing rejection of literal offsets and `@ <timestamp>`. [#19406](prometheus/prometheus#19406) - \[BUGFIX] PromQL: Report the position of the histogram argument rather than of a scalar argument in the native histogram NaN observation annotations of `histogram_quantile` and `histogram_fraction`. [#19330](prometheus/prometheus#19330) - \[BUGFIX] PromQL: info() now applies the @ modifier/offset when evaluating the info series, so info(v @ T) enriches as of T consistently instead of depending on the query start/eval time. [#19266](prometheus/prometheus#19266) - \[BUGFIX] Rules: Fix a panic when a rule manager created without a logger loads a rule file containing multiple YAML documents. [#19433](prometheus/prometheus#19433) - \[BUGFIX] Scrape: Do not append a stale marker for a series that is still exposed when the storage returns a new series reference for it. [#19328](prometheus/prometheus#19328) - \[BUGFIX] Scrape: JSON log formatter correctly format scrape target info. [#19472](prometheus/prometheus#19472) - \[BUGFIX] TSDB: Fix in-order chunk ID overflow by wrapping head chunk IDs modulo 2^23 so they never collide with the out-of-order flag bit. [#19450](prometheus/prometheus#19450) - \[BUGFIX] TSDB: Fix out-of-order chunk ID overflow by wrapping `firstOOOChunkID` modulo 2^23 instead of growing unbounded. [#19216](prometheus/prometheus#19216) - \[BUGFIX] UI: Remove an extraneous X-axis tick mark in the native histogram chart when using the "linear" display mode. [#19326](prometheus/prometheus#19326) - \[BUGFIX] discovery/aws: Avoid a panic when an ElastiCache ARN is missing its resource ID. [#19333](prometheus/prometheus#19333) - \[BUGFIX] discovery/aws: Do not panic on MSK clusters whose optional API fields are absent. [#19584](prometheus/prometheus#19584) - \[BUGFIX] discovery/aws: Do not panic when the EC2 API omits optional instance fields. [#19512](prometheus/prometheus#19512) - \[BUGFIX] discovery/aws: Don't panic on ECS tasks with absent optional fields. [#19396](prometheus/prometheus#19396) - \[BUGFIX] discovery/aws: MSK Optional Custom Configuration Fields [#19422](prometheus/prometheus#19422). [#19422](prometheus/prometheus#19422) - \[BUGFIX] discovery/ionos: Fix panic when the IONOS API omits optional server fields. [#19418](prometheus/prometheus#19418) - \[BUGFIX] discovery/kubernetes: Populate `__meta_kubernetes_service_loadbalancer_ip` from `status.loadBalancer.ingress`, falling back to deprecated `spec.loadBalancerIP`. [#19404](prometheus/prometheus#19404) - \[BUGFIX] histogram: Fix Compact moving buckets to wrong indices, and producing negative bucket counts for integer histograms, when more than one span is merged in the same pass. [#19312](prometheus/prometheus#19312) - \[BUGFIX] promtool: Fixed `tsdb dump` silently dropping native histogram samples. [#18051](prometheus/prometheus#18051) - \[BUGFIX] scrape: fix data race in `Manager.TargetsDroppedCounts` to avoid miscounting dropped targets. [#19304](prometheus/prometheus#19304) - \[BUGFIX] scrape: fix nil histogram when native and classic histograms are mixed in one metric family. [#19452](prometheus/prometheus#19452) - \[BUGFIX] TSDB: Fix WAL and GC log messages to emit human-readable duration strings instead of nanosecond integers. [#19307](prometheus/prometheus#19307) - \[BUGFIX] TSDB: Avoid WAL corruption after a failed WAL write in Agent mode. [#19700](prometheus/prometheus#19700) - \[BUGFIX] Agent: Ignore unknown WAL record types, to help users rolling back. [#19814](prometheus/prometheus#19814)

…→ v3.15.0) (#769) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [quay.io/prometheus/prometheus](https://github.com/prometheus/prometheus) | minor | `v3.14.0` → `v3.15.0` | --- ### Release Notes <details> <summary>prometheus/prometheus (quay.io/prometheus/prometheus)</summary> ### [`v3.15.0`](https://github.com/prometheus/prometheus/releases/tag/v3.15.0): 3.15.0 / 2026-09-24 [Compare Source](prometheus/prometheus@v3.14.0...v3.15.0) - \[CHANGE] PromQL: A range query whose `end` was not aligned to `step` caused subqueries inside it to evaluate past the parent's last actual step, inflating `peakSamples` in the query stats and against the `query.max-samples` limit, and wasting storage I/O reading samples that were never used in the result. Add tests to prevent regression of the fix made in [#18081](prometheus/prometheus#18081). [#18598](prometheus/prometheus#18598) - \[CHANGE] PromQL: Do not register a start timestamp reset if the start timestamp hasn't changed between subsequent samples. [#19454](prometheus/prometheus#19454) - \[CHANGE] Logging: Deprecate `--log.level`; use `runtime.log_level` configuration to supply the default level. [#19511](prometheus/prometheus#19511) - \[FEATURE] Configuration: Allow changing the process log level through `runtime.log_level` on configuration reload. [#19511](prometheus/prometheus#19511) - \[FEATURE] Prometheus: Add `--auto-gomemlimit.refresh-interval` flag to periodically re-detect the container or system memory limit and update `GOMEMLIMIT` at runtime. [#18843](prometheus/prometheus#18843) - \[FEATURE] Scraping: Add support for scraping targets via Unix Domain Sockets. [#12024](prometheus/prometheus#12024). [#18091](prometheus/prometheus#18091) - \[FEATURE] scrape: Implement OM2.0 scrape format. [#18606](prometheus/prometheus#18606) - \[ENHANCEMENT] Reduce TSDB head CPU utilization when initializing. [#18001](prometheus/prometheus#18001) - \[ENHANCEMENT] Docker SD: Add labels `__meta_docker_container_image` and `__meta_docker_container_image_id`. [#19386](prometheus/prometheus#19386) - \[ENHANCEMENT] Mixin: Add a p95/p99 remote-write send-batch latency panel to the remote-write dashboard. [#19500](prometheus/prometheus#19500) - \[ENHANCEMENT] Mixin: Support native histograms in the remote-write send-batch latency panel. [#19522](prometheus/prometheus#19522) - \[ENHANCEMENT] PromQL/TSDB: The `--enable-feature=st-storage` flag now automatically enables XOR2 float chunk encoding and ST-capable histogram chunk encoding, so you no longer need to pass `xor2-encoding` and `histograms-st-encoding` alongside it. [#19518](prometheus/prometheus#19518) - \[ENHANCEMENT] Remote write / Alertmanager: upgrade sigv4 to v0.5.0, adding `session_name` and `tags` fields for STS AssumeRole sessions. The previously undocumented `service_name` field is now also documented. [#19569](prometheus/prometheus#19569) - \[ENHANCEMENT] Scraping: Support zstd-compressed scrape responses, enabled via feature flag `zstd-scrape`. [#19502](prometheus/prometheus#19502) - \[ENHANCEMENT] TSDB: Stabilize the XOR2 float chunk encoding. `--enable-feature=xor2-encoding` is deprecated; use `storage.tsdb.chunk_encoding.floats: xor2` instead. Check that other software reading the TSDB directly (e.g. Thanos sidecar) supports XOR2 before enabling. [#19461](prometheus/prometheus#19461) - \[ENHANCEMENT] TSDB: add `prometheus_tsdb_head_appenders_created_total` metric. [#19411](prometheus/prometheus#19411) - \[ENHANCEMENT] Tracing: add more spans to scrapes, API queries and rule evaluations. [#19410](prometheus/prometheus#19410) - \[ENHANCEMENT] UI: Show the effective configuration for each scrape pool on the Targets and Service Discovery pages. [#19384](prometheus/prometheus#19384) - \[ENHANCEMENT] scrape: Enable start time synthesis for summary `_count` and `_sum` series in scrape appender v2. [#19323](prometheus/prometheus#19323) - \[ENHANCEMENT] scrape: stop all pools in parallel for faster shutdowns. [#19295](prometheus/prometheus#19295) - \[ENHANCEMENT] storage/remote: Add undocumented failed\_request\_logging config field to debug log remote write V2 requests on send errors. [#19249](prometheus/prometheus#19249) - \[ENHANCEMENT] TSDB: Add fast path for XOR chunk decompression to speed up queries. [#18049](prometheus/prometheus#18049) - \[ENHANCEMENT] UI: Improve native histogram table formatting and add a background bar indicating the bucket count. [#19332](prometheus/prometheus#19332) - \[ENHANCEMENT] TSDB: Add `prometheus_tsdb_head_series_pending_commit_underflow_total` to report pending-sample reservation underflows. [#19470](prometheus/prometheus#19470) - \[PERF] AWS SD: Build RDS cluster labels once per cluster instead of once per instance. [#19504](prometheus/prometheus#19504) - \[PERF] AWS SD: Describe RDS instances of different clusters concurrently, bounded by `request_concurrency`. [#19506](prometheus/prometheus#19506) - \[PERF] AWS SD: Describe each ElastiCache resource once per refresh instead of twice. [#19585](prometheus/prometheus#19585) - \[PERF] Remote read: Avoid cloning labels for sampled reads when no external labels are configured. [#19503](prometheus/prometheus#19503) - \[PERF] Remote write: Reuse OTLP converter scratch state between requests. [#19388](prometheus/prometheus#19388) - \[PERF] scrape: conversion from classic to native histograms should only parse start times when enabled. [#19446](prometheus/prometheus#19446) - \[BUGFIX] PromQL: Fix `info()` enrichment for composite expressions with mixed `@`/offset references or selector-free vector branches, preventing metadata from being evaluated at an unrelated timestamp. [#19387](prometheus/prometheus#19387) - \[BUGFIX] PromQL: Fix info() enrichment when input series use different subsets of identifying labels. [#19557](prometheus/prometheus#19557) - \[BUGFIX] PromQL: Preserve metric-name dropping through the info function when delayed name removal is enabled. [#19413](prometheus/prometheus#19413) - \[BUGFIX] TSDB: Don't silently drop samples when head garbage collection removes a series while it is being appended to. [#19272](prometheus/prometheus#19272) - \[BUGFIX] TSDB: Keep series with uncommitted samples during selected- and stale-series compaction, including when appenders overlap. [#19470](prometheus/prometheus#19470) - \[BUGFIX] TSDB: Do not retain head series after a synthetic start-timestamp zero sample is rejected. [#19470](prometheus/prometheus#19470) - \[BUGFIX] TSDB: Prevent query panics during series eviction after WAL replay. [#19664](prometheus/prometheus#19664) - \[BUGFIX] TSDB: fix potential deadlock between mmapSeriesChunks and gcSeries. [#19460](prometheus/prometheus#19460) - \[BUGFIX] TSDB: fix default block reload interval for custom options. [#19368](prometheus/prometheus#19368) - \[BUGFIX] AWS SD: Do not crash on serverless MSK clusters or MSK clusters without Open Monitoring. [#19194](prometheus/prometheus#19194) - \[BUGFIX] AWS SD: Do not panic when the ElastiCache API omits optional fields of a serverless cache or cache cluster. [#19435](prometheus/prometheus#19435) - \[BUGFIX] AWS SD: Reject non-positive `request_concurrency` instead of hanging service discovery indefinitely. [#19524](prometheus/prometheus#19524) - \[BUGFIX] Discovery/AWS: Avoid a panic when discovering standalone ECS tasks with custom task groups. [#19302](prometheus/prometheus#19302) - \[BUGFIX] Discovery: Do not panic in AWS Lightsail service discovery when an instance is missing optional fields such as availability zone, blueprint, bundle, name, state or support code. [#19324](prometheus/prometheus#19324) - \[BUGFIX] Discovery: delete the stale `prometheus_sd_last_update_timestamp_seconds` series for a config that is removed on reload. [#19131](prometheus/prometheus#19131) - \[BUGFIX] HTTP: Avoid truncating compressed responses when handlers set Content-Length. [#19661](prometheus/prometheus#19661) - \[BUGFIX] IONOS SD: Do not panic when the API response omits the server, NIC or volume collections, or a server's properties. [#19438](prometheus/prometheus#19438) - \[BUGFIX] Metadata will not affect the number of Remote Write v2 shards. [#19218](prometheus/prometheus#19218) - \[BUGFIX] Mixins: Fix label mismatches that prevented PrometheusHAGroupNotIngestingSamples and PrometheusHAGroupCrashlooping from firing. [#19444](prometheus/prometheus#19444) - \[BUGFIX] Native histograms: `DetectReset` no longer misses a counter reset when a populated bucket behind an empty one disappears, which could make histogram `rate()`/`increase()` undercount. [#19367](prometheus/prometheus#19367) - \[BUGFIX] Never skip histogram buckets for histogram\_stddev and histogram\_stdvar functions. [#19521](prometheus/prometheus#19521) - \[BUGFIX] OTLP: Do not abort an entire OTLP payload ingestion if one metric has no datapoints. [#19343](prometheus/prometheus#19343) - \[BUGFIX] PromQL: Fix FastRegexMatcher false-positive match when a capturing group is directly adjacent to a literal (e.g. `.*\|(foo)\|.*`). [#19516](prometheus/prometheus#19516) - \[BUGFIX] PromQL: Fix a panic in range selectors using the experimental `anchored` or `smoothed` modifier when the selected series has no samples inside the query window, for example a query evaluated inside a scrape gap. [#19431](prometheus/prometheus#19431) - \[BUGFIX] PromQL: Fix empty results when a subquery with `@` is used as the matrix argument of a call that is not step-invariant (for example `quantile_over_time(scalar(x), metric[...:...] @ T)`). [#19187](prometheus/prometheus#19187) - \[BUGFIX] PromQL: Make the "found duplicate series for the match group" many-to-many matching error message deterministic by sorting the two duplicate labels. [#18810](prometheus/prometheus#18810) - \[BUGFIX] PromQL: Preserve parentheses around duration literals on Expr.String() round-trip. [#19403](prometheus/prometheus#19403) - \[BUGFIX] PromQL: Reject duration-expression offsets and `@ start()` / `@ end()` before range selectors, matching the existing rejection of literal offsets and `@ <timestamp>`. [#19406](prometheus/prometheus#19406) - \[BUGFIX] PromQL: Report the position of the histogram argument rather than of a scalar argument in the native histogram NaN observation annotations of `histogram_quantile` and `histogram_fraction`. [#19330](prometheus/prometheus#19330) - \[BUGFIX] PromQL: info() now applies the @ modifier/offset when evaluating the info series, so info(v @ T) enriches as of T consistently instead of depending on the query start/eval time. [#19266](prometheus/prometheus#19266) - \[BUGFIX] Rules: Fix a panic when a rule manager created without a logger loads a rule file containing multiple YAML documents. [#19433](prometheus/prometheus#19433) - \[BUGFIX] Scrape: Do not append a stale marker for a series that is still exposed when the storage returns a new series reference for it. [#19328](prometheus/prometheus#19328) - \[BUGFIX] Scrape: JSON log formatter correctly format scrape target info. [#19472](prometheus/prometheus#19472) - \[BUGFIX] TSDB: Fix in-order chunk ID overflow by wrapping head chunk IDs modulo 2^23 so they never collide with the out-of-order flag bit. [#19450](prometheus/prometheus#19450) - \[BUGFIX] TSDB: Fix out-of-order chunk ID overflow by wrapping `firstOOOChunkID` modulo 2^23 instead of growing unbounded. [#19216](prometheus/prometheus#19216) - \[BUGFIX] UI: Remove an extraneous X-axis tick mark in the native histogram chart when using the "linear" display mode. [#19326](prometheus/prometheus#19326) - \[BUGFIX] discovery/aws: Avoid a panic when an ElastiCache ARN is missing its resource ID. [#19333](prometheus/prometheus#19333) - \[BUGFIX] discovery/aws: Do not panic on MSK clusters whose optional API fields are absent. [#19584](prometheus/prometheus#19584) - \[BUGFIX] discovery/aws: Do not panic when the EC2 API omits optional instance fields. [#19512](prometheus/prometheus#19512) - \[BUGFIX] discovery/aws: Don't panic on ECS tasks with absent optional fields. [#19396](prometheus/prometheus#19396) - \[BUGFIX] discovery/aws: MSK Optional Custom Configuration Fields [#19422](prometheus/prometheus#19422). [#19422](prometheus/prometheus#19422) - \[BUGFIX] discovery/ionos: Fix panic when the IONOS API omits optional server fields. [#19418](prometheus/prometheus#19418) - \[BUGFIX] discovery/kubernetes: Populate `__meta_kubernetes_service_loadbalancer_ip` from `status.loadBalancer.ingress`, falling back to deprecated `spec.loadBalancerIP`. [#19404](prometheus/prometheus#19404) - \[BUGFIX] histogram: Fix Compact moving buckets to wrong indices, and producing negative bucket counts for integer histograms, when more than one span is merged in the same pass. [#19312](prometheus/prometheus#19312) - \[BUGFIX] promtool: Fixed `tsdb dump` silently dropping native histogram samples. [#18051](prometheus/prometheus#18051) - \[BUGFIX] scrape: fix data race in `Manager.TargetsDroppedCounts` to avoid miscounting dropped targets. [#19304](prometheus/prometheus#19304) - \[BUGFIX] scrape: fix nil histogram when native and classic histograms are mixed in one metric family. [#19452](prometheus/prometheus#19452) - \[BUGFIX] TSDB: Fix WAL and GC log messages to emit human-readable duration strings instead of nanosecond integers. [#19307](prometheus/prometheus#19307) - \[BUGFIX] TSDB: Avoid WAL corruption after a failed WAL write in Agent mode. [#19700](prometheus/prometheus#19700) - \[BUGFIX] Agent: Ignore unknown WAL record types, to help users rolling back. [#19814](prometheus/prometheus#19814) </details> --- ### Configuration 📅 **Schedule**: (in timezone Europe/London) - Branch creation - At any time (no schedule defined) - Automerge - At any time (no schedule defined) 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate CLI](https://github.com/renovatebot/renovate).  Reviewed-on: https://git.hayden.moe/hayden/phoebe/pulls/769

…➔ v3.15.0) (#2199) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [quay.io/prometheus/prometheus](https://github.com/prometheus/prometheus) | minor | `v3.14.0` → `v3.15.0` | --- > ⚠️ **Warning** > > Some dependencies could not be looked up. Check the [Dependency Dashboard](issues/567) for more information. --- ### Release Notes <details> <summary>prometheus/prometheus (quay.io/prometheus/prometheus)</summary> ### [`v3.15.0`](https://github.com/prometheus/prometheus/releases/tag/v3.15.0): 3.15.0 / 2026-09-24 [Compare Source](prometheus/prometheus@v3.14.0...v3.15.0) - \[CHANGE] PromQL: A range query whose `end` was not aligned to `step` caused subqueries inside it to evaluate past the parent's last actual step, inflating `peakSamples` in the query stats and against the `query.max-samples` limit, and wasting storage I/O reading samples that were never used in the result. Add tests to prevent regression of the fix made in [#18081](prometheus/prometheus#18081). [#18598](prometheus/prometheus#18598) - \[CHANGE] PromQL: Do not register a start timestamp reset if the start timestamp hasn't changed between subsequent samples. [#19454](prometheus/prometheus#19454) - \[CHANGE] Logging: Deprecate `--log.level`; use `runtime.log_level` configuration to supply the default level. [#19511](prometheus/prometheus#19511) - \[FEATURE] Configuration: Allow changing the process log level through `runtime.log_level` on configuration reload. [#19511](prometheus/prometheus#19511) - \[FEATURE] Prometheus: Add `--auto-gomemlimit.refresh-interval` flag to periodically re-detect the container or system memory limit and update `GOMEMLIMIT` at runtime. [#18843](prometheus/prometheus#18843) - \[FEATURE] Scraping: Add support for scraping targets via Unix Domain Sockets. [#12024](prometheus/prometheus#12024). [#18091](prometheus/prometheus#18091) - \[FEATURE] scrape: Implement OM2.0 scrape format. [#18606](prometheus/prometheus#18606) - \[ENHANCEMENT] Reduce TSDB head CPU utilization when initializing. [#18001](prometheus/prometheus#18001) - \[ENHANCEMENT] Docker SD: Add labels `__meta_docker_container_image` and `__meta_docker_container_image_id`. [#19386](prometheus/prometheus#19386) - \[ENHANCEMENT] Mixin: Add a p95/p99 remote-write send-batch latency panel to the remote-write dashboard. [#19500](prometheus/prometheus#19500) - \[ENHANCEMENT] Mixin: Support native histograms in the remote-write send-batch latency panel. [#19522](prometheus/prometheus#19522) - \[ENHANCEMENT] PromQL/TSDB: The `--enable-feature=st-storage` flag now automatically enables XOR2 float chunk encoding and ST-capable histogram chunk encoding, so you no longer need to pass `xor2-encoding` and `histograms-st-encoding` alongside it. [#19518](prometheus/prometheus#19518) - \[ENHANCEMENT] Remote write / Alertmanager: upgrade sigv4 to v0.5.0, adding `session_name` and `tags` fields for STS AssumeRole sessions. The previously undocumented `service_name` field is now also documented. [#19569](prometheus/prometheus#19569) - \[ENHANCEMENT] Scraping: Support zstd-compressed scrape responses, enabled via feature flag `zstd-scrape`. [#19502](prometheus/prometheus#19502) - \[ENHANCEMENT] TSDB: Stabilize the XOR2 float chunk encoding. `--enable-feature=xor2-encoding` is deprecated; use `storage.tsdb.chunk_encoding.floats: xor2` instead. Check that other software reading the TSDB directly (e.g. Thanos sidecar) supports XOR2 before enabling. [#19461](prometheus/prometheus#19461) - \[ENHANCEMENT] TSDB: add `prometheus_tsdb_head_appenders_created_total` metric. [#19411](prometheus/prometheus#19411) - \[ENHANCEMENT] Tracing: add more spans to scrapes, API queries and rule evaluations. [#19410](prometheus/prometheus#19410) - \[ENHANCEMENT] UI: Show the effective configuration for each scrape pool on the Targets and Service Discovery pages. [#19384](prometheus/prometheus#19384) - \[ENHANCEMENT] scrape: Enable start time synthesis for summary `_count` and `_sum` series in scrape appender v2. [#19323](prometheus/prometheus#19323) - \[ENHANCEMENT] scrape: stop all pools in parallel for faster shutdowns. [#19295](prometheus/prometheus#19295) - \[ENHANCEMENT] storage/remote: Add undocumented failed\_request\_logging config field to debug log remote write V2 requests on send errors. [#19249](prometheus/prometheus#19249) - \[ENHANCEMENT] TSDB: Add fast path for XOR chunk decompression to speed up queries. [#18049](prometheus/prometheus#18049) - \[ENHANCEMENT] UI: Improve native histogram table formatting and add a background bar indicating the bucket count. [#19332](prometheus/prometheus#19332) - \[ENHANCEMENT] TSDB: Add `prometheus_tsdb_head_series_pending_commit_underflow_total` to report pending-sample reservation underflows. [#19470](prometheus/prometheus#19470) - \[PERF] AWS SD: Build RDS cluster labels once per cluster instead of once per instance. [#19504](prometheus/prometheus#19504) - \[PERF] AWS SD: Describe RDS instances of different clusters concurrently, bounded by `request_concurrency`. [#19506](prometheus/prometheus#19506) - \[PERF] AWS SD: Describe each ElastiCache resource once per refresh instead of twice. [#19585](prometheus/prometheus#19585) - \[PERF] Remote read: Avoid cloning labels for sampled reads when no external labels are configured. [#19503](prometheus/prometheus#19503) - \[PERF] Remote write: Reuse OTLP converter scratch state between requests. [#19388](prometheus/prometheus#19388) - \[PERF] scrape: conversion from classic to native histograms should only parse start times when enabled. [#19446](prometheus/prometheus#19446) - \[BUGFIX] PromQL: Fix `info()` enrichment for composite expressions with mixed `@`/offset references or selector-free vector branches, preventing metadata from being evaluated at an unrelated timestamp. [#19387](prometheus/prometheus#19387) - \[BUGFIX] PromQL: Fix info() enrichment when input series use different subsets of identifying labels. [#19557](prometheus/prometheus#19557) - \[BUGFIX] PromQL: Preserve metric-name dropping through the info function when delayed name removal is enabled. [#19413](prometheus/prometheus#19413) - \[BUGFIX] TSDB: Don't silently drop samples when head garbage collection removes a series while it is being appended to. [#19272](prometheus/prometheus#19272) - \[BUGFIX] TSDB: Keep series with uncommitted samples during selected- and stale-series compaction, including when appenders overlap. [#19470](prometheus/prometheus#19470) - \[BUGFIX] TSDB: Do not retain head series after a synthetic start-timestamp zero sample is rejected. [#19470](prometheus/prometheus#19470) - \[BUGFIX] TSDB: Prevent query panics during series eviction after WAL replay. [#19664](prometheus/prometheus#19664) - \[BUGFIX] TSDB: fix potential deadlock between mmapSeriesChunks and gcSeries. [#19460](prometheus/prometheus#19460) - \[BUGFIX] TSDB: fix default block reload interval for custom options. [#19368](prometheus/prometheus#19368) - \[BUGFIX] AWS SD: Do not crash on serverless MSK clusters or MSK clusters without Open Monitoring. [#19194](prometheus/prometheus#19194) - \[BUGFIX] AWS SD: Do not panic when the ElastiCache API omits optional fields of a serverless cache or cache cluster. [#19435](prometheus/prometheus#19435) - \[BUGFIX] AWS SD: Reject non-positive `request_concurrency` instead of hanging service discovery indefinitely. [#19524](prometheus/prometheus#19524) - \[BUGFIX] Discovery/AWS: Avoid a panic when discovering standalone ECS tasks with custom task groups. [#19302](prometheus/prometheus#19302) - \[BUGFIX] Discovery: Do not panic in AWS Lightsail service discovery when an instance is missing optional fields such as availability zone, blueprint, bundle, name, state or support code. [#19324](prometheus/prometheus#19324) - \[BUGFIX] Discovery: delete the stale `prometheus_sd_last_update_timestamp_seconds` series for a config that is removed on reload. [#19131](prometheus/prometheus#19131) - \[BUGFIX] HTTP: Avoid truncating compressed responses when handlers set Content-Length. [#19661](prometheus/prometheus#19661) - \[BUGFIX] IONOS SD: Do not panic when the API response omits the server, NIC or volume collections, or a server's properties. [#19438](prometheus/prometheus#19438) - \[BUGFIX] Metadata will not affect the number of Remote Write v2 shards. [#19218](prometheus/prometheus#19218) - \[BUGFIX] Mixins: Fix label mismatches that prevented PrometheusHAGroupNotIngestingSamples and PrometheusHAGroupCrashlooping from firing. [#19444](prometheus/prometheus#19444) - \[BUGFIX] Native histograms: `DetectReset` no longer misses a counter reset when a populated bucket behind an empty one disappears, which could make histogram `rate()`/`increase()` undercount. [#19367](prometheus/prometheus#19367) - \[BUGFIX] Never skip histogram buckets for histogram\_stddev and histogram\_stdvar functions. [#19521](prometheus/prometheus#19521) - \[BUGFIX] OTLP: Do not abort an entire OTLP payload ingestion if one metric has no datapoints. [#19343](prometheus/prometheus#19343) - \[BUGFIX] PromQL: Fix FastRegexMatcher false-positive match when a capturing group is directly adjacent to a literal (e.g. `.*\|(foo)\|.*`). [#19516](prometheus/prometheus#19516) - \[BUGFIX] PromQL: Fix a panic in range selectors using the experimental `anchored` or `smoothed` modifier when the selected series has no samples inside the query window, for example a query evaluated inside a scrape gap. [#19431](prometheus/prometheus#19431) - \[BUGFIX] PromQL: Fix empty results when a subquery with `@` is used as the matrix argument of a call that is not step-invariant (for example `quantile_over_time(scalar(x), metric[...:...] @ T)`). [#19187](prometheus/prometheus#19187) - \[BUGFIX] PromQL: Make the "found duplicate series for the match group" many-to-many matching error message deterministic by sorting the two duplicate labels. [#18810](prometheus/prometheus#18810) - \[BUGFIX] PromQL: Preserve parentheses around duration literals on Expr.String() round-trip. [#19403](prometheus/prometheus#19403) - \[BUGFIX] PromQL: Reject duration-expression offsets and `@ start()` / `@ end()` before range selectors, matching the existing rejection of literal offsets and `@ <timestamp>`. [#19406](prometheus/prometheus#19406) - \[BUGFIX] PromQL: Report the position of the histogram argument rather than of a scalar argument in the native histogram NaN observation annotations of `histogram_quantile` and `histogram_fraction`. [#19330](prometheus/prometheus#19330) - \[BUGFIX] PromQL: info() now applies the @ modifier/offset when evaluating the info series, so info(v @ T) enriches as of T consistently instead of depending on the query start/eval time. [#19266](prometheus/prometheus#19266) - \[BUGFIX] Rules: Fix a panic when a rule manager created without a logger loads a rule file containing multiple YAML documents. [#19433](prometheus/prometheus#19433) - \[BUGFIX] Scrape: Do not append a stale marker for a series that is still exposed when the storage returns a new series reference for it. [#19328](prometheus/prometheus#19328) - \[BUGFIX] Scrape: JSON log formatter correctly format scrape target info. [#19472](prometheus/prometheus#19472) - \[BUGFIX] TSDB: Fix in-order chunk ID overflow by wrapping head chunk IDs modulo 2^23 so they never collide with the out-of-order flag bit. [#19450](prometheus/prometheus#19450) - \[BUGFIX] TSDB: Fix out-of-order chunk ID overflow by wrapping `firstOOOChunkID` modulo 2^23 instead of growing unbounded. [#19216](prometheus/prometheus#19216) - \[BUGFIX] UI: Remove an extraneous X-axis tick mark in the native histogram chart when using the "linear" display mode. [#19326](prometheus/prometheus#19326) - \[BUGFIX] discovery/aws: Avoid a panic when an ElastiCache ARN is missing its resource ID. [#19333](prometheus/prometheus#19333) - \[BUGFIX] discovery/aws: Do not panic on MSK clusters whose optional API fields are absent. [#19584](prometheus/prometheus#19584) - \[BUGFIX] discovery/aws: Do not panic when the EC2 API omits optional instance fields. [#19512](prometheus/prometheus#19512) - \[BUGFIX] discovery/aws: Don't panic on ECS tasks with absent optional fields. [#19396](prometheus/prometheus#19396) - \[BUGFIX] discovery/aws: MSK Optional Custom Configuration Fields [#19422](prometheus/prometheus#19422). [#19422](prometheus/prometheus#19422) - \[BUGFIX] discovery/ionos: Fix panic when the IONOS API omits optional server fields. [#19418](prometheus/prometheus#19418) - \[BUGFIX] discovery/kubernetes: Populate `__meta_kubernetes_service_loadbalancer_ip` from `status.loadBalancer.ingress`, falling back to deprecated `spec.loadBalancerIP`. [#19404](prometheus/prometheus#19404) - \[BUGFIX] histogram: Fix Compact moving buckets to wrong indices, and producing negative bucket counts for integer histograms, when more than one span is merged in the same pass. [#19312](prometheus/prometheus#19312) - \[BUGFIX] promtool: Fixed `tsdb dump` silently dropping native histogram samples. [#18051](prometheus/prometheus#18051) - \[BUGFIX] scrape: fix data race in `Manager.TargetsDroppedCounts` to avoid miscounting dropped targets. [#19304](prometheus/prometheus#19304) - \[BUGFIX] scrape: fix nil histogram when native and classic histograms are mixed in one metric family. [#19452](prometheus/prometheus#19452) - \[BUGFIX] TSDB: Fix WAL and GC log messages to emit human-readable duration strings instead of nanosecond integers. [#19307](prometheus/prometheus#19307) - \[BUGFIX] TSDB: Avoid WAL corruption after a failed WAL write in Agent mode. [#19700](prometheus/prometheus#19700) - \[BUGFIX] Agent: Ignore unknown WAL record types, to help users rolling back. [#19814](prometheus/prometheus#19814) </details> --- ### Configuration 📅 **Schedule**: (in timezone Europe/Paris) - Branch creation - At any time (no schedule defined) - Automerge - At any time (no schedule defined) 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate CLI](https://github.com/renovatebot/renovate).  Reviewed-on: https://git.erwanleboucher.dev/eleboucher/homelab/pulls/2199

rbizos requested a review from a team as a code owner April 29, 2026 10:01

rbizos requested a review from cstyan April 29, 2026 10:01

rbizos changed the title ~~adding OM2 scrape parsing~~ scrape: implement OM2 scrape format Apr 29, 2026

krajorama requested review from bwplotka, krajorama and ywwg April 29, 2026 12:43

dashpole reviewed Apr 29, 2026

View reviewed changes

rbizos force-pushed the feature/om2-parser branch from e443792 to a71dfbd Compare May 11, 2026 07:22

rbizos force-pushed the feature/om2-parser branch 4 times, most recently from e3770b3 to f560f9d Compare May 19, 2026 17:54

rbizos added 10 commits June 15, 2026 14:23

adding OM2 scrape parsing

92a1afc

Signed-off-by: Raphael Bizos <[email protected]>

Renaming native histogram buckets

71fcead

Also adding test case for omitted buckets / span Signed-off-by: Raphael Bizos <[email protected]>

better test unknown metrics

1cf3334

Signed-off-by: Raphael Bizos <[email protected]>

Enforcing examplar timestamp and remove requirement on unit suffix

10f071c

Signed-off-by: Raphael Bizos <[email protected]>

adding test exemplar above previous limit

4704752

Signed-off-by: Raphael Bizos <[email protected]>

supporting having both native and classic histograms if both provided

bdb7cf8

Signed-off-by: Raphael Bizos <[email protected]>

adding benchmarks for the diff between om1 and om2

9da945b

Signed-off-by: Raphael Bizos <[email protected]>

reusing the label builder

4bce6e4

Signed-off-by: Raphael Bizos <[email protected]>

using an iter for splitting composite field

44f3637

Signed-off-by: Raphael Bizos <[email protected]>

fixing native histogram parsing

2744e18

Before we would not check if buckets are floats or not, this ensures that we don't miss some edgecases Also adding test coverage on the different cases Signed-off-by: Raphael Bizos <[email protected]>

rbizos force-pushed the feature/om2-parser branch from 0777168 to 2744e18 Compare June 15, 2026 12:27

reduce allocations in composite value parsing

86bd113

- converts parseBuckets/parseQuantile to iterators - reusing pending series Signed-off-by: Raphael Bizos <[email protected]>

krajorama reviewed Jun 16, 2026

View reviewed changes

Comment thread model/textparse/openmetrics2parse.go Resolved

Comment thread model/textparse/openmetrics2parse.go Resolved

Comment thread model/textparse/openmetrics2parse.go Resolved

Comment thread model/textparse/testdata/alltypes.om2.txt Resolved

bwplotka reviewed Jun 17, 2026

View reviewed changes

Comment thread model/textparse/openmetrics2parse.go Resolved

Comment thread model/textparse/testdata/alltypes.om2.txt Resolved

fixing native histograms format

76cd4b6

renamed correctly the gauge histogram om encode buckets as positive absolutes count in stead of delta Signed-off-by: Raphael Bizos <[email protected]>

rbizos force-pushed the feature/om2-parser branch from 4301dc5 to 76cd4b6 Compare June 18, 2026 16:19

rbizos changed the title ~~scrape: implement OM2 scrape format~~ model/textparse: implement OM2 scrape format Jun 19, 2026

krajorama and others added 3 commits July 23, 2026 12:50

krajorama reviewed Jul 23, 2026

View reviewed changes

krajorama mentioned this pull request Jul 23, 2026

model/textparse: fix OM2 test failure and spec-align test data rbizos/prometheus#1

Merged

krajorama requested changes Jul 24, 2026

View reviewed changes

Merge pull request #1 from prometheus/krajo/update-pr-18606

c507e15

model/textparse: fix OM2 test failure and spec-align test data

adding a feature flag to activate OM2 support

9d3f163

Signed-off-by: Raphael Bizos <[email protected]>

dashpole reviewed Aug 13, 2026

View reviewed changes

krajorama approved these changes Aug 26, 2026

View reviewed changes

chore: merge main into feature/om2-parser

8f7cda2

Signed-off-by: r.bizos <[email protected]>

krajorama merged commit ffe0b67 into prometheus:main Aug 27, 2026
39 checks passed

This was referenced Sep 18, 2026

model/textparse: follow-up improvements and spec validations for OpenMetrics 2.0 parser #19745

Open

model/textparse: fix OpenMetrics 2.0 lexer, labels, metadata, and parser options #19748

Merged

github-actions Bot mentioned this pull request Oct 19, 2026

Update prom/prometheus Docker tag to v3.15.0 claytono/infra#3239

Merged

1 task

	// {count:12,sum:5.5,bucket:[+Inf:12,1.0:3,2.0:7]}
	// {count:12,sum:5.5,bucket:[1.0:3,2.0:7,+Inf:12]}

Conversation

rbizos commented Apr 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Which issue(s) does the PR fix:

Release notes for end users (ALL commits must be considered).

What this PR does / why we need it:

Benchstat

Uh oh!

dashpole left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

krajorama left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

krajorama left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bwplotka left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

krajorama Jul 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

krajorama left a comment

Choose a reason for hiding this comment

Uh oh!

bwplotka commented Jul 24, 2026

Uh oh!

bwplotka commented Aug 11, 2026

Uh oh!

rbizos commented Aug 13, 2026

Uh oh!

dashpole left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rbizos commented Apr 29, 2026 •

edited

Loading

krajorama left a comment •

edited

Loading

krajorama Jul 14, 2026 •

edited

Loading