Skip to content

build(tooling): add a parser-agreement column to the CSS, HTML and XML parse tables - #22907

Merged
alexander-akait merged 2 commits into
mainfrom
build/parser-agreement-column
Oct 25, 2026
Merged

alexander-akait merged 2 commits into
mainfrom
build/parser-agreement-column

Conversation

@alexander-akait

@alexander-akait alexander-akait commented Oct 25, 2026 •

Copy link
Copy Markdown
Member

Summary

The JS parse table already says whether each parser agrees with acorn. This adds the same column to the CSS, HTML and XML parse tables. Each parser's tree is flattened the same way and compared with a reference parser's tree: css-tree for CSS, parse5 for HTML, @rgrove/parse-xml for XML. The cell names the first node where they differ. A parser that builds no tree, or a tree in its own shape, reads own dialect. The column is informational and doesn't gate anything.

Before (HTML), the parse table had no agreement column:

  parse                                   ms    cpu     peak
  webpack                                  0      0    59 MB

After:

  parse                                   ms    cpu     peak   agrees with parse5
  webpack                                  0      0    59 MB   yes
  parse5                                   0      0    64 MB   reference
  htmlparser2                              0      0    64 MB   own dialect

Results over the installed corpora:

reference fixtures webpack disagrees others held
CSS css-tree 77 4 postcss 5
HTML parse5 8 0 none (the other parsers don't build the spec's tree)
XML @rgrove/parse-xml 9 (parse-xml rejects 1: DTD entities) 0 xmldom 0, htmlparser2 (xmlMode) 0

Most CSS disagreements come from css-tree itself: it leaves some nested rules unparsed, and it keeps IE hacks like *zoom that the spec drops. One is a real difference in the tree: webpack walks a block's declarations before its nested rules (Designsystemet). A sample over the repo's own test/ inputs also turned up one webpack parser difference: a <?… cut off at the end of the input becomes no node, while the spec emits a bogus comment for it. This PR doesn't change that.

What kind of change does this PR introduce?

build

Did you add tests for your changes?

Yes: test/unitCases/tooling/compare-{harness,css,html,xml}.unittest.js. The reference parsers are stubbed there, since CI doesn't install the corpora.

Does this PR introduce a breaking change?

No.

If relevant, what needs to be documented once your changes are merged or what have you already documented?

Documented in tooling/COMPARE_TOOLS.md.

Use of AI

Written with Claude Code: it prototyped the comparison over the installed corpora, wrote the code, tests and docs, and ran lint and the targeted tests. The requester directed the work and reviews it.


Generated by Claude Code

Summary by CodeRabbit

  • New Features
    • Parser comparison reports now show whether CSS, HTML, and XML parsers agree with their reference results, including the first detected difference.
    • Parsers without a registered comparison are identified as using their own dialect.
  • Documentation
    • Comparison-tool documentation now explains how reference comparisons work and clarifies that they are informational and do not block runs.

…L parse tables

Hold webpack (and postcss, xmldom, htmlparser2 where they build a
comparable tree) to css-tree, parse5 and @rgrove/parse-xml, naming the
first differing node. Table-only.
@changeset-bot

changeset-bot Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: f199cfe

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@github-actions github-actions Bot added the area: tooling Repo tooling, codegen, CLI entry (tooling/, bin/) label Oct 25, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Types Coverage

Coverage after merging build/parser-agreement-column into main will be
99.26%
Coverage Report
FileStmtsBranchesFuncsLinesUncovered Lines
bin
   webpack.js98.84%100%100%98.84%113
declarations
   WebpackOptions.ts99.94%100%100%99.94%4240
examples
   build-common.js100%100%100%100%
   buildAll.js100%100%100%100%
   examples.js100%100%100%100%
   template-common.js98.21%100%100%98.21%72
examples/custom-javascript-parser
   test.filter.js100%100%100%100%
examples/custom-javascript-parser/internals
   acorn-parse.js100%100%100%100%
   meriyah-parse.js100%100%100%100%
   oxc-parse.js100%100%100%100%
examples/markdown
   webpack.config.mjs100%100%100%100%
examples/module-federation
   test.filter.js100%100%100%100%
examples/reexport-components
   test.filter.js100%100%100%100%
examples/ssr
   test.filter.js100%100%100%100%
examples/typescript
   test.filter.js100%100%100%100%
examples/typescript-non-erasable
   test.filter.js50%100%100%50%5
examples/virtual-modules
   test.filter.js100%100%100%100%
examples/wasm-bindgen-esm
   test.filter.js100%100%100%100%
examples/wasm-complex
   test.filter.js100%100%100%100%
examples/wasm-emscripten
   test.filter.js100%100%100%100%
examples/wasm-simple
   test.filter.js100%100%100%100%
examples/wasm-simple-source-phase
   test.filter.js100%100%100%100%
lib
   Chunk.js100%100%100%100%
   Compilation.js98.74%100%100%98.74%1823, 2135, 2142, 2150, 2172, 2175, 3161, 3720, 3763, 4358, 4362, 4488, 4509, 4634, 4671, 4678, 4731–4732, 4736, 4741, 4757–4758, 4772–4773, 4778–4779, 5307, 5333, 6254, 6271, 6289, 6305, 6320, 6345, 6348, 6760, 6763–6764, 6769, 6784, 6867, 6891, 883–884
   Compiler.js98.81%100%100%98.81%1107, 1144, 1147, 1323–1324, 1332, 848, 932, 972
   Dependency.js100%100%100%100%
   DependencyTemplate.js100%100%100%100%
   EntryPlugin.js100%100%100%100%
   Entrypoint.js100%100%100%100%
   ExternalsPlugin.js100%100%100%100%
   FileSystemInfo.js100%100%100%100%
   InitFragment.js100%100%100%100%
   LibraryTemplatePlugin.js100%100%100%100%
   ModuleFilenameHelpers.js100%100%100%100%
   ModuleNotFoundError.js100%100%100%100%
   MultiCompiler.js98.91%100%100%98.91%489, 561, 748, 813
   NormalModule.js100%100%100%100%
   NullFactory.js100%100%100%100%
   ProgressPlugin.js100%100%100%100%
   RawModule.js100%100%100%100%
   RequestShortener.js100%100%100%100%
   SingleEntryPlugin.js100%100%100%100%
   WebpackError.js100%100%100%100%
   index.js100%100%100%100%
   webpack.js98.59%100%100%98.59%306, 308
lib/asset
   AssetBytesGenerator.js100%100%100%100%
   AssetBytesParser.js91.67%100%100%91.67%27
   AssetGenerator.js100%100%100%100%
   AssetModule.js100%100%100%100%
   AssetModulesPlugin.js98.45%100%100%98.45%334, 360, 363, 493, 58
   AssetParser.js96.15%100%100%96.15%47
   AssetSourceGenerator.js100%100%100%100%
   AssetSourceParser.js91.67%100%100%91.67%27
   RawDataUrlModule.js100%100%100%100%
   WebManifestGenerator.js100%100%100%100%
   WebManifestParser.js100%100%100%100%
lib/async-modules
   AsyncModuleHelpers.js100%100%100%100%
   AwaitDependenciesInitFragment.js100%100%100%100%
   InferAsyncModulesPlugin.js100%100%100%100%
   isGeneratorLowered.js100%100%100%100%
lib/bun
   BunTargetPlugin.js100%100%100%100%
lib/cache
   AddBuildDependenciesPlugin.js100%100%100%100%
   AddManagedPathsPlugin.js100%100%100%100%
   Cache.js98.25%100%100%98.25%104
   CacheFacade.js100%100%100%100%
   IdleFileCachePlugin.js97.92%100%100%97.92%75, 87, 95
   MemoryCachePlugin.js92%100%100%92%33, 42
   MemoryWithGcCachePlugin.js93.42%100%100%93.42%106, 120–121, 130, 88
   PackFileCacheStrategy.js96.54%100%100%96.54%1304, 1404, 1408, 1470, 1716, 1796, 1819, 1849, 684, 703, 713–715, 717, 733–734, 739, 742, 744, 749, 754, 779, 785, 819, 825, 831, 836, 847, 856, 861–862, 864, 881, 887–888, 890
   ResolverCachePlugin.js100%100%100%100%
   getLazyHashedEtag.js100%100%100%100%
   mergeEtags.js100%100%100%100%
lib/config
   OptionsApply.js100%100%100%100%
   PlatformPlugin.js100%100%100%100%
   WebpackOptionsApply.js100%100%100%100%
   WebpackOptionsDefaulter.js100%100%100%100%
   browserslistTargetHandler.js100%100%100%100%
   cli.js98.89%100%100%98.89%114, 549, 581, 631
   defaults.js99.59%100%100%99.59%1633–1635, 1643, 288, 548
   defineConfig.js100%100%100%100%
   getClaimedAssetTypes.js100%100%100%100%
   normalization.js99.14%100%100%99.14%285–286, 356, 371
   target.js100%100%100%100%
   validateSchema.js94.67%100%100%94.67%100, 87, 89, 98
lib/container
   ContainerEntryDependency.js100%100%100%100%
   ContainerEntryModule.js100%100%100%100%
   ContainerEntryModuleFactory.js100%100%100%100%
   ContainerExposedDependency.js100%100%100%100%
   ContainerPlugin.js100%100%100%100%
   ContainerReferencePlugin.js100%100%100%100%
   FallbackDependency.js100%100%100%100%
   FallbackItemDependency.js100%100%100%100%
   FallbackModule.js100%100%100%100%
   FallbackModuleFactory.js100%100%100%100%
   HoistContainerReferencesPlugin.js100%100%100%100%
   ModuleFederationPlugin.js100%100%100%100%
   RemoteModule.js100%100%100%100%
   RemoteRuntimeModule.js100%100%100%100%
   RemoteToExternalDependency.js100%100%100%100%
   declaredRemotes.js100%100%100%100%
   moduleFederationHooks.js100%100%100%100%
   options.js100%100%100%100%
lib/context
   ContextExclusionPlugin.js100%100%100%100%
   ContextModule.js99.88%100%100%99.88%1495
   ContextModuleFactory.js95.70%100%100%95.70%230, 257, 276, 280–281, 289, 466, 487, 492, 534, 543, 545, 549, 552, 558–559
   ContextReplacementPlugin.js100%100%100%100%
lib/css
   CssGenerator.js99.29%100%100%99.29%1085, 129, 305, 837
   CssInjectStyleRuntimeModule.js100%100%100%100%
   CssLoadingRuntimeModule.js100%100%100%100%
   CssModule.js100%100%100%100%
   CssModulesPlugin.js98.72%100%100%98.72%217, 418, 432, 445, 458, 481, 494, 507, 520
   CssParser.js99.76%100%100%99.76%1089, 2424, 3071, 3074, 3080, 3512, 942
   CssServerStylesRuntimeModule.js100%100%100%100%
   conventions.js100%100%100%100%
   cssMinify.js100%100%100%100%
   data.js99.84%100%100%99.84%229, 5605
   syntax-parser.js99.70%100%100%99.70%10975–10976, 11528–11529, 11566, 11776, 11825, 14220, 14281–14284, 14389–14390, 14488–14489, 15262, 15558, 15560, 16115, 16507, 16549, 18939, 3066, 3068, 3073, 3086, 3837, 3843
   syntax-printer.js99.33%100%100%99.33%2611–2612, 2614–2615, 2617–2618, 2623, 2893–2896, 2989, 356, 3690, 4115, 4251, 4928, 5242, 6143, 730
   syntax.js100%100%100%100%
   topologicalSort.js100%100%100%100%
lib/debug
   ProfilingPlugin.js100%100%100%100%
lib/define
   DefinePlugin.js99.42%100%100%99.42%1488, 936, 938, 943, 967
   DotenvPlugin.js97.61%100%100%97.61%276, 395, 443, 456–457
   EnvironmentPlugin.js100%100%100%100%
lib/deno
   DenoTargetPlugin.js100%100%100%100%
lib/dependencies
   ConstDependency.js100%100%100%100%
   ContextElementDependency.js100%100%100%100%
   NullDependency.js100%100%100%100%
lib/dependencies/amd
   AMDDefineDependency.js100%100%100%100%
   AMDDefineDependencyParserPlugin.js100%100%100%100%
   AMDPlugin.js99.31%100%100%99.31%54
   AMDRequireArrayDependency.js100%100%100%100%
   AMDRequireContextDependency.js100%100%100%100%
   AMDRequireDependenciesBlock.js100%100%100%100%
   AMDRequireDependenciesBlockParserPlugin.js100%100%100%100%
   AMDRequireDependency.js100%100%100%100%
   AMDRequireItemDependency.js100%100%100%100%
   AMDRuntimeModules.js95.45%100%100%95.45%65
   LocalModule.js100%100%100%100%
   LocalModuleDependency.js100%100%100%100%
   LocalModulesHelpers.js100%100%100%100%
   RequireJsStuffPlugin.js100%100%100%100%
   UnsupportedDependency.js100%100%100%100%
lib/dependencies/commonjs
   CommonJsDependencyHelpers.js98.63%100%100%98.63%43
   CommonJsExportRequireDependency.js99.21%100%100%99.21%413, 415, 417
   

@github-actions

Copy link
Copy Markdown
Contributor

This PR is packaged and the instant preview of its latest commit is available.

Install it locally:

  • npm
npm i -D webpack@https://pkg.pr.new/webpack@22907
  • yarn
yarn add -D webpack@https://pkg.pr.new/webpack@22907
  • pnpm
pnpm add -D webpack@https://pkg.pr.new/webpack@22907

@coderabbitai

coderabbitai Bot commented Oct 25, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review.

Recent review info
Run configuration
Commits

Reviewing files that changed from the base of the PR and between ab4c991 and f199cfe.

Files selected for processing: 1
  • test/unitCases/tooling/compare-xml.unittest.js

Included review availability: This review used your included allowance. Your plan provides up to 10 included reviews per hour; 3 remain after this review.

Walkthrough

The comparison harness now supports parser-tree agreement checks. CSS, HTML, and XML comparison tools register tree readers, compare results with reference parsers, and include agreement results in their parse tables.

Changes: Parser agreement comparisons

Layer / File(s) Summary
Shared tree-event comparison
tooling/compare-tools-harness.js, test/unitCases/tooling/compare-harness.unittest.js, tooling/COMPARE_TOOLS.md
The harness records and compares tree events, and reports parser agreement or errors. Tests cover event paths, first differences, and parser failures. The documentation describes the comparison tables and their non-gating status.
CSS parser agreement
tooling/compare-css-tools.js, test/unitCases/tooling/compare-css.unittest.js, cspell.json
The CSS tool compares css-tree, webpack, and PostCSS trees. Tests cover matching trees and a mismatch. The spell-checker word list adds atrule.
HTML parser agreement
tooling/compare-html-tools.js, test/unitCases/tooling/compare-html.unittest.js
The HTML tool compares webpack parser trees with parse5. Tests cover BOM handling and a tree mismatch.
XML parser agreement
tooling/compare-xml-tools.js, test/unitCases/tooling/compare-xml.unittest.js
The XML tool compares webpack, xmldom, and htmlparser2 trees with the reference parser. Tests cover matching trees and a tree mismatch.

Priority: Low

Change: Feature

Merge Risk: Minimal · up to f199c

The parser-agreement additions do not establish an actionable issue blocking merge.

Pre-merge checks: Passed 4
Check name Status Explanation
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title uses the conventional-commit form with scope: build(tooling). The type 'build' is in the allowed list. The title names the main change: a parser-agreement column added to the CSS, HTML and X…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Title check

Explanation

The title uses the conventional-commit form with scope: build(tooling). The type 'build' is in the allowed list. The title names the main change: a parser-agreement column added to the CSS, HTML and XML parse tables. The changeset matches that description. The requirement that the type match the branch prefix cannot be verified from the provided context, because no branch name was given.

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions

Copy link
Copy Markdown
Contributor

Generated code size

Comparing base (669012d) to head (ab4c991). Merging this pull request will not change the code webpack generates.

What moved Tests Assets Gzip Raw Test edit
Changed, test untouched 0 0 — — —
Changed, test edited 0 0 — — —
New 0 0 — — —
Deleted 0 0 — — —
Unchanged — 9200 — — —

Read Changed, test untouched first: the test is byte-identical on both sides, so webpack generated the difference. Changed, test edited moved partly because the test did — Test edit is how many bytes the test gained, and a bundle that grew by less is not a regression. New and Deleted are whole files, not deltas — a new asset was created, not grown, so it reads gray (⚪ added) — and adding tests cannot bury a real change. Gzip decides, because that is what users download; raw is the tiebreak, and brotli and zstd are per asset below.

No asset changed size.

No runtime gained or lost a runtime module.

Built test/configCases with the defaults a user gets: 2290 test(s), 9200 asset(s), 101 emitted nothing.

@codspeed

codspeed Bot commented Oct 25, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

1 warning, 1 note

⚠️ 117 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

ℹ️ 45 benchmarks have no flamegraph

The flamegraph wasn't generated: most of the time was spent in runtime internals, which would leave nothing useful to analyze.

See affected benchmarks

✅ 351 untouched benchmarks


Comparing build/parser-agreement-column (f199cfe) with main (669012d)

Open in CodSpeed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: tooling Repo tooling, codegen, CLI entry (tooling/, bin/)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants