Skip to content

BUG: Preserve small upper-tail Wald p-values - #975

Merged
bashtage merged 1 commit into
bashtage:mainfrom
galafis:fix/wald-upper-tail
Oct 24, 2026
Merged

bashtage merged 1 commit into
bashtage:mainfrom
galafis:fix/wald-upper-tail

Conversation

@galafis

@galafis galafis commented Oct 24, 2026

Copy link
Copy Markdown
Contributor

WaldTestStatistic.pval subtracts the chi-squared CDF from 1. This loses relative accuracy in the upper tail and rounds representable p-values to zero. For a statistic of 100 and 2 degrees of freedom it returns 0 instead of exp(-50), approximately 1.92875e-22.

Use the distribution's survival function. Four regression cases compare the two-degree-of-freedom tail against its independent closed form exp(-stat/2), with zero absolute tolerance; all four fail before the change. Existing tests continue to cover ordinary values, NaN and infinity.

SciPy documents sf as the upper tail and notes its greater accuracy over 1-cdf: https://docs.scipy.org/doc/scipy/reference/generated/scipy.stats.chi2.html .

Validation: 1227 utility tests passed; Ruff lint and formatting passed for both changed files; git diff --check passed. Tested on current source main with Python 3.12.14, NumPy 2.5.4, pandas 3.1.0 and SciPy 1.18.1. The installed arch 8.0.0 distribution supplied only the ignored version metadata file; tests import the current source tree.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 24, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-24T17:16:27.197836Z
We couldn’t complete this review. Comment @codex review to try again.
806d630 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@bashtage

Copy link
Copy Markdown
Owner

Thanks. I"m sure this is correct but will wait for green. I'm happy for all 1- cdf to be replaced with sf if there are any more.

@codecov

codecov Bot commented Oct 24, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 98.95%. Comparing base (5db69b0) to head (806d630).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #975   +/-   ##
=======================================
  Coverage   98.95%   98.95%           
=======================================
  Files         137      137           
  Lines       30099    30104    +5     
  Branches     2337     2337           
=======================================
+ Hits        29785    29790    +5     
  Misses        256      256           
  Partials       58       58           
Flag Coverage Δ
adder 98.90% <100.00%> (+<0.01%) ⬆️
subtractor 98.90% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@bashtage
bashtage merged commit 2646f9a into bashtage:main Oct 24, 2026
18 checks passed
@bashtage

Copy link
Copy Markdown
Owner

Merged, thanks.

jngod2011 pushed a commit to jngod2011/arch that referenced this pull request Oct 31, 2026
- Highlights and new features: NGARCH (bashtage#966), the VaR backtests (bashtage#965), the
  local block bootstrap (bashtage#967) and bandwidth_method (bashtage#964, and
  phillips_ouliaris here).
- Changes that alter results: the automatic bandwidth entry of bashtage#983 now
  also describes the bandwidth of the kernels with bounded support, the
  fractional bandwidths and the Tukey-Parzen constant of bashtage#964, its S&P 500
  bandwidths are those of the bandwidth attribute (30.96 and 34.50, where it
  said the 31.96 and 35.50 of opt_bandwidth), and it links phillips_ouliaris
  in arch.unitroot.cointegration. The ADF-Z tables of bashtage#972, bashtage#973 and bashtage#980.
- Backward-incompatible changes: strings in object data.
- Bug fixes: bashtage#954, bashtage#970, bashtage#974, bashtage#975, bashtage#977, bashtage#978, bashtage#982, and the constant
  data of the Newey-West bandwidth and mackinnonp at -inf and inf.
- Maintenance: the CI changes and the version file.
- Contributors: galafis, jackiectl2, mkzung and wavebyrd.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants