Skip to content

chore: extend pre commit instructions for AI agents - #23313

Merged
comphead merged 1 commit into
apache:mainfrom
comphead:chore
Jul 3, 2026
Merged

comphead merged 1 commit into
apache:mainfrom
comphead:chore

Conversation

@comphead

@comphead comphead commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

Extend pre commit instructions for AI agents to involve contributor machine to find issues before being committed. Each commit triggers a CI which in its turn asks ASF Infra for their precious resources and if we can find and fix as early as possible, much before utilizing ASF resources, would be amazing

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@comphead
comphead requested a review from 2010YOUY01 July 3, 2026 18:34
@comphead
comphead requested a review from kumarUjjawal July 3, 2026 18:34
@comphead comphead added the development-process Related to development process of DataFusion label Jul 3, 2026
Comment thread AGENTS.md

See the [Testing Quick Start](docs/source/contributor-guide/testing.md#testing-quick-start)
for the recommended pre-PR test commands.
If documentation files changed then run

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Other ones I use:

ci/scripts/rust_prettier.sh
ci/scripts/rust_clippy.sh

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I cant see rust_prettier 🤔

@alamb alamb Jul 4, 2026 •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I meant
ci/scripts/rust_fmt.sh

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

but I see those commands are already covered above

@comphead
comphead added this pull request to the merge queue Jul 3, 2026
@comphead

comphead commented Jul 3, 2026

Copy link
Copy Markdown
Contributor Author

Thanks @alamb for the review

Merged via the queue into apache:main with commit 0fcaef3 Jul 3, 2026
56 of 58 checks passed
@comphead
comphead deleted the chore branch July 3, 2026 23:22
@neilconway

Copy link
Copy Markdown
Contributor

FWIW, I find this change causes coding agents to run the extended tests way too often, which slows down local iteration quite a bit.

@comphead

Copy link
Copy Markdown
Contributor Author

FWIW, I find this change causes coding agents to run the extended tests way too often, which slows down local iteration quite a bit.

The idea was use more local resources instead of ASF, probably agents try commit too often?

@alamb

alamb commented Sep 24, 2026

Copy link
Copy Markdown
Contributor

Maybe we can adjust and say we don't need to run extended tests locally?

@comphead

Copy link
Copy Markdown
Contributor Author

The better possible option is to ask agent to identify if changes require extended tests to run, we have everything for that in CI rules so the agent would most likely do the correct thing. Supposedly this reduces number of runs.

Removing extended tests to run locally, can hit us on merge queue failures, I won't be considering this. But for experienced contributors they can just amend locally the skill to avoid excessive runs if they feel this is a problem

@2010YOUY01

Copy link
Copy Markdown
Member

Removing extended tests to run locally, can hit us on merge queue failures, I won't be considering this. But for experienced contributors they can just amend locally the skill to avoid excessive runs if they feel this is a problem

Yes I agree, it's also easy to override default AI instructions locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of DataFusion v55.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Reduce Github Action Usage

5 participants