Skip to content

Store Required Checks within the repo - #1871

Merged
iHiD merged 8 commits into
mainfrom
required-checks
Nov 8, 2026
Merged

iHiD merged 8 commits into
mainfrom
required-checks

Conversation

@iHiD

@iHiD iHiD commented Nov 7, 2026 •

Copy link
Copy Markdown
Member

Currently, "required checks" on PRs are hidden from maintainers, and can get out of sync with the reality of a repo. To fix this, we're adding a .github/required-checks.yml file, which lists the checks that must pass before a PR can merge into main.

When this file is changed, the ruleset that manages branch protection automatically gets synced up. The new Required checks workflow checks that all the checks listed in required-checks.yml exist.

(Sidenote: I'm increasingly wary of agents that have access to GitHub mistakenly (or potentially nefariously) doing things that could do us damage or cause us to have unexpected or high costs. That's why I'm using CODEOWNERS on a more frequent basis for files that are always worth just getting a second pair of eyes on. It's not a reflection on trust for maintainers 🙂)

The file adds the following Required Checks:

  • configlet / configlet
  • i18n / completeness
  • Check Generator Templates
  • Test Generator
  • Validate required checks (rather recursively, I admit!)

For many repos (including Ruby), the exercise tests are named with version (e.g. Ruby 3.3 - ubuntu-24.04 - pull_request and Ruby 3.4 - ubuntu-24.04 - pull_request). Those names change whenever a version is bumped, which is quite unstable, and then the required checks break. I'm going to fix that separately by adding a check with a more standard name (e.g. "tests"), which can rely on the unstably named tests, and add that to this file. That'll be a separate PR.

exercism/maintainers-admin-tools reads .github/required-checks.yml and applies
it to this repo's "Default branch" ruleset. The required-checks workflow fails a
PR when a listed check didn't run on it, so a wrong name can't block every PR.

The Ruby version matrix jobs aren't listed, because their names change when a
version is bumped.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@iHiD
iHiD requested a review from a team as a code owner November 7, 2026 14:09
Comment thread .github/required-checks.yml Resolved
iHiD and others added 2 commits November 7, 2026 15:33
@iHiD iHiD changed the title List the checks that must pass before a PR can merge Store Required Checks within the repo Nov 8, 2026
iHiD and others added 5 commits November 8, 2026 13:37
The workflow now runs on every PR and passes straight away when the PR changes
neither required-checks.yml nor a workflow. That lets it be listed as a
required check, so a PR that breaks the list can't be merged past a red X.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This reverts commit 6c2443a.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
It lists itself in required-checks.yml, but it leaves itself out of the checks
it waits for, so it reported its own name as missing.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@iHiD
iHiD merged commit b8a1036 into main Nov 8, 2026
10 checks passed
@iHiD
iHiD deleted the required-checks branch November 8, 2026 07:44
@iHiD iHiD mentioned this pull request Nov 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant