Skip to content

fix RQ job scoped ready registry - #5

Merged
virtualstaticvoid merged 6 commits into
mainfrom
fix/rq-job-scoped-ready-registry
Nov 17, 2026
Merged

virtualstaticvoid merged 6 commits into
mainfrom
fix/rq-job-scoped-ready-registry

Conversation

@virtualstaticvoid

Copy link
Copy Markdown
Owner

Fix RQ 3.0 delaying dependent steps up to ten minutes by adding RqQueue (job-scoped ready registry), add smoke and greeting-example tests to CI, tighten release tasks.

RQ 3.0 claims each ready dependent in a transaction that watches the
queue's shared ready registry as well as the job. Every worker writes to
that registry when readying or enqueueing any dependent, so concurrent
hand-offs of unrelated jobs abort each other, and the aborted dependent
waits up to ten minutes for worker maintenance while later process
steps sit in the deferred registry.

`JobScopedReadyJobRegistry` claims ready jobs exactly as RQ does but
watches only the job: every claim, deletion or cancellation writes the
job's hash, so a job is still never enqueued twice. The
`JobScopedReadyJobRegistryMixin` uses it as a queue's ready registry,
and `RqQueue` is `rq.Queue` with the mixin, for use as the workers'
queue class (`rq worker --queue-class tasktronaut.backends.rq.RqQueue`).

Tests use fakeredis, added to the `test` dependency group.
@virtualstaticvoid
virtualstaticvoid merged commit ce532ee into main Nov 17, 2026
4 checks passed
@virtualstaticvoid
virtualstaticvoid deleted the fix/rq-job-scoped-ready-registry branch November 17, 2026 03:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant