[release-5.0] OCPBUGS-112279: Use Add() instead of AddRateLimited() for routine Profile enqueues - #1595
Conversation
Change 1: workqueue.DefaultTypedControllerRateLimiter's AddRateLimited() draws from a single 10qps/burst-100 token bucket shared by every item in the queue, regardless of kind or key. Cascade/trigger enqueues (Pod/Node change to Profile update, per-Profile bootstrap loop, initial bootstrap event) used AddRateLimited() for ordinary enqueuing rather than error retries. During a burst of ~100 nodes joining, this exhausted the shared bucket, delaying later Profile syncs by minutes even though they were never dropped, just queued behind the backlog. Switch these call sites to Add(), which is unthrottled and still deduped by key via the delaying queue's dirty set. Keep AddRateLimited() only for its intended purpose: the retry-after- sync()-error path, where per-key exponential backoff is correct. Change 2: validateTunedCRs() called UpdateStatus() on every Tuned CR on every invocation, even when the computed status conditions were identical to what's already stored. Compare the newly computed status against the cached copy with reflect.DeepEqual() and skip the UpdateStatus() call when nothing semantically changed. Resolves: OCPBUGS-105458
|
Pipeline controller notification For optional jobs, comment This repository is configured in: LGTM mode |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Repository: openshift/coderabbit/.coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Comment |
|
@openshift-cherrypick-robot: Jira Issue OCPBUGS-105458 has been cloned as Jira Issue OCPBUGS-112279. Will retitle bug to link to clone. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
openshift-ci
Bot
changed the title
openshift-ci-robot
added
jira/severity-important
|
@openshift-cherrypick-robot: This pull request references Jira Issue OCPBUGS-112279, which is invalid:
Comment The bug has been updated to refer to the pull request using the external bug tracker. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
/retest |
|
/test e2e-aws-operator |
|
PR-Agent: could not find a component named |
in ci/prow/images is a known issue |
|
/retest |
|
/lgtm |
|
Scheduling required tests: |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: jmencak, openshift-cherrypick-robot The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-ci
Bot
added
the
approved
|
/label backport-risk-assessed |
openshift-ci
Bot
added
the
backport-risk-assessed
|
PR-Agent: could not find a component named |
|
/test images |
|
PR-Agent: could not find a component named |
|
/retest |
|
/jira refresh |
openshift-ci-robot
added
jira/valid-bug
|
@jmencak: This pull request references Jira Issue OCPBUGS-112279, which is valid. The bug has been moved to the POST state. 7 validation(s) were run on this bug
Requesting review from QA contact: DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
we cannot afford to wait for #1599 to merge |
|
@jmencak: /override requires failed status contexts, check run or a prowjob name to operate on.
Only the following failed contexts/checkruns were expected:
If you are trying to override a checkrun that has a space in it, you must put a double quote on the context. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
@jmencak: /override requires failed status contexts, check run or a prowjob name to operate on.
Only the following failed contexts/checkruns were expected:
If you are trying to override a checkrun that has a space in it, you must put a double quote on the context. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
/override ci/prow/e2e-gcp-pao-updating-profile |
|
@jmencak: Overrode contexts on behalf of jmencak: ci/prow/e2e-gcp-pao-updating-profile DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
/verified later @shyadav10 |
|
@jmencak: This PR has been marked to be verified later by DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
openshift-ci-robot
added
the
verified
4870b00
into
openshift:release-5.0
|
@openshift-cherrypick-robot: Jira Issue OCPBUGS-112279: All pull requests linked via external trackers have merged: This pull request has the DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
Fix included in release 5.0.0-0.nightly-2026-08-21-033959 |
|
/cherry-pick release-4.22 |
|
@jmencak: new pull request created: #1601 DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
5 participants
This is an automated cherry-pick of #1584
/assign jmencak