privilegedescalation/headlamp-sealed-secrets-plugin
12
0
Fork 0
Code Issues 2 Pull Requests 2 Actions Packages Projects Releases 27 Wiki Activity

E2E runner startup failures — ARC runner capacity or kubeconfig issue (PRI-1016) #76

New Issue
Open
opened 2026-05-06 23:52:55 +00:00 by privilegedescalation-engineer[bot] · 0 comments
privilegedescalation-engineer[bot] commented 2026-05-06 23:52:55 +00:00 (Migrated from github.com)
Copy Link
Copy Source

Issue

E2E tests for headlamp-sealed-secrets-plugin are failing with startup_failure — the ARC runner itself is failing to start, not the test steps.

Affected runs

Run Branch Error
25466426561 hugh/fix-stale-rbac-path-pri-1002 startup_failure
25466411337 hugh/fix-stale-rbac-path-pri-1002 startup_failure
25458479514 hugh/migrate-scripts-to-headlamp-dev startup_failure

All three runs targeted hugh/fix-stale-rbac-path-pri-1002. The CI step passed (2m3s), but the E2E step failed immediately with startup_failure.

Observations

  • The same ARC runner (runners-privilegedescalation) is shared across all plugin repos
  • headlamp-polaris-plugin shows similar E2E startup_failure on the same runs
  • Successful E2E runs exist on main and older branches (pre-May 6)
  • The reusable plugin-e2e.yaml workflow relies on the runner having /runner/config pre-populated

Hypotheses

  1. ARC runner capacity exhaustion — too many jobs queued simultaneously against a limited runner pool
  2. Runner config missing — /runner/config not available at job start for self-hosted runners

Next steps

  1. Check ARC runner pool size and active job count at time of failures
  2. Verify /runner/config exists and is populated on the runner at startup
  3. If capacity issue: consider adding more runner replicas or implementing a concurrency queue

Assignee: Regression Regina (fd5dbec8-ddbb-4b57-9703-624e0ed90053)

## Issue E2E tests for `headlamp-sealed-secrets-plugin` are failing with `startup_failure` — the ARC runner itself is failing to start, not the test steps. ### Affected runs | Run | Branch | Error | |-----|--------|-------| | 25466426561 | hugh/fix-stale-rbac-path-pri-1002 | startup_failure | | 25466411337 | hugh/fix-stale-rbac-path-pri-1002 | startup_failure | | 25458479514 | hugh/migrate-scripts-to-headlamp-dev | startup_failure | All three runs targeted `hugh/fix-stale-rbac-path-pri-1002`. The CI step passed (2m3s), but the E2E step failed immediately with `startup_failure`. ### Observations - The same ARC runner (`runners-privilegedescalation`) is shared across all plugin repos - `headlamp-polaris-plugin` shows similar E2E `startup_failure` on the same runs - Successful E2E runs exist on `main` and older branches (pre-May 6) - The reusable `plugin-e2e.yaml` workflow relies on the runner having `/runner/config` pre-populated ### Hypotheses 1. **ARC runner capacity exhaustion** — too many jobs queued simultaneously against a limited runner pool 2. **Runner config missing** — `/runner/config` not available at job start for self-hosted runners ### Next steps 1. Check ARC runner pool size and active job count at time of failures 2. Verify `/runner/config` exists and is populated on the runner at startup 3. If capacity issue: consider adding more runner replicas or implementing a concurrency queue **Assignee:** Regression Regina (`fd5dbec8-ddbb-4b57-9703-624e0ed90053`)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something isn't working
 dependencies
Pull requests that update a dependency file
 documentation
Improvements or additions to documentation
 duplicate
This issue or pull request already exists
 enhancement
New feature or request
 good first issue
Good for newcomers
 help wanted
Extra attention is needed
 invalid
This doesn't seem right
 javascript
Pull requests that update javascript code
 question
Further information is requested
 wontfix
This will not be worked on
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
cpfarhood (Chris Farhood) ci (Continuous Integration [bot]) pe_countess (Countess von Containerheim) flux (Flux CD) pe_gandalf (Gandalf the Greybeard) admin (Gitea Admin) pe_hugh (Hugh Hackman) pe_karen (Kubectl Karen) renovate (Mend Renovate) pe_nancy (Null Pointer Nancy) pe_patty (Pixel Patty) pe_regina (Regression Regina)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: privilegedescalation/headlamp-sealed-secrets-plugin#76
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?