Skip to content

KAR-799: update components version for loki stack#11306

Open
olegbet wants to merge 11 commits intoredhat-appstudio:mainfrom
olegbet:KAR-799_upgrade_loki_helm_chart_versions
Open

KAR-799: update components version for loki stack#11306
olegbet wants to merge 11 commits intoredhat-appstudio:mainfrom
olegbet:KAR-799_upgrade_loki_helm_chart_versions

Conversation

@olegbet
Copy link
Copy Markdown
Contributor

@olegbet olegbet commented Apr 15, 2026

Signed-off-by: obetsun [email protected]

KAR-799

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED

Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
@openshift-ci openshift-ci bot requested review from ggallen and rh-hemartin April 15, 2026 12:54
@openshift-ci
Copy link
Copy Markdown

openshift-ci bot commented Apr 15, 2026

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: olegbet

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 15, 2026

Kustomize Render Diff

Comparing 469327f79c7ff14ccd

Component Environment Changes
components/vector-kubearchive-log-collector/development development +941 -277
components/vector-kubearchive-log-collector/staging/stone-stage-p01 staging +989 -333
components/vector-kubearchive-log-collector/staging/stone-stg-rh01 staging +989 -333

Total: 3 components, +2919 -943 lines

📋 Full diff available in the workflow summary and as a downloadable artifact.

Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 15, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 51.62%. Comparing base (2165dbe) to head (7e54533).
⚠️ Report is 23 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main   #11306   +/-   ##
=======================================
  Coverage   51.62%   51.62%           
=======================================
  Files          18       18           
  Lines        1263     1263           
=======================================
  Hits          652      652           
  Misses        539      539           
  Partials       72       72           
Flag Coverage Δ
go 51.62% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
@konflux-ci-qe-bot
Copy link
Copy Markdown

konflux-ci-qe-bot commented Apr 15, 2026

🤖 Pipeline Failure Analysis

Category: Infrastructure

The pipeline failed because critical ArgoCD applications, specifically vector-kubearchive-log-collector-in-cluster-local, timed out waiting for StatefulSet pods (loki-chunks-cache, loki-results-cache) to become ready during cluster bootstrapping.

📋 Technical Details

Immediate Cause

The appstudio-e2e-tests/redhat-appstudio-e2e step failed due to a timeout while waiting for ArgoCD applications to sync and reach a healthy state. The vector-kubearchive-log-collector-in-cluster-local application was identified as Progressing, with its loki-chunks-cache and loki-results-cache StatefulSets stuck awaiting pod readiness.

Contributing Factors

The underlying issue appears to be an infrastructure problem with resource provisioning or pod startup within the OpenShift cluster environment, preventing the loki component pods from initializing correctly. Although konflux-kite-in-cluster-local reported Healthy, it was also OutOfSync, suggesting broader deployment instability.

Impact

The inability of these critical ArgoCD applications to deploy and stabilize within the allotted time prevented the cluster from being properly bootstrapped. This directly blocked the execution of the end-to-end tests, leading to the overall failure of the pipeline.

🔍 Evidence

appstudio-e2e-tests/redhat-appstudio-e2e

Category: infrastructure
Root Cause: Two critical ArgoCD applications, konflux-kite-in-cluster-local and vector-kubearchive-log-collector-in-cluster-local, failed to achieve a healthy and synced state within the allocated time, specifically due to loki-chunks-cache and loki-results-cache StatefulSets being stuck in a progressing state, waiting for pods to become ready. This indicates an underlying issue with resource provisioning or pod startup for these components on the OpenShift cluster.

Logs:

artifacts/appstudio-e2e-tests/redhat-appstudio-e2e/build-log.txt
[2026-04-16 13:26:30] [STEP] Waiting for all ArgoCD applications to sync and become healthy
[2026-04-16 13:26:30] [INFO] Timeout: 2700 seconds (45 minutes)
artifacts/appstudio-e2e-tests/redhat-appstudio-e2e/build-log.txt
[2026-04-16 14:11:40] [ERROR] =============================================================================
[2026-04-16 14:11:40] [ERROR] TIMEOUT: Applications failed to sync within 45 minutes
[2026-04-16 14:11:40] [ERROR] =============================================================================
artifacts/appstudio-e2e-tests/redhat-appstudio-e2e/build-log.txt
[2026-04-16 14:11:40] [ERROR] Application: konflux-kite-in-cluster-local
[2026-04-16 14:11:40] [ERROR] -----------------------------------------------------------------------------
[2026-04-16 14:11:42] [ERROR]   Sync Status: OutOfSync
[2026-04-16 14:11:42] [ERROR]   Health Status: Healthy
[2026-04-16 14:11:42] [ERROR]   Repository: https://github.com/redhat-appstudio-qe/infra-deployments.git
[2026-04-16 14:11:42] [ERROR]   Target Revision: preview-KAR-799_upgrade_loki_helm_chart_versions-mtma
[2026-04-16 14:11:42] [ERROR]   Conditions:
[2026-04-16 14:11:43] [ERROR]   Unhealthy Resources:
[2026-04-16 14:11:44] [ERROR]   Operation Message: successfully synced (all tasks run)
artifacts/appstudio-e2e-tests/redhat-appstudio-e2e/build-log.txt
[2026-04-16 14:11:44] [ERROR] Application: vector-kubearchive-log-collector-in-cluster-local
[2026-04-16 14:11:44] [ERROR] -----------------------------------------------------------------------------
[2026-04-16 14:11:46] [ERROR]   Sync Status: Synced
[2026-04-16 14:11:46] [ERROR]   Health Status: Progressing
[2026-04-16 14:11:46] [ERROR]   Repository: https://github.com/redhat-appstudio-qe/infra-deployments.git
[2026-04-16 14:11:46] [ERROR]   Target Revision: preview-KAR-799_upgrade_loki_helm_chart_versions-mtma
[2026-04-16 14:11:46] [ERROR]   Conditions:
    - [RepeatedResourceWarning] Resource /ServiceAccount/product-kubearchive-logging/minio-sa appeared 2 times among application resources.
[2026-04-16 14:11:47] [ERROR]   Unhealthy Resources:
    - StatefulSet/loki-chunks-cache: Progressing - Waiting for 1 pods to be ready...
    - StatefulSet/loki-results-cache: Progressing - Waiting for 1 pods to be ready...
[2026-04-16 14:11:48] [ERROR]   Operation Message: waiting for healthy state of apps/StatefulSet/loki-chunks-cache and 1 more resources
artifacts/appstudio-e2e-tests/redhat-appstudio-e2e/build-log.txt
Error: error when bootstrapping cluster: reached maximum number of attempts (2). error: exit status 1

Analysis powered by prow-failure-analysis | Build: 2044751218273685504

olegbet added 8 commits April 15, 2026 23:26
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Signed-off-by: obetsun <[email protected]>

rh-pre-commit.version: 2.3.2
rh-pre-commit.check-secrets: ENABLED
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants