Skip to content

Update Claude build analysis prompt and model to Sonnet 4.6#25477

Merged
iangmaia merged 3 commits intotrunkfrom
iangmaia/update-claude-build-analysis
Apr 8, 2026
Merged

Update Claude build analysis prompt and model to Sonnet 4.6#25477
iangmaia merged 3 commits intotrunkfrom
iangmaia/update-claude-build-analysis

Conversation

@iangmaia
Copy link
Copy Markdown
Contributor

@iangmaia iangmaia commented Apr 2, 2026

Description

  • Migrate Claude build analysis model from Sonnet 4.5 to Sonnet 4.6
  • Gate Claude analysis on real failures: upload-claude-analysis.sh checks non-essential step outcomes (currently Danger) via buildkite-agent before uploading the pipeline. When only Danger failed, Claude is skipped entirely — no annotation, no PR comment
  • Simplify the custom prompt now that non-essential jobs are filtered upstream

(This repo already used the iangmaia/claude-summarize fork with build_log_mode support.)

Test Steps

  • Verify the Claude analysis step passes (green) and does not post a PR comment when only Danger fails

🤖 Generated with Claude Code

Improve the custom prompt to ignore non-real failures (the intentional
exit 1 trigger, Danger PR Check, and broken/skipped jobs) and respond
briefly when no actual failures exist. Migrate model from Sonnet 4.5
to Sonnet 4.6.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@iangmaia iangmaia self-assigned this Apr 2, 2026
@wpmobilebot
Copy link
Copy Markdown
Contributor

wpmobilebot commented Apr 2, 2026

App Icon📲 You can test the changes from this Pull Request in WordPress by scanning the QR code below to install the corresponding build.
App NameWordPress
ConfigurationRelease-Alpha
Build Number31916
VersionPR #25477
Bundle IDorg.wordpress.alpha
Commit6aa76f8
Installation URL01bd3svc6ggb0
Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

@wpmobilebot
Copy link
Copy Markdown
Contributor

wpmobilebot commented Apr 2, 2026

App Icon📲 You can test the changes from this Pull Request in Jetpack by scanning the QR code below to install the corresponding build.
App NameJetpack
ConfigurationRelease-Alpha
Build Number31916
VersionPR #25477
Bundle IDcom.jetpack.alpha
Commit6aa76f8
Installation URL4mpr6d3qe02h8
Automatticians: You can use our internal self-serve MC tool to give yourself access to those builds if needed.

@wpmobilebot
Copy link
Copy Markdown
Contributor

wpmobilebot commented Apr 2, 2026

🤖 Build Failure Analysis

This build has failures. Claude has analyzed them - check the build annotations for details.

Add upload-claude-analysis.sh that checks non-essential step outcomes
before uploading the Claude analysis pipeline. When only Danger or
other non-critical jobs failed, the pipeline is not uploaded — no
analysis, no annotation, no PR comment.

Also simplify the custom prompt now that Danger is filtered upstream.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@iangmaia iangmaia added the Tooling Build, Release, and Validation Tools label Apr 2, 2026
@iangmaia iangmaia added this to the 26.9 milestone Apr 2, 2026
@iangmaia iangmaia requested review from mokagio and twstokes April 2, 2026 18:59
@iangmaia iangmaia enabled auto-merge April 2, 2026 19:02
When real failures co-occur with a Danger failure, Claude should still
ignore Danger rather than wasting analysis space on it.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Apr 2, 2026

@iangmaia iangmaia added this pull request to the merge queue Apr 7, 2026
Merged via the queue into trunk with commit 046b3df Apr 8, 2026
25 of 28 checks passed
@iangmaia iangmaia deleted the iangmaia/update-claude-build-analysis branch April 8, 2026 00:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Tooling Build, Release, and Validation Tools

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants