Skip to content

fix(e2e): add max_turns to SIMULATED_V1 dataset examples#1370

Closed
jariy17 wants to merge 1 commit into
mainfrom
fix/dataset-e2e-failures
Closed

fix(e2e): add max_turns to SIMULATED_V1 dataset examples#1370
jariy17 wants to merge 1 commit into
mainfrom
fix/dataset-e2e-failures

Conversation

@jariy17
Copy link
Copy Markdown
Contributor

@jariy17 jariy17 commented May 22, 2026

Summary

The e2e: dataset lifecycle > deploys a SIMULATED_V1 schema type dataset test has been failing on main because the inline example fixtures omit the required max_turns field. CloudFormation rejects the AWS::BedrockAgentCore::Dataset resource with:

Resource handler returned message:
"Example at index 0 failed schema validation: 'max_turns' must be an integer"

This adds max_turns: 5 to both SIMULATED_V1 examples in e2e-tests/dataset-lifecycle.test.ts so the resource passes schema validation and the deploy completes.

Note: 5 is an arbitrary positive integer chosen to satisfy the schema — the failure surfaced no bound information, so any sane integer works.

Test plan

  • CI E2E suite passes the SIMULATED_V1 case
  • No other dataset-lifecycle tests regress

The dataset-lifecycle SIMULATED_V1 test was failing in CloudFormation
with "'max_turns' must be an integer" because the inline example
fixtures omitted the required field. Add max_turns to both examples so
the AgentCore Dataset resource passes schema validation.
@jariy17 jariy17 requested a review from a team May 22, 2026 16:44
@github-actions github-actions Bot added the size/xs PR size: XS label May 22, 2026
@github-actions github-actions Bot added the agentcore-harness-reviewing AgentCore Harness review in progress label May 22, 2026
@agentcore-devx-automation agentcore-devx-automation Bot added the claude-security-reviewing Claude Code /security-review in progress label May 22, 2026
@agentcore-devx-automation
Copy link
Copy Markdown
Contributor

Claude Security Review: no high-confidence findings. (run)

@agentcore-devx-automation agentcore-devx-automation Bot removed the claude-security-reviewing Claude Code /security-review in progress label May 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Package Tarball

aws-agentcore-0.14.2.tgz

How to install

gh release download pr-1370-tarball --repo aws/agentcore-cli --pattern "*.tgz" --dir /tmp/pr-tarball
npm install -g /tmp/pr-tarball/aws-agentcore-0.14.2.tgz

Copy link
Copy Markdown

@agentcore-cli-automation agentcore-cli-automation left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. The fix is consistent with the canonical src/assets/datasets/simulated-v1.jsonl sample, which already includes max_turns on every example. Adding it to the inline e2e fixtures aligns them with the SIMULATED_V1 schema enforced server-side.

I checked the other tests touching SIMULATED_V1 / simulated examples:

  • integ-tests/add-remove-dataset.test.ts already asserts max_turns is present.
  • e2e-tests/dataset-large-batch.test.ts uses PREDEFINED_V1 (turns), so it's unaffected.
  • e2e-tests/dataset-eval-integration.test.ts also uses PREDEFINED_V1.

No new product code, no new mocking patterns, no telemetry surface — pure test fixture fix. Nothing else to flag.

@github-actions github-actions Bot removed the agentcore-harness-reviewing AgentCore Harness review in progress label May 22, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Coverage Report

Status Category Percentage Covered / Total
🔵 Lines 44.57% 9918 / 22249
🔵 Statements 43.82% 10535 / 24040
🔵 Functions 41.17% 1724 / 4187
🔵 Branches 40.89% 6346 / 15516
Generated in workflow #3258 for commit eb979e3 by the Vitest Coverage Report Action

@jariy17 jariy17 closed this May 22, 2026
@jariy17 jariy17 deleted the fix/dataset-e2e-failures branch May 22, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/xs PR size: XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants