Skip to content

Create stress test pipeline#3867

Open
paulmedynski wants to merge 6 commits intomainfrom
dev/paul/stress-test-pipeline
Open

Create stress test pipeline#3867
paulmedynski wants to merge 6 commits intomainfrom
dev/paul/stress-test-pipeline

Conversation

@paulmedynski
Copy link
Contributor

@paulmedynski paulmedynski commented Jan 5, 2026

Description

This PR adds a dedicated stress pipeline, and removes stress testing from all other pipelines. The new pipeline is triggered by successful runs of the PR/CI project-reference pipelines. It will not prevent PRs from merging.

Testing

We won't be able to test this new pipeline due to limitations in Azure DevOps that require the YAML file exist on the default branch before you can create a pipeline. So we expect a follow-up PR to fine-tune things once the new stress-tests-pipeline.yml file merges to main.

@paulmedynski paulmedynski requested a review from a team as a code owner January 5, 2026 19:19
Copilot AI review requested due to automatic review settings January 5, 2026 19:19
@github-project-automation github-project-automation bot moved this to To triage in SqlClient Board Jan 5, 2026
@paulmedynski paulmedynski moved this from To triage to In progress in SqlClient Board Jan 5, 2026
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a dedicated stress testing pipeline that triggers automatically after successful PR/CI package pipeline runs, decoupling stress tests from blocking PR merges. The stress tests now run asynchronously in a separate pipeline.

Key changes:

  • Created a new standalone stress-tests-pipeline.yml that triggers on successful completion of upstream package pipelines
  • Removed the enableStressTests parameter from all PR and CI pipelines
  • Updated stress test infrastructure to parse MDS package version from artifacts when not explicitly provided
  • Added support for .NET 10.0 runtime in stress tests

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
eng/pipelines/stress-tests-pipeline.yml Updated header formatting, renamed pipeline identifiers to be more descriptive (e.g., Public-ADO-PR-SqlClient-Package), replaced placeholder stage with actual stress test stage template
eng/pipelines/stages/stress-tests-ci-stage.yml Removed displayName attributes from parameters, removed dependsOn parameter, added .NET 10.0 to default runtimes, fixed variable name casing (ConfigContentconfigContent), updated template paths to use absolute paths with @self
eng/pipelines/jobs/stress-tests-ci-job.yml Removed default: '' from required parameters, added mdsPackageVersion parameter with logic to parse version from artifact filename, updated .NET SDK to 10.0, added logic to download artifacts from triggering pipeline, added MdsPackageVersion property to all dotnet CLI commands
eng/pipelines/sqlclient-pr-project-ref-pipeline.yml Removed enableStressTests parameter
eng/pipelines/sqlclient-pr-package-ref-pipeline.yml Removed enableStressTests parameter
eng/pipelines/dotnet-sqlclient-ci-project-reference-pipeline.yml Removed enableStressTests parameter
eng/pipelines/dotnet-sqlclient-ci-package-reference-pipeline.yml Removed enableStressTests parameter
eng/pipelines/dotnet-sqlclient-ci-core.yml Removed enableStressTests parameter and the conditional stress test stage that depended on it

@paulmedynski paulmedynski marked this pull request as draft January 5, 2026 19:51
Copilot AI review requested due to automatic review settings January 6, 2026 12:05
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 3 comments.

Copilot AI review requested due to automatic review settings January 6, 2026 12:31
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 3 comments.

@paulmedynski paulmedynski force-pushed the dev/paul/stress-test-pipeline branch from 23d23c3 to 22cb8c1 Compare March 11, 2026 18:36
@cheenamalhotra cheenamalhotra added the Area\Tests Issues that are targeted to tests or test projects label Mar 13, 2026
@cheenamalhotra cheenamalhotra added this to the 7.1.0-preview1 milestone Mar 16, 2026
- Added initial placeholder pipeline entry point file.
- Wired up the new top-level stress test pipeline to the existing stages/jobs.
- Using human friendly triggering pipeline names.
- Removed PR pipeline as upstream trigger.
- When triggered manually, we must choose one of the upstream pipelines to use for artifact download.
- Temporarily added PR-SqlClient-Package to help with PR-based testing.
- Sorted template parameters alphabetically.
- Added debugging for artifact details.
Copilot AI review requested due to automatic review settings March 19, 2026 15:36
@paulmedynski paulmedynski force-pushed the dev/paul/stress-test-pipeline branch from 22cb8c1 to 9a44529 Compare March 19, 2026 15:36
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 8 comments.

Comments suppressed due to low confidence (1)

src/Microsoft.Data.SqlClient/tests/StressTests/StressTests.slnx:1

  • This file has been emptied but not removed. An empty .slnx is not a valid solution definition and can confuse tooling and contributors. If the solution is no longer used, delete the file; otherwise restore its <Solution> contents.

You can also share your feedback on Copilot code review. Take the survey.

@paulmedynski paulmedynski marked this pull request as ready for review March 19, 2026 16:03
Copilot AI review requested due to automatic review settings March 19, 2026 16:03
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 17 out of 17 changed files in this pull request and generated 3 comments.


You can also share your feedback on Copilot code review. Take the survey.

value: $(Build.StagingDirectory)/dotnetArtifacts

# The top-level project file to build and run.
- name: project
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The StressTests project(s) no longer use package references, so the whole pipeline becomes much simpler. We are now just building the top-level Runner project, which builds everything else transitively.

@codecov
Copy link

codecov bot commented Mar 19, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 68.17%. Comparing base (ce38e64) to head (45b3359).
⚠️ Report is 1 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (ce38e64) and HEAD (45b3359). Click for more details.

HEAD has 1 upload less than BASE
Flag BASE (ce38e64) HEAD (45b3359)
CI-SqlClient 1 0
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3867      +/-   ##
==========================================
- Coverage   75.09%   68.17%   -6.93%     
==========================================
  Files         280      275       -5     
  Lines       43830    66924   +23094     
==========================================
+ Hits        32914    45623   +12709     
- Misses      10916    21301   +10385     
Flag Coverage Δ
CI-SqlClient ?
PR-SqlClient-Project 68.17% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@paulmedynski paulmedynski moved this from In progress to In review in SqlClient Board Mar 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area\Tests Issues that are targeted to tests or test projects

Projects

Status: In review

Development

Successfully merging this pull request may close these issues.

4 participants