Skip to content

Sync eng/common directory with azure-sdk-tools for PR 14420#48401

Open
azure-sdk wants to merge 8 commits intomainfrom
sync-eng/common-azsdk-benchmark-pipeline-14420
Open

Sync eng/common directory with azure-sdk-tools for PR 14420#48401
azure-sdk wants to merge 8 commits intomainfrom
sync-eng/common-azsdk-benchmark-pipeline-14420

Conversation

@azure-sdk
Copy link
Collaborator

Sync eng/common directory with azure-sdk-tools for PR Azure/azure-sdk-tools#14420 See eng/common workflow

@azure-sdk azure-sdk requested a review from a team as a code owner March 12, 2026 19:46
@azure-sdk azure-sdk requested review from Copilot and jeo02 March 12, 2026 19:46
@azure-sdk azure-sdk added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Mar 12, 2026
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new benchmark-job.yml Azure Pipelines job template under eng/common as part of syncing eng/common with azure-sdk-tools PR 14420.

Changes:

  • Introduces a Run_Benchmark job template that performs a sparse checkout and runs a .NET benchmark project via dotnet run.
  • Adds parameters to select benchmark scenarios by name/tags and control parallelism and model selection.

variables:
- template: /eng/pipelines/templates/variables/globals.yml
- template: /eng/pipelines/templates/variables/image.yml
- group: 'AzSDK_Eval_Variable_group'
Copy link

Copilot AI Mar 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This template hard-codes a dependency on the Azure DevOps variable group AzSDK_Eval_Variable_group. That makes the job template non-portable and will fail in pipelines/projects where this group isn’t defined. Consider removing the variable group from the template and instead passing any required values in as parameters (or documenting that the consuming pipeline must include the group explicitly).

Copilot uses AI. Check for mistakes.
DOTNET_SKIP_FIRST_TIME_EXPERIENCE: 1
DOTNET_CLI_TELEMETRY_OPTOUT: 1
DOTNET_MULTILEVEL_LOOKUP: 0
COPILOT_GITHUB_TOKEN: $(azuresdk-copilot-github-pat)
Copy link

Copilot AI Mar 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

COPILOT_GITHUB_TOKEN is set from a specific secret variable name $(azuresdk-copilot-github-pat), but the template doesn’t define/require it as a parameter. This creates a hidden prerequisite and can break consumers that don’t have that variable configured. Prefer making the token an explicit (secret) parameter and only setting COPILOT_GITHUB_TOKEN when it’s non-empty.

Copilot uses AI. Check for mistakes.
Comment on lines +7 to +13
default: ' '
- name: Tags
type: string
default: ' '
- name: Model
type: string
default: ' '
Copy link

Copilot AI Mar 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These parameters default to a single space (' ') and then rely on .Trim() in the script. Using an empty string default ('') avoids surprising whitespace behavior and removes the need for trimming to detect “unset” values (same applies to Tags/Model).

Suggested change
default: ' '
- name: Tags
type: string
default: ' '
- name: Model
type: string
default: ' '
default: ''
- name: Tags
type: string
default: ''
- name: Model
type: string
default: ''

Copilot uses AI. Check for mistakes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants