Skip to content

Allow control of whether we generate output variables for S3 commands#1869

Merged
david-staniec-octopus merged 4 commits intomainfrom
ds/outputVariablesFlag
May 1, 2026
Merged

Allow control of whether we generate output variables for S3 commands#1869
david-staniec-octopus merged 4 commits intomainfrom
ds/outputVariablesFlag

Conversation

@david-staniec-octopus
Copy link
Copy Markdown
Contributor

@david-staniec-octopus david-staniec-octopus commented Apr 7, 2026

This PR introduces a new option in the UploadAwsS3Command to allow the caller to disable creation of output variables. This is via the new enum S3OutputVariablesStrategy, which can be set to AllFiles or NoFiles.

For deployments with thousands of files, this can create hundreds of thousands of output variables. For performance, the caller can choose to disable the creation of these output variables for performance purposes.

This defaults to S3OutputVariablesStrategy.AllFiles to maintain the existing behaviour of creating these variables.

⚠️ Does this change require a corresponding Server Change?
⚠️ If so - please add a "Requires Server Change" label to this PR!

@david-staniec-octopus david-staniec-octopus force-pushed the ds/outputVariablesFlag branch 2 times, most recently from c7b37f8 to 81d73a8 Compare April 9, 2026 03:23
@david-staniec-octopus david-staniec-octopus marked this pull request as ready for review April 10, 2026 01:34
Copy link
Copy Markdown
Contributor

@Jtango18 Jtango18 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sensible addition. LGTM

@david-staniec-octopus david-staniec-octopus force-pushed the ds/outputVariablesFlag branch 2 times, most recently from 06f9d5a to 777c70d Compare April 28, 2026 01:07
@david-staniec-octopus david-staniec-octopus merged commit 3ca09c5 into main May 1, 2026
33 checks passed
@david-staniec-octopus david-staniec-octopus deleted the ds/outputVariablesFlag branch May 1, 2026 04:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants