Skip to content

[Flytekit-7005] Adding ray autoscaler options#3413

Open
0yukali0 wants to merge 12 commits intoflyteorg:masterfrom
0yukali0:flyte-7005
Open

[Flytekit-7005] Adding ray autoscaler options#3413
0yukali0 wants to merge 12 commits intoflyteorg:masterfrom
0yukali0:flyte-7005

Conversation

@0yukali0
Copy link
Copy Markdown

@0yukali0 0yukali0 commented Mar 30, 2026

Tracking issue

Ralated 7005

Why are the changes needed?

Ray plugin in Flytekit does not support ray autoscaler option when enable_autoscaling is settable.

What changes were proposed in this pull request?

  1. Create autoscaler option dataclass
  2. Add that to ray cluster message which sent to backend.

How was this patch tested?

Setup process

clone flyte and flytekit (branch flyte-7005 and flytekit-7005)
run the flyte backend in sandbox
2.1 flytectl demo start --dev
2.2 make compile && POD_NAMESPACE=flyte ./flyte start --config flyte-single-binary-local.yaml
Update ray example like Ray example
3.1 uv venv -p 3.11 && source .venv/bin/activate && uv pip install -e ~/flytekit ~/flytekit/plugins/flytekit-ray && uv pip install -e ~/flyte/flyteidl
3.2 "pyflyte run --remote ray_example.py ray_workflow --n 10"

Screenshots

image image

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

@0yukali0 0yukali0 changed the title [flyte-7005] Adding ray autoscaler options [Flyte-7005] Adding ray autoscaler options Mar 30, 2026
@0yukali0 0yukali0 changed the title [Flyte-7005] Adding ray autoscaler options [Flytekit-7005] Adding ray autoscaler options Mar 30, 2026
@0yukali0 0yukali0 marked this pull request as ready for review March 31, 2026 14:44
0yukali0 added 12 commits April 6, 2026 14:21
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
Signed-off-by: Yuteng Chen <a08h0283@gmail.com>
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 6, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 47.76%. Comparing base (c164f35) to head (3fb001d).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3413      +/-   ##
==========================================
+ Coverage   45.78%   47.76%   +1.98%     
==========================================
  Files         317      216     -101     
  Lines       28359    22845    -5514     
  Branches     3015     3015              
==========================================
- Hits        12983    10911    -2072     
+ Misses      15278    11333    -3945     
- Partials       98      601     +503     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant