Skip to content

Run vortex-mask benchmarks with codspeed#7804

Merged
robert3005 merged 1 commit intodevelopfrom
rk/vortex-mask-benchmarks
May 5, 2026
Merged

Run vortex-mask benchmarks with codspeed#7804
robert3005 merged 1 commit intodevelopfrom
rk/vortex-mask-benchmarks

Conversation

@robert3005
Copy link
Copy Markdown
Contributor

We didn't use to have benchmarks there, now we do

Signed-off-by: Robert Kruszewski github@robertk.io

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added the changelog/chore A trivial change label May 5, 2026
@robert3005 robert3005 enabled auto-merge (squash) May 5, 2026 23:15
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 5, 2026

Merging this PR will degrade performance by 19.16%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 2 regressed benchmarks
✅ 1178 untouched benchmarks
🆕 26 new benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Simulation rank_indices[(0.5, 0.5, "self_dense_rank_dense")] N/A 867.4 µs N/A
🆕 Simulation sparse[(100000, 0.05, "sparse_5pct")] N/A 132.1 µs N/A
🆕 Simulation very_sparse_mask_uncached[(0.1, 0.01, "self_10pct_mask_1pct")] N/A 118.6 µs N/A
🆕 Simulation very_sparse_mask_uncached[(0.5, 0.005, "self_dense_mask_0p5pct")] N/A 432.3 µs N/A
Simulation bitwise_not_vortex_buffer_mut[128] 246.1 ns 304.4 ns -19.16%
Simulation map_new_output[128] 731.1 ns 818.6 ns -10.69%
🆕 Simulation density_matrix[(0.05, 0.5, "self_sparse_mask_dense")] N/A 131.8 µs N/A
🆕 Simulation density_matrix[(0.5, 0.5, "self_dense_mask_dense")] N/A 979 µs N/A
🆕 Simulation rank_indices[(0.01, 0.5, "self_very_sparse_rank_dense")] N/A 54.7 µs N/A
🆕 Simulation rank_indices[(0.05, 0.5, "self_sparse_rank_dense")] N/A 120.1 µs N/A
🆕 Simulation rank_indices[(0.5, 0.01, "self_dense_rank_very_sparse")] N/A 427.9 µs N/A
🆕 Simulation very_sparse_mask_cached[(0.5, 0.005, "self_dense_mask_0p5pct")] N/A 422.3 µs N/A
🆕 Simulation very_sparse_mask_cached[(0.5, 0.02, "self_dense_mask_2pct")] N/A 435.4 µs N/A
🆕 Simulation density_matrix[(0.05, 0.05, "self_sparse_mask_sparse")] N/A 83 µs N/A
🆕 Simulation density_matrix[(0.5, 0.05, "self_dense_mask_sparse")] N/A 482.5 µs N/A
🆕 Simulation intersect_by_rank[(10000, "random")] N/A 103.6 µs N/A
🆕 Simulation intersect_by_rank[(10000, "runs")] N/A 103.6 µs N/A
🆕 Simulation intersect_by_rank[(100000, "random")] N/A 979.4 µs N/A
🆕 Simulation intersect_by_rank[(100000, "runs")] N/A 976.8 µs N/A
🆕 Simulation rank_indices[(0.05, 0.05, "self_sparse_rank_sparse")] N/A 80.8 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing rk/vortex-mask-benchmarks (442153e) with develop (a9dc3a2)

Open in CodSpeed

@robert3005 robert3005 merged commit 924409f into develop May 5, 2026
65 of 67 checks passed
@robert3005 robert3005 deleted the rk/vortex-mask-benchmarks branch May 5, 2026 23:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants