Skip to content

activate lelantos in benchmarks#183

Open
kisernl wants to merge 1 commit into
masterfrom
add-lelantos
Open

activate lelantos in benchmarks#183
kisernl wants to merge 1 commit into
masterfrom
add-lelantos

Conversation

@kisernl

@kisernl kisernl commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

This pull request enables the lelantos provider in both the GitHub Actions workflow and the application code, allowing it to be used in the sandbox benchmarks and provider configuration. The main changes include uncommenting and implmenting configuration and code related to lelantos.

Workflow configuration updates:

  • Enabled the lelantos provider in the jobs matrix in .github/workflows/sandbox-benchmarks.yml, so benchmarks will now run for this provider.
  • Activated the LELANTOS_API_KEY environment variable in the workflow, allowing the job to access the necessary credentials.

Provider code updates:

  • Imported the lelantos provider in src/sandbox/providers.ts to make it available for use.
  • Added the lelantos provider to the providers array, enabling it as an available compute provider in the application.

@open-cla

open-cla Bot commented Jul 9, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Sandbox Benchmark Results

Sequential

# Provider Score Median TTI P95 P99 Status
1 declaw 99.1 0.05s 0.14s 0.14s 10/10
2 isorun 99.1 0.02s 0.21s 0.21s 10/10
3 northflank 98.0 0.16s 0.26s 0.26s 10/10
4 lightning 97.4 0.21s 0.32s 0.32s 10/10
5 daytona 97.0 0.14s 0.54s 0.54s 10/10
6 upstash 96.5 0.27s 0.47s 0.47s 10/10
7 blaxel 95.1 0.43s 0.58s 0.58s 10/10
8 vercel 94.8 0.44s 0.64s 0.64s 10/10
9 cloud-run 94.8 0.50s 0.55s 0.55s 10/10
10 tensorlake 93.7 0.54s 0.75s 0.75s 10/10
11 modal 93.7 0.51s 0.82s 0.82s 10/10
12 e2b 93.2 0.38s 1.13s 1.13s 10/10
13 runloop 91.9 0.60s 1.14s 1.14s 10/10
14 archil 90.6 0.34s 1.84s 1.84s 10/10
15 createos 90.0 0.82s 1.27s 1.27s 10/10
16 superserve 85.8 1.28s 1.62s 1.62s 10/10
17 beam 85.8 0.39s 2.96s 2.96s 10/10
18 cloudflare 75.2 2.21s 2.90s 2.90s 10/10
19 codesandbox 74.3 2.36s 2.89s 2.89s 10/10
20 hopx 0.0 0.00s 0.00s 0.00s 0/10
21 lelantos 0.0 0.00s 0.00s 0.00s 0/10

Staggered

# Provider Score Median TTI P95 P99 Status
1 isorun 99.8 0.01s 0.03s 0.03s 10/10
2 declaw 99.3 0.06s 0.10s 0.10s 10/10
3 northflank 98.1 0.18s 0.21s 0.21s 10/10
4 lightning 97.9 0.19s 0.23s 0.23s 10/10
5 daytona 97.7 0.16s 0.32s 0.32s 10/10
6 archil 97.2 0.22s 0.37s 0.37s 10/10
7 upstash 96.1 0.29s 0.55s 0.55s 10/10
8 beam 96.0 0.38s 0.43s 0.43s 10/10
9 e2b 95.9 0.37s 0.46s 0.46s 10/10
10 blaxel 95.4 0.45s 0.48s 0.48s 10/10
11 cloud-run 95.3 0.45s 0.51s 0.51s 10/10
12 vercel 94.4 0.43s 0.75s 0.75s 10/10
13 runloop 94.0 0.58s 0.65s 0.65s 10/10
14 tensorlake 93.2 0.63s 0.76s 0.76s 10/10
15 modal 92.7 0.48s 1.11s 1.11s 10/10
16 createos 91.4 0.73s 1.07s 1.07s 10/10
17 superserve 86.1 1.33s 1.48s 1.48s 10/10
18 cloudflare 77.8 1.64s 3.08s 3.08s 10/10
19 codesandbox 76.3 2.29s 2.48s 2.48s 10/10
20 hopx 0.0 0.00s 0.00s 0.00s 0/10
21 lelantos 0.0 0.00s 0.00s 0.00s 0/10

Burst

# Provider Score Median TTI P95 P99 Status
1 isorun 99.8 0.02s 0.02s 0.02s 10/10
2 declaw 98.1 0.19s 0.20s 0.20s 10/10
3 lightning 98.0 0.18s 0.23s 0.23s 10/10
4 northflank 97.5 0.23s 0.26s 0.26s 10/10
5 daytona 97.4 0.20s 0.35s 0.35s 10/10
6 archil 96.2 0.27s 0.55s 0.55s 10/10
7 upstash 95.4 0.41s 0.53s 0.53s 10/10
8 e2b 95.0 0.45s 0.57s 0.57s 10/10
9 cloud-run 94.5 0.47s 0.67s 0.67s 10/10
10 vercel 93.8 0.42s 0.91s 0.91s 10/10
11 tensorlake 93.1 0.66s 0.74s 0.74s 10/10
12 beam 93.0 0.36s 1.19s 1.19s 10/10
13 runloop 92.9 0.65s 0.80s 0.80s 10/10
14 modal 92.6 0.55s 1.02s 1.02s 10/10
15 blaxel 92.0 0.47s 1.30s 1.30s 10/10
16 createos 91.8 0.72s 0.97s 0.97s 10/10
17 superserve 80.8 1.88s 1.98s 1.98s 10/10
18 codesandbox 67.1 3.03s 3.67s 3.67s 10/10
19 cloudflare 65.3 2.90s 4.32s 4.32s 10/10
20 hopx 0.0 0.00s 0.00s 0.00s 0/10
21 lelantos 0.0 0.00s 0.00s 0.00s 0/10

View full run · SVGs available as build artifacts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant