Cloud sandboxes, measured
Oct 22–26, 2026 · 8 providers (9 configs) · 2 caller locations: Florida, US & Frankfurt, DE · 100 runs per main test, 20 per location test
Caller locations:All locations (EU-Central vs US-East)EU-Central · Frankfurt, DEUS-East · Florida, USUS-West · soon
Oct 22–26, 2026 · 8 providers (9 configs) · 2 caller locations: Florida, US & Frankfurt, DE · 100 runs per main test, 20 per location test
Caller locations:All locations (EU-Central vs US-East)EU-Central · Frankfurt, DEUS-East · Florida, USUS-West · soon
Upstash appears twice: Box can pause; Ephemeral Box starts in 0.68 s but can't pause.
Upstash appears twice: Box can pause; Ephemeral Box starts in 0.68 s but can't pause.
By location
How network distance changes latency: the same tests run from EU-Central (Frankfurt) and US-East (Florida).
Cold start by caller location
Median time from each caller location · Colored bar marks the faster location · Lower is better
Oct 26, 2026 · 5–20 runs per test
E2BSandbox in Oregon
EU-Central
0.67 s
US-East
0.48 s
×1.4 faster from US-East
DaytonaAPI in Virginia
EU-Central
1.5 s
US-East
0.99 s
×1.5 faster from US-East
Upstash BoxSandbox in Virginia
EU-Central
3.0 s
US-East
2.5 s
×1.2 faster from US-East
BoatSandbox in Northern France
EU-Central
0.78 s
US-East
1.1 s
×1.5 faster from EU-Central
boxdSandbox in Frankfurt
EU-Central
1.6 s
US-East
1.0 s
×1.6 faster from US-East
FreestyleSandbox in SF Bay Area
EU-Central
1.1 s
US-East
0.81 s
×1.3 faster from US-East
TenkiSandbox in Seattle
EU-Central
1.1 s
US-East
0.91 s
×1.2 faster from US-East
SuperserveSandbox in Virginia
EU-Central
0.71 s
US-East
0.49 s
×1.5 faster from US-East
Run a command
fastest location- E2B
- 0.12 sUS-East×1.5
- Daytona
- 0.10 sUS-East×1.6
- Upstash Box
- 0.22 sUS-East×2.5
- Boat
- 0.11 sEU-Central×2.9
- boxd
- 0.17 sEU-Central×1.7
- Freestyle
- 0.16 sUS-East×1.6
- Tenki
- 0.17 sUS-East×1.4
- Superserve
- 0.15 sUS-East×1.6
Write + read 10 MB
fastest location- E2B
- 1.3 sUS-East×2.1
- Daytona
- 1.8 sUS-East×1.1
- Upstash Box
- 2.1 sUS-East×1.9
- Boat
- 3.5 sEU-Central×2.0
- boxd
- 0.74 sEU-Central×3.9
- Freestyle
- 2.1 sUS-East×2.3
- Tenki
- 2.0 sUS-East×1.5
- Superserve
- 0.61 sUS-East×3.6
Agent tool replay
fastest location- E2B
- 14 sUS-East×1.6
- Daytona
- 17 sUS-East×1.3
- Upstash Box
- 21 sUS-East×1.8
- Boat
- 23 sEU-Central×1.8
- boxd
- 17 sEU-Central×1.8
- Freestyle
- 19 sUS-East×1.7
- Tenki
- 15 sUS-East×1.6
- Superserve
- 11 sUS-East×2.0
| Test | E2B | Daytona | Upstash Box | Boat | boxd | Freestyle | Tenki | Superserve |
|---|---|---|---|---|---|---|---|---|
| Cold start | 0.48 sUS-East | 0.99 sUS-East | 2.5 sUS-East | 0.78 sEU-Central | 1.0 sUS-East | 0.81 sUS-East | 0.91 sUS-East | 0.49 sUS-East |
| Run a command | 0.12 sUS-East | 0.10 sUS-East | 0.22 sUS-East | 0.11 sEU-Central | 0.17 sEU-Central | 0.16 sUS-East | 0.17 sUS-East | 0.15 sUS-East |
| Write + read 1 KB | 0.20 sUS-East | 0.12 sUS-East | 0.31 sUS-East | 0.43 sEU-Central | 0.24 sEU-Central | 0.19 sUS-East | 0.19 sUS-East | 0.08 sUS-East |
| Write + read 10 MB | 1.3 sUS-East | 1.8 sUS-East | 2.1 sUS-East | 3.5 sEU-Central | 0.74 sEU-Central | 2.1 sUS-East | 2.0 sUS-East | 0.61 sUS-East |
| Reconnect | 0.41 sUS-East | 0.24 sUS-East | 0.41 sUS-East | 0.25 sEU-Central | 0.42 sEU-Central | 0.47 sUS-East | 0.65 sUS-East | 0.28 sUS-East |
| Pause + resume | 0.73 sUS-East | Not measured | 1.2 sUS-East | Not measured | 0.19 sEU-Central | 0.83 sUS-East | 60 stie | 0.87 sUS-East |
| Destroy | 0.11 sUS-East | 0.79 sUS-East | 0.59 sUS-East | 0.07 sEU-Central | 0.03 sEU-Central | 0.38 sUS-East | 0.14 sUS-East | 0.21 sUS-East |
| Dev server ready | 2.1 sUS-East | 3.0 sUS-East | 3.1 sUS-East | 1.6 sEU-Central | 2.0 sEU-Central | 1.9 sUS-East | 1.8 sUS-East | 1.6 sUS-East |
| Preview URL first byte | 0.22 sUS-East | 0.20 sUS-East | 0.22 sUS-East | 0.13 sEU-Central | 0.07 sEU-Central | 0.46 sUS-East | 0.38 sUS-East | 0.16 sUS-East |
| Edit, rebuild, reload | 0.33 sUS-East | 0.42 sUS-East | 0.37 sUS-East | 0.47 sEU-Central | 0.26 sEU-Central | 0.26 sUS-East | 0.51 sUS-East | 0.47 sUS-East |
| Agent tool replay | 14 sUS-East | 17 sUS-East | 21 sUS-East | 23 sEU-Central | 17 sEU-Central | 19 sUS-East | 15 sUS-East | 11 sUS-East |
Boat (Northern France) and boxd (Frankfurt) run their sandboxes in Europe; the remaining providers run in US-East. In-sandbox CPU, memory, disk, and package install speed do not change with caller location and are omitted here.
Cold start from EU-Central (Frankfurt am Main, DE)
Median cold start and HTTPS first byte from OVH SAS · Lower is better
E2BSandbox in Oregon
0.67 s
226 ms 1st byte
×1.4 faster from US-East
SuperserveSandbox in Virginia
0.71 s
388 ms 1st byte
×1.5 faster from US-East
BoatSandbox in Northern France
0.78 s
78 ms 1st byte
×1.5 faster here
FreestyleSandbox in SF Bay Area
1.1 s
652 ms 1st byte
×1.3 faster from US-East
TenkiSandbox in Seattle
1.1 s
213 ms 1st byte
×1.2 faster from US-East
DaytonaAPI in Virginia
1.5 s
164 ms 1st byte
×1.5 faster from US-East
boxdSandbox in Frankfurt
1.6 s
28 ms 1st byte
×1.6 faster from US-East
Upstash BoxSandbox in Virginia
3.0 s
396 ms 1st byte
×1.2 faster from US-East
| Test | E2B | Daytona | Upstash Box | Boat | boxd | Freestyle | Tenki | Superserve |
|---|---|---|---|---|---|---|---|---|
| Cold start | 0.67 s | 1.5 s | 3.0 s | 0.78 s | 1.6 s | 1.1 s | 1.1 s | 0.71 s |
| Run a command | 0.18 s | 0.17 s | 0.54 s | 0.11 s | 0.17 s | 0.24 s | 0.24 s | 0.24 s |
| Write + read 1 KB | 0.33 s | 0.24 s | 0.45 s | 0.43 s | 0.24 s | 0.37 s | 0.33 s | 0.22 s |
| Write + read 10 MB | 2.7 s | 2.0 s | 4.0 s | 3.5 s | 0.74 s | 4.9 s | 3.0 s | 2.2 s |
| Reconnect | 0.66 s | 0.57 s | 0.93 s | 0.25 s | 0.42 s | 0.80 s | 0.97 s | 0.50 s |
| Pause + resume | 0.97 s | Not measured | 1.9 s | Not measured | 0.19 s | 1.2 s | 60 s | 1.1 s |
| Destroy | 0.17 s | 0.97 s | 0.90 s | 0.07 s | 0.03 s | 0.46 s | 0.19 s | 0.27 s |
| Dev server ready | 2.9 s | 4.7 s | 5.1 s | 1.6 s | 2.0 s | 3.2 s | 2.9 s | 2.4 s |
| Preview URL first byte | 0.29 s | 0.43 s | 0.53 s | 0.13 s | 0.07 s | 0.77 s | 0.58 s | 0.17 s |
| Edit, rebuild, reload | 0.51 s | 0.68 s | 0.56 s | 0.47 s | 0.26 s | 0.53 s | 0.77 s | 0.84 s |
| Agent tool replay | 21 s | 21 s | 37 s | 23 s | 17 s | 33 s | 23 s | 23 s |
Boat (Northern France) and boxd (Frankfurt) run their sandboxes in Europe; the remaining providers run in US-East. In-sandbox CPU, memory, disk, and package install speed do not change with caller location and are omitted here.
Cold start from US-East (Boca Raton, US)
Median cold start and HTTPS first byte from AT&T Enterprises, LLC · Lower is better
E2BSandbox in Oregon
0.48 s
155 ms 1st byte
×1.4 faster here
SuperserveSandbox in Virginia
0.49 s
103 ms 1st byte
×1.5 faster here
FreestyleSandbox in SF Bay Area
0.81 s
312 ms 1st byte
×1.3 faster here
TenkiSandbox in Seattle
0.91 s
178 ms 1st byte
×1.2 faster here
DaytonaAPI in Virginia
0.99 s
79 ms 1st byte
×1.5 faster here
boxdSandbox in Frankfurt
1.0 s
493 ms 1st byte
×1.6 faster here
BoatSandbox in Northern France
1.1 s
410 ms 1st byte
×1.5 faster from EU-Central
Upstash BoxSandbox in Virginia
2.5 s
123 ms 1st byte
×1.2 faster here
| Test | E2B | Daytona | Upstash Box | Boat | boxd | Freestyle | Tenki | Superserve |
|---|---|---|---|---|---|---|---|---|
| Cold start | 0.48 s | 0.99 s | 2.5 s | 1.1 s | 1.0 s | 0.81 s | 0.91 s | 0.49 s |
| Run a command | 0.12 s | 0.10 s | 0.22 s | 0.33 s | 0.29 s | 0.16 s | 0.17 s | 0.15 s |
| Write + read 1 KB | 0.20 s | 0.12 s | 0.31 s | 0.82 s | 0.46 s | 0.19 s | 0.19 s | 0.08 s |
| Write + read 10 MB | 1.3 s | 1.8 s | 2.1 s | 7.0 s | 2.8 s | 2.1 s | 2.0 s | 0.61 s |
| Reconnect | 0.41 s | 0.24 s | 0.41 s | 0.70 s | 0.88 s | 0.47 s | 0.65 s | 0.28 s |
| Pause + resume | 0.73 s | Not measured | 1.2 s | Not measured | 0.54 s | 0.83 s | 63 s | 0.87 s |
| Destroy | 0.11 s | 0.79 s | 0.59 s | 0.18 s | 0.14 s | 0.38 s | 0.14 s | 0.21 s |
| Dev server ready | 2.1 s | 3.0 s | 3.1 s | 4.1 s | 3.7 s | 1.9 s | 1.8 s | 1.6 s |
| Preview URL first byte | 0.22 s | 0.20 s | 0.22 s | 0.99 s | 0.86 s | 0.46 s | 0.38 s | 0.16 s |
| Edit, rebuild, reload | 0.33 s | 0.42 s | 0.37 s | 1.2 s | 0.96 s | 0.26 s | 0.51 s | 0.47 s |
| Agent tool replay | 14 s | 17 s | 21 s | 43 s | 31 s | 19 s | 15 s | 11 s |
Boat (Northern France) and boxd (Frankfurt) run their sandboxes in Europe; the remaining providers run in US-East. In-sandbox CPU, memory, disk, and package install speed do not change with caller location and are omitted here.
Cold start
Median s · lower is better
0.52
0.68
0.69
0.79
1.1
1.1
1.2
1.2
2.7
- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest.
Agent work, 100 tool calls
Median s · lower is better
12
13
15
21
22
24
27
34
43
- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest.
Cost per 1,000 tasks
USD · lower is better
$0.26
$0.34
$0.52
$1.32
$1.36
$1.56
$1.79
$1.97
$2.00
- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest.
Start from snapshot
Median s · lower is better
0.55
0.75
1.1
1.1
1.1
1.9
2.4
4.9
- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest.
Where the time goes
Step by step, from median timings, in each provider's own time.
TraceCold start · every provider, median of each step
Fastest
519ms
Superserve · provider time
Slowest
2.62s
Upstash Box · provider time
Spread
5.1×
slowest vs fastest
Failures
0
of 900 attempts
Provider
0s1s2s3s
create()First commandRanked by provider time · pick a provider for its full trace.
TraceCold start · every provider, median of each step
Fastest
495ms
E2B · provider time
Slowest
2.62s
Upstash Box · provider time
Spread
5.3×
slowest vs fastest
Failures
0
of 900 attempts
Provider
0s1s2s3s
create()First commandOurs: Sandbox SDKRanked by provider time · pick a provider for its full trace.
Start-up
Cold start is the wait before an agent can do anything: from create() until the first command runs, the provider's own time.
Cold start
create() to first command, without our SDK's setup · Median seconds · Lower is better
Superserve
Median
0.52 sp95
0.64 s95% CI
0.52 s–0.52 sAttempts
100Click for where the time goes
Upstash Ephemeral Box
Median
0.68 sp95
0.79 s95% CI
0.68 s–0.69 sAttempts
100Click for where the time goes
Freestyle
Median
0.69 sp95
2.0 s95% CI
0.68 s–0.72 sAttempts
100Click for where the time goes
E2B
Median
0.79 sp95
2.2 s95% CI
0.71 s–0.82 sAttempts
100Click for where the time goes
Tenki
Median
1.1 sp95
3.3 s95% CI
0.94 s–1.2 sAttempts
100Click for where the time goes
Boat
Median
1.1 sp95
1.6 s95% CI
1.0 s–1.2 sAttempts
100Click for where the time goes
boxd
Median
1.2 sp95
1.3 s95% CI
1.1 s–1.2 sAttempts
100Click for where the time goes
Daytona
Median
1.2 sp95
2.1 s95% CI
1.1 s–1.3 sAttempts
100Click for where the time goes
Upstash Box
Median
2.7 sp95
11 s95% CI
2.6 s–2.7 sAttempts
100Click for where the time goes
0.52
Superserve
Median
0.52 sp95
0.64 s95% CI
0.52 s–0.52 sAttempts
100Click for where the time goes
0.68
Upstash Ephemeral Box
Median
0.68 sp95
0.79 s95% CI
0.68 s–0.69 sAttempts
100Click for where the time goes
0.69
Freestyle
Median
0.69 sp95
2.0 s95% CI
0.68 s–0.72 sAttempts
100Click for where the time goes
0.79
E2B
Median
0.79 sp95
2.2 s95% CI
0.71 s–0.82 sAttempts
100Click for where the time goes
1.1
Tenki
Median
1.1 sp95
3.3 s95% CI
0.94 s–1.2 sAttempts
100Click for where the time goes
1.1
Boat
Median
1.1 sp95
1.6 s95% CI
1.0 s–1.2 sAttempts
100Click for where the time goes
1.2
boxd
Median
1.2 sp95
1.3 s95% CI
1.1 s–1.2 sAttempts
100Click for where the time goes
1.2
Daytona
Median
1.2 sp95
2.1 s95% CI
1.1 s–1.3 sAttempts
100Click for where the time goes
2.7
Upstash Box
Median
2.7 sp95
11 s95% CI
2.6 s–2.7 sAttempts
100Click for where the time goes
- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest.
Every cold start
Each successful cold start, one ridge per provider · Log scale · Further left is faster
Superserve0.52 s · n = 100
Upstash Ephemeral Box0.68 s · n = 100
Freestyle0.69 s · n = 100
E2B0.79 s · n = 100
Tenki1.1 s · n = 100
Boat1.1 s · n = 100
boxd1.2 s · n = 100
Daytona1.3 s · n = 100
Upstash Box2.7 s · n = 100
0.20.5125102050 s
Superserve0.52 s · n = 100
Upstash Ephemeral Box0.68 s · n = 100
Freestyle0.69 s · n = 100
E2B0.79 s · n = 100
Tenki1.1 s · n = 100
Boat1.1 s · n = 100
boxd1.2 s · n = 100
Daytona1.3 s · n = 100
Upstash Box2.7 s · n = 100
0.20.5125102050 s
Cold start
create() to first command, without our SDK's setup · Median seconds · Lower is better
E2B
Median
0.50 sp95
2.0 s95% CI
0.48 s–0.51 sAttempts
100Click for where the time goes
Superserve
Median
0.53 sp95
0.63 s95% CI
0.52 s–0.53 sAttempts
100Click for where the time goes
Upstash Ephemeral Box
Median
0.68 sp95
0.81 s95% CI
0.68 s–0.69 sAttempts
100Click for where the time goes
Freestyle
Median
0.72 sp95
3.0 s95% CI
0.71 s–0.75 sAttempts
100Click for where the time goes
Tenki
Median
0.86 sp95
3.1 s95% CI
0.81 s–0.92 sAttempts
100Click for where the time goes
boxd
Median
1.1 sp95
1.2 s95% CI
1.1 s–1.1 sAttempts
100Click for where the time goes
Boat
Median
1.2 sp95
1.4 s95% CI
1.1 s–1.2 sAttempts
100Click for where the time goes
Daytona
Median
1.5 sp95
2.8 s95% CI
1.4 s–1.6 sAttempts
100Click for where the time goes
Upstash Box
Median
2.6 sp95
13 s95% CI
2.6 s–2.7 sAttempts
100Click for where the time goes
0.50
E2B
Median
0.50 sp95
2.0 s95% CI
0.48 s–0.51 sAttempts
100Click for where the time goes
0.53
Superserve
Median
0.53 sp95
0.63 s95% CI
0.52 s–0.53 sAttempts
100Click for where the time goes
0.68
Upstash Ephemeral Box
Median
0.68 sp95
0.81 s95% CI
0.68 s–0.69 sAttempts
100Click for where the time goes
0.72
Freestyle
Median
0.72 sp95
3.0 s95% CI
0.71 s–0.75 sAttempts
100Click for where the time goes
0.86
Tenki
Median
0.86 sp95
3.1 s95% CI
0.81 s–0.92 sAttempts
100Click for where the time goes
1.1
boxd
Median
1.1 sp95
1.2 s95% CI
1.1 s–1.1 sAttempts
100Click for where the time goes
1.2
Boat
Median
1.2 sp95
1.4 s95% CI
1.1 s–1.2 sAttempts
100Click for where the time goes
1.5
Daytona
Median
1.5 sp95
2.8 s95% CI
1.4 s–1.6 sAttempts
100Click for where the time goes
2.6
Upstash Box
Median
2.6 sp95
13 s95% CI
2.6 s–2.7 sAttempts
100Click for where the time goes
- 1E2B: ran E2B's default base template, 2 vCPU and 512 MB. E2B's pricing page says its default sandbox has 4 GB.
Every cold start
Each successful cold start, one ridge per provider · Log scale · Further left is faster
E2B0.50 s · n = 100
Superserve0.53 s · n = 100
Upstash Ephemeral Box0.68 s · n = 100
Freestyle0.72 s · n = 100
Tenki0.86 s · n = 100
boxd1.1 s · n = 100
Boat1.2 s · n = 100
Daytona1.5 s · n = 100
Upstash Box2.6 s · n = 100
0.20.5125102050 s
E2B0.50 s · n = 100
Superserve0.53 s · n = 100
Upstash Ephemeral Box0.68 s · n = 100
Freestyle0.72 s · n = 100
Tenki0.86 s · n = 100
boxd1.1 s · n = 100
Boat1.2 s · n = 100
Daytona1.5 s · n = 100
Upstash Box2.6 s · n = 100
0.20.5125102050 s
Agent work
Real coding-agent tasks, so CPU, disk and network count as much as the API.
Agent tool replay
100 tool calls in a row: write, read, edit, list, grep, run a test · Median seconds · Lower is better
Daytona
Median
12 sp95
30 s95% CI
12 s–13 sAttempts
30Click for where the time goes
Superserve
Median
13 sp95
15 s95% CI
13 s–13 sAttempts
30Click for where the time goes
E2B
Median
15 sp95
17 s95% CI
15 s–16 sAttempts
30Click for where the time goes
Tenki
Median
21 sp95
31 s95% CI
19 s–22 sAttempts
30Click for where the time goes
Upstash Ephemeral Box
Median
22 sp95
23 s95% CI
22 s–23 sAttempts
30Click for where the time goes
Freestyle
Median
24 sp95
42 s95% CI
22 s–29 sAttempts
30Click for where the time goes
Upstash Box
Median
27 sp95
32 s95% CI
26 s–28 sAttempts
30Click for where the time goes
boxd
Median
34 sp95
40 s95% CI
33 s–34 sAttempts
30Click for where the time goes
Boat
Median
43 sp95
49 s95% CI
43 s–44 sAttempts
30Click for where the time goes
12
Daytona
Median
12 sp95
30 s95% CI
12 s–13 sAttempts
30Click for where the time goes
13
Superserve
Median
13 sp95
15 s95% CI
13 s–13 sAttempts
30Click for where the time goes
15
E2B
Median
15 sp95
17 s95% CI
15 s–16 sAttempts
30Click for where the time goes
21
Tenki
Median
21 sp95
31 s95% CI
19 s–22 sAttempts
30Click for where the time goes
22
Upstash Ephemeral Box
Median
22 sp95
23 s95% CI
22 s–23 sAttempts
30Click for where the time goes
24
Freestyle
Median
24 sp95
42 s95% CI
22 s–29 sAttempts
30Click for where the time goes
27
Upstash Box
Median
27 sp95
32 s95% CI
26 s–28 sAttempts
30Click for where the time goes
34
boxd
Median
34 sp95
40 s95% CI
33 s–34 sAttempts
30Click for where the time goes
43
Boat
Median
43 sp95
49 s95% CI
43 s–44 sAttempts
30Click for where the time goes
- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
npm install
npm ci for a small Vite and React app · Median seconds · Lower is better
Daytona
Median
0.75 sp95
0.91 s95% CI
0.73 s–0.77 sAttempts
30Boat
Median
0.85 sp95
1.9 s95% CI
0.84 s–0.86 sAttempts
30Upstash Ephemeral Box
Median
1.00 sp95
1.0 s95% CI
0.99 s–1.0 sAttempts
30Upstash Box
Median
1.1 sp95
1.2 s95% CI
1.1 s–1.1 sAttempts
30Superserve
Median
1.1 sp95
1.8 s95% CI
0.99 s–1.4 sAttempts
30Tenki
Median
1.1 sp95
1.8 s95% CI
1.0 s–1.4 sAttempts
30boxd
Median
1.4 sp95
1.7 s95% CI
1.3 s–1.5 sAttempts
30Freestyle
Median
1.7 sp95
3.5 s95% CI
1.6 s–1.9 sAttempts
30E2B
Median
1.8 sp95
2.9 s95% CI
1.7 s–1.9 sAttempts
300.75
Daytona
Median
0.75 sp95
0.91 s95% CI
0.73 s–0.77 sAttempts
300.85
Boat
Median
0.85 sp95
1.9 s95% CI
0.84 s–0.86 sAttempts
301.00
Upstash Ephemeral Box
Median
1.00 sp95
1.0 s95% CI
0.99 s–1.0 sAttempts
301.1
Upstash Box
Median
1.1 sp95
1.2 s95% CI
1.1 s–1.1 sAttempts
301.1
Superserve
Median
1.1 sp95
1.8 s95% CI
0.99 s–1.4 sAttempts
301.1
Tenki
Median
1.1 sp95
1.8 s95% CI
1.0 s–1.4 sAttempts
301.4
boxd
Median
1.4 sp95
1.7 s95% CI
1.3 s–1.5 sAttempts
301.7
Freestyle
Median
1.7 sp95
3.5 s95% CI
1.6 s–1.9 sAttempts
301.8
E2B
Median
1.8 sp95
2.9 s95% CI
1.7 s–1.9 sAttempts
30- 1Boat: runs in France, so every call from our Florida server crosses the Atlantic.
- 2boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
pip install
requests and numpy from PyPI · Median seconds · Lower is better
Tenki
Median
3.3 sp95
5.0 s95% CI
3.1 s–4.5 sAttempts
30Superserve
Median
3.8 sp95
4.6 s95% CI
3.7 s–4.1 sAttempts
30Boat
Median
3.9 sp95
9.0 s95% CI
3.9 s–4.4 sAttempts
30Upstash Box
Median
4.0 sp95
5.0 s95% CI
4.0 s–4.1 sAttempts
30Daytona
Median
4.2 sp95
5.5 s95% CI
4.0 s–4.3 sAttempts
30boxd
Median
4.5 sp95
5.0 s95% CI
4.5 s–4.5 sAttempts
30E2B
Median
4.9 sp95
8.2 s95% CI
4.2 s–5.0 sAttempts
30Upstash Ephemeral Box
Median
5.6 sp95
6.4 s95% CI
5.2 s–5.9 sAttempts
30Freestyle
Median
7.5 sp95
20 s95% CI
7.4 s–8.4 sAttempts
303.3
Tenki
Median
3.3 sp95
5.0 s95% CI
3.1 s–4.5 sAttempts
303.8
Superserve
Median
3.8 sp95
4.6 s95% CI
3.7 s–4.1 sAttempts
303.9
Boat
Median
3.9 sp95
9.0 s95% CI
3.9 s–4.4 sAttempts
304.0
Upstash Box
Median
4.0 sp95
5.0 s95% CI
4.0 s–4.1 sAttempts
304.2
Daytona
Median
4.2 sp95
5.5 s95% CI
4.0 s–4.3 sAttempts
304.5
boxd
Median
4.5 sp95
5.0 s95% CI
4.5 s–4.5 sAttempts
304.9
E2B
Median
4.9 sp95
8.2 s95% CI
4.2 s–5.0 sAttempts
305.6
Upstash Ephemeral Box
Median
5.6 sp95
6.4 s95% CI
5.2 s–5.9 sAttempts
307.5
Freestyle
Median
7.5 sp95
20 s95% CI
7.4 s–8.4 sAttempts
30- 1Boat: runs in France, so every call from our Florida server crosses the Atlantic.
- 2boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
git clone
Shallow clone of a small pinned repo · Median seconds · Lower is better
Daytona
Median
0.43 sp95
1.0 s95% CI
0.42 s–0.45 sAttempts
30Upstash Ephemeral Box
Median
0.61 sp95
0.67 s95% CI
0.60 s–0.63 sAttempts
30Upstash Box
Median
0.69 sp95
1.7 s95% CI
0.67 s–0.72 sAttempts
30Superserve
Median
1.0 sp95
2.7 s95% CI
0.85 s–1.1 sAttempts
30Tenki
Median
1.2 sp95
2.1 s95% CI
1.1 s–1.3 sAttempts
30E2B
Median
1.2 sp95
2.1 s95% CI
1.1 s–1.3 sAttempts
30Freestyle
Median
1.5 sp95
2.6 s95% CI
1.4 s–1.7 sAttempts
30boxd
Median
1.5 sp95
1.9 s95% CI
1.5 s–1.6 sAttempts
30Boat
Median
2.1 sp95
2.4 s95% CI
2.1 s–2.1 sAttempts
300.43
Daytona
Median
0.43 sp95
1.0 s95% CI
0.42 s–0.45 sAttempts
300.61
Upstash Ephemeral Box
Median
0.61 sp95
0.67 s95% CI
0.60 s–0.63 sAttempts
300.69
Upstash Box
Median
0.69 sp95
1.7 s95% CI
0.67 s–0.72 sAttempts
301.0
Superserve
Median
1.0 sp95
2.7 s95% CI
0.85 s–1.1 sAttempts
301.2
Tenki
Median
1.2 sp95
2.1 s95% CI
1.1 s–1.3 sAttempts
301.2
E2B
Median
1.2 sp95
2.1 s95% CI
1.1 s–1.3 sAttempts
301.5
Freestyle
Median
1.5 sp95
2.6 s95% CI
1.4 s–1.7 sAttempts
301.5
boxd
Median
1.5 sp95
1.9 s95% CI
1.5 s–1.6 sAttempts
302.1
Boat
Median
2.1 sp95
2.4 s95% CI
2.1 s–2.1 sAttempts
30- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Dev server ready
Start Vite and wait until it is ready · Median seconds · Lower is better
Superserve
Median
1.3 sp95
1.7 s95% CI
1.3 s–1.3 sAttempts
30Tenki
Median
1.9 sp95
4.6 s95% CI
1.9 s–2.0 sAttempts
30E2B
Median
2.2 sp95
3.4 s95% CI
2.1 s–2.3 sAttempts
30Freestyle
Median
2.2 sp95
4.8 s95% CI
2.1 s–2.5 sAttempts
30Daytona
Median
2.6 sp95
6.6 s95% CI
2.5 s–2.6 sAttempts
30Upstash Ephemeral Box
Median
3.1 sp95
3.3 s95% CI
3.1 s–3.2 sAttempts
30Upstash Box
Median
3.7 sp95
5.6 s95% CI
3.7 s–3.8 sAttempts
30boxd
Median
4.0 sp95
4.9 s95% CI
4.0 s–4.1 sAttempts
30Boat
Median
4.0 sp95
4.8 s95% CI
3.9 s–4.1 sAttempts
301.3
Superserve
Median
1.3 sp95
1.7 s95% CI
1.3 s–1.3 sAttempts
301.9
Tenki
Median
1.9 sp95
4.6 s95% CI
1.9 s–2.0 sAttempts
302.2
E2B
Median
2.2 sp95
3.4 s95% CI
2.1 s–2.3 sAttempts
302.2
Freestyle
Median
2.2 sp95
4.8 s95% CI
2.1 s–2.5 sAttempts
302.6
Daytona
Median
2.6 sp95
6.6 s95% CI
2.5 s–2.6 sAttempts
303.1
Upstash Ephemeral Box
Median
3.1 sp95
3.3 s95% CI
3.1 s–3.2 sAttempts
303.7
Upstash Box
Median
3.7 sp95
5.6 s95% CI
3.7 s–3.8 sAttempts
304.0
boxd
Median
4.0 sp95
4.9 s95% CI
4.0 s–4.1 sAttempts
304.0
Boat
Median
4.0 sp95
4.8 s95% CI
3.9 s–4.1 sAttempts
30- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Preview URL first byte
Fetch the dev server through the public preview URL · Median seconds · Lower is better
Superserve
Median
0.18 sp95
0.23 s95% CI
0.18 s–0.19 sAttempts
30Daytona
Median
0.25 sp95
0.44 s95% CI
0.25 s–0.27 sAttempts
30E2B
Median
0.27 sp95
0.49 s95% CI
0.27 s–0.28 sAttempts
30Upstash Ephemeral Box
Median
0.29 sp95
0.41 s95% CI
0.28 s–0.31 sAttempts
30Upstash Box
Median
0.31 sp95
0.73 s95% CI
0.29 s–0.34 sAttempts
30Tenki
Median
0.38 sp95
0.49 s95% CI
0.37 s–0.39 sAttempts
30Freestyle
Median
0.48 sp95
0.65 s95% CI
0.45 s–0.51 sAttempts
30, 1 failedboxd
Median
0.84 sp95
0.99 s95% CI
0.82 s–0.86 sAttempts
30Boat
Median
0.86 sp95
1.1 s95% CI
0.82 s–0.97 sAttempts
290.18
Superserve
Median
0.18 sp95
0.23 s95% CI
0.18 s–0.19 sAttempts
300.25
Daytona
Median
0.25 sp95
0.44 s95% CI
0.25 s–0.27 sAttempts
300.27
E2B
Median
0.27 sp95
0.49 s95% CI
0.27 s–0.28 sAttempts
300.29
Upstash Ephemeral Box
Median
0.29 sp95
0.41 s95% CI
0.28 s–0.31 sAttempts
300.31
Upstash Box
Median
0.31 sp95
0.73 s95% CI
0.29 s–0.34 sAttempts
300.38
Tenki
Median
0.38 sp95
0.49 s95% CI
0.37 s–0.39 sAttempts
300.48
Freestyle
Median
0.48 sp95
0.65 s95% CI
0.45 s–0.51 sAttempts
30, 1 failed0.84
boxd
Median
0.84 sp95
0.99 s95% CI
0.82 s–0.86 sAttempts
300.86
Boat
Median
0.86 sp95
1.1 s95% CI
0.82 s–0.97 sAttempts
29- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Edit, rebuild, reload
Edit a file, rebuild, fetch the page again · Median seconds · Lower is better
Freestyle
Median
0.30 sp95
1.6 s95% CI
0.29 s–0.32 sAttempts
30Daytona
Median
0.31 sp95
0.76 s95% CI
0.30 s–0.34 sAttempts
30E2B
Median
0.33 sp95
0.56 s95% CI
0.32 s–0.34 sAttempts
30Upstash Ephemeral Box
Median
0.35 sp95
0.38 s95% CI
0.35 s–0.36 sAttempts
30Upstash Box
Median
0.43 sp95
0.93 s95% CI
0.42 s–0.43 sAttempts
30Superserve
Median
0.49 sp95
0.89 s95% CI
0.45 s–0.51 sAttempts
30Tenki
Median
0.52 sp95
0.61 s95% CI
0.50 s–0.54 sAttempts
30boxd
Median
1.1 sp95
1.5 s95% CI
1.1 s–1.1 sAttempts
30Boat
Median
1.1 sp95
1.4 s95% CI
1.1 s–1.1 sAttempts
300.30
Freestyle
Median
0.30 sp95
1.6 s95% CI
0.29 s–0.32 sAttempts
300.31
Daytona
Median
0.31 sp95
0.76 s95% CI
0.30 s–0.34 sAttempts
300.33
E2B
Median
0.33 sp95
0.56 s95% CI
0.32 s–0.34 sAttempts
300.35
Upstash Ephemeral Box
Median
0.35 sp95
0.38 s95% CI
0.35 s–0.36 sAttempts
300.43
Upstash Box
Median
0.43 sp95
0.93 s95% CI
0.42 s–0.43 sAttempts
300.49
Superserve
Median
0.49 sp95
0.89 s95% CI
0.45 s–0.51 sAttempts
300.52
Tenki
Median
0.52 sp95
0.61 s95% CI
0.50 s–0.54 sAttempts
301.1
boxd
Median
1.1 sp95
1.5 s95% CI
1.1 s–1.1 sAttempts
301.1
Boat
Median
1.1 sp95
1.4 s95% CI
1.1 s–1.1 sAttempts
30- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest. Runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Agent tool replay
100 tool calls in a row: write, read, edit, list, grep, run a test · Median seconds · Lower is better
Superserve
Median
13 sp95
14 s95% CI
13 s–13 sAttempts
30Click for where the time goes
Daytona
Median
15 sp95
34 s95% CI
13 s–18 sAttempts
30Click for where the time goes
E2B
Median
16 sp95
18 s95% CI
16 s–17 sAttempts
30Click for where the time goes
Tenki
Median
18 sp95
24 s95% CI
17 s–20 sAttempts
30Click for where the time goes
Upstash Ephemeral Box
Median
23 sp95
24 s95% CI
23 s–23 sAttempts
30, 2 failedClick for where the time goes
Freestyle
Median
26 sp95
44 s95% CI
22 s–28 sAttempts
30Click for where the time goes
Upstash Box
Median
27 sp95
31 s95% CI
26 s–28 sAttempts
30Click for where the time goes
boxd
Median
33 sp95
40 s95% CI
33 s–33 sAttempts
30Click for where the time goes
Boat
Median
43 sp95
51 s95% CI
43 s–46 sAttempts
30Click for where the time goes
13
Superserve
Median
13 sp95
14 s95% CI
13 s–13 sAttempts
30Click for where the time goes
15
Daytona
Median
15 sp95
34 s95% CI
13 s–18 sAttempts
30Click for where the time goes
16
E2B
Median
16 sp95
18 s95% CI
16 s–17 sAttempts
30Click for where the time goes
18
Tenki
Median
18 sp95
24 s95% CI
17 s–20 sAttempts
30Click for where the time goes
23
Upstash Ephemeral Box
Median
23 sp95
24 s95% CI
23 s–23 sAttempts
30, 2 failedClick for where the time goes
26
Freestyle
Median
26 sp95
44 s95% CI
22 s–28 sAttempts
30Click for where the time goes
27
Upstash Box
Median
27 sp95
31 s95% CI
26 s–28 sAttempts
30Click for where the time goes
33
boxd
Median
33 sp95
40 s95% CI
33 s–33 sAttempts
30Click for where the time goes
43
Boat
Median
43 sp95
51 s95% CI
43 s–46 sAttempts
30Click for where the time goes
- 1boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
npm install
npm ci for a small Vite and React app · Median seconds · Lower is better
Boat
Median
0.86 sp95
4.2 s95% CI
0.84 s–1.8 sAttempts
30Upstash Ephemeral Box
Median
1.0 sp95
1.1 s95% CI
1.0 s–1.0 sAttempts
29Upstash Box
Median
1.1 sp95
1.2 s95% CI
1.1 s–1.1 sAttempts
30Daytona
Median
1.2 sp95
1.4 s95% CI
1.2 s–1.3 sAttempts
30Tenki
Median
1.4 sp95
2.1 s95% CI
1.0 s–1.5 sAttempts
30Superserve
Median
1.4 sp95
2.0 s95% CI
1.3 s–1.8 sAttempts
30boxd
Median
1.4 sp95
1.8 s95% CI
1.3 s–1.5 sAttempts
30Freestyle
Median
1.6 sp95
3.3 s95% CI
1.6 s–1.8 sAttempts
30E2B
Median
2.1 sp95
2.8 s95% CI
2.0 s–2.3 sAttempts
300.86
Boat
Median
0.86 sp95
4.2 s95% CI
0.84 s–1.8 sAttempts
301.0
Upstash Ephemeral Box
Median
1.0 sp95
1.1 s95% CI
1.0 s–1.0 sAttempts
291.1
Upstash Box
Median
1.1 sp95
1.2 s95% CI
1.1 s–1.1 sAttempts
301.2
Daytona
Median
1.2 sp95
1.4 s95% CI
1.2 s–1.3 sAttempts
301.4
Tenki
Median
1.4 sp95
2.1 s95% CI
1.0 s–1.5 sAttempts
301.4
Superserve
Median
1.4 sp95
2.0 s95% CI
1.3 s–1.8 sAttempts
301.4
boxd
Median
1.4 sp95
1.8 s95% CI
1.3 s–1.5 sAttempts
301.6
Freestyle
Median
1.6 sp95
3.3 s95% CI
1.6 s–1.8 sAttempts
302.1
E2B
Median
2.1 sp95
2.8 s95% CI
2.0 s–2.3 sAttempts
30- 1Boat: runs in France, so every call from our Florida server crosses the Atlantic.
- 2boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
- 3E2B: ran E2B's default base template, 2 vCPU and 512 MB. E2B's pricing page says its default sandbox has 4 GB.
pip install
requests and numpy from PyPI · Median seconds · Lower is better
Superserve
Median
3.8 sp95
4.6 s95% CI
3.7 s–4.2 sAttempts
30Boat
Median
4.0 sp95
6.4 s95% CI
3.7 s–4.3 sAttempts
30Upstash Box
Median
4.1 sp95
5.0 s95% CI
4.0 s–4.4 sAttempts
30Tenki
Median
4.3 sp95
4.9 s95% CI
3.1 s–4.5 sAttempts
30Upstash Ephemeral Box
Median
4.3 sp95
5.4 s95% CI
4.1 s–4.6 sAttempts
29boxd
Median
4.5 sp95
5.2 s95% CI
4.4 s–4.6 sAttempts
30Daytona
Median
4.6 sp95
6.2 s95% CI
4.3 s–4.7 sAttempts
30E2B
Median
5.0 sp95
6.0 s95% CI
4.8 s–5.1 sAttempts
30Freestyle
Median
7.5 sp95
14 s95% CI
7.4 s–9.7 sAttempts
303.8
Superserve
Median
3.8 sp95
4.6 s95% CI
3.7 s–4.2 sAttempts
304.0
Boat
Median
4.0 sp95
6.4 s95% CI
3.7 s–4.3 sAttempts
304.1
Upstash Box
Median
4.1 sp95
5.0 s95% CI
4.0 s–4.4 sAttempts
304.3
Tenki
Median
4.3 sp95
4.9 s95% CI
3.1 s–4.5 sAttempts
304.3
Upstash Ephemeral Box
Median
4.3 sp95
5.4 s95% CI
4.1 s–4.6 sAttempts
294.5
boxd
Median
4.5 sp95
5.2 s95% CI
4.4 s–4.6 sAttempts
304.6
Daytona
Median
4.6 sp95
6.2 s95% CI
4.3 s–4.7 sAttempts
305.0
E2B
Median
5.0 sp95
6.0 s95% CI
4.8 s–5.1 sAttempts
307.5
Freestyle
Median
7.5 sp95
14 s95% CI
7.4 s–9.7 sAttempts
30- 1Boat: runs in France, so every call from our Florida server crosses the Atlantic.
- 2boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
git clone
Shallow clone of a small pinned repo · Median seconds · Lower is better
Upstash Ephemeral Box
Median
0.61 sp95
0.67 s95% CI
0.61 s–0.64 sAttempts
29Daytona
Median
0.62 sp95
0.97 s95% CI
0.47 s–0.87 sAttempts
30Upstash Box
Median
0.70 sp95
1.3 s95% CI
0.68 s–0.77 sAttempts
30Superserve
Median
1.1 sp95
1.9 s95% CI
1.1 s–1.2 sAttempts
30E2B
Median
1.2 sp95
2.6 s95% CI
1.1 s–1.2 sAttempts
30Tenki
Median
1.2 sp95
2.3 s95% CI
1.0 s–1.3 sAttempts
30Freestyle
Median
1.5 sp95
2.8 s95% CI
1.4 s–1.8 sAttempts
30boxd
Median
1.5 sp95
2.0 s95% CI
1.5 s–1.5 sAttempts
30Boat
Median
2.1 sp95
4.3 s95% CI
2.1 s–2.1 sAttempts
300.61
Upstash Ephemeral Box
Median
0.61 sp95
0.67 s95% CI
0.61 s–0.64 sAttempts
290.62
Daytona
Median
0.62 sp95
0.97 s95% CI
0.47 s–0.87 sAttempts
300.70
Upstash Box
Median
0.70 sp95
1.3 s95% CI
0.68 s–0.77 sAttempts
301.1
Superserve
Median
1.1 sp95
1.9 s95% CI
1.1 s–1.2 sAttempts
301.2
E2B
Median
1.2 sp95
2.6 s95% CI
1.1 s–1.2 sAttempts
301.2
Tenki
Median
1.2 sp95
2.3 s95% CI
1.0 s–1.3 sAttempts
301.5
Freestyle
Median
1.5 sp95
2.8 s95% CI
1.4 s–1.8 sAttempts
301.5
boxd
Median
1.5 sp95
2.0 s95% CI
1.5 s–1.5 sAttempts
302.1
Boat
Median
2.1 sp95
4.3 s95% CI
2.1 s–2.1 sAttempts
30- 1boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Dev server ready
Start Vite and wait until it is ready · Median seconds · Lower is better
Superserve
Median
1.8 sp95
2.0 s95% CI
1.8 s–1.9 sAttempts
30Tenki
Median
1.9 sp95
3.2 s95% CI
1.9 s–2.0 sAttempts
30Freestyle
Median
2.2 sp95
5.0 s95% CI
2.0 s–2.5 sAttempts
30E2B
Median
2.3 sp95
3.3 s95% CI
2.2 s–2.6 sAttempts
30Daytona
Median
2.8 sp95
6.8 s95% CI
2.6 s–3.6 sAttempts
30Upstash Ephemeral Box
Median
3.2 sp95
3.5 s95% CI
3.2 s–3.2 sAttempts
29, 1 failedUpstash Box
Median
3.8 sp95
4.8 s95% CI
3.7 s–3.8 sAttempts
30boxd
Median
4.0 sp95
5.0 s95% CI
3.9 s–4.0 sAttempts
30Boat
Median
4.1 sp95
5.4 s95% CI
4.0 s–4.3 sAttempts
301.8
Superserve
Median
1.8 sp95
2.0 s95% CI
1.8 s–1.9 sAttempts
301.9
Tenki
Median
1.9 sp95
3.2 s95% CI
1.9 s–2.0 sAttempts
302.2
Freestyle
Median
2.2 sp95
5.0 s95% CI
2.0 s–2.5 sAttempts
302.3
E2B
Median
2.3 sp95
3.3 s95% CI
2.2 s–2.6 sAttempts
302.8
Daytona
Median
2.8 sp95
6.8 s95% CI
2.6 s–3.6 sAttempts
303.2
Upstash Ephemeral Box
Median
3.2 sp95
3.5 s95% CI
3.2 s–3.2 sAttempts
29, 1 failed3.8
Upstash Box
Median
3.8 sp95
4.8 s95% CI
3.7 s–3.8 sAttempts
304.0
boxd
Median
4.0 sp95
5.0 s95% CI
3.9 s–4.0 sAttempts
304.1
Boat
Median
4.1 sp95
5.4 s95% CI
4.0 s–4.3 sAttempts
30- 1boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Preview URL first byte
Fetch the dev server through the public preview URL · Median seconds · Lower is better
Superserve
Median
0.19 sp95
0.25 s95% CI
0.18 s–0.20 sAttempts
30E2B
Median
0.27 sp95
0.53 s95% CI
0.26 s–0.28 sAttempts
30Daytona
Median
0.28 sp95
0.46 s95% CI
0.26 s–0.31 sAttempts
30Upstash Ephemeral Box
Median
0.29 sp95
0.39 s95% CI
0.28 s–0.30 sAttempts
28Upstash Box
Median
0.30 sp95
0.43 s95% CI
0.29 s–0.31 sAttempts
30Tenki
Median
0.40 sp95
1.5 s95% CI
0.39 s–0.44 sAttempts
30Freestyle
Median
0.48 sp95
1.7 s95% CI
0.45 s–0.53 sAttempts
30, 1 failedBoat
Median
0.85 sp95
1.2 s95% CI
0.73 s–0.99 sAttempts
30boxd
Median
0.91 sp95
1.5 s95% CI
0.85 s–0.95 sAttempts
300.19
Superserve
Median
0.19 sp95
0.25 s95% CI
0.18 s–0.20 sAttempts
300.27
E2B
Median
0.27 sp95
0.53 s95% CI
0.26 s–0.28 sAttempts
300.28
Daytona
Median
0.28 sp95
0.46 s95% CI
0.26 s–0.31 sAttempts
300.29
Upstash Ephemeral Box
Median
0.29 sp95
0.39 s95% CI
0.28 s–0.30 sAttempts
280.30
Upstash Box
Median
0.30 sp95
0.43 s95% CI
0.29 s–0.31 sAttempts
300.40
Tenki
Median
0.40 sp95
1.5 s95% CI
0.39 s–0.44 sAttempts
300.48
Freestyle
Median
0.48 sp95
1.7 s95% CI
0.45 s–0.53 sAttempts
30, 1 failed0.85
Boat
Median
0.85 sp95
1.2 s95% CI
0.73 s–0.99 sAttempts
300.91
boxd
Median
0.91 sp95
1.5 s95% CI
0.85 s–0.95 sAttempts
30- 1Boat: runs in France, so every call from our Florida server crosses the Atlantic.
- 2boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
Edit, rebuild, reload
Edit a file, rebuild, fetch the page again · Median seconds · Lower is better
Freestyle
Median
0.31 sp95
3.8 s95% CI
0.29 s–0.34 sAttempts
30E2B
Median
0.34 sp95
0.59 s95% CI
0.33 s–0.36 sAttempts
30Daytona
Median
0.34 sp95
0.96 s95% CI
0.33 s–0.45 sAttempts
30Upstash Ephemeral Box
Median
0.36 sp95
0.40 s95% CI
0.36 s–0.37 sAttempts
28Upstash Box
Median
0.43 sp95
1.1 s95% CI
0.42 s–0.44 sAttempts
30Superserve
Median
0.46 sp95
0.78 s95% CI
0.45 s–0.50 sAttempts
30Tenki
Median
0.52 sp95
1.7 s95% CI
0.51 s–0.53 sAttempts
30boxd
Median
1.1 sp95
2.3 s95% CI
1.1 s–1.1 sAttempts
30Boat
Median
1.1 sp95
1.5 s95% CI
1.1 s–1.2 sAttempts
300.31
Freestyle
Median
0.31 sp95
3.8 s95% CI
0.29 s–0.34 sAttempts
300.34
E2B
Median
0.34 sp95
0.59 s95% CI
0.33 s–0.36 sAttempts
300.34
Daytona
Median
0.34 sp95
0.96 s95% CI
0.33 s–0.45 sAttempts
300.36
Upstash Ephemeral Box
Median
0.36 sp95
0.40 s95% CI
0.36 s–0.37 sAttempts
280.43
Upstash Box
Median
0.43 sp95
1.1 s95% CI
0.42 s–0.44 sAttempts
300.46
Superserve
Median
0.46 sp95
0.78 s95% CI
0.45 s–0.50 sAttempts
300.52
Tenki
Median
0.52 sp95
1.7 s95% CI
0.51 s–0.53 sAttempts
301.1
boxd
Median
1.1 sp95
2.3 s95% CI
1.1 s–1.1 sAttempts
301.1
Boat
Median
1.1 sp95
1.5 s95% CI
1.1 s–1.2 sAttempts
30- 1boxd: runs in Germany, so every call from our Florida server crosses the Atlantic.
- 2Boat: runs in France, so every call from our Florida server crosses the Atlantic.
Everyday calls
What an agent does hundreds of times per task: run a command, move files, reattach to a sandbox.
Run a command
A no-op command, mostly network and API overhead · Median seconds · Lower is better
Daytona
Median
0.13 sp95
0.30 s95% CI
0.13 s–0.14 sAttempts
100E2B
Median
0.13 sp95
0.19 s95% CI
0.13 s–0.14 sAttempts
100Freestyle
Median
0.16 sp95
0.26 s95% CI
0.16 s–0.16 sAttempts
100Tenki
Median
0.18 sp95
0.21 s95% CI
0.18 s–0.19 sAttempts
100Superserve
Median
0.19 sp95
0.22 s95% CI
0.19 s–0.19 sAttempts
100boxd
Median
0.30 sp95
0.31 s95% CI
0.30 s–0.30 sAttempts
98Upstash Ephemeral Box
Median
0.31 sp95
0.38 s95% CI
0.31 s–0.31 sAttempts
100Upstash Box
Median
0.33 sp95
0.41 s95% CI
0.32 s–0.33 sAttempts
100Boat
Median
0.33 sp95
0.39 s95% CI
0.33 s–0.34 sAttempts
1000.13
Daytona
Median
0.13 sp95
0.30 s95% CI
0.13 s–0.14 sAttempts
1000.13
E2B
Median
0.13 sp95
0.19 s95% CI
0.13 s–0.14 sAttempts
1000.16
Freestyle
Median
0.16 sp95
0.26 s95% CI
0.16 s–0.16 sAttempts
1000.18
Tenki
Median
0.18 sp95
0.21 s95% CI
0.18 s–0.19 sAttempts
1000.19
Superserve
Median
0.19 sp95
0.22 s95% CI
0.19 s–0.19 sAttempts
1000.30
boxd
Median
0.30 sp95
0.31 s95% CI
0.30 s–0.30 sAttempts
980.31
Upstash Ephemeral Box
Median
0.31 sp95
0.38 s95% CI
0.31 s–0.31 sAttempts
1000.33
Upstash Box
Median
0.33 sp95
0.41 s95% CI
0.32 s–0.33 sAttempts
1000.33
Boat
Median
0.33 sp95
0.39 s95% CI
0.33 s–0.34 sAttempts
100- 1boxd: ran 4 vCPU, 16 GB, not 4 vCPU, 8 GB. boxd has no 8 GB size at 4 vCPU; this is its nearest.
Write + read 1 KB
Write a 1 KB file and read it back · Median seconds · Lower is better
Superserve
Median
0.10 sp95
0.11 s95% CI
0.10 s–0.10 sAttempts
100