Skip to content

Disable stealth for browser throughput + latency benchmarks#179

Merged
kisernl merged 3 commits into
masterfrom
disable-browser-throughput-stealth
Jul 8, 2026
Merged

Disable stealth for browser throughput + latency benchmarks#179
kisernl merged 3 commits into
masterfrom
disable-browser-throughput-stealth

Conversation

@HeyGarrison

Copy link
Copy Markdown
Collaborator

Summary

  • disable stealth for all browser throughput benchmark providers
  • explicitly disable proxies for throughput session creation
  • keep the shared 1920x1080 viewport and headless settings

Testing

  • ./node_modules/typescript/bin/tsc --noEmit (fails: existing unrelated TypeScript errors in src/scale scripts and tigris sink)

@open-cla

open-cla Bot commented Jul 8, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Browser Throughput Benchmark Results

# Provider Score APS (med) Task (med) Task (p95) Screenshot Status
1 Browseruse 72.1 4.00/s 2.50s 2.56s 245ms 3/3
2 Kernel 67.5 3.17/s 3.16s 3.45s 387ms 3/3
3 Hyperbrowser 63.9 2.54/s 3.94s 4.08s 491ms 3/3
4 Browserbase 58.5 1.90/s 5.25s 6.83s 359ms 3/3
5 Notte 53.7 1.52/s 6.59s 9.73s 834ms 3/3
6 Steel 51.6 1.20/s 8.36s 8.78s 655ms 3/3

View full run · SVG available as build artifact

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Browser Benchmark Results

# Provider Score Create Connect Navigate Release Total Status
1 Kernel 96.9 0.02s 0.13s 0.18s 0.03s 0.35s 10/10
2 Browserbase 94.2 0.22s 0.13s 0.12s 0.13s 0.61s 10/10
3 Hyperbrowser 93.2 0.30s 0.15s 0.15s 0.09s 0.70s 10/10
4 Browseruse 91.7 0.61s 0.12s 0.06s 0.04s 0.87s 10/10
5 Notte 90.9 0.21s 0.51s 0.25s 0.11s 1.17s 10/10
6 Steel 64.9 0.56s 0.79s 0.12s 0.17s 3.80s 10/10

View full run · SVG available as build artifact

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates browser benchmark provider configurations to disable stealth mode, and for throughput benchmarks it also explicitly disables proxies while keeping a consistent headless 1920×1080 session setup.

Changes:

  • Set stealth: false across throughput benchmark providers and add proxies: false for throughput session creation.
  • Set stealth: false for the non-throughput browserProviders configurations as well.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
src/browser/throughput-providers.ts Disables stealth and proxies for throughput sessions and keeps headless + consistent viewport.
src/browser/providers.ts Disables stealth for non-throughput browser benchmark session creation options.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread src/browser/throughput-providers.ts
Comment thread src/browser/providers.ts
@kisernl kisernl changed the title Disable stealth for browser throughput benchmarks Disable stealth for browser throughput + latency benchmarks Jul 8, 2026
@kisernl kisernl merged commit 0d9653f into master Jul 8, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants