Skip to content

bench: add connection and query benchmarks for SQLite, Postgres, MySQL - #4368

Open
Map130 wants to merge 5 commits into
transact-rs:mainfrom
Map130:bench/connection
Open

bench: add connection and query benchmarks for SQLite, Postgres, MySQL#4368
Map130 wants to merge 5 commits into
transact-rs:mainfrom
Map130:bench/connection

Conversation

@Map130

@Map130 Map130 commented Aug 9, 2026

Copy link
Copy Markdown

Closes #158.

Adds criterion benchmarks covering all items from the issue checklist, for all three supported databases.

What's included

Each database gets a benches/<db>/connection.rs with five benchmarks:

Benchmark Description
new_connection Establish a fresh connection from scratch (connect only; graceful close is done outside the timed section)
pool_checkout Acquire an idle connection from a pool (min=max=1, test_before_acquire(false))
ping Ping an existing open connection
query_small_result Fetch 1 row by PK from a populated table (TechEmpower single-query style)
query_large_result Fetch 10 000 rows with TEXT and BLOB/BYTEA columns

How to run

SQLite (no external DB needed):

cargo bench --bench sqlite-connection --features sqlite,runtime-tokio

Postgres:

DATABASE_URL=postgres://... cargo bench --bench postgres-connection --features postgres,runtime-tokio

MySQL (mysql-rsa enables caching_sha2_password auth without TLS for MySQL 8+):

DATABASE_URL=mysql://... cargo bench --bench mysql-connection --features mysql-rsa,runtime-tokio

The existing tests/docker-compose.yml can be used to spin up Postgres and MySQL.

Notes on methodology

  • pool_checkout uses test_before_acquire(false). With the pool default (true), every acquire() pings the connection before handing it out, which would make this benchmark measure ping + checkout rather than the checkout fast path. Disabling it isolates the pool's own overhead.
  • new_connection times connect() only. Connections are closed gracefully (Terminate / COM_QUIT) outside the measured section via iter_custom, so teardown isn't included in the timing and we don't abandon thousands of sockets on the server over a run.
  • Fetched results are passed through std::hint::black_box so the optimizer can't elide the decode/allocation work being measured.
  • SQLite numbers aren't directly comparable to Postgres/MySQL. sqlite::memory: has no network round-trip, so its new_connection/ping/pool_checkout measure in-process setup rather than a real connection/RTT. The three DBs share the same schema (16-byte blob, 10 000 rows) but should be read per-database.

Map130 and others added 5 commits August 9, 2026 19:17
Adds criterion benchmarks for SQLite covering all items from issue transact-rs#158:
new connection, pool checkout, ping, small-result query (1 row, TechEmpower-style),
and large-result query (10K rows with TEXT and BLOB columns).
Same benchmark suite as for SQLite: new connection, pool checkout, ping,
small-result query (1 row), and large-result query (10K rows with TEXT and BYTEA columns).
Requires DATABASE_URL pointing to a running Postgres instance.
Same benchmark suite as for SQLite and Postgres: new connection, pool checkout, ping,
small-result query (1 row), and large-result query (10K rows with TEXT and BLOB columns).
Requires DATABASE_URL pointing to a running MySQL instance.
Uses mysql-rsa feature for caching_sha2_password auth without TLS (MySQL 8+).
- pool_checkout: set test_before_acquire(false) so it measures the pool
  checkout fast path instead of an implicit ping on every acquire.
- new_connection: time connect() only via iter_custom and close the
  connection gracefully outside the measured section, so teardown isn't
  timed and sockets aren't abandoned across iterations.
- query benchmarks: pass fetched rows through std::hint::black_box to
  prevent the optimizer from eliding the decode/allocation work.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add benchmarks to inform performance-oriented refactoring

1 participant