Skip to content

Revert "Update Results for DataFusion 52.0.0"#766

Merged
rschu1ze merged 1 commit intomainfrom
revert-749-datafusion-52
Jan 28, 2026
Merged

Revert "Update Results for DataFusion 52.0.0"#766
rschu1ze merged 1 commit intomainfrom
revert-749-datafusion-52

Conversation

@rschu1ze
Copy link
Member

@rschu1ze rschu1ze commented Jan 28, 2026 •
edited
Loading

Reverts #749

The script failed to run in unattended benchmark runs (full output below).

@waynexia The problem seems

Install Homebrew
Warning: Running in non-interactive mode because `stdin` is not a TTY.
/bin/bash: line 187: HOME: unbound variable
./benchmark.sh: line 17: /home/linuxbrew/.linuxbrew/bin/brew: No such file or directory
Install datafusion-cli
./benchmark.sh: line 21: brew: command not found
./benchmark.sh: line 22: datafusion-cli: command not found

Do we really need to install a full-blown package manager just to get datafusion? Can't the script run a datafusion docker container or download a tar file that contains datafusion from somewhere?

Cloning into 'ClickBench'...
+ cd ClickBench/datafusion
+ echo -n 'System name: '
+ tee -a log
System name: + jq -r .system template.json
+ tee -a log
DataFusion (Parquet, single)
+ tee -a log
+ echo -n 'Proprietary: '
Proprietary: + jq -r .proprietary template.json
+ tee -a log
no
+ echo -n 'Tuned: '
+ tee -a log
Tuned: + jq -r .tuned template.json
+ tee -a log
no
+ echo -n 'Tags: '
+ tee -a log
Tags: + jq -c -r .tags template.json
+ tee -a log
["Rust","column-oriented","embedded","stateless","lukewarm-cold-run"]
+ echo -n 'Disk usage before: '
+ tee -a log
Disk usage before: + df -B1 /
+ tail -n1
+ awk '{ print $3 }'
+ tee -a log
2138923008
+ timeout 20000 ./benchmark.sh
+ tee -a log
Install Dependencies
Hit:1 http://us-east-1.ec2.archive.ubuntu.com/ubuntu noble InRelease
Hit:2 http://us-east-1.ec2.archive.ubuntu.com/ubuntu noble-updates InRelease
Hit:3 http://us-east-1.ec2.archive.ubuntu.com/ubuntu noble-backports InRelease
Hit:4 http://security.ubuntu.com/ubuntu noble-security InRelease
Reading package lists...
Install Homebrew
Warning: Running in non-interactive mode because `stdin` is not a TTY.
/bin/bash: line 187: HOME: unbound variable
./benchmark.sh: line 17: /home/linuxbrew/.linuxbrew/bin/brew: No such file or directory
Install datafusion-cli
./benchmark.sh: line 21: brew: command not found
./benchmark.sh: line 22: datafusion-cli: command not found
Download benchmark target data, single file
--2026-01-28 22:11:41--  https://datasets.clickhouse.com/hits_compatible/hits.parquet
Resolving datasets.clickhouse.com (datasets.clickhouse.com)... 172.66.43.7, 172.66.40.249, 2606:4700:3108::ac42:2b07, ...
Connecting to datasets.clickhouse.com (datasets.clickhouse.com)|172.66.43.7|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 14779976446 (14G) [binary/octet-stream]
Saving to: ‘hits.parquet’

     0K ........ ........ ........ ........  0% 38.0M 6m10s
 32768K ........ ........ ........ ........  0%  253M 3m32s
 65536K ........ ........ ........ ........  0%  272M 2m38s
 98304K ........ ........ ........ ........  0%  175M 2m19s
131072K ........ ........ ........ ........  1%  127M 2m13s
163840K ........ ........ ........ ........  1%  130M 2m8s
196608K ........ ........ ........ ........  1% 99.9M 2m9s
229376K ........ ........ ........ ........  1% 84.2M 2m13s
262144K ........ ........ ........ ........  2% 54.3M 2m27s
294912K ........ ........ ........ ........  2%  107M 2m25s
327680K ........ ........ ........ ........  2% 97.6M 2m24s
360448K ........ ........ ........ ........  2%  142M 2m20s
393216K ........ ........ ........ ........  2%  118M 2m18s
425984K ........ ........ ........ ........  3%  121M 2m15s
458752K ........ ........ ........ ........  3% 89.1M 2m16s
491520K ........ ........ ........ ........  3%  101M 2m16s
524288K ........ ........ ........ ........  3% 91.1M 2m16s
557056K ........ ........ ........ ........  4%  118M 2m15s
589824K ........ ........ ........ ........  4% 94.8M 2m15s
622592K ........ ........ ........ ........  4% 87.2M 2m16s
655360K ........ ........ ........ ........  4% 71.4M 2m18s
688128K ........ ........ ........ ........  4%  136M 2m16s
720896K ........ ........ ........ ........  5%  100M 2m15s
753664K ........ ........ ........ ........  5% 84.6M 2m16s
786432K ........ ........ ........ ........  5% 89.6M 2m16s
819200K ........ ........ ........ ........  5% 99.7M 2m16s
851968K ........ ........ ........ ........  6% 74.1M 2m17s
884736K ........ ........ ........ ........  6%  188M 2m14s
917504K ........ ........ ........ ........  6% 92.9M 2m14s
950272K ........ ........ ........ ........  6% 81.0M 2m15s
983040K ........ ........ ........ ........  7% 96.2M 2m14s
1015808K ........ ........ ........ ........  7%  115M 2m14s
1048576K ........ ........ ........ ........  7% 83.0M 2m14s
1081344K ........ ........ ........ ........  7% 97.2M 2m14s
1114112K ........ ........ ........ ........  7% 89.8M 2m14s
1146880K ........ ........ ........ ........  8%  126M 2m12s
1179648K ........ ........ ........ ........  8% 95.8M 2m12s
1212416K ........ ........ ........ ........  8% 92.9M 2m12s
1245184K ........ ........ ........ ........  8% 89.0M 2m12s
1277952K ........ ........ ........ ........  9% 81.6M 2m12s
1310720K ........ ........ ........ ........  9%  112M 2m12s
1343488K ........ ........ ........ ........  9% 86.3M 2m12s
1376256K ........ ........ ........ ........  9% 99.2M 2m11s
1409024K ........ ........ ........ ........  9% 56.0M 2m13s
1441792K ........ ........ ........ ........ 10%  155M 2m12s
1474560K ........ ........ ........ ........ 10%  152M 2m10s
1507328K ........ ........ ........ ........ 10% 97.4M 2m10s
1540096K ........ ........ ........ ........ 10% 96.8M 2m10s
1572864K ........ ........ ........ ........ 11% 89.8M 2m9s
1605632K ........ ........ ........ ........ 11% 97.2M 2m9s
1638400K ........ ........ ........ ........ 11% 90.5M 2m9s
1671168K ........ ........ ........ ........ 11%  118M 2m8s
1703936K ........ ........ ........ ........ 12% 90.4M 2m8s
1736704K ........ ........ ........ ........ 12% 90.9M 2m8s
1769472K ........ ........ ........ ........ 12% 75.9M 2m8s
1802240K ........ ........ ........ ........ 12%  112M 2m7s
1835008K ........ ........ ........ ........ 12% 95.7M 2m7s
1867776K ........ ........ ........ ........ 13% 76.1M 2m7s
1900544K ........ ........ ........ ........ 13% 76.9M 2m8s
1933312K ........ ........ ........ ........ 13%  107M 2m7s
1966080K ........ ........ ........ ........ 13% 95.1M 2m7s
1998848K ........ ........ ........ ........ 14%  160M 2m6s
2031616K ........ ........ ........ ........ 14% 79.3M 2m6s
2064384K ........ ........ ........ ........ 14% 88.4M 2m6s
2097152K ........ ........ ........ ........ 14%  114M 2m5s
2129920K ........ ........ ........ ........ 14%  109M 2m4s
2162688K ........ ........ ........ ........ 15%  100M 2m4s
2195456K ........ ........ ........ ........ 15% 91.2M 2m4s
2228224K ........ ........ ........ ........ 15%  110M 2m3s
2260992K ........ ........ ........ ........ 15% 86.8M 2m3s
2293760K ........ ........ ........ ........ 16% 52.6M 2m4s
2326528K ........ ........ ........ ........ 16% 75.9M 2m4s
2359296K ........ ........ ........ ........ 16%  222M 2m3s
2392064K ........ ........ ........ ........ 16%  196M 2m2s
2424832K ........ ........ ........ ........ 17% 90.4M 2m2s
2457600K ........ ........ ........ ........ 17%  101M 2m1s
2490368K ........ ........ ........ ........ 17% 86.4M 2m1s
2523136K ........ ........ ........ ........ 17%  120M 2m0s
2555904K ........ ........ ........ ........ 17% 90.4M 2m0s
2588672K ........ ........ ........ ........ 18% 95.8M 2m0s
2621440K ........ ........ ........ ........ 18% 92.2M 1m59s
2654208K ........ ........ ........ ........ 18%  102M 1m59s
2686976K ........ ........ ........ ........ 18% 91.3M 1m59s
2719744K ........ ........ ........ ........ 19% 89.5M 1m59s
2752512K ........ ........ ........ ........ 19% 87.3M 1m58s
2785280K ........ ........ ........ ........ 19%  129M 1m58s
2818048K ........ ........ ........ ........ 19% 95.5M 1m57s
2850816K ........ ........ ........ ........ 19% 91.9M 1m57s
2883584K ........ ........ ........ ........ 20% 92.5M 1m57s
2916352K ........ ........ ........ ........ 20% 89.7M 1m57s
2949120K ........ ........ ........ ........ 20% 81.6M 1m57s
2981888K ........ ........ ........ ........ 20% 67.9M 1m57s
3014656K ........ ........ ........ ........ 21%  150M 1m56s
3047424K ........ ........ ........ ........ 21%  102M 1m56s
3080192K ........ ........ ........ ........ 21%  129M 1m55s
3112960K ........ ........ ........ ........ 21% 94.0M 1m55s
3145728K ........ ........ ........ ........ 22% 62.9M 1m55s
3178496K ........ ........ ........ ........ 22%  184M 1m54s
3211264K ........ ........ ........ ........ 22% 93.1M 1m54s
3244032K ........ ........ ........ ........ 22% 84.9M 1m53s
3276800K ........ ........ ........ ........ 22%  102M 1m53s
3309568K ........ ........ ........ ........ 23% 85.7M 1m53s
3342336K ........ ........ ........ ........ 23%  127M 1m52s
3375104K ........ ........ ........ ........ 23% 90.5M 1m52s
3407872K ........ ........ ........ ........ 23% 73.2M 1m52s
3440640K ........ ........ ........ ........ 24%  112M 1m52s
3473408K ........ ........ ........ ........ 24% 70.4M 1m52s
3506176K ........ ........ ........ ........ 24%  143M 1m51s
3538944K ........ ........ ........ ........ 24% 92.5M 1m51s
3571712K ........ ........ ........ ........ 24%  108M 1m50s
3604480K ........ ........ ........ ........ 25% 86.9M 1m50s
3637248K ........ ........ ........ ........ 25%  106M 1m49s
3670016K ........ ........ ........ ........ 25% 78.5M 1m49s
3702784K ........ ........ ........ ........ 25%  148M 1m49s
3735552K ........ ........ ........ ........ 26% 75.9M 1m49s
3768320K ........ ........ ........ ........ 26%  119M 1m48s
3801088K ........ ........ ........ ........ 26% 88.9M 1m48s
3833856K ........ ........ ........ ........ 26% 94.8M 1m48s
3866624K ........ ........ ........ ........ 27% 89.0M 1m47s
3899392K ........ ........ ........ ........ 27%  118M 1m47s
3932160K ........ ........ ........ ........ 27% 90.5M 1m46s
3964928K ........ ........ ........ ........ 27%  101M 1m46s
3997696K ........ ........ ........ ........ 27% 94.4M 1m46s
4030464K ........ ........ ........ ........ 28% 81.5M 1m46s
4063232K ........ ........ ........ ........ 28%  101M 1m45s
4096000K ........ ........ ........ ........ 28% 91.0M 1m45s
4128768K ........ ........ ........ ........ 28% 83.2M 1m45s
4161536K ........ ........ ........ ........ 29% 76.9M 1m45s
4194304K ........ ........ ........ ........ 29%  223M 1m44s
4227072K ........ ........ ........ ........ 29% 84.2M 1m44s
4259840K ........ ........ ........ ........ 29% 96.1M 1m43s
4292608K ........ ........ ........ ........ 29% 78.2M 1m43s
4325376K ........ ........ ........ ........ 30% 93.3M 1m43s
4358144K ........ ........ ........ ........ 30%  113M 1m42s
4390912K ........ ........ ........ ........ 30%  106M 1m42s
4423680K ........ ........ ........ ........ 30% 85.2M 1m42s
4456448K ........ ........ ........ ........ 31%  117M 1m41s
4489216K ........ ........ ........ ........ 31% 92.6M 1m41s
4521984K ........ ........ ........ ........ 31% 74.5M 1m41s
4554752K ........ ........ ........ ........ 31%  117M 1m40s
4587520K ........ ........ ........ ........ 32% 96.6M 1m40s
4620288K ........ ........ ........ ........ 32%  101M 1m40s
4653056K ........ ........ ........ ........ 32% 89.8M 99s
4685824K ........ ........ ........ ........ 32% 93.7M 99s
4718592K ........ ........ ........ ........ 32% 98.8M 99s
4751360K ........ ........ ........ ........ 33% 86.6M 98s
4784128K ........ ........ ........ ........ 33% 84.1M 98s
4816896K ........ ........ ........ ........ 33% 56.5M 98s
4849664K ........ ........ ........ ........ 33%  152M 98s
4882432K ........ ........ ........ ........ 34% 82.4M 97s
4915200K ........ ........ ........ ........ 34%  216M 97s
4947968K ........ ........ ........ ........ 34%  113M 96s
4980736K ........ ........ ........ ........ 34% 87.4M 96s
5013504K ........ ........ ........ ........ 34%  122M 96s
5046272K ........ ........ ........ ........ 35% 91.4M 95s
5079040K ........ ........ ........ ........ 35%  102M 95s
5111808K ........ ........ ........ ........ 35% 82.3M 95s
5144576K ........ ........ ........ ........ 35% 98.1M 94s
5177344K ........ ........ ........ ........ 36% 93.1M 94s
5210112K ........ ........ ........ ........ 36% 93.7M 94s
5242880K ........ ........ ........ ........ 36% 48.3M 94s
5275648K ........ ........ ........ ........ 36% 78.4M 94s
5308416K ........ ........ ........ ........ 37%  154M 93s
5341184K ........ ........ ........ ........ 37% 71.6M 93s
5373952K ........ ........ ........ ........ 37%  142M 92s
5406720K ........ ........ ........ ........ 37%  145M 92s
5439488K ........ ........ ........ ........ 37%  118M 92s
5472256K ........ ........ ........ ........ 38% 82.5M 91s
5505024K ........ ........ ........ ........ 38%  126M 91s
5537792K ........ ........ ........ ........ 38% 87.3M 91s
5570560K ........ ........ ........ ........ 38%  145M 90s
5603328K ........ ........ ........ ........ 39%  108M 90s
5636096K ........ ........ ........ ........ 39% 87.0M 89s
5668864K ........ ........ ........ ........ 39%  102M 89s
5701632K ........ ........ ........ ........ 39% 93.3M 89s
5734400K ........ ........ ........ ........ 39% 88.3M 88s
5767168K ........ ........ ........ ........ 40% 84.6M 88s
5799936K ........ ........ ........ ........ 40%  107M 88s
5832704K ........ ........ ........ ........ 40% 89.3M 87s
5865472K ........ ........ ........ ........ 40%  112M 87s
5898240K ........ ........ ........ ........ 41% 62.9M 87s
5931008K ........ ........ ........ ........ 41% 80.2M 87s
5963776K ........ ........ ........ ........ 41%  150M 86s
5996544K ........ ........ ........ ........ 41%  126M 86s
6029312K ........ ........ ........ ........ 41% 95.9M 85s
6062080K ........ ........ ........ ........ 42% 97.9M 85s
6094848K ........ ........ ........ ........ 42% 97.6M 85s
6127616K ........ ........ ........ ........ 42% 88.3M 84s
6160384K ........ ........ ........ ........ 42%  117M 84s
6193152K ........ ........ ........ ........ 43% 71.7M 84s
6225920K ........ ........ ........ ........ 43% 95.9M 83s
6258688K ........ ........ ........ ........ 43%  108M 83s
6291456K ........ ........ ........ ........ 43%  106M 83s
6324224K ........ ........ ........ ........ 44% 90.4M 82s
6356992K ........ ........ ........ ........ 44% 92.7M 82s
6389760K ........ ........ ........ ........ 44% 95.1M 82s
6422528K ........ ........ ........ ........ 44%  119M 81s
6455296K ........ ........ ........ ........ 44% 96.1M 81s
6488064K ........ ........ ........ ........ 45% 71.0M 81s
6520832K ........ ........ ........ ........ 45%  121M 80s
6553600K ........ ........ ........ ........ 45% 90.8M 80s
6586368K ........ ........ ........ ........ 45%  100M 80s
6619136K ........ ........ ........ ........ 46% 87.5M 79s
6651904K ........ ........ ........ ........ 46% 53.8M 79s
6684672K ........ ........ ........ ........ 46%  191M 79s
6717440K ........ ........ ........ ........ 46% 67.1M 79s
6750208K ........ ........ ........ ........ 46%  116M 78s
6782976K ........ ........ ........ ........ 47%  133M 78s
6815744K ........ ........ ........ ........ 47%  116M 77s
6848512K ........ ........ ........ ........ 47%  103M 77s
6881280K ........ ........ ........ ........ 47%  102M 77s
6914048K ........ ........ ........ ........ 48% 93.6M 76s
6946816K ........ ........ ........ ........ 48% 92.1M 76s
6979584K ........ ........ ........ ........ 48%  106M 76s
7012352K ........ ........ ........ ........ 48% 73.4M 75s
7045120K ........ ........ ........ ........ 49%  109M 75s
7077888K ........ ........ ........ ........ 49%  109M 75s
7110656K ........ ........ ........ ........ 49% 96.5M 74s
7143424K ........ ........ ........ ........ 49% 92.4M 74s
7176192K ........ ........ ........ ........ 49% 93.5M 74s
7208960K ........ ........ ........ ........ 50% 97.3M 73s
7241728K ........ ........ ........ ........ 50% 57.2M 73s
7274496K ........ ........ ........ ........ 50%  148M 73s
7307264K ........ ........ ........ ........ 50% 92.2M 73s
7340032K ........ ........ ........ ........ 51%  159M 72s
7372800K ........ ........ ........ ........ 51% 52.6M 72s
7405568K ........ ........ ........ ........ 51%  168M 72s
7438336K ........ ........ ........ ........ 51%  144M 71s
7471104K ........ ........ ........ ........ 51% 87.6M 71s
7503872K ........ ........ ........ ........ 52% 99.3M 70s
7536640K ........ ........ ........ ........ 52%  120M 70s
7569408K ........ ........ ........ ........ 52% 92.0M 70s
7602176K ........ ........ ........ ........ 52% 97.4M 69s
7634944K ........ ........ ........ ........ 53% 82.9M 69s
7667712K ........ ........ ........ ........ 53% 69.9M 69s
7700480K ........ ........ ........ ........ 53%  145M 68s
7733248K ........ ........ ........ ........ 53% 99.2M 68s
7766016K ........ ........ ........ ........ 54% 48.5M 68s
7798784K ........ ........ ........ ........ 54%  184M 68s
7831552K ........ ........ ........ ........ 54% 58.8M 67s
7864320K ........ ........ ........ ........ 54% 47.7M 67s
7897088K ........ ........ ........ ........ 54%  141M 67s
7929856K ........ ........ ........ ........ 55%  113M 67s
7962624K ........ ........ ........ ........ 55% 83.5M 66s
7995392K ........ ........ ........ ........ 55%  124M 66s
8028160K ........ ........ ........ ........ 55% 99.8M 65s
8060928K ........ ........ ........ ........ 56%  144M 65s
8093696K ........ ........ ........ ........ 56% 73.2M 65s
8126464K ........ ........ ........ ........ 56%  193M 64s
8159232K ........ ........ ........ ........ 56%  140M 64s
8192000K ........ ........ ........ ........ 56%  199M 63s
8224768K ........ ........ ........ ........ 57% 90.1M 63s
8257536K ........ ........ ........ ........ 57%  110M 63s
8290304K ........ ........ ........ ........ 57% 94.6M 62s
8323072K ........ ........ ........ ........ 57% 91.7M 62s
8355840K ........ ........ ........ ........ 58%  123M 62s
8388608K ........ ........ ........ ........ 58% 91.4M 61s
8421376K ........ ........ ........ ........ 58% 62.7M 61s
8454144K ........ ........ ........ ........ 58% 65.4M 61s
8486912K ........ ........ ........ ........ 59%  108M 61s
8519680K ........ ........ ........ ........ 59%  217M 60s
8552448K ........ ........ ........ ........ 59%  114M 60s
8585216K ........ ........ ........ ........ 59%  104M 59s
8617984K ........ ........ ........ ........ 59% 86.9M 59s
8650752K ........ ........ ........ ........ 60% 98.4M 59s
8683520K ........ ........ ........ ........ 60% 69.9M 58s
8716288K ........ ........ ........ ........ 60%  177M 58s
8749056K ........ ........ ........ ........ 60% 83.5M 58s
8781824K ........ ........ ........ ........ 61% 87.4M 57s
8814592K ........ ........ ........ ........ 61% 91.2M 57s
8847360K ........ ........ ........ ........ 61% 72.1M 57s
8880128K ........ ........ ........ ........ 61%  124M 56s
8912896K ........ ........ ........ ........ 61% 81.2M 56s
8945664K ........ ........ ........ ........ 62%  237M 56s
8978432K ........ ........ ........ ........ 62% 78.5M 55s
9011200K ........ ........ ........ ........ 62% 84.3M 55s
9043968K ........ ........ ........ ........ 62%  130M 55s
9076736K ........ ........ ........ ........ 63% 84.2M 54s
9109504K ........ ........ ........ ........ 63% 79.6M 54s
9142272K ........ ........ ........ ........ 63% 81.9M 54s
9175040K ........ ........ ........ ........ 63%  128M 53s
9207808K ........ ........ ........ ........ 64% 95.4M 53s
9240576K ........ ........ ........ ........ 64%  107M 53s
9273344K ........ ........ ........ ........ 64%  120M 52s
9306112K ........ ........ ........ ........ 64% 53.7M 52s
9338880K ........ ........ ........ ........ 64% 95.8M 52s
9371648K ........ ........ ........ ........ 65% 54.0M 52s
9404416K ........ ........ ........ ........ 65% 59.8M 51s
9437184K ........ ........ ........ ........ 65% 95.2M 51s
9469952K ........ ........ ........ ........ 65% 63.8M 51s
9502720K ........ ........ ........ ........ 66%  124M 50s
9535488K ........ ........ ........ ........ 66%  136M 50s
9568256K ........ ........ ........ ........ 66%  133M 50s
9601024K ........ ........ ........ ........ 66%  106M 49s
9633792K ........ ........ ........ ........ 66% 55.8M 49s
9666560K ........ ........ ........ ........ 67% 83.3M 49s
9699328K ........ ........ ........ ........ 67%  129M 48s
9732096K ........ ........ ........ ........ 67% 60.8M 48s
9764864K ........ ........ ........ ........ 67%  162M 48s
9797632K ........ ........ ........ ........ 68%  185M 47s
9830400K ........ ........ ........ ........ 68% 91.0M 47s
9863168K ........ ........ ........ ........ 68%  129M 47s
9895936K ........ ........ ........ ........ 68%  214M 46s
9928704K ........ ........ ........ ........ 69%  129M 46s
9961472K ........ ........ ........ ........ 69% 56.2M 46s
9994240K ........ ........ ........ ........ 69%  123M 45s
10027008K ........ ........ ........ ........ 69%  157M 45s
10059776K ........ ........ ........ ........ 69%  131M 44s
10092544K ........ ........ ........ ........ 70%  100M 44s
10125312K ........ ........ ........ ........ 70%  132M 44s
10158080K ........ ........ ........ ........ 70%  148M 43s
10190848K ........ ........ ........ ........ 70% 79.0M 43s
10223616K ........ ........ ........ ........ 71% 72.6M 43s
10256384K ........ ........ ........ ........ 71% 65.0M 42s
10289152K ........ ........ ........ ........ 71%  144M 42s
10321920K ........ ........ ........ ........ 71%  162M 42s
10354688K ........ ........ ........ ........ 71% 58.2M 41s
10387456K ........ ........ ........ ........ 72%  121M 41s
10420224K ........ ........ ........ ........ 72%  134M 41s
10452992K ........ ........ ........ ........ 72%  112M 40s
10485760K ........ ........ ........ ........ 72%  110M 40s
10518528K ........ ........ ........ ........ 73% 92.6M 40s
10551296K ........ ........ ........ ........ 73% 98.0M 39s
10584064K ........ ........ ........ ........ 73%  121M 39s
10616832K ........ ........ ........ ........ 73% 93.1M 39s
10649600K ........ ........ ........ ........ 74% 85.5M 38s
10682368K ........ ........ ........ ........ 74%  109M 38s
10715136K ........ ........ ........ ........ 74% 83.5M 38s
10747904K ........ ........ ........ ........ 74%  101M 37s
10780672K ........ ........ ........ ........ 74% 87.1M 37s
10813440K ........ ........ ........ ........ 75% 76.9M 37s
10846208K ........ ........ ........ ........ 75%  137M 36s
10878976K ........ ........ ........ ........ 75% 93.5M 36s
10911744K ........ ........ ........ ........ 75%  104M 36s
10944512K ........ ........ ........ ........ 76% 98.0M 35s
10977280K ........ ........ ........ ........ 76% 77.2M 35s
11010048K ........ ........ ........ ........ 76%  117M 35s
11042816K ........ ........ ........ ........ 76% 91.3M 34s
11075584K ........ ........ ........ ........ 76% 80.6M 34s
11108352K ........ ........ ........ ........ 77%  121M 34s
11141120K ........ ........ ........ ........ 77% 97.1M 33s
11173888K ........ ........ ........ ........ 77%  101M 33s
11206656K ........ ........ ........ ........ 77% 80.4M 33s
11239424K ........ ........ ........ ........ 78% 68.0M 32s
11272192K ........ ........ ........ ........ 78%  162M 32s
11304960K ........ ........ ........ ........ 78% 77.3M 32s
11337728K ........ ........ ........ ........ 78%  115M 31s
11370496K ........ ........ ........ ........ 79% 90.5M 31s
11403264K ........ ........ ........ ........ 79%  109M 31s
11436032K ........ ........ ........ ........ 79%  122M 30s
11468800K ........ ........ ........ ........ 79% 93.2M 30s
11501568K ........ ........ ........ ........ 79% 73.8M 30s
11534336K ........ ........ ........ ........ 80% 98.4M 29s
11567104K ........ ........ ........ ........ 80%  113M 29s
11599872K ........ ........ ........ ........ 80% 87.1M 29s
11632640K ........ ........ ........ ........ 80% 95.9M 28s
11665408K ........ ........ ........ ........ 81% 98.8M 28s
11698176K ........ ........ ........ ........ 81% 40.8M 28s
11730944K ........ ........ ........ ........ 81%  130M 27s
11763712K ........ ........ ........ ........ 81%  132M 27s
11796480K ........ ........ ........ ........ 81%  149M 27s
11829248K ........ ........ ........ ........ 82% 70.6M 26s
11862016K ........ ........ ........ ........ 82%  157M 26s
11894784K ........ ........ ........ ........ 82%  116M 26s
11927552K ........ ........ ........ ........ 82%  106M 25s
11960320K ........ ........ ........ ........ 83%  107M 25s
11993088K ........ ........ ........ ........ 83%  101M 25s
12025856K ........ ........ ........ ........ 83% 66.5M 24s
12058624K ........ ........ ........ ........ 83% 90.0M 24s
12091392K ........ ........ ........ ........ 83%  109M 24s
12124160K ........ ........ ........ ........ 84% 87.1M 23s
12156928K ........ ........ ........ ........ 84% 75.0M 23s
12189696K ........ ........ ........ ........ 84% 58.0M 23s
12222464K ........ ........ ........ ........ 84% 97.2M 22s
12255232K ........ ........ ........ ........ 85%  199M 22s
12288000K ........ ........ ........ ........ 85%  117M 22s
12320768K ........ ........ ........ ........ 85% 49.7M 21s
12353536K ........ ........ ........ ........ 85% 83.2M 21s
12386304K ........ ........ ........ ........ 86%  137M 21s
12419072K ........ ........ ........ ........ 86% 80.8M 20s
12451840K ........ ........ ........ ........ 86% 98.4M 20s
12484608K ........ ........ ........ ........ 86%  122M 20s
12517376K ........ ........ ........ ........ 86%  116M 19s
12550144K ........ ........ ........ ........ 87%  204M 19s
12582912K ........ ........ ........ ........ 87%  128M 19s
12615680K ........ ........ ........ ........ 87%  158M 18s
12648448K ........ ........ ........ ........ 87%  102M 18s
12681216K ........ ........ ........ ........ 88% 78.8M 18s
12713984K ........ ........ ........ ........ 88%  109M 17s
12746752K ........ ........ ........ ........ 88% 89.3M 17s
12779520K ........ ........ ........ ........ 88% 99.5M 17s
12812288K ........ ........ ........ ........ 88%  114M 16s
12845056K ........ ........ ........ ........ 89% 87.3M 16s
12877824K ........ ........ ........ ........ 89% 64.3M 16s
12910592K ........ ........ ........ ........ 89%  105M 15s
12943360K ........ ........ ........ ........ 89%  135M 15s
12976128K ........ ........ ........ ........ 90% 94.1M 15s
13008896K ........ ........ ........ ........ 90% 95.7M 14s
13041664K ........ ........ ........ ........ 90% 89.9M 14s
13074432K ........ ........ ........ ........ 90% 98.9M 14s
13107200K ........ ........ ........ ........ 91%  123M 13s
13139968K ........ ........ ........ ........ 91% 93.3M 13s
13172736K ........ ........ ........ ........ 91% 89.8M 13s
13205504K ........ ........ ........ ........ 91% 62.2M 12s
13238272K ........ ........ ........ ........ 91%  214M 12s
13271040K ........ ........ ........ ........ 92% 87.7M 12s
13303808K ........ ........ ........ ........ 92% 89.4M 11s
13336576K ........ ........ ........ ........ 92% 69.3M 11s
13369344K ........ ........ ........ ........ 92%  110M 11s
13402112K ........ ........ ........ ........ 93%  165M 10s
13434880K ........ ........ ........ ........ 93% 89.4M 10s
13467648K ........ ........ ........ ........ 93% 72.7M 10s
13500416K ........ ........ ........ ........ 93% 65.6M 9s
13533184K ........ ........ ........ ........ 93%  137M 9s
13565952K ........ ........ ........ ........ 94%  156M 9s
13598720K ........ ........ ........ ........ 94% 62.6M 8s
13631488K ........ ........ ........ ........ 94%  126M 8s
13664256K ........ ........ ........ ........ 94%  156M 8s
13697024K ........ ........ ........ ........ 95% 68.1M 7s
13729792K ........ ........ ........ ........ 95%  108M 7s
13762560K ........ ........ ........ ........ 95% 92.0M 7s
13795328K ........ ........ ........ ........ 95%  124M 6s
13828096K ........ ........ ........ ........ 96% 70.5M 6s
13860864K ........ ........ ........ ........ 96%  100M 6s
13893632K ........ ........ ........ ........ 96%  125M 5s
13926400K ........ ........ ........ ........ 96%  123M 5s
13959168K ........ ........ ........ ........ 96% 58.1M 5s
13991936K ........ ........ ........ ........ 97%  113M 4s
14024704K ........ ........ ........ ........ 97%  145M 4s
14057472K ........ ........ ........ ........ 97%  104M 4s
14090240K ........ ........ ........ ........ 97% 82.4M 3s
14123008K ........ ........ ........ ........ 98% 74.7M 3s
14155776K ........ ........ ........ ........ 98%  139M 3s
14188544K ........ ........ ........ ........ 98% 92.3M 2s
14221312K ........ ........ ........ ........ 98% 94.8M 2s
14254080K ........ ........ ........ ........ 98%  109M 1s
14286848K ........ ........ ........ ........ 99% 64.7M 1s
14319616K ........ ........ ........ ........ 99% 76.1M 1s
14352384K ........ ........ ........ ........ 99%  201M 0s
14385152K ........ ........ ........ ........ 99%  113M 0s
14417920K ........ .......                   100%  114M=2m28s

2026-01-28 22:14:09 (95.5 MB/s) - ‘hits.parquet’ saved [14779976446/14779976446]

Run benchmarks

[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
[null, null, null],
Load time: 0
Data size: 14779976446	hits.parquet
14779976446	total
+ echo -n 'Disk usage after: '
+ tee -a log
Disk usage after: + df -B1 /
+ tail -n1
+ awk '{ print $3 }'
+ tee -a log
16919031808
+ echo 'System: datafusion'
+ tee -a log
System: datafusion
+ echo -n 'Machine: '
+ tee -a log
Machine: + tee -a log
++ curl -X PUT http://169.254.169.254/latest/api/token -sS -H 'X-aws-ec2-metadata-token-ttl-seconds: 21600'
+ curl -sS -H 'X-aws-ec2-metadata-token: AQAEAHYMTEz4UvNYottnPI6gP_vJWVWxktP59mb5nicrJ-yqP6gYiw==' http://169.254.169.254/latest/meta-data/instance-type
c6a.4xlarge+ echo
+ tee -a log

+ echo 'Total time: 182'
+ tee -a log
Total time: 182
+ du -b --max-depth=2
+ tee -a log
6794	./results
14780027492	.
+ RESULTS_URL='https://play.clickhouse.com/?user=sink&query=INSERT+INTO+data+FORMAT+RawBLOB'
+ curl 'https://play.clickhouse.com/?user=sink&query=INSERT+INTO+data+FORMAT+RawBLOB' --data-binary @log
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 28826    0     0  100 28826      0  98561 --:--:-- --:--:-- --:--:-- 98719
+ curl 'https://play.clickhouse.com/?user=sink&query=INSERT+INTO+data+FORMAT+RawBLOB' --data-binary @/var/log/cloud-init-output.log

@rschu1ze rschu1ze merged commit 4195872 into main Jan 28, 2026
@waynexia
Copy link
Contributor

waynexia commented Feb 2, 2026

Oops, my bad. I'll look into this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@rschu1ze @waynexia