Commit ba2db74
committed
simd(W1a-#9): U64x8/U32x16 andnot + ternlog — the masking primitives
Adds the two operators the polyfill lacked for mask composition: set
difference, and any 3-input boolean function selected by a truth-table
immediate. No new type — U64x8 (8 x u64 = 512 bits) and U32x16 already
exist in every backend and are re-exported from all six arms of simd.rs,
so simd.rs needs no dispatch change; the methods ride along.
Why these two: FieldMask-style bitsets had AND/OR/XOR and no and-not,
which is the operator 'stack this prerequisite, exclude that one' needs,
and no three-input form at all. Stacking N prerequisite masks cost N-1
ops; with ternlog it costs ceil((N-1)/2), and on AVX-512 each of those is
one instruction over 512 positions regardless of how many bits are set.
Semantics, identical on every backend:
a.andnot(b) = a & !b -- NOTE the argument order differs from the raw
intrinsic: _mm*_andnot_si*(a, b) computes !a & b. Documented at every
definition; the AVX-512 path swaps its arguments accordingly.
a.ternlog::<IMM>(b, c): per bit, index = (a<<2)|(b<<1)|c, result bit =
(IMM >> index) & 1 (Intel VPTERNLOG convention). IMM is i32 to match
the intrinsic; 0..=255 legal, enforced at compile time by the
intrinsic's own static assert. Named immediates (AND3, AND2_ANDNOT,
OR2_AND, MAJ3, ...) in the scalar backend's ternlog module.
Total functions: no saturation, no overflow, no UB, no lane interaction.
Backends. AVX-512 uses the native intrinsics; that module compiles only
under a global target_feature = avx512f, which is the guard -- no added
CPU check, no runtime detection. AVX2/NEON/wasm/scalar share ONE portable
body: an element-wise loop over the repr(align(64)) backing array, the
same idiom this file's existing BitAnd/BitOr/BitXor use. That is not a
scalar fallback -- measured codegen below.
Measured codegen (examples/w1a9_codegen_probe.rs, black_box'd inputs,
release):
v4 (config-avx512.toml):
ternlog::<0x80> -> vpternlogq /bin/bashx80,%zmm2,%zmm1,%zmm0 (1 insn)
ternlog::<0x40> -> vpternlogq /bin/bashx40,%zmm2,%zmm1,%zmm0 (1 insn)
andnot -> vandnps %zmm0,%zmm1,%zmm0 (1 insn)
v3 default (.cargo/config.toml):
ternlog::<0x80> -> 2 x [vmovaps ymm; vandps; vandps; vmovaps]
aligned moves, 512 bits in 8 insns
The portable body auto-vectorises to real ymm work; repr(align(64)) is
what earns the aligned vmovaps. Matches the storage documented for the
HSW/ARL profiles in .claude/knowledge/agnostic-surface-cpu-matrix.md.
Tests (5, at the simd.rs facade so they exercise whichever backend the
build selected): all 256 immediates against an independent bit-by-bit
truth-table reference; andnot direction with an anti-vacuity assertion
that the self-minus-other vs not-self-and-other distinction is actually
observable on the corpus; named-immediate meanings with a pairwise
distinctness check so aliasing cannot pass; agreement with the existing
BitAnd/BitOr/BitXor operators; the 32-bit-lane sibling. Fixed-seed
SplitMix64 corpus with edge cases (0, MAX, 0x5555.., 0xAAAA..), no
dev-dependency added.
Verification: lib suite 2207 passed / 0 failed on the v3 arm; cargo check
clean on the v4 arm; fmt clean; clippy adds no finding (3 pre-existing
warnings remain in property_mask.rs / bitwise.rs / palette_codec.rs,
untouched here).
Known gap, stated rather than papered over: the v4 arm's *test* build is
broken on main independently of this change (15 errors on a clean tree,
missing I8x16/U64x8/U16x8 types in unrelated test modules), so the parity
tests could not be RUN under AVX-512 -- only compiled. The native path is
verified by the disassembly above, not by a test execution.
Consumer site: AdaWorldAPI/lance-graph crates/lance-graph-contract/src/
class_view.rs -- FieldMask/WideFieldMask carry intersect/union/is_disjoint
and lack difference/is_subset_of (D-MAR-1); and graph/blasgraph/
typed_graph.rs masked_traverse, which filters a materialised result
per-entry instead of masking during the operation.
Co-Authored-By: Claude <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01KCGhDYoQBXs3poaR7sFuqp1 parent 4612014 commit ba2db74
5 files changed
Lines changed: 598 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1266 | 1266 | | |
1267 | 1267 | | |
1268 | 1268 | | |
| 1269 | + | |
| 1270 | + | |
| 1271 | + | |
| 1272 | + | |
| 1273 | + | |
| 1274 | + | |
| 1275 | + | |
| 1276 | + | |
| 1277 | + | |
| 1278 | + | |
| 1279 | + | |
| 1280 | + | |
| 1281 | + | |
| 1282 | + | |
| 1283 | + | |
| 1284 | + | |
| 1285 | + | |
| 1286 | + | |
| 1287 | + | |
| 1288 | + | |
| 1289 | + | |
| 1290 | + | |
| 1291 | + | |
| 1292 | + | |
| 1293 | + | |
| 1294 | + | |
| 1295 | + | |
| 1296 | + | |
| 1297 | + | |
| 1298 | + | |
| 1299 | + | |
| 1300 | + | |
| 1301 | + | |
| 1302 | + | |
| 1303 | + | |
| 1304 | + | |
| 1305 | + | |
| 1306 | + | |
| 1307 | + | |
| 1308 | + | |
| 1309 | + | |
| 1310 | + | |
| 1311 | + | |
| 1312 | + | |
| 1313 | + | |
| 1314 | + | |
| 1315 | + | |
| 1316 | + | |
| 1317 | + | |
| 1318 | + | |
| 1319 | + | |
| 1320 | + | |
| 1321 | + | |
| 1322 | + | |
| 1323 | + | |
| 1324 | + | |
| 1325 | + | |
| 1326 | + | |
| 1327 | + | |
| 1328 | + | |
| 1329 | + | |
| 1330 | + | |
| 1331 | + | |
| 1332 | + | |
| 1333 | + | |
| 1334 | + | |
| 1335 | + | |
| 1336 | + | |
| 1337 | + | |
| 1338 | + | |
| 1339 | + | |
| 1340 | + | |
| 1341 | + | |
| 1342 | + | |
| 1343 | + | |
| 1344 | + | |
| 1345 | + | |
| 1346 | + | |
| 1347 | + | |
| 1348 | + | |
| 1349 | + | |
| 1350 | + | |
| 1351 | + | |
| 1352 | + | |
| 1353 | + | |
| 1354 | + | |
| 1355 | + | |
| 1356 | + | |
| 1357 | + | |
| 1358 | + | |
| 1359 | + | |
| 1360 | + | |
| 1361 | + | |
| 1362 | + | |
| 1363 | + | |
| 1364 | + | |
| 1365 | + | |
| 1366 | + | |
| 1367 | + | |
| 1368 | + | |
| 1369 | + | |
| 1370 | + | |
| 1371 | + | |
| 1372 | + | |
| 1373 | + | |
| 1374 | + | |
| 1375 | + | |
| 1376 | + | |
| 1377 | + | |
| 1378 | + | |
| 1379 | + | |
| 1380 | + | |
| 1381 | + | |
| 1382 | + | |
| 1383 | + | |
| 1384 | + | |
| 1385 | + | |
| 1386 | + | |
| 1387 | + | |
| 1388 | + | |
| 1389 | + | |
| 1390 | + | |
| 1391 | + | |
| 1392 | + | |
| 1393 | + | |
| 1394 | + | |
| 1395 | + | |
| 1396 | + | |
| 1397 | + | |
| 1398 | + | |
| 1399 | + | |
| 1400 | + | |
| 1401 | + | |
| 1402 | + | |
| 1403 | + | |
| 1404 | + | |
| 1405 | + | |
| 1406 | + | |
| 1407 | + | |
| 1408 | + | |
| 1409 | + | |
| 1410 | + | |
| 1411 | + | |
| 1412 | + | |
| 1413 | + | |
| 1414 | + | |
| 1415 | + | |
| 1416 | + | |
| 1417 | + | |
| 1418 | + | |
| 1419 | + | |
| 1420 | + | |
| 1421 | + | |
| 1422 | + | |
| 1423 | + | |
| 1424 | + | |
| 1425 | + | |
| 1426 | + | |
| 1427 | + | |
| 1428 | + | |
| 1429 | + | |
| 1430 | + | |
| 1431 | + | |
| 1432 | + | |
| 1433 | + | |
| 1434 | + | |
| 1435 | + | |
| 1436 | + | |
| 1437 | + | |
| 1438 | + | |
| 1439 | + | |
| 1440 | + | |
| 1441 | + | |
| 1442 | + | |
| 1443 | + | |
| 1444 | + | |
| 1445 | + | |
| 1446 | + | |
| 1447 | + | |
| 1448 | + | |
| 1449 | + | |
| 1450 | + | |
| 1451 | + | |
| 1452 | + | |
| 1453 | + | |
| 1454 | + | |
| 1455 | + | |
| 1456 | + | |
| 1457 | + | |
| 1458 | + | |
| 1459 | + | |
| 1460 | + | |
| 1461 | + | |
| 1462 | + | |
| 1463 | + | |
| 1464 | + | |
| 1465 | + | |
| 1466 | + | |
| 1467 | + | |
| 1468 | + | |
| 1469 | + | |
| 1470 | + | |
| 1471 | + | |
| 1472 | + | |
| 1473 | + | |
| 1474 | + | |
| 1475 | + | |
| 1476 | + | |
| 1477 | + | |
| 1478 | + | |
| 1479 | + | |
| 1480 | + | |
| 1481 | + | |
| 1482 | + | |
| 1483 | + | |
| 1484 | + | |
1269 | 1485 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3500 | 3500 | | |
3501 | 3501 | | |
3502 | 3502 | | |
| 3503 | + | |
| 3504 | + | |
| 3505 | + | |
| 3506 | + | |
| 3507 | + | |
| 3508 | + | |
| 3509 | + | |
| 3510 | + | |
| 3511 | + | |
| 3512 | + | |
| 3513 | + | |
| 3514 | + | |
| 3515 | + | |
| 3516 | + | |
| 3517 | + | |
| 3518 | + | |
| 3519 | + | |
| 3520 | + | |
| 3521 | + | |
| 3522 | + | |
| 3523 | + | |
| 3524 | + | |
| 3525 | + | |
| 3526 | + | |
| 3527 | + | |
| 3528 | + | |
| 3529 | + | |
| 3530 | + | |
| 3531 | + | |
| 3532 | + | |
| 3533 | + | |
| 3534 | + | |
| 3535 | + | |
| 3536 | + | |
| 3537 | + | |
| 3538 | + | |
| 3539 | + | |
| 3540 | + | |
| 3541 | + | |
| 3542 | + | |
| 3543 | + | |
| 3544 | + | |
| 3545 | + | |
| 3546 | + | |
| 3547 | + | |
| 3548 | + | |
| 3549 | + | |
| 3550 | + | |
| 3551 | + | |
| 3552 | + | |
| 3553 | + | |
| 3554 | + | |
| 3555 | + | |
| 3556 | + | |
| 3557 | + | |
| 3558 | + | |
| 3559 | + | |
| 3560 | + | |
| 3561 | + | |
| 3562 | + | |
| 3563 | + | |
| 3564 | + | |
| 3565 | + | |
| 3566 | + | |
| 3567 | + | |
| 3568 | + | |
| 3569 | + | |
| 3570 | + | |
| 3571 | + | |
| 3572 | + | |
| 3573 | + | |
| 3574 | + | |
| 3575 | + | |
| 3576 | + | |
| 3577 | + | |
| 3578 | + | |
| 3579 | + | |
| 3580 | + | |
| 3581 | + | |
| 3582 | + | |
| 3583 | + | |
| 3584 | + | |
| 3585 | + | |
| 3586 | + | |
| 3587 | + | |
| 3588 | + | |
| 3589 | + | |
| 3590 | + | |
| 3591 | + | |
| 3592 | + | |
| 3593 | + | |
| 3594 | + | |
| 3595 | + | |
| 3596 | + | |
| 3597 | + | |
| 3598 | + | |
| 3599 | + | |
| 3600 | + | |
| 3601 | + | |
| 3602 | + | |
| 3603 | + | |
| 3604 | + | |
| 3605 | + | |
| 3606 | + | |
| 3607 | + | |
| 3608 | + | |
| 3609 | + | |
| 3610 | + | |
| 3611 | + | |
| 3612 | + | |
| 3613 | + | |
| 3614 | + | |
| 3615 | + | |
| 3616 | + | |
| 3617 | + | |
| 3618 | + | |
| 3619 | + | |
| 3620 | + | |
| 3621 | + | |
| 3622 | + | |
| 3623 | + | |
| 3624 | + | |
| 3625 | + | |
| 3626 | + | |
| 3627 | + | |
| 3628 | + | |
| 3629 | + | |
| 3630 | + | |
| 3631 | + | |
| 3632 | + | |
| 3633 | + | |
| 3634 | + | |
0 commit comments