Skip to content

merge - #3304

Merged
bghira merged 44 commits into
releasefrom
main
Oct 28, 2026
Merged

merge#3304
bghira merged 44 commits into
releasefrom
main

Conversation

@bghira

@bghira bghira commented Oct 28, 2026

Copy link
Copy Markdown
Owner

No description provided.

bghira and others added 30 commits October 18, 2026 13:26
Organize training examples by model family, flavour, and VRAM
…cision

Port KohakuFA key centering and precision diagnostics
Keep EMA accumulation in FP32 during mixed-precision training
Serialize DINOv2 cache loading across REPA workers
Target repeated MOSS transformer blocks for regional compilation
Require LyCORIS 4.1.3 to fix LoKR kernel dispatch
Refresh Webshart caption and image metadata caches on worker reload
Sync CuTe attention with KohakuFA-CuTe 9280c20
Port KohakuFA-CuTe eb1c2f2 query-column sharing, staged KV statistics,
and cache/replay regressions.
Thread completion does not guarantee that multiprocessing queue feeders
have published bucket results. Match queue types to worker types and
cover delayed feeder writes in the eval metadata regression.
Synchronize CuTe kernels with upstream 181c1c2 and extend projection-layout,
gradient cancellation, and full-width dispatch coverage for SM120.
Optimize SM120 CuTe attention with full-width D512 tiles
Sync KohakuFA-CuTe c0786dd, enable SM86 in native and automatic dispatch,
and extend architecture, graph replay, and gradient regressions. Update
the attention option documentation and translations.
Add SM86 Ampere support and improve Ada CuTe attention
Disable cuDNN SDPA to prevent nonfinite attention gradients
Enable VAE tiling automatically after CUDA OOM
@bghira
bghira merged commit be6dff9 into release Oct 28, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant