Skip to content

Respect caption dropout in AnyFlow derivative guidance - #3301

Merged
bghira merged 1 commit into
mainfrom
fix/anyflow-dropout-guidance
Oct 28, 2026
Merged

bghira merged 1 commit into
mainfrom
fix/anyflow-dropout-guidance

Conversation

@bghira

@bghira bghira commented Oct 28, 2026 •

Copy link
Copy Markdown
Owner

MeanFlow divided every finite-difference derivative by the fused guidance scale, including dropped-caption samples whose conditional and unconditional predictions share the same model and conditioning. This changes the target of an already-correct unconditional flow.

Carry a per-sample conditioning mask from collation and scale derivatives only where guidance applies. A model foundation hook lets Ideogram retain guidance against its separate unconditional transformer. Tests cover selected and dropped captions, mixed batches, dedicated unconditional models, invalid masks, and exact Gaussian-flow fixed points. The new AnyFlow regressions participate in standard unittest discovery.

Validation:

  • .venv/bin/python -m unittest -v -f tests.test_anyflow_dropout_guidance tests.helpers.distillation.test_anyflow_distiller tests.test_collate tests.test_ideogram_unconditional — 92 tests passed.
  • The mixed-caption and exact-flow regressions fail against the original guidance calculation.
  • All pre-commit hooks passed.
  • Full unittest discovery passed all tests before a fixed-port webhook fixture collision between parallel suites. The webhook fixture and remaining 479 tests passed when rerun serially.

@bghira
bghira merged commit 92d6963 into main Oct 28, 2026
2 checks passed
@bghira
bghira deleted the fix/anyflow-dropout-guidance branch October 28, 2026 13:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant