[Flux2] Fix LoRA loading for Flux2 Klein by adaptively enumerating transformer blocks #13030
+8
−2
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
The Flux2 model features the same underlying architecture as its successor, the Flux2 Klein series, but varies in the number of Transformer Blocks — these block differences correspond to the two variants with distinct computational footprints, namely the 4B and 9B versions.
Previously, this architectural mismatch was the root cause of errors when loading LoRAs fine-tuned on Flux2 Klein models (context: ostris/ai-toolkit#667).
The update now adaptively enumerates the number of Transformer Blocks, thereby enabling seamless LoRA loading across both the original Flux2 and the entire Flux2 Klein series.
Who is this for?
Users trying to load LoRAs trained on Flux2 Klein (4B/9B variants) into the diffusers Flux pipeline.
Checklist: