LLM/diffusers
1
0
Fork 0
mirror of https://github.com/huggingface/diffusers.git synced 2026-02-15 15:25:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,913 Commits 742 Branches 94 Tags
4c5082ca685d1dd0a24907890da170e258e5cd01
Commit Graph

4913 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Álvaro Somoza
25b4975285 [SD3 Training] T5 token limit (#8564) 
* initial commit

* default back to 77

* better text

* text correction

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
AmosDinh
925e2343d7 Syntax error in readme example "pipe" -> "pipeline" (#8601) 
Update controlnet.md

Syntax error pipe -> pipeline
 2024-12-23 13:02:13 +05:30
Dhruv Nair
a9572e55f3 Temporarily pin Numpy in the CI (#8603) 
temp pin numpy
 2024-12-23 13:02:13 +05:30
YiYi Xu
2ed103560b Image processor latent (#8513) 
* fix

* up

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
 2024-12-23 13:02:13 +05:30
spacepxl
7cb40ee5ab Fix the deletion of SD3 text encoders for Dreambooth/LoRA training if the text encoders are not being trained (#8536) 
* Update train_dreambooth_sd3.py to fix TE garbage collection

* Update train_dreambooth_lora_sd3.py to fix TE garbage collection

---------

Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Rafie Walker
2891f6f116 Implement SD3 loss weighting (#8528) 
* Add lognorm and cosmap weighting

* Implement mode sampling

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* keep timestamp sampling fully on cpu

---------

Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Sayak Paul
1242672994 pin accelerate to 0.31.0 (#8563) 
* pin accelerate to 0.31.0

* update dep table

* empty
 2024-12-23 13:02:13 +05:30
Jonathan Rahn
5a1acc82b0 add sentencepiece to requirements.txt for SD3 dreambooth (#8538) 
* add `sentencepiece` requirement for SD3

add `sentencepiece` requirement

* Empty-Commit

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Sayak Paul
ddbb30b823 pin transformers to the latest (#8522) 
thanks!
 2024-12-23 13:02:13 +05:30
Tolga Cangöz
a81a6d3eed Refactor StableDiffusion3Img2ImgPipeline to remove redundant code (#8533) 2024-12-23 13:02:13 +05:30
Sayak Paul
bcf0f7667f post release 0.29.0 (#8492) 
post release
 2024-12-23 13:02:13 +05:30
Haofan Wang
5d4603a52c Update requirements_sd3.txt (#8521) 2024-12-23 13:02:13 +05:30
YiYi Xu
a18dcb5ccc remove the deprecated prepare_mask_and_masked_image function (#8512) 
remove prepare mask fn

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Dhruv Nair
fa640cc7d7 Expand Single File support in SD3 Pipeline (#8517) 
* update

* update
 2024-12-23 13:02:12 +05:30
Lucain
ff679c5bf7 Fix PATH_IN_REPO on new release in mirror_community_pipeline.yaml (#8519) 
Fix PATH_IN_REPO in mirror workflow
 2024-12-23 13:02:12 +05:30
ちくわぶ
1a7629e5ca Fix duplicate variable assignments in SD3's JointAttnProcessor (#8516) 
* Fix duplicate variable assignments.

* Fix duplicate variable assignments.
 2024-12-23 13:02:12 +05:30
Beinsezii
bca796fc09 Add Hunyuan AutoPipe mapping (#8505) 2024-12-23 13:02:12 +05:30
kkj15dk
830208c5c1 Fix spelling in scheduling_flow_match_euler_discrete.py (#8497) 
Update scheduling_flow_match_euler_discrete.py

Spelling:
Foward -> Forward

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:12 +05:30
Beinsezii
45fcce63e1 Add SD3 AutoPipeline mappings (#8489) 2024-12-23 13:02:12 +05:30
Radamés Ajna
19b14dc11b Fix small typo (#8498) 2024-12-23 13:02:12 +05:30
Sayak Paul
2d66c3278e fix warning log for Transformer SD3 (#8496) 
fix warning log
 2024-12-23 13:02:12 +05:30
Sayak Paul
35adebd36b fix dual transformer2d import (#8491) 
fix
 2024-12-23 13:02:12 +05:30
Ameer Azam
6c9b130bca Update README_sd3.md (#8490) 
becasue in  Readme  it was not correct
train_dreambooth_sd3.py to train_dreambooth_lora_sd3
 2024-12-23 13:02:12 +05:30
Dhruv Nair
d0b14d0f08 Add Stable Diffusion 3 (#8483) 
* up

* add sd3

* update

* update

* add tests

* fix copies

* fix docs

* update

* add dreambooth lora

* add LoRA

* update

* update

* update

* update

* import fix

* update

* Update src/diffusers/pipelines/stable_diffusion_3/pipeline_stable_diffusion_3.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* import fix 2

* update

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* update

* update

* update

* fix ckpt id

* fix more ids

* update

* missing doc

* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update'

* fix

* update

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

* Update src/diffusers/models/autoencoders/autoencoder_kl.py

* note on gated access.

* requirements

* licensing

---------

Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:12 +05:30
Jiwook Han
266c178cb6 🌐 [i18n-KO] Translated conceptual/philosophy.md and 3 other documents to Korean (#8294) 
* translation about 3 documents into Korean

* evaluation doc korean translation

* _toctree.yml modify

* doc title fix : philosopy->philosophy

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/ethical_guidelines.md

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update docs/source/ko/conceptual/evaluation.md

Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>

* Update philosophy.md (from jungnerd)

---------

Co-authored-by: Jihun Lim <31366038+heuristicwave@users.noreply.github.com>
Co-authored-by: Chulhwa (Evan) Han <cjfghk5697@ajou.ac.kr>
 2024-12-23 13:02:12 +05:30
Greg Hunkins
04567a445e 🤫 Quiet IP Adapter Mask Warning (#8475) 
* quiet attn parameters

* fix lint

* make style && make quality

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Sayak Paul
af581b10b9 change max_shard_size to 10GB (#8445) 
* change max_shard_size to 10GB

* add notes to the documentation

* Update src/diffusers/models/modeling_utils.py

Co-authored-by: Lucain <lucainp@gmail.com>

* change to abs limit

---------

Co-authored-by: Lucain <lucainp@gmail.com>
 2024-12-23 13:02:12 +05:30
Patrick
07720df0fa image_processor.py: Fixed an error in ValueError's message (#8447) 
* image_processor.py: Fixed an error in ValueError's message , as the string's join method tried to join types, instead of strings

Bug that occurred:

f"Input is in incorrect format. Currently, we only support {', '.join(supported_formats)}"
TypeError: sequence item 0: expected str instance, type found

* Fixed: C417 Unnecessary `map` usage (rewrite using a generator expression)

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
YiYi Xu
b31191f85c fix SEGA pipeline (#8467) 
* fix

* style

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Sayak Paul
dbc8b516ee Update README.md to update the MaPO project (#8470) 
Update README.md
 2024-12-23 13:02:12 +05:30
Jianqi Pan
c2f2dc8013 🔧 chore: use modeling_outputs.Transformer2DModelOutput (#8436) 
* 🔧 chore: use modeling_outputs.Transformer2DModelOutput

* 🔧 chore: isort

* 🔧 chore: isort

* style

---------

Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Luc Georges
1c9ac547a3 fix(ci): remove unnecessary permissions (#8457) 2024-12-23 13:02:12 +05:30
Luc Georges
14d7c986f2 feat(ci): add trufflehog secrets detection (#8430) 2024-12-23 13:02:12 +05:30
Lucain
4e7fa7715d Move away from cached_download (#8419) 
* Move away from

* unused constant

* Add custom error
 2024-12-23 13:02:12 +05:30
Sayak Paul
5b279af650 [Core] support saving and loading of sharded checkpoints (#7830) 
* feat: support saving a model in sharded checkpoints.

* feat: make loading of sharded checkpoints work.

* add tests

* cleanse the loading logic a bit more.

* more resilience while loading from the Hub.

* parallelize shard downloads by using snapshot_download()/

* default to a shard size.

* more fix

* Empty-Commit

* debug

* fix

* uality

* more debugging

* fix more

* initial comments from Benjamin

* move certain methods to loading_utils

* add test to check if the correct number of shards are present.

* add a test to check if loading of sharded checkpoints from the Hub is okay

* clarify the unit when passed as an int.

* use hf_hub for sharding.

* remove unnecessary code

* remove unnecessary function

* lucain's comments.

* fixes

* address high-level comments.

* fix test

* subfolder shenanigans./

* Update src/diffusers/utils/hub_utils.py

Co-authored-by: Lucain <lucainp@gmail.com>

* Apply suggestions from code review

Co-authored-by: Lucain <lucainp@gmail.com>

* remove _huggingface_hub_version as not needed.

* address more feedback.

* add a test for local_files_only=True/

* need hf hub to be at least 0.23.2

* style

* final comment.

* clean up subfolder.

* deal with suffixes in code.

* _add_variant default.

* use weights_name_pattern

* remove add_suffix_keyword

* clean up downloading of sharded ckpts.

* don't return something special when using index.json

* fix more

* don't use bare except

* remove comments and catch the errors better

* fix a couple of things when using is_file()

* empty

---------

Co-authored-by: Lucain <lucainp@gmail.com>
 2024-12-23 13:02:12 +05:30
Lucain
68892fb0a3 Final fix for mirror community pipeline (#8427) 2024-12-23 13:02:12 +05:30
Lucain
7d461e6b90 Fix mirror community pipeline (#8426) 2024-12-23 13:02:12 +05:30
Lucain
6130c5b827 Fix mirror_community_pipeline.yml name (#8425) 2024-12-23 13:02:12 +05:30
Lucain
ad4b3eee9b Mirror ./examples/community folder on HF (#8417) 
* first draft

* secret

* tiktok

* capital matters

* dataset matter

* don't be a prick

* refact

* only on main or tag

* document with an example

* Update destination dataset

* link

* allow manual trigger

* better

* lin

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Tolga Cangöz
9ed762d207 Optimize test files by fixing CPU-offloading usage (#8409) 
* Refactor code to remove unnecessary calls to `to(torch_device)`

* Refactor code to remove unnecessary calls to `to("cuda")`

* Update pipeline_stable_diffusion_diffedit.py
 2024-12-23 13:02:12 +05:30
Steven Liu
072b14dea1 [docs] Single file usage (#8412) 
* single file usage

* edit
 2024-12-23 13:02:12 +05:30
Sayak Paul
9bafb24cd6 [Core] fix: legacy model mapping (#8416) 
* fix: legacy model mapping

* remove print
 2024-12-23 13:02:12 +05:30
Sayak Paul
751ed84019 [Hunyuan] add optimization related sections to the hunyuan dit docs. (#8402) 
* optimizations to the hunyuan dit docs.

* Apply suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/hunyuandit.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:12 +05:30
Tolga Cangöz
d027cb4326 Errata (#8322) 
* Fix typos

* Trim trailing whitespaces

* Remove a trailing whitespace

* chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0

* Revert "chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0"

This reverts commit fd742b30b4.

* pokemon -> naruto

* `DPMSolverMultistep` -> `DPMSolverMultistepScheduler`

* Improve Markdown stylization

* Improve style

* Improve style

* Refactor pipeline variable names for consistency

* up style
 2024-12-23 13:02:12 +05:30
Guillaume LEGENDRE
a4dd48662e Update tailscale action to main (#8403) 2024-12-23 13:02:12 +05:30
Hzzone
cce0e5af64 Gligen training (#7906) 
* add training code of gligen

* fix code quality tests.

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Sayak Paul
49b9fbb51c [Scheduler] fix: EDM schedulers when using the exp sigma schedule. (#8385) 
* fix: euledm when using the exp sigma schedule.

* fix-copies

* remove print.

* reduce friction

* yiyi's suggestioms
 2024-12-23 13:02:12 +05:30
Sayak Paul
9873a35ae6 [Hunyuan] allow Hunyuan DiT to run under 6GB for GPU VRAM (#8399) 
* allow hunyuan dit to run under 6GB for GPU VRAM

* add section in the docs/
 2024-12-23 13:02:12 +05:30
Sayak Paul
385abf623f [LoRA] Remove legacy LoRA code and related adjustments (#8316) 
* remove legacy code from load_attn_procs.

* finish first draft

* fix more.

* fix more

* add test

* add serialization support.

* fix-copies

* require peft backend for lora tests

* style

* fix test

* fix loading.

* empty

* address benjamin's feedback.
 2024-12-23 13:02:12 +05:30
Sayak Paul
3e841ebca6 [Hunyuan] feat: support chunked ff. (#8397) 
feat: support chunked ff.
 2024-12-23 13:02:12 +05:30