LLM/diffusers
1
0
Fork 0
mirror of https://github.com/huggingface/diffusers.git synced 2026-02-13 22:35:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,913 Commits 744 Branches 94 Tags
4c5082ca685d1dd0a24907890da170e258e5cd01
Commit Graph

4913 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Pedro Cuenca
9320bc0fc4 Interpolate fix on cuda for large output tensors (#10067) 
* Workaround for upscale with large output tensors.

Fixes #10040.

* Fix scale when output_size is given

* Style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Dhruv Nair
8d23c5db06 [Single File] Pass token when fetching interpreted config (#10082) 
update
 2024-12-23 13:02:18 +05:30
hlky
13be7bd77f Fix num_images_per_prompt>1 with Skip Guidance Layers in StableDiffusion3Pipeline (#10086) 2024-12-23 13:02:18 +05:30
Dhruv Nair
47ee799144 [Single File] Fix SD3.5 single file loading (#10077) 
update
 2024-12-23 13:02:18 +05:30
YiYi Xu
72c809eca7 fix offloading for sd3.5 controlnets (#10072) 
* add
 2024-12-23 13:02:18 +05:30
ChG
ee211d7096 fix link in the docs (#10058) 
* fix link in the docs

* fix same issue for ko
 2024-12-23 13:02:18 +05:30
Parag Ekbote
35213f8670 Fixed Nits in Evaluation Docs (#10063) 
Minor fixes and script improvement in evaluation
docs.
 2024-12-23 13:02:18 +05:30
hlky
c9e266e61d Add sigmas to Flux pipelines (#10081) 2024-12-23 13:02:18 +05:30
Sayak Paul
812e688d6a [CI] Add quantization (#9832) 
* add quantization to nightly CI.

* prep.

* fix lib name.

* remove deps that are not needed.

* fix slice.
 2024-12-23 13:02:18 +05:30
SahilCarterr
befe016edf [Fix] Syntax error (#10068) 
fix syntax error
 2024-12-23 13:02:18 +05:30
Sayak Paul
2d9c6269cd [Mochi-1] ensuring to compute the fourier features in FP32 in Mochi encoder (#10031) 
compute fourier features in FP32.
 2024-12-23 13:02:18 +05:30
Fanli Lin
ac5e032ab0 make pipelines tests device-agnostic (part2) (#9400) 
* enable on xpu

* add 1 more

* add one more

* enable more

* add 1 more

* add more

* enable 1

* enable more cases

* enable

* enable

* update comment

* one more

* enable 1

* add more cases

* enable xpu

* add one more caswe

* add more cases

* add 1

* add more

* add more cases

* add case

* enable

* add more

* add more

* add more

* enbale more

* add more

* update code

* update test marker

* add skip back

* update comment

* remove single files

* remove

* style

* add

* revert

* reformat

* enable

* enable esingle g

* add 2 more

* update decorator

* update

* update

* update

* Update tests/pipelines/deepfloyd_if/test_if.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update src/diffusers/utils/testing_utils.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* update float16

* no unitest.skipt

* update

* apply style check

* adapt style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:18 +05:30
Álvaro Somoza
0c8b319ac0 Change image_gen_aux repository URL (#10048) 
change image_gen_aux repo url
 2024-12-23 13:02:18 +05:30
Dimitri Barbot
ca6229bc75 Add sdxl controlnet reference community pipeline (#9893) 
* Add reference_attn & reference_adain support for sdxl with other controlnet

* Update README.md

* Update README.md by replacing human example with a cat one

Replace human example with a cat one

* Replace default human example with a cat one

* Use example images from huggingface documentation-images repository

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
cjkangme
82cd61db40 [Community Pipeline] Add some feature for regional prompting pipeline (#9874) 
* [Fix] fix bugs of  regional_prompting pipeline

* [Feat] add base prompt feature

* [Fix] fix __init__ pipeline error

* [Fix] delete unused args

* [Fix] improve string handling

* [Docs] docs to use_base in regional_prompting

* make style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Dimitri Barbot
e28419ddf4 Update sdxl reference pipeline to latest sdxl pipeline (#9938) 
* Update sdxl reference community pipeline

* Update README.md

Add example images.

* Style & quality

* Use example images from huggingface documentation-images repository

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
hlky
4da42c2533 Add beta, exponential and karras sigmas to FlowMatchEulerDiscreteScheduler (#10001) 
Add beta, exponential and karras sigmas to FlowMatchEuler
 2024-12-23 13:02:18 +05:30
YiYi Xu
c5f6fb9cdb Sd35 controlnet (#10020) 
* add model/pipeline

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Parag Ekbote
30c91896c3 Notebooks for Community Scripts-3 (#10032) 
* Add Notebooks for Community Scripts
in  ReadME.

* Minor Script Improvement.
 2024-12-23 13:02:18 +05:30
Aryan
fab8f75a3f [docs] Fix CogVideoX table (#10008) 
* fix

* fix
 2024-12-23 13:02:18 +05:30
SkyCol
cd1d9e9610 Add prompt about wandb in examples/dreambooth/readme. (#10014) 
Add files via upload
 2024-12-23 13:02:18 +05:30
Sayak Paul
8253421d13 [Docs] add: missing pipelines from the spec. (#10005) 
add: missing pipelines from the spec.
 2024-12-23 13:02:18 +05:30
Linoy Tsaban
fbcf84d489 [SD3 dreambooth lora] smol fix to checkpoint saving (#9993) 
* smol change to fix checkpoint saving & resuming (as done in train_dreambooth_sd3.py)

* style

* modify comment to explain reasoning behind hidden size check
 2024-12-23 13:02:18 +05:30
Aryan
fbf0755594 Flux Fill, Canny, Depth, Redux (#9985) 
* update

---------

Co-authored-by: yiyixuxu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
hlky
9c111310c9 ControlNet from_single_file when already converted (#9978) 
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:18 +05:30
Fanli Lin
527b79d00a make pipelines tests device-agnostic (part1) (#9399) 
* enable on xpu

* add 1 more

* add one more

* enable more

* add 1 more

* add more

* enable 1

* enable more cases

* enable

* enable

* update comment

* one more

* enable 1

* add more cases

* enable xpu

* add one more caswe

* add more cases

* add 1

* add more

* add more cases

* add case

* enable

* add more

* add more

* add more

* enbale more

* add more

* update code

* update test marker

* add skip back

* update comment

* remove single files

* remove

* style

* add

* revert

* reformat

* update decorator

* update

* update

* update

* Update tests/pipelines/deepfloyd_if/test_if.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update src/diffusers/utils/testing_utils.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update tests/pipelines/animatediff/test_animatediff_controlnet.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* update float16

* no unitest.skipt

* update

* apply style check

* reapply format

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:18 +05:30
Sayak Paul
3bf336d983 [Tests] skip nan lora tests on PyTorch 2.5.1 CPU. (#9975) 
* skip nan lora tests on PyTorch 2.5.1 CPU.

* cog

* use xfail

* correct xfail

* add condition

* tests
 2024-12-23 13:02:18 +05:30
Aryan
1a111b69ab Fix prepare latent image ids and vae sample generators for flux (#9981) 
* fix

* update expected slice
 2024-12-23 13:02:18 +05:30
YiYi Xu
193ecaab79 fix controlnet module refactor (#9968) 
* fix
 2024-12-23 13:02:18 +05:30
raulmosa
6905951328 Update handle single blocks on _convert_xlabs_flux_lora_to_diffusers (#9915) 
* Update handle single blocks on _convert_xlabs_flux_lora_to_diffusers to fix bug on updating keys and old_state_dict


---------

Co-authored-by: raul_ar <raul.moreno.salinas@autoretouch.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
linjiapro
6b44c28884 Improve control net block index for sd3 (#9758) 
* improve control net index

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:18 +05:30
Sayak Paul
dac51f6bb1 [LoRA] enable LoRA for Mochi-1 (#9943) 
* feat: add lora support to Mochi-1.
 2024-12-23 13:02:18 +05:30
Dhruv Nair
11f6f364c7 Flux latents fix (#9929) 
* update

* update

* update

* update

* update

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
hlky
675c24b612 Fix beta and exponential sigmas + add tests (#9954) 
* Fix beta and exponential sigmas + add tests

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Bagheera
84d11bca38 add skip_layers argument to SD3 transformer model class (#9880) 
* add skip_layers argument to SD3 transformer model class

* add unit test for skip_layers in stable diffusion 3

* sd3: pipeline should support skip layer guidance

* up

---------

Co-authored-by: bghira <bghira@users.github.com>
Co-authored-by: yiyixuxu <yixu310@gmail.com>
 2024-12-23 13:02:18 +05:30
Parag Ekbote
06e78d28c8 Move IP Adapter Scripts to research project (#9960) 
* Move files to research-projects.

* docs: add IP Adapter training instructions

* Delete venv

* Update examples/ip_adapter/tutorial_train_sdxl.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Cherry-picked commits and re-moved files
to research_projects.

* make style.

* Update toctree and delete ip_adapter.

* Nit Fix

* Fix nit.

* Fix nit.

* Create training script for single GPU and set
model format to .safetensors

* Add sample inference script and restore _toctree

* Restore toctree.yaml

* fix spacing.

* Update toctree.yaml

---------

Co-authored-by: AMohamedAakhil <a.aakhilmohamed@gmail.com>
Co-authored-by: BootesVoid <78485654+AMohamedAakhil@users.noreply.github.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Dhruv Nair
2f509de896 [CI] Unpin torch<2.5 in CI (#9961) 
* update

* update
 2024-12-23 13:02:18 +05:30
Aryan
7b7c5536f0 Make CogVideoX RoPE implementation consistent (#9963) 
* update cogvideox rope implementation

* apply suggestions from review
 2024-12-23 13:02:18 +05:30
Sayak Paul
19dc28f3ea [LoRA] feat: save_lora_adapter() (#9862) 
* feat: save_lora_adapter.
 2024-12-23 13:02:18 +05:30
Linoy Tsaban
b97b4c1444 [advanced flux training] bug fix + reduce memory cost as in #9829 (#9838) 
* memory improvement as done here: https://github.com/huggingface/diffusers/pull/9829

* fix bug

* fix bug

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Parag Ekbote
18216ac4ad Notebooks for Community Scripts-2 (#9952) 
4 Notebooks for Community Scripts and minor
script improvements.
 2024-12-23 13:02:18 +05:30
Yuxuan.Zhang
8c553e0a3c CogVideoX 1.5 (#9877) 
* CogVideoX1_1PatchEmbed test

* 1360 * 768

* refactor

* make style

* update docs

* add modeling tests for cogvideox 1.5

* update

* make fix-copies

* add ofs embed(for convert)

* add ofs embed(for convert)

* more resolution for cogvideox1.5-5b-i2v

* use even number of latent frames only

* update pipeline implementations

* make style

* set patch_size_t as None by default

* #skip frames 0

* refactor

* make style

* update docs

* fix ofs_embed

* update docs

* invert_scale_latents

* update

* fix

* Update docs/source/en/api/pipelines/cogvideox.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/cogvideox.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/cogvideox.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/api/pipelines/cogvideox.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update src/diffusers/models/transformers/cogvideox_transformer_3d.py

* update conversion script

* remove copied from

* fix test

* Update docs/source/en/api/pipelines/cogvideox.md

* Update docs/source/en/api/pipelines/cogvideox.md

* Update docs/source/en/api/pipelines/cogvideox.md

* Update docs/source/en/api/pipelines/cogvideox.md

---------

Co-authored-by: Aryan <aryan@huggingface.co>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:18 +05:30
Grant Sherrick
7f236b4975 Add server example (#9918) 
* Add server example.

* Minor updates to README.

* Add fixes after local testing.

* Apply suggestions from code review

Updates to README from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* More doc updates.

* Maybe this will work to build the docs correctly?

* Fix style issues.

* Fix toc.

* Minor reformatting.

* Move docs to proper loc.

* Fix missing tick.

* Apply suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Sync docs changes back to README.

* Very minor update to docs to add space.

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:18 +05:30
Parag Ekbote
7b28265fed Fixed Nits in Docs and Example Script (#9940) 
Fixed nits in docs and example script.

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
ちくわぶ
dd9a3f2206 Add all AttnProcessor classes in AttentionProcessor type (#9909) 
Add all AttnProcessor in `AttentionProcessor` type
 2024-12-23 13:02:18 +05:30
_
398a99644e Correct pipeline_output.py to the type Mochi (#9945) 
Correct pipeline_output.py
 2024-12-23 13:02:18 +05:30
Heavenn
08e5177053 Modify apply_overlay for inpainting with padding_mask_crop (Inpainting area: "Only Masked") (#8793) 
* Modify apply_overlay for inpainting

* style

---------

Co-authored-by: root <root@debian>
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>
Co-authored-by: yiyixuxu <yixu310@gmail.com>
 2024-12-23 13:02:18 +05:30
高佳宝
c3698c8225 Update ip_adapter.py (#8882) 
update comments of load_ip_adapter function
 2024-12-23 13:02:18 +05:30
Parag Ekbote
d27c692917 Move Wuerstchen Dreambooth to research_projects (#9935) 
update file paths to research_projects folder.

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:18 +05:30
Pakkapon Phongthawee
94007c0697 add depth controlnet sd3 pre-trained checkpoints to docs (#9937) 2024-12-23 13:02:18 +05:30