LLM/diffusers
1
0
Fork 0
mirror of https://github.com/huggingface/diffusers.git synced 2026-02-22 10:50:35 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,905 Commits 748 Branches 94 Tags
9feab900e229ddb2447f396da48939ccaeb8c679
Commit Graph

704 Commits

Author SHA1 Message Date
M. Tolga Cangöz
9feab900e2 [Docs] Fix typos (#7451) 
* Fix typos

* Fix typos

* Fix typos

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul
a48c41f4c7 add: space for calculating memory usagee. (#7414) 
* add: space for calculating memory usahe.

* Update docs/source/en/using-diffusers/loading.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul
99dd106e5e [Docs] add missing output image (#7425) 
add missing output image
 2024-12-23 13:02:09 +05:30
sayakpaul
fec596ddf1 Revert "add: space within docs to calculate mememory usage." 
This reverts commit 78990dd960.
 2024-12-23 13:02:09 +05:30
sayakpaul
634c467193 add: space within docs to calculate mememory usage. 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz
651dac5447 Fix typos (#7411) 
* Fix typos

* Fix typo in SVD.md
 2024-12-23 13:02:09 +05:30
Sayak Paul
8d9dadaa64 [Custom Pipelines with Custom Components] fix multiple things (#7304) 
* checking to improve pipelines.

* more fixes.

* add: tip to encourage the usage of revision

* Apply suggestions from code review

* retrigger ci

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:09 +05:30
Dhruv Nair
636c99afc2 Add FreeInit Outputs to Docs Page (#7384) 
* update

* fix
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz
950c7085f5 Update access of configuration attributes (#7343) 
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz
4e546762ab Fix Typos (#7325) 
* Fix PyTorch's convention for inplace functions

* Fix import structure in __init__.py and update config loading logic in test_config.py

* Update configuration access

* Fix typos

* Trim trailing white spaces

* Fix typo in logger name

* Revert "Fix PyTorch's convention for inplace functions"

This reverts commit f65dc4afcb.

* Fix typo in step_index property description

* Revert "Update configuration access"

This reverts commit 8d44e870b8.

* Revert "Fix import structure in __init__.py and update config loading logic in test_config.py"

This reverts commit 2ad5e8bca2.

* Fix typos

* Fix typos

* Fix typos

* Fix a typo: tranform -> transform
 2024-12-23 13:02:09 +05:30
Sayak Paul
08a03e1641 post-release v0.27.0 (#7329) 
* post-release

* quality
 2024-12-23 13:02:09 +05:30
Abubakar Abid
e272342f3e Adds docs for gradio.Interface.from_pipeline() (#7346) 
* gradio docs

* Update docs/source/en/api/pipelines/stable_diffusion/overview.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* changes

* changes

* changes

* Update docs/source/en/api/pipelines/stable_diffusion/overview.md

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Suraj Patil
c7c339555c add edm schedulers in doc (#7319) 
* add edm schedulers in doc

* add in toctree

* address reviewe comments
 2024-12-23 13:02:09 +05:30
Michael
f08278b391 Add Intro page of TCD (#7259) 
* add tcd intro

* resolve repos

* Apply suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* revise NFEs related

* change inpainting location

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:09 +05:30
Manuel Brack
87c83dd381 [Pipeline] Add LEDITS++ pipelines (#6074) 
* Setup LEdits++ file structure

* Fix import

* LEditsPP Stable Diffusion pipeline

* Include variable image aspect ratios

* Implement LEDITS++ for SDXL

* clean up LEditsPPPipelineStableDiffusion

* Adjust inversion output

* Added docu, more cleanup for LEditsPPPipelineStableDiffusion

* clean up LEditsPPPipelineStableDiffusionXL

* Update documentation

* Fix documentation import

* Add skeleton IF implementation

* Fix documentation typo

* Add LEDTIS docu to toctree

* Add missing title

* Finalize SD documentation

* Finalize SD-XL documentation

* Fix code style and quality

* Fix typo

* Fix return types

* added LEditsPPPipelineIF; minor changes for LEditsPPPipelineStableDiffusion and LEditsPPPipelineStableDiffusionXL

* Fix copy reference

* add documentation for IF

* Add first tests

* Fix batching for SD-XL

* Fix text encoding and perfect reconstruction for SD-XL

* Add tests for SD-XL, minor changes

* move user_mask to correct device, use cross_attention_kwargs also for inversion

* Example docstring

* Fix attention resolution for non-square images

* Refactoring for PR review

* Safely remove ledits_utils.py

* Style fixes

* Replace assertions with ValueError

* Remove LEditsPPPipelineIF

* Remove unecessary input checks

* Refactoring of CrossAttnProcessor

* Revert unecessary changes to scheduler

* Remove first progress-bar in inversion

* Refactor scheduler usage and reset

* Use imageprocessor instead of custom logic

* Fix scheduler init warning

* Fix error when running the pipeline in fp16

* Update documentation wrt perfect inversion

* Update tests

* Fix code quality and copy consistency

* Update LEditsPP import

* Remove enable/disable methods that are now in StableDiffusionMixin

* Change import in docs

* Revert import structure change

* Fix ledits imports

---------

Co-authored-by: Katharina Kornmeier <katharina.kornmeier@stud.tu-darmstadt.de>
 2024-12-23 13:02:09 +05:30
Dhruv Nair
8a422df965 Update Cascade documentation (#7257) 
* updates

* update

* update

* Update docs/source/en/api/pipelines/stable_cascade.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* update

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com>
 2024-12-23 13:02:09 +05:30
UmerHA
c5c113369b Adds denoising_end parameter to ControlNetPipeline for SDXL (#6175) 
* Initial commit

* Removed copy hints, as in original SDXLControlNetPipeline

Removed copy hints, as in original SDXLControlNetPipeline, as the `make fix-copies` seems to have issues with the @property decorator.

* Reverted changes to ControlNetXS

* Addendum to: Removed changes to ControlNetXS

* Added test+docs for mixture of denoiser

* Update docs/source/en/using-diffusers/controlnet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/using-diffusers/controlnet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:09 +05:30
Steven Liu
6b2f8109bc [docs] IP-Adapter image embedding (#7226) 
* update

* fix parameter name

* feedback

* add no mask version

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Steven Liu
9d10e629af [docs] Community tips (#7137) 
* tips

* feedback

* callback only
 2024-12-23 13:02:08 +05:30
Steven Liu
19d9e7d5d9 [docs] Merge LoRAs (#7213) 
* merge loras

* feedback

* torch.compile

* feedback
 2024-12-23 13:02:08 +05:30
bimsarapathiraja
e5b4915090 Remove the line. Using it create wrong output (#7075) 
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Kashif Rasul
48d4cc94b0 [Pipiline] Wuerstchen v3 aka Stable Cascasde pipeline (#6487) 
* initial diffNext v3

* move to v3 folder

* imports

* dry up the unets

* no switch_level

* fix init

* add switch_level tp config

* Fixed some things

* Added pooled text embeddings

* Initial work on adding image encoder

* changes from @dome272

* Stuff for the image encoder processing and variable naming in decoder

* fix arg name

* inference fixes

* inference fixes

* default TimestepBlock without conds

* c_skip=0 by default

* fix bfloat16 to cpu

* use config

* undo temp change

* fix gen_c_embeddings args

* change text encoding

* text encoding

* undo print

* undo .gitignore change

* Allow WuerstchenV3PriorPipeline to use the base DDPM & DDIM schedulers

* use WuerstchenV3Unet in both pipelines

* fix imports

* initial failing tests

* cleanup

* use scheduler.timesterps

* some fixes to the tests, still not fully working

* fix tests

* fix prior tests

* add dropout to the model_kwargs

* more tests passing

* update expected_slice

* initial rename

* rename tests

* rename class names

* make fix-copies

* initial docs

* autodocs

* typos

* fix arg docs

* add text_encoder info

* combined pipeline has optional image arg

* fix documentation

* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* use self.config

* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* c_in -> in_channels

* removed kwargs from unet's forward

* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* remove older callback api

* removed kwargs and fixed decoder guidance > 1

* decoder takes emeds

* check and use image_embeds

* fixed all but one decoder test

* fix decoder tests

* update callback api

* fix some more combined tests

* push combined pipeline

* initial docs

* fix doc_string

* update combined api

* no test_callback_inputs test for combined pipeline

* add optional components

* fix ordering of components

* fix combined tests

* update convert script

* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* fix imports

* move effnet out of deniosing loop

* prompt_embeds_pooled only when doing guidance

* Fix repeat shape

* move StableCascadeUnet to models/unets/

* more descriptive names

* converted when numpy()

* StableCascadePriorPipelineOutput docs

* rename StableCascadeUNet

* add slow tests

* fix slow tests

* update

* update

* updated model_path

* add args for weights

* set push_to_hub to false

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: Dominic Rampas <d6582533@gmail.com>
Co-authored-by: Pablo Pernias <pablo@pernias.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: 99991 <99991@users.noreply.github.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:08 +05:30
Michael
6568ee3076 add TCD Scheduler (#7174) 
* add: support TCD scheduler


---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Vinh H. Pham
eb3c60cbde [Docs] Update callback.md code example (#7150) 
Update callback.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz
06de6e0b0f Fix typos (#7181) 
* Fix typos

* Fix typos

* Fix typos and update documentation in lora.md
 2024-12-23 13:02:08 +05:30
Sayak Paul
ba756dd5ea [Docs] more elaborate example for peft torch.compile (#7161) 
more elaborate example for peft torch.compile
 2024-12-23 13:02:08 +05:30
YiYi Xu
f38417fe30 [ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder (#7016) 
* add

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz
a3c115949d [Docs] Fix typos (#7131) 
* Add copyright notice to relevant files and fix typos

* Set `timestep_spacing` parameter of `StableDiffusionXLPipeline`'s scheduler to `'trailing'`.

* Update `StableDiffusionXLPipeline.from_single_file` by including EulerAncestralDiscreteScheduler with `timestep_spacing="trailing"` param.

* Update model loading method in SDXL Turbo documentation
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz
59ed616c16 [Docs] Fix typos (#7118) 
Fix typos, formatting and remove trailing whitespace
 2024-12-23 13:02:08 +05:30
Steven Liu
d6e432c38a [docs] Minor updates (#7063) 
* updates

* feedback
 2024-12-23 13:02:08 +05:30
bimsarapathiraja
85e57454a0 Change images to image. The variable images is not used anywhere (#7074) 2024-12-23 13:02:08 +05:30
YiYi Xu
cae3e45cbb fix doc example for fom_single_file (#7015) 
* fix doc

* remove use_safetensors from signature

* more

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
 2024-12-23 13:02:08 +05:30
Dhruv Nair
7ec59bb36a Fix alt text and image links in AnimateLCM docs (#7029) 
update
 2024-12-23 13:02:08 +05:30
Dhruv Nair
e1577ca648 Add section on AnimateLCM to docs (#7024) 
* update

* update

* update
 2024-12-23 13:02:08 +05:30
Fabio Rigano
98326b5f04 IP-Adapter attention masking (#6847) 
* Add attention masking to attn processors

* Update tensor conversion

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Steven Liu
374cbcbd42 [docs] Video generation (#6701) 
* first draft

* fix path

* fix path

* i2vgen-xl

* review

* modelscopet2v

* feedback
 2024-12-23 13:02:07 +05:30
Steven Liu
0535a85d52 [docs] Fix callout (#6998) 
Update ip_adapter.md
 2024-12-23 13:02:07 +05:30
Sayak Paul
e42e3ef1ab [IP Adapters] feat: allow low_cpu_mem_usage in ip adapter loading (#6946) 
* feat: allow low_cpu_mem_usage in ip adapter loading

* reduce the number of device placements.

* documentation.

* throw low_cpu_mem_usage warning only once from the main entry point.
 2024-12-23 13:02:07 +05:30
Steven Liu
ceb53a65bd [docs] IP-Adapter (#6897) 
* use cases

* first draft

* fix image links

* lcm-lora

* feedback

* review

* feedback

* feedback
 2024-12-23 13:02:07 +05:30
Younes Belkada
484c256303 [PEFT / docs] Add a note about torch.compile (#6864) 
* Update using_peft_for_inference.md

* add more explanation
 2024-12-23 13:02:07 +05:30
Steven Liu
1b6feac509 [docs] Community pipelines (#6929) 
fix
 2024-12-23 13:02:07 +05:30
Sayak Paul
86e62ae4c5 change to 2024 in the license (#6902) 
change to 2024
 2024-12-23 13:02:07 +05:30
Félix Sanz
6d0fe4ea94 fix: typo in callback function name and property (#6834) 
* fix: callback function name is incorrect

On this tutorial there is a function defined and then used inside `callback_on_step_end` argument, but the name was not correct (mismatch)

* fix: typo in num_timestep (correct is num_timesteps)

fixed property name
 2024-12-23 13:02:06 +05:30
Dhruv Nair
d44a09475d Multiple small fixes to Video Pipeline docs (#6805) 
* update

* update

* update

* Update src/diffusers/pipelines/i2vgen_xl/pipeline_i2vgen_xl.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* update

* update

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:06 +05:30
Sayak Paul
804d50ec24 [Feat] add I2VGenXL for image-to-video generation (#6665) 
---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:06 +05:30
YiYi Xu
f1e105e664 [IP-Adapter] Support multiple IP-Adapters (#6573) 
---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Alvaro Somoza <somoza.alvaro@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2024-12-23 13:02:06 +05:30
Dhruv Nair
a31ebdc56c Add PIA Model/Pipeline (#6698) 
* update

* update

* updaet

* add tests and docs

* clean up

* add to toctree

* fix copies

* pr review feedback

* fix copies

* fix tests

* update docs

* update

* update

* update docs

* update

* update

* update

* update
 2024-12-23 13:02:06 +05:30
Sayak Paul
4485d34f2f add note about serialization (#6764) 2024-12-23 13:02:06 +05:30
xhedit
e0f29a6a85 Update lora.md with a more accurate description of rank (#6724) 
* Update lora.md with a more accurate description of rank

* Update docs/source/en/training/lora.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:06 +05:30
Sayak Paul
7bd61ef799 [Core] move transformer scripts to transformers modules (#6747) 
* move transformer scripts to transformers modules

* move transformer model test

* move prior transformer test to  directory

* fix doc path

* correct doc path

* add: __init__.py
 2024-12-23 13:02:06 +05:30