Commit Graph

4913 Commits

Author SHA1 Message Date
Thomas Lips
3af4447358 Add documentation for strength parameter in Controlnet_img2img pipelines (#6951)
copy docstring for `strength` from  stablediffusion img2img pipeline to controlnet img2img pipelines
2024-12-23 13:02:07 +05:30
Sayak Paul
e2b35d0bd0 start depcrecation cycle for lora_attention_proc 👋 (#7007) 2024-12-23 13:02:07 +05:30
Steven Liu
374cbcbd42 [docs] Video generation (#6701)
* first draft

* fix path

* fix path

* i2vgen-xl

* review

* modelscopet2v

* feedback
2024-12-23 13:02:07 +05:30
Steven Liu
0535a85d52 [docs] Fix callout (#6998)
Update ip_adapter.md
2024-12-23 13:02:07 +05:30
Bhavay Malhotra
2f3c3fd6e7 Update textual_inversion.py (#6952)
* Update textual_inversion.py

* Apply suggestions from code review

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update examples/textual_inversion/textual_inversion.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update textual_inversion.py

* styling

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Stephen
56637cb949 Standardize model card for textual inversion sdxl (#6963)
* standardize model card

* fix tags

* correct import styling and update tags

* run make style and make quality

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
co63oc
c8a06e0c20 Fix procecss process (#6591)
* Fix words

* Fix

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:07 +05:30
Sayak Paul
c60e5cb9e7 add: peft to the benchmark workflow (#6989) 2024-12-23 13:02:07 +05:30
Paakhhi
2e90dae0ef Fix diffusers import prompt2prompt (#6927)
* Bugfix: correct import for diffusers

* Fix: Prompt2Prompt example

* Format style

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:07 +05:30
Sayak Paul
e42e3ef1ab [IP Adapters] feat: allow low_cpu_mem_usage in ip adapter loading (#6946)
* feat: allow low_cpu_mem_usage in ip adapter loading

* reduce the number of device placements.

* documentation.

* throw low_cpu_mem_usage warning only once from the main entry point.
2024-12-23 13:02:07 +05:30
Linoy Tsaban
8183a770e7 [advanced sdxl lora script] - fix #6967 bug when using prior preservation loss (#6968)
* fix bug in micro-conditioning of class images

* fix bug in micro-conditioning of class images

* style
2024-12-23 13:02:07 +05:30
YiYi Xu
51005f69e5 fix IPAdapter unload_ip_adapter test (#6972)
add

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:07 +05:30
Steven Liu
ceb53a65bd [docs] IP-Adapter (#6897)
* use cases

* first draft

* fix image links

* lcm-lora

* feedback

* review

* feedback

* feedback
2024-12-23 13:02:07 +05:30
Sayak Paul
0c78d63e55 fix: controlnet inpaint single file. (#6975) 2024-12-23 13:02:07 +05:30
Sayak Paul
56bb13bfa1 [Core] Harmonize single file ckpt model loading (#6971)
* use load_model_into_meta in single file utils

* propagate to autoencoder and controlnet.

* correct class name access behaviour.

* remove torch_dtype from load_model_into_meta; seems unncessary

* remove incorrect kwarg

* style to avoid extra unnecessary line breaks
2024-12-23 13:02:07 +05:30
Younes Belkada
484c256303 [PEFT / docs] Add a note about torch.compile (#6864)
* Update using_peft_for_inference.md

* add more explanation
2024-12-23 13:02:07 +05:30
Dhruv Nair
32c9362976 Allow passing config_file argument to ControlNetModel when using from_single_file (#6959)
* update

* update

* update
2024-12-23 13:02:07 +05:30
Dhruv Nair
dda00daf69 Move SDXL T2I Adapter lora test into PEFT workflow (#6965)
update
2024-12-23 13:02:07 +05:30
Dhruv Nair
66568841f4 Fix flaky IP Adapter test (#6960)
update
2024-12-23 13:02:07 +05:30
YiYi Xu
f5b20e00a8 [DPMSolverSinglestepScheduler] correct get_order_list for solver_order=2and lower_order_final=True (#6953)
* add

* change default

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:07 +05:30
Dhruv Nair
ddbf9adb47 Fix configuring VAE from single file mixin (#6950)
* update
2024-12-23 13:02:07 +05:30
Alex Umnov
9477fa618b Updated lora inference instructions (#6913)
* Updated lora inference instructions

* Update examples/dreambooth/README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update README.md

* Update README.md

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Piyush Thakur
1b885c2d9a [Type annotations] fixed in save_model_card (#6948)
fixed type annotations

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Steven Liu
1b6feac509 [docs] Community pipelines (#6929)
fix
2024-12-23 13:02:07 +05:30
Sayak Paul
f9d2466609 [Diffusers -> Original SD conversion] fix things (#6933)
* fix: bias loading bug

* fixes for SDXL

* apply changes to the conversion script to match single_file_utils.py

* do transpose to match the single file loading logic.
2024-12-23 13:02:07 +05:30
Piyush Thakur
1974ec76a9 [Model Card] standardize T2I Adapter Sdxl model card (#6947)
standardize model card template t21-adapter-sdxl
2024-12-23 13:02:07 +05:30
Dhruv Nair
7d6ecd18d4 Unpin torch versions in CI (#6945)
* update

* update

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Disty0
375baadc7c Pass device to enable_model_cpu_offload in maybe_free_model_hooks (#6937) 2024-12-23 13:02:07 +05:30
Piyush Thakur
60a8bf7639 [Model Card] standardize T2I Sdxl Lora model card (#6944)
* standardize model card template t2i-lora-sdxl

* type annotations
2024-12-23 13:02:07 +05:30
Dhruv Nair
88189c5d5e Update PixArt Alpha test module to match src module (#6943)
update
2024-12-23 13:02:07 +05:30
Piyush Thakur
3cc84918d5 [Model Card] standardize T2I Sdxl model card (#6942)
standardize model card template t2i-sdxl
2024-12-23 13:02:07 +05:30
Piyush Thakur
6edce9ad71 [Model Card] standardize T2I Lora model card (#6940)
standardize model card t2i-lora
2024-12-23 13:02:07 +05:30
Piyush Thakur
40ca5be078 [Model Card] standardize T2I model card (#6939)
* standardize model card

* fix base_model
2024-12-23 13:02:07 +05:30
dg845
fbf548faae Replace hardcoded values in SchedulerCommonTest with properties (#5479)
---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
2024-12-23 13:02:07 +05:30
YiYi Xu
81f277e3d5 Fix a bug in AutoPipeline.from_pipe when switching pipeline with optional components (#6820)
* fix

* add tests

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
YiYi Xu
767c187bdc allow attention processors to have different signatures (#6915)
add

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:07 +05:30
Sayak Paul
166641aefa post release 0.26.2 (#6885)
* post release

* style

* Empty-Commit

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
2024-12-23 13:02:07 +05:30
Sayak Paul
43609078b2 [LoRA] deprecate certain lora methods from the old backend. (#6889)
* deprecate certain lora methods from the old backend.

* uncomment necessary things.

* safe remove old lora backend 👋
2024-12-23 13:02:07 +05:30
Bingxin Ke
fa4a64ca8d [Community Pipeline][Bug Fix] marigold_depth_estimation: input image value range (#6787)
[FIX] IMPORTANT: rgb normalization
2024-12-23 13:02:07 +05:30
Dhruv Nair
dd9d2feb5e More IPAdapter test fixes (#6888)
update
2024-12-23 13:02:07 +05:30
camaro
181230a64d Standardize model card for Controlnet (#6910)
* controlnet

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Sayak Paul
72d23f5309 correct hub_token exposition behaviour (thanks to @bghira). (#6918) 2024-12-23 13:02:07 +05:30
Aryan
ec5ff53004 [refactor] unnecessary lines in decode_latents in video pipelines (#6682)
* refactor decode latents in video pipelines

* make fix-copies
2024-12-23 13:02:07 +05:30
camaro
ecfe845374 Standardize model card for Controlnet SDXL (#6908)
controlnet-sdxl
2024-12-23 13:02:07 +05:30
camaro
d65f583758 Standardize model card for Controlnet flax (#6909)
* controlnet-flax

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
C Q
6d7c1c8530 Fix Compatibility Issues in stable_diffusion_xl_reference.py (#6251)
* Fix Compatibility Issues in stable_diffusion_xl_reference.py

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:07 +05:30
shaoxiaowang
8f4e6538e4 fix examples/community/pipeline_stable_diffusion_xl_instantid.py (#6759)
Co-authored-by: wangshaoxiao <wangshaoxiao@xiaomi.com>
2024-12-23 13:02:07 +05:30
Kyunghwan Kim
c92d01a1b1 Add vae tiling and slicing in img2img and inpaint (#6871)
* Add vae tiling in img2img and inpaint

* Add vae tiling not slicing
2024-12-23 13:02:07 +05:30
Michael
075b63882e Remove <cat-toy> validation prompt from examples/textual_inversion/textual_inversion_sdxl.py (#6877)
Remove <cat-toy> validation prompt from textual_inversion_sdxl.py

The `<cat-toy>` validation prompt is a default choice for the example task in the README. But no other part of `textual_inversion_sdxl.py` references the cat toy and `textual_inversion.py` has a default validation prompt of `None` as well.

So bring `textual_inversion_sdxl.py` in line with `textual_inversion.py` and change default validation prompt to `None`
2024-12-23 13:02:07 +05:30
Laisky.Cai
a52fe6b236 fix: load_image should support PIL Image (#6904)
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30