Daniel Regado
b571adfb40
[WIP] SD3.5 IP-Adapter Pipeline Integration ( #9987 )
...
* Added support for single IPAdapter on SD3.5 pipeline
---------
Co-authored-by: hlky <hlky@hlky.ac >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:19 +05:30
Sayak Paul
00a8ea658e
[Docs] add rest of the lora loader mixins to the docs. ( #10230 )
...
add rest of the lora loader mixins to the docs.
2024-12-23 13:02:19 +05:30
Aryan
0494cbd01a
Remove CogVideoX mentions from single file docs; Test updates ( #9444 )
...
* remove mentions from single file
* update tests
* update
2024-12-23 13:02:16 +05:30
Yuxuan.Zhang
75682c97cf
CogVideoX-5b-I2V support ( #9418 )
...
* draft Init
* draft
* vae encode image
* make style
* image latents preparation
* remove image encoder from conversion script
* fix minor bugs
* make pipeline work
* make style
* remove debug prints
* fix imports
* update example
* make fix-copies
* add fast tests
* fix import
* update vae
* update docs
* update image link
* apply suggestions from review
* apply suggestions from review
* add slow test
* make use of learned positional embeddings
* apply suggestions from review
* doc change
* Update convert_cogvideox_to_diffusers.py
* make style
* final changes
* make style
* fix tests
---------
Co-authored-by: Aryan <aryan@huggingface.co >
2024-12-23 13:02:16 +05:30
zR
dbf5d348e6
Add CogVideoX text-to-video generation model ( #9082 )
...
* add CogVideoX
---------
Co-authored-by: Aryan <aryan@huggingface.co >
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: Aryan <contact.aryanvs@gmail.com >
Co-authored-by: yiyixuxu <yixu310@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-12-23 13:02:15 +05:30
Dhruv Nair
faa0826328
update
2024-12-23 13:02:15 +05:30
Sayak Paul
6d11129c5a
[Chore] add LoraLoaderMixin to the inits ( #8981 )
...
* introduce to promote reusability.
* up
* add more tests
* up
* remove comments.
* fix fuse_nan test
* clarify the scope of fuse_lora and unfuse_lora
* remove space
* rewrite fuse_lora a bit.
* feedback
* copy over load_lora_into_text_encoder.
* address dhruv's feedback.
* fix-copies
* fix issubclass.
* num_fused_loras
* fix
* fix
* remove mapping
* up
* fix
* style
* fix-copies
* change to SD3TransformerLoRALoadersMixin
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* up
* handle wuerstchen
* up
* move lora to lora_pipeline.py
* up
* fix-copies
* fix documentation.
* comment set_adapters().
* fix-copies
* fix set_adapters() at the model level.
* fix?
* fix
* loraloadermixin.
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:14 +05:30
YiYi Xu
a754d9071e
Revert "[LoRA] introduce LoraBaseMixin to promote reusability." ( #8976 )
...
Revert "[LoRA] introduce LoraBaseMixin to promote reusability. (#8774 )"
This reverts commit 527430d0a4
2024-12-23 13:02:14 +05:30
Sayak Paul
82b37a4cc3
[LoRA] introduce LoraBaseMixin to promote reusability. ( #8774 )
...
* introduce to promote reusability.
* up
* add more tests
* up
* remove comments.
* fix fuse_nan test
* clarify the scope of fuse_lora and unfuse_lora
* remove space
* rewrite fuse_lora a bit.
* feedback
* copy over load_lora_into_text_encoder.
* address dhruv's feedback.
* fix-copies
* fix issubclass.
* num_fused_loras
* fix
* fix
* remove mapping
* up
* fix
* style
* fix-copies
* change to SD3TransformerLoRALoadersMixin
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* up
* handle wuerstchen
* up
* move lora to lora_pipeline.py
* up
* fix-copies
* fix documentation.
* comment set_adapters().
* fix-copies
* fix set_adapters() at the model level.
* fix?
* fix
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:14 +05:30
Sayak Paul
11c5f6bfcd
Revert "[LoRA] introduce LoraBaseMixin to promote reusability." ( #8773 )
...
Revert "[LoRA] introduce `LoraBaseMixin` to promote reusability. (#8670 )"
This reverts commit a2071a1837
2024-12-23 13:02:14 +05:30
Sayak Paul
2686552727
[LoRA] introduce LoraBaseMixin to promote reusability. ( #8670 )
...
* introduce to promote reusability.
* up
* add more tests
* up
* remove comments.
* fix fuse_nan test
* clarify the scope of fuse_lora and unfuse_lora
* remove space
2024-12-23 13:02:13 +05:30
Dhruv Nair
fa640cc7d7
Expand Single File support in SD3 Pipeline ( #8517 )
...
* update
* update
2024-12-23 13:02:12 +05:30
Steven Liu
072b14dea1
[docs] Single file usage ( #8412 )
...
* single file usage
* edit
2024-12-23 13:02:12 +05:30
Dhruv Nair
915c094068
Clean up from_single_file docs ( #8268 )
...
* update
* update
2024-12-23 13:02:12 +05:30
Dhruv Nair
e931befdbf
[Refactor] Better align from_single_file logic with from_pretrained ( #7496 )
...
* refactor unet single file loading a bit.
* retrieve the unet from create_diffusers_unet_model_from_ldm
* update
* update
* updae
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* tests
* update
* update
* update
* Update docs/source/en/api/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/loaders/single_file.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:11 +05:30
Steven Liu
6b2f8109bc
[docs] IP-Adapter image embedding ( #7226 )
...
* update
* fix parameter name
* feedback
* add no mask version
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:09 +05:30
Steven Liu
ceb53a65bd
[docs] IP-Adapter ( #6897 )
...
* use cases
* first draft
* fix image links
* lcm-lora
* feedback
* review
* feedback
* feedback
2024-12-23 13:02:07 +05:30
Sayak Paul
86e62ae4c5
change to 2024 in the license ( #6902 )
...
change to 2024
2024-12-23 13:02:07 +05:30
Dhruv Nair
20ecdf6fc3
[Refactor] Update from single file ( #6428 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update'
* update
* update
* update
* update
* update
* update
* up
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* up
* update
* update
* update
* update
* update'
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* clean
* update
* update
* clean up
* clean up
* update
* clean
* clean
* update
* updaet
* clean up
* fix docs
* update
* update
* Revert "update"
This reverts commit dbfb8f1ea9
2024-12-23 13:02:06 +05:30
Steven Liu
699b33da95
[docs] PEFT adapter API ( #6499 )
...
follow up
2024-12-23 13:02:05 +05:30
Sayak Paul
38c3bcd840
[Core] introduce PeftAdapterMixin module. ( #6416 )
...
* introduce integrations module.
* remove duplicate methods.
* better imports.
* move to loaders.py
* remove peftadaptermixin from modelmixin.
* add: peftadaptermixin selectively.
* add: entry to _toctree
* Empty-Commit
2024-12-23 13:02:05 +05:30
Steven Liu
8ccc76ab37
[docs] IP-Adapter API doc ( #6140 )
...
add ip-adapter
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-14 09:19:37 -08:00
Steven Liu
7457aa67cb
[docs] Loader APIs ( #5813 )
...
* first draft
* remove old loader doc
* start adding lora code examples
* finish
* add link to loralinearlayer
* feedback
* fix
2023-11-20 10:53:13 -08:00
