YiYi Xu
94b332c476
support from_single_file for SDXL inpainting ( #4408 )
...
fix
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-08-01 07:47:22 -10:00
Dhruv Nair
6f4355f89f
Cleanup pass for flaky Slow Tests for Stable diffusion ( #4415 )
...
* update expected slice so img2img compile tests pass
* use default attn processor
* use default attn processor and update expected slice value to pass test
* use default attn processor
* set default attn processor and update expected slice
* set default attn processor and change precision for check
* set unet to use default attn processor
2023-08-01 18:21:14 +02:00
estelleafl
05a1cb902c
[ldm3d] documentation fixing typos ( #4284 )
...
* fixed typo
* updated doc to be consistent in naming
* make style/quality
* preprocessing for 4 channels and not 6
* make style
* test for 4c
* make style/quality
* fixed test on cpu
* fixed doc typo
* changed default ckpt to 4c
* Update pipeline_stable_diffusion_ldm3d.py
---------
Co-authored-by: Aflalo <estellea@isl-iam1.rr.intel.com >
Co-authored-by: Aflalo <estellea@isl-gpu33.rr.intel.com >
Co-authored-by: Aflalo <estellea@isl-gpu38.rr.intel.com >
2023-08-01 09:03:29 -07:00
Patrick von Platen
c69526a3d5
[AutoPipeline] Correct naming ( #4420 )
2023-08-01 14:56:27 +02:00
Nishant Rajadhyaksha
6c49d542a3
Update docs of unet_1d.py ( #4394 )
...
Update unet_1d.py
highlighting the way the modules are actually fed in the main code as the order matters because no skip block attaches time embeds whilst others do not
2023-07-31 11:04:47 -07:00
Sayak Paul
ba43ce3476
minor doc fixes. ( #4380 )
2023-07-31 12:15:56 +05:30
Andrey Voroshilov
ea5b0575f8
Clean up duplicate lines in encode_prompt ( #4369 )
...
* Clean up duplicate line
* Clean up duplicate lines
* Clean up duplicate line
2023-07-30 15:49:46 +05:30
Patrick von Platen
4f986fb28a
[SDXL] Fix dummy imports incorrect naming ( #4370 )
...
[SDXL] Fix dummy imports
2023-07-30 12:17:38 +02:00
Harutatsu Akiyama
aae27262f4
[SDXL-IP2P] Add gif for demonstrating training processes ( #4342 )
...
* [SDXL-IP2P] Add gif for demonstrating training processes
* [SDXL-IP2P] Add gif for demonstrating training processes
* [SDXL-IP2P] Change gif to URLs
* [SDXL-IP2P] Add URLs in case gif now show
---------
Co-authored-by: Harutatsu Akiyama <kf.zy.qin@gmail.com >
2023-07-30 10:07:10 +05:30
Sayak Paul
34b5b63bb8
Update README.md to have PyPI-friendly path ( #4351 )
2023-07-29 08:59:18 +05:30
Will Berman
2b1786735e
fix fp type in t2i adapter docs ( #4350 )
2023-07-28 13:01:52 -07:00
Sayak Paul
4a4cdd6b07
[Feat] Support SDXL Kohya-style LoRA ( #4287 )
...
* sdxl lora changes.
* better name replacement.
* better replacement.
* debugging
* debugging
* debugging
* debugging
* debugging
* remove print.
* print state dict keys.
* print
* distingisuih better
* debuggable.
* fxi: tyests
* fix: arg from training script.
* access from class.
* run style
* debug
* save intermediate
* some simplifications for SDXL LoRA
* styling
* unet config is not needed in diffusers format.
* fix: dynamic SGM block mapping for SDXL kohya loras (#4322 )
* Use lora compatible layers for linear proj_in/proj_out (#4323 )
* improve condition for using the sgm_diffusers mapping
* informative comment.
* load compatible keys and embedding layer maaping.
* Get SDXL 1.0 example lora to load
* simplify
* specif ranks and hidden sizes.
* better handling of k rank and hidden
* debug
* debug
* debug
* debug
* debug
* fix: alpha keys
* add check for handling LoRAAttnAddedKVProcessor
* sanity comment
* modifications for text encoder SDXL
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* denugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* up
* up
* up
* up
* up
* up
* unneeded comments.
* unneeded comments.
* kwargs for the other attention processors.
* kwargs for the other attention processors.
* debugging
* debugging
* debugging
* debugging
* improve
* debugging
* debugging
* more print
* Fix alphas
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* clean up
* clean up.
* debugging
* fix: text
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Batuhan Taskaya <batuhan@python.org >
2023-07-28 19:49:49 +02:00
Patrick von Platen
b7b6d6138d
[SDXL] Make watermarker optional under certain circumstances to improve usability of SDXL 1.0 ( #4346 )
...
* improve sdxl
* more fixes
* improve sdxl
* improve sdxl
* improve sdxl
* finish
2023-07-28 19:29:22 +02:00
kathath
faa6cbc959
Fix repeat of negative prompt ( #4335 )
...
fix repeat of negative prompt
2023-07-28 18:14:22 +02:00
Patrick von Platen
306a7bd047
[ONNX] Don't download ONNX model by default ( #4338 )
...
* [Download] Don't download ONNX weights by default
* [Download] Don't download ONNX weights by default
* [Download] Don't download ONNX weights by default
* fix more
* finish
* finish
* finish
2023-07-28 14:02:48 +02:00
Tanupriya Singh
c7250f2b8a
correct doc string for default value of guidance_scale ( #4339 )
2023-07-28 13:54:28 +02:00
Patrick von Platen
18b018c864
[SDXL Refiner] Fix refiner forward pass for batched input ( #4327 )
...
* fix_batch_xl
* Fix other pipelines as well
* up
* up
* Update tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl_inpaint.py
* sort
* up
* Finish it all up Co-authored-by: Bagheera <bghira@users.github.com >
* Co-authored-by: Bagheera bghira@users.github.com
* Co-authored-by: Bagheera <bghira@users.github.com >
* Finish it all up Co-authored-by: Bagheera <bghira@users.github.com >
2023-07-28 12:34:18 +02:00
Sayak Paul
54fab2cd5f
Update README_sdxl.md to correct the header ( #4330 )
...
Update README_sdxl.md
2023-07-28 09:22:14 +05:30
Sayak Paul
961173064d
Honor the SDXL 1.0 licensing from the training scripts. ( #4319 )
...
* honor the original license.
* train_instruct_pix2pix_xl -> train_instruct_pix2pix_sdxl
2023-07-28 01:28:36 +05:30
Sayak Paul
7d0d073261
[Tests] add test for pipeline import. ( #4276 )
...
* add test for pipeline import.
* Update tests/others/test_dependencies.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* address suggestions
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-07-28 00:08:15 +05:30
Xinyang Li
01b6ec21fa
fix validation option for dreambooth training example ( #4317 )
2023-07-27 09:58:52 -07:00
Ella Charlaix
92e5ddd295
Fix typo documentation ( #4320 )
...
fix typo documentation
2023-07-27 21:31:58 +05:30
Patrick von Platen
1926331eaf
[Local loading] Correct bug with local files only ( #4318 )
...
* [Local loading] Correct bug with local files only
* file not found error
* fix
* finish
2023-07-27 16:16:46 +02:00
YiYi Xu
5fd3dca5f3
fix a bug in StableDiffusionUpscalePipeline when prompt is None ( #4278 )
...
* fix batch_size
* add test
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-07-27 15:07:50 +02:00
Duong A. Nguyen
a2091b7071
Fix SDXL conversion from original to diffusers ( #4280 )
...
* fix sdxl conversion
* convention
2023-07-27 15:05:43 +02:00
Patrick von Platen
d8bc1a4e51
[Torch.compile] Fixes torch compile graph break ( #4315 )
...
* fix torch compile
* Fix all
* make style
2023-07-27 13:53:36 +02:00
YiYi Xu
80c10d8245
update Kandinsky doc ( #4301 )
...
* update doc
* fix an error in autopipe doc
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-07-27 13:10:41 +02:00
Patrick von Platen
20e92586c1
0.20.0dev0 ( #4299 )
...
* 0.20.0dev0
* make style
2023-07-26 23:06:18 +02:00
Patrick von Platen
5623ea065a
quick fix
2023-07-26 21:01:17 +02:00
Patrick von Platen
16049caf79
quick fix
2023-07-26 18:47:21 +00:00
Patrick von Platen
6a6dfe1cbd
Rename ( #4294 )
...
* up
* Apply suggestions from code review
* Apply suggestions from code review
* up
2023-07-26 20:41:21 +02:00
Ella Charlaix
b83bdce42a
add openvino and onnx runtime SD XL documentation ( #4285 )
...
* add openvino SD XL documentation
* add onnx SD XL integration
* rephrase
* update doc
* add images
* update model
2023-07-26 20:25:07 +02:00
camenduru
c6ae9b7df6
Where did this 'x' come from, Elon? ( #4277 )
...
* why mdx?
* why mdx?
* why mdx?
* no x for kandinksy either
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-07-26 18:18:14 +02:00
Patrick von Platen
b3e5cd6b4d
[Kandinsky] Add combined pipelines / Fix cpu model offload / Fix inpainting ( #4207 )
...
* Add combined pipeline
* Download readme
* Upload
* up
* up
* fix final
* Add enable model cpu offload kandinsky
* finish
* finish
* Fix
* fix more
* make style
* fix kandinsky mask
* fix inpainting test
* add callbacks
* add tests
* fix tests
* Apply suggestions from code review
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* docs
* docs
* correct docs
* fix tests
* add warning
* correct docs
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2023-07-26 17:13:55 +02:00
Patrick von Platen
b37dc3b3cd
Fix all missing optional import statements from pipeline folders ( #4272 )
...
* fix circular import
* fix imports when watermark not specified
* fix all pipelines
2023-07-26 01:46:05 +02:00
Batuhan Taskaya
ff8f58086b
Load Kohya-ss style LoRAs with auxilary states ( #4147 )
...
* Support to load Kohya-ss style LoRA file format (without restrictions)
Co-Authored-By: Takuma Mori <takuma104@gmail.com >
Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com >
* tmp: add sdxl to mlp_modules
---------
Co-authored-by: Takuma Mori <takuma104@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-07-26 00:24:19 +02:00
Sayak Paul
161449d51a
[SDXL DreamBooth LoRA] multiple fixes ( #4262 )
...
* add automatic licensing.
* debugging
* debugging
* more debugging
* more debugging.
* run make fix-copies.
* change to default tracker.
2023-07-25 21:10:01 +02:00
Steven Liu
34abee0907
[docs] Fix image in SDXL docs ( #4267 )
...
fix image link
2023-07-25 09:41:11 -07:00
Harutatsu Akiyama
428dbfecd9
[SDXL and IP2P]: instruction pix2pix XL training and pipeline ( #4079 )
...
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* [Community] Implementation of the IADB community pipeline (#3996 )
* community pipeline: implementation of iadb
* iadb.py: reformat using black
* iadb.py: linting update
* add kandinsky to readme table (#4081 )
Co-authored-by: yiyixuxu <yixu310@gmail,com>
* [From Single File] Force accelerate to be installed (#4078 )
force accelerate to be installed
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Support instruction pix2pix sdxl
* Clean up IP2P SDXL code
* Clean up IP2P SDXL code
* [IP2P and SDXL] clean up code
* [IP2P and SDXL] clean up code
* [IP2P and SDXL] clean up code
* [IP2P SDXL] Address code reviews
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews, add docs, tests
* [IP2P SDXL] Address code reviews
* [IP2P SDXL] Address code reviews
* [IP2P SDXL] Add README_SDXL
* [IP2P SDXL] Address code reviews
* [IP2P SDXL] Address code reviews
* [IP2P SDXL] Fix the copy problems
* [IP2P SDXL] Add license
* [IP2P SDXL] Add license
* [IP2P SDXL] Add license
* [IP2P SDXL] Address code reivew for selecting VAE andd others
* [IP2P SDXL] Update README_sdxl
* [IP2P SDXL] Update __init__
* [IP2P SDXL] Update dummy_torch_and_transformers_and_invisible_watermark_objects
* address patrick's comments and some additions to readmes.
---------
Co-authored-by: Harutatsu Akiyama <kf.zy.qin@gmail.com >
Co-authored-by: Thomas Chambon <36728882+tchambon@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-07-25 18:19:35 +05:30
Ragnar Rova
4e2a021829
Model path for sdxl wrong in dreambooth README ( #4261 )
2023-07-25 18:06:50 +05:30
Patrick von Platen
ebfe343149
[from_single_file] Fix circular import ( #4259 )
...
* up
* finish
* fix final
2023-07-25 14:30:39 +02:00
Sayak Paul
5ef6b8fa53
Update README_sdxl.md to change the note on default hyperparameters ( #4258 )
2023-07-25 16:57:48 +05:30
YiYi Xu
c11d11d63d
[draft v2] AutoPipeline ( #4138 )
...
* initial
* style
* from ...pipelines -> from ..pipeline_util
* make style
* fix-copies
* fix value_guided_sampling oops
* style
* add test
* Show failing test
* update from_pipe
* fix
* add controlnet, additional test and register unused original config
* update for controlnet
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* store unused config as private attribute and pass if can
* add doc
* kandinsky inpaint pipeline does not work with decoder checkpoint
* update doc
* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* style
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* fix
* Apply suggestions from code review
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-07-25 13:20:35 +02:00
Patrick von Platen
d74561da2c
[SDXL] Improve docs ( #4196 )
...
* Improve docs
* Correct docs
* Add better example inpaint
* make style
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* fix
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-07-25 12:48:25 +02:00
Patrick von Platen
a0422ed0c9
[From Single File] Allow vae to be loaded ( #4242 )
...
* Allow vae to be loaded
* up
2023-07-25 12:16:43 +02:00
Will Berman
3dd339379d
do not pass list to accelerator.init_trackers ( #4248 )
2023-07-24 21:10:37 -07:00
nupurkmr9
5652c43f83
Resolve bf16 error as mentioned in this [issue]( https://github.com/huggingface/diffusers/issues/4139#issuecomment-1639977304 ) ( #4214 )
...
* resolve bf16 error
* resolve bf16 error
* resolve bf16 error
* resolve bf16 error
* resolve bf16 error
* resolve bf16 error
* resolve bf16 error
2023-07-25 05:41:19 +05:30
Sayak Paul
365e8461ac
[SDXL DreamBooth LoRA] add support for text encoder fine-tuning ( #4097 )
...
* Allow low precision sd xl
* finish
* finish
* feat: initial draft for supporting text encoder lora finetuning for SDXL DreamBooth
* fix: variable assignments.
* add: autocast block.
* add debugging
* vae dtype hell
* fix: vae dtype hell.
* fix: vae dtype hell 3.
* clean up
* lora text encoder loader.
* fix: unwrapping models.
* add: tests.
* docs.
* handle unexpected keys.
* fix vae dtype in the final inference.
* fix scope problem.
* fix: save_model_card args.
* initialize: prefix to None.
* fix: dtype issues.
* apply gixes.
* debgging.
* debugging
* debugging
* debugging
* debugging
* debugging
* add: fast tests.
* pre-tokenize.
* address: will's comments.
* fix: loader and tests.
* fix: dataloader.
* simplify dataloader.
* length.
* simplification.
* make style && make quality
* simplify state_dict munging
* fix: tests.
* fix: state_dict packing.
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-07-25 05:35:48 +05:30
Sayak Paul
fed12376c5
[ControlNet SDXL training] fixes in the training script ( #4223 )
...
* fix : #4206
* add: sdxl controlnet training smoketest.
* remove unnecessary token inits.
* add: licensing to model card.
* include SDXL licensing in the model card and make public visibility default
* debugging
* debugging
* disable local file download.
* fix: training test.
* fix: ckpt prefix.
2023-07-25 05:31:48 +05:30
Patrick von Platen
95b7de88fd
[Docs] Fix from pretrained docs ( #4240 )
...
* [Docs] Fix from pretrained docs
* [Docs] Fix from pretrained docs
2023-07-24 20:24:29 +02:00
