Commit Graph

46 Commits

Author SHA1 Message Date
Ki-wimon
6bcd52c9cc
update new locon args support 2023-03-01 12:22:11 +08:00
Ki-wimon
c07e3bba76
add new LoCon args 2023-03-01 12:19:18 +08:00
Ki-wimon
d76fe7d4e0
LoCon script auto upgrade feature 2023-02-28 22:58:35 +08:00
bmaltais
f6bec77eaa
Merge branch 'dev' into master 2023-02-28 07:04:08 -05:00
Ki-wimon
c32a99dad5
Update lora_gui.py 2023-02-28 01:38:05 +08:00
Ki-wimon
6e664f1176
support locon 2023-02-28 01:16:23 +08:00
bmaltais
9d2e3f85a2 Add tensorboard support 2023-02-26 19:49:22 -05:00
bmaltais
f213b15014 Updates 2023-02-24 20:37:51 -05:00
bmaltais
bf0344ba9e Adding GUI support for new features 2023-02-22 20:32:57 -05:00
bmaltais
dfc9a8dd40 Fix issue with save config 2023-02-20 07:56:24 -05:00
bmaltais
758bfe85dc Adding support for Lion optimizer in gui 2023-02-19 20:13:03 -05:00
bmaltais
e5f8ba559f Add server_port and inbrowser support
- to all gui scripts
2023-02-10 08:22:03 -05:00
bmaltais
09d3a72cd8 Adding support for caption dropout 2023-02-07 20:58:35 -05:00
bmaltais
cbfc311687 Integrate new bucket parameters in GUI 2023-02-05 20:07:00 -05:00
bmaltais
2486af9903 Update to latest dev code of kohya_s. WIP 2023-02-05 14:16:53 -05:00
bmaltais
2626214f8a Add support for LoRA resizing 2023-02-04 11:55:06 -05:00
bmaltais
045750b46a v20.6.0
- Increase max LoRA rank (dim) size to 1024.
    - Update finetune preprocessing scripts.
        - ``.bmp`` and ``.jpeg`` are supported. Thanks to breakcore2 and p1atdev!
        - The default weights of ``tag_images_by_wd14_tagger.py`` is now ``SmilingWolf/wd-v1-4-convnext-tagger-v2``. You can specify another model id from ``SmilingWolf`` by ``--repo_id`` option. Thanks to SmilingWolf for the great work.
        - To change the weight, remove ``wd14_tagger_model`` folder, and run the script again.
        - ``--max_data_loader_n_workers`` option is added to each script. This option uses the DataLoader for data loading to speed up loading, 20%~30% faster.
        - Please specify 2 or 4, depends on the number of CPU cores.
        - ``--recursive`` option is added to ``merge_dd_tags_to_metadata.py`` and ``merge_captions_to_metadata.py``, only works with ``--full_path``.
        - ``make_captions_by_git.py`` is added. It uses [GIT microsoft/git-large-textcaps](https://huggingface.co/microsoft/git-large-textcaps) for captioning.
        - ``requirements.txt`` is updated. If you use this script, [please update the libraries](https://github.com/kohya-ss/sd-scripts#upgrade).
        - Usage is almost the same as ``make_captions.py``, but batch size should be smaller.
        - ``--remove_words`` option removes as much text as possible (such as ``the word "XXXX" on it``).
        - ``--skip_existing`` option is added to ``prepare_buckets_latents.py``. Images with existing npz files are ignored by this option.
        - ``clean_captions_and_tags.py`` is updated to remove duplicated or conflicting tags, e.g. ``shirt`` is removed when ``white shirt`` exists. if ``black hair`` is with ``red hair``, both are removed.
    - Tag frequency is added to the metadata in ``train_network.py``. Thanks to space-nuko!
        - __All tags and number of occurrences of the tag are recorded.__ If you do not want it, disable metadata storing with ``--no_metadata`` option.
2023-02-04 08:36:35 -05:00
bmaltais
c8f4c9d6e8 Add support for lr_scheduler_num_cycles, lr_scheduler_power 2023-01-30 08:26:15 -05:00
bmaltais
202923b3ce Add support for --keep_token option 2023-01-27 07:33:44 -05:00
bmaltais
bf371b49bf Fix issue 71 2023-01-27 07:04:35 -05:00
bmaltais
03bd2e9b01 Add TI training support 2023-01-26 16:22:58 -05:00
bmaltais
511361c80b - Add new tool to verify LoRA weights produced by the trainer. Can be found under "Dreambooth LoRA/Tools/Verify LoRA 2023-01-22 11:40:14 -05:00
bmaltais
2ca17f69dd v20.4.0:
Add support for `network_alpha` under the Training tab and support for `--training_comment` under the Folders tab.
2023-01-22 10:18:00 -05:00
bmaltais
fcad6bfd98 Add default for caption extension tools 2023-01-20 18:41:37 -05:00
bmaltais
6a85f15542 Remove arg that were replaced 2023-01-19 20:49:40 -05:00
bmaltais
567221549f Complete training code refactoring 2023-01-15 19:59:40 -05:00
bmaltais
123cf4e3c5 Move cxommon adv train parm to common gui 2023-01-15 15:03:04 -05:00
bmaltais
abccecb093 Move save_state and resume to common gui
Format code
2023-01-15 12:01:59 -05:00
bmaltais
6aed2bb402 Add support for new arguments:
- max_train_epochs
- max_data_loader_n_workers
Move some of the codeto  common gui library.
2023-01-15 11:05:22 -05:00
bmaltais
43116feda8 Add support for max token 2023-01-10 09:38:32 -05:00
bmaltais
11fbc63440 Fix issue with lora model loading 2023-01-09 17:22:42 -05:00
bmaltais
dc5afbb057 Move functions to common_gui
Add model name support
2023-01-09 11:48:57 -05:00
bmaltais
a4262c0a66 - Add vae support to dreambooth GUI
- Add gradient_checkpointing, gradient_accumulation_steps, mem_eff_attn, shuffle_caption to finetune GUI
- Add gradient_accumulation_steps, mem_eff_attn to dreambooth lora gui
2023-01-08 20:55:41 -05:00
bmaltais
34f7cd8e57 Add new Utility to Extract a LoRA from a finetuned model 2023-01-06 18:25:55 -05:00
bmaltais
c20a10d7fd Emergency fix for dreambooth_ui no longer working, sorry
- Add LoRA network merge too GUI. Run `pip install -U -r requirements.txt` after pulling this new release.
2023-01-06 07:13:12 -05:00
bmaltais
b8100b1a0a - Add support for --clip_skip option
- Add missing `detect_face_rotate.py` to tools folder
- Add `gui.cmd` for easy start of GUI
2023-01-05 19:16:13 -05:00
bmaltais
9d3c402973 - Finetune, add xformers, 8bit adam, min bucket, max bucket, batch size and flip augmentation support for dataset preparation
- Finetune, add "Dataset preparation" tab to group task specific options
2023-01-02 13:07:17 -05:00
bmaltais
1d460a09fd add support for color and flip augmentation to "Dreambooth LoRA" 2023-01-01 22:43:44 -05:00
bmaltais
bfa590b313 Quick fix for bug when no LoRA network weights is provided 2023-01-01 14:37:32 -05:00
bmaltais
af46ce4c47 Update LoRA GUI
Various improvements
2023-01-01 14:14:58 -05:00
bmaltais
2c069d1067 Improve GUI 2023-01-01 00:33:29 -05:00
bmaltais
6b41f4f951 Fix standalone lora gui issue 2022-12-30 21:18:50 -05:00
bmaltais
0c5966f6f4 Fix issue with LR 2022-12-29 21:17:41 -05:00
bmaltais
b44f075f60 Implement open and save config for LoRA 2022-12-29 14:00:02 -05:00
bmaltais
0f42ab78c4 Fix issue with caption extension 2022-12-28 23:19:18 -05:00
bmaltais
d6def2343f !st rough implementation of LoRA GUI 2022-12-28 23:02:35 -05:00