Code

[FEATURE] Lora support in 2.3#3072

Code

Merged

lstein merged 117 commits intov2.3invoke-ai/InvokeAI:v2.3from feat/lora-support-2.3invoke-ai/InvokeAI:feat/lora-support-2.3Copy head branch name to clipboardApr 7, 2023

+3,201-3,153

Commits

Commits on Feb 18, 2023

• initial setup of lora support

  felorhik

  committed
  141be95

  Copy full SHA for 141be95

Commits on Feb 19, 2023

• add pending support for safetensors with cloneofsimo/lora

  felorhik

  committed
  afc8639

  Copy full SHA for afc8639

• Create convert_lora.py

  felorhik

  committed
  5a7145c

  Copy full SHA for 5a7145c

Commits on Feb 20, 2023

• change to new method to load safetensors

  felorhik

  committed
  82e4d5a

  Copy full SHA for 82e4d5a

• start of rewrite for add / remove

  felorhik

  committed
  096e1d3

  Copy full SHA for 096e1d3

• Rewrite lora manager with hooks

  neecapp

  committed
  e744774

  Copy full SHA for e744774

• Merge pull request #1 from neecapp/add_lora_support

  Show description for 404000b
  felorhik

  authored
  404000b

  Copy full SHA for 404000b

• code cleanup

  felorhik

  committed
  8f6e43d

  Copy full SHA for 8f6e43d

• cleanup suggestions from neecap

  felorhik

  committed
  3c6c18b

  Copy full SHA for 3c6c18b

• update prompt setup so lora's can be loaded in other ways

  felorhik

  committed
  ac972eb

  Copy full SHA for ac972eb

• adjust loader to use a settings dict

  felorhik

  committed
  884a554

  Copy full SHA for 884a554

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  6e730bd

  Copy full SHA for 6e730bd

• add notes and adjust functions

  felorhik

  committed
  c3edede

  Copy full SHA for c3edede

• Merge branch 'add_lora_support' of https://github.com/jordanramstad/InvokeAI into add_lora_support

  felorhik

  committed
  488326d

  Copy full SHA for 488326d

Commits on Feb 21, 2023

• optimize functions for unloading

  felorhik

  committed
  de89041

  Copy full SHA for de89041

• fix prompt

  neecapp

  committed
  3732af6

  Copy full SHA for 3732af6

• Merge pull request #2 from jordanramstad/prompt-fix

  Show description for 8f527c2
  felorhik

  authored
  8f527c2

  Copy full SHA for 8f527c2

• Update generate.py

  felorhik

  committed
  e2b6dfe

  Copy full SHA for e2b6dfe

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  c1c62f7

  Copy full SHA for c1c62f7

• change hook to override

  felorhik

  committed
  49c0516

  Copy full SHA for 49c0516

• adjusting back to hooks, forcing to be last in execution

  felorhik

  committed
  5529309

  Copy full SHA for 5529309

• Update lora_manager.py

  felorhik

  committed
  c669336

  Copy full SHA for c669336

• fix typo

  felorhik

  committed
  24d9297

  Copy full SHA for 24d9297

Commits on Feb 22, 2023

• cleanup / concept of loading through diffusers

  felorhik

  committed
  f70b727

  Copy full SHA for f70b727

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  686f6ef

  Copy full SHA for 686f6ef

• further cleanup and implement wrapper

  felorhik

  committed
  af3543a

  Copy full SHA for af3543a

• move key converter to wrapper

  felorhik

  committed
  cd333e4

  Copy full SHA for cd333e4

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  5b4a241

  Copy full SHA for 5b4a241

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  d408322

  Copy full SHA for d408322

Commits on Feb 23, 2023

• re-enable load attn procs support (no multiplier)

  felorhik

  committed
  71972c3

  Copy full SHA for 71972c3

• Merge branch 'add_lora_support' of https://github.com/jordanramstad/InvokeAI into add_lora_support

  felorhik

  committed
  3f477da

  Copy full SHA for 3f477da

• setup legacy class to abstract hacky logic for none diffusers lora and format prompt for compel

  felorhik

  committed
  f64a4db

  Copy full SHA for f64a4db

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  8e1fd92

  Copy full SHA for 8e1fd92

• switch all none diffusers stuff to legacy, and load through compel prompts

  felorhik

  committed
  6a1129a

  Copy full SHA for 6a1129a

Commits on Feb 24, 2023

• initial setup of cross attention

  felorhik

  committed
  b69f9d4

  Copy full SHA for b69f9d4

• move legacy lora manager to its own file

  felorhik

  committed
  68a3132

  Copy full SHA for 68a3132

• setup cross conditioning for lora

  felorhik

  committed
  4ce8b1b

  Copy full SHA for 4ce8b1b

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  6a79484

  Copy full SHA for 6a79484

• simplify manager

  felorhik

  committed
  523e44c

  Copy full SHA for 523e44c

• tweaks and small refactors

  damian0815

  committed
  7dbe027

  Copy full SHA for 7dbe027

• Merge pull request #4 from damian0815/pr/2712

  Show description for 036ca31
  felorhik

  authored
  036ca31

  Copy full SHA for 036ca31

• Sync main with v2.3.1 (#2792)

  Show description for e700da2
  lstein

  authored
  e700da2

  Copy full SHA for e700da2

• translationBot(ui): update translation (Spanish)

  Show description for 1447b6d
  

  gallegonovato

  authored and

  weblate

  committed
  1447b6d

  Copy full SHA for 1447b6d

• translationBot(ui): added translation (Romanian)

  Show description for 5725fcb
  

  mahoney-jb

  authored and

  weblate

  committed
  5725fcb

  Copy full SHA for 5725fcb

• translationBot(ui): update translation (Portuguese (Brazil))

  Show description for ec14e2d
  

  telles0808

  authored and

  weblate

  committed
  ec14e2d

  Copy full SHA for ec14e2d

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  ef82290

  Copy full SHA for ef82290

• ui: translations update from weblate (#2804)

  Show description for 49ffb64
  psychedelicious

  authored
  49ffb64

  Copy full SHA for 49ffb64

Commits on Feb 25, 2023

• parent 9eed191

  Show description for 34e3aa1
  Kyle0654

  committed
  34e3aa1

  Copy full SHA for 34e3aa1

• [nodes] Removed InvokerServices, simplying service model

  Kyle0654

  committed
  cd98d88

  Copy full SHA for cd98d88

• Add node-based invocation system (#1650)

  Show description for c22d529
  blessedcoolant

  authored
  c22d529

  Copy full SHA for c22d529

Commits on Feb 26, 2023

• add peft setup (need to install huggingface/peft)

  felorhik

  committed
  d9c4627

  Copy full SHA for d9c4627

• Merge branch 'main' into add_lora_support

  felorhik

  authored
  9cf7e5f

  Copy full SHA for 9cf7e5f

Commits on Mar 29, 2023

• merge lora support

  lstein

  committed
  5a8d66a

  Copy full SHA for 5a8d66a

Commits on Mar 30, 2023

• Kohya lora models load but generate freezes

  lstein

  committed
  c2487e4

  Copy full SHA for c2487e4

• merge with 2.3 release candidate 6

  lstein

  committed
  6ce2484

  Copy full SHA for 6ce2484

• upgrade compel to work with lora syntax

  lstein

  committed
  2a586f3

  Copy full SHA for 2a586f3

• add solution to ROCm fail-to-install error

  lstein

  committed
  91e4c60

  Copy full SHA for 91e4c60

Commits on Mar 31, 2023

• Merge branch 'release/2.3.3-rc3' into feat/lora-support-2.3

  lstein

  committed
  ea5f6b9

  Copy full SHA for ea5f6b9

• preliminary LoRA support ready for testing

  Show description for 879c800
  lstein

  committed
  879c800

  Copy full SHA for 879c800

• Merge branch 'release/2.3.3-rc3' into feat/lora-support-2.3

  lstein

  committed
  8fbe019

  Copy full SHA for 8fbe019

• default --ckpt_convert to true

  lstein

  committed
  74ff73f

  Copy full SHA for 74ff73f

• feat(ui): Add Lora To WebUI

  blessedcoolant

  committed
  8554f81

  Copy full SHA for 8554f81

• fix(ui): Missing Colors

  Show description for b598b84
  blessedcoolant

  committed
  b598b84

  Copy full SHA for b598b84

• build(ui): Add Lora to WebUI

  blessedcoolant

  committed
  1040076

  Copy full SHA for 1040076

• fix: Typescript being broken

  blessedcoolant

  committed
  274d623

  Copy full SHA for 274d623

• fix: LoraManager UI not returning a component

  blessedcoolant

  committed
  a8b9458

  Copy full SHA for a8b9458

• localization(ui): Localize Lora Stuff

  blessedcoolant

  committed
  2c5c20c

  Copy full SHA for 2c5c20c

• build(ui): Rebuild Frontend - Add Lora WebUI

  Show description for 4faf902
  blessedcoolant

  committed
  4faf902

  Copy full SHA for 4faf902

• feat: Add Lora Manager to remaining tabs

  blessedcoolant

  committed
  dabf56b

  Copy full SHA for dabf56b

• build(ui): Add Lora To Other Tabs

  Show description for beff122
  blessedcoolant

  committed
  beff122

  Copy full SHA for beff122

Commits on Apr 1, 2023

• Merge branch 'v2.3' into feat/lora-support-2.3

  lstein

  authored
  acd9838

  Copy full SHA for acd9838

• moved LoRA manager cleanup routines into a context

  lstein

  committed
  c9372f9

  Copy full SHA for c9372f9

• remove direct legacy checkpoint rendering capabilities

  lstein

  committed
  b632b35

  Copy full SHA for b632b35

• add support for loras ending with .pt

  lstein

  committed
  605ceb2

  Copy full SHA for 605ceb2

• detect lora files with .pt suffix

  lstein

  committed
  d3b63ca

  Copy full SHA for d3b63ca

• LoRA alpha can be 0

  lstein

  committed
  8518f8c

  Copy full SHA for 8518f8c

Commits on Apr 2, 2023

• added a button to retrieve textual inversion triggers; but causes high browser load

  lstein

  committed
  67435da

  Copy full SHA for 67435da

• add debugging to where spinloop is occurring

  lstein

  committed
  71e4add

  Copy full SHA for 71e4add

• Update ldm/modules/kohya_lora_manager.py

  Show description for 110b067
  

  lstein

  and

  neecapp

  authored
  110b067

  Copy full SHA for 110b067

• Update ldm/modules/kohya_lora_manager.py

  Show description for 941fc22
  

  lstein

  and

  neecapp

  authored
  941fc22

  Copy full SHA for 941fc22

• Update ldm/modules/lora_manager.py

  Show description for 90f77c0
  

  lstein

  and

  neecapp

  authored
  90f77c0

  Copy full SHA for 90f77c0

• more elegant handling of lora context

  lstein

  committed
  e0bd30b

  Copy full SHA for e0bd30b

• tweak debugging message for lora unloading

  lstein

  committed
  16aeb8d

  Copy full SHA for 16aeb8d

• limit number of suggested concepts to those with at least 6 likes

  lstein

  committed
  d7b2dbb

  Copy full SHA for d7b2dbb

• rebuild frontend

  lstein

  committed
  63ecdb1

  Copy full SHA for 63ecdb1

• fix(ui): LoraManager UI causing overload

  blessedcoolant

  committed
  fad6fc8

  Copy full SHA for fad6fc8

• add withLora() readline autocompletion support

  lstein

  committed
  3a0fed2

  Copy full SHA for 3a0fed2

• fix crash when no extra conditioning provided

  lstein

  committed
  0a0e44b

  Copy full SHA for 0a0e44b

• fix crash when no extra conditioning provided (redux)

  lstein

  committed
  afcb278

  Copy full SHA for afcb278

Commits on Apr 3, 2023

• fix cpu overload issue with TI trigger button

  lstein

  committed
  8246e4a

  Copy full SHA for 8246e4a

• rebuild frontend

  lstein

  committed
  f75a20b

  Copy full SHA for f75a20b

• add scrollbars to textual inversion button menu

  lstein

  committed
  667dee7

  Copy full SHA for 667dee7

• fix: Fix Lora / TI Prompt Interaction

  blessedcoolant

  committed
  a14fc3a

  Copy full SHA for a14fc3a

• feat(ui): Make HuggingFace Concepts display optional

  blessedcoolant

  committed
  25faec8

  Copy full SHA for 25faec8

• build: Frontend (Lora Support)

  blessedcoolant

  committed
  11cd8d0

  Copy full SHA for 11cd8d0

• sort lora list alphabetically

  lstein

  committed
  793488e

  Copy full SHA for 793488e

• Merge branch 'feat/lora-support-2.3' of github.com:invoke-ai/InvokeAI into feat/lora-support-2.3

  lstein

  committed
  1e6d804

  Copy full SHA for 1e6d804

• change label for HF concepts library option

  lstein

  committed
  fc4b76c

  Copy full SHA for fc4b76c

Commits on Apr 4, 2023

• remove nodes app directory

  Show description for ad5142d
  lstein

  committed
  ad5142d

  Copy full SHA for ad5142d

• sort loras and TIs in case-insensitive fashion

  lstein

  committed
  e3772f6

  Copy full SHA for e3772f6

Commits on Apr 5, 2023

• create loras directory at update time

  lstein

  committed
  cb1d433

  Copy full SHA for cb1d433

• bump compel version

  lstein

  committed
  e069523

  Copy full SHA for e069523

• adjust debouncing timeout; fix duplicated ti triggers in menu

  lstein

  committed
  261be4e

  Copy full SHA for 261be4e

• remove app tests

  Show description for c8fa019
  lstein

  committed
  c8fa019

  Copy full SHA for c8fa019

• Draft implementation if LyCORIS(LoCon and LoHi)

  

  Sergey Borisov

  committed
  6a8848b

  Copy full SHA for 6a8848b

• Clean up

  

  Sergey Borisov

  committed
  b62cce2

  Copy full SHA for b62cce2

• decrease minimum number of likes to 5

  lstein

  committed
  7bd870f

  Copy full SHA for 7bd870f

• Update kohya_lora_manager.py

  Show description for baf6094
  

  Sergey Borisov

  committed
  baf6094

  Copy full SHA for baf6094

Commits on Apr 6, 2023

• [FEATURE] LyCORIS support in 2.3 (#3118)

  Show description for ab9756b
  lstein

  authored
  ab9756b

  Copy full SHA for ab9756b

• Merge branch 'v2.3' into feat/lora-support-2.3

  lstein

  authored
  3dffa33

  Copy full SHA for 3dffa33

• Merge branch 'feat/lora-support-2.3' of github.com:invoke-ai/InvokeAI into feat/lora-support-2.3

  lstein

  committed
  4b624dc

  Copy full SHA for 4b624dc

• rebuild frontend

  lstein

  committed
  e9d2205

  Copy full SHA for e9d2205

• Update shared_invokeai_diffusion.py

  Show description for 09fe211
  damian0815

  authored
  09fe211

  Copy full SHA for 09fe211

• code cleanup and change default LoRA weight

  Show description for 0784e49
  lstein

  committed
  0784e49

  Copy full SHA for 0784e49

Commits on Apr 7, 2023

• prevent crash when prompt blend requested

  lstein

  committed
  35c4ff8

  Copy full SHA for 35c4ff8

• Merge branch 'v2.3' into feat/lora-support-2.3

  lstein

  authored
  0590bd6

  Copy full SHA for 0590bd6

• bump compel version to fix lora + blend

  damian0815

  committed
  b141ab4

  Copy full SHA for b141ab4