[Bug]: lora-embedding bundle system is not working

[Ketorami]

Checklist

• The issue exists after disabling all extensions
• The issue exists on a clean installation of webui
• The issue is caused by an extension, but I believe it is caused by a bug in the webui
• The issue exists in the current version of the webui
• The issue has not been reported before recently
• The issue has been reported before but has not been fixed yet

What happened?

The usage of lora-embedding did not yield the expected results compared to A1111, which has no errors in using LoRA with bundled Embedding. You can find more information at Here

[ Left side: Forge , Right side: A1111 ]

Steps to reproduce the problem

LoRA used in testing: Ayanami , Muelsyse

What should have happened?

Supporting lora-embedding like A1111

What browsers do you use to access the UI ?

Google Chrome

Sysinfo

sysinfo-2024-02-21-00-22.json

Console logs

Already up to date.
venv "E:\AI Gen\stable-diffusion-webui-forge\venv\Scripts\Python.exe"
Python 3.10.11 (tags/v3.10.11:7d4cc5a, Apr  5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
Version: f0.0.14v1.8.0rc-latest-186-ge5b7fdf2
Commit hash: e5b7fdf227bbb85951e1ac792faff802ee549949
loading WD14-tagger reqs from E:\AI Gen\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-wd14-tagger\requirements.txt
Checking WD14-tagger requirements.
Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\a1111-sd-webui-tagcomplete':
Already up to date.

Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\adetailer':
Already up to date.

Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\sd-webui-aspect-ratio-helper':
Already up to date.

Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\sd-webui-cd-tuner':
Already up to date.

Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\sd-webui-negpip':
Already up to date.

Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\sdwebui-close-confirmation-dialogue':
Already up to date.

Pulled changes for repository in 'E:\AI Gen\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-wd14-tagger':
Already up to date.

Launching Web UI with arguments: --ckpt-dir E:\AI Gen\stable-diffusion-webui\models\Stable-diffusion --embeddings-dir E:\AI Gen\stable-diffusion-webui\embeddings --lora-dir E:\AI Gen\stable-diffusion-webui\models\Lora --vae-dir E:\AI Gen\stable-diffusion-webui\models\VAE --esrgan-models-path E:\AI Gen\stable-diffusion-webui\models\ESRGAN --controlnet-dir E:\AI Gen\stable-diffusion-webui\models\ControlNet --controlnet-preprocessor-models-dir E:\AI Gen\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator --skip-load-model-at-start --update-all-extensions
Total VRAM 8192 MB, total RAM 16180 MB
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 2060 SUPER : native
VAE dtype: torch.float32
2024-02-21 07:22:29.586458: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
WARNING:tensorflow:From E:\AI Gen\stable-diffusion-webui-forge\venv\lib\site-packages\keras\src\losses.py:2976: The name tf.losses.sparse_softmax_cross_entropy is deprecated. Please use tf.compat.v1.losses.sparse_softmax_cross_entropy instead.

Using pytorch cross attention
ControlNet preprocessor location: E:\AI Gen\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator
Tag Autocomplete: Could not locate model-keyword extension, Lora trigger word completion will be limited to those added through the extra networks menu.
[-] ADetailer initialized. version: 24.1.2, num models: 9
== WD14 tagger /gpu:0, uname_result(system='Windows', node='DESKTOP-4SOKSJ3', release='10', version='10.0.22621', machine='AMD64') ==
Loading weights [cf38a0a2ca] from E:\AI Gen\stable-diffusion-webui\models\Stable-diffusion\AstreaPixie KetorAMI-ReMIX\AstreaPixie KetoREMIX [ Improve NSFW ] V6 R1 -E5 [ Bake VAE ] .safetensors
2024-02-21 07:22:48,173 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 41.6s (prepare environment: 14.2s, import torch: 5.5s, import gradio: 1.4s, setup paths: 9.9s, initialize shared: 0.2s, other imports: 1.0s, load scripts: 7.8s, create ui: 0.8s, gradio launch: 0.8s).
model_type EPS
UNet ADM Dimension 0
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
left over keys: dict_keys(['model_ema.decay', 'model_ema.num_updates'])
loaded straight to GPU
To load target model BaseModel
Begin to load 1 model
Loading VAE weights specified in settings: E:\AI Gen\stable-diffusion-webui\models\VAE\anythingKlF8Anime2VaeFtMse840000_blessed2.safetensors
To load target model SD1ClipModel
Begin to load 1 model
Moving model(s) has taken 0.21 seconds
Model loaded in 7.6s (load weights from disk: 0.7s, forge instantiate config: 0.3s, forge load real models: 5.0s, load VAE: 0.8s, calculate empty prompt: 0.7s).
lora key not loaded bundle_emb.muelsyse_arknights.string_to_param.*

CD Tuner Effective : [-2.5, 1.5, 0.5, 1.25, 0, 0, 0, 0, 0, 0, 0, -1, -1, 0, 1.5]
To load target model SD1ClipModel
Begin to load 1 model
unload clone 0
Moving model(s) has taken 0.24 seconds
To load target model BaseModel
Begin to load 1 model
unload clone 1
Moving model(s) has taken 1.45 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 30/30 [00:11<00:00,  2.57it/s]
To load target model AutoencoderKL█████████████████████████████████████████████████████| 30/30 [00:10<00:00,  2.41it/s]
Begin to load 1 model
Moving model(s) has taken 1.10 seconds
Total progress: 100%|██████████████████████████████████████████████████████████████████| 30/30 [00:13<00:00,  2.22it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 30/30 [00:13<00:00,  2.41it/s]

Additional information

No response