Welcome to kohya_ss Discussions!

[bmaltais]

👋 Welcome!

We’re using Discussions as a place to connect with other members of our community. We hope that you:

• Ask questions you’re wondering about.
• Share ideas.
• Engage with other community members.
• Welcome others and are open-minded. Remember that this is a community we
  build together 💪.

To get started, comment below with an introduction of yourself and tell us about what you do with this community.

[AAGS111]

What is the reason for such errors during Lora training? Solution: raise subprocess CalledProcessError (return code=process. return code, cmd=cmd)

[AAGS111]

Console status:

17:15:38-554665 INFO Kohya_ss GUI version: v24.1.4
17:15:39-317928 INFO Submodule initialized and updated.
17:15:39-321086 INFO nVidia toolkit detected
17:15:45-069944 INFO Torch 2.1.2+cu118
17:15:45-152306 INFO Torch backend: nVidia CUDA 11.8 cuDNN 8905
17:15:45-157311 INFO Torch detected GPU: NVIDIA GeForce RTX 3070 Laptop GPU VRAM 8192 Arch (8, 6) Cores 40
17:15:45-166464 INFO Python version is 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit
(AMD64)]
17:15:45-171467 INFO Verifying modules installation status from requirements_pytorch_windows.txt...
17:15:45-181768 INFO Verifying modules installation status from requirements_windows.txt...
17:15:45-190371 INFO Verifying modules installation status from requirements.txt...
17:16:03-668231 INFO headless: False
17:16:03-733808 INFO Using shell=True when running external commands...
IMPORTANT: You are using gradio version 4.26.0, however version 4.29.0 is available, please upgrade.

Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch().
17:17:53-551668 INFO Loading config...
17:19:56-749343 INFO Start training LoRA Standard ...
17:19:56-751344 INFO Validating lr scheduler arguments...
17:19:56-753344 INFO Validating optimizer arguments...
17:19:56-755343 INFO Validating E:/AI/A_kohya_ss/kohya_ss/train/log existence and writability... SUCCESS
17:19:56-757344 INFO Validating E:/AI/A_kohya_ss/kohya_ss/train/model existence and writability... SUCCESS
17:19:56-759343 INFO Validating E:/AI/A_kohya_ss/kohya_ss/train/majicMIX realistic v7.safetensors existence...
SUCCESS
17:19:56-760343 INFO Validating E:/AI/A_kohya_ss/kohya_ss/train/xunxian existence... SUCCESS
17:19:56-762563 INFO Folder 10_darius kawasaki person: 10 repeats found
17:19:56-764600 INFO Folder 10_darius kawasaki person: 5 images found
17:19:56-766603 INFO Folder 10_darius kawasaki person: 5 * 10 = 50 steps
17:19:56-767600 INFO Regulatization factor: 1
17:19:56-768598 INFO Total steps: 50
17:19:56-769565 INFO Train batch size: 1
17:19:56-770598 INFO Gradient accumulation steps: 1
17:19:56-771606 INFO Epoch: 1
17:19:56-772598 INFO Max train steps: 1600
17:19:56-773570 INFO stop_text_encoder_training = 0
17:19:56-774599 INFO lr_warmup_steps = 160
17:19:56-779600 INFO Saving training config to E:/AI/A_kohya_ss/kohya_ss/train/model\last_20240516-171956.json...
17:19:56-782566 INFO Executing command: E:\AI\A_kohya_ss\kohya_ss\venv\Scripts\accelerate.EXE launch
--dynamo_backend no --dynamo_mode default --mixed_precision fp16 --num_processes 1
--num_machines 1 --num_cpu_threads_per_process 2
E:/AI/A_kohya_ss/kohya_ss/sd-scripts/train_network.py --config_file
E:/AI/A_kohya_ss/kohya_ss/train/model/config_lora-20240516-171956.toml
17:19:56-827996 INFO Command executed.
2024-05-16 17:20:12 INFO Loading settings from train_util.py:3744
E:/AI/A_kohya_ss/kohya_ss/train/model/config_lora-20240516-171956.toml..
.
INFO E:/AI/A_kohya_ss/kohya_ss/train/model/config_lora-20240516-171956 train_util.py:3763
2024-05-16 17:20:12 INFO prepare tokenizer train_util.py:4227
Traceback (most recent call last):
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\connectionpool.py", line 700, in urlopen
self._prepare_proxy(conn)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\connectionpool.py", line 996, in prepare_proxy
conn.connect()
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\connection.py", line 414, in connect
self.sock = ssl_wrap_socket(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\util\ssl.py", line 449, in ssl_wrap_socket
ssl_sock = ssl_wrap_socket_impl(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\util\ssl.py", line 493, in _ssl_wrap_socket_impl
return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
File "C:\Users\one\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 513, in wrap_socket
return self.sslsocket_class._create(
File "C:\Users\one\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1071, in _create
self.do_handshake()
File "C:\Users\one\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1342, in do_handshake
self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\requests\adapters.py", line 489, in send
resp = conn.urlopen(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\connectionpool.py", line 787, in urlopen
retries = retries.increment(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\urllib3\util\retry.py", line 592, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /openai/clip-vit-large-patch14/resolve/main/tokenizer_config.json (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "E:\AI\A_kohya_ss\kohya_ss\sd-scripts\train_network.py", line 1115, in
trainer.train(args)
File "E:\AI\A_kohya_ss\kohya_ss\sd-scripts\train_network.py", line 154, in train
tokenizer = self.load_tokenizer(args)
File "E:\AI\A_kohya_ss\kohya_ss\sd-scripts\train_network.py", line 105, in load_tokenizer
tokenizer = train_util.load_tokenizer(args)
File "E:\AI\A_kohya_ss\kohya_ss\sd-scripts\library\train_util.py", line 4241, in load_tokenizer
tokenizer = CLIPTokenizer.from_pretrained(original_path)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\transformers\tokenization_utils_base.py", line 1969, in from_pretrained
resolved_config_file = cached_file(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\transformers\utils\hub.py", line 398, in cached_file
resolved_file = hf_hub_download(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\utils_validators.py", line 118, in _inner_fn
return fn(*args, **kwargs)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\file_download.py", line 1238, in hf_hub_download
metadata = get_hf_file_metadata(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\utils_validators.py", line 118, in _inner_fn
return fn(*args, **kwargs)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\file_download.py", line 1631, in get_hf_file_metadata
r = _request_wrapper(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\file_download.py", line 385, in _request_wrapper
response = _request_wrapper(
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\file_download.py", line 408, in _request_wrapper
response = get_session().request(method=method, url=url, **params)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\requests\sessions.py", line 587, in request
resp = self.send(prep, **send_kwargs)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\requests\sessions.py", line 701, in send
r = adapter.send(request, **kwargs)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\huggingface_hub\utils_http.py", line 67, in send
return super().send(request, *args, **kwargs)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\requests\adapters.py", line 563, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /openai/clip-vit-large-patch14/resolve/main/tokenizer_config.json (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1007)')))"), '(Request ID: e06dffc6-0d60-4e02-a614-209fb54c20e0)')
Traceback (most recent call last):
File "C:\Users\one\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\one\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "E:\AI\A_kohya_ss\kohya_ss\venv\Scripts\accelerate.EXE_main.py", line 7, in
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\accelerate\commands\accelerate_cli.py", line 47, in main
args.func(args)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\accelerate\commands\launch.py", line 1017, in launch_command
simple_launcher(args)
File "E:\AI\A_kohya_ss\kohya_ss\venv\lib\site-packages\accelerate\commands\launch.py", line 637, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['E:\AI\A_kohya_ss\kohya_ss\venv\Scripts\python.exe', 'E:/AI/A_kohya_ss/kohya_ss/sd-scripts/train_network.py', '--config_file', 'E:/AI/A_kohya_ss/kohya_ss/train/model/config_lora-20240516-171956.toml']' returned non-zero exit status 1.
17:20:14-131155 INFO Training has ended.

[5KilosOfCheese]

Some of you might have seen me here. I'm not a coder - however I am an engineer of a non-software variety. I can be found to be discussion rather near metaphysical and philosophical aspescts of finetuning. Generally also can be seen going against the "common accepted knowledge" since I been able to pull off everything I want thus far with and without: Captions, Regularisation images, Massive dataset of pictures. I don't do anime stuff, and generally I hang around the far borders of strange, odd and "whether this is possible at all". Which usually means what I do and can be seen talking about have very little to do with "making pretty images" and more about "does this concept work at all".

I'm a great fan of documentation with goal of trying to write something down which could useful for others to use. However I keep getting sidetracked with that task. I'm also appreciator of good UI/UX design which is human centric in nature, and I might aswell be wishing for an utopia on that front. Despite being an engineer, I think the biggest flaw of us engineers is to make things that only other engineers can possibly understand.

I am also often found at giving people basic troubleshooting tips, which usually are them misunderstanding something very basic about setting things up... Or running to that one problem that in the year of our lord 2024 you still can't reliably use "special" characters - like äöå - in filenames or paths.

[SodaShenZhen]

请问这个训练出的lora 能适用comfyui吗？