https://docs.dify.ai/getting-started/install-self-hosted/local-source-code #6157

yanguangcang2019 · 2024-07-10T13:48:34Z

          https://docs.dify.ai/getting-started/install-self-hosted/local-source-code

I run Dify in docker,not local-source-code,I am also encountering the same issue where the progress of my file upload to the knowledge base is always at 0. I've been waiting for a long time, but the progress number has disappeared, and the "Next Step" button is ineffective. What could be the reason? I am using the Docker method to start, and I don't need to execute the command celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace, right?
pls check your worker service is started or not @dwq370

Originally posted by @JohnJyong in #4295 (comment)

The text was updated successfully, but these errors were encountered:

dosubot · 2024-07-10T13:54:22Z

Hey @yanguangcang2019! I'm here to help you with your Dify issue. I'm a bot that can assist you with bug fixes, answer questions, and guide you on how to become a contributor. Let's tackle this issue together!

To address the issue where the progress of your file upload to the knowledge base remains at 0 when running Dify using Docker, you need to ensure that the Celery worker service is running correctly. Here are the steps to verify and start the worker service:

Check if the worker service is running:
Use the following Docker command to list the status of all services defined in your docker-compose.yaml file:
```
docker compose ps
```
Look for the worker service in the output. It should show a status of Up if it is running correctly.
Start the worker service if it is not running:
If the worker service is not running, you can start it with:
```
docker compose up -d worker
```
Check the logs for the worker service:
If the worker service is running but the file upload progress remains at 0, there might be an issue with the Celery worker processing the tasks. Check the logs for the worker service to diagnose any issues:
```
docker compose logs worker
```
Look for any errors or warnings in the logs that might indicate why the worker is not processing the file upload tasks.
Ensure all necessary services are running:
Make sure all other necessary services are running correctly. You can start all services with:
```
cd dify/docker
docker compose up -d
```
Then, verify the status of all containers:
```
docker compose ps
```
The output should show all services, including api, worker, web, weaviate, db, redis, and nginx, with a status of Up. If any service is not running, it could affect the file upload process.

By following these steps, you should be able to determine if the worker service is running and diagnose any issues that might be causing the file upload progress to remain at 0 ^[1]^[2]^[3]^[4].

To continue talking to Dosu, mention @dosu.

yanguangcang2019 · 2024-07-10T14:03:51Z

NAME                  IMAGE                              COMMAND                   SERVICE      CREATED      STATUS                        PORTS
docker-api-1          langgenius/dify-api:0.6.12-fix1    "/bin/bash /entrypoi…"   api          8 days ago   Up About a minute             5001/tcp
docker-db-1           postgres:15-alpine                 "docker-entrypoint.s…"   db           8 days ago   Up About a minute (healthy)   5432/tcp
docker-nginx-1        nginx:latest                       "sh -c 'cp /docker-e…"   nginx        8 days ago   Up About a minute             0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp
docker-redis-1        redis:6-alpine                     "docker-entrypoint.s…"   redis        8 days ago   Up About a minute (healthy)   6379/tcp
docker-sandbox-1      langgenius/dify-sandbox:0.2.1      "/main"                   sandbox      8 days ago   Up About a minute
docker-ssrf_proxy-1   ubuntu/squid:latest                "sh -c 'cp /docker-e…"   ssrf_proxy   8 days ago   Up About a minute             3128/tcp
docker-weaviate-1     semitechnologies/weaviate:1.19.0   "/bin/weaviate --hos…"   weaviate     8 days ago   Up About a minute
docker-web-1          langgenius/dify-web:0.6.12-fix1    "/bin/sh ./entrypoin…"   web          8 days ago   Up About a minute             3000/tcp
docker-worker-1       langgenius/dify-api:0.6.12-fix1    "/bin/bash /entrypoi…"   worker       8 days ago   Up About a minute             5001/tcp

all is right，but why？

yanguangcang2019 · 2024-07-10T14:06:59Z

embeding model in xinference is running，and it is setted right in dify，can you help me?

crazywoola · 2024-07-10T14:41:28Z

Please do not modify the template.

crazywoola · 2024-07-10T14:43:01Z

run Dify in docker,not local-source-code,I am also encountering the same issue where the progress of my file upload to the knowledge base is always at 0. I've been waiting for a long time, but the progress number has disappeared, and the "Next Step" button is ineffective. What could be the reason? I am using the Docker method to start, and I don't need to execute the command celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace, right?
pls check your worker service is started or not @dwq370

Yes you do not need to run that command.

And please use the right markdown syntax to format code and tracing logs. And you need to provide the logs of the worker container.

Not docker compose ps.

yanguangcang2019 · 2024-07-11T01:15:19Z

(diy_env) root@cuda22:/dify/docker# docker compose logs worker
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Database migration skipped
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-02 04:08:59
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fa9f6350940
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-02 04:08:59,308: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-02 04:08:59,311: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-02 04:09:00,324: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-02 04:09:00,576: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-02 04:09:00,577: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-06 04:51:24
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fbecb6f8040
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-06 04:51:24,765: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-06 04:51:24,767: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-06 04:51:25,780: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-06 04:51:25,790: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-06 04:51:25,795: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-06 04:59:32,807: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection...
worker-1 | Traceback (most recent call last):
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/consumer/consumer.py", line 340, in start
worker-1 | blueprint.start(self)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/bootsteps.py", line 116, in start
worker-1 | step.start(parent)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/consumer/consumer.py", line 742, in start
worker-1 | c.loop(*c.loop_args())
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/loops.py", line 130, in synloop
worker-1 | connection.drain_events(timeout=2.0)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/connection.py", line 341, in drain_events
worker-1 | return self.transport.drain_events(self.connection, kwargs)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/virtual/base.py", line 997, in drain_events
worker-1 | get(self._deliver, timeout=timeout)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 591, in get
worker-1 | ret = self.handle_event(fileno, event)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 573, in handle_event
worker-1 | return self.on_readable(fileno), self
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 569, in on_readable
worker-1 | chan.handlerstype
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 913, in _receive
worker-1 | ret.append(self._receive_one(c))
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 923, in _receive_one
worker-1 | response = c.parse_response()
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 837, in parse_response
worker-1 | response = self._execute(conn, try_read)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 813, in _execute
worker-1 | return conn.retry.call_with_retry(
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 49, in call_with_retry
worker-1 | fail(error)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 815, in
worker-1 | lambda error: self._disconnect_raise_connect(conn, error),
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 802, in _disconnect_raise_connect
worker-1 | raise error
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
worker-1 | return do()
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 814, in
worker-1 | lambda: command(*args, kwargs),
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 835, in try_read
worker-1 | return conn.read_response(disconnect_on_error=False, push_request=True)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/connection.py", line 512, in read_response
worker-1 | response = self._parser.read_response(disable_decoding=disable_decoding)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 124, in read_response
worker-1 | self.read_from_socket()
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 86, in read_from_socket
worker-1 | raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
worker-1 | redis.exceptions.ConnectionError: Connection closed by server.
worker-1 | [2024-07-06 04:59:32,820: WARNING/MainProcess] /app/api/.venv/lib/python3.10/site-packages/celery/worker/consumer/consumer.py:391: CPendingDeprecationWarning:
worker-1 | In Celery 5.1 we introduced an optional breaking change which
worker-1 | on connection loss cancels all currently executed tasks with late acknowledgement enabled.
worker-1 | These tasks cannot be acknowledged as the connection is gone, and the tasks are automatically redelivered
worker-1 | back to the queue. You can enable this behavior using the worker_cancel_long_running_tasks_on_connection_loss
worker-1 | setting. In Celery 5.1 it is set to False by default. The setting will be set to True by default in Celery 6.0.
worker-1 |
worker-1 | warnings.warn(CANCEL_TASKS_BY_DEFAULT, CPendingDeprecationWarning)
worker-1 |
worker-1 | [2024-07-06 04:59:32,820: INFO/MainProcess] Temporarily reducing the prefetch count to 4 to avoid over-fetching since 0 tasks are currently being processed.
worker-1 | The prefetch count will be gradually restored to 0 as the tasks complete processing.
worker-1 | [2024-07-06 04:59:32,823: WARNING/MainProcess] Traceback (most recent call last):
worker-1 | [2024-07-06 04:59:32,823: WARNING/MainProcess] File "src/gevent/_waiter.py", line 122, in gevent._gevent_c_waiter.Waiter.switch
worker-1 | [2024-07-06 04:59:32,823: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/pidbox.py", line 118, in loop
worker-1 | connection.drain_events(timeout=1.0)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/connection.py", line 341, in drain_events
worker-1 | return self.transport.drain_events(self.connection, kwargs)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/virtual/base.py", line 997, in drain_events
worker-1 | get(self._deliver, timeout=timeout)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 591, in get
worker-1 | ret = self.handle_event(fileno, event)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 573, in handle_event
worker-1 | return self.on_readable(fileno), self
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 569, in on_readable
worker-1 | chan.handlerstype
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 913, in _receive
worker-1 | ret.append(self._receive_one(c))
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 923, in _receive_one
worker-1 | response = c.parse_response()
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 837, in parse_response
worker-1 | response = self._execute(conn, try_read)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 813, in _execute
worker-1 | return conn.retry.call_with_retry(
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 49, in call_with_retry
worker-1 | fail(error)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 815, in
worker-1 | lambda error: self._disconnect_raise_connect(conn, error),
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 802, in _disconnect_raise_connect
worker-1 | raise error
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
worker-1 | return do()
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 814, in
worker-1 | lambda: command(*args, kwargs),
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 835, in try_read
worker-1 | return conn.read_response(disconnect_on_error=False, push_request=True)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/connection.py", line 512, in read_response
worker-1 | response = self._parser.read_response(disable_decoding=disable_decoding)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 124, in read_response
worker-1 | self.read_from_socket()
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 86, in read_from_socket
worker-1 | raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess] redis.exceptions.ConnectionError: Connection closed by server.
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess] 2024-07-06T04:59:32Z
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess]
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess] <built-in method switch of gevent._gevent_c_greenlet_primitives.TrackedRawGreenlet object at 0x7fbea90a2ac0> failed with ConnectionError
worker-1 | [2024-07-06 04:59:32,829: ERROR/MainProcess] consumer: Cannot connect to redis://:@redis:6379/1: Error 111 connecting to redis:6379. Connection refused..
worker-1 | Trying again in 2.00 seconds... (1/100)
worker-1 |
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-06 05:00:54
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f2fc8e84880
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-06 05:00:54,772: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-06 05:00:54,776: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-06 05:00:55,791: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-06 05:00:55,829: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-06 05:00:55,835: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-08 14:05:36
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f661510c760
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-08 14:05:36,384: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-08 14:05:36,388: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-08 14:05:37,404: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-08 14:05:37,446: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-08 14:05:37,451: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 14:48:52
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f6504b08610
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 14:48:52,282: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 14:48:52,285: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 14:48:53,295: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 14:48:53,316: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-09 14:48:53,320: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 15:36:58
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f8e1740c7c0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 15:36:58,604: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 15:36:58,606: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 15:36:59,622: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 15:36:59,661: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-09 15:36:59,666: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 15:41:35
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7efeca5147c0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 15:41:35,230: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 15:41:35,235: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 15:41:36,249: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 15:41:36,285: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-09 15:41:36,291: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 15:49:59
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f8f25180040
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 15:49:59,347: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 15:49:59,350: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 15:50:00,363: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 15:50:00,401: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-09 15:50:00,411: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:19:26
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f772d9106a0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:19:27,010: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:19:27,014: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:19:28,023: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:19:28,033: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:19:28,035: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Database migration skipped
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:29:36
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fc7392786a0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:29:36,556: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:29:36,560: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:29:37,574: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:29:37,614: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:29:37,617: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Database migration skipped
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:35:48
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fd8e5d10880
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:35:48,171: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:35:48,175: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:35:49,190: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:35:49,229: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:35:49,233: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:56:39
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fd92fb217b0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:56:39,485: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:56:39,487: INFO/MainProcess] mingle: searching for neighbors
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:57:30
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f0d9fb54970
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:57:30,515: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:57:30,519: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:57:31,532: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:57:31,541: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:57:31,546: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:58:35
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f481ee500d0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:58:35,803: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:58:35,807: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:58:36,822: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:58:36,854: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-10 13:58:36,859: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
(diy_env) root@cuda22:/dify/docker# docker compose ps
NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS
docker-api-1 langgenius/dify-api:0.6.12-fix1 "/bin/bash /entrypoi…" api 8 days ago Up About a minute 5001/tcp
docker-db-1 postgres:15-alpine "docker-entrypoint.s…" db 8 days ago Up About a minute (healthy) 5432/tcp
docker-nginx-1 nginx:latest "sh -c 'cp /docker-e…" nginx 8 days ago Up About a minute 0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp
docker-redis-1 redis:6-alpine "docker-entrypoint.s…" redis 8 days ago Up About a minute (healthy) 6379/tcp
docker-sandbox-1 langgenius/dify-sandbox:0.2.1 "/main" sandbox 8 days ago Up About a minute
docker-ssrf_proxy-1 ubuntu/squid:latest "sh -c 'cp /docker-e…" ssrf_proxy 8 days ago Up About a minute 3128/tcp
docker-weaviate-1 semitechnologies/weaviate:1.19.0 "/bin/weaviate --hos…" weaviate 8 days ago Up About a minute
docker-web-1 langgenius/dify-web:0.6.12-fix1 "/bin/sh ./entrypoin…" web 8 days ago Up About a minute 3000/tcp
docker-worker-1 langgenius/dify-api:0.6.12-fix1 "/bin/bash /entrypoi…" worker 8 days ago Up About a minute 5001/tcp
(diy_env) root@cuda22:/dify/docker# docker compose logs worker
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Database migration skipped
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-02 04:08:59
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fa9f6350940
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-02 04:08:59,308: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-02 04:08:59,311: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-02 04:09:00,324: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-02 04:09:00,576: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-02 04:09:00,577: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-06 04:51:24
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fbecb6f8040
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-06 04:51:24,765: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-06 04:51:24,767: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-06 04:51:25,780: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-06 04:51:25,790: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-06 04:51:25,795: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-06 04:59:32,807: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection...
worker-1 | Traceback (most recent call last):
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/consumer/consumer.py", line 340, in start
worker-1 | blueprint.start(self)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/bootsteps.py", line 116, in start
worker-1 | step.start(parent)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/consumer/consumer.py", line 742, in start
worker-1 | c.loop(*c.loop_args())
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/loops.py", line 130, in synloop
worker-1 | connection.drain_events(timeout=2.0)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/connection.py", line 341, in drain_events
worker-1 | return self.transport.drain_events(self.connection, kwargs)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/virtual/base.py", line 997, in drain_events
worker-1 | get(self._deliver, timeout=timeout)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 591, in get
worker-1 | ret = self.handle_event(fileno, event)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 573, in handle_event
worker-1 | return self.on_readable(fileno), self
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 569, in on_readable
worker-1 | chan.handlerstype
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 913, in _receive
worker-1 | ret.append(self._receive_one(c))
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 923, in _receive_one
worker-1 | response = c.parse_response()
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 837, in parse_response
worker-1 | response = self._execute(conn, try_read)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 813, in _execute
worker-1 | return conn.retry.call_with_retry(
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 49, in call_with_retry
worker-1 | fail(error)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 815, in
worker-1 | lambda error: self._disconnect_raise_connect(conn, error),
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 802, in _disconnect_raise_connect
worker-1 | raise error
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
worker-1 | return do()
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 814, in
worker-1 | lambda: command(*args, kwargs),
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 835, in try_read
worker-1 | return conn.read_response(disconnect_on_error=False, push_request=True)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/connection.py", line 512, in read_response
worker-1 | response = self._parser.read_response(disable_decoding=disable_decoding)
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 124, in read_response
worker-1 | self.read_from_socket()
worker-1 | File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 86, in read_from_socket
worker-1 | raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
worker-1 | redis.exceptions.ConnectionError: Connection closed by server.
worker-1 | [2024-07-06 04:59:32,820: WARNING/MainProcess] /app/api/.venv/lib/python3.10/site-packages/celery/worker/consumer/consumer.py:391: CPendingDeprecationWarning:
worker-1 | In Celery 5.1 we introduced an optional breaking change which
worker-1 | on connection loss cancels all currently executed tasks with late acknowledgement enabled.
worker-1 | These tasks cannot be acknowledged as the connection is gone, and the tasks are automatically redelivered
worker-1 | back to the queue. You can enable this behavior using the worker_cancel_long_running_tasks_on_connection_loss
worker-1 | setting. In Celery 5.1 it is set to False by default. The setting will be set to True by default in Celery 6.0.
worker-1 |
worker-1 | warnings.warn(CANCEL_TASKS_BY_DEFAULT, CPendingDeprecationWarning)
worker-1 |
worker-1 | [2024-07-06 04:59:32,820: INFO/MainProcess] Temporarily reducing the prefetch count to 4 to avoid over-fetching since 0 tasks are currently being processed.
worker-1 | The prefetch count will be gradually restored to 0 as the tasks complete processing.
worker-1 | [2024-07-06 04:59:32,823: WARNING/MainProcess] Traceback (most recent call last):
worker-1 | [2024-07-06 04:59:32,823: WARNING/MainProcess] File "src/gevent/_waiter.py", line 122, in gevent._gevent_c_waiter.Waiter.switch
worker-1 | [2024-07-06 04:59:32,823: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/celery/worker/pidbox.py", line 118, in loop
worker-1 | connection.drain_events(timeout=1.0)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/connection.py", line 341, in drain_events
worker-1 | return self.transport.drain_events(self.connection, kwargs)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/virtual/base.py", line 997, in drain_events
worker-1 | get(self._deliver, timeout=timeout)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 591, in get
worker-1 | ret = self.handle_event(fileno, event)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 573, in handle_event
worker-1 | return self.on_readable(fileno), self
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 569, in on_readable
worker-1 | chan.handlerstype
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 913, in _receive
worker-1 | ret.append(self._receive_one(c))
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/kombu/transport/redis.py", line 923, in _receive_one
worker-1 | response = c.parse_response()
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 837, in parse_response
worker-1 | response = self._execute(conn, try_read)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 813, in _execute
worker-1 | return conn.retry.call_with_retry(
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 49, in call_with_retry
worker-1 | fail(error)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 815, in
worker-1 | lambda error: self._disconnect_raise_connect(conn, error),
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 802, in _disconnect_raise_connect
worker-1 | raise error
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
worker-1 | return do()
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 814, in
worker-1 | lambda: command(*args, kwargs),
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/client.py", line 835, in try_read
worker-1 | return conn.read_response(disconnect_on_error=False, push_request=True)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/connection.py", line 512, in read_response
worker-1 | response = self._parser.read_response(disable_decoding=disable_decoding)
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 124, in read_response
worker-1 | self.read_from_socket()
worker-1 | [2024-07-06 04:59:32,824: WARNING/MainProcess] File "/app/api/.venv/lib/python3.10/site-packages/redis/_parsers/hiredis.py", line 86, in read_from_socket
worker-1 | raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess] redis.exceptions.ConnectionError: Connection closed by server.
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess] 2024-07-06T04:59:32Z
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess]
worker-1 | [2024-07-06 04:59:32,825: WARNING/MainProcess] <built-in method switch of gevent._gevent_c_greenlet_primitives.TrackedRawGreenlet object at 0x7fbea90a2ac0> failed with ConnectionError
worker-1 | [2024-07-06 04:59:32,829: ERROR/MainProcess] consumer: Cannot connect to redis://:@redis:6379/1: Error 111 connecting to redis:6379. Connection refused..
worker-1 | Trying again in 2.00 seconds... (1/100)
worker-1 |
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-06 05:00:54
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f2fc8e84880
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-06 05:00:54,772: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-06 05:00:54,776: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-06 05:00:55,791: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-06 05:00:55,829: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-06 05:00:55,835: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-08 14:05:36
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f661510c760
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-08 14:05:36,384: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-08 14:05:36,388: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-08 14:05:37,404: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-08 14:05:37,446: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-08 14:05:37,451: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 14:48:52
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f6504b08610
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 14:48:52,282: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 14:48:52,285: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 14:48:53,295: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 14:48:53,316: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-09 14:48:53,320: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 15:36:58
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f8e1740c7c0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 15:36:58,604: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 15:36:58,606: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 15:36:59,622: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 15:36:59,661: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-09 15:36:59,666: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 15:41:35
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7efeca5147c0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 15:41:35,230: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 15:41:35,235: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 15:41:36,249: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 15:41:36,285: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-09 15:41:36,291: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-09 15:49:59
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f8f25180040
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-09 15:49:59,347: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-09 15:49:59,350: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-09 15:50:00,363: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-09 15:50:00,401: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-09 15:50:00,411: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:19:26
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f772d9106a0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:19:27,010: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:19:27,014: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:19:28,023: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:19:28,033: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:19:28,035: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Database migration skipped
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:29:36
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fc7392786a0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:29:36,556: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:29:36,560: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:29:37,574: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:29:37,614: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:29:37,617: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Database migration skipped
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:35:48
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fd8e5d10880
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:35:48,171: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:35:48,175: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:35:49,190: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:35:49,229: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:35:49,233: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:56:39
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7fd92fb217b0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:56:39,485: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:56:39,487: INFO/MainProcess] mingle: searching for neighbors
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:57:30
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f0d9fb54970
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:57:30,515: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:57:30,519: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:57:31,532: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:57:31,541: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
worker-1 | [2024-07-10 13:57:31,546: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | Running migrations
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | Preparing database migration...
worker-1 | Start database migration.
worker-1 | INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
worker-1 | INFO [alembic.runtime.migration] Will assume transactional DDL.
worker-1 | Database migration successful!
worker-1 | None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
worker-1 | /app/api/.venv/lib/python3.10/site-packages/celery/platforms.py:829: SecurityWarning: You're running the worker with superuser privileges: this is
worker-1 | absolutely not recommended!
worker-1 |
worker-1 | Please specify a different user using the --uid option.
worker-1 |
worker-1 | User information: uid=0 euid=0 gid=0 egid=0
worker-1 |
worker-1 | warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
worker-1 |
worker-1 | -------------- celery@ec7d05c739d7 v5.3.6 (emerald-rush)
worker-1 | --- ***** -----
worker-1 | -- ******* ---- Linux-5.15.0-107-generic-x86_64-with-glibc2.36 2024-07-10 13:58:35
worker-1 | - *** --- * ---
worker-1 | - ** ---------- [config]
worker-1 | - ** ---------- .> app: app:0x7f481ee500d0
worker-1 | - ** ---------- .> transport: redis://:@redis:6379/1
worker-1 | - ** ---------- .> results: postgresql://postgres:@db:5432/dify
worker-1 | - *** --- * --- .> concurrency: 1 (gevent)
worker-1 | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker-1 | --- ***** -----
worker-1 | -------------- [queues]
worker-1 | .> dataset exchange=dataset(direct) key=dataset
worker-1 | .> generation exchange=generation(direct) key=generation
worker-1 | .> mail exchange=mail(direct) key=mail
worker-1 | .> ops_trace exchange=ops_trace(direct) key=ops_trace
worker-1 |
worker-1 | [tasks]
worker-1 | . schedule.clean_embedding_cache_task.clean_embedding_cache_task
worker-1 | . schedule.clean_unused_datasets_task.clean_unused_datasets_task
worker-1 | . tasks.add_document_to_index_task.add_document_to_index_task
worker-1 | . tasks.annotation.add_annotation_to_index_task.add_annotation_to_index_task
worker-1 | . tasks.annotation.batch_import_annotations_task.batch_import_annotations_task
worker-1 | . tasks.annotation.delete_annotation_index_task.delete_annotation_index_task
worker-1 | . tasks.annotation.disable_annotation_reply_task.disable_annotation_reply_task
worker-1 | . tasks.annotation.enable_annotation_reply_task.enable_annotation_reply_task
worker-1 | . tasks.annotation.update_annotation_to_index_task.update_annotation_to_index_task
worker-1 | . tasks.batch_create_segment_to_index_task.batch_create_segment_to_index_task
worker-1 | . tasks.clean_dataset_task.clean_dataset_task
worker-1 | . tasks.clean_document_task.clean_document_task
worker-1 | . tasks.clean_notion_document_task.clean_notion_document_task
worker-1 | . tasks.deal_dataset_vector_index_task.deal_dataset_vector_index_task
worker-1 | . tasks.delete_segment_from_index_task.delete_segment_from_index_task
worker-1 | . tasks.disable_segment_from_index_task.disable_segment_from_index_task
worker-1 | . tasks.document_indexing_sync_task.document_indexing_sync_task
worker-1 | . tasks.document_indexing_task.document_indexing_task
worker-1 | . tasks.document_indexing_update_task.document_indexing_update_task
worker-1 | . tasks.duplicate_document_indexing_task.duplicate_document_indexing_task
worker-1 | . tasks.enable_segment_to_index_task.enable_segment_to_index_task
worker-1 | . tasks.mail_invite_member_task.send_invite_member_mail_task
worker-1 | . tasks.ops_trace_task.process_trace_tasks
worker-1 | . tasks.recover_document_indexing_task.recover_document_indexing_task
worker-1 | . tasks.remove_document_from_index_task.remove_document_from_index_task
worker-1 | . tasks.retry_document_indexing_task.retry_document_indexing_task
worker-1 | . tasks.sync_website_document_indexing_task.sync_website_document_indexing_task
worker-1 |
worker-1 | [2024-07-10 13:58:35,803: INFO/MainProcess] Connected to redis://:@redis:6379/1
worker-1 | [2024-07-10 13:58:35,807: INFO/MainProcess] mingle: searching for neighbors
worker-1 | [2024-07-10 13:58:36,822: INFO/MainProcess] mingle: all alone
worker-1 | [2024-07-10 13:58:36,854: INFO/MainProcess] celery@ec7d05c739d7 ready.
worker-1 | [2024-07-10 13:58:36,859: INFO/MainProcess] pidbox: Connected to redis://:@redis:6379/1.
(diy_env) root@cuda22:/dify/docker#

yanguangcang2019 · 2024-07-11T01:16:42Z

Are these logs of the worker container?thanks

yanguangcang2019 · 2024-07-11T01:40:54Z

I can not click the next step button

yanguangcang2019 · 2024-07-11T13:52:01Z

Who can help me？

dosubot bot added the 🐞 bug Something isn't working label Jul 10, 2024

crazywoola removed the 🐞 bug Something isn't working label Jul 10, 2024

crazywoola closed this as completed Jul 10, 2024

dosubot bot mentioned this issue Aug 28, 2024

After uploading files in the knowledge base, the status is always in queue. #7747

Closed

5 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

https://docs.dify.ai/getting-started/install-self-hosted/local-source-code #6157

https://docs.dify.ai/getting-started/install-self-hosted/local-source-code #6157

yanguangcang2019 commented Jul 10, 2024

dosubot bot commented Jul 10, 2024

yanguangcang2019 commented Jul 10, 2024 •

edited by crazywoola

Loading

yanguangcang2019 commented Jul 10, 2024

crazywoola commented Jul 10, 2024

crazywoola commented Jul 10, 2024 •

edited

Loading

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 11, 2024

https://docs.dify.ai/getting-started/install-self-hosted/local-source-code #6157

https://docs.dify.ai/getting-started/install-self-hosted/local-source-code #6157

Comments

yanguangcang2019 commented Jul 10, 2024

dosubot bot commented Jul 10, 2024

yanguangcang2019 commented Jul 10, 2024 • edited by crazywoola Loading

yanguangcang2019 commented Jul 10, 2024

crazywoola commented Jul 10, 2024

crazywoola commented Jul 10, 2024 • edited Loading

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 11, 2024

yanguangcang2019 commented Jul 10, 2024 •

edited by crazywoola

Loading

crazywoola commented Jul 10, 2024 •

edited

Loading