Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow program execution #79

Open
it666-png opened this issue Jul 31, 2024 · 14 comments
Open

Slow program execution #79

it666-png opened this issue Jul 31, 2024 · 14 comments

Comments

@it666-png
Copy link

When running automated program operation testing, the entire operation process is very slow, and sometimes it takes 20 minutes to complete one step. Is there any parameter that can be adjusted?

@WeihaoTan
Copy link
Collaborator

The main bottleneck is the time to wait for GPT-4o's response. It seems that you need to wait for a long time to get GPT-4o's response. Maybe you could run a minimal GPT-4o call and see whether you could get the reply within several seconds (https://platform.openai.com/docs/api-reference/chat/create?lang=python).

@it666-png
Copy link
Author

Sorry, I didn't describe it clearly. The slow execution of automatic programs is not related to the response time of GPT. I can see that the execution steps generated by GPT are repeated many times in the execution window, but the program either has no response or has to wait for a long time before moving. I didn't make any changes, I just followed the official documentation to perform the relevant operations.

@it666-png
Copy link
Author

Is there a place to upload videos? I recorded a video, is it convenient to upload

@WeihaoTan
Copy link
Collaborator

Can you check the actions outputted? Are they correct and executable?

@it666-png
Copy link
Author

I can't confirm this, I just looked at the content and found that the operation steps generated by GPT are correct, but the program did not synchronize the operation.

@it666-png
Copy link
Author

Is there a place to upload videos? I recorded a video, is it convenient to upload

@WeihaoTan
Copy link
Collaborator

You can upload the video to any platform you prefer and share the link with us. But I do not think a video is enough for us to debug. Could you provide the corresponding log file in the run folder after you run the code, which should contain all the input and output from GPT-4o?

@it666-png
Copy link
Author

链接: https://pan.baidu.com/s/1vTNzaUNQWYhHAlQZBqGv7Q 提取码: 6666

The video and log files are in the cloud storage. Could you please analyze the reason? Thank you very much.

@WeihaoTan
Copy link
Collaborator

Could you explain more about your issue? This video looks good to me. The agent executes several actions successfully in the 20-minute-long video.

@it666-png
Copy link
Author

There are mainly the following issues:

  1. The execution time is too long, with 3 tasks taking 20 minutes;
  2. And none of the three tasks were successfully executed:
    a, Create a schedule
    b. Send a Hi message to Gradle
    c. Send PDF file
    None of the three tasks were successful

@WeihaoTan
Copy link
Collaborator

For the time issue, it is quite common. Due to the delay in the GPT-4o API's response, we need to wait for about 15-60 seconds for each action.

For the performance issue, I noticed that you did not open Feishu as full screen. Could you check your settings according to our readme? Thanks

@it666-png
Copy link
Author

Feishu opens in full screen, but when the program runs, Feishu automatically shrinks the window
Additionally, I operated remotely from the server, and the server settings were configured according to the requirements outlined in the cradle project documentation

@D-Mad
Copy link

D-Mad commented Sep 24, 2024

I also got extremely slow response.

@LianShuQuan
Copy link

2024-11-09 14:23:50,239 - CPU: 0.0%, Memory: 72.5% - UAC Logger - INFO - Starting SOM augmentation.
2024-11-09 14:33:55,363 - CPU: 0.0%, Memory: 70.5% - UAC Logger - INFO - Removed 11.18% redundant bounding boxes.
2024-11-09 14:33:55,776 - CPU: 100.0%, Memory: 70.5% - UAC Logger - INFO - Removed 8.15% merged bounding boxes.
The main bottleneck is SOM augmentation. And I observed that my gpu utilization ratio is very low.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants