Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 1.2-dev standalone: sysbench bulk_insert 100threads test mo oom #16942

Closed
1 task done
heni02 opened this issue Jun 17, 2024 · 12 comments
Closed
1 task done

[Bug]: 1.2-dev standalone: sysbench bulk_insert 100threads test mo oom #16942

heni02 opened this issue Jun 17, 2024 · 12 comments
Assignees
Labels
kind/bug Something isn't working severity/s0 Extreme impact: Cause the application to break down and seriously affect the use
Milestone

Comments

@heni02
Copy link
Contributor

heni02 commented Jun 17, 2024

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Branch Name

1.2-dev

Commit ID

6cfdcaf

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

job:https://github.com/matrixorigin/mo-nightly-regression/actions/runs/9536425137/job/26283375736
企业微信截图_a94238ba-5139-4d79-953a-79e4179e241e
oom时间04:48:25
企业微信截图_1cdd13e0-3e15-45b2-9136-18041844e059

oom前heap:
heap_019022b9-0526-7e0a-9b0c-648731f5cf5d.gz
heap_019022b8-9007-7bef-889d-171780b05b15.gz
heap_019022b9-ef97-7447-b429-f85a47b2af74 (1).gz
heap_019022b9-7a5f-7937-bd29-6edbb5171dad.gz
企业微信截图_9c9d4ca5-2a9c-4d8d-b10e-05b6ad673630

mo log plz contact me

Expected Behavior

No response

Steps to Reproduce

sysbench  --mysql-host=127.0.0.1 --mysql-port=6001 --mysql-user=dump --mysql-password=111 bulk_insert.lua --mysql-db=sysbench_db --tables=10 --table_size=100000 --threads=100 --time=30 --report-interval=10 prepare
sysbench  --mysql-host=127.0.0.1 --mysql-port=6001 --mysql-user=dump --mysql-password=111  bulk_insert.lua --mysql-db=sysbench_db --tables=10 --table_size=100000 --threads=100 --time=300 --report-interval=10 --range_selects=off --point_selects=1 run

Additional information

No response

@heni02 heni02 added kind/bug Something isn't working severity/s0 Extreme impact: Cause the application to break down and seriously affect the use labels Jun 17, 2024
@heni02 heni02 added this to the 1.2.1 milestone Jun 17, 2024
@heni02 heni02 assigned gouhongshen and w-zr and unassigned gouhongshen Jun 17, 2024
@gouhongshen
Copy link
Contributor

129 env:

150G:
heap_bulk_insert (1).out.zip

200G:
heap_bulk_insert2 (1).out.zip

@w-zr
Copy link
Contributor

w-zr commented Jun 26, 2024

目前没有进展

@w-zr
Copy link
Contributor

w-zr commented Jul 3, 2024

目前没有进展

@aressu1985 aressu1985 modified the milestones: 1.2.2, 1.3.0 Jul 8, 2024
@w-zr
Copy link
Contributor

w-zr commented Jul 9, 2024

目前没有进展

1 similar comment
@w-zr
Copy link
Contributor

w-zr commented Jul 15, 2024

目前没有进展

@w-zr
Copy link
Contributor

w-zr commented Jul 18, 2024

目前正在优化手动merge操作。

@w-zr
Copy link
Contributor

w-zr commented Jul 24, 2024

一个优化merge 内存占用的pr合进main了 我最近测一下

@w-zr
Copy link
Contributor

w-zr commented Jul 25, 2024

image
最新的main上bulk insert 100没有oom

@w-zr
Copy link
Contributor

w-zr commented Jul 25, 2024

image
最新的main上拉通跑sysbench 10w, bulk insert 1000没有OOM

@w-zr w-zr assigned w-zr and unassigned w-zr and heni02 Jul 25, 2024
@w-zr
Copy link
Contributor

w-zr commented Jul 25, 2024

后续会把#17656 合并到1.2-dev上

@w-zr
Copy link
Contributor

w-zr commented Jul 31, 2024

#17734 合并了就可以了

@w-zr w-zr assigned heni02 and unassigned w-zr Jul 31, 2024
@heni02
Copy link
Contributor Author

heni02 commented Aug 7, 2024

confirm,closed

@heni02 heni02 closed this as completed Aug 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working severity/s0 Extreme impact: Cause the application to break down and seriously affect the use
Projects
None yet
Development

No branches or pull requests

5 participants