Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

speed up random sample of graph engine #34088

Merged
merged 161 commits into from
Jul 13, 2021
Merged

speed up random sample of graph engine #34088

merged 161 commits into from
Jul 13, 2021

Conversation

seemingwang
Copy link
Contributor

PR types

Performance optimization

PR changes

Others

Describe

speed up graph engine sampling

seemingwang and others added 30 commits February 25, 2021 12:30
@seemingwang
graph engine demo
9d24726
@seemingwang
upload unsaved changes
7753f38
@seemingwang
fix dependency error
5fa66ab
@seemingwang
fix shard_num problem
3e12386
@seemingwang
py client
acacce0
@seemingwang
remove lock and graph-type
3f32bf1
@Yelrose
Merge pull request #2 from seemingwang/develop
dda5291 
Merge Graph Engine
@Yelrose
add load direct graph
44df9ac
@Yelrose
add load direct graph
c8e67b8
@Yelrose
add load direct graph
7320994
@WeiyueSu
batch random_sample
f4ea973
@WeiyueSu
batch_sample_k
492e551
@WeiyueSu
fix num_nodes size
193203f
@WeiyueSu
batch brpc
b55bf42
@WeiyueSu
batch brpc
102ae95
@WeiyueSu
add test
3106b2a
@WeiyueSu
add test
51ed7d8
@seemingwang
Merge pull request #1 from Yelrose/develop
94025b9 
Add Simple Loading for Direct Graph
@Yelrose
add load_nodes; change add_node function
e087485
@Yelrose
Merge pull request #3 from seemingwang/develop
455e2a0 
Merge pull request #1 from Yelrose/develop
@seemingwang
change sample return type to pair
c588c96
@Yelrose
merge
391b8e5
@Yelrose
resolve conflict
2dc7ebf
@Yelrose
Merge branch 'develop' of https://github.com/Yelrose/Paddle into develop
f1ea3ac
@Yelrose
resolved conflict
e359135
@Yelrose
resolved conflict
a4e8939
@Yelrose
resolved conflict
290840f
@seemingwang
separate server and client
d98be69
@WeiyueSu
merge pair type
db6ee86
@Yelrose
resolved conflict
550a23f
seemingwang and others added 22 commits April 1, 2021 08:31
@seemingwang
fix code problems by reviewers' suggestions
0f85b95
@seemingwang
move graph files into a folder
2afea69
@seemingwang
resolve conflicts
ceebbf9
@seiriosPlus
Merge branch 'develop' into develop
a537778
@seemingwang
code style change
06c6c9b
@seemingwang
remove graph operations from base table
f291ea0
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
d4d4e1a
@seemingwang
optimize get_feat function of graph engine
59fa614
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
7f5c835
@seemingwang
fix long long count problem
faadcba
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
618b7ce
@seemingwang
remove redandunt graph files
7ced015
@seemingwang
remove unused shell
20023e9
@seemingwang
resolve conflict
df5c83c
@seemingwang
recover dropout_op_pass.h
e9a718d
@seemingwang
Merge remote-tracking branch 'upstream/develop' into develop
da7be7d
@seemingwang
fix potential stack overflow when request number is too large & node …
5b07c6c 
…add & node clear & node remove
@Liwb5
when sample k is larger than neigbor num, return directly
d66d648
@Liwb5
using random seed generator of paddle to speed up
2037c51
@seemingwang
Merge pull request #18 from Liwb5/engine2.0
fc74f83 
speed up graph neighbors sampling
@Liwb5
fix bug of random sample k
d743606
@seemingwang
Merge pull request #19 from Liwb5/engine2.0
0a4a081 
fix bug of random sample k
@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

yaoxuefeng6
yaoxuefeng6 approved these changes Jul 13, 2021
View reviewed changes
Copy link
Contributor

@yaoxuefeng6 yaoxuefeng6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yaoxuefeng6 yaoxuefeng6 merged commit 9e32a38 into PaddlePaddle:develop Jul 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yaoxuefeng6 yaoxuefeng6 yaoxuefeng6 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@seemingwang @yaoxuefeng6 @Yelrose @WeiyueSu @Liwb5 @seiriosPlus