Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel cl #616

Closed
wants to merge 6 commits into from
Closed

Parallel cl #616

wants to merge 6 commits into from

Conversation

rsbivand
Copy link
Member

This indicates the code that generated the output in the issue, but isn't finished - st_union.sfg probably shouldn't be there - the st_union.sfc shows the bare-bones parallel approach.

@rsbivand rsbivand mentioned this pull request Jan 15, 2018
@rsbivand
Copy link
Member Author

Changed case to binary union. Question - how to tell roxygen to add parallel to Suggests:?

@LDalby
Copy link

LDalby commented Jan 16, 2018

@rsbivand: If you are using devtools I think this line should do it:
devtools::use_package("parallel", "Suggests")

@edzer
Copy link
Member

edzer commented Jan 16, 2018

Currently, DESCRIPTION is manually maintained.

@rsbivand
Copy link
Member Author

Corrected socket parallel using trick from boot::boot to realize the y promise. Added internal timing - the parallel approaches using mclapply and parLapply are viable, but for the test case (see issue #611) with a 0.5GB output object and 80000 union objects, catenating the output is the main source of time cost.

@edzer edzer closed this Dec 30, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants