Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

netloc: new design #1

Merged
merged 118 commits into from
Oct 26, 2016
Merged

netloc: new design #1

merged 118 commits into from
Oct 26, 2016

Conversation

rools32
Copy link

@rools32 rools32 commented Oct 25, 2016

The code of Netloc was simplified and cleaned up, with new data types. The main netloc API isn't installed during make install since it may still change in the future. Tools were reorganized under utils/netloc/. A draw tool was added to visualize a topology in a web browser (under utils/netloc/draw/). Netloc can interact with the Scotch partitioning tool by creating Scotch "architectures" from the network topology, and by generating a rank file for MPI from a Scotch mapping. This is the only part of the netloc API that is already public and installed during make install (when scotch is detected).

mark-mb and others added 2 commits October 25, 2016 10:38
Just needs to disable openat() which doesn't seem allowed inside APK.
@bgoglin bgoglin changed the title New design of netloc netloc: new design Oct 25, 2016
This tool permits to show a network in a web browser. This is still a
beta version, only for tests.
The nodes can be displayed in different colors depending on the topology
found by hwloc.
When saved to json, if gbits is a float, it is not saved as a string (it
is the case with int). The problem was solved by converting gbits into a
string.
The partition index is used instaed of the pointer.
Better colors, and different sizes for nodes.
And bandwidth added in node info.
cbordage and others added 25 commits October 25, 2016 22:31
Theses problems were memory leaks or so in case of error (for instance
in a read file).
When we sort the hash tables, we do not use anymore pointer arithmetic
that will have different results on different runs.
The tests have been updated to fit the new sort method.
On some machines errno is not set to 0 and since getline returns -1 when
EOF it fails.
The new functions permit to build Scotch architectures from the machine or
the sub-machine.
netloc.pc and netloc*.h aren't needed since the netloc API isn't public yet.

But netloc.h is needed when netlocscotch API is enabled.
It's not directly used yet, but applications will need it for checking netlocscotch error codes.
@bgoglin bgoglin merged commit 0b94a3f into bgoglin:master Oct 26, 2016
bgoglin added a commit that referenced this pull request Oct 26, 2016
netloc: new design

The code of Netloc was simplified and cleaned up, with new data types.
The main netloc API isn't installed during make install since it may
still change in the future.

Tools were reorganized under utils/netloc/. A draw tool was added to
visualize a topology in a web browser (under utils/netloc/draw/).

Netloc can interact with the Scotch partitioning tool by creating
Scotch "architectures" from the network topology, and by generating
a rank file for MPI from a Scotch mapping. This is the only part of
the netloc API that is already public and installed during make install
(when scotch is detected).
bgoglin added a commit that referenced this pull request Oct 26, 2016
netloc: new design

The code of Netloc was simplified and cleaned up, with new data types.
The main netloc API isn't installed during make install since it may
still change in the future.

Tools were reorganized under utils/netloc/. A draw tool was added to
visualize a topology in a web browser (under utils/netloc/draw/).

Netloc can interact with the Scotch partitioning tool by creating
Scotch "architectures" from the network topology, and by generating
a rank file for MPI from a Scotch mapping. This is the only part of
the netloc API that is already public and installed during make install
(when scotch is detected).

Signed-off-by: Brice Goglin <Brice.Goglin@inria.fr>
bgoglin added a commit that referenced this pull request Mar 16, 2018
On a 4-core machine with #2 offline, we want x86 to look at all 4 cores,
so that we get info for all online ones (#1, #3 and #4).
Before this commit, x86 would only look at the 3 first ones
(just like if the offline PUs were always at the end of the range).

At least Linux and Solaris can put some CPUs offline in the middle of the index range.
So ask hwloc_fallback_nbprocessors() to get the number of existing CPUs.

Signed-off-by: Brice Goglin <Brice.Goglin@inria.fr>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants