create a python script for quagga_parse

[brunoerg]

Instead of donwloading a lib like libbgpdump and calling it with a sh script, we could have a Python script to do the same work.

[dunxen]

Concept ACK

Running it against dumps currently.

[sipa]

Should we support V1 tables too? I vaguely recall seeing such dumps too.

[brunoerg]

I only added support for V1 tables because I realized bgpdump does it as well but I can drop it. Realized just one of the dumps was V1.

[sipa]

I believe the dumps can contain other entries besides just v1 and v2 table dumps. Does the BGPDump package already filter those out, or should we be explict?

[brunoerg]

I think it already filter them.

[brunoerg]

    @property
    def routeEntries(self):

        if self._routeEntries is not None:
            return self._routeEntries
        self._routeEntries = []
        for i in range(0, self.body.entry_count):
            self._routeEntries.append(TableDumpV2RouteEntry(self.bgp, self.body.entries[i]))
        return self._routeEntries

[sipa]

Actually, I'm kind of confused about the state of the software here. I'm not sure I was using any of the code in the remote_dumps/ directory. I wrote my own download script in the construct/ directory, and a more advanced bottleneck constructing one in bottleneck.py.

[brunoerg]

Actually, I'm kind of confused about the state of the software here

I feel the same haha. Seems like this project is the best fit to move asmap stuff forward, but it seems hard to contribute since there is a lack of documentation and project management. I'm willing to help manage this if you want.

[sipa]

@brunoerg Please do!

Feel free to reuse whatever is usable anywhere in the repo. I think that I was using:

• To download dumps, the code in construct/construct.py.
• For converting dump files to human-readable dumps, either the bgpdump command-line tool, or bgpdump.py (I vaguely remember the latter being too slow, but unsure). If your quagga_parse.py is sufficiently fast to be usable, so much the better.
• The bottleneck.py script to convert (sets of) human-readable dumps into a text file with iprange->asn mappings.
• The asmap-cli.py tool to convert those mappings into binary asmap files.

[brunoerg]

Thanks, @sipa! I'm gonna move it forward!