Webviz on remote bag

[NicolasBernard456]

Hello,

Thanks for your amazing work!
I was wondering if i could get some more infos on how to use webviz on remote bags? I saw that it was possible to do it with a cloud provider like S3 or GCS https://github.com/cruise-automation/webviz/blob/master/packages/webviz-core/src/dataProviders/BrowserHttpReader.js
I have a custom NAS where my bags are stored and I am using Marv as a bag management platform. I wanted to generate link like this to have a complete view of the bags. Can you give me some advices on how to proceed?

If this appears to be too harsh to setup, is there a way to generate an url to have a view of one local bag instead of drag/dropping it?

Best regards,
Nicolas

[janpaul123]

Hi! I don't know much about MARV. Is it able to provide URLs that link to bags, e.g. like https://open-source-webviz-ui.s3.amazonaws.com/demo.bag? If so, then it might just be a matter of configuring their webserver to support CORS and HTTP Range Requests.

I'm trying their demo now, but can't seem to download bag files. E.g. if I click on the bag file link in https://ternaris.com/marv-robotics/demo/#/detail/sdcokcphyel4i52ggeemts33ly then Chrome shows me an "ERR_INVALID_RESPONSE" error. Any idea what might be going on? It would be cool to perhaps make a contribution to MARV to add an "open in Webviz" link.

[janpaul123]

If this appears to be too harsh to setup, is there a way to generate an url to have a view of one local bag instead of drag/dropping it?

Oh I forgot to answer this question. The browser does not have direct access to the file system (for security reasons), so we can't access arbitrary files through a URL. They have to be explicitly selected by the user, either by drag and drop or through a file selection dialog (which is very similar to drag and drop so we didn't bother implement that).

[stefan-enway]

you could try to put https://min.io/ in front of your NAS as it acts as a S3 compatible storage layer.

[NicolasBernard456]

Thank for your answers!
@janpaul123: MARV can provide URLs that link to bag, i've tried it locally it works fine :) I'm not sure why the demo is not working though... I'll try to configure the webserver as you said!

@stefan-enway: Thanks, i'll look into it if I struggle too much setting up the webserver :)

[NicolasBernard456]

I managed to use flask_cors as MARV is implemented in python. I think I got the correct configuration, here is the response header using Postman :

But I still have this error on my console :

I also tried putting http://webviz.io as the origin or localhost:8080 as the origin(and building and running locally) but I'm getting the same result :(

Maybe I am missing something?

[janpaul123]

Looks like CORS headers are not set properly for OPTIONS requests (CORS preflight), try seeing what you get in postman if you make an OPTIONS request.

[stefan-enway]

@NicolasBernard456
docker run -p 9000:9000 -v /mnt/data:/data minio/minio server /data
plus another for nginx with TLS proxy & all the CORS/proxy tuning.
I even automated the letencrypt part for "offical" certs ;)

[NicolasBernard456]

@janpaul123
This is what I get :

[NicolasBernard456]

@stefan-enway Got this error when using min.io

on console :

I tried drag and dropping that bag, it worked fine.. :/

[stefan-enway]

please run curl -H "Access-Control-Request-Method: GET" -H "Origin: http://localhost" --head http://www.google.com replace google with your URI.
and please just copy&paste the output in text (maybe with `` enclosing)

[stefan-enway]

and get an nginx somewhere and look at https://enable-cors.org/server_nginx.html. beware that * is a wildcard for everywhere, but if you use it on a local VM/network you should be fine.

[janpaul123]

@janpaul123
This is what I get

Right so if in that case Access-Control-Allow-Origin and Access-Control-Expose-Headers are missing, then that is the issue!

[NicolasBernard456]

Thanks for your help, I added those headers and it's working now!

[janpaul123]

@NicolasBernard456 any chance you could share your final solution? Would be cool to contribute this back to MARV, too! 😄