Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance misleading - no JSON with gzip #9

Open
ChrisJefferson opened this issue Mar 10, 2016 · 4 comments
Open

Performance misleading - no JSON with gzip #9

ChrisJefferson opened this issue Mar 10, 2016 · 4 comments

Comments

@ChrisJefferson
Copy link

Why do you show vpack with gzip, but not JSON with gzip (especially as JSON tends to gzip very well)

@ChrisJefferson
Copy link
Author

I took the first file, api-docs.json, and with gzip -9, json wins! (size 99,932)

@neunhoef
Copy link
Member

Originally, we did not have compression in this table at all, because one of the most important features of VelocyPack for us is that one can access substructures efficiently without deserialising! Obviously, this does not work with compression. We have added the gzipped sizes of the compact VelocyPack because somebody asked for them.

You are right, we should also add a column for the sizes of the gzipped JSON documents. I would not be surprised if they are comparable or even smaller to the sizes of the compressed VelocyPack, since the "overhead" of JSON can be zipped relatively well. VelocyPack adds binary index tables which can probably not be zipped very well.

I'll keep this open until we got round to add the numbers.

@ChrisJefferson
Copy link
Author

I should have said, for me you could also remove the gzips (or perhaps put them in another table with an explanation).

P.S. Hi @neunhoef

@neunhoef
Copy link
Member

A different table would be an alternative approach, removing would probably make the person who asked for it unhappy.

P.S. Hi @ChrisJefferson

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants