Benchmarking & Visualization

[WenheLI]

We should track the building, execution, and installing time for every release and visualize them.
This could give us a clear clue on what is improved and what could be improved in the future release.

We can refer to deno's benchmark.

[yorkie]

We need a website to show our benchmark firstly :)

[WenheLI]

We need a website to show our benchmark firstly :)

This could be done via vercel?

[yorkie]

That's cool!

[WenheLI]

Just one thing comes into my mind, how should store the benchmark data?

[yorkie]

in JSON or other formats? It depends on what benchmark framework that we choose :)

[WenheLI]

in JSON or other formats? It depends on what benchmark framework that we choose :)

My concern is how to make persistent storage(DB)? Vercel is essentially a serverless provider which means every time we restart the container, we will lose the previous data. Therefore, persistent storage will help us keep tracks on all data.

[yorkie]

How does deno resolve this problem?

[WenheLI]

How does deno resolve this problem?

Deno seems to put benchmark data under a github repo. We can do host such a repo under imgcook.