backend: de-pandasify most of it

[JulienPeloton]

For convenience (or lazyness), we format straight the data coming from the HBase client (mostly nested dictionaries or arrays) into Pandas DataFrame. This has the advantage to make the data processing easy to understand and maintain, but it largely impacts performances.

It is now time to redesign low-level routines to use more efficient data structures.