Funnels reorganization, persons pagination, and conversion window support

[buwilliams]

Changes

• Reorganize code structure for funnels to support differences between queries and formats
• GenerateLocal class to generate data for local development
• microseconds_from_days to convert days to microseconds
• Handle conversion window for funnels
• If offset > 0 use new SQL to fetch offset list of persons

GenerateLocal Usage

Open django shell with Clickhouse environment variables

from ee.clickhouse.generate_local import GenerateLocal
g = GenerateLocal()
g.generate()

You can also cleanup the data with but you'll need to drop the Clickhouse db manually.

g.destroy()

[EDsCODE]

Comment below + backend tests. Otherwise looks good

[neilkakkar]

This seems to be the opposite of what it should be?

I.e., bulk querying uses the bulk API (which gains the advantage of querying in bulk), while the single query makes a call to the bulk end point with a list of one item.

https://docs.djangoproject.com/en/3.2/ref/models/querysets/#in-bulk - in_bulk achieves this, I think.

[buwilliams]

This was a quick pass but I'll be refactoring with ejecting to SQL for best performance. Just trying to get it out the door quickly.

[EDsCODE]

🚀