proposal: %sqlcmd profile

[edublancas]

When working with a new dataset, practitioners need to explore and summarize it quickly: column values, types, distributions, etc. We could create a %sqlcmd profile magic that produces an HTML table/report of a table. Similar to pandas-profiling, except this would run the analysis on the SQL engine, making it more scalable.

Examples:

display an embedded summary:

%sqlcmd profile --table my_table

store a report:

%sqlcmd profile --table my_table --output report.html

[edublancas]

we can start with something simple here and show the same stats that pandas.describe shows.

to display it nicely, we can use prettytable (see inspect.py for an example)