Periods in column names cause page to go blank

[beautah]

If a data frame column has a period in the name, as in 'meta.site_id' the rendered page goes blank as soon as you click on that column. No errors logged, just blank screen.

dtale 1.7.3
pandas 0.25.1

``

[aschonfeld]

@beautah good catch! I've been meaning to fix that. We saw it when using pd.read_json and if you had JSON objects multiple levels deep it concatenates them with periods in the column name. Thus causing the same issue.

Would you be alright with me simply replacing any periods in column names underscores?

[beautah]

Ha, that's exactly what I did, that's hilarious. I even started digging in to figure out where to make a pull request, didn't find it right off the bat. Yes, its a simple elegant, perhaps brilliant solution. Great project btw, I'll see if I can help out.

…

On Fri, Feb 14, 2020 at 9:22 AM Andrew Schonfeld ***@***.***> wrote: @beautah <https://github.com/beautah> good catch! I've been meaning to fix that. We saw it when using pd.read_json and if you had JSON objects multiple levels deep it concatenates them with periods in the column name. Thus causing the same issue. Would you be alright with me simply replacing any periods in column names underscores? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#63?email_source=notifications&email_token=ABO6OL4DAPJP2W3X645NENLRC3ANFA5CNFSM4KVLE6O2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELZSQGQ#issuecomment-586360858>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABO6OL4FX4FW4L4UEFIWEYTRC3ANFANCNFSM4KVLE6OQ> .

[aschonfeld]

I'll let you know when the fix is in. For the time being I think theres a sep argument you can set in pd.json_normalize

[jboscolo]

I think I am having the same problem with '#' in the column name. I don't think the problem is limited to periods :)

[aschonfeld]

@jboscolo, thanks for the heads up! I’m working on a release which includes the other fix. I’ll include this as well and dig into what other characters pandas doesnt like.

[aschonfeld]

So it looks like pandas has actually solved this issue, but it won't be available until the release of 1.1.0 commit|issue

that being said, I have found a possible work around that will allow me to not remove special characters (https://stackoverflow.com/questions/40045545/pandas-query-string-where-column-name-contains-special-characters)

[aschonfeld]

Fixed this in v.1.7.5. I ended up using this solution which will only work in Python3 and eventually when pandas does a new release it will handle this problem for us. Once that happens I'll make this code be conditional on that version of pandas being used.