Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG-REPORT] converting to DataFrame from an astropy Table will drop 2D columns #2445

Open
rileythai opened this issue Dec 16, 2024 · 0 comments

Comments

@rileythai
Copy link

Description
When converting from an astropy Table object, vaex will silently drop two-dimensional columns. Adding a UserWarning or successfully converting them would be a viable fix.

A min reproducible is provided below:

>>> from astropy.table import Table
>>> import vaex as vx
>>> import numpy as np
>>> data = {'foo': np.ones(100), 'bar': np.ones((100,2)), 'apple': np.zeros(100)}
>>> t = Table(data)
>>> t
<Table length=100>
  foo      bar      apple 
float64 float64[2] float64
------- ---------- -------
    1.0 1.0 .. 1.0     0.0
    1.0 1.0 .. 1.0     0.0
    ...        ...     ...
    1.0 1.0 .. 1.0     0.0
>>> vx.from_astropy_table(t)
#    foo    apple
0    1.0    0.0
1    1.0    0.0
...  ...    ...

The column bar is silently dropped.

Software information

  • Vaex versions:
{'vaex': '4.17.0',
 'vaex-core': '4.17.1',
 'vaex-viz': '0.5.4',
 'vaex-hdf5': '0.14.1',
 'vaex-server': '0.9.0',
 'vaex-astro': '0.9.3',
 'vaex-jupyter': '0.8.2',
 'vaex-ml': '0.18.3'}
  • Vaex was installed via: conda-forge
  • OS: Ubuntu 22.04.2 LTS

Additional information
Please state any supplementary information or provide additional context for the problem (e.g. screenshots, data, etc..).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant