Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Support Tensors ? #433

Closed
BambOoxX opened this issue May 2, 2023 · 5 comments
Closed

[Feature Request] Support Tensors ? #433

BambOoxX opened this issue May 2, 2023 · 5 comments

Comments

@BambOoxX
Copy link

BambOoxX commented May 2, 2023

I see in the documentation that there is currently no support of tensors.
I tried to check why it was so, but could not find a previous discussion about this.
Is it still not planned ?

If I can be of help (not sure I can do much though) please tell me where I could start.

@Moelf
Copy link
Contributor

Moelf commented May 3, 2023

isn't it just dense n-dimensional array? have you tried? since Julia supports n-d array natively I don't imagine there's anything super special

@BambOoxX
Copy link
Author

BambOoxX commented May 3, 2023

Yes I guess it is just n-dimensional arrays, but these seem to be called tensors in the Arrow vocabulary.
I don't think there should be anything fancy about this either, however it does (as advertised) not work.

As an example, doing

using Arrow
mat = rand(10,20,30)
Arrow.write("foo.bar",(mat=mat,)) # does not work
Arrow.write("foo.bar",(vec=mat[:,1,1],)) # works

@Moelf
Copy link
Contributor

Moelf commented May 3, 2023

Arrow.write("foo.bar",(mat=mat,)) # does not work

this doesn't make sense, your column needs to be a collection, it can't be a single tensor.


I tried

Arrow.write("foo.bar",(mat=[mat],))

and it works in terms to successfully written to disk, but the shape information is lost.

@BambOoxX
Copy link
Author

BambOoxX commented May 3, 2023

Arrow.write("foo.bar",(mat=mat,)) # does not work

this doesn't make sense, your column needs to be a collection, it can't be a single tensor.

Ah yes my bad, in a way I think I misunderstood the Arrow format capabilities. But now I get the point

@quinnj
Copy link
Member

quinnj commented Jun 9, 2023

Duplicate of #187

@quinnj quinnj marked this as a duplicate of #187 Jun 9, 2023
@quinnj quinnj closed this as completed Jun 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants