unsupported ARROW:extension:name type: "JuliaLang.Nothing"
#132
Comments
|
Ok, on the #156 PR, this now works for me: using AnalyzeRegistry, Arrow
const NAME = Symbol("JuliaLang.AnalyzeRegistry.Package")
ArrowTypes.arrowname(::Type{AnalyzeRegistry.Package}) = NAME
ArrowTypes.JuliaType(::Val{NAME}, S) = AnalyzeRegistry.Package
save(path, packages) = Arrow.write(path, (; packages))
load(path) = copy(Arrow.Table(path).packages)
auth = AnalyzeRegistry.github_auth(personal_token)
results = analyze(find_packages("DataFrames", "Flux"); auth=auth);
save("packages.arrow", results)
res = load("packages.arrow") |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I ran into a weird situation where I saved an arrow table consisting of a single column of one custom type on one computer (WSL 2 on windows if it matters), then deserialized on another (M1 macbook with Julia running on rosetta), registering the type each time, and I got a bunch of warnings
followed by a related error (
ERROR: MethodError: Cannotconvertan object of type NamedTuple{(), Tuple{}} to an object of type Symbol).I believe I used Arrow 1.2.4 in each case. Manually defining
then led to the deserialization succeeding (without warnings or errors, and the table seems correct).
When I try serializing and deserializing the exact same type with the exact same setup locally to produce a MWE, I don't get this error. The actual table is here: https://www.icloud.com/iclouddrive/0fFusdT5pfUior3qaXJ5u3uxA#all_pkgs_results (3 MB). The code to load it is the following:
Here's the output I get:
As I said before, manually defining how to deserialize
Nothinggives the right results. Also if you don't registerPackageat all, you correctly get a vector of NamedTuple's.(By the way, it's a nice table-- info for every package in the general registry. Fun fact: there are 6.9M lines of Julia-language source code in General!).
The text was updated successfully, but these errors were encountered: