Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix "zed dev vcache copy" #4950

Merged
merged 1 commit into from
Dec 22, 2023
Merged

Fix "zed dev vcache copy" #4950

merged 1 commit into from
Dec 22, 2023

Conversation

nwt
Copy link
Member

@nwt nwt commented Dec 20, 2023

Do that by plugging some holes left by #4925.

  • In runtime/vcache/ztests/, re-enable skipped "zed dev vcache copy" tests.

  • In cmd/zed/dev/vcache/copy.Command.Run, resurrect the call to zio.Copy.

  • In package runtime/vcache:

    • Resurrect the Reader type and update its Read method.

    • Resurrect Object.NewReader.

    • Add loader type to hold the *zed.Context needed when loading a vector of type values.

    • Convert existing loadXXX functions to loader methods.

    • In loadArray, fix bad nil argument to loadVector.

    • In loadMap, load lengths vector.

    • In loadNulls, create slots slice and load values vector.

    • In loadPrimitive, remove null handling (vector.Nulls now does that) and add support for missing Zed types (float16, float32, float64, bytes, ip, net, and type).

    • In loadRecord, load all fields when no specific path is requested.

    • In loadUnion, load tags vector.

    • In loadVector, assign to *any when loading a constant vector.

  • In package vector:

    • Add missing Byte, Float, IP, Net, and Type types.

    • Add missing length field to Map type.

    • Add missing tags field to Union type.

    • Implement NewBuilder method for Array, Map, and Union types.

    • Handle nulls for all vector types by replacing the Nullmask type with Nulls, which wraps a vector.Any.

Do that by plugging some holes left by #4925.

* In runtime/vcache/ztests/, re-enable skipped "zed dev vcache copy"
  tests.

* In cmd/zed/dev/vcache/copy.Command.Run, resurrect the call to
  zio.Copy.

* In package runtime/vcache:

  * Resurrect the Reader type and update its Read method.

  * Resurrect Object.NewReader.

  * Add loader type to hold the *zed.Context needed when loading
    a vector of type values.

  * Convert existing loadXXX functions to loader methods.

  * In loadArray, fix bad nil argument to loadVector.

  * In loadMap, load lengths vector.

  * In loadNulls, create slots slice and load values vector.

  * In loadPrimitive, remove null handling (vector.Nulls now does
    that) and add support for missing Zed types (float16, float32,
    float64, bytes, ip, net, and type).

  * In loadRecord, load all fields when no specific path is requested.

  * In loadUnion, load tags vector.

  * In loadVector, assign to *any when loading a constant vector.

* In package vector:

  * Add missing Byte, Float, IP, Net, and Type types.

  * Add missing length field to Map type.

  * Add missing tags field to Union type.

  * Implement NewBuilder method for Array, Map, and Union types.

  * Handle nulls for all vector types by replacing the Nullmask
    type with Nulls, which wraps a vector.Any.
@nwt nwt requested a review from a team December 20, 2023 17:30
@nwt nwt merged commit ec5165f into main Dec 22, 2023
3 checks passed
@nwt nwt deleted the fix-vcache-copy branch December 22, 2023 13:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants