Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional constructors for external sort classes. #4928

Merged
merged 1 commit into from
May 1, 2024

Conversation

lums658
Copy link
Contributor

@lums658 lums658 commented May 1, 2024

This PR is stacked on #4925. It adds additional constructors for the two view classes for var length data.

The previous implementations had constructors that just took input ranges, and constructed a var length view over the data specified by those ranges. However, in general, we may have a range that is not completely filled with data, and so may need to specify the data to be viewed in some other way. The complete set of constructors take

  • ranges for data and offsets (arrow format) - the size of the resulting view is one less than the size of the offset range
  • ranges plus sizes for data and offsets (arrow format) - the size of the resulting view is one less than the size given for the offset range
  • iterator pairs for data and offsets (arrow format) - the size of the resulting view is one less than the difference between end and begin of the offsets pair
  • iterator pairs for data and offsets, with sizes (arrow format) - the size of the resulting view is one less than the size given for the offset range
  • ranges for data and offsets (tilledb format) - the size of the resulting view is equal to the size of the offset range (takes an extra argument for last offset value)
  • ranges plus sizes for data and offsets (tiledb format) - the size of the resulting view is equal to the size given for the offset range (takes an extra argument for last offset value)
  • iterator pairs for data and offsets (tiledb format) - the size of the resulting view is equal to the difference between end and begin of the offsets pair (takes an extra argument for last offset value)
  • iterator pairs for data and offsets, with sizes (tiledb format) - the size of the resulting view is equal than the size given for the offset range (takes an extra argument for last offset value)

[sc-44576]


TYPE: NO_HISTORY
DESC: Additional constructors for external sort classes.

This PR is stacked on #4925.  It adds additional constructors for the two view classes for var length data.

The previous implementations had constructors that just took input ranges, and constructed a var length view over the data specified by those ranges.  However, in general, we may have a range that is not completely filled with data, and so may need to specify the data to be viewed in some other way.  The complete set of constructors take
* ranges for data and offsets (arrow format) - the size of the resulting view is one less than the size of the offset range
* ranges plus sizes for data and offsets (arrow format) - the size of the resulting view is one less than the size given for the offset range
* iterator pairs for data and offsets (arrow format) - the size of the resulting view is one less than the difference between end and begin of the offsets pair
* iterator pairs for data and offsets, with sizes (arrow format) - the size of the resulting view is one less than the size given for the offset range
* ranges for data and offsets (tilledb format) - the size of the resulting view is equal to the size of the offset range (takes an extra argument for last offset value)
* ranges plus sizes for data and offsets (tiledb format) - the size of the resulting view is equal to the size given for the offset range (takes an extra argument for last offset value)
* iterator pairs for data and offsets (tiledb format) - the size of the resulting view is equal to the difference between end and begin of the offsets pair (takes an extra argument for last offset value)
* iterator pairs for data and offsets, with sizes (tiledb format) - the size of the resulting view is equal than the size given for the offset range (takes an extra argument for last offset value)

---
TYPE: NO_HISTORY
DESC: Additional constructors for external sort classes.
@KiterLuc KiterLuc force-pushed the al/additional-constructors/ch44576 branch from 785becd to fb28835 Compare May 1, 2024 16:06
@KiterLuc KiterLuc merged commit 3a88d3c into dev May 1, 2024
59 checks passed
@KiterLuc KiterLuc deleted the al/additional-constructors/ch44576 branch May 1, 2024 18:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants