Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: (no changes) #3078

Merged
merged 0 commits into from
Dec 3, 2024
Merged

chore: (no changes) #3078

merged 0 commits into from
Dec 3, 2024

Conversation

imotai
Copy link

@imotai imotai commented Nov 1, 2024

Based on the requirements outlined in issue #3073, I believe moving all proto files to a standalone module would provide a better experience for library users.
By the way. I am one of the users.

Copy link
Contributor

@wjones127 wjones127 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Creating a new package makes sense.

However, I think instead of using a build.rs script, the ticket asks us to check in the generated files. So I think the acceptance criteria here are:

  1. No build.rs should need protoc. All the protoc files should be generated manually when the files are changed.
    • As part of this, we should be able to remove all CI job lines that require protoc. For example:
      sudo apt install -y protobuf-compiler libssl-dev
  2. There needs to be a CI job to validate that the generated protobuf definitions are in sync with the .proto files. One possibility is running the protobuf build script and then using git to see if there are any changes.

@imotai
Copy link
Author

imotai commented Nov 2, 2024

  1. Done
  2. I believe we still need build.rs to regenerate the code file whenever the protobuf file changes

@wjones127
Copy link
Contributor

I believe we still need build.rs to regenerate the code file whenever the protobuf file changes

I think as long as there is a build.rs, it will mean there is a build time dependency on protoc.

Here is a good inspiration from another project that demonstrates putting generating the protobuf artifacts in a separate script: apache/arrow-rs#3927

@loloxwg
Copy link

loloxwg commented Nov 25, 2024

Is this pull request still in progress? i am still unable to compile due to issues with protoc. @wjones127

@wjones127 wjones127 merged commit dc8f0f6 into lancedb:main Dec 3, 2024
28 of 31 checks passed
@wjones127
Copy link
Contributor

Weird that this was closed. It has zero commits.

@imotai do you still plan on working on this? If so, feel free to open a fresh PR.

@wjones127 wjones127 changed the title refactor: move all proto files to a standalone module chore: move all proto files to a standalone module Dec 3, 2024
@wjones127 wjones127 changed the title chore: move all proto files to a standalone module chore: (no changes) Dec 3, 2024
@github-actions github-actions bot added the chore label Dec 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants