Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pkg/stanza] Rename tokenize package to split #26540

Closed

Conversation

djaglowski
Copy link
Member

Another subset of #26241.

This renames the tokenize package to split. The tokenize package was created by isolating several related concerns into a single package. However, at this point, each of those concerns has been moved into a very specific package. e.g. decode, flush, trim, split.

What remains of the tokenize package is only concerned with split functions, so the name is more appropriate going forward. Future PRs will rename some of the structs and functions in and relating to this package.

@djaglowski djaglowski marked this pull request as ready for review September 8, 2023 16:45
@djaglowski djaglowski requested a review from a team September 8, 2023 16:45
dmitryax
dmitryax previously approved these changes Sep 11, 2023
@dmitryax dmitryax dismissed their stale review September 11, 2023 18:28

Would like to see #26544 approved as well before merging this

djaglowski added a commit that referenced this pull request Sep 11, 2023
Subset of #26241 

Follows #26540 

- Rename `MultilineConfig` to `split.Config`
- Remove `Multiline`, previously a struct representation that only
wrapped a split func
- Remove `NewMultilineConfig`, because `split.Config` is just two simple
fields with "" defaults.
- Condense references in tests
- Substantially increate test coverage in `split` package.
@djaglowski
Copy link
Member Author

Merged as part of #26544

@djaglowski djaglowski closed this Sep 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants