[Fix] Unify dataclasses under a types.py for ease #80
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request focuses on refactoring the
Chonkie
package by moving several dataclass definitions to a newtypes
module and updating the imports across various files accordingly. The most important changes include the relocation of dataclasses, the update of imports, and the addition of new attributes to certain classes.Refactoring and code organization:
src/chonkie/__init__.py
: MovedContext
,SemanticSentence
,Sentence
,Chunk
,SentenceChunk
, andSemanticChunk
imports to the newtypes
module.src/chonkie/chunker/__init__.py
: Updated imports to reflect the relocation ofChunk
,SemanticChunk
,SemanticSentence
, andSentence
to thetypes
module.src/chonkie/chunker/base.py
: Removed theChunk
dataclass and imported it from thetypes
module instead.src/chonkie/types.py
: Added a new module to house theContext
,Chunk
,Sentence
,SentenceChunk
,SemanticSentence
, andSemanticChunk
dataclasses.Class and method updates:
src/chonkie/chunker/sentence.py
: Added a new attributeuse_approximate
to theSentenceChunker
class and updated the constructor to include this attribute. [1] [2]Test updates:
Chunk
andSemanticChunk
from the newtypes
module. [1] [2] [3]