feat: enable context flag and add context paragraph limit on chatgpt …

[mkXultra]

1. A new constant CONTEXT_PARAGRAPH_LIMIT has been added with a default value of 3.

2. The ChatGPTAPI constructor now accepts two new parameters:

   • context_flag: A boolean to enable/disable context preservation.
   • context_paragraph_limit: An integer to set the maximum number of paragraphs to keep in context.

3. New instance variables have been added to store context:

   • self.context_flag
   • self.context_list
   • self.context_translated_list
   • self.context_paragraph_limit

4. The create_chat_completion method has been modified to include context in the messages when context_flag is True.

5. A new save_context method has been added to manage the context lists, ensuring they don't exceed the specified limit.

6. The get_translation method now calls save_context when context_flag is True.

[yihong0618]

why we use global var here since it can set by user.

[mkXultra]

@yihong0618

Thank you for your question about the global variable CONTEXT_PARAGRAPH_LIMIT.
This global variable is used because it serves as a default value across multiple classes in the system, particularly in the EPUBBookLoader class.

The EPUBBookLoader class initializes context_paragraph_limit with a default value of 0:

python
class EPUBBookLoader(BaseBookLoader):
def init(
self,
# ... other parameters ...
context_paragraph_limit=0,
):
# ...

When this value (0) is passed to the ChatGPTAPI class, it triggers the use of the global CONTEXT_PARAGRAPH_LIMIT as a fallback:

python
if context_paragraph_limit > 0:
self.context_paragraph_limit = context_paragraph_limit
else:
self.context_paragraph_limit = CONTEXT_PARAGRAPH_LIMIT

This design allows for a consistent default value across the application while still providing flexibility for users to override it when necessary. It also maintains backwards compatibility with existing code that may not explicitly set this parameter.

That being said, if you have any suggestions for a better implementation that maintains the current functionality while reducing global variable usage, I'd be more than happy to consider and potentially implement it. I appreciate your keen eye for code quality and welcome any ideas that could enhance the codebase.

[yihong0618]

make sense thank you very much for the contribution and the kind explanation