DocumentLoaderConfig

[enoch3712]

To build:

Create a Base Configuration Class: Define a base configuration class that includes common parameters shared across different loaders.

Implement Loader-Specific Configuration Subclasses: For each DocumentLoader implementation that requires unique parameters, create a subclass of the base configuration class to include these specific settings.

Utilize Pydantic for Data Validation: Use Pydantic models to define configuration classes, ensuring data validation and easy integration.

Modify DocumentLoader to Accept Configuration Objects: Update the DocumentLoader class and its subclasses to accept a configuration object during initialization.

Standardize Configuration Access Methods: Implement standard methods or properties in the base DocumentLoader class to access configuration parameters uniformly.

Integrate Configuration Passing in Higher-Level Classes: Modify classes like Extractor and Process to accept and pass configuration objects to the appropriate DocumentLoader.