feat: Add support to handle Parquet Dataset files via data config

[Abhishek-TAMU]

Description of the change

Adding changes to enable loading of Parquet Dataset files by datasets.load_dataset

Related issue number

#1469

How to verify the PR

Testing with Parquet file

python tuning/sft_trainer.py  \
--model_name_or_path Maykeye/TinyLLama-v0  \
--training_data_path tests/artifacts/testdata/twitter_complaints_input_output.parquet \
--output_dir outputs/full-tuning  \
--num_train_epochs 5  \
--per_device_train_batch_size 2  \
--gradient_accumulation_steps 1  \
--learning_rate 1e-5  \
--use_flash_attn false \
--torch_dtype "float32"

Was the PR tested

• I have added >=1 unit test(s) for every new method I have added.
• I have ensured all unit tests pass

[github-actions]

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.

[github-actions]

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.

[github-actions]

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.

[dushyantbehl]

LGTM thanks @Abhishek-TAMU