Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added table serializers operators and add Wikitq table question answering dataset #544

Merged
merged 4 commits into from
Feb 1, 2024

Conversation

csrajmohan
Copy link
Collaborator

Table serializers convert a given table into a flat sequence with special symbols. This data preparation step is essential for running tabular data tasks with LLMs. As part of this PR,

  • Created base class for Table serializers and added 2 main table serializers(Indexed Row major, Markdown) as new Unitxt operators.
  • Added a new task card for WikiTableQuestions(wikitq) dataset and validated the serializer operators with table input.

Copy link

codecov bot commented Feb 1, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (099c601) 93.93% compared to head (31784ae) 93.93%.
Report is 2 commits behind head on main.

❗ Current head 31784ae differs from pull request most recent head 37b24a2. Consider uploading reports for the commit 37b24a2 to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #544   +/-   ##
=======================================
  Coverage   93.93%   93.93%           
=======================================
  Files         207      207           
  Lines        8009     8009           
=======================================
  Hits         7523     7523           
  Misses        486      486           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@elronbandel elronbandel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done great contribution!

@elronbandel elronbandel changed the title Added Table Serializers Added table serializers operators and add Wikitq table question answering dataset Feb 1, 2024
@elronbandel elronbandel merged commit ce5a0a3 into main Feb 1, 2024
4 checks passed
@csrajmohan csrajmohan deleted the table_serializers branch February 1, 2024 17:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants