Skip to content

Commit

Permalink
Merge pull request #113 from weekenthralling/main
Browse files Browse the repository at this point in the history
docs: add component clarification
  • Loading branch information
edwardzjl authored Nov 26, 2024
2 parents 12a5000 + fe5d26c commit ca55e5d
Showing 1 changed file with 9 additions and 0 deletions.
9 changes: 9 additions & 0 deletions docs/howto/normalize-datasets.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,15 @@
"- **Empty or Placeholder Rows:** Extra rows with missing or irrelevant data can complicate data loading and analysis."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"> **!!! Note:** When the `tablegpt-agent` enables the `Dataset Normalizer` to format the dataset, the dataset reading process will be noticeably slower. This is because the `Dataset Normalizer` needs to analyze the dataset and generate transformation code, a process that takes considerable time. \n",
">\n",
"> **It is worth noting that the data normalization process can effectively address most common data irregularities. However, for more complex datasets, further optimization may be needed, and the results depend on the specific normalization model used.**"
]
},
{
"cell_type": "markdown",
"id": "bc22a838",
Expand Down

0 comments on commit ca55e5d

Please sign in to comment.