[INLONG-9788][Sort] Supports data parse that contains delimiters in kv and csv data format

[baomingyu]

• Fixes [Feature][Sort] Supports data parse that contains delimiters in kv and csv data content #9788

[aloyszhang]

I found that we already have several tests for splitKv or splitCsv

https://github.com/apache/inlong/blob/master/inlong-sort/sort-formats/format-rowdata/format-rowdata-kv/src/test/java/org/apache/inlong/sort/formats/kv/KvUtilsTest.java

https://github.com/apache/inlong/blob/master/inlong-sort/sort-formats/format-row/format-kv/src/test/java/org/apache/inlong/sort/formats/kv/KvUtilsTest.java

https://github.com/apache/inlong/blob/master/inlong-sort/sort-formats/format-row/format-csv/src/test/java/org/apache/inlong/sort/formats/csv/CsvUtilsTest.java

Is it necessacery to add a new test class?

[baomingyu]

I found that we already have several tests for splitKv or splitCsv

https://github.com/apache/inlong/blob/master/inlong-sort/sort-formats/format-rowdata/format-rowdata-kv/src/test/java/org/apache/inlong/sort/formats/kv/KvUtilsTest.java

https://github.com/apache/inlong/blob/master/inlong-sort/sort-formats/format-row/format-kv/src/test/java/org/apache/inlong/sort/formats/kv/KvUtilsTest.java

https://github.com/apache/inlong/blob/master/inlong-sort/sort-formats/format-row/format-csv/src/test/java/org/apache/inlong/sort/formats/csv/CsvUtilsTest.java

Is it necessacery to add a new test class?

All existing tests are tests of data in kv and csv formats that combine expected rules. The new ones are scenarios that can parse data in kv and csv formats that do not comply with the rules.

[aloyszhang]

All existing tests are tests of data in kv and csv formats that combine expected rules. The new ones are scenarios that can parse data in kv and csv formats that do not comply with the rules.

What I am concerned about is whether the new test cases can be added to the existing UT class(the three UT classes mentioned above) or not.

Or, are there some reasons that we must put the new test cases into a new UT class?

[baomingyu]

All existing tests are tests of data in kv and csv formats that combine expected rules. The new ones are scenarios that can parse data in kv and csv formats that do not comply with the rules.

What I am concerned about is whether the new test cases can be added to the existing UT class(the three UT classes mentioned above) or not.

Or, are there some reasons that we must put the new test cases into a new UT class?

New tests test new scenarios，whether to put it in the inventory will be adjusted later.

[aloyszhang]

New tests test new scenarios，whether to put it in the inventory will be adjusted later.

Make sense to me. We can unify the UT later.