CSV file has address field which has commas within,

[Qunovaganesh]

Hi,

CSV file has address field which has commas within. While reading the contents, HOP is creating many more columns the moment it encounters a comma in a single cell. This is disturbing the headers.

Another issue:

When I use csv input and do get fields, the data type HOP sets by default is wrong if it is a big file. While I use a sample file with much lesser rows, the data types identified perfectly. I'm attaching both the files for your reference. Thanks in advance for your thoughts and guidance.

Ganesh

OutletDumpReport-1736936474-b9e01c9.csv
OutletDumpReport-1736507458-2618a22 Tushar.csv

[bamaer]

I can't reproduce your first issue. The enclosure should (and does) allow delimiter characters (commas) within a field.
The second issue (data types) is inherent to the schema-less nature of CSV or any type of delimited text files. We scan x number of rows and do the best possible informed guess on the data type. You can manually overrule the detected field type, or scan more rows. You can use 0 to scan the entire file, but that obviously might take a while on large files, and it still is not a 100% guarantee if you use the same layout to read multiple files.

[Qunovaganesh]

Thanks @bamaer. We had overruled the data type earlier to Integer but Hop was adding preceding Zeros. We deleted the value in Length field and now it works fine. Your prompt guidance always helps us to explore more and get to the destination. Thanks