field with new line breaks preprocessing

[antgonza]

if we have a column with a new line in this format:

"This is my line.
"

preprocessing (split libraries) fails.

[josenavas]

How did that made it into the DB? I'm concerned because if a column has a new line, that is creating a new row, so I'm unsure on how the parsers worked with that case.

[antgonza]

The quotes do the trick!

[josenavas]

interesting...

[antgonza]

Just found a new one on this point: lines with \t break the analysis.

[antgonza]

The easiest solution for this issue is to simply remove all \t and \n from all values in the tables and remove them when adding the info files, what do you guys think?

[josenavas]

Agree on removing those plus adding a warning letting the user know that we remove those.