3767: CSV ingest improvements

[oscardssmith]

No description provided.

[coveralls]

Coverage increased (+0.01%) to 10.288% when pulling cba5f38 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[coveralls]

Coverage increased (+0.5%) to 10.736% when pulling 851b724 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[coveralls]

Coverage increased (+0.5%) to 10.78% when pulling cb40437 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[oscardssmith]

@landreev current problem
java.io.IOException: (line 2) invalid char between encapsulated token and delimiter java.lang.RuntimeException at org.apache.commons.csv.CSVParser$1.getNextRecord(CSVParser.java:442) at org.apache.commons.csv.CSVParser$1.hasNext(CSVParser.java:452) at edu.harvard.iq.dataverse.ingest.tabulardata.impl.plugins.csv.CSVFileReader.readFile(CSVFileReader.java:178) at edu.harvard.iq.dataverse.ingest.tabulardata.impl.plugins.csv.CSVFileReader.read(CSVFileReader.java:104) at edu.harvard.iq.dataverse.ingest.tabulardata.impl.plugins.csv.CSVFileReaderTest.testHardRead(CSVFileReaderTest.java:108) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184) at org.junit.runners.ParentRunner.run(ParentRunner.java:236) at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110) at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175) at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:107) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68) Caused by: java.io.IOException: (line 2) invalid char between encapsulated token and delimiter at org.apache.commons.csv.Lexer.parseEncapsulatedToken(Lexer.java:275) at org.apache.commons.csv.Lexer.nextToken(Lexer.java:152) at org.apache.commons.csv.CSVParser.nextRecord(CSVParser.java:498) at org.apache.commons.csv.CSVParser$1.getNextRecord(CSVParser.java:439) ... 32 more

[coveralls]

Coverage increased (+0.5%) to 10.789% when pulling e568fa7 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[coveralls]

Coverage increased (+0.5%) to 10.784% when pulling c699e54 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[coveralls]

Coverage increased (+0.5%) to 10.786% when pulling ef4b590 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[coveralls]

Coverage increased (+0.5%) to 10.818% when pulling 19e5454 on 3767-CSV-injest-improvements into 6c7e016 on develop.

[oscardssmith]

see #3961 for the updated version of this.