XML2CSV tool editing for migration

[rtilla1]

Step 2 of Investigate using OpenRefine as part of the migration process is to transform MODS with xml2csv tool into very specific columns with well-documented delimiters between compound or complex contents.

Cara is working on pulling simple personal names (with one namePart), complex personal names (with multiple nameParts), simple corporate names, and complex corporate names into their own columns, with appropriate delimiters between the names and their roles and name/role pairs.

Each institution will need to customize parts of the xml2csv tool, but work should be done to make sure any data created by the basic Islandora 7.x forms are carried over.

[carakey]

The latest version has multiple columns for Names as follows: Personal, Corporate, Conference, Family, and No Type (mapping to the type attribute on the name element) -- each of the above with a Simple column (which maps to either un-typed namePart or displayForm) and Compound column (which maps to nameParts with type attributes).

Overkill? Maybe.

Delimiting is as follows (and could easily be changed):

• In both simple and compound fields, each discrete name element is separated by a double pipe ||.
• In both simple and compound fields, each name is followed by role information in double brackets, in the form [[marcrelator=code/text]].
  • If either code or text term is not present then the value of the missing term is given as "NULL".
  • If neither code nor text term is present, or if the authority is other than marcrelators, then [[marcrelators=ctb/Contributor]] is supplied.
• In simple fields, multiple namePart or displayForm subelements within a name element are separated with a period, e.g. "University of Wyoming. Junior Class"
• In compound fields, each namePart that has a type attribute is followed by type information in double brackets, e.g. "Andō [[type=family]]Hiroshige [[type=given]]1797-1858 [[type=date]]"
  • The multiple nameParts in compound fields do not have additional delimiters