Bug fixes for the MoH model

[daisieh]

• fixed a bug in which something like primary_site.INDEX, which has no sub-objects and is just an array of strings, can be processed as that.
• added the NONE option for indexed_on
• added errors for when things don't work, esp when an index is missing.

[kcranston]

AttributeError: module 'mappings' has no attribute 'indexed_on'

[daisieh]

What line was this on? Can you use verbose mode?

[kcranston]

Using the REDCAP data in clinical_ETL_data:

Mapping line primary_diagnoses.0
Evaluating {indexed_on(Primary Diagnosis_id)}
Traceback (most recent call last):
  File "/Users/karen/Documents/candig/repos/clinical_ETL_code/CSVConvert.py", line 592, in <module>
    main(parse_args())
  File "/Users/karen/Documents/candig/repos/clinical_ETL_code/CSVConvert.py", line 576, in main
    mcodepackets.append(map_row_to_mcodepacket(
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/karen/Documents/candig/repos/clinical_ETL_code/CSVConvert.py", line 196, in map_row_to_mcodepacket
    dict = map_row_to_mcodepacket(identifier, index_field, new_key, indexed_data, node[key], x)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/karen/Documents/candig/repos/clinical_ETL_code/CSVConvert.py", line 196, in map_row_to_mcodepacket
    dict = map_row_to_mcodepacket(identifier, index_field, new_key, indexed_data, node[key], x)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/karen/Documents/candig/repos/clinical_ETL_code/CSVConvert.py", line 170, in map_row_to_mcodepacket
    return eval_mapping(identifier, index_field, indexed_data, node, x)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/karen/Documents/candig/repos/clinical_ETL_code/CSVConvert.py", line 308, in eval_mapping
    return eval(f'module.{method}({data_values})')
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<string>", line 1, in <module>
AttributeError: module 'mappings' has no attribute 'indexed_on'

[daisieh]

That line has the old 0 instead of INDEX

[daisieh]

You'll probably need to merge mappings onto the new template.

[kcranston]

Do you have updates you can push to clinical_ETL_data? (hard to test if we aren't using the same data files)