Support for the Research Organization Registry (ROR)

[joemull]

Closes #3168.

Overview

This piece of work adds a ROR data model, including affiliations, organizations, organization names, and locations. It includes an import routine to fetch and process ROR's full database. I've included as much backwards compatibility as possible for importers that do not know about ROR. It also adds a user interface for editing one's own affiliations, and an admin interface for all of the relevant models.

Command line interface

❯ python src/manage.py import_ror_data
DEBUG 2024-12-09 18:41:33,666 connectionpool P:131157 T:135176669522816 Starting new HTTPS connection (1): zenodo.org:443
DEBUG 2024-12-09 18:41:34,697 connectionpool P:131157 T:135176669522816 https://zenodo.org:443 "GET /api/communities/ror-data/records?sort=newest HTTP/1.1" 200 None
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:00<00:00, 101.06it/s]
INFO 2024-12-09 18:41:38,658 import_ror_data P:131157 T:135176669522816 successful

User interface

Some functionality is still to do:

• As a system admin, I can import the organizations more quickly (currently the process is slow due to the need to check existing data while creating new records to avoid duplicates)
• A cron job is created to run ROR imports when I install Janeway in production
• As the author of an article submission, I can add an affiliation for myself and my coauthors (see Update the author submission screen #4519)
• As the author of a repository submission, I can add an affiliation for myself and my coauthors
• As an editor, I can edit the affiliations of frozen author records on articles in the pipeline
• As a publishing librarian or research impact librarian, I can see ROR data in Crossref deposits, OAI-PMH feeds, and JATS files exposed to web crawlers so that I can track research impact
• As a publisher importing metadata, I can import RORs using the import / export / update interface
• As an editor/publisher I can to be able to pull reports using ROR as a filter
• As a marketer/publisher I can pull reports that compare authors against the consortial billing plugin

Some things still need design / feature development:

• As any user, I can enter location metadata for my account that is separate from an affiliation (do we want this?)
• As any user, when I enter a custom organization, I can add a custom location to the organization (do we want this?)
• When I search for and add an author in the author submission interface (Update the author submission screen #4519), the ROR affiliations are pulled in from ORCID API search results
• As a staff member, I can edit the affiliations of user accounts with a role in my journal

[MartinPaulEve]

If you enter an organization name that isn't found (e.g., in test import, "Birkbeck") and then click on one of the pagination items at the bottom, you are redirected to an erroring page eg:

http://127.0.0.1:8000/JRNL/profile/organization/search/?q=birkbeck&page=3&paginate_by=25

This errors because the item isn't found, but the search query is inserted into the pagination link

[MartinPaulEve]

This mostly looks really good. Just a few small things.

• Pagination in ROR search currently redirects to page not found error
• List of affiliations should show which is primary?
• RORImportStatus should not be duplicated?

[MartinPaulEve]

Should this message be more explicit?

[joemull]

Yes probably, though I'm just removing the noisy print statement here, not changing this feature on this branch.

[MartinPaulEve]

Top test author

[joemull]

Without a doubt!

[MartinPaulEve]

Should these choices reference RORImportStatus rather than duplicating?

[joemull]

I believe this is the standard way Django records choices in migrations, even when the choices are expressed in a class. The reason is that if the migration referenced a variable in the models file, then if the choices list ever changed there, the migration might stop working.

Example:

janeway/src/journal/migrations/0031_issue_old_issue_type.py

Line 35 in bc8a327

choices=[('Issue', 'Issue'), ('Collection', 'Collection')],

[joemull]

• Pagination in ROR search currently redirects to page not found error

This turned out to be a Django bug I believe. I think it's obscure because most people don't encounter it, since they submit their search query to change the list of items before selecting a page.

But I've gone ahead and fixed it for this view.

• List of affiliations should show which is primary?

Yes, good call. I added a label.

I also updated the save method to make the affiliation primary if it's the first one.

• RORImportStatus should not be duplicated?

That's standard, I'm pretty sure. See comment inline.