Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request - publication metadata #41

Open
dustymc opened this issue Oct 4, 2022 · 8 comments
Open

Feature Request - publication metadata #41

dustymc opened this issue Oct 4, 2022 · 8 comments
Labels
Enhancement I think this would make Arctos even awesomer!

Comments

@dustymc
Copy link
Contributor

dustymc commented Oct 4, 2022

Is your feature request related to a problem? Please describe.

We don't record who/when created publications. We should.

Describe what you're trying to accomplish

Immediately, find messes.

Ideally I'd like to prevent messes, but I don't know how to do that. (Be much, much more careful about who gets manage_publication access??)

Describe the solution you'd like

Lacking real solutions, grab at least created_by_agent_id and created_date - if there's any pattern, it might involve user-at-time.

And there will never be a better time if anyone has other requests, so - other requests?

Describe alternatives you've considered

Nothing very nice

Additional context

Cleanup is needed. This is certainly not all of the problems, and contains lots of things that aren't problems, but this SQL

create table temp_m_d_p as select full_citation from publication where short_citation in (select short_citation from publication group by short_citation having count(*) > 1) and publication_type != 'field notebook' order by full_citation;

was used to make https://docs.google.com/spreadsheets/d/1RQCUSIZ4q4-XEElhMe5SRPgLVrC4wqyyew3tDocDJLQ/edit?usp=sharing

Some things that jumped out at me, and that I noticed being created today:


Antoinette J. Piaggio and Greg S. Spicer. 2001. Molecular phylogeny of the chipmunks inferred from mitochondrial cytochrome b and cytochrome oxidase II gene sequences. Molecular Phylogenetics and Evolution 20(3):335-350.
--
Antoinette J. Piaggio and Greg S. Spicer. 2001. Molecular Phylogeny of the Chipmunks Inferred from Mitochondrial Cytochrome b and Cytochrome Oxidase II Gene Sequences. Molecular Phylogenetics and Evolution 20(3):335-350.



Barron-Ortiz,C.I., A.T.Rodrigues, J. M. Theodor, B. P. Kooyman, D.Y. Yang, and C. F.Speller. 2017. Cheek tooth morphology and ancient mitochondrial DNA of late Pleistocene horses from the western interior of North America:  Implications for the taxonomy of North American Late Pleistocene Equus. PLoS ONE 12 (8), E0183045.
--
Barron-Ortiz, C. I., A. T. Rodrigues, J. M. Theodor, B. P. Kooyman, D. Y. Yang, C. F. Speller. 2017. Cheek tooth morphology and ancient mitochondrial DNA of late Pleistocene horses from the western interior of North America: Implications for the taxonomy of North American Late Pleistocene <i>Equus</i>. PLoS ONE 12(8): e0183045.


Baugh, A. T., A. G. West, E. A. Rickart, T. E. Cerling, J. R. Ehleringer, and M. D. Dearing. 2004.  Stable isotope ratios (d15N and d13C) of syntopic shrews (genus Sorex). Southwestern Naturalist 49:493-500
--
Baugh, A. T., A. G. West, E. A. Rickart, T. E. Cerling, J. R. Ehleringer, and M. D. Dearing. 2004.  Stable isotope ratios (d<sup>15</sup>N and d<sup>13</sup>C) of syntopic shrews (genus <i>Sorex</i>). Southwestern Naturalist 49:493-500



B. Kurten and Robert L. Rausch. 1959. Biometric comparisons between North American and Fennoscandian mammals. I. A comparison between Alaskan and Fennoscandian wolverines (<i>Gulo gulo</i> Linnaeus). Acta Arctica 11:1-20.
--
B. Kurten and Robert L. Rausch. 1959. Biometric comparisons between North American and Fennoscandian mammals. II. A comparison between the northern lynxes of Fennoscandia and Alaska. Acta Arctica 11:21-45.



Byrum, S., and B. S. Lieberman. 2020. Phylogeny and biogeography of some Cretaceous spatangoid echinoids with special emphasis on taxa from the Western Interior Seaway. Journal of Paleontology 95:613–623.
--
Byrum, S., and B. S. Lieberman. 2020. Phylogeny and biogeography of some Cretaceous spatangoid echinoids with special emphasis on taxa from the Western Interior Seaway. Journal of Paleontology 95:613–623. Cambridge University Press (CUP).



Cole W. Matson and Robert J. Baker. 2001. DNA Sequence Variation in the Mitochondrial Control Region of Red-Backed Voles (Clethrionomys). Molecular Biology and Evolution 18(8):1494-1501.
--
Cole W. Matson and Robert J. Baker. 2001. DNA sequence variation in the mitochondrial control region of red-backed voles (<i>Clethrionomys</i>). Molecular Biology and Evolution 18(8):1494-1501.



Donald W. Duszynski. 1989. Coccidian Parasites (Apicomplexa: Eimeriidae) from Insectivores. VIII. Four New Species from the Star-Nosed Mole, Condylura cristata. The Journal of Parasitology 75(4):514.
--
Donald W. Duszynski. 1989. Coccidian Parasites (Apicomplexa: Eimeriidae) from Insectivores. VIII. Four New Species from the Star-Nosed Mole, <i>Condylura cristata</i>. Journal of Parasitology 75(4):514-518.



Eli Greenbaum, Edward L. Stanley, Chifundera Kusamba, Wandege M. Moninga, Stephen R. Goldberg, Charles R. Bursey. 2012. A new species of <i>Cordylus</i> (Squamata: Cordylidae) from the Marungu Plateau of south-eastern Democratic Republic of the Congo. African Journal of Herpetology 61(1):14-39.
--
Eli Greenbaum, Edward L. Stanley, Chifundera Kusamba, Wandege M. Moninga, Stephen R. Goldberg, Charles R. Bursey. 2012. A new species of (Squamata: Cordylidae) from the Marungu Plateau of south-eastern Democratic Republic of the Congo. African Journal of Herpetology 61(1):14-39.



Eric S. Loker and Sara V. Brant. 2006. Diversification, dioecy and dimorphism in schistosomes. Trends in Parasitology 22(11):521-528.
--
Eric S Loker and Sara V Brant. 2006. Diversification, dioecy and dimorphism in schistosomes. Trends in parasitology 22(11):521-8.



Harris, Arthur H. 1989. The New Mexican late Wisconsin—East versus West. National Geographic Research 5:205-217.
--
Harris, Arthur H. 1989. The New Mexican Late Wisconsin--East versus West. National Geographic Research 5(2):205-217.



Marchetti, L., M. Belvedere, S. Voigt, H. Klein, D. Castanera, I. Díaz-Martínez, D. Marty, L. Xing, S. Feola, R. N. Melchor, and J. O. Farlow. 2019. Defining the morphological quality of fossil footprint. Problems and principles of preservation in tetrapod ichnology with examples from the Palaeozoic to the present.
--
Marchetti, L., M. Belvedere, S. Voigt, H. Klein, D. Castanera, I. Díaz-Martínez, D. Marty, L. Xing, S. Feola, R. N. Melchor, and J. O. Farlow. 2019. Defining the morphological quality of fossil footprints. Problems and principles of preservation in tetrapod ichnology with examples from the Palaeozoic to the present.



R. Eduardo Palma and Angel E. Spotorno. 1999. Molecular Systematics of Marsupials Based on the rRNA 12S Mitochondrial Gene: The Phylogeny of Didelphimorphia and of the Living Fossil Microbiotheriid <i>Dromiciops gliroides</i> Thomas. Molecular Evolution and Ecology 13(3):525-535.
--
R. Eduardo Palma and Angel E. Spotorno. 1999. Molecular Systematics of Marsupials Based on the rRNA 12S Mitochondrial Gene: The Phylogeny of Didelphimorphia and of the Living Fossil Microbiotheriid <i>Dromiciops gliroides Thomas</i>. Molecular Evolution and Ecology 13(3):525-535.



Robert T. Moore. 1934. A review of the races of Buthraupis exima. American Museum Novitates 715:1-8.
--
Robert T. Moore. 1934. A review of the races of <i>Buthraupis eximia</i> (Boissonneau). American Museum Novitates 715:1-8



Robert T. Moore. 1939. Two new races of Carpodacus mexicanus. Proceedings of the Biological Society of Washington 52:105-112.
--
Robert T. Moore. 1939. Two new races of <i>Carpodacus mexicanus</i>. Proceedings of the Biological Society of Washington 52:105-112.



Winkler, Alisa J., and Yukimitsu Tomida. 1988. New records of the small leporid Aztlanolagus agilis Russell and Harris (Leporidae: Leporinae). Southwestern Naturalist 33(4):391-396.
--
Winkler, Alisa J., and Yukimitsu Tomida. 1988. New records of the small leporid <i>Aztlanolagus agilis</i> Russell and Harris (Leporidae: Leporinae). Southwestern Naturalist 33(4): 391-396.


Priority

I thought high but it seems @Nicole-Ridgwell-NMMNHS has dealt with most of what lead here so ??

@dustymc dustymc added the Enhancement I think this would make Arctos even awesomer! label Oct 4, 2022
@Jegelewicz
Copy link
Member

grab at least created_by_agent_id and created_date

we should do this for everything, so yes

And there will never be a better time if anyone has other requests, so - other requests?

Free text citations lead to this. I was thinking that perhaps adding something to allow for checks might help, but it's just more work that nobody wants to do or still won't do correctly.

Can we add flags to pubs that appear to be duplicates? Not that anyone would go looking for them, but at least when someone finds one, they might be inclined to clean it up? Although, this can be difficult when cited things aren't in a collection to which you have edit access. Possible to mark pubs for merge?

UGH

@ewommack
Copy link

ewommack commented Oct 4, 2022

Possible to mark pubs for merge?

From a curatorial point of view that sounds doable. No idea on the Arctos side, but it would be pretty easy to see a publication while working with them and go same as that one, merge please.

@Nicole-Ridgwell-NMMNHS
Copy link

Yeah, sorry, the stuff in the last couple days is my student's mess. I'll talk with them again about how to check for duplicate pubs first. Good thing is we haven't added the citations yet, so it will be easier to clean up.

created_by_agent_id and created_date

This would greatly aid with checking the work of folks you are trying to train.

@Nicole-Ridgwell-NMMNHS
Copy link

Some things that jumped out at me, and that I noticed being created today

the stuff in the last couple days is my student's mess

I take that back, only a few of those are ours.

@dustymc
Copy link
Contributor Author

dustymc commented Oct 4, 2022

Free text citations lead to this.

At some level, but I think that's very far from the whole picture. A bunch of these have DOIs, users just aren't searching, or don't know how to search, or are not good at searching, or ??. The tools to avoid this exist, they're just not being used, or not being used in a way that leads somewhere productive, or ????.

Does everyone understand the importance to DOIs (identifiers!) and how to use them to create publications? Logs suggest maybe no, we need - documentation? Training? How-tos? A post-training/pre-access test? Something.....

Some of it's https://handbook.arctosdb.org/documentation/encoding.html, and it may be hard to avoid when pulling from a DOI. You search races of 𝐵𝑢𝑡𝘩, races of <i>Buth (and an occasional ü) exists, you make a duplicate. MAYBE there's something technical in there (ArctosDB/arctos#4783 might help), but I think we mostly need to get people to recognize and avoid that sort of thing.

I don't know how to find duplicates, other than above which is really primitive, misses lots, and finds thousands of potentials (volumes and prolific authors and the occasional homonym) which are fine. Always up for ideas, but I'm not sure machines are going to have much luck with this (except when there's a DOI, those things are made for machines and none of this happens when they exist).

difficult when cited things aren't in a collection to which you have edit access.

Even with access, there's always the chance the suggestion is wrong so I'm very reluctant to just merge (and potentially make bigger messes).

Possible to mark pubs for merge?

At some level museum exist to link material to literature - this is arguably our most sacred task, what I've seen in the logs suggests this is (mostly) easily preventable, we should strive to accept that this is (still mostly) a preventable problem and address that with training. I'd rather The Community build resources which help avoid this, instead of preemptively accepting that we are untrainable and using those resources to perpetually pick up after ourselves. If for some reason we can't do that, I don't think there are technical problems with a merger system but it would be significant development.

For scale, there are 10K pubs, my shady little query found 1200 potential dups, about a dozen of those looked like actual duplicates in the 10 minutes I spent scanning. That would have been a different picture if I wasn't watching the logs or if there wasn't a responsive CM available, but I do and they were and I don't think this is a wide-scale problem. Adding the metadata would help when something takes longer to catch - not a solution to anything, but useful and not much work to add.

@Nicole-Ridgwell-NMMNHS
Copy link

Nicole-Ridgwell-NMMNHS commented Oct 4, 2022

I think a simple first step would be to add to the beginning of this: https://handbook.arctosdb.org/how_to/How-to-Create-a-Publication.html with 1) an instruction to search for a pub before creating a new entry and 2) suggestions on how to search (for example, don't search for the whole title, just a few words from the title so that you catch any variations).

@genevieve-anderegg
Copy link

A bunch of these have DOIs, users just aren't searching, or don't know how to search, or are not good at searching, or ??

Perhaps updating the project and publications search page would help with searching for publications overall and increasing the chance of finding a pub before mistakenly entering it and creating a duplicate -> ArctosDB/arctos#3736 ArctosDB/arctos#3468

@dustymc
Copy link
Contributor Author

dustymc commented Jun 25, 2024

I'm going next task, I know how to do the core of this, if anyone has other publication metadata uses please leave them here.

@dustymc dustymc transferred this issue from ArctosDB/arctos Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement I think this would make Arctos even awesomer!
Projects
None yet
Development

No branches or pull requests

5 participants