Sciencedirect fetcher non OpenAccess PDF links don't work

[lecc0r]

I've just tested the newly implemented "Full text article download" function, however for several articles it downloaded a version from ResearchGate but I want to have the one from Elsevier. Dependent who you are working for, you have special access privileges on certain publisher sites where you download papers.

It would be handy to specify (in the preferences) which publisher the download pdf function should prefer. Perhaps even define a priority list, e.g. Sciencedirect (Elsevier), Wiley, ResearchGate, google, etc..

[stefan-kolb]

@lecc0r There is a hard-coded priority list right know which prefers the official publishers over google scholar for example. You can see it here: https://github.com/JabRef/jabref/blob/master/src/main/java/net/sf/jabref/external/FindFullText.java#L28
So this should already work as you expected. We need to reproduce the issue why it didn't fetch the one from Elsevier. Obviously it wasn't found or you had no priviledges.

[lecc0r]

@stefan-kolb : I reproduced the issue using the "Look up full text document" function to download the paper "Fabbri, A. & Fen-Chong, T. Indirect measurement of the ice content curve of partially frozen cement based materials Cold Regions Science and Technology , 2013, 90–91, 14 - 21".

The first screenshot shows on the right-hand side the pdf file that's been downloaded. The second screenshot shows the search result on sciencedirect (note the "brought to you by Universitätsbibliothek Stuttgart" message on the top right-hand side) offering the pdf download. The third screenshot shows the paper version I want.

I am going to check this issue against a paper which is available for the public to see if there is some privilege issue when downloading via JabRef.

[stefan-kolb]

@lecc0r Most of the fetchers are based on DOIs at the moment, except for GoogleScholar as far as I remember correctly. See https://github.com/JabRef/jabref/tree/master/src/main/java/net/sf/jabref/logic/fetcher. Therefore you won't get your PDFs from official sources but from the Scholar search if you don't include a valid DOI in your BibTeX entry.

I don't have access to Elsevier so please try again with DOI: doi:10.1016/j.coldregions.2013.03.002

[lecc0r]

@stefan-kolb I manually downloaded the citation from sciencedirect because the websearch import does not include doi, url, and abstract (see #431). The citation by default shows in the doi field: http://dx.doi.org/10.1016/j.coldregions.2013.03.002.
I tried your suggestion "doi:10.1016/j.coldregions.2013.03.002" as well as "10.1016/j.coldregions.2013.03.002". All tested doi entries result in the ResearchGate version.

[stefan-kolb]

This should work. However, I can't test it because I don't have access to this particular paper on Elsevier. Can you possibly reproduce this with an open access paper on Elsevier?

[lecc0r]

@stefan-kolb Yes it works but on sciencedirect only for Open Access Articles. I've just tested the function to download the open access paper "Numerical simulation of displacement characteristics of CO2 injected in pore-scale porous media" (http://www.sciencedirect.com/science/article/pii/S1674775515001079). I received the correct version.
So this means that for some reason JabRef does not pass on the privilege you automatically receive when browsing sciencedirect while being connected to a privileged network. What could be the reason for that?

[stefan-kolb]

@lecc0r Does this URL return a PDF for you? http://api.elsevier.com/content/article/doi/10.1016/j.coldregions.2013.03.002?httpAccept=application/pdf

[lecc0r]

@stefan-kolb Not when opened in the browser. Sorry I am not quite sure if that's what you want.
When I click on Download and insert your link in the URL field it results in no valid pdf.

[stefan-kolb]

Yeah, ok that's what i expected. The current crawler returns a URL that is given by the API. Although, it seems that these URLs only work for public PDFs. Thanks for debugging, I'll see what I can do.

[stefan-kolb]

@lecc0r This should work as expected now. Please try the current master build at http://builds.jabref.org/.

[lecc0r]

@stefan-kolb Yes, sciencedirect full document look up works now! Thanks.