SemanticScholar search optimization

[r-wrobel]

Hi there,
if someone perform a search_semanticscholar(query) litstudy executes a request for each search result.
Therefore I suggest using
https://api.semanticscholar.org/graph/v1/paper/search?query=searchString&limit=100&fields=title,authors,year,venue,abstract,citations,references,externalIds to request the complete data for the DocumentSets.
The API Limit is limit+offset<=1,000 results. A disadvantage is the missing numCitedBy field. With len(citations) <= 1,000 the amount derived from this will be limited to 1,000.

If someone needs more results, they can't use the current implementation anyway. The /paper/search/bulk can return 10,000,000 total results with up to 1,000 per request. This bulk search does not contain any information on citation and reference and therefore requires the request_paper() step as before.

[isazi]

Interesting, would you like to submit a pull request for this?

[r-wrobel]

Sure, but I was only looking for quick solutions to my problems. In addition, I don't yet know all the connections within litstudy. The code quality will be accordingly.
Feel free to cherry-pick the good features from #96