GET /CVE-id endpoint fails for very large datasets

[jdaigneau5]

Summary

Currently, the GET /CVE-id endpoint fails for large datasets. This is was first seen on DEV, which had over 100k CVE-ids. This is primarily an issue for the Secretariat user, as that user would see all CVE-Ids while other users would only be returned their org's CVE-ids.

Mongo Log Error:

Definition of Done

• Address the memory limit for the $lookup call in our CVE-id aggregation function
• Ensure that all CVE-ids get returned from this endpoint in a manageable way (i.e. paging, chunks, etc)

[jdaigneau5]

This will only occur for the Secretariat, because other users can only pull a subset of cve-ids at one time.