fix: remove duplicate cves

[MaineK00n]

What did you implement:

CVEs of "recent" and "modified" that were always brought at fetch time were duplicated with CVEs of years.
In the case of RDB, multiple CVEs were inserted, and multiple identical ones appeared in the response. Also, in the case of Redis, the data was overwritten, and old data may have appeared in the response.

Type of change

• Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

NVD

$ go-cve-dictionary.old fetch nvd --years 2021 --dbpath ./cve.old.sqlite
$ go-cve-dictionary.new fetch nvd --years 2021 --dbpath ./cve.new.sqlite

$ go-cve-dictionary.old server --dbpath ./cve.old.sqlite --port 1325
$ go-cve-dictionary.new server --dbpath ./cve.new.sqlite --port 1326

// upstream/master
$ curl http://127.0.0.1:1326/cves/CVE-2020-20349 | jq | grep "CveID"
  "CveID": "CVE-2020-20349",
      "CveID": "CVE-2020-20349",
      "CveID": "CVE-2020-20349",

// PR
$ curl http://127.0.0.1:1326/cves/CVE-2020-20349 | jq | grep "CveID"
  "CveID": "CVE-2020-20349",
      "CveID": "CVE-2020-20349",

JVN

$ go-cve-dictionary.old fetch jvn --years 2021 --dbpath ./cve.old.sqlite
$ go-cve-dictionary.new fetch jvn --years 2021 --dbpath ./cve.new.sqlite

$ go-cve-dictionary.old server --dbpath ./cve.old.sqlite --port 1325
$ go-cve-dictionary.new server --dbpath ./cve.new.sqlite --port 1326

// upstream/master
$ curl http://127.0.0.1:1326/cves/CVE-2020-35838 | jq | grep "ID"
  "CveID": "CVE-2020-35838",
      "CveID": "CVE-2020-35838",
      "JvnID": "JVNDB-2020-014893",
      "CveID": "CVE-2020-35838",
      "JvnID": "JVNDB-2020-014893",

// PR
$ curl http://127.0.0.1:1326/cves/CVE-2020-35838 | jq | grep "ID"
  "CveID": "CVE-2020-35838",
      "CveID": "CVE-2020-35838",
      "JvnID": "JVNDB-2020-014893",

Integration

$ make clean-integration && make build-integration
$ make fetch-rdb && make fetch-redis
$ make diff-server-rdb-redis

Checklist:

You don't have to satisfy all of the following.

• Write tests
• Write documentation
• Check that there aren't other open pull requests for the same issue/feature
• Format your source code by make fmt
• Pass the test by make test
• Provide verification config / commands
• Enable "Allow edits from maintainers" for this PR
• Update the messages below

Is this ready for review?: YES

Reference

[kotakanbe]

I commented, please check it out.