Skip to content

Elastic Search, v4.4.0

Compare
Choose a tag to compare
@nitrosx nitrosx released this 07 Dec 15:44
· 1123 commits to master since this release
0d68e18

This release provides the first version of SciCat with Elastic Search integration.
Elastic Search is opt-in feature, and has to be configured as indicated in the documentation.
Elastic Search is disabled by default, so existing deployments can be upgraded in place without changing configuration.

What's Changed

  • build(deps): bump luxon from 3.4.0 to 3.4.2 by @dependabot in #691
  • build(deps-dev): bump @nestjs/schematics from 10.0.1 to 10.0.2 by @dependabot in #692
  • build(deps-dev): bump @types/node from 20.4.5 to 20.5.7 by @dependabot in #693
  • build(deps-dev): bump @nestjs/cli from 10.1.7 to 10.1.16 by @dependabot in #694
  • build(deps-dev): bump chai from 4.3.7 to 4.3.8 by @dependabot in #695
  • build(deps): bump @user-office-software/duo-message-broker from 1.5.0 to 1.5.1 by @dependabot in #697
  • build(deps): bump @nestjs/passport from 10.0.0 to 10.0.1 by @dependabot in #698
  • build(deps): bump mongoose from 7.4.3 to 7.4.5 by @dependabot in #699
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.4.0 to 6.5.0 by @dependabot in #700
  • build(deps): bump mongodb and mongoose by @dependabot in #702
  • build(deps-dev): bump @types/uuid from 9.0.2 to 9.0.3 by @dependabot in #703
  • build(deps): bump @nestjs/swagger from 7.1.8 to 7.1.10 by @dependabot in #704
  • build(deps-dev): bump @types/luxon from 3.3.1 to 3.3.2 by @dependabot in #705
  • build(deps-dev): bump eslint from 8.47.0 to 8.48.0 by @dependabot in #706
  • build(deps): bump bcrypt from 5.1.0 to 5.1.1 by @dependabot in #707
  • build(deps-dev): bump concurrently from 8.2.0 to 8.2.1 by @dependabot in #708
  • build(deps): bump @nestjs/config from 3.0.0 to 3.0.1 by @dependabot in #710
  • build(deps): bump actions/checkout from 3 to 4 by @dependabot in #711
  • build(deps-dev): bump @typescript-eslint/parser from 6.4.0 to 6.6.0 by @dependabot in #713
  • Feat: sync elastic search data with mongoDB CRUD operation by @Junjiequan in #717
  • Fix: PUT endpoint changes PID of the dataset by @Junjiequan in #715
  • E2e fix by @bpedersen2 in #719
  • build(deps): bump @user-office-software/duo-message-broker from 1.5.1 to 1.5.2 by @dependabot in #736
  • Libs upgrade by @bpedersen2 in #718
  • MLZ to central by @bpedersen2 in #720
  • github: use nodeversion in cache key by @bpedersen2 in #722
  • build(deps-dev): bump eslint from 8.48.0 to 8.49.0 by @dependabot in #730
  • build(deps): bump @nestjs/swagger from 7.1.10 to 7.1.11 by @dependabot in #733
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.5.0 to 6.7.0 by @dependabot in #738
  • build(deps-dev): bump @types/node from 20.5.9 to 20.6.1 by @dependabot in #743
  • Fix: saving logbook token in memory by @Junjiequan in #725
  • build(deps-dev): bump @typescript-eslint/parser from 6.6.0 to 6.7.0 by @dependabot in #746
  • build(deps): bump mongoose from 7.5.0 to 7.5.2 by @dependabot in #747
  • build(deps-dev): bump @types/node-fetch from 2.6.4 to 2.6.5 by @dependabot in #748
  • build(deps): bump @nestjs/config from 3.0.1 to 3.1.1 by @dependabot in #751
  • build(deps): bump @user-office-software/duo-message-broker from 1.5.2 to 1.6.0 by @dependabot in #749
  • build(deps): bump @nestjs/passport from 10.0.1 to 10.0.2 by @dependabot in #752
  • Use separate eslint/prettier step by @bpedersen2 in #723
  • Add message for instrument creation problems by @bpedersen2 in #721
  • build(deps): bump uuid and @types/uuid by @dependabot in #753
  • build(deps-dev): bump @types/nodemailer from 6.4.9 to 6.4.10 by @dependabot in #754
  • build(deps-dev): bump sinon from 15.2.0 to 16.0.0 by @dependabot in #755
  • build(deps): bump docker/build-push-action from 4 to 5 by @dependabot in #756
  • build(deps): bump docker/metadata-action from 4 to 5 by @dependabot in #757
  • build(deps): bump docker/setup-buildx-action from 2 to 3 by @dependabot in #758
  • build(deps): bump docker/login-action from 2 to 3 by @dependabot in #759
  • build(deps-dev): bump @types/node from 20.6.1 to 20.6.3 by @dependabot in #761
  • build(deps-dev): bump @types/express-session from 1.17.7 to 1.17.8 by @dependabot in #775
  • build(deps-dev): bump @types/passport-jwt from 3.0.9 to 3.0.10 by @dependabot in #766
  • build(deps-dev): bump @faker-js/faker from 8.0.2 to 8.1.0 by @dependabot in #767
  • build(deps-dev): bump eslint from 8.49.0 to 8.50.0 by @dependabot in #768
  • build(deps-dev): bump @nestjs/cli from 10.1.17 to 10.1.18 by @dependabot in #769
  • build(deps-dev): bump @types/supertest from 2.0.12 to 2.0.13 by @dependabot in #771
  • build(deps-dev): bump @types/lodash from 4.14.198 to 4.14.199 by @dependabot in #773
  • build(deps-dev): bump @types/passport-local from 1.0.35 to 1.0.36 by @dependabot in #774
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.7.0 to 6.7.3 by @dependabot in #776
  • build(deps-dev): bump @types/node from 20.6.3 to 20.7.1 by @dependabot in #780
  • chore: auto-merge dependabot patch versions by @Junjiequan in #778
  • build(deps-dev): bump @types/node-fetch from 2.6.5 to 2.6.6 by @dependabot in #782
  • build(deps-dev): bump @types/node from 20.7.1 to 20.8.0 by @dependabot in #785
  • build(deps): bump mongoose from 7.5.2 to 7.5.3 by @dependabot in #784
  • build(deps-dev): bump @types/express from 4.17.17 to 4.17.18 by @dependabot in #792
  • build(deps): bump @nestjs/swagger from 7.1.11 to 7.1.12 by @dependabot in #793
  • build(deps-dev): bump @types/nodemailer from 6.4.10 to 6.4.11 by @dependabot in #786
  • build(deps): bump rimraf from 5.0.1 to 5.0.5 by @dependabot in #783
  • build(deps-dev): bump @types/mocha from 10.0.1 to 10.0.2 by @dependabot in #787
  • build(deps-dev): bump @typescript-eslint/parser from 6.7.0 to 6.7.3 by @dependabot in #790
  • build(deps-dev): bump chai from 4.3.8 to 4.3.10 by @dependabot in #791
  • build(deps): bump mathjs from 11.11.0 to 11.11.1 by @dependabot in #788
  • build(deps): bump migrate-mongo from 10.0.0 to 11.0.0 by @dependabot in #789
  • build(deps-dev): bump @types/supertest from 2.0.13 to 2.0.14 by @dependabot in #796
  • build(deps-dev): bump eslint from 8.50.0 to 8.51.0 by @dependabot in #797
  • build(deps-dev): bump @types/node from 20.8.0 to 20.8.3 by @dependabot in #795
  • build(deps): bump openid-client from 5.5.0 to 5.6.0 by @dependabot in #803
  • build(deps): bump mongoose from 7.5.3 to 7.6.0 by @dependabot in #799
  • build(deps-dev): bump @typescript-eslint/parser from 6.7.3 to 6.7.4 by @dependabot in #804
  • build(deps): bump nodemailer from 6.9.5 to 6.9.6 by @dependabot in #802
  • build(deps-dev): bump ts-loader from 9.4.4 to 9.5.0 by @dependabot in #801
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.7.3 to 6.7.4 by @dependabot in #798
  • build(deps-dev): bump sinon from 16.0.0 to 16.1.0 by @dependabot in #800
  • build(deps-dev): bump @typescript-eslint/parser from 6.7.4 to 6.7.5 by @dependabot in #808
  • build(deps-dev): bump @babel/traverse from 7.22.15 to 7.23.2 by @dependabot in #817
  • build(deps): bump mongoose from 7.6.0 to 7.6.2 by @dependabot in #807
  • build(deps-dev): bump @faker-js/faker from 8.1.0 to 8.2.0 by @dependabot in #811
  • build(deps): bump @nestjs/swagger from 7.1.12 to 7.1.13 by @dependabot in #814
  • build(deps-dev): bump @types/uuid from 9.0.4 to 9.0.5 by @dependabot in #810
  • build(deps-dev): bump @types/express from 4.17.18 to 4.17.19 by @dependabot in #813
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.7.4 to 6.7.5 by @dependabot in #815
  • build(deps): bump mathjs from 11.11.1 to 11.11.2 by @dependabot in #809
  • build(deps): bump openid-client from 5.6.0 to 5.6.1 by @dependabot in #812
  • build(deps-dev): bump @types/chai from 4.3.6 to 4.3.8 by @dependabot in #816
  • feat: add better check for logout urls by @martin-trajanovski in #820
  • fix: implement authorization on origDatablock by @Junjiequan in #765
  • feat : introduced new filters to elastic search, creationtime & scientific metadata condition by @Junjiequan in #794
  • build(deps): bump undici from 5.22.1 to 5.26.3 by @dependabot in #822
  • Refactor: refactored createFullfacetPipeline function by @Junjiequan in #806
  • Update README.md by @bpedersen2 in #824
  • build(tsconfig): include only src when building the project by @martin-trajanovski in #823
  • build(deps-dev): bump @types/express from 4.17.19 to 4.17.20 by @dependabot in #827
  • build(deps-dev): bump eslint-plugin-prettier from 5.0.0 to 5.0.1 by @dependabot in #829
  • build(deps-dev): bump @types/supertest from 2.0.14 to 2.0.15 by @dependabot in #828
  • build(deps-dev): bump @nestjs/cli from 10.1.18 to 10.2.0 by @dependabot in #826
  • build(deps): bump mongoose from 7.6.2 to 7.6.3 by @dependabot in #831
  • build(deps-dev): bump @types/bcrypt from 5.0.0 to 5.0.1 by @dependabot in #832
  • build(deps-dev): bump @types/lodash from 4.14.199 to 4.14.200 by @dependabot in #833
  • build(deps): bump nodemailer and @types/nodemailer by @dependabot in #834
  • build(deps): bump @nestjs/swagger from 7.1.13 to 7.1.14 by @dependabot in #830
  • build(deps-dev): bump @types/uuid from 9.0.5 to 9.0.6 by @dependabot in #835
  • fix: updated mathJS package version && improved number check by @Junjiequan in #836
  • build(deps-dev): bump @types/express-session from 1.17.8 to 1.17.9 by @dependabot in #845
  • build(deps-dev): bump @nestjs/cli from 10.2.0 to 10.2.1 by @dependabot in #848
  • build(deps): bump @elastic/elasticsearch from 8.9.0 to 8.10.0 by @dependabot in #846
  • build(deps-dev): bump concurrently from 8.2.1 to 8.2.2 by @dependabot in #851
  • build(deps-dev): bump @types/node-fetch from 2.6.6 to 2.6.7 by @dependabot in #850
  • build(deps): bump @nestjs/axios from 3.0.0 to 3.0.1 by @dependabot in #849
  • build(deps-dev): bump @types/luxon from 3.3.2 to 3.3.3 by @dependabot in #852
  • build(deps-dev): bump @types/mocha from 10.0.2 to 10.0.3 by @dependabot in #856
  • build(deps-dev): bump @types/passport-local from 1.0.36 to 1.0.37 by @dependabot in #853
  • build(deps): bump mathjs from 11.11.2 to 12.0.0 by @dependabot in #854
  • build(deps-dev): bump sinon from 16.1.0 to 17.0.0 by @dependabot in #847
  • build(deps): bump actions/setup-node from 3 to 4 by @dependabot in #855
  • fix: improved elastic search query filter #837 by @Junjiequan in #861
  • Add: added elastic search aggregation to query facet objects by @Junjiequan in #859
  • add: added heatlh check endpoint by @Junjiequan in #865
  • build(deps-dev): bump sinon from 17.0.0 to 17.0.1 by @dependabot in #873
  • build(deps-dev): bump wait-on from 7.0.1 to 7.1.0 by @dependabot in #867
  • build(deps-dev): bump @types/node from 20.8.3 to 20.8.10 by @dependabot in #871
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.7.5 to 6.10.0 by @dependabot in #877
  • build(deps-dev): bump @types/node-fetch from 2.6.7 to 2.6.9 by @dependabot in #876
  • build(deps-dev): bump @typescript-eslint/parser from 6.7.5 to 6.10.0 by @dependabot in #878
  • build(deps-dev): bump @nestjs/schematics from 10.0.2 to 10.0.3 by @dependabot in #869
  • build(deps-dev): bump eslint from 8.51.0 to 8.53.0 by @dependabot in #875
  • build(deps-dev): bump @types/passport-jwt from 3.0.10 to 3.0.13 by @dependabot in #879
  • build(deps-dev): bump @types/express-session from 1.17.9 to 1.17.10 by @dependabot in #884
  • build(deps): bump @nestjs/event-emitter from 2.0.2 to 2.0.3 by @dependabot in #891
  • build(deps-dev): bump @types/node from 20.8.10 to 20.9.0 by @dependabot in #888
  • build(deps): bump @nestjs/mongoose from 10.0.1 to 10.0.2 by @dependabot in #883
  • build(deps-dev): bump @types/lodash from 4.14.200 to 4.14.201 by @dependabot in #885
  • build(deps-dev): bump @types/chai from 4.3.8 to 4.3.10 by @dependabot in #889
  • build(deps-dev): bump prettier from 3.0.3 to 3.1.0 by @dependabot in #886
  • build(deps): bump @nestjs/jwt from 10.1.1 to 10.2.0 by @dependabot in #887
  • build(deps-dev): bump @types/nodemailer from 6.4.13 to 6.4.14 by @dependabot in #893
  • build(deps): bump @nestjs/swagger from 7.1.14 to 7.1.15 by @dependabot in #890
  • build(deps-dev): bump @types/express from 4.17.20 to 4.17.21 by @dependabot in #892
  • build(deps-dev): bump @typescript-eslint/parser from 6.10.0 to 6.11.0 by @dependabot in #896
  • build(deps-dev): bump ts-loader from 9.5.0 to 9.5.1 by @dependabot in #895
  • build(deps): bump mathjs from 12.0.0 to 12.1.0 by @dependabot in #899
  • build(deps-dev): bump @faker-js/faker from 8.2.0 to 8.3.1 by @dependabot in #900
  • build(deps-dev): bump @types/uuid from 9.0.6 to 9.0.7 by @dependabot in #903
  • build(deps-dev): bump @types/bcrypt from 5.0.1 to 5.0.2 by @dependabot in #902
  • build(deps-dev): bump @types/mocha from 10.0.3 to 10.0.4 by @dependabot in #901
  • build(deps): bump luxon and @types/luxon by @dependabot in #898
  • build(deps-dev): bump @types/supertest from 2.0.15 to 2.0.16 by @dependabot in #897
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.10.0 to 6.11.0 by @dependabot in #904
  • Chore: Elasticsearch documentation by @Junjiequan in #880
  • Patch out vulnerable vm2 with an override by @bpedersen2 in #894
  • Add "create dataset privileged" groups and review dataset authorization by @nitrosx in #818
  • modified env variables based on new authorization for e2e test by @Junjiequan in #908
  • Fix MeasurementPeriodList validation by @fpotier in #881
  • Fix: count endpoint in PublishedDataController is fixed by @janosbabik in #912
  • build(deps-dev): bump @types/node from 20.9.0 to 20.10.0 by @dependabot in #913
  • build(deps-dev): bump @types/luxon from 3.3.4 to 3.3.5 by @dependabot in #918
  • build(deps-dev): bump @types/passport-local from 1.0.37 to 1.0.38 by @dependabot in #914
  • build(deps-dev): bump @types/chai from 4.3.10 to 4.3.11 by @dependabot in #916
  • build(deps-dev): bump @types/mocha from 10.0.4 to 10.0.6 by @dependabot in #921
  • build(deps-dev): bump @types/lodash from 4.14.201 to 4.14.202 by @dependabot in #920
  • build(deps-dev): bump eslint from 8.53.0 to 8.54.0 by @dependabot in #919
  • build(deps): bump @nestjs/terminus from 10.1.1 to 10.2.0 by @dependabot in #915
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.11.0 to 6.12.0 by @dependabot in #922
  • test: add some extra tests for creating datasets including pid with right access groups by @martin-trajanovski in #910
  • updated readme based on new authorization model by @Junjiequan in #909
  • build(deps-dev): bump @typescript-eslint/eslint-plugin from 6.12.0 to 6.13.1 by @dependabot in #928
  • build(deps): bump @nestjs/passport from 10.0.2 to 10.0.3 by @dependabot in #933
  • build(deps-dev): bump @types/node from 20.10.0 to 20.10.3 by @dependabot in #935
  • build(deps-dev): bump @typescript-eslint/parser from 6.11.0 to 6.13.1 by @dependabot in #936
  • build(deps): bump @nestjs/swagger from 7.1.15 to 7.1.16 by @dependabot in #934
  • build(deps-dev): bump eslint-config-prettier from 9.0.0 to 9.1.0 by @dependabot in #931
  • build(deps-dev): bump eslint from 8.54.0 to 8.55.0 by @dependabot in #929
  • build(deps): bump passport from 0.6.0 to 0.7.0 by @dependabot in #927
  • build(deps-dev): bump @types/luxon from 3.3.5 to 3.3.6 by @dependabot in #930
  • Fix: dataset table sort is not working when elasticsearch is enabled. by @Junjiequan in #937

New Contributors

Full Changelog: v4.3.1...v4.4.0