Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Find a better operation log implementation #1725

Closed
iGormilhit opened this issue Feb 25, 2021 · 1 comment
Closed

Find a better operation log implementation #1725

iGormilhit opened this issue Feb 25, 2021 · 1 comment
Assignees
@jma
Labels
developers From a developer point of view. enhancement Improvement of an existing feature p-High High priority (to be solved in the 2-3 next months) performance
Milestone
v1.3.0

Comments

@iGormilhit
Copy link

Describe the issue

Each time an operation is logged, the current implementation creates a new record and writes in the database. This causes performance issue as lot of operation on records have to be logged.

What should be done

A better solution should be found, maybe through the new Invenio records management.
@iGormilhit iGormilhit added enhancement Improvement of an existing feature developers From a developer point of view. performance p-High High priority (to be solved in the 2-3 next months) labels Feb 25, 2021
@iGormilhit iGormilhit added this to the v1.3.0 milestone Mar 4, 2021
@pronguen pronguen mentioned this issue Mar 17, 2021
Closed
@pronguen
Copy link
Contributor

See also #1779

@pronguen pronguen modified the milestones: v1.2.0, v1.3.0 Apr 14, 2021
jma added a commit to jma/rero-ils that referenced this issue May 23, 2021
@jma
operation logs: use an elasticsearch only resource
9ab6b1e 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
@jma jma mentioned this issue May 23, 2021
Merged
7 tasks
jma added a commit to jma/rero-ils that referenced this issue May 24, 2021
@jma
operation logs: use an elasticsearch only resource
d7e0bd5 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 24, 2021
@jma
operation logs: use an elasticsearch only resource
1b60fce 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
@jma jma self-assigned this May 25, 2021
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an elasticsearch only resource
f10c903 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an elasticsearch only resource
e804e37 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an elasticsearch only resource
4ffc736 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an elasticsearch only resource
b869885 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an elasticsearch only resource
0fcc8d2 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an elasticsearch only resource
8c88771 
* Renames virtua command cli name.
* Fixes monitor view to compute elasticsearch and db count diff when the
  index does not exists.
* Creates an operation logs elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a cli to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 26, 2021
@jma
operation logs: use an Elasticsearch only resource
5661fdc 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit to jma/rero-ils that referenced this issue May 27, 2021
@jma
operation logs: use an Elasticsearch only resource
afc478d 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: rero#1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit that referenced this issue May 27, 2021
@jma
operation logs: use an Elasticsearch only resource
df3a6c0 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: #1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
sebdeleze pushed a commit that referenced this issue Jun 3, 2021
@jma
operation logs: use an Elasticsearch only resource
16f28ce 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: #1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
sebdeleze pushed a commit that referenced this issue Jun 3, 2021
@jma
operation logs: use an Elasticsearch only resource
ca8bd6d 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: #1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
sebdeleze pushed a commit that referenced this issue Jun 9, 2021
@jma
operation logs: use an Elasticsearch only resource
927a040 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: #1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
jma added a commit that referenced this issue Jun 12, 2021
@jma
operation logs: use an Elasticsearch only resource
4188f55 
* Renames virtua command CLI name.
* Fixes monitor view to compute Elasticsearch and DB count diff when the
  index does not exists.
* Creates an operation logs Elasticsearch record class. It creates one
  index per year.
* Denies to all to read one record.
* Adds a CLI to dumps the operation logs in a JSON file for backup.
* Closes: #1725.

Co-Authored-By: Johnny Mariéthoz <Johnny.Mariethoz@rero.ch>
@jma jma closed this as completed in 3323f70 Jun 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jma jma

Labels
developers From a developer point of view. enhancement Improvement of an existing feature p-High High priority (to be solved in the 2-3 next months) performance
Projects
None yet
Milestone
v1.3.0
Development

No branches or pull requests
4 participants
@jma @iGormilhit @pronguen @BadrAly