-
Notifications
You must be signed in to change notification settings - Fork 6
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #120 from icatproject/collab_meeting_20230831
Add 20230831 meeting notes from HackMD
- Loading branch information
Showing
1 changed file
with
143 additions
and
0 deletions.
There are no files selected for viewing
143 changes: 143 additions & 0 deletions
143
.../collaboration/communication/monthly-meetings/2023-meetings/20230831-meeting.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,143 @@ | ||
| # ICAT Collaboration Meeting 31st August 2023 | ||
|
|
||
| Attendees | ||
| - Gabriel | ||
| - Allan | ||
| - Kirsty | ||
| - Alejandra | ||
| - Alex | ||
| - Patrick | ||
| - Andy | ||
| - Marjolaine | ||
| - Viktor | ||
| - Christopher | ||
|
|
||
|
|
||
| ## Agenda | ||
|
|
||
| 1. Introductions (if needed) | ||
| 2. ICALEPCS paper | ||
| 3. Extra meetings being arranged | ||
| - E-logbooks: https://terminplaner6.dfn.de/de/p/50ab9986e7d3334ee89bc3c088352098-352747 | ||
| - Sample tracking: https://doodle.com/meeting/participate/id/bqZ4v8Gd | ||
| 4. Java version discussion | ||
| 5. Usual components and site updates | ||
| 6. AOB | ||
|
|
||
| ## Introductions | ||
| Chris for Allan/Gabriel | ||
|
|
||
| ## ICALEPS paper | ||
| - Deadline early October | ||
| - Andy plans to create paper on Overleaf | ||
| - Suggestions for draft sections/topics | ||
| - Summary of sites (facilities) and their status | ||
| - ICALEPS link: | ||
| - Intention is to send update on the lastest ICAT developments | ||
| - Andy will be chairing conference, only author planned to attend the conference | ||
| - Meeting in a week to confirm sections | ||
| - Organise now? Next Thursday same time? | ||
| - Alejandra can't make it but not everyone needs to be there - meet anyway | ||
|
|
||
| ## Extra meetings | ||
|
|
||
| ### E-logbooks | ||
| https://terminplaner6.dfn.de/de/p/50ab9986e7d3334ee89bc3c088352098-352747 | ||
| - Looking like 14th of September is most popular date? | ||
| - Wait until Rolf is back to organise the meeting | ||
| - Wait for feedback from HZB e-logbook contributor (Marcus?) - final decision on date next week | ||
| - Probably back from the 12th | ||
| - Andy: Interest from other communities - is this an internal meeeting? Yes | ||
|
|
||
|
|
||
| ### Sample tracking | ||
| https://doodle.com/meeting/participate/id/bqZ4v8Gd | ||
| Allan to orgnaise. Deadline for filling form for next Monday - send reminder then. | ||
| - Sirius has a problem with some beamline which want sample tracking (SAXS, powder diffraction and tomography beamlines) | ||
| - ESRF have a WIP tracking solution which joins the ispyb and ICAT Samples | ||
| - Good time for discussion for if (Sirius) can collaborate on this | ||
| - Andy: see no problem with supporting multiple techniques | ||
| - Allan: is this feasible? does it make sense to have information for the different domains in the same interface | ||
| - Alex: when the samples are sent to the synchotron, we want to know where the sample is and also describe it. Parameters are determined by the acquisition panel - (temperate etc.) also processing parameters (what has been done). This is more than just "sample tracking" in terms of location. | ||
| - Allan: Sirius has two beamlines that do want to know T and other physical parameters. Special case at Sirius for safety of the sample - user needs to fill in a form to assure the safety of the sample at Sirius. Want a way of extracting this information. What is the pipeline from user sending the sample to then sending the form - how are other synchotrons doing this? | ||
| - Alex: Have safety concerns as well. Have a [diagram](https://confluence.esrf.fr/pages/viewpage.action?spaceKey=PROJSAMPLETRACKING&title=Parcel+status+diagram) showing the process. | ||
| - Alejandra: we are also interested in how people are doing this and want to know if the description of samples can be standardised and shared. | ||
| - Kirsty: there is interest/progress along these lines at DLS as well (but Kirsty is not the person to ask about it) | ||
|
|
||
| ## Java versions | ||
| https://www.oracle.com/java/technologies/java-se-support-roadmap.html | ||
| - Might be worth waiting for Rolf as he raised this. | ||
| - Discussion ongoing via the mailing list | ||
| - Pros/cons of running 11/17 in production? | ||
| - Rolf wants to see "results" - i.e. a conclusion on what to use | ||
| - ESRF have no plans - using Java 8 and if it is not necessary do not want to change | ||
| - Alan: Payara supports 11, 17, 21, move to 17? | ||
| - Allan: has concerns about security of 11 | ||
| - https://www.oracle.com/java/technologies/java-se-support-roadmap.html | ||
|
|
||
|
|
||
| ## Site updates | ||
|
|
||
| ### ESRF: Alex | ||
| - Still working on supporting crystallography with ICAT | ||
| - Goal is to have one beamline simultaneously on ICAT and ispyb | ||
| - Support for running workflows and the results ending up in ICAT | ||
| - Workflow could mean anything. Could run on the edge (beamline) or the cluster | ||
| - Alejandra: what is the script? Anything you want, python script etc. | ||
| - Support multiple workflow engines: | ||
| - https://gitlab.esrf.fr/workflow/ewoks/ewoks | ||
| - https://streamline.esrf.fr/non-classe/ewoks-the-esrf-workflow-system/ | ||
| - Don't like CWL as is not feature complete - does not support loops, for example | ||
| - Marjolaine is working on a new access method to the data (have IDS and MongoDB for small files) but want larger file support - "/online" | ||
| - Will be archived but also accessible 10 -> 100 MB in size | ||
| - "online" directory treated differently than "gallery" for example | ||
|
|
||
| ### HZB: Gabriel | ||
| - No real updates, still down from the cyber attack, no realistic timeline for when things will be running again - open time frame | ||
| - Rolf has announced snapshot releases for several minor components. | ||
| - ANdy: security of ICAT being considered? | ||
| - ICAT has nothing to do with the cyber attack. To prevent fututre attacks the network infrastructure of the institute external facing tools are being discussed. ICAT will not be online until this is resolved. | ||
|
|
||
| ### ALBA: No-one present | ||
|
|
||
| ### Sirius: Allan | ||
| - Almost finished K8s infrastructure but no update to give | ||
| - In November want to have ICAT running in production - good time as a nation attempting data standardisation - two techniques | ||
| - Andy: installing ICAT+? Docker compose is the thing working for them, working through the icatproject documentation | ||
| - Sesame have ICAT running | ||
|
|
||
| ### ISIS: No-one present | ||
|
|
||
| ### DLS: Kirsty and Chris | ||
| - Yesterday moved ingest to K8s - "baby steps" | ||
| - Hopeful improve stability and make more improvements in the future | ||
| - Have been running ICAT6 (Payara6 etc.) for a month | ||
| - Had minor performance issues with DB, created new indices to improve READs | ||
| - Also upgrading servers for ingesting to tape to improve throughput 60TB a day currently | ||
| - Want to duplicate ingest path to double the throughput | ||
|
|
||
| ## Component updates | ||
| Snapshot releases mentioned in email from Rolf | ||
|
|
||
| ### icat.server | ||
|
|
||
| ### ids.server | ||
|
|
||
| ### authn.oidc & icat.oaipmh | ||
|
|
||
| ### DataGateway | ||
|
|
||
| ### icat-doi-api | ||
|
|
||
| ### DataHub | ||
|
|
||
| ## AOB | ||
|
|
||
| Gabriel wants to join mailing list - but this requires linking the business and personal accounts | ||
| - Viktor knows a way of subscribing without using GMail | ||
| - icatgroup+subscribe@googlegroups.com | ||
|
|
||
| Some emails to the mailing list get flagged as spam/moderation | ||
| - Requires AGB to manually approve emails which get caught (unclear what triggers this) | ||
|
|
||
| Next meeting on the 28th of September. Alejandra unable to chair. |