Skip to content

Commit

Permalink
Merge pull request #7 from ral-facilities/flavor_checks
Browse files Browse the repository at this point in the history
Correct Flavors Match CPUs/RAM
  • Loading branch information
oxfordfun authored Feb 28, 2024
2 parents 6916d26 + 79c145f commit ceb8571
Show file tree
Hide file tree
Showing 75 changed files with 235 additions and 476 deletions.
18 changes: 9 additions & 9 deletions docs/2023-06-TechUpdate.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
Expand Down Expand Up @@ -91,20 +91,20 @@
<div itemprop="articleBody">

<section id="isis-daaas-tech-update-june-2023">
<h1>ISIS DAaaS Tech Update - June 2023<a class="headerlink" href="#isis-daaas-tech-update-june-2023" title="Permalink to this heading"></a></h1>
<h1>ISIS DAaaS Tech Update - June 2023<a class="headerlink" href="#isis-daaas-tech-update-june-2023" title="Link to this heading"></a></h1>
<div class="toctree-wrapper compound">
<ul>
<li class="toctree-l1"><a class="reference internal" href="isis-data-cache-2023.html">ISIS Instrument Data Cache 2023</a></li>
</ul>
</div>
<section id="platform">
<h2>Platform<a class="headerlink" href="#platform" title="Permalink to this heading"></a></h2>
<h2>Platform<a class="headerlink" href="#platform" title="Link to this heading"></a></h2>
<p>As you may be aware, CentOS has reached its end of life. To ensure
continued security, stability, and support, we have migrated the DAaaS
platform to Rocky 8 Linux, a reliable and compatible alternative.</p>
</section>
<section id="workspaces">
<h2>Workspaces<a class="headerlink" href="#workspaces" title="Permalink to this heading"></a></h2>
<h2>Workspaces<a class="headerlink" href="#workspaces" title="Link to this heading"></a></h2>
<p>We have also been working on upgrading workspaces to Rocky 8 Linux. This
will replace the aging CentOS7 Linux distribution we currently use.</p>
<p>In the coming months, we will work with each instrument group one-by-one
Expand All @@ -115,7 +115,7 @@ <h2>Workspaces<a class="headerlink" href="#workspaces" title="Permalink to this
each group for this upgrade.</p>
</section>
<section id="data">
<h2>Data<a class="headerlink" href="#data" title="Permalink to this heading"></a></h2>
<h2>Data<a class="headerlink" href="#data" title="Link to this heading"></a></h2>
<p>In the new updated workspaces, we also plan to disconnect ISIS Archive
from workspaces. All new workspaces will use ISIS Instrument Data Cache,
which aligns with ISIS Data Policy.</p>
Expand Down
22 changes: 11 additions & 11 deletions docs/2024-01-TechUpdate.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
Expand Down Expand Up @@ -96,7 +96,7 @@
<div itemprop="articleBody">

<section id="isis-daaas-tech-update-january-2024">
<h1>ISIS DAaaS Tech Update - January 2024<a class="headerlink" href="#isis-daaas-tech-update-january-2024" title="Permalink to this heading"></a></h1>
<h1>ISIS DAaaS Tech Update - January 2024<a class="headerlink" href="#isis-daaas-tech-update-january-2024" title="Link to this heading"></a></h1>
<div class="toctree-wrapper compound">
<ul>
<li class="toctree-l1"><a class="reference internal" href="isis-data-cache-2024.html">ISIS Instrument Data Cache 2024</a></li>
Expand All @@ -106,25 +106,25 @@ <h1>ISIS DAaaS Tech Update - January 2024<a class="headerlink" href="#isis-daaas
</ul>
</div>
<section id="workspaces">
<h2>Workspaces<a class="headerlink" href="#workspaces" title="Permalink to this heading"></a></h2>
<h2>Workspaces<a class="headerlink" href="#workspaces" title="Link to this heading"></a></h2>
<p>Rocky Linux 8 is available on all workspaces from <strong>5 February 2024</strong>.</p>
<p>Many thanks to all the instrument scientists at the ISIS facility who have assisted in testing the new workspaces since September 2023.</p>
</section>
<section id="data">
<h2>Data<a class="headerlink" href="#data" title="Permalink to this heading"></a></h2>
<h2>Data<a class="headerlink" href="#data" title="Link to this heading"></a></h2>
<p>ISIS Data cache is the main data source for instrument data from <strong>5 February 2024</strong>.</p>
<p>The summary of changes and follow-up actions after the Tech Update can be found in Section <a class="reference internal" href="isis-data-cache-2024.html"><span class="doc">ISIS Instrument Data Cache 2024</span></a>.</p>
</section>
<section id="specification">
<h2>Specification<a class="headerlink" href="#specification" title="Permalink to this heading"></a></h2>
<h2>Specification<a class="headerlink" href="#specification" title="Link to this heading"></a></h2>
<p><a class="reference internal" href="isis-specifications.html"><span class="doc">ISIS Specifications</span></a> of all workspaces are here for review. Please send feedback to our support if any updates needed.</p>
</section>
<section id="training">
<h2>Training<a class="headerlink" href="#training" title="Permalink to this heading"></a></h2>
<h2>Training<a class="headerlink" href="#training" title="Link to this heading"></a></h2>
<p>Check out our <a class="reference external" href="https://training.analysis.stfc.ac.uk/">Training site</a> if you are an organizer of conferences, workshops or training courses.</p>
</section>
<section id="to-do-list-from-tech-update-01-2024">
<h2>To-do list from Tech Update 01/2024<a class="headerlink" href="#to-do-list-from-tech-update-01-2024" title="Permalink to this heading"></a></h2>
<h2>To-do list from Tech Update 01/2024<a class="headerlink" href="#to-do-list-from-tech-update-01-2024" title="Link to this heading"></a></h2>
<ol class="arabic simple" start="0">
<li><p>Keep cycle folder structure as it was in Archive. (Done)</p></li>
<li><p>Files in RB0 folders are also available from Cycle folders. (Done)</p></li>
Expand Down
12 changes: 6 additions & 6 deletions docs/clf-specifications.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
Expand Down Expand Up @@ -83,7 +83,7 @@
<div itemprop="articleBody">

<section id="clf-specifications">
<h1>CLF Specifications<a class="headerlink" href="#clf-specifications" title="Permalink to this heading"></a></h1>
<h1>CLF Specifications<a class="headerlink" href="#clf-specifications" title="Link to this heading"></a></h1>
<table class="docutils align-default">
<colgroup>
<col style="width: 19%" />
Expand Down
12 changes: 6 additions & 6 deletions docs/clf.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
Expand Down Expand Up @@ -82,7 +82,7 @@
<div itemprop="articleBody">

<section id="clf">
<h1>CLF<a class="headerlink" href="#clf" title="Permalink to this heading"></a></h1>
<h1>CLF<a class="headerlink" href="#clf" title="Link to this heading"></a></h1>
<div class="toctree-wrapper compound">
<ul>
<li class="toctree-l1"><a class="reference internal" href="clf-specifications.html">CLF Specifications</a></li>
Expand Down
Binary file modified docs/doctrees/2023-06-TechUpdate.doctree
Binary file not shown.
Binary file modified docs/doctrees/2024-01-TechUpdate.doctree
Binary file not shown.
Binary file modified docs/doctrees/clf-specifications.doctree
Binary file not shown.
Binary file modified docs/doctrees/clf.doctree
Binary file not shown.
Binary file modified docs/doctrees/environment.pickle
Binary file not shown.
Binary file modified docs/doctrees/index.doctree
Binary file not shown.
Binary file modified docs/doctrees/isis-data-cache-2023.doctree
Binary file not shown.
Binary file modified docs/doctrees/isis-data-cache-2024.doctree
Binary file not shown.
Binary file modified docs/doctrees/isis-specifications.doctree
Binary file not shown.
Binary file modified docs/doctrees/isis.doctree
Binary file not shown.
Binary file modified docs/doctrees/scientific-computing.doctree
Binary file not shown.
Binary file modified docs/doctrees/services.doctree
Binary file not shown.
Binary file modified docs/doctrees/software.doctree
Binary file not shown.
Binary file modified docs/doctrees/training.doctree
Binary file not shown.
10 changes: 5 additions & 5 deletions docs/genindex.html
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="#" />
<link rel="search" title="Search" href="search.html" />
Expand Down
12 changes: 6 additions & 6 deletions docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
Expand Down Expand Up @@ -78,7 +78,7 @@
<div itemprop="articleBody">

<section id="welcome-to-daaas-tech-updates">
<h1>Welcome to DAaaS Tech Updates<a class="headerlink" href="#welcome-to-daaas-tech-updates" title="Permalink to this heading"></a></h1>
<h1>Welcome to DAaaS Tech Updates<a class="headerlink" href="#welcome-to-daaas-tech-updates" title="Link to this heading"></a></h1>
<div class="toctree-wrapper compound">
<ul>
<li class="toctree-l1"><a class="reference internal" href="clf.html">CLF</a><ul>
Expand Down
30 changes: 15 additions & 15 deletions docs/isis-data-cache-2023.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@
<script src="static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="static/jquery.js"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js"></script>
<script data-url_root="./" id="documentation_options" src="static/documentation_options.js"></script>
<script src="static/doctools.js"></script>
<script src="static/sphinx_highlight.js"></script>
<script src="static/jquery.js?v=5d32c60e"></script>
<script src="static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="static/documentation_options.js?v=f2a433a1"></script>
<script src="static/doctools.js?v=888ff710"></script>
<script src="static/sphinx_highlight.js?v=dc90522c"></script>
<script src="static/js/theme.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
Expand Down Expand Up @@ -103,10 +103,10 @@
<div itemprop="articleBody">

<section id="isis-instrument-data-cache-2023">
<h1>ISIS Instrument Data Cache 2023<a class="headerlink" href="#isis-instrument-data-cache-2023" title="Permalink to this heading"></a></h1>
<h1>ISIS Instrument Data Cache 2023<a class="headerlink" href="#isis-instrument-data-cache-2023" title="Link to this heading"></a></h1>
<p>updated: 2023-06</p>
<section id="brief">
<h2>Brief<a class="headerlink" href="#brief" title="Permalink to this heading"></a></h2>
<h2>Brief<a class="headerlink" href="#brief" title="Link to this heading"></a></h2>
<p>We are still working towards disconnecting the Archive from the Workspaces and replacing it with the Instrument Data Cache.
This is so we can make the service adhere to the <a class="reference external" href="https://www.isis.stfc.ac.uk/Pages/Data-Policy.aspx">ISIS Data Policy</a>.
This is just a change to the Workspaces and will not impact the Archive in any other way.
Expand All @@ -118,7 +118,7 @@ <h2>Brief<a class="headerlink" href="#brief" title="Permalink to this heading">
<p>If you need to access older data, you can download it from <a class="reference external" href="https://data.isis.stfc.ac.uk/">DataGateway</a>.</p>
</section>
<section id="introduction">
<h2>Introduction<a class="headerlink" href="#introduction" title="Permalink to this heading"></a></h2>
<h2>Introduction<a class="headerlink" href="#introduction" title="Link to this heading"></a></h2>
<p>The ISIS Instrument Data Cache is an alternative to the ISIS Archive on
IDAaaS. The ISIS Data Cache is a store of instrument data located on
SCD’s Ceph storage cluster that contains data copied directly from
Expand All @@ -127,7 +127,7 @@ <h2>Introduction<a class="headerlink" href="#introduction" title="Permalink to t
Data Cache so that you will have access to past data.</p>
</section>
<section id="why">
<h2>Why?<a class="headerlink" href="#why" title="Permalink to this heading"></a></h2>
<h2>Why?<a class="headerlink" href="#why" title="Link to this heading"></a></h2>
<p>Data in the cache is access-restricted so that only members of the
relevant experiment group and instrument scientists will have access to
the data, whilst nobody else will be able to access the data.</p>
Expand All @@ -136,15 +136,15 @@ <h2>Why?<a class="headerlink" href="#why" title="Permalink to this heading"><
experiment data.</p>
</section>
<section id="how-frequently-is-the-data-updated">
<h2>How frequently is the data updated?<a class="headerlink" href="#how-frequently-is-the-data-updated" title="Permalink to this heading"></a></h2>
<h2>How frequently is the data updated?<a class="headerlink" href="#how-frequently-is-the-data-updated" title="Link to this heading"></a></h2>
<p>We are running a service called the Cache Updater which will check
periodically (ideally at least every 10 seconds) to see if there are any
new files to be copied from instrument PCs.</p>
<p>New data from instrument PCs should appear in the Data Cache in under 5
minutes depending on the file size.</p>
</section>
<section id="what-data-are-captured">
<h2>What data are captured?<a class="headerlink" href="#what-data-are-captured" title="Permalink to this heading"></a></h2>
<h2>What data are captured?<a class="headerlink" href="#what-data-are-captured" title="Link to this heading"></a></h2>
<p>All run files should be captured, for RB pre-fixed experiments (listed
below) will be in RB folders, others will be in a folder called Unknown.</p>
<table class="docutils align-default">
Expand Down Expand Up @@ -206,15 +206,15 @@ <h2>What data are captured?<a class="headerlink" href="#what-data-are-captured"
</table>
</section>
<section id="how-to-access-the-data-cache">
<h2>How to access the Data Cache?<a class="headerlink" href="#how-to-access-the-data-cache" title="Permalink to this heading"></a></h2>
<h2>How to access the Data Cache?<a class="headerlink" href="#how-to-access-the-data-cache" title="Link to this heading"></a></h2>
<p>Please access the shortcut under Data on the Applications menu called
“Instrument Data Cache” at your workspaces.</p>
<p>This will take you to the data cache via the file browser GUI. For
command line access, there is a symlink at /data/cache which points to
the cache directory.</p>
</section>
<section id="where-to-find-the-data">
<h2>Where to find the data?<a class="headerlink" href="#where-to-find-the-data" title="Permalink to this heading"></a></h2>
<h2>Where to find the data?<a class="headerlink" href="#where-to-find-the-data" title="Link to this heading"></a></h2>
<p>The data cache has the following directory structure:
<strong>INSTRUMENT/YEAR/RB NUMBER</strong></p>
<p>For example, to find instrument data from the 2022 WISH experiment
Expand All @@ -235,14 +235,14 @@ <h2>Where to find the data?<a class="headerlink" href="#where-to-find-the-data"
Scheduler and thus be placed in the correct folder.</p>
</section>
<section id="monitoring-and-alerting">
<h2>Monitoring and Alerting<a class="headerlink" href="#monitoring-and-alerting" title="Permalink to this heading"></a></h2>
<h2>Monitoring and Alerting<a class="headerlink" href="#monitoring-and-alerting" title="Link to this heading"></a></h2>
<p>We have monitoring and alerting system set up so that we should be
alerted if the Cache Updater service goes down. Alerts will be sent and
responded to both during the day and out-ofhours for this service so
that disruption to instrument data access is minimized.</p>
</section>
<section id="support">
<h2>Support<a class="headerlink" href="#support" title="Permalink to this heading"></a></h2>
<h2>Support<a class="headerlink" href="#support" title="Link to this heading"></a></h2>
<p>Get in touch if you have any queries: <a class="reference external" href="mailto:supportanalysis&#37;&#52;&#48;stfc&#46;ac&#46;uk">supportanalysis<span>&#64;</span>stfc<span>&#46;</span>ac<span>&#46;</span>uk</a>.</p>
</section>
</section>
Expand Down
Loading

0 comments on commit ceb8571

Please sign in to comment.