Add self hosted runner

[fzimmermann89]

No description provided.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
src/mrpro/algorithms/csm
inati.py	24	1	96%	44
walsh.py	16	1	94%	34
src/mrpro/algorithms/dcf
dcf_voronoi.py	53	4	92%	15, 48–49, 76
src/mrpro/algorithms/optimizers
adam.py	20	1	95%	69
src/mrpro/algorithms/reconstruction
DirectReconstruction.py	28	16	43%	51–71, 85
IterativeSENSEReconstruction.py	13	1	92%	76
Reconstruction.py	50	22	56%	42, 54–56, 80–87, 104–113
RegularizedIterativeSENSEReconstruction.py	41	17	59%	96–100, 114–139
src/mrpro/data
AcqInfo.py	128	3	98%	26, 169, 207
CsmData.py	29	3	90%	15, 82–84
DcfData.py	45	8	82%	18, 66, 78–83
IData.py	67	9	87%	119, 125, 129, 159–167
IHeader.py	75	7	91%	75, 109, 127–131
KHeader.py	153	17	89%	25, 119–123, 150, 199, 210, 217–218, 221, 228, 260–271
KNoise.py	31	15	52%	39–52, 56–61
KTrajectory.py	69	5	93%	178–182
MoveDataMixin.py	140	18	87%	15, 113, 129, 143–145, 207, 323–325, 338, 417, 437–438, 440, 455–456, 458
QData.py	39	7	82%	42, 65–73
Rotation.py	674	35	95%	100, 198, 335, 433, 477, 495, 581, 583, 592, 626, 628, 691, 768, 773, 776, 791, 808, 813, 889, 1077, 1082, 1085, 1109, 1113, 1240, 1242, 1250–1251, 1315, 1397, 1690, 1846, 1881, 1885, 1996
SpatialDimension.py	232	21	91%	34, 104, 141, 148, 154, 274–276, 289–291, 325, 343, 356, 369, 382, 395, 404–405, 420, 429
acq_filters.py	12	1	92%	47
src/mrpro/data/_kdata
KData.py	134	18	87%	109–110, 125, 132, 142, 150, 204–205, 243, 248–249, 268–279
KDataRemoveOsMixin.py	29	2	93%	44, 46
KDataSelectMixin.py	19	2	89%	48, 63
KDataSplitMixin.py	48	3	94%	53, 84, 93
src/mrpro/data/traj_calculators
KTrajectoryCalculator.py	25	2	92%	23, 45
KTrajectoryIsmrmrd.py	13	2	85%	41, 50
KTrajectoryPulseq.py	31	1	97%	54
src/mrpro/operators
CartesianSamplingOp.py	89	3	97%	118, 157, 280
ConstraintsOp.py	60	2	97%	46, 48
EndomorphOperator.py	65	2	97%	228, 234
FiniteDifferenceOp.py	27	2	93%	40, 105
FourierOp.py	158	3	98%	263, 381, 386
Functional.py	71	5	93%	20–22, 117, 119
GridSamplingOp.py	136	9	93%	72–73, 82–83, 90–91, 94, 96, 98
LinearOperator.py	168	10	94%	55, 91, 190, 220, 261, 270, 278, 287, 295, 320
LinearOperatorMatrix.py	158	16	90%	82, 119, 152, 161, 166, 175–178, 191–194, 203, 215, 304, 331, 359
MultiIdentityOp.py	13	2	85%	43, 48
Operator.py	78	2	97%	25, 74
ProximableFunctionalSeparableSum.py	39	3	92%	50, 103, 110
SliceProjectionOp.py	173	8	95%	44, 61, 63, 69, 206, 227, 260, 300
WaveletOp.py	120	5	96%	152, 170, 205, 210, 233
ZeroPadOp.py	16	1	94%	30
src/mrpro/utils
filters.py	62	2	97%	44, 49
reshape.py	60	1	98%	191
slice_profiles.py	46	6	87%	20, 36, 113–116, 149
sliding_window.py	34	1	97%	34
split_idx.py	10	2	80%	43, 47
summarize_tensorvalues.py	11	9	18%	20–29
typing.py	18	11	39%	8–23
zero_pad_or_crop.py	31	6	81%	26, 30, 54, 57, 60, 63
TOTAL	4912	353	93%

Tests	Skipped	Failures	Errors	Time
2262	0 💤	0 ❌	0 🔥	2m 21s ⏱️

[github-actions]

📚 Documentation

📁 Download as zip
🔍 View online

[fzimmermann89]

That works if i run
docker run -it -e REPO_NAME=PTB-MR -e TOKEN=ABH.... image
with the image build from the Runner dockerfile on my laptop.

[fzimmermann89]

a worker token can be obtained via
curl -X POST -H "Authorization: Bearer $PAT" https://api.github.com/orgs/PTB-MR/actions/runners/registration-token | jq -r '.token' (PAT is a personal access token)

[fzimmermann89]

@schuenke @ckolbPTB
This seems to work with our proxy. The worker is currently running on e....30.
As long as we don't need artifacts etc that would require access to domains blocked by our firewall.

I am currently for testing using the latest mrpro image as base, so no cuda driver.

Also, we should decide when we run this. either only triggered via a comment by a maintainer or only after the merge to main.
And only approved workflows should be allowed to run on the self-hosted worker (setting in the organisation/settings/actions/worker pane)
It should not be possible to make our worker run code via forking without us approving it. We don't want to provide a crypto miner ;)

[fzimmermann89]

@lrlunin said he is interested in continuing here. He will start working using his laptop.

@ckolbPTB after your vacation, lets have a short chat about what system we can use for developing this.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
src/mrpro
_version.py	6	2	67%	7–8
src/mrpro/algorithms/csm
inati.py	24	1	96%	44
walsh.py	16	1	94%	53
src/mrpro/algorithms/dcf
dcf_voronoi.py	55	4	93%	15, 55–56, 89
src/mrpro/algorithms/optimizers
adam.py	20	1	95%	101
pdhg.py	79	3	96%	177–178, 184
pgd.py	51	4	92%	106, 151–154
src/mrpro/algorithms/reconstruction
DirectReconstruction.py	28	16	43%	59–79, 93
IterativeSENSEReconstruction.py	13	1	92%	79
Reconstruction.py	50	22	56%	42, 54–56, 80–87, 108–117
RegularizedIterativeSENSEReconstruction.py	41	17	59%	97–101, 115–140
src/mrpro/data
AcqInfo.py	128	3	98%	26, 169, 207
CsmData.py	29	3	90%	15, 84–86
DcfData.py	45	8	82%	18, 66, 78–83
IData.py	60	8	87%	129, 142, 171–179
IHeader.py	96	11	89%	103, 106, 116, 119, 122, 125, 162–166
KData.py	214	25	88%	111–112, 127, 134, 144, 152, 206–207, 245, 250–251, 270–281, 440, 442, 507, 522, 559, 590, 599
KHeader.py	153	17	89%	25, 119–123, 150, 199, 210, 217–218, 221, 228, 260–271
KNoise.py	31	15	52%	39–52, 56–61
KTrajectory.py	81	12	85%	112–117, 120–122, 207–211
MoveDataMixin.py	140	18	87%	28, 126, 142, 156–158, 220, 336–338, 351, 430, 450–451, 453, 468–469, 471
QData.py	39	7	82%	42, 65–73
Rotation.py	719	35	95%	101, 199, 336, 434, 478, 496, 583, 585, 594, 628, 630, 693, 770, 775, 778, 793, 810, 815, 891, 1079, 1084, 1087, 1111, 1115, 1243, 1245, 1253–1254, 1318, 1400, 1703, 1855, 1890, 1894, 2084
SpatialDimension.py	232	21	91%	34, 104, 141, 148, 154, 274–276, 289–291, 325, 343, 356, 369, 382, 395, 404–405, 420, 429
acq_filters.py	12	1	92%	47
src/mrpro/data/traj_calculators
KTrajectoryCalculator.py	25	2	92%	23, 45
KTrajectoryIsmrmrd.py	13	2	85%	41, 50
KTrajectoryPulseq.py	23	1	96%	55
src/mrpro/operators
CartesianSamplingOp.py	89	3	97%	118, 157, 280
ConstraintsOp.py	60	2	97%	46, 48
EndomorphOperator.py	32	2	94%	52, 58
FiniteDifferenceOp.py	27	2	93%	40, 105
FourierOp.py	73	2	97%	234, 239
Functional.py	77	9	88%	20–22, 117, 119, 226–228, 242
GridSamplingOp.py	136	9	93%	72–73, 82–83, 90–91, 94, 96, 98
LinearOperator.py	200	10	95%	48, 107, 217, 244, 251, 292, 301, 309, 326, 361
LinearOperatorMatrix.py	162	19	88%	82, 119, 152, 161, 166, 175–178, 191–194, 202–203, 208–209, 221, 310, 337, 364
MultiIdentityOp.py	13	2	85%	43, 48
NonUniformFastFourierOp.py	177	10	94%	69, 96, 206, 208, 241, 243, 302, 356, 406, 411
Operator.py	79	2	97%	32, 88
ProximableFunctionalSeparableSum.py	39	3	92%	50, 103, 110
SliceProjectionOp.py	174	8	95%	45, 62, 64, 70, 206, 227, 260, 300
WaveletOp.py	119	5	96%	151, 169, 204, 209, 232
ZeroPadOp.py	16	1	94%	30
src/mrpro/phantoms
brainweb.py	275	26	91%	325–335, 371, 427–430, 452–453, 458–459, 474, 520, 586–587, 606–609, 620, 622, 657–658, 671
src/mrpro/utils
filters.py	62	2	97%	44, 49
reshape.py	95	2	98%	110, 301
slice_profiles.py	47	6	87%	21, 37, 116–119, 152
sliding_window.py	34	1	97%	34
split_idx.py	10	2	80%	43, 47
summarize_tensorvalues.py	11	9	18%	20–29
typing.py	58	45	22%	9–217
zero_pad_or_crop.py	31	6	81%	26, 30, 55, 58, 61, 64
TOTAL	5553	449	92%

Tests	Skipped	Failures	Errors	Time
2461	0 💤	0 ❌	0 🔥	1m 54s ⏱️

[fzimmermann89]

https://github.com/ci-for-research/self-hosted-runners/blob/master/ubuntu-singularity/entrypoint.sh

Should work in singularity. Note the username environment variable.

[fzimmermann89]

please add a start-runner.sh script that uses the correct image, singularity call, etc, obtains the registration token etc.

otherwise we will forget how to actually start the runner on our cluster.

[lrlunin]

We would need to further decide when we would like to trigger the pytest-selfhosted...

[fzimmermann89]

This is currently blocked due to office politics.

Before enabling this, we might need some risk assesment.