Installing Grid Certificates on Coffea Casa

[derekgrove]

Hi,

I have been trying to use Coffea Casa (after working extensively with coffea on SWAN) and the first issue I ran into was when trying a basic query using Rucio:

from coffea.dataset_tools import rucio_utils
from coffea.dataset_tools.dataset_query import print_dataset_query
from rich.console import Console
from rich.table import Table

client = rucio_utils.get_rucio_client()
client

and I get this error:

Couldn't find a valid proxy.
---------------------------------------------------------------------------
CalledProcessError                        Traceback (most recent call last)
File /usr/local/lib/python3.10/site-packages/coffea/dataset_tools/rucio_utils.py:22, in get_proxy_path()
     21 try:
---> 22     subprocess.run("voms-proxy-info -exists -hours 1", shell=True, check=True)
     23 except subprocess.CalledProcessError:

File /usr/local/lib/python3.10/subprocess.py:526, in run(input, capture_output, timeout, check, *popenargs, **kwargs)
    525     if check and retcode:
--> 526         raise CalledProcessError(retcode, process.args,
    527                                  output=stdout, stderr=stderr)
    528 return CompletedProcess(process.args, retcode, stdout, stderr)

CalledProcessError: Command 'voms-proxy-info -exists -hours 1' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Exception                                 Traceback (most recent call last)
Cell In[2], line 1
----> 1 client = rucio_utils.get_rucio_client()
      2 client

File /usr/local/lib/python3.10/site-packages/coffea/dataset_tools/rucio_utils.py:57, in get_rucio_client(proxy)
     55 except Exception as e:
     56     print("Wrong Rucio configuration, impossible to create client")
---> 57     raise e

File /usr/local/lib/python3.10/site-packages/coffea/dataset_tools/rucio_utils.py:51, in get_rucio_client(proxy)
     49 try:
     50     if not proxy:
---> 51         proxy = get_proxy_path()
     52     nativeClient = Client()
     53     return nativeClient

File /usr/local/lib/python3.10/site-packages/coffea/dataset_tools/rucio_utils.py:24, in get_proxy_path()
     22     subprocess.run("voms-proxy-info -exists -hours 1", shell=True, check=True)
     23 except subprocess.CalledProcessError:
---> 24     raise Exception(
     25         "VOMS proxy expirend or non-existing: please run `voms-proxy-init -voms cms -rfc --valid 168:0`"
     26     )
     28 # Now get the path of the certificate
     29 proxy = subprocess.check_output(
     30     "voms-proxy-info -path", shell=True, text=True
     31 ).strip()

Exception: VOMS proxy expirend or non-existing: please run `voms-proxy-init -voms cms -rfc --valid 168:0`

So sure, I need to install my grid certificate and then run voms-proxy-init -voms cms -rfc --valid 168:0, I've done this a million times. So I follow the recipe I've done many times before:

cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ mkdir .globus
[cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ ls -a
.   .cache       .condor  dwg_analysis  .ipynb_checkpoints  .jupyter  logs        mycert.p12  processor_template.ipynb
..  coffea-casa  .config  .globus       .ipython            .local    lost+found  .npm        .servicex
[cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ openssl pkcs12 -in mycert.p12 -clcerts -nokeys -out $HOME/.globus/usercert.pem
Enter Import Password:
[cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ openssl pkcs12 -in mycert.p12 -nocerts -out $HOME/.globus/userkey.pem
Enter Import Password:
Enter PEM pass phrase:
Verifying - Enter PEM pass phrase:
[cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ chmod 600 $HOME/.globus/userkey.pem
[cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ chmod 600 $HOME/.globus/usercert.pem
[cms-jovyan@jupyter-derek-2ewilliam-2egrove-40cern-2ech ~]$ voms-proxy-init --valid 192:00 -voms cms
Enter GRID pass phrase:
Your identity: /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=dgrove/CN=853044/CN=Derek William Grove
Cannot open fileFilename=/home/cms-jovyan/.rnd
Function: 
Segmentation fault (core dumped)

and that's the error I'm getting at the end, a segfault and a mention of a .rnd file. I've never had this issue before on any of the other systems. CMS connect, lxplus, SWAN, cms lpc, none of them had this issue so I'm very confused. I checked my SWAN home directory and there is no .rnd file there, which this error claims it needs, so I don't understand whats going wrong here.

[oshadura]

@derekgrove since we are using tokens instead of x509 I realised coffea.dataset_tools is missing support for it (it requires to have only proxy :D ). I will try to add it asap!

For proxy generation looks like it work if to use instead: voms-proxy-init -voms cms -vomses /etc/vomses

[derekgrove]

Thank you for your swift response! I will try this after my meeting and post an update here then!

Edit: It works! This is the proper way (for now) to initialize the proxy on coffea-casa in the terminal. For reference I was running this basic code:

from coffea.dataset_tools import rucio_utils
from coffea.dataset_tools.dataset_query import print_dataset_query
from rich.console import Console
from rich.table import Table

client = rucio_utils.get_rucio_client()
client