This package is used to centrally produced events for FCC-hh at a center of mass of 100 TeV and for FCC-ee. Any other future collider can also be supported by this framework. In order to use it, please get in contact with the FCC software and computing coordinators as running this package requieres specific rights.
- EventProducer
- Table of contents
- Clone and initialisation
- Generate LHE events from gridpacks
- Generate LHE files directly from MG5
- Generate FCCSW files from the LHE and decay with Pyhtia8
- Generate FCCSW files from Pythia8
- Expert mode
If you do not attempt to contribute to the repository, simply clone it:
git clone git@github.com:HEP-FCC/EventProducer.git
If you aim at contributing to the repository, you need to fork and then clone the forked repository:
git clone git@github.com:YOURGITUSERNAME/EventProducer.git
Then initialise:
source ./init.sh
To send jobs starting from a gridpack that does not exist but that you have produced, do the following:
- place gridpack on eos
- for FCC-hh
/eos/experiment/fcc/hh/generation/gridpacks/
- for FCC-ee
/eos/experiment/fcc/ee/generation/gridpacks/
- for FCC-hh
- if the gridpack is from Madgraph, name it
mg_process
(and call optiongp_mg
when running generation commands), if from powheg please name itpw_process
(and call optiongp_pw
), - add to
config/param_FCCee.py
an entry corresponding to the gridpack name in thegridpacklist
list, depending on the study.
If the gridpack already exists or has been properly added to the param
, then simply run:
python bin/run.py --FCCee --LHE --send --condor --typelhe <gp> -p <process> -n <nevents> -N <njobs> -q <queue> --prodtag <prodtag> --detector <detector>
example to send 10 jobs of 10 000 events of ZHH events at 365GeV using the longlunch queue of HTCondor for FCC--ee for the spring2021 production tag and the IDEA detector:
python bin/run.py --FCCee --LHE --send --condor --typelhe gp_mg -p mg_ee_zhh_ecm365 -n 10000 -N 10 -q longlunch --prodtag spring2021 --detector IDEA
The options --ncpus
and --priority
can also be specified to increase the numbers of cpus on the cluster and to change the priority queue.
To send jobs directly from MG5, you need a configuration file (see in mg5/examples
directory *.mg5
) and, optionally:
- a
cuts.f
file (containing additional cuts) - a model (see in
models
directory for instance)
N.B. At the moment no example is generated for FCC-ee this way. Below is an example for FCC-hh.
As before, you need to add the process to the config/param_FCChh.py
file. Thn you can run with the following command:
python bin/run.py --FCC --LHE --send --condor --typelhe mg -p mg_pp_hh_test --mg5card mg5/examples/pp_hh.mg5 --model mg5/models/loop_sm_hh.tar -N 2 -n 10000 -q workday --memory 16000. --disk 8000.
The options --ncpus
and --priority
can also be specified to increase the numbers of cpus on the cluster and to change the priority queue.
- if you want to let pythia decay without specifiying anything, you can use the default card, but if you have requested extra partons at matrix element, you might need to specify matching parameters to your pythia card
- if you want to use a specific decay, make sure that the decay you want is in
decaylist
andbranching_ratios
of theparam
- then create appropriate pythia8 card, by appending standard card with decay syntax if needed and add it to the proper directory. For FCC-ee this directory is
/eos/experiment/fcc/ee/generation/FCC-config/spring2021/FCCee/Generator/Pythia8/
N.B.: please do not write there directly. Cards should be added by making a PR to https://github.com/HEP-FCC/FCC-config/tree/spring2021.
- Run jobs:
python bin/run.py --FCChh/FCCee --reco --send --type lhep8 --condor -p <process> -N <njobs> -q <queue> --prodtag <prodtag> --detector <detector>
Example produce 10 jobs of FCC Delphes events of ttz decaying the Z to neutrinos. :
python bin/run.py --FCCee --reco --send --type lhep8 --condor -p mg_ee_zhh_ecm365 -N 10 -q workday --prodtag spring2021 --detector IDEA
Please note that the decay in pythia is optional, and that there is no need to specify the number of events to run on as it will by default run over all the events present in the LHE file
The options --ncpus
and --priority
can also be specified to increase the numbers of cpus on the cluster and to change the priority queue.
The Pythia8 manual is available here: http://home.thep.lu.se/~torbjorn/pythia81html/Welcome.html
-
Define process in pythialist in the
param
corresponding to your job flavour -
Write Pythia8 process card and put it in:
/eos/experiment/fcc/ee/generation/FCC-config/spring2021/FCCee/Generator/Pythia8
by making a PR to https://github.com/HEP-FCC/FCC-config/tree/spring2021, for examplep8_ee_Zbb_ecm91.cmd
-
send jobs
python bin/run.py --FCC-hh/FCCee --reco --send --type p8 --condor -p <process> --pycard <pythia_card> -n <nevents> -N <njobs> -q <queue> --prodtag <prodtag> --detector <detector>
Example produce 1 job of 10000 events of ZH at FCC-ee 240GeV
python bin/run.py --FCCee --reco --send --type p8 -p p8_ee_ZH_ecm240 -n 10000 -N 1 --condor -q longlunch --prodtag spring2021 --detector IDEA
The options --ncpus
and --priority
can also be specified to increase the numbers of cpus on the cluster and to change the priority queue.
Important: If --pycard
option not specified, this step wil lrun with the default pythia8 card (in this case p8_ee_default.cmd
), that does not include specific decays nor specific matching/merging parameters.
The following commands should be run with care, as they update the database, webapge etc...
They run every two hours with crontab, thus you will eventually know when your sample is ready to be used.
The --force
option is used to force the script to run as to optimze running time, processes that have not been flagged will not be checked.
- First one need to check the eos directories that have been populated with new files. Example for LHE:
python bin/run.py --FCCee --LHE --checkeos [--process process] [--force]
Example for Delphes events:
python bin/run.py --FCCee --reco --checkeos --prodtag fcc_v04 [--process process] [--force]
- Second one need to check the quality of the files that have been produced. Example for LHE:
python bin/run.py --FCCee --LHE --check [--process process] [--force]
Example for Delphes events:
python bin/run.py --FCCee --reco --check --prodtag fcc_v04 [--process process] [--force]
- Then the checked files needs to be merged: Example for LHE:
python bin/run.py --FCCee --LHE --merge [--process process] [--force]
Example for Delphes events:
python bin/run.py --FCCee --reco --merge --prodtag fcc_v04 [--process process] [--force]
To clean jobs that are flagged as bad, the following command can be used for LHE:
python bin/run.py --FCCee --LHE --clean [--process process]
and for Delphes
python bin/run.py --FCCee --reco --clean --prodtag spring2021 [--process process]
As the code checks the files that are in the end written on eos, we need to clean also old jobs that don't produced outputs 3 days after they started. To do so run the following command for LHE
python bin/run.py --FCCee --LHE --cleanold [--process process]
and for Delphes
python bin/run.py --FCCee --reco --cleanold --prodtag spring2021 [--process process]
If you want to completly remove a process, the following command can be used with care for LHE:
python bin/run.py --FCCee --LHE --remove --process process
and for Delphes
python bin/run.py --FCCee --reco --remove --process process --prodtag spring2021
The webpage can be updated after the files have been checked and merged by running for LHE
python bin/run.py --FCCee --LHE --web
and for Delphes
python bin/run.py --FCCee --reco --web --prodtag spring2021
To create the list of samples to be used in physics analyses
python bin/run.py --FCCee --reco --sample --prodtag spring2021
The EventProducer depends on two hardcoded AFS locations to deploy the FCCDicts
to. The groups fccsw:fccdicts-read
and fccsw:fccdicts-write
should have the
following access rights:
[fccsw@lxplus767 ~]$ fs listacl /afs/cern.ch/work/f/fccsw/public/FCCDicts
Access list for /afs/cern.ch/work/f/fccsw/public/FCCDicts is
Normal rights:
fccsw:fccdicts-write rlidwk
fccsw:fccdicts-read rl
system:administrators rlidwka
system:anyuser rl
fccsw rlidwka
[fccsw@lxplus767 ~]$ fs listacl /afs/cern.ch/user/f/fccsw/www/data/FCCDicts
Access list for /afs/cern.ch/user/f/fccsw/www/data/FCCDicts is
Normal rights:
fccsw:fccdicts-write rlidwk
fccsw:fccdicts-read rl
webserver:afs rl
system:administrators rlidwka
system:anyuser l
fccsw rlidwka