Please note the name at the end of the clone command!
git clone --recursive [email protected]:uhh-cms/cms-hh-bbtautau-pisa-Framework.git Framework
Following command activates the framework environment:
source env.sh
Production should be run on the server that have the crab stageout area mounted to the file system.
-
Load environment on CentOS8 machine
source $PWD/env.sh source /cvmfs/cms.cern.ch/common/crab-setup.sh voms-proxy-init -voms cms -rfc -valid 192:00
-
Create crab configs
python3 NanoProd/createCrabConfigs.py --samples config/samples_2018.yaml --output crab/Run2_2018
-
Check that all datasets are present and valid:
cat crab/Run2_2018/all_samples.txt| xargs python3 RunKit/checkDatasetExistance.py
-
Modify output and other site-specific settings in
config/overseer_cfg.yaml
. In particular:- site
- crabOutput
- localCrabOutput
- finalOutput
- renewKerberosTicket
-
Test that the code works locally (take one of the miniAOD files as an input). E.g.
python3 RunKit/nanoProdWrapper.py customise=Framework/NanoProd/customiseNano.customise skimCfg=config/skim.yaml maxEvents=100 sampleType=mc storeFailed=True era=Run2_2018 inputFiles=file:/eos/cms/store/group/phys_tau/kandroso/miniAOD_UL18/TTToSemiLeptonic.root ./RunKit/nanoProdCrabJob.sh
- check that output file
nano.root
is created correctly
- check that output file
-
Test a dryrun crab submission
python3 RunKit/crabOverseer.py --work-area crab_test --cfg config/overseer_cfg.yaml --no-loop config/crab_test.yaml
- NB. Crab estimates of processing time will not be accurate, ignore them.
- After the test, remove
crab_test
directory:rm -r crab_test
-
Test that post-processing task is known to law:
law index law run CrabNanoProdTaskPostProcess --help
-
Submit tasks using
RunKit/crabOverseer.py
. It is recommended to runcrabOverseer
in screen.python3 RunKit/crabOverseer.py --cfg config/overseer_cfg.yaml --no-loop crab/Run2_2018/FILE1.yaml crab/Run2_2018/FILE2.yaml ...
- Use
crab/Run2_2018/*.yaml
to submit all the tasks - For more information about available command line arguments run
python3 RunKit/crabOverseer.py --help
- For consecutive runs, if there are no modifications in the configs, it is enough to run
crabOverseer
without any arguments:python3 RunKit/crabOverseer.py
- Use
law run CreateNanoSkims --version prod_v1 --periods 2016,2016APV,2017,2018 --ignore-missing-samples True
python Studies/HHBTag/CreateTrainingSkim.py --inFile $CENTRAL_STORAGE/prod_v1/nanoAOD/2018/GluGluToBulkGravitonToHHTo2B2Tau_M-350.root --outFile output/skim.root --mass 350 --sample GluGluToBulkGraviton --year 2018 >& EventInfo.txt
python Common/SaveHisto.txt --inFile $CENTRAL_STORAGE/prod_v1/nanoAOD/2018/GluGluToBulkGravitonToHHTo2B2Tau_M-350.root --outFile output/skim.root