Skip to content

Reports on datasets popularity and not-used data in ATLAS DDM

Notifications You must be signed in to change notification settings

ATLAS-Analytics/scrutiny

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data usage statistics for ATLAS DDM

Reports based on Rucio traces:

  • Volumes of data vs. number of accesses for last N months
  • The volume of datasets as s function of number of times accessed in periods of 3, 6, 9, 12 months and infinity
  • List of never used datasets
  • Detailed statistics on unused data by project and datatype

xAOD reports:

  • Analysed events of AODs/DAODs on the grid and locally over time
  • Fraction of AOD/DAOD events accessed on the grid and locally
  • Fraction of AOD/DAOD volume accessed on the grid and locally
  • Fraction of events read locally over time

Usage:

"Horn plots" and unused data:

  • ./process.sh

xAOD reports:

  • /.process_xaod.sh <start month> <end month>

The format for the months is YYYY-MM

Configuration

Data sources

Output

About

Reports on datasets popularity and not-used data in ATLAS DDM

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •