Configuration

The main purpose of aDMIX is to take over the interaction with the data management tool Rucio (source) what is provided by ATLAS. Therefore you need to setup aDMIX with several configuration files which present the data outline of your experiment on local disks and the later data naming convention in Rucio with containers, datasets and files.

This part of the documentation guides you through the necessary configuration.

aDMIX basic configuration

The basic configuration from an example configuration file is given here in /admix/config/host_config_dummy.config

{
    "host": "A short abbreviation of hostname to which individual database data locations refer",
    "hostname": "The hostname where aDMIX is executed",
    "log_path": "/path/to/your/logfile.log",
    "type": [], #["datatype1", "datatype2", ..., "datatypeN"], A list of individual data types you like to handle in your experiment
    "detector": [], #["tpc", "mv"], Specify detector names. NOT YET SUPPORTED
    "source": [], #["ambe", "none"], Specify a certain sources. Select data by sources. NOT YET SUPPORTED
    "template":"/path/to/your/datatype/template/xenon1t_template.config",
    "rucio_backend": "API", # Allow API or CLI, depending what configuration you prefer. CLI is legacy
    "rucio_account": "YOUR RUCIO ACCOUNT",
    "rucio_x509": "/path/to/x509/proxy/ticket",
    "rucio_template": "/path/to/Rucio/datatype/template/format.config",
    "rucio_cli": "/path/to/Rucio/CLI/calls/rucio_cli/",
    "database": {
                    "type":"MongoDB",
                    "address": "mongodb://address of your mongoDB (r/w requiered)",
                    "user": "mongodb_user",
                    "password": "mongdb_password",
                    "collection": "xenon1t-runs",
                    "projection": {"_id": true,
                                   "name": true,
                                   "number": true,
                                   "data": true,
                                   "detector": true,
                                   "start":true
                    }
                },
    "sleep_time": 5,
    "experiment": "Xenon1T"
}

To begin with you need to setup certain keys beforehand:

  • host: A short abbreviation of hostname to which individual database data locations refer later.

    The hostname of your data facility is data-host1.cluster.aws.com. To manage your data locations later in a database or simplicity, you will use an abbreviation for the long hostname (e.g. data-host1):

    data-host1:
    • /data/path/to/dataset/dataset_01
    • /data/path/to/dataset/dataset_02
    • /data/path/to/dataset/dataset_03
  • hostname: The hostname of your data facility. For practial reasons this should be same name such it is used in your HOSTNAME bash variable.

  • log_path: Specify the path to your log file. All logs will go into one log file. Log file rotation is not yet supported.