sys

The sys config group deals with system specific settings and allows you to set mml configuration for multiple compute hardware. By default mml ships with two systems in mind: a local setup and a remote compute cluster. For each system the root paths need to be set somewhere - the mml.env file offers an easy solution to keep these personal settings out of your repository but you may set those paths also directly in the sys config file. Below you find the two configurations provided:

local

data_dir
default: ${oc.env:MML_DATA_PATH}
  • path to data folder

  • by default the environment variable is read

out_dir
default: ${oc.env:MML_CLUSTER_RESULTS_PATH}
  • path to results (output) folder

  • by default the environment variable is read

num_workers
default: ${oc.env:MML_LOCAL_WORKERS}
  • number of max processes to spawn

  • by default the environment variable is read

cluster

data_dir
default: ${oc.env:MML_CLUSTER_DATA_PATH}
  • path to data folder

  • by default the environment variable is read

out_dir
default: ${oc.env:MML_CLUSTER_RESULTS_PATH}
  • path to results (output) folder

  • by default the environment variable is read

num_workers
default: ${oc.env:MML_CLUSTER_WORKERS}
  • number of max processes to spawn

  • by default the environment variable is read

trainer
enable_progress_bar
default: False
  • disable progress bar for detached system