mml.core.data_loading
mml.core.data_loading deals with all file and data operations except for the initial data integration part,
which is dealt with in mml.core.data_preparation.
- Data loading from a task is layered in three:
TaskStructholds only lightweight meta information of a taskTaskDatasetimplements mechanics to use the task description file and load individual samplesMultiTaskDataModuleholds different splits of (potentially) multiple task, deals with transforms and provides the dataloaders
Furthermore file_manager holds the central MMLFileManager.
augmentations deals with data augmentations.
task_attributes declares task meta information
formats as they are needed by the central task_description.
modality_loaders implement the reading operations for different
Modality’s. Lastly
utils holds a small number of utility functions for data transformations.