SLICES Data Management Infrastructure for Reproducible Experimental Research on Digital Technologies

Abstract

This paper presents the ongoing research effort related to the design of the Data Management Infrastructure (DMI) to support experimental research on digital technologies with application to the ESFRI SLICES scientific instrument. We consider the experiment documentation and data collection across the whole continuum of access network, IoT, edge, cloud, and data processing workflow. The paper includes the requirements analysis for DMI to enable research reproducibility of complex and large-scale experimentation. We provide an analysis of data collected and processed in SLICES and explain approaches and solutions used in SLICES for experimental research reproducibility, primarily based on the plain orchestration service and supported by metadata collection tools. The proposed multi-layer DMI includes: data (storage) access, data processing, data ingest, experiment management, and virtual research environment. The paper also provides recommendations for the selection of existing standards and tools for data and metadata management, in particular those developed by EOSC and supported by the RDA community to ensure wide compatibility and integration.