Literature Database Entry

hauser2025marte

Eric Hauser, Kilian Warmuth, Marcel Kempf, Stefan Lachnit and Georg Carle, "MARTE: Malleable and Automated Reproduction for Testbed-driven Experiments," Proceedings of 3rd ACM Conference on Reproducibility and Replicability (REP 2025), Vancouver, Canada, July 2025, pp. 121–131.

Abstract

Reproducing experimental results in computing and networking is notoriously difficult due to intricate dependencies and diverse execution environments. Re-executing an experiment often feels like deciphering a puzzle, where incomplete documentation and missing configurations lead to inconsistent outcomes. While research infrastructures in the form of testbeds provide a structured framework for (reproducible) experiments, additional measures are necessary to completely close the loop between experiment execution, sharing of results, and re-execution. To address these challenges, we propose MARTE, a reproduction methodology for testbed-driven experiments. MARTE consists of two complementary approaches: (1) Malleable reproduction , which retains original scripts, allowing modifications for flexible reuse, and (2) automated record-replay , which automatically captures and seamlessly replays all experiment instructions. Additionally, we integrate a structured data management format to store experiment results along with all relevant metadata about the execution and environment. This new approach for packaging artifacts ensures that configurations and dependencies are preserved and remain accessible. By integrating a tool for seamless publication to open repositories, we transform experimental results into shareable artifacts that others can build upon. We argue that the barriers for researchers to achieve reproducibility must be kept as low as possible. We address this by automating key aspects of experiment documentation, re-execution, and publication. The functionality of our implementation is showcased in a demonstration experiment. Its complete artifact is openly accessible, along with an example of its reproduction and replay using MARTE.

Quick access

Original Version DOI (at publishers web site)
BibTeX BibTeX

Contact

Eric Hauser
Kilian Warmuth
Marcel Kempf
Stefan Lachnit
Georg Carle

BibTeX reference

@inproceedings{hauser2025marte,
    author = {Hauser, Eric and Warmuth, Kilian and Kempf, Marcel and Lachnit, Stefan and Carle, Georg},
    doi = {10.1145/3736731.3746154},
    title = {{MARTE: Malleable and Automated Reproduction for Testbed-driven Experiments}},
    pages = {121--131},
    publisher = {ACM},
    address = {Vancouver, Canada},
    booktitle = {3rd ACM Conference on Reproducibility and Replicability (REP 2025)},
    month = {7},
    year = {2025},
   }
   
   

Copyright notice

Links to final or draft versions of papers are presented here to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted or distributed for commercial purposes without the explicit permission of the copyright holder.

The following applies to all papers listed above that have IEEE copyrights: Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

The following applies to all papers listed above that are in submission to IEEE conference/workshop proceedings or journals: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible.

The following applies to all papers listed above that have ACM copyrights: ACM COPYRIGHT NOTICE. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept., ACM, Inc., fax +1 (212) 869-0481, or permissions@acm.org.

The following applies to all SpringerLink papers listed above that have Springer Science+Business Media copyrights: The original publication is available at www.springerlink.com.

This page was automatically generated using BibDB and bib2web.

Last modified: 2026-04-30