Artifact Evaluation

RTSS 2025 Artifact Evaluation

Artifact Evaluation (AE) for RTSS is an optional evaluation process for research works that have been accepted for publication at RTSS. Authors are encouraged to submit artifacts to increase the value and the visibility of their research.

The AE process seeks to further the goal of reproducible science. It offers authors the opportunity to highlight the reproducibility of their results, and to obtain a validation given by the community for the experiments and data reported in their paper. In the AE process, peer practitioners from the community will follow the instructions included in the artifacts and give feedback to the authors, while keeping papers and artifacts confidential and under the control of the authors.

The AE process is non-competitive and success-oriented. The acceptance of the papers has already been decided before the AE process starts and the hope is that all submitted artifacts will pass the evaluation criteria. Authors of artifacts are expected to interact with the evaluators to fix any possible technical issues that may emerge during the review process and to improve the portability of the artifact.

Authors of papers corresponding to artifacts that pass the evaluation will be entitled to include, in the camera-ready version of their paper, an RTSS AE seal that indicates that the artifact has passed the repeatability test. Authors are also entitled to, and indeed encouraged, to also use this RTSS AE seal on the title slide of the corresponding presentation at RTSSโ€™25.

Please refer to the Artifact Evaluation Criteria for further details on how artifacts are evaluated.

Submission Deadline

Artifacts for accepted papers and conditionally accepted papers undergoing shepherding are expected to be submitted by August 15, 2025.

Artifact Submission

Please refer to the Artifact Preparation Instructions for guidelines and best practices for packaging your artifact to ensure evaluation success.

The submission website will be announced shortly.

Organizers

Artifact Evaluation Chair
Kilho Lee
Soongsil University, South Korea

Program Committee

TBA