RTSS 2025 Artifact Evaluation
Artifact Evaluation (AE) for RTSS is an optional evaluation process for research works that have been accepted for publication at RTSS. Authors are encouraged to submit artifacts to increase the value and the visibility of their research.
The AE process seeks to further the goal of reproducible science. It offers authors the opportunity to highlight the reproducibility of their results, and to obtain a validation given by the community for the experiments and data reported in their paper. In the AE process, peer practitioners from the community will follow the instructions included in the artifacts and give feedback to the authors, while keeping papers and artifacts confidential and under the control of the authors.
The AE process is non-competitive and success-oriented. The acceptance of the papers has already been decided before the AE process starts and the hope is that all submitted artifacts will pass the evaluation criteria. Authors of artifacts are expected to interact with the evaluators to fix any possible technical issues that may emerge during the review process and to improve the portability of the artifact.
Authors of papers corresponding to artifacts that pass the evaluation will be entitled to include, in the camera-ready version of their paper, an RTSS AE seal that indicates that the artifact has passed the repeatability test. Authors are also entitled to, and indeed encouraged, to also use this RTSS AE seal on the title slide of the corresponding presentation at RTSSโ25.
Please refer to the Artifact Evaluation Criteria for further details on how artifacts are evaluated.
Submission Deadline
Artifacts for accepted papers and conditionally accepted papers undergoing shepherding are expected to be submitted by August 15, 2025.
Artifact Submission
Please refer to the Artifact Preparation Instructions for guidelines and best practices for packaging your artifact to ensure evaluation success.
Please submit your artifact via the following link:
https://openreview.net/group?id=IEEE.org/RTSS/2025/AE
If you do not yet have an OpenReview account, please create one. Please take note of the following OpenReview policy:
- New profiles created with an institutional email address will be activated automatically.
- New profiles created without an institutional email address will be subject to a moderation process that may take up to two weeks.
Organizers
Artifact Evaluation Chair
Kilho Lee
Soongsil University, South Korea
Program Committee
BaekGyu Kim
DGIST, South Korea
Sangeun Oh
Korea University, South Korea
Kuan-Hsun Chen
University of Twente, The Netherlands
Ann Franchesca
Laguna De La salle University, Philippines
Shengzhong Liu
Shanghai Jiao Tong, China
Federico Aromolo
Scuola Superiore Sant’Anna
Jaeheon Kwak
Ajou University, South Korea
Jinwen Wang
University of Texas at Dallas, USA
Corey Tessler
University of Nevada, Las Vegas, USA