IMC 2024 will continue with the Replicability Track introduced in 2023. This track is for submissions that aim to reproduce or replicate results of Internet measurement papers in the scope of IMC. Reproduced/replicated papers are ideally from previous IMC iterations, but papers at other high-quality conferences (e.g., SIGCOMM, CoNext, …) will also be considered.
Submissions to this track are two-phase. Prospective authors are invited to submit an Expression of Interest (EoI) via the submission system in the form of an abstract which must explain:
Which paper the authors aim to replicate
Whether the paper will be replicated or reproduced
What the IMC community stands to learn from the replication or reproduction
Chosen approach, and why it will lead to new insights
A small committee will evaluate the EoIs and their potential to be of interest to the IMC community. The authors of strong abstracts will receive an invitation to a full submission. Priority will be given to replicability studies, although reproducibility studies are also in scope. For the definitions, please see ACM’s site. The EoI serves to avoid misunderstandings and disappointment for authors as we acknowledge that replicating or reproducing a paper is a very significant effort to which potential authors would commit much time.
Full submissions will then be assessed by a sub-committee of the TPC. Full submissions must otherwise conform to the same criteria and rules as the papers for the main track. The papers are also reviewed by the same TPC, with an important criterion in the evaluation being the “contribution of the replication/reproduction”. This examines the insights that the replicated/reproduced paper provides for the community.
As in the previous iteration of this track, particularly strong papers (with respect to the evaluation criteria) will be published in the IMC proceedings. The remaining accepted papers will be published in the ACM SIGCOMM Computer Communication Review (CCR).
Expressions of Interest are due by 23 February 2024. Full submissions have the same deadlines (abstract registration and full submission) as the IMC main deadline.