Community Involvement in Artifact Evaluation

Paolo Gi­a­r­russo
AlumniPaolo Gi­a­r­russo was in­vited to par­tic­i­pate in the Ar­ti­fact Eval­u­a­tion Com­mit­tee of ECOOP 2015.

Ar­ti­fact eval­u­a­tion is a new trend in peer re­view, and Paolo Gi­a­r­russo
AlumniPaolo Gi­a­r­russo is en­thu­si­as­tic about it, be­cause he be­lieves that it will im­prove the qual­ity of re­search in our field. From the ECOOP web­site:

Tra­di­tion­ally, tech­ni­cal re­search pa­pers are pub­lished with­out in­clud­ing any ar­ti­facts (such as tools, data, mod­els, videos, etc.), even though the ar­ti­facts may serve as cru­cial and de­tailed ev­i­dence for the qual­ity of the re­sults that the as­so­ci­ated paper of­fers. They sup­port the re­peata­bil­ity of ex­per­i­ments and pre­cise com­par­i­son with al­ter­na­tive ap­proaches, thus en­abling higher qual­ity in the re­search area as a whole. They may also make it eas­ier for other re­searchers to per­form their own ex­per­i­ments, thus help­ing the orig­i­nal au­thors dis­sem­i­nat­ing their ideas in de­tail. Hence, ar­ti­facts should be taken se­ri­ously and rec­og­nized sep­a­rately.