Performance Evaluations

Different (preliminary) versions of RDFMutate have been used in publications, which included different evaluations of the performance of RDFMutate. This page provides instructions where to find the results and how to reproduce them.

Evaluation for ISWC 2025 Submission

• The artifact is available on Zenodo
• The data, the LaTex source files and the produced PDFs that we used in our submission are in the folder evaluation/ISWC
• RDFMutate can be used to generate the data for the evaluation and LaTex can be used to produce the plots.
  • requirements:
    • a version of Java (we used Java 17)
    • an installation of pdflatex
  • run the following to reproduce the evaluation (run time: ~2h):

  cd evaluation
  ./iswcEvaluation.sh 
  

  • run the following to run the experiments with fewer data samples (run time: ~10min):

  cd evaluation
  ./iswcEvaluationLimited.sh 
  

Evaluation for Submission at ESE journal (2025)

• The artifact is available on Zenodo
• You can also consult the branch ese to find the data used for the evaluation and detailed explanations how to reproduce our results.

Evaluation for Publication at ISSRE 2024

• The reviewed artifact is available on Zenodo
• You can also consult the branch issre to find the data used for the evaluation and detailed explanations how to reproduce our results.