This is the JuliaReach repeatability evaluation (RE) package for the ARCH-COMP 2022 category report: Artificial Intelligence and Neural Network Control Systems (AINNCS) for Continuous and Hybrid Systems Plants of the 6th International Competition on Verifying Continuous and Hybrid Systems (ARCH-COMP '22).
To cite the work, you can use:
@inproceedings{LopezABCFFHJLLSZ22,
author = {Diego Manzanas Lopez and
Matthias Althoff and
Luis Benet and
Xin Chen and
Jiameng Fan and
Marcelo Forets and
Chao Huang and
Taylor T. Johnson and
Tobias Ladner and
Wenchao Li and
Christian Schilling and
Qi Zhu},
editor = {Goran Frehse and
Matthias Althoff},
title = {{ARCH-COMP22} Category Report: Artificial Intelligence and Neural
Network Control Systems {(AINNCS)} for Continuous and Hybrid Systems
Plants},
booktitle = {{ARCH}},
series = {EPiC Series in Computing},
volume = {90},
pages = {142--184},
publisher = {EasyChair},
year = {2022},
url = {https://doi.org/10.29007/wfgr},
doi = {10.29007/wfgr}
}
Note: Running the full benchmark suite should take no more than two hours with a reasonable internet connection.
There are two ways to install and run this RE: either using the Julia script or using the Docker script. In both cases, first clone this repository.
Using the Julia script. First install the Julia compiler following the instructions here. Once you have installed Julia, execute
$ julia startup.jl
to run all the benchmarks.
Using the Docker container.
To build the container, you need the program docker
.
For installation instructions on different platforms, consult
the Docker documentation.
For general information about Docker
, see
this guide.
Once you have installed Docker, start the measure_all
script:
$ ./measure_all
The Docker container can also be run interactively:
$ docker run -it juliareach bash
$ julia
julia> include("startup.jl")
After the benchmark runs have finished, the results will be stored in the folder
result
and plots are generated in your working directory.
julia> ]
(@v1.7) pkg> activate .
Activating new environment at `.../ARCH2022_AINNCS/Project.toml`
pkg> add ClosedLoopReachability
pkg> add DifferentialEquations
pkg> add LinearAlgebra
pkg> add MAT
pkg> add Plots
pkg> add Symbolics
pkg> add YAML