=============
Miscellaneous
=============
Benchmark comparison
^^^^^^^^^^^^^^^^^^^^
In the companion `JOSS `_
`paper `_
AMaze is compared against a number of other benchmarks from the Python ecosystem.
The scripts (Python and Shell) to reproduce a under `docs/latex/benchmarking`:
- `generate_all.sh` iterates over every declared package and proceeds, if necessary, to
installing it before delegating to the dedicated worker.
- The full list of workers is:
.. literalinclude:: ../latex/benchmarking/generate_all.sh
:linenos:
:lines: 11-20
- Individual workers will perform 1000 timesteps of every available environment (averaged
over 10 replicates) in the inspected library and report through a pandas dataframe
- `format.py` performs the formatting of the raw data thus produced.
Note that the one used for the aforementioned article is available under
`docs/latex/benchmarking/table.csv`
.. warning::
Installing all of these libraries plus their dependencies *will* take quite some time
and disk space.
It is *highly* recommended to do so in a virtual environment on a sufficiently robust
machine.
Complexity space
^^^^^^^^^^^^^^^^
In the README, a figure presenting the complexity of 500'000 mazes is used to showcase the
diversity of the underlying space.
Such a figure can be generated by the scripts under `docs/latex/complexity/`:
- `generate.py` will create 100'000 mazes of Trivial, Simple, Lures, Traps and Complex classes,
each.
Results are stored in the sibling file `data.csv`
- `format.py` will generate most of the visuals (kde, image overlay)
- `complexity.tex` needs to be compiled for the inset images (it is recommended to do so
from the main compiler at `docs/latex/compile.sh`
Build Errors
^^^^^^^^^^^^
.. include:: _autogen/errors.rst