Running the benchmark

The release comes with a benchmark script that can be used to measure the performance of the accelerator for a variety of models. The script uses the vollo compiler to compile the models for your accelerator and then runs the models on the accelerator to measure the performance.

1. Install the script dependencies:

   sudo apt install python3-venv jq
   

   Note, the compiler requires python 3.7 or later.

2. Ensure you have run the setup steps:

   cd <vollo-sdk>
   sudo ./load_kernel_driver.sh
   source setup.sh
   export MYRTLE_LICENSE=<your-license-file>
   

3. Run the benchmark:

   $VOLLO_SDK/example/benchmark.sh
   

4. You can cross reference your numbers with those in the benchmarks section of the documentation.