Vollo Compiler API Reference
- vollo_compiler
Config
NNIR
Program
Program.compute_duration_per_inference_us()
Program.cycle_count_per_inference()
Program.hw_config()
Program.io_only_test()
Program.load()
Program.load_bytes()
Program.metrics()
Program.model_input_shape()
Program.model_input_streaming_dim()
Program.model_num_inputs()
Program.model_num_outputs()
Program.model_output_shape()
Program.model_output_streaming_dim()
Program.num_models()
Program.save()
Program.save_bytes()
Program.to_vm()
Program.transform_to_io_only_test()
ProgramBuilder
Metrics
VM
AllocationError
SaveError
LoadError
- vollo_torch
- vollo_rt
VolloRTContext
VolloRTContext.accelerator_block_size()
VolloRTContext.accelerator_num_cores()
VolloRTContext.add_accelerator()
VolloRTContext.add_job()
VolloRTContext.add_job_bf16()
VolloRTContext.add_job_f32()
VolloRTContext.add_vm()
VolloRTContext.get_result()
VolloRTContext.load_program()
VolloRTContext.load_program_bytes()
VolloRTContext.model_input_shape()
VolloRTContext.model_input_streaming_dim()
VolloRTContext.model_name()
VolloRTContext.model_num_inputs()
VolloRTContext.model_num_outputs()
VolloRTContext.model_output_shape()
VolloRTContext.model_output_streaming_dim()
VolloRTContext.num_models()
VolloRTContext.poll()
VolloRTContext.run()