We've just released new improvements!
INT8 and FP32 Performance Improvement
OctoML regularly improves TVM performance on INT8 and FP32models. This week, we’ve released an update that improves TVM performance on INT8 Computer Vision models on Arm Cortex-A devices.
In our internal testing, we saw an approximately 20% improvement for MobileNetv2, 35% for Inceptionv3, and 13% for Resnet50.