We've just released new improvements!

INT8 and FP32 Performance Improvement

  • OctoML regularly improves TVM performance on INT8 and FP32models. This week, we’ve released an update that improves TVM performance on INT8 Computer Vision models on Arm Cortex-A devices.

  • In our internal testing, we saw an approximately 20% improvement for MobileNetv2, 35% for Inceptionv3, and 13% for Resnet50.

Did this answer your question?