Search code examples
intelopenvino

Big difference in performance using OpenVINO model on CPU vs Intel Compute Stick 2


I own an Intel Compute Stick 2 that I intend to use to process object detection networks.

After installing OpenVINO on my machine (Ubuntu 18.04), I tried running the object detection python demo on a video. When running it on the Intel stick, I would get a speed of around 7.5 frames per second, while running it on my laptop Intel CPU is a lot faster at 44 frames per second.

Even if my laptop is a decent gaming laptop, I was surprised by the fact that processing on the Intel stick is so much slower. I plan to use the Intel stick on another device, not my laptop, but I would like to understand why there is this big difference in performance. Anyone had a similar experience?


Solution

  • You're getting an expected performance of Intel® Neural Compute Stick 2.

    Check out the following discussions regarding the performance of Intel® Neural Compute Stick 2.

    Raspberry Pi and Movidius NCS Face Recognition

    Share | Intel Neural Compute Stick 2 (Intel Neural Compute Stick 2) related tests

    Battle of Edge AI — Nvidia vs Google vs Intel