Search code examples
deploymentdeep-learningmodelgpuartificial-intelligence

Do I need a GPU even to deploy a deep learning model?

I know I do need a GPU to train a model but even after the model is trained do I need a GPU to deploy the same trained model? For example I have a model for a car with auto-pilot to predict and take a decision... Do I need a GPU for the prediction too..

Specially in case of reinforcement learning

Solution

  • Strictly speaking you usually don't need a GPU for training either depending on the platform, it would just be much slower than if you utilized he GPU rather than the CPU.

    For deploying the model you do not need a GPU. Most models are simply an organized list of weights which are used by the model to operate on its inputs. Since this usually isn't particularly computationally expensive, except for very large models, a GPU isn't necessary for deployment either, but may provide some performance benefit for lager models.