How to Run Pytorch Bert with AMD

Question

github code: https://github.com/bellowman/Deep-Learning-Practice/blob/main/BioBert%20for%20Multi%20Label%20AMD.ipynb

Hello everyone,

I am a beginner with pytorch, tensorflow, and BERT. I have a machine at home with an AMD Ryzen 7 1800x and a Radeon RX 6600 video card.

I am trying to run a bioBERT model at home. I have trouble leveraging my model to use my AMD card. I posted my github notebook. I have troubles in cell 3 and 9.

1. First Question: In cell 3,I am trying to convert the bioBERT weight to PyTorch with transformmer-cli. I get the warning of "Could not load dynamic library 'cudart64_110.dll'". Does this affect performance later?
2. Second Question: In cell 9, My model load is really slow because it is using just the CPU. How can I get the model to run on my AMD GPU

Answer 1

Thank you to chrispresso

AMD ROCm seems to be the way to go, but it requires one to run under linux