If i try to use and docker image or template, it say's the image does not exist. My docker is running as windows containers.
Yes you can.
Altough you'll need to run Windows specific images. In the default App Templates list, you'll want to search for templates with the Windows icon.