The question is in the title.
So far I've only used IntelliJ for Java. Do I need to download some sort of Compiler or how can I create C++ files?
You should use CLion instead. It's the JetBrains IDE for C/C++.