According to the Android Studio first app tutorial, there should be a folder in the res called layout folder and inside that folder > activity_my.xml file.
My res folder does not contain the layout folder, it has drawable, mipmap, and value folders.
I have attempted restarting the program and creating multiple new projects.
Right click on resource folder and create new directory with layout name and put your XML in it. I hope your problem solved.