Is it possible to get the hours for multiple venues with a single query using the foursquare API? Or does each venue needs to queried separately?
Each venue must be queried individually. You can use the multi endpoint to make multiple queries in one HTTP request.