The default in-use IP address quota is only 8 but I would like to create a Dataproc cluster with more than 8 nodes. I tried to request more allocation but was rejected xD
I tried creating a cluster with my VPC network (with internal ip address only) as described in https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/network#create_a_cloud_dataproc_cluster_with_internal_ip_address_only
But the problem is that the master node cannot be SSHed into. Is there a way in which I can create a cluster with a number of nodes more than the quota, but I can also SSH into the master node?
Much appreciated! :)
If you're looking for SSH access to a VM with private IPs then there are a few options detailed here.
One option is to create what it calls a "bastion" or "jump" host VM that's connected to both the private network and one that's reachable from your computer. You SSH into the bastion and then from there to the private one.
You can also use VPN as described here.