Search code examples
apache-sparkhadoop-yarngoogle-cloud-dataproc

Proxying Resource Manager in Google Dataproc


I've followed Google instructions on this.

gcloud compute ssh  --zone=us-central1-b --ssh-flag="-D 8088" --ssh-flag="-N" --ssh-flag="-n" spark-test-m

followed by

/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome --proxy-server="socks5://localhost:1080" --host-resolver-rules="MAP * 0.0.0.0 , EXCLUDE localhost" --user-data-dir=/tmp/

Navigate to https://spark-test-m:8088 and I get nothing.


Solution

  • The first SSH flag should be "-D 1080" per http://cloud.google.com/dataproc/cluster-web-interfaces