Search code examples
amazon-web-servicesapache-sparkamazon-ec2spark-ec2

spark-ec2 not recognized when lauching cluster on windows 8.1


I'm a complete beginner on spark. I'm trying to run spark on Amazon EC2, but my system does not recognize "spark-ec2" or "./spark-ec2". It says "spark-ec2" is not recognized as an internal or external command.

I followed the instruction here to launch a cluster. I would like to use Scala, how do I make it work?


Solution

  • Add PYTHON PATH environment variable with boto. PYTHONPATH="${SPARK_EC2_DIR}/third_party/boto-2.4.1.zip/boto-2.4.1:$PYTHONPATH" And execute the python script