This project is a fork of amplab spark-ce2 branch-1.5. See original description here.
This repository contains the set of scripts used to setup a Spark cluster on EC2 by using Apache Spark on EC2 Script. This fork works only with yarn (which installs hadoop 2.7.1) and spark version 1.6.0.
Overall status: testing (on ec2 - it seems all works fine)
- last version of java 8 - done
- last version of scala 2.10 - done
- hadoop 2.7.1 - done
- spark 1.6.x - done
- tachyon 0.8.2 - done
- scala 2.11
- spark 1.6.0 (scala-2.11 build)