已安裝Hadoop2.7.2的三節(jié)點(diǎn)集群
安裝Scala
- 下載scala-2.11.7.tgz
- 解壓Scala
$ tar -zxvf scala-2.11.7.tgz -C ~/cloud/
- 配置環(huán)境變量
export SCALA_HOME=/home/ubuntu/cloud/scala-2.11.7
export PATH = $PATH:$SCALA_HOME/bin
- 測(cè)試
scala -version
Scala code runner version 2.11.7 -- Copyright 2002-2013, LAMP/EPFL
- 配置到每臺(tái)節(jié)點(diǎn)
安裝Spark
Spark
export SPARK_HOME=/home/ubuntu/cloud/spark-1.6.0
export PATH=$PATH:$SPARK_HOME/bin
export JAVA_HOME=/usr/java/jdk1.8.0_91
export SPARK_MASTER_IP=10.0.0.7
export SPARK_WORKER_MEMORY=2g
export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
slave1
slave2
