Upgrade Spark
Follow instructions here
https://www.cloudera.com/documentation/spark2/2-1-x/topics/spark2_installing.html
Note: you may need to also install newer version of CDH 5.13
5.13.0-1.cdh5.13.0.p0.29
Download CSD
http://archive.cloudera.com/spark2/csd/
Place this in /opt/cloudera/csd
Set ownership to cloudera-scm:cloudera-scm with permission 644.
chown cloudera-scm:cloudera-scm *.jar
sudo chmod 644 *.jar
Restart Cloudera SCM
https://archive.cloudera.com/spark2/parcels/latest/
Add Parcel repositories to the Configuration section, download and distribute
http://quickstart.cloudera:7180/cmf/parcel/status
https://www.cloudera.com/documentation/spark2/2-1-x/topics/spark2_installing.html
Note: you may need to also install newer version of CDH 5.13
5.13.0-1.cdh5.13.0.p0.29
Download CSD
http://archive.cloudera.com/spark2/csd/
Place this in /opt/cloudera/csd
Set ownership to cloudera-scm:cloudera-scm with permission 644.
chown cloudera-scm:cloudera-scm *.jar
sudo chmod 644 *.jar
Restart Cloudera SCM
service cloudera-scm-server restart
Download Parcel
https://archive.cloudera.com/spark2/parcels/latest/
Add Parcel repositories to the Configuration section, download and distribute
http://quickstart.cloudera:7180/cmf/parcel/status
Comments
Post a Comment