Upgrade Spark

Follow instructions here
https://www.cloudera.com/documentation/spark2/2-1-x/topics/spark2_installing.html

Note: you may need to also install newer version of CDH 5.13
5.13.0-1.cdh5.13.0.p0.29

Download CSD
http://archive.cloudera.com/spark2/csd/
Place this in /opt/cloudera/csd
Set ownership to cloudera-scm:cloudera-scm with permission 644.
chown  cloudera-scm:cloudera-scm *.jar
sudo chmod 644 *.jar

Restart Cloudera SCM
service cloudera-scm-server restart

Download Parcel
https://archive.cloudera.com/spark2/parcels/latest/

Add Parcel repositories to the Configuration section, download and distribute
http://quickstart.cloudera:7180/cmf/parcel/status

Comments

Popular posts from this blog

How to create an organizational chart in your webpage using Google Organization Chart Tools