Upgrade Spark

Follow instructions here
https://www.cloudera.com/documentation/spark2/2-1-x/topics/spark2_installing.html

Note: you may need to also install newer version of CDH 5.13
5.13.0-1.cdh5.13.0.p0.29

Download CSD
http://archive.cloudera.com/spark2/csd/
Place this in /opt/cloudera/csd
Set ownership to cloudera-scm:cloudera-scm with permission 644.
chown  cloudera-scm:cloudera-scm *.jar
sudo chmod 644 *.jar

Restart Cloudera SCM
service cloudera-scm-server restart

Download Parcel
https://archive.cloudera.com/spark2/parcels/latest/

Add Parcel repositories to the Configuration section, download and distribute
http://quickstart.cloudera:7180/cmf/parcel/status

Comments

Popular posts from this blog

How to create an organizational chart in your webpage using Google Organization Chart Tools

How to add Diggit, Technorati, Del.icio.us, Stumbleupon, Reddit and pInterest buttons to your Blogger posts