Скачать или смотреть SparkConf and SparkContext

Let us understand more about SparkConf and SparkContext.

To get access to complete course which contains videos, reference material, code, labs and support, - you need to purchase https://kaizen.itversity.com/shop/all...

Every application will have a runtime configuration. For Spark it is
SparkConf.
SparkConf has several APIs to set and get the properties. We can
overwrite any property using set.
There are some additional APIs such as appName, master etc.
appName is a handy function which overwrites spark.app.name
property while master overwrites spark.master property.
Once the SparkConf object is created, it can be passed to the
constructor of SparkContext to create a context object.
It will get the resources from the underlying framework (YARN,
Mesos, Stand Alone or local)
It will start web service on port number 4040 (we can override
by overwriting the value for spark.ui.port)
SparkContext object exposes several APIs which include those
APIs that can be used to read the data from files (e. g.: textFile,
sequenceFile etc)
We have to set all the properties first using SparkConf object and
then create a SparkContext object.

Connect with me or follow me at
  / durga0gadiraju  
  / itversity  
https://github.com/dgadiraju
   / itversityin  
  / itversity