PySpark Error: Py4JJavaError For Python version being incorrect

Описание к видео PySpark Error: Py4JJavaError For Python version being incorrect

Advance note: Audio was bad because I was traveling. haha
_____
The error in my case was: PySpark was running python 2.7 from my environment's default library. This is an issue since I have Python 3.6 for that enviroment. So, I reconfigured the PYSPARK_PYTHON path with this command:

import os
os.environ["PYSPARK_PYTHON"]="/anaconda3/envs/DIRECTORYNAME/bin/python"

I found my version of python being used in my environment by typing in "which python" Linux [Unix I think it's "find python"]

Комментарии

Информация по комментариям в разработке

Похожие видео