Configure PyCharm CE to work with Apache Spark

This guide should help you to setup PyCharm CE to work with Python3 and Apache Spark (tested with version 2.1) First, Create a new Pure Python PyCharm project. Now copy the content of https://github.com/apache/spark/blob/master/examples/src/main/python/wordcount.py to your project. Your IDE should complain at the following line from pyspark.sql import SparkSession because it doesn’t know where is pyspark.sql which […]

Read More »