Apache Spark Fundamentals

In the previous post we have installed Spark development environment up and running. Now I'll explain the Apache Spark basic concepts. These concepts will provide insight into how Spark works. Spark Architecture Spark application consist of a driver process and a set of executor processes. Driver program is the one that contains the user's main() … Continue reading Apache Spark Fundamentals

Advertisements

Setting up Spark development environment

Now that you know what Spark is for, we'll show you how to set up and test a Spark development environment on Windows, Linux (Ubuntu), and macOS X — whatever common operating system you are using, this article should give you what you need to be able to start developing Spark applications. What is Spark … Continue reading Setting up Spark development environment