Apache Spark Fundamentals

In the previous post we have installed Spark development environment up and running. Now I'll explain the Apache Spark basic concepts. These concepts will provide insight into how Spark works. Spark Architecture Spark application consist of a driver process and a set of executor processes. Driver program is the one that contains the user's main() … Continue reading Apache Spark Fundamentals

Advertisements

Apache Spark Introduction

In this first Spark article, I'll try to answer the question "What is Spark?" and give you an in-depth overview of what makes it special. I'll outline the main features, including some of the advanced functionality. I'll also show you some of the main building blocks. What is Spark? Apache Spark is an open-source cluster-computing … Continue reading Apache Spark Introduction