Apache Spark Fundamentals

In the previous post we have installed Spark development environment up and running. Now I'll explain the Apache Spark basic concepts. These concepts will provide insight into how Spark works. Spark Architecture Spark application consist of a driver process and a set of executor processes. Driver program is the one that contains the user's main() … Continue reading Apache Spark Fundamentals

Advertisements

Setting up Spark development environment

Now that you know what Spark is for, we'll show you how to set up and test a Spark development environment on Windows, Linux (Ubuntu), and macOS X — whatever common operating system you are using, this article should give you what you need to be able to start developing Spark applications. What is Spark … Continue reading Setting up Spark development environment

Mockito: Java Unit Testing with Mock Objects

Mockito is an open source testing framework for Java. The framework allows the creation of Test Double objects called, "Mock Objects" in automated unit tests for the purpose of Test-driven Development (TDD) or Behavior Driven Development (BDD). Mockito compared to EasyMock seems to be more easily and has more flexibility. First it's able to mock … Continue reading Mockito: Java Unit Testing with Mock Objects