RDDs and DataFrames

Understand RDDs and DataFrames

For RDDs and DataFrames, begin with the problem it solves. Identify the inputs, constraints, and observable outcome before choosing an implementation.

Practise deliberately

Create one small example for RDDs and DataFrames and verify its result before expanding it.

A useful comparison

RDDs and DataFrames is like a route plan: it keeps each step connected to a destination.

Check your reasoning.

Quick check: What is the best first step for RDDs and DataFrames?

• Define the goal and constraints.
• Copy an unverified example.
• Skip measurement.