PySpark Koans

Learn by fixing tests

Progress0/39
Documentation

© 2025-2026 Alex Cole. All Rights Reserved.

Spark Koans is an independent community tool.

BasicsKoan 7

Distinct Values

Remove duplicate rows from a DataFrame. Replace ___ with the correct code.

How it works: Replace the ___ blanks in the code editor with the correct PySpark code, then hit Run Code. Stuck? Try the Hint button.
Setup (read-only)
data = [("Alice", "NYC"), ("Bob", "LA"), ("Alice", "NYC"), ("Charlie", "NYC")]
df = spark.createDataFrame(data, ["name", "city"])
Your CodeCtrl/Cmd+Enter to run
Output
Output will appear here...