PySpark Koans

Learn by fixing tests

Progress0/39

Spark Koans is an independent community tool.

AdvancedKoan 29

Explode Arrays

Expand array columns into multiple rows. Replace ___ with the correct code.

How it works: Replace the ___ blanks in the code editor with the correct PySpark code, then hit Run Code. Stuck? Try the Hint button.

Setup (read-only)

from pyspark.sql.functions import explode, split, col

data = [("Alice", "python,sql,spark"), ("Bob", "java,scala")]
df = spark.createDataFrame(data, ["name", "skills_str"])

# First split the string into an array
df = df.withColumn("skills", split(col("skills_str"), ","))

Your CodeCtrl/Cmd+Enter to run

Output

Output will appear here...