PySpark 면접 질문과 답변

Question: What is the purpose of the 'explode' function in PySpark?

Answer: The 'explode' function is used to transform a column with arrays or maps into multiple rows, duplicating the values of the other columns.

Example:

from pyspark.sql.functions import explode

exploded_df = df.select('ID', explode('items').alias('item'))