PySpark 면접 질문과 답변

Question: Explain the purpose of the 'groupBy' operation in PySpark.

Answer: 'groupBy' is used to group the data based on one or more columns. It is often followed by aggregation functions to perform operations on each group.

Example:

grouped_data = df.groupBy('Category').agg({'Price': 'mean'})