PySpark 面接の質問と回答

Question: What is the purpose of the 'agg' method in PySpark?

Answer: The 'agg' method is used for aggregating data in a PySpark DataFrame. It allows you to perform various aggregate functions like sum, avg, max, min, etc., on specified columns.

Example:

result = df.agg({'Sales': 'sum', 'Quantity': 'avg'})