PySpark 面试题与答案

Question: How can you handle data skewness in PySpark?

Answer: Data skewness can be handled by using techniques like salting, bucketing, or using the 'broadcast' hint to distribute data more evenly across partitions.

Example:

df.write.option('skew_hint', 'true').parquet('output_path')