Apache Spark 面试题与答案
Question: What is the significance of the Spark Shuffle operation?Answer: The Spark Shuffle operation redistributes data across partitions during certain transformations, such as groupByKey or reduceByKey. It is a costly operation that involves data exchange and can impact performance.Example:
|
保存以便复习
收藏此条目、标记为困难题,或将其加入复习集合。
这有帮助吗? 是 否
用户评价最有帮助的内容:
- What is the purpose of the Spark SQL module?
- Explain the difference between narrow and wide transformations in Spark.