Apache Spark 面试题与答案

Question: Explain the concept of a Spark task.

Answer: A task is the smallest unit of work in Spark, representing the execution of a transformation or action on a partition of data. Tasks are scheduled by the Spark Scheduler on Spark Executors.

Example:

val taskResult = executor.runTask(taskID, taskInfo)