Apache Spark 면접 질문과 답변

Question: Explain the concept of a Spark task.

Answer: A task is the smallest unit of work in Spark, representing the execution of a transformation or action on a partition of data. Tasks are scheduled by the Spark Scheduler on Spark Executors.

Example:

val taskResult = executor.runTask(taskID, taskInfo)