Question: What is the significance of Spark's lineage graph (DAG)?Answer: Spark's lineage graph (DAG) is a directed acyclic graph that represents the sequence of transformations and actions on RDDs. It helps in recovering lost data in case of node failure.Example:
|
Is it helpful?
Yes
No
Most helpful rated by users:
- What is the purpose of the Spark SQL module?
- Explain the difference between narrow and wide transformations in Spark.