Data Engineer 면접 질문과 답변

Question: Explain the concept of data skewness and its impact on data processing.

Answer: Data skewness refers to the uneven distribution of data within a dataset. It can impact performance in distributed computing environments, causing certain tasks to take longer than others.

Example:

Identifying and addressing data skewness issues in a Spark job to improve overall processing time.