Machine Learning Interview Questions and Answers

Question: Explain the difference between batch gradient descent and stochastic gradient descent.

Answer: Batch gradient descent updates the model parameters using the entire dataset, while stochastic gradient descent updates the parameters using one randomly selected data point at a time. Mini-batch gradient descent is a compromise, using a small subset of the data for each update.