Search for question
Question

3.2) Which of the following statements is/are true?

Generally, while minimizing the loss, local minima is guaranteed but not the global

minimum.

In a high-dimensional space, saddle points are quite common and hence advanced

optimization techniques, such as momentum-based methods can be employed.

It is difficult to come out of the saddle points, because of the plateau or flat regions,

which gives an impression that the gradient is zero across dimensions.

Fig: 1