Gradient Free Exclusive

: Finding a global optimum in a massive, messy search space where you might otherwise get stuck in a "local trap". 2. Particle Swarm Optimization (PSO)

: The data is so "jittery" that calculated gradients point in the wrong direction. gradient free

A more sophisticated statistical approach that creates a "cloud" of points. It analyzes which points performed best and reshapes the cloud to zoom in on the most promising area. : Finding a global optimum in a massive,