QAOA Parameter Optimization
Strategies for choosing and training the angles that control a Quantum Approximate Optimization Algorithm circuit.
The optimization surface
QAOA of depth p has 2p angles (gamma_1..gamma_p, beta_1..beta_p). The objective F(gamma,beta) =
Initialization strategies
- Linear ramp: set gamma to increase and beta to decrease linearly across layers, mimicking an adiabatic schedule.
- Parameter transfer: reuse optimized angles from smaller instances or lower depth as a warm start.
- Fixed-angle patterns: for regular graphs, precomputed angle patterns generalize across many instances.
- Random restarts: sample several starting points to escape shallow basins.
Optimizers
Gradient-free methods (Nelder-Mead, COBYLA, SPSA) are common because they tolerate measurement noise. Gradient-based methods use the parameter-shift rule: the derivative of an expectation with respect to an angle equals a difference of the expectation evaluated at shifted angles, giving exact analytic gradients from circuit runs. SPSA approximates gradients with few evaluations, useful when each measurement is costly.
Parameter-shift rule
For a gate exp(-i theta G) with G having eigenvalues +/- 1, dF/dtheta = (F(theta + pi/2) - F(theta - pi/2))/2. This requires two circuit evaluations per parameter and is exact, unlike finite differences.
Barren plateaus and remedies
In deep or highly expressive circuits, gradients can vanish exponentially in system size, flattening the landscape (a barren plateau). QAOA is somewhat protected by its structured ansatz and shallow depth, but large p and global cost functions still risk flatness. Layerwise training, local cost functions, and good initialization mitigate the problem.
Concentration
Optimal QAOA angles often concentrate: instances drawn from the same family share nearly the same best angles. This lets practitioners optimize once on a representative instance and transfer, reducing per-instance optimization cost. See QAOA for MaxCut.