Gradient-free optimizers need only the value of the figure of merit, never its derivative. They are the natural choice when gradients are unavailable or unreliable. Examples: the fidelity is measured on an experiment and is noisy, the simulation is a black box, or the objective is not differentiable. They are also useful when the landscape is rugged enough that local gradient methods get stuck. The price is poor scaling with the number of parameters, so they are usually combined with a compact pulse description such as CRAB.

The main families

  • Direct search — Nelder–Mead. A simplex of \(n+1\) points in parameter space is reflected, expanded and contracted towards better values [1]. Simple, with few settings, and effective for up to a few tens of parameters. It is the classic partner of CRAB [2].
  • Evolution strategies — CMA-ES. Candidates are sampled from a multivariate Gaussian whose mean and covariance matrix adapt to the landscape [3]. CMA-ES learns correlations between parameters and copes well with noise and rugged landscapes.
  • Genetic and evolutionary algorithms. Populations of pulses are recombined and mutated. They were used in the first proposal of learning control, in which an algorithm drives a laser experiment directly [4]. For fast gates where greedy algorithms are trapped — a qutrit phase gate and a CNOT — an evolutionary algorithm has been shown to succeed [5].
  • Surrogate-based optimization. Bayesian optimization and other machine-learning surrogates build a model of the landscape from few, expensive evaluations, for example to optimize ultracold-atom experiments online [6]; see Reinforcement & machine learning for control.

Where they shine

  • Closed-loop experiments. Optimizing directly on the device sidesteps model errors. Examples include tuning superconducting-qubit gates with randomized-benchmarking fidelities as the objective [7], and refining model-based optimal pulses in the laboratory (ad-HOC) [8]. See Closed-loop & in-situ optimization.
  • Black-box simulations whose gradients are unavailable, for example tensor-network or mean-field dynamics in Many-body optimal control.
  • Global exploration. Population methods can escape local optima that trap greedy methods. Even human intuition, collected through a citizen-science game, has been used to seed optimizers in such landscapes [9].

Limitations

  • The number of evaluations needed grows quickly with the number of parameters, so the pulse description must stay compact (a few to a few dozen parameters).
  • With cheap exact gradients, gradient-based methods (GRAPE, GOAT with L-BFGS) almost always converge in far fewer evaluations.
  • “Global” methods such as genetic algorithms or CMA-ES explore more widely, but give no guarantee of finding the global optimum. For a certified global optimum, see QCPOP.