This is for the optimization algorithms that need to keep some internal state other than the list of experiments done and historical data.