Custom Objective Function

pyPESTO can not only do parameter estimation for PEtab and AMICI models, but is able to do so on any provided function. This is done by providing the objective with the function as well as possibly gradient and hessian. In this notebook, we will show a few different ways on how to do this. As sometimes manually providing the gradient and hessian is tedious, we will try to emphasize on the importance of those two.

After this notebook, you should …

• … be able to create an objective from a given function.

• … be able to potentially add a gradient and hessian to the objective.

• … be able to run parameter estimation on the objective.

• … know the importance of gradient and hessian in terms of optimization speed and accuracy.

# install if not done yet
# %pip install pypesto --quiet

import matplotlib.pyplot as plt
import numpy as np
import scipy as sp
from IPython.display import Markdown, display

import pypesto
import pypesto.optimize as optimize
import pypesto.profile as profile
import pypesto.visualize as visualize

# set a random seed
np.random.seed(1912)

%matplotlib inline

1. Objective + Problem Definition

In the following we will use the Rosenbrock Banana function, which we can directly get from scipy.

The first creation of the objective function is rather straightforward: We create it by providing a function, as well as gradient and hessian.

# first type of objective defined through callables
objective1 = pypesto.Objective(
    fun=sp.optimize.rosen,
    grad=sp.optimize.rosen_der,
    hess=sp.optimize.rosen_hess,
)

The second option is to provide a function that returns objective value, gradient and hessian (last two optional) all as a tuple. In this case, we just need to notify the pyPESTO objective of this through boolean values.

# second type of objective
def rosen2(x):
    return (
        sp.optimize.rosen(x),
        sp.optimize.rosen_der(x),
        sp.optimize.rosen_hess(x),
    )


objective2 = pypesto.Objective(fun=rosen2, grad=True, hess=True)

For later comparisons, we create two other objectives. One that is only provided with function and gradient, and one that only has the functional value, forcing it to rely on finite differences in optimization.

# no hessian objective
objective3 = pypesto.Objective(
    fun=sp.optimize.rosen,
    grad=sp.optimize.rosen_der,
)

# neither hessian nor gradient objective
objective4 = pypesto.Objective(
    fun=sp.optimize.rosen,
)

To get from objective to a usable parameter estimation problem, we need to additionally provide the bounds of our parameters.

dim_full = 15
lb = -5 * np.ones((dim_full, 1))
ub = 5 * np.ones((dim_full, 1))

# for the sake of comparison, we create 20 starts within these bounds
x_guesses = np.random.uniform(-5, 5, (20, dim_full))

problem1 = pypesto.Problem(
    objective=objective1, lb=lb, ub=ub, x_guesses=x_guesses
)
problem2 = pypesto.Problem(
    objective=objective2, lb=lb, ub=ub, x_guesses=x_guesses
)
problem3 = pypesto.Problem(
    objective=objective3, lb=lb, ub=ub, x_guesses=x_guesses
)
problem4 = pypesto.Problem(
    objective=objective4, lb=lb, ub=ub, x_guesses=x_guesses
)

Illustration

The Rosenbrock function is a function, which is often used to test optimization algorithms. It is defined as

\[f(x) = \sum_{i=1}^{n-1} 100 (x_{i+1} - x_i^2)^2 + (1 - x_i)^2, \quad x \in \mathbb{R}^n\]

This function has a global minimum at \(x^* = (1, \dots, 1)\) with \(f(x^*) = 0\). If \(n\geq 4\), the function has an additional local minimum at \(x^* = (-1, 1, \dots, 1)\) with \(f(x^*) = 4\).

We will illustrate the function for \(n=2\).

x = np.arange(-2, 2, 0.1)
y = np.arange(-2, 2, 0.1)
x, y = np.meshgrid(x, y)
z = np.zeros_like(x)
for j in range(0, x.shape[0]):
    for k in range(0, x.shape[1]):
        z[j, k] = objective1([x[j, k], y[j, k]], (0,))

fig = plt.figure()
fig.set_size_inches(*(14, 10))
ax = plt.axes(projection="3d")
ax.plot_surface(X=x, Y=y, Z=z)
plt.xlabel("x axis")
plt.ylabel("y axis")
ax.set_title("cost function values");

And a contour plot:

fig = plt.figure()
fig.set_size_inches(*(14, 10))
ax = plt.axes()
ax.contourf(x, y, z, 100, norm="log");

2. Optimization

# optimizer
optimizer = optimize.ScipyOptimizer()
# engine
# In this notebook, it is faster to use a single core engine, due to the
# overhead of multiprocessing. But in general with more expensive problems
# it is recommended to use the MultiProcessEngine.
engine = pypesto.engine.SingleCoreEngine()
# starts
n_starts = 20

As a first comparison, we time each optimization. We also use the same optimizer and engine for all optimizations.

%%time
# run optimization of problem 1
result1 = optimize.minimize(
    problem=problem1, optimizer=optimizer, n_starts=n_starts, engine=engine
)
# run optimization of problem 2
result2 = optimize.minimize(
    problem=problem2, optimizer=optimizer, n_starts=n_starts, engine=engine
)
# run optimization of problem 3
result3 = optimize.minimize(
    problem=problem3, optimizer=optimizer, n_starts=n_starts, engine=engine
)
# run optimization of problem 4
result4 = optimize.minimize(
    problem=problem4, optimizer=optimizer, n_starts=n_starts, engine=engine
)

/home/docs/checkouts/readthedocs.org/user_builds/pypesto/envs/stable/lib/python3.11/site-packages/pypesto/optimize/optimizer.py:251: UserWarning: scipy.optimize.minimize does not support passing fun and hess as one function. Hence for each evaluation of hess, fun will be evaluated again. This can lead to increased computation times. If possible, separate fun and hess.
  return minimize(

CPU times: user 4.14 s, sys: 4.55 ms, total: 4.14 s
Wall time: 4.14 s

As a first step, let us take a look at the different result summaries:

display(
    Markdown("# Result 1\n" + result1.optimize_result.summary(disp_best=False))
)
display(
    Markdown("# Result 2\n" + result2.optimize_result.summary(disp_best=False))
)
display(
    Markdown("# Result 3\n" + result3.optimize_result.summary(disp_best=False))
)
display(
    Markdown("# Result 4\n" + result4.optimize_result.summary(disp_best=False))
)

Result 1

Optimization Result

• number of starts: 20

• best value: 7.551827196421667e-11, id=3

• worst value: 3.986623814631966, id=6

• number of non-finite values: 0

• execution time summary:

  • Mean execution time: 0.029s

  • Maximum execution time: 0.037s, id=7

  • Minimum execution time: 0.018s, id=13

• summary of optimizer messages:

  Count	Message
  20	CONVERGENCE: REL_REDUCTION_OF_F_<=_FACTR*EPSMCH

• best value found (approximately) 15 time(s)

• number of plateaus found: 2

Result 2

Optimization Result

• number of starts: 20

• best value: 7.551827196421667e-11, id=3

• worst value: 3.986623814631966, id=6

• number of non-finite values: 0

• execution time summary:

  • Mean execution time: 0.026s

  • Maximum execution time: 0.033s, id=7

  • Minimum execution time: 0.016s, id=13

• summary of optimizer messages:

  Count	Message
  20	CONVERGENCE: REL_REDUCTION_OF_F_<=_FACTR*EPSMCH

• best value found (approximately) 15 time(s)

• number of plateaus found: 2

Result 3

Optimization Result

• number of starts: 20

• best value: 7.551827196421667e-11, id=3

• worst value: 3.986623814631966, id=6

• number of non-finite values: 0

• execution time summary:

  • Mean execution time: 0.029s

  • Maximum execution time: 0.036s, id=7

  • Minimum execution time: 0.018s, id=13

• summary of optimizer messages:

  Count	Message
  20	CONVERGENCE: REL_REDUCTION_OF_F_<=_FACTR*EPSMCH

• best value found (approximately) 15 time(s)

• number of plateaus found: 2

Result 4

Optimization Result

• number of starts: 20

• best value: 0.1082625043906273, id=9

• worst value: 10.866234639719915, id=11

• number of non-finite values: 0

• execution time summary:

  • Mean execution time: 0.123s

  • Maximum execution time: 0.126s, id=17

  • Minimum execution time: 0.121s, id=6

• summary of optimizer messages:

  Count	Message
  20	STOP: TOTAL NO. of f AND g EVALUATIONS EXCEEDS LIMIT

• best value found (approximately) 1 time(s)

• number of plateaus found: 3

Here we can see already a big difference between the first three and the fourth. The one without gradients took approximately five times as long to finish the optimization as the other three. The best value found is also not the same as for the others. But the biggest difference is probably the fact that while the first three all converged in all their starts, the one without gradient reach the maximum number of evaluations in most to all cases. Keep in mind: All starts were the same for all problems.

A small detail here: When comparing the first three results, one may notice two things. For one, leaving out the hessian seems not make any difference. And additionally, while they are rather close in speed compared to the fourth one, the second one sticks out to be somewhat slower. This is mainly due to the fact that we chose the scipy optimizer “l-bfgs-b”, which does not support the usage of a hessian, for the sake of comparing all four of them. This also explains why the second one is slower, as (by construction), whether needed or not, problem2 will evaluate the hessian.

Visualization

# waterfalls
visualize.waterfall(result1)
visualize.waterfall(result2)
visualize.waterfall(result3)
visualize.waterfall(result4);

We can see here already the stark difference between the problem definitions. In order to compare things easier, we can also plot all results in one waterfall plot:

# plot one list of waterfalls
visualize.waterfall(
    [result1, result2, result3, result4],
    legends=["Problem 1", "Problem 2", "Problem 3", "Problem 4"],
);

We can also take a look at the parameters, that each optimizer found:

# plot parameters
ax = visualize.parameters(
    result1,
)
ax.set_title("Estimated parameters problem 1")
ax2 = visualize.parameters(
    [result4, result1, result2, result3],
    legends=["Problem 4", "Problem 1", "Problem 2", "Problem 3"],
)
ax2.set_title("Estimated parameters all problems");

3. Profiling

We want to create profiles for our parameters to know more about their uncertainties. We shall create profiles for problem 1 and 4. For problem 1 specifically, we create two profiles, as we have seen, that there are two distinct optima, so we want to start our profile likelihood from both optima.

Note that when running profiles, the cost function is interpreted as a negative log likelihood function. This has some implications on the stopping criteria of the algorithm and on the confidence intervals. Therefore a meaningful statistical interpretation of the results is only possible if the cost function is a negative log likelihood function or a negative log posterior function. The same holds for sampling.

# we create references for each "best point":
ref = {
    "x": result1.optimize_result.x[0],
    "fval": result1.optimize_result.fval[0],
    "color": [0.2, 0.4, 1.0, 1.0],
    "legend": "First optimum problem 1",
}
ref = visualize.create_references(ref)[0]
# we create references for each "best point":
ref2 = {
    "x": result1.optimize_result.x[-1],
    "fval": result1.optimize_result.fval[-1],
    "color": [0.4, 1.0, 0.2, 1.0],
    "legend": "Second optimum problem 1",
}
ref2 = visualize.create_references(ref2)[0]
# we create references for each "best point":
ref4 = {
    "x": result4.optimize_result.x[0],
    "fval": result4.optimize_result.fval[0],
    "color": [0.2, 0.4, 1.0, 1.0],
    "legend": "First optimum problem 4",
}
ref4 = visualize.create_references(ref4)[0];

%%time
# compute profiles
profile_options = profile.ProfileOptions(whole_path=True)

result1 = profile.parameter_profile(
    problem=problem1,
    result=result1,
    optimizer=optimizer,
    profile_index=np.array([0, 3]),
    result_index=0,
    profile_options=profile_options,
    filename=None,
)

# compute profiles from second optimum
result1 = profile.parameter_profile(
    problem=problem1,
    result=result1,
    optimizer=optimizer,
    profile_index=np.array([0, 3]),
    result_index=-1,
    profile_options=profile_options,
    filename=None,
)
result4 = profile.parameter_profile(
    problem=problem4,
    result=result4,
    optimizer=optimizer,
    profile_index=np.array([0, 3]),
    result_index=0,
    profile_options=profile_options,
    filename=None,
)

Next guess for x0 in direction -1 is 0.9837. Step size: -0.0163.
Optimization successful for x0=0.9837. Start fval 0.104551, end fval 0.078386.
Next guess for x0 in direction -1 is 0.9800. Step size: -0.0037.
Optimization successful for x0=0.9800. Start fval 0.117532, end fval 0.117532.
Next guess for x0 in direction -1 is 0.9755. Step size: -0.0046.
Optimization successful for x0=0.9755. Start fval 0.176282, end fval 0.176282.
Next guess for x0 in direction -1 is 0.9699. Step size: -0.0056.
Optimization successful for x0=0.9699. Start fval 0.264400, end fval 0.264400.
Next guess for x0 in direction -1 is 0.9629. Step size: -0.0069.
Optimization successful for x0=0.9629. Start fval 0.396568, end fval 0.396567.
Next guess for x0 in direction -1 is 0.9544. Step size: -0.0086.
Optimization successful for x0=0.9544. Start fval 0.594810, end fval 0.594808.
Next guess for x0 in direction -1 is 0.9438. Step size: -0.0106.
Optimization successful for x0=0.9438. Start fval 0.892165, end fval 0.892165.
Next guess for x0 in direction -1 is 0.9306. Step size: -0.0132.
Optimization successful for x0=0.9306. Start fval 1.337870, end fval 1.337870.
Next guess for x0 in direction -1 is 0.9142. Step size: -0.0164.
Optimization successful for x0=0.9142. Start fval 2.006274, end fval 2.006273.
Next guess for x0 in direction -1 is 0.8937. Step size: -0.0206.
Optimization successful for x0=0.8937. Start fval 3.008621, end fval 3.008620.
Next guess for x0 in direction -1 is 0.8677. Step size: -0.0259.
Optimization successful for x0=0.8677. Start fval 4.511700, end fval 4.511697.
Next guess for x0 in direction -1 is 0.8347. Step size: -0.0330.
Optimization successful for x0=0.8347. Start fval 6.765640, end fval 6.765632.
Next guess for x0 in direction -1 is 0.7920. Step size: -0.0426.
Optimization successful for x0=0.7920. Start fval 10.145850, end fval 10.145827.
Next guess for x0 in direction -1 is 0.7359. Step size: -0.0562.
Optimization successful for x0=0.7359. Start fval 15.216551, end fval 15.216483.
Next guess for x0 in direction -1 is 0.6594. Step size: -0.0764.
Optimization successful for x0=0.6594. Start fval 22.824023, end fval 22.823795.
Next guess for x0 in direction -1 is 0.5594. Step size: -0.1000.
Optimization successful for x0=0.5594. Start fval 33.140851, end fval 33.140181.
Next guess for x0 in direction -1 is 0.4594. Step size: -0.1000.
Optimization successful for x0=0.4594. Start fval 42.907316, end fval 42.906498.
Next guess for x0 in direction -1 is 0.3594. Step size: -0.1000.
Optimization successful for x0=0.3594. Start fval 51.325351, end fval 51.324670.
Next guess for x0 in direction -1 is 0.2594. Step size: -0.1000.
Optimization successful for x0=0.2594. Start fval 57.865527, end fval 57.865160.
Next guess for x0 in direction -1 is 0.1594. Step size: -0.1000.
Optimization successful for x0=0.1594. Start fval 62.274016, end fval 62.273758.
Next guess for x0 in direction -1 is 0.0594. Step size: -0.1000.
Optimization successful for x0=0.0594. Start fval 64.574694, end fval 64.568963.
Next guess for x0 in direction -1 is -0.0406. Step size: -0.1000.
Optimization successful for x0=-0.0406. Start fval 64.998257, end fval 64.943113.
Next guess for x0 in direction -1 is -0.1018. Step size: -0.0612.
Optimization successful for x0=-0.1018. Start fval 64.278274, end fval 64.251117.
Next guess for x0 in direction -1 is -0.1526. Step size: -0.0508.
Optimization successful for x0=-0.1526. Start fval 63.110589, end fval 63.107158.
Next guess for x0 in direction -1 is -0.2067. Step size: -0.0541.
Optimization successful for x0=-0.2067. Start fval 61.289678, end fval 61.288855.
Next guess for x0 in direction -1 is -0.2680. Step size: -0.0613.
Optimization successful for x0=-0.2680. Start fval 58.458485, end fval 58.458282.
Next guess for x0 in direction -1 is -0.3401. Step size: -0.0721.
Optimization successful for x0=-0.3401. Start fval 54.110081, end fval 54.110041.
Next guess for x0 in direction -1 is -0.4274. Step size: -0.0874.
Optimization successful for x0=-0.4274. Start fval 47.488178, end fval 47.487911.
Next guess for x0 in direction -1 is -0.5274. Step size: -0.1000.
Optimization successful for x0=-0.5274. Start fval 38.479852, end fval 38.478964.
Next guess for x0 in direction -1 is -0.6274. Step size: -0.1000.
Optimization successful for x0=-0.6274. Start fval 28.636928, end fval 28.635660.
Next guess for x0 in direction -1 is -0.7274. Step size: -0.1000.
Optimization successful for x0=-0.7274. Start fval 18.936607, end fval 18.935368.
Next guess for x0 in direction -1 is -0.8274. Step size: -0.1000.
Optimization successful for x0=-0.8274. Start fval 10.616397, end fval 10.615152.
Next guess for x0 in direction -1 is -0.9274. Step size: -0.1000.
Optimization successful for x0=-0.9274. Start fval 5.169779, end fval 5.168674.
Next guess for x0 in direction -1 is -1.0274. Step size: -0.1000.
Optimization successful for x0=-1.0274. Start fval 4.344489, end fval 4.343505.
Next guess for x0 in direction -1 is -1.0662. Step size: -0.0387.
Optimization successful for x0=-1.0662. Start fval 5.684667, end fval 5.684604.
Next guess for x0 in direction -1 is -1.1004. Step size: -0.0342.
Optimization successful for x0=-1.1004. Start fval 7.795637, end fval 7.795624.
Next guess for x0 in direction -1 is -1.1364. Step size: -0.0361.
Optimization successful for x0=-1.1364. Start fval 11.062279, end fval 11.062267.
Next guess for x0 in direction -1 is -1.1764. Step size: -0.0399.
Optimization successful for x0=-1.1764. Start fval 16.060611, end fval 16.060594.
Next guess for x0 in direction -1 is -1.2215. Step size: -0.0452.
Optimization successful for x0=-1.2215. Start fval 23.653589, end fval 23.653562.
Next guess for x0 in direction -1 is -1.2731. Step size: -0.0516.
Optimization successful for x0=-1.2731. Start fval 35.128703, end fval 35.128658.
Next guess for x0 in direction -1 is -1.3323. Step size: -0.0592.
Optimization successful for x0=-1.3323. Start fval 52.443181, end fval 52.443107.
Next guess for x0 in direction -1 is -1.4001. Step size: -0.0679.
Optimization successful for x0=-1.4001. Start fval 78.475599, end fval 78.475476.
Next guess for x0 in direction -1 is -1.4779. Step size: -0.0778.
Optimization successful for x0=-1.4779. Start fval 117.582045, end fval 117.581843.
Next guess for x0 in direction -1 is -1.5669. Step size: -0.0890.
Optimization successful for x0=-1.5669. Start fval 176.281765, end fval 176.281434.
Next guess for x0 in direction -1 is -1.6669. Step size: -0.1000.
Optimization successful for x0=-1.6669. Start fval 262.887874, end fval 262.887374.
Next guess for x0 in direction -1 is -1.7669. Step size: -0.1000.
Optimization successful for x0=-1.7669. Start fval 374.783541, end fval 374.783007.
Next guess for x0 in direction -1 is -1.8669. Step size: -0.1000.
Optimization successful for x0=-1.8669. Start fval 515.800249, end fval 515.799751.
Next guess for x0 in direction -1 is -1.9669. Step size: -0.1000.
Optimization successful for x0=-1.9669. Start fval 690.014708, end fval 690.014244.
Next guess for x0 in direction -1 is -2.0669. Step size: -0.1000.
Optimization successful for x0=-2.0669. Start fval 901.748411, end fval 901.747978.
Next guess for x0 in direction -1 is -2.1669. Step size: -0.1000.
Optimization successful for x0=-2.1669. Start fval 1155.567379, end fval 1155.566979.
Next guess for x0 in direction -1 is -2.2669. Step size: -0.1000.
Optimization successful for x0=-2.2669. Start fval 1456.281902, end fval 1456.281526.
Next guess for x0 in direction -1 is -2.3669. Step size: -0.1000.
Optimization successful for x0=-2.3669. Start fval 1808.946253, end fval 1808.945893.
Next guess for x0 in direction -1 is -2.4669. Step size: -0.1000.
Optimization successful for x0=-2.4669. Start fval 2218.858463, end fval 2218.858124.
Next guess for x0 in direction -1 is -2.5669. Step size: -0.1000.
Optimization successful for x0=-2.5669. Start fval 2691.560182, end fval 2691.559818.
Next guess for x0 in direction -1 is -2.6669. Step size: -0.1000.
Optimization successful for x0=-2.6669. Start fval 3232.836245, end fval 3232.835956.
Next guess for x0 in direction -1 is -2.7669. Step size: -0.1000.
Optimization successful for x0=-2.7669. Start fval 3848.715036, end fval 3848.714714.
Next guess for x0 in direction -1 is -2.8669. Step size: -0.1000.
Optimization successful for x0=-2.8669. Start fval 4545.467617, end fval 4545.467317.
Next guess for x0 in direction -1 is -2.9669. Step size: -0.1000.
Optimization successful for x0=-2.9669. Start fval 5329.608174, end fval 5329.607892.
Next guess for x0 in direction -1 is -3.0669. Step size: -0.1000.
Optimization successful for x0=-3.0669. Start fval 6207.893606, end fval 6207.893342.
Next guess for x0 in direction -1 is -3.1669. Step size: -0.1000.
Optimization successful for x0=-3.1669. Start fval 7187.323495, end fval 7187.323205.
Next guess for x0 in direction -1 is -3.2669. Step size: -0.1000.
Optimization successful for x0=-3.2669. Start fval 8275.139814, end fval 8275.139586.
Next guess for x0 in direction -1 is -3.3669. Step size: -0.1000.
Optimization successful for x0=-3.3669. Start fval 9478.827308, end fval 9478.826971.
Next guess for x0 in direction -1 is -3.4669. Step size: -0.1000.
Optimization successful for x0=-3.4669. Start fval 10806.112454, end fval 10806.112247.
Next guess for x0 in direction -1 is -3.5669. Step size: -0.1000.
Optimization successful for x0=-3.5669. Start fval 12264.964777, end fval 12264.964490.
Next guess for x0 in direction -1 is -3.6669. Step size: -0.1000.
Optimization successful for x0=-3.6669. Start fval 13863.595180, end fval 13863.594980.
Next guess for x0 in direction -1 is -3.7669. Step size: -0.1000.
Optimization successful for x0=-3.7669. Start fval 15610.457322, end fval 15610.457006.
Next guess for x0 in direction -1 is -3.8669. Step size: -0.1000.
Optimization successful for x0=-3.8669. Start fval 17514.246153, end fval 17514.245968.
Next guess for x0 in direction -1 is -3.9669. Step size: -0.1000.
Optimization successful for x0=-3.9669. Start fval 19583.899352, end fval 19583.899146.
Next guess for x0 in direction -1 is -4.0669. Step size: -0.1000.
Optimization successful for x0=-4.0669. Start fval 21828.595909, end fval 21828.595690.
Next guess for x0 in direction -1 is -4.1669. Step size: -0.1000.
Optimization successful for x0=-4.1669. Start fval 24257.756768, end fval 24257.756561.
Next guess for x0 in direction -1 is -4.2669. Step size: -0.1000.
Optimization successful for x0=-4.2669. Start fval 26881.044674, end fval 26881.044472.
Next guess for x0 in direction -1 is -4.3669. Step size: -0.1000.
Optimization successful for x0=-4.3669. Start fval 29708.364034, end fval 29708.363839.
Next guess for x0 in direction -1 is -4.4669. Step size: -0.1000.
Optimization successful for x0=-4.4669. Start fval 32749.860914, end fval 32749.860726.
Next guess for x0 in direction -1 is -4.5669. Step size: -0.1000.
Optimization successful for x0=-4.5669. Start fval 36015.922975, end fval 36015.922793.
Next guess for x0 in direction -1 is -4.6669. Step size: -0.1000.
Optimization successful for x0=-4.6669. Start fval 39517.179423, end fval 39517.179248.
Next guess for x0 in direction -1 is -4.7669. Step size: -0.1000.
Optimization successful for x0=-4.7669. Start fval 43264.500974, end fval 43264.500805.
Next guess for x0 in direction -1 is -4.8669. Step size: -0.1000.
Optimization successful for x0=-4.8669. Start fval 47268.999803, end fval 47268.999639.
Next guess for x0 in direction -1 is -4.9669. Step size: -0.1000.
Optimization successful for x0=-4.9669. Start fval 51542.029506, end fval 51542.029348.
Next guess for x0 in direction -1 is -5.0000. Step size: -0.0331.
Optimization successful for x0=-5.0000. Start fval 53019.631895, end fval 53018.240792.
Next guess for x0 in direction 1 is 1.0266. Step size: 0.0266.
Optimization successful for x0=1.0266. Start fval 0.220103, end fval 0.220100.
Next guess for x0 in direction 1 is 1.0325. Step size: 0.0059.
Optimization successful for x0=1.0325. Start fval 0.330017, end fval 0.330016.
Next guess for x0 in direction 1 is 1.0396. Step size: 0.0071.
Optimization successful for x0=1.0396. Start fval 0.494938, end fval 0.494937.
Next guess for x0 in direction 1 is 1.0483. Step size: 0.0087.
Optimization successful for x0=1.0483. Start fval 0.742268, end fval 0.742268.
Next guess for x0 in direction 1 is 1.0588. Step size: 0.0105.
Optimization successful for x0=1.0588. Start fval 1.113182, end fval 1.113182.
Next guess for x0 in direction 1 is 1.0715. Step size: 0.0127.
Optimization successful for x0=1.0715. Start fval 1.669540, end fval 1.669540.
Next guess for x0 in direction 1 is 1.0869. Step size: 0.0153.
Optimization successful for x0=1.0869. Start fval 2.503989, end fval 2.503988.
Next guess for x0 in direction 1 is 1.1053. Step size: 0.0184.
Optimization successful for x0=1.1053. Start fval 3.754710, end fval 3.754709.
Next guess for x0 in direction 1 is 1.1274. Step size: 0.0221.
Optimization successful for x0=1.1274. Start fval 5.629436, end fval 5.629435.
Next guess for x0 in direction 1 is 1.1539. Step size: 0.0264.
Optimization successful for x0=1.1539. Start fval 8.440232, end fval 8.440229.
Next guess for x0 in direction 1 is 1.1853. Step size: 0.0315.
Optimization successful for x0=1.1853. Start fval 12.657018, end fval 12.657012.
Next guess for x0 in direction 1 is 1.2227. Step size: 0.0373.
Optimization successful for x0=1.2227. Start fval 18.982414, end fval 18.982402.
Next guess for x0 in direction 1 is 1.2667. Step size: 0.0440.
Optimization successful for x0=1.2667. Start fval 28.460274, end fval 28.460251.
Next guess for x0 in direction 1 is 1.3184. Step size: 0.0517.
Optimization successful for x0=1.3184. Start fval 42.668449, end fval 42.668407.
Next guess for x0 in direction 1 is 1.3788. Step size: 0.0604.
Optimization successful for x0=1.3788. Start fval 63.993765, end fval 63.993688.
Next guess for x0 in direction 1 is 1.4489. Step size: 0.0701.
Optimization successful for x0=1.4489. Start fval 95.949812, end fval 95.949678.
Next guess for x0 in direction 1 is 1.5299. Step size: 0.0811.
Optimization successful for x0=1.5299. Start fval 143.843511, end fval 143.843283.
Next guess for x0 in direction 1 is 1.6299. Step size: 0.1000.
Optimization successful for x0=1.6299. Start fval 221.628181, end fval 221.627705.
Next guess for x0 in direction 1 is 1.7299. Step size: 0.1000.
Optimization successful for x0=1.7299. Start fval 323.349215, end fval 323.348674.
Next guess for x0 in direction 1 is 1.8299. Step size: 0.1000.
Optimization successful for x0=1.8299. Start fval 452.747441, end fval 452.746928.
Next guess for x0 in direction 1 is 1.9299. Step size: 0.1000.
Optimization successful for x0=1.9299. Start fval 613.809048, end fval 613.808572.
Next guess for x0 in direction 1 is 2.0299. Step size: 0.1000.
Optimization successful for x0=2.0299. Start fval 810.765138, end fval 810.764693.
Next guess for x0 in direction 1 is 2.1299. Step size: 0.1000.
Optimization successful for x0=2.1299. Start fval 1048.091444, end fval 1048.091027.
Next guess for x0 in direction 1 is 2.2299. Step size: 0.1000.
Optimization successful for x0=2.2299. Start fval 1330.508047, end fval 1330.507662.
Next guess for x0 in direction 1 is 2.3299. Step size: 0.1000.
Optimization successful for x0=2.3299. Start fval 1662.979136, end fval 1662.978773.
Next guess for x0 in direction 1 is 2.4299. Step size: 0.1000.
Optimization successful for x0=2.4299. Start fval 2050.712734, end fval 2050.712387.
Next guess for x0 in direction 1 is 2.5299. Step size: 0.1000.
Optimization successful for x0=2.5299. Start fval 2499.160530, end fval 2499.160159.
Next guess for x0 in direction 1 is 2.6299. Step size: 0.1000.
Optimization successful for x0=2.6299. Start fval 3014.017489, end fval 3014.017194.
Next guess for x0 in direction 1 is 2.7299. Step size: 0.1000.
Optimization successful for x0=2.7299. Start fval 3601.222183, end fval 3601.221855.
Next guess for x0 in direction 1 is 2.8299. Step size: 0.1000.
Optimization successful for x0=2.8299. Start fval 4266.955911, end fval 4266.955606.
Next guess for x0 in direction 1 is 2.9299. Step size: 0.1000.
Optimization successful for x0=2.9299. Start fval 5017.643154, end fval 5017.642868.
Next guess for x0 in direction 1 is 3.0299. Step size: 0.1000.
Optimization successful for x0=3.0299. Start fval 5859.951153, end fval 5859.950880.
Next guess for x0 in direction 1 is 3.1299. Step size: 0.1000.
Optimization successful for x0=3.1299. Start fval 6800.789836, end fval 6800.789579.
Next guess for x0 in direction 1 is 3.2299. Step size: 0.1000.
Optimization successful for x0=3.2299. Start fval 7847.311746, end fval 7847.311465.
Next guess for x0 in direction 1 is 3.3299. Step size: 0.1000.
Optimization successful for x0=3.3299. Start fval 9006.911758, end fval 9006.911535.
Next guess for x0 in direction 1 is 3.4299. Step size: 0.1000.
Optimization successful for x0=3.4299. Start fval 10287.227439, end fval 10287.227111.
Next guess for x0 in direction 1 is 3.5299. Step size: 0.1000.
Optimization successful for x0=3.5299. Start fval 11696.138055, end fval 11696.137853.
Next guess for x0 in direction 1 is 3.6299. Step size: 0.1000.
Optimization successful for x0=3.6299. Start fval 13241.765837, end fval 13241.765558.
Next guess for x0 in direction 1 is 3.7299. Step size: 0.1000.
Optimization successful for x0=3.7299. Start fval 14932.474373, end fval 14932.474178.
Next guess for x0 in direction 1 is 3.8299. Step size: 0.1000.
Optimization successful for x0=3.8299. Start fval 16776.869932, end fval 16776.869634.
Next guess for x0 in direction 1 is 3.9299. Step size: 0.1000.
Optimization successful for x0=3.9299. Start fval 18783.800073, end fval 18783.799892.
Next guess for x0 in direction 1 is 4.0299. Step size: 0.1000.
Optimization successful for x0=4.0299. Start fval 20962.354996, end fval 20962.354773.
Next guess for x0 in direction 1 is 4.1299. Step size: 0.1000.
Optimization successful for x0=4.1299. Start fval 23321.866133, end fval 23321.865915.
Next guess for x0 in direction 1 is 4.2299. Step size: 0.1000.
Optimization successful for x0=4.2299. Start fval 25871.906936, end fval 25871.906744.
Next guess for x0 in direction 1 is 4.3299. Step size: 0.1000.
Optimization successful for x0=4.3299. Start fval 28622.292601, end fval 28622.292404.
Next guess for x0 in direction 1 is 4.4299. Step size: 0.1000.
Optimization successful for x0=4.4299. Start fval 31583.079897, end fval 31583.079707.
Next guess for x0 in direction 1 is 4.5299. Step size: 0.1000.
Optimization successful for x0=4.5299. Start fval 34764.567259, end fval 34764.567078.
Next guess for x0 in direction 1 is 4.6299. Step size: 0.1000.
Optimization successful for x0=4.6299. Start fval 38177.294682, end fval 38177.294506.
Next guess for x0 in direction 1 is 4.7299. Step size: 0.1000.
Optimization successful for x0=4.7299. Start fval 41832.043674, end fval 41832.043504.
Next guess for x0 in direction 1 is 4.8299. Step size: 0.1000.
Optimization successful for x0=4.8299. Start fval 45739.837225, end fval 45739.837060.
Next guess for x0 in direction 1 is 4.9299. Step size: 0.1000.
Optimization successful for x0=4.9299. Start fval 49911.939760, end fval 49911.939600.
Next guess for x0 in direction 1 is 5.0000. Step size: 0.0701.
Optimization successful for x0=5.0000. Start fval 52998.525743, end fval 52998.240225.
Next guess for x3 in direction -1 is 0.9855. Step size: -0.0145.
Optimization successful for x3=0.9855. Start fval 0.104276, end fval 0.062466.
Next guess for x3 in direction -1 is 0.9822. Step size: -0.0033.
Optimization successful for x3=0.9822. Start fval 0.093695, end fval 0.093695.
Next guess for x3 in direction -1 is 0.9781. Step size: -0.0041.
Optimization successful for x3=0.9781. Start fval 0.140528, end fval 0.140528.
Next guess for x3 in direction -1 is 0.9732. Step size: -0.0050.
Optimization successful for x3=0.9732. Start fval 0.210773, end fval 0.210773.
Next guess for x3 in direction -1 is 0.9670. Step size: -0.0061.
Optimization successful for x3=0.9670. Start fval 0.316132, end fval 0.316132.
Next guess for x3 in direction -1 is 0.9594. Step size: -0.0076.
Optimization successful for x3=0.9594. Start fval 0.474162, end fval 0.474162.
Next guess for x3 in direction -1 is 0.9500. Step size: -0.0094.
Optimization successful for x3=0.9500. Start fval 0.711199, end fval 0.711199.
Next guess for x3 in direction -1 is 0.9384. Step size: -0.0116.
Optimization successful for x3=0.9384. Start fval 1.066749, end fval 1.066748.
Next guess for x3 in direction -1 is 0.9239. Step size: -0.0145.
Optimization successful for x3=0.9239. Start fval 1.599608, end fval 1.599607.
Next guess for x3 in direction -1 is 0.9058. Step size: -0.0181.
Optimization successful for x3=0.9058. Start fval 2.398664, end fval 2.398660.
Next guess for x3 in direction -1 is 0.8830. Step size: -0.0227.
Optimization successful for x3=0.8830. Start fval 3.596968, end fval 3.596960.
Next guess for x3 in direction -1 is 0.8542. Step size: -0.0288.
Optimization successful for x3=0.8542. Start fval 5.394191, end fval 5.394168.
Next guess for x3 in direction -1 is 0.8174. Step size: -0.0369.
Optimization successful for x3=0.8174. Start fval 8.090153, end fval 8.090079.
Next guess for x3 in direction -1 is 0.7694. Step size: -0.0480.
Optimization successful for x3=0.7694. Start fval 12.134799, end fval 12.134595.
Next guess for x3 in direction -1 is 0.7055. Step size: -0.0639.
Optimization successful for x3=0.7055. Start fval 18.199477, end fval 18.198791.
Next guess for x3 in direction -1 is 0.6166. Step size: -0.0889.
Optimization successful for x3=0.6166. Start fval 27.297956, end fval 27.295194.
Next guess for x3 in direction -1 is 0.5166. Step size: -0.1000.
Optimization successful for x3=0.5166. Start fval 37.533447, end fval 37.527063.
Next guess for x3 in direction -1 is 0.4166. Step size: -0.1000.
Optimization successful for x3=0.4166. Start fval 46.859879, end fval 46.850580.
Next guess for x3 in direction -1 is 0.3166. Step size: -0.1000.
Optimization successful for x3=0.3166. Start fval 54.602560, end fval 54.588993.
Next guess for x3 in direction -1 is 0.2166. Step size: -0.1000.
Optimization successful for x3=0.2166. Start fval 60.365480, end fval 60.344613.
Next guess for x3 in direction -1 is 0.1166. Step size: -0.1000.
Optimization successful for x3=0.1166. Start fval 64.057359, end fval 64.021187.
Next guess for x3 in direction -1 is 0.0166. Step size: -0.1000.
Optimization successful for x3=0.0166. Start fval 65.954546, end fval 65.887193.
Next guess for x3 in direction -1 is -0.0834. Step size: -0.1000.
Optimization successful for x3=-0.0834. Start fval 66.859828, end fval 66.710031.
Next guess for x3 in direction -1 is -0.1834. Step size: -0.1000.
Optimization successful for x3=-0.1834. Start fval 67.524789, end fval 67.197833.
Next guess for x3 in direction -1 is -0.2834. Step size: -0.1000.
Optimization successful for x3=-0.2834. Start fval 67.589360, end fval 67.447060.
Next guess for x3 in direction -1 is -0.3834. Step size: -0.1000.
Optimization successful for x3=-0.3834. Start fval 67.576571, end fval 67.559020.
Next guess for x3 in direction -1 is -0.4750. Step size: -0.0916.
Optimization successful for x3=-0.4750. Start fval 67.831382, end fval 67.826145.
Next guess for x3 in direction -1 is -0.5374. Step size: -0.0624.
Optimization successful for x3=-0.5374. Start fval 68.330046, end fval 68.329198.
Next guess for x3 in direction -1 is -0.5937. Step size: -0.0563.
Optimization successful for x3=-0.5937. Start fval 69.186641, end fval 69.186243.
Next guess for x3 in direction -1 is -0.6491. Step size: -0.0554.
Optimization successful for x3=-0.6491. Start fval 70.573351, end fval 70.573173.
Next guess for x3 in direction -1 is -0.7059. Step size: -0.0569.
Optimization successful for x3=-0.7059. Start fval 72.755113, end fval 72.754937.
Next guess for x3 in direction -1 is -0.7658. Step size: -0.0599.
Optimization successful for x3=-0.7658. Start fval 76.132092, end fval 76.131896.
Next guess for x3 in direction -1 is -0.8298. Step size: -0.0639.
Optimization successful for x3=-0.8298. Start fval 81.291411, end fval 81.291153.
Next guess for x3 in direction -1 is -0.8988. Step size: -0.0690.
Optimization successful for x3=-0.8988. Start fval 89.119771, end fval 89.119475.
Next guess for x3 in direction -1 is -0.9740. Step size: -0.0752.
Optimization successful for x3=-0.9740. Start fval 100.962736, end fval 100.962269.
Next guess for x3 in direction -1 is -1.0561. Step size: -0.0822.
Optimization successful for x3=-1.0561. Start fval 118.792969, end fval 118.792546.
Next guess for x3 in direction -1 is -1.1464. Step size: -0.0903.
Optimization successful for x3=-1.1464. Start fval 145.618135, end fval 145.617556.
Next guess for x3 in direction -1 is -1.2464. Step size: -0.1000.
Optimization successful for x3=-1.2464. Start fval 186.178385, end fval 186.177606.
Next guess for x3 in direction -1 is -1.3464. Step size: -0.1000.
Optimization successful for x3=-1.3464. Start fval 240.610783, end fval 240.609992.
Next guess for x3 in direction -1 is -1.4464. Step size: -0.1000.
Optimization successful for x3=-1.4464. Start fval 311.710789, end fval 311.710062.
Next guess for x3 in direction -1 is -1.5464. Step size: -0.1000.
Optimization successful for x3=-1.5464. Start fval 402.521210, end fval 402.520526.
Next guess for x3 in direction -1 is -1.6464. Step size: -0.1000.
Optimization successful for x3=-1.6464. Start fval 516.331488, end fval 516.330859.
Next guess for x3 in direction -1 is -1.7464. Step size: -0.1000.
Optimization successful for x3=-1.7464. Start fval 656.677261, end fval 656.676686.
Next guess for x3 in direction -1 is -1.8464. Step size: -0.1000.
Optimization successful for x3=-1.8464. Start fval 827.339868, end fval 827.339335.
Next guess for x3 in direction -1 is -1.9464. Step size: -0.1000.
Optimization successful for x3=-1.9464. Start fval 1032.345919, end fval 1032.345416.
Next guess for x3 in direction -1 is -2.0464. Step size: -0.1000.
Optimization successful for x3=-2.0464. Start fval 1275.966915, end fval 1275.966446.
Next guess for x3 in direction -1 is -2.1464. Step size: -0.1000.
Optimization successful for x3=-2.1464. Start fval 1562.718964, end fval 1562.718525.
Next guess for x3 in direction -1 is -2.2464. Step size: -0.1000.
Optimization successful for x3=-2.2464. Start fval 1897.362475, end fval 1897.362048.
Next guess for x3 in direction -1 is -2.3464. Step size: -0.1000.
Optimization successful for x3=-2.3464. Start fval 2284.901843, end fval 2284.901444.
Next guess for x3 in direction -1 is -2.4464. Step size: -0.1000.
Optimization successful for x3=-2.4464. Start fval 2730.585325, end fval 2730.584950.
Next guess for x3 in direction -1 is -2.5464. Step size: -0.1000.
Optimization successful for x3=-2.5464. Start fval 3239.904800, end fval 3239.902027.
Next guess for x3 in direction -1 is -2.6464. Step size: -0.1000.
Optimization successful for x3=-2.6464. Start fval 3818.594300, end fval 3818.593801.
Next guess for x3 in direction -1 is -2.7464. Step size: -0.1000.
Optimization successful for x3=-2.7464. Start fval 4472.639320, end fval 4472.631468.
Next guess for x3 in direction -1 is -2.8464. Step size: -0.1000.
Optimization successful for x3=-2.8464. Start fval 5208.252268, end fval 5208.243493.
Next guess for x3 in direction -1 is -2.9464. Step size: -0.1000.
Optimization successful for x3=-2.9464. Start fval 6031.896217, end fval 6031.893788.
Next guess for x3 in direction -1 is -3.0464. Step size: -0.1000.
Optimization successful for x3=-3.0464. Start fval 6950.290629, end fval 6950.289362.
Next guess for x3 in direction -1 is -3.1464. Step size: -0.1000.
Optimization successful for x3=-3.1464. Start fval 7970.381181, end fval 7970.358857.
Next guess for x3 in direction -1 is -3.2464. Step size: -0.1000.
Optimization successful for x3=-3.2464. Start fval 9100.364848, end fval 9099.331948.
Next guess for x3 in direction -1 is -3.3464. Step size: -0.1000.
Optimization successful for x3=-3.3464. Start fval 10344.771957, end fval 10344.613207.
Next guess for x3 in direction -1 is -3.4464. Step size: -0.1000.
Optimization successful for x3=-3.4464. Start fval 11714.602994, end fval 11713.899424.
Next guess for x3 in direction -1 is -3.5464. Step size: -0.1000.
Optimization successful for x3=-3.5464. Start fval 13215.135176, end fval 13215.106058.
Next guess for x3 in direction -1 is -3.6464. Step size: -0.1000.
Optimization successful for x3=-3.6464. Start fval 14856.397478, end fval 14856.392809.
Next guess for x3 in direction -1 is -3.7464. Step size: -0.1000.
Optimization successful for x3=-3.7464. Start fval 16646.166191, end fval 16646.163483.
Next guess for x3 in direction -1 is -3.8464. Step size: -0.1000.
Optimization successful for x3=-3.8464. Start fval 18593.065411, end fval 18593.034510.
Next guess for x3 in direction -1 is -3.9464. Step size: -0.1000.
Optimization successful for x3=-3.9464. Start fval 20708.276885, end fval 20705.949495.
Next guess for x3 in direction -1 is -4.0464. Step size: -0.1000.
Optimization successful for x3=-4.0464. Start fval 22994.261562, end fval 22993.996239.
Next guess for x3 in direction -1 is -4.1464. Step size: -0.1000.
Optimization successful for x3=-4.1464. Start fval 25467.393630, end fval 25466.569253.
Next guess for x3 in direction -1 is -4.2464. Step size: -0.1000.
Optimization successful for x3=-4.2464. Start fval 28133.311691, end fval 28133.276126.
Next guess for x3 in direction -1 is -4.3464. Step size: -0.1000.
Optimization successful for x3=-4.3464. Start fval 31003.974438, end fval 31003.971144.
Next guess for x3 in direction -1 is -4.4464. Step size: -0.1000.
Optimization successful for x3=-4.4464. Start fval 34088.752085, end fval 34088.750991.
Next guess for x3 in direction -1 is -4.5464. Step size: -0.1000.
Optimization successful for x3=-4.5464. Start fval 37397.955046, end fval 37397.950816.
Next guess for x3 in direction -1 is -4.6464. Step size: -0.1000.
Optimization successful for x3=-4.6464. Start fval 40942.157505, end fval 40942.156830.
Next guess for x3 in direction -1 is -4.7464. Step size: -0.1000.
Optimization successful for x3=-4.7464. Start fval 44732.190951, end fval 44732.177590.
Next guess for x3 in direction -1 is -4.8464. Step size: -0.1000.
Optimization successful for x3=-4.8464. Start fval 48779.093211, end fval 48779.085348.
Next guess for x3 in direction -1 is -4.9464. Step size: -0.1000.
Optimization successful for x3=-4.9464. Start fval 53094.183670, end fval 53094.183416.
Next guess for x3 in direction -1 is -5.0000. Step size: -0.0536.
Optimization successful for x3=-5.0000. Start fval 55520.859736, end fval 55520.181764.
Next guess for x3 in direction 1 is 1.0252. Step size: 0.0252.
Optimization successful for x3=1.0252. Start fval 0.197629, end fval 0.197620.
Next guess for x3 in direction 1 is 1.0308. Step size: 0.0056.
Optimization successful for x3=1.0308. Start fval 0.296305, end fval 0.296305.
Next guess for x3 in direction 1 is 1.0376. Step size: 0.0068.
Optimization successful for x3=1.0376. Start fval 0.444381, end fval 0.444381.
Next guess for x3 in direction 1 is 1.0458. Step size: 0.0082.
Optimization successful for x3=1.0458. Start fval 0.666450, end fval 0.666450.
Next guess for x3 in direction 1 is 1.0558. Step size: 0.0100.
Optimization successful for x3=1.0558. Start fval 0.999480, end fval 0.999480.
Next guess for x3 in direction 1 is 1.0679. Step size: 0.0121.
Optimization successful for x3=1.0679. Start fval 1.498909, end fval 1.498908.
Next guess for x3 in direction 1 is 1.0825. Step size: 0.0146.
Optimization successful for x3=1.0825. Start fval 2.247514, end fval 2.247512.
Next guess for x3 in direction 1 is 1.1000. Step size: 0.0176.
Optimization successful for x3=1.1000. Start fval 3.369702, end fval 3.369700.
Next guess for x3 in direction 1 is 1.1211. Step size: 0.0211.
Optimization successful for x3=1.1211. Start fval 5.052304, end fval 5.052299.
Next guess for x3 in direction 1 is 1.1463. Step size: 0.0252.
Optimization successful for x3=1.1463. Start fval 7.576449, end fval 7.576439.
Next guess for x3 in direction 1 is 1.1764. Step size: 0.0301.
Optimization successful for x3=1.1764. Start fval 11.363402, end fval 11.363383.
Next guess for x3 in direction 1 is 1.2120. Step size: 0.0357.
Optimization successful for x3=1.2120. Start fval 17.038092, end fval 17.038054.
Next guess for x3 in direction 1 is 1.2542. Step size: 0.0421.
Optimization successful for x3=1.2542. Start fval 25.543728, end fval 25.543658.
Next guess for x3 in direction 1 is 1.3037. Step size: 0.0495.
Optimization successful for x3=1.3037. Start fval 38.302869, end fval 38.302742.
Next guess for x3 in direction 1 is 1.3617. Step size: 0.0580.
Optimization successful for x3=1.3617. Start fval 57.441442, end fval 57.441130.
Next guess for x3 in direction 1 is 1.4291. Step size: 0.0674.
Optimization successful for x3=1.4291. Start fval 86.114200, end fval 86.113825.
Next guess for x3 in direction 1 is 1.5071. Step size: 0.0780.
Optimization successful for x3=1.5071. Start fval 129.117932, end fval 129.117067.
Next guess for x3 in direction 1 is 1.5970. Step size: 0.0899.
Optimization successful for x3=1.5970. Start fval 193.619562, end fval 193.618471.
Next guess for x3 in direction 1 is 1.6970. Step size: 0.1000.
Optimization successful for x3=1.6970. Start fval 287.080828, end fval 287.078875.
Next guess for x3 in direction 1 is 1.7970. Step size: 0.1000.
Optimization successful for x3=1.7970. Start fval 406.961557, end fval 406.960077.
Next guess for x3 in direction 1 is 1.8970. Step size: 0.1000.
Optimization successful for x3=1.8970. Start fval 557.168507, end fval 557.167190.
Next guess for x3 in direction 1 is 1.9970. Step size: 0.1000.
Optimization successful for x3=1.9970. Start fval 741.851644, end fval 741.850458.
Next guess for x3 in direction 1 is 2.0970. Step size: 0.1000.
Optimization successful for x3=2.0970. Start fval 965.406000, end fval 965.404912.
Next guess for x3 in direction 1 is 2.1970. Step size: 0.1000.
Optimization successful for x3=2.1970. Start fval 1232.471043, end fval 1232.470045.
Next guess for x3 in direction 1 is 2.2970. Step size: 0.1000.
Optimization successful for x3=2.2970. Start fval 1547.930464, end fval 1547.929545.
Next guess for x3 in direction 1 is 2.3970. Step size: 0.1000.
Optimization successful for x3=2.3970. Start fval 1916.911887, end fval 1916.911037.
Next guess for x3 in direction 1 is 2.4970. Step size: 0.1000.
Optimization successful for x3=2.4970. Start fval 2344.786654, end fval 2344.785868.
Next guess for x3 in direction 1 is 2.5970. Step size: 0.1000.
Optimization successful for x3=2.5970. Start fval 2837.169668, end fval 2837.168895.
Next guess for x3 in direction 1 is 2.6970. Step size: 0.1000.
Optimization successful for x3=2.6970. Start fval 3399.918992, end fval 3399.918306.
Next guess for x3 in direction 1 is 2.7970. Step size: 0.1000.
Optimization successful for x3=2.7970. Start fval 4039.136126, end fval 4039.135459.
Next guess for x3 in direction 1 is 2.8970. Step size: 0.1000.
Optimization successful for x3=2.8970. Start fval 4761.165320, end fval 4761.164719.
Next guess for x3 in direction 1 is 2.9970. Step size: 0.1000.
Optimization successful for x3=2.9970. Start fval 5572.593957, end fval 5572.593307.
Next guess for x3 in direction 1 is 3.0970. Step size: 0.1000.
Optimization successful for x3=3.0970. Start fval 6480.251720, end fval 6480.251203.
Next guess for x3 in direction 1 is 3.1970. Step size: 0.1000.
Optimization successful for x3=3.1970. Start fval 7491.211560, end fval 7491.210993.
Next guess for x3 in direction 1 is 3.2970. Step size: 0.1000.
Optimization successful for x3=3.2970. Start fval 8612.788290, end fval 8612.787774.
Next guess for x3 in direction 1 is 3.3970. Step size: 0.1000.
Optimization successful for x3=3.3970. Start fval 9852.539535, end fval 9852.539050.
Next guess for x3 in direction 1 is 3.4970. Step size: 0.1000.
Optimization successful for x3=3.4970. Start fval 11218.265097, end fval 11218.264648.
Next guess for x3 in direction 1 is 3.5970. Step size: 0.1000.
Optimization successful for x3=3.5970. Start fval 12718.007091, end fval 12718.006578.
Next guess for x3 in direction 1 is 3.6970. Step size: 0.1000.
Optimization successful for x3=3.6970. Start fval 14360.049437, end fval 14360.049044.
Next guess for x3 in direction 1 is 3.7970. Step size: 0.1000.
Optimization successful for x3=3.7970. Start fval 16152.918718, end fval 16152.918274.
Next guess for x3 in direction 1 is 3.8970. Step size: 0.1000.
Optimization successful for x3=3.8970. Start fval 18105.382887, end fval 18105.382486.
Next guess for x3 in direction 1 is 3.9970. Step size: 0.1000.
Optimization successful for x3=3.9970. Start fval 20226.452208, end fval 20226.451824.
Next guess for x3 in direction 1 is 4.0970. Step size: 0.1000.
Optimization successful for x3=4.0970. Start fval 22525.378655, end fval 22525.378317.
Next guess for x3 in direction 1 is 4.1970. Step size: 0.1000.
Optimization successful for x3=4.1970. Start fval 25011.656196, end fval 25011.655692.
Next guess for x3 in direction 1 is 4.2970. Step size: 0.1000.
Optimization successful for x3=4.2970. Start fval 27695.019855, end fval 27695.019545.
Next guess for x3 in direction 1 is 4.3970. Step size: 0.1000.
Optimization successful for x3=4.3970. Start fval 30585.447481, end fval 30585.447039.
Next guess for x3 in direction 1 is 4.4970. Step size: 0.1000.
Optimization successful for x3=4.4970. Start fval 33693.157346, end fval 33693.157063.
Next guess for x3 in direction 1 is 4.5970. Step size: 0.1000.
Optimization successful for x3=4.5970. Start fval 37028.610424, end fval 37028.610026.
Next guess for x3 in direction 1 is 4.6970. Step size: 0.1000.
Optimization successful for x3=4.6970. Start fval 40602.508180, end fval 40602.507890.
Next guess for x3 in direction 1 is 4.7970. Step size: 0.1000.
Optimization successful for x3=4.7970. Start fval 44425.794441, end fval 44425.794083.
Next guess for x3 in direction 1 is 4.8970. Step size: 0.1000.
Optimization successful for x3=4.8970. Start fval 48509.653801, end fval 48509.653542.
Next guess for x3 in direction 1 is 4.9970. Step size: 0.1000.
Optimization successful for x3=4.9970. Start fval 52865.512909, end fval 52865.512564.
Next guess for x3 in direction 1 is 5.0000. Step size: 0.0030.
Optimization successful for x3=5.0000. Start fval 53003.709474, end fval 52999.839528.
Next guess for x0 in direction -1 is -1.0095. Step size: -0.0162.
Optimization successful for x0=-1.0095. Start fval 4.091226, end fval 4.065046.
Next guess for x0 in direction -1 is -1.0247. Step size: -0.0152.
Optimization successful for x0=-1.0247. Start fval 4.287695, end fval 4.287694.
Next guess for x0 in direction -1 is -1.0420. Step size: -0.0173.
Optimization successful for x0=-1.0420. Start fval 4.725729, end fval 4.725729.
Next guess for x0 in direction -1 is -1.0620. Step size: -0.0199.
Optimization successful for x0=-1.0620. Start fval 5.487468, end fval 5.487463.
Next guess for x0 in direction -1 is -1.0850. Step size: -0.0231.
Optimization successful for x0=-1.0850. Start fval 6.733543, end fval 6.733541.
Next guess for x0 in direction -1 is -1.1117. Step size: -0.0267.
Optimization successful for x0=-1.1117. Start fval 8.704289, end fval 8.704273.
Next guess for x0 in direction -1 is -1.1429. Step size: -0.0311.
Optimization successful for x0=-1.1429. Start fval 11.763793, end fval 11.763787.
Next guess for x0 in direction -1 is -1.1791. Step size: -0.0362.
Optimization successful for x0=-1.1791. Start fval 16.452851, end fval 16.452840.
Next guess for x0 in direction -1 is -1.2212. Step size: -0.0421.
Optimization successful for x0=-1.2212. Start fval 23.579423, end fval 23.579361.
Next guess for x0 in direction -1 is -1.2701. Step size: -0.0489.
Optimization successful for x0=-1.2701. Start fval 34.366192, end fval 34.366156.
Next guess for x0 in direction -1 is -1.3268. Step size: -0.0567.
Optimization successful for x0=-1.3268. Start fval 50.633368, end fval 50.633203.
Next guess for x0 in direction -1 is -1.3923. Step size: -0.0655.
Optimization successful for x0=-1.3923. Start fval 75.096531, end fval 75.096425.
Next guess for x0 in direction -1 is -1.4678. Step size: -0.0755.
Optimization successful for x0=-1.4678. Start fval 111.880240, end fval 111.879930.
Next guess for x0 in direction -1 is -1.5544. Step size: -0.0866.
Optimization successful for x0=-1.5544. Start fval 167.076999, end fval 167.076699.
Next guess for x0 in direction -1 is -1.6544. Step size: -0.1000.
Optimization successful for x0=-1.6544. Start fval 250.786858, end fval 250.786364.
Next guess for x0 in direction -1 is -1.7544. Step size: -0.1000.
Optimization successful for x0=-1.7544. Start fval 359.325907, end fval 359.324966.
Next guess for x0 in direction -1 is -1.8544. Step size: -0.1000.
Optimization successful for x0=-1.8544. Start fval 496.494484, end fval 496.493978.
Next guess for x0 in direction -1 is -1.9544. Step size: -0.1000.
Optimization successful for x0=-1.9544. Start fval 666.339956, end fval 666.338801.
Next guess for x0 in direction -1 is -2.0544. Step size: -0.1000.
Optimization successful for x0=-2.0544. Start fval 873.151557, end fval 873.151099.
Next guess for x0 in direction -1 is -2.1544. Step size: -0.1000.
Optimization successful for x0=-2.1544. Start fval 1121.466840, end fval 1121.466416.
Next guess for x0 in direction -1 is -2.2544. Step size: -0.1000.
Optimization successful for x0=-2.2544. Start fval 1416.064974, end fval 1416.063118.
Next guess for x0 in direction -1 is -2.3544. Step size: -0.1000.
Optimization successful for x0=-2.3544. Start fval 1761.968024, end fval 1761.967562.
Next guess for x0 in direction -1 is -2.4544. Step size: -0.1000.
Optimization successful for x0=-2.4544. Start fval 2164.447881, end fval 2164.444727.
Next guess for x0 in direction -1 is -2.5544. Step size: -0.1000.
Optimization successful for x0=-2.5544. Start fval 2629.008958, end fval 2629.008463.
Next guess for x0 in direction -1 is -2.6544. Step size: -0.1000.
Optimization successful for x0=-2.6544. Start fval 3161.413790, end fval 3161.413342.
Next guess for x0 in direction -1 is -2.7544. Step size: -0.1000.
Optimization successful for x0=-2.7544. Start fval 3767.657524, end fval 3767.651944.
Next guess for x0 in direction -1 is -2.8544. Step size: -0.1000.
Optimization successful for x0=-2.8544. Start fval 4453.975466, end fval 4453.974021.
Next guess for x0 in direction -1 is -2.9544. Step size: -0.1000.
Optimization successful for x0=-2.9544. Start fval 5226.865293, end fval 5226.853987.
Next guess for x0 in direction -1 is -3.0544. Step size: -0.1000.
Optimization successful for x0=-3.0544. Start fval 6093.029342, end fval 6093.027712.
Next guess for x0 in direction -1 is -3.1544. Step size: -0.1000.
Optimization successful for x0=-3.1544. Start fval 7059.465568, end fval 7059.455712.
Next guess for x0 in direction -1 is -3.2544. Step size: -0.1000.
Optimization successful for x0=-3.2544. Start fval 8133.359684, end fval 8133.358512.
Next guess for x0 in direction -1 is -3.3544. Step size: -0.1000.
Optimization successful for x0=-3.3544. Start fval 9322.192070, end fval 9322.181556.
Next guess for x0 in direction -1 is -3.4544. Step size: -0.1000.
Optimization successful for x0=-3.4544. Start fval 10633.631543, end fval 10633.630143.
Next guess for x0 in direction -1 is -3.5544. Step size: -0.1000.
Optimization successful for x0=-3.5544. Start fval 12075.644071, end fval 12075.642762.
Next guess for x0 in direction -1 is -3.6544. Step size: -0.1000.
Optimization successful for x0=-3.6544. Start fval 13656.401166, end fval 13656.383302.
Next guess for x0 in direction -1 is -3.7544. Step size: -0.1000.
Optimization successful for x0=-3.7544. Start fval 15384.542539, end fval 15384.301117.
Next guess for x0 in direction -1 is -3.8544. Step size: -0.1000.
Optimization successful for x0=-3.8544. Start fval 17268.079794, end fval 17268.038442.
Next guess for x0 in direction -1 is -3.9544. Step size: -0.1000.
Optimization successful for x0=-3.9544. Start fval 19316.622848, end fval 19316.520887.
Next guess for x0 in direction -1 is -4.0544. Step size: -0.1000.
Optimization successful for x0=-4.0544. Start fval 21538.911500, end fval 21538.894413.
Next guess for x0 in direction -1 is -4.1544. Step size: -0.1000.
Optimization successful for x0=-4.1544. Start fval 23944.552913, end fval 23944.548995.
Next guess for x0 in direction -1 is -4.2544. Step size: -0.1000.
Optimization successful for x0=-4.2544. Start fval 26543.119143, end fval 26543.075238.
Next guess for x0 in direction -1 is -4.3544. Step size: -0.1000.
Optimization successful for x0=-4.3544. Start fval 29345.489222, end fval 29344.416499.
Next guess for x0 in direction -1 is -4.4544. Step size: -0.1000.
Optimization successful for x0=-4.4544. Start fval 32358.782421, end fval 32358.643512.
Next guess for x0 in direction -1 is -4.5544. Step size: -0.1000.
Optimization successful for x0=-4.5544. Start fval 35596.324966, end fval 35596.137144.
Next guess for x0 in direction -1 is -4.6544. Step size: -0.1000.
Optimization successful for x0=-4.6544. Start fval 39067.518637, end fval 39067.492324.
Next guess for x0 in direction -1 is -4.7544. Step size: -0.1000.
Optimization successful for x0=-4.7544. Start fval 42783.553877, end fval 42783.548570.
Next guess for x0 in direction -1 is -4.8544. Step size: -0.1000.
Optimization successful for x0=-4.8544. Start fval 46755.390235, end fval 46755.387535.
Next guess for x0 in direction -1 is -4.9544. Step size: -0.1000.
Optimization successful for x0=-4.9544. Start fval 50994.334146, end fval 50994.332470.
Next guess for x0 in direction -1 is -5.0000. Step size: -0.0456.
Optimization successful for x0=-5.0000. Start fval 53019.253973, end fval 53018.238194.
Next guess for x0 in direction 1 is -0.9655. Step size: 0.0278.
Optimization successful for x0=-0.9655. Start fval 4.207165, end fval 4.207162.
Next guess for x0 in direction 1 is -0.9447. Step size: 0.0207.
Optimization successful for x0=-0.9447. Start fval 4.642245, end fval 4.642243.
Next guess for x0 in direction 1 is -0.9210. Step size: 0.0237.
Optimization successful for x0=-0.9210. Start fval 5.399583, end fval 5.399581.
Next guess for x0 in direction 1 is -0.8925. Step size: 0.0285.
Optimization successful for x0=-0.8925. Start fval 6.639302, end fval 6.639288.
Next guess for x0 in direction 1 is -0.8575. Step size: 0.0350.
Optimization successful for x0=-0.8575. Start fval 8.601850, end fval 8.601832.
Next guess for x0 in direction 1 is -0.8134. Step size: 0.0441.
Optimization successful for x0=-0.8134. Start fval 11.648195, end fval 11.648169.
Next guess for x0 in direction 1 is -0.7564. Step size: 0.0570.
Optimization successful for x0=-0.7564. Start fval 16.320828, end fval 16.320756.
Next guess for x0 in direction 1 is -0.6801. Step size: 0.0763.
Optimization successful for x0=-0.6801. Start fval 23.433974, end fval 23.433747.
Next guess for x0 in direction 1 is -0.5801. Step size: 0.1000.
Optimization successful for x0=-0.5801. Start fval 33.340741, end fval 33.340073.
Next guess for x0 in direction 1 is -0.4801. Step size: 0.1000.
Optimization successful for x0=-0.4801. Start fval 42.895265, end fval 42.894434.
Next guess for x0 in direction 1 is -0.3801. Step size: 0.1000.
Optimization successful for x0=-0.3801. Start fval 51.244682, end fval 51.243960.
Next guess for x0 in direction 1 is -0.2801. Step size: 0.1000.
Optimization successful for x0=-0.2801. Start fval 57.803444, end fval 57.802997.
Next guess for x0 in direction 1 is -0.1801. Step size: 0.1000.
Optimization successful for x0=-0.1801. Start fval 62.260073, end fval 62.259932.
Next guess for x0 in direction 1 is -0.0801. Step size: 0.1000.
Optimization successful for x0=-0.0801. Start fval 64.582128, end fval 64.578926.
Next guess for x0 in direction 1 is 0.0199. Step size: 0.1000.
Optimization successful for x0=0.0199. Start fval 64.975228, end fval 64.936962.
Next guess for x0 in direction 1 is 0.0795. Step size: 0.0596.
Optimization successful for x0=0.0795. Start fval 64.294548, end fval 64.269280.
Next guess for x0 in direction 1 is 0.1301. Step size: 0.0506.
Optimization successful for x0=0.1301. Start fval 63.164975, end fval 63.159863.
Next guess for x0 in direction 1 is 0.1840. Step size: 0.0539.
Optimization successful for x0=0.1840. Start fval 61.394161, end fval 61.392559.
Next guess for x0 in direction 1 is 0.2450. Step size: 0.0610.
Optimization successful for x0=0.2450. Start fval 58.638254, end fval 58.637737.
Next guess for x0 in direction 1 is 0.3162. Step size: 0.0712.
Optimization successful for x0=0.3162. Start fval 54.404039, end fval 54.403966.
Next guess for x0 in direction 1 is 0.4019. Step size: 0.0857.
Optimization successful for x0=0.4019. Start fval 47.955076, end fval 47.954912.
Next guess for x0 in direction 1 is 0.5019. Step size: 0.1000.
Optimization successful for x0=0.5019. Start fval 38.884661, end fval 38.883865.
Next guess for x0 in direction 1 is 0.6019. Step size: 0.1000.
Optimization successful for x0=0.6019. Start fval 28.772329, end fval 28.771127.
Next guess for x0 in direction 1 is 0.7019. Step size: 0.1000.
Optimization successful for x0=0.7019. Start fval 18.528232, end fval 18.526980.
Next guess for x0 in direction 1 is 0.8019. Step size: 0.1000.
Optimization successful for x0=0.8019. Start fval 9.323782, end fval 9.322556.
Next guess for x0 in direction 1 is 0.8655. Step size: 0.0636.
Optimization successful for x0=0.8655. Start fval 4.653612, end fval 4.653318.
Next guess for x0 in direction 1 is 0.9073. Step size: 0.0419.
Optimization successful for x0=0.9073. Start fval 2.322065, end fval 2.322017.
Next guess for x0 in direction 1 is 0.9356. Step size: 0.0283.
Optimization successful for x0=0.9356. Start fval 1.158958, end fval 1.158949.
Next guess for x0 in direction 1 is 0.9550. Step size: 0.0194.
Optimization successful for x0=0.9550. Start fval 0.579323, end fval 0.579321.
Next guess for x0 in direction 1 is 0.9685. Step size: 0.0135.
Optimization successful for x0=0.9685. Start fval 0.289100, end fval 0.289100.
Next guess for x0 in direction 1 is 0.9778. Step size: 0.0094.
Optimization successful for x0=0.9778. Start fval 0.144311, end fval 0.144311.
Next guess for x0 in direction 1 is 0.9844. Step size: 0.0066.
Optimization successful for x0=0.9844. Start fval 0.072004, end fval 0.072004.
Next guess for x0 in direction 1 is 0.9890. Step size: 0.0046.
Optimization successful for x0=0.9890. Start fval 0.035926, end fval 0.035926.
Next guess for x0 in direction 1 is 0.9923. Step size: 0.0032.
Optimization successful for x0=0.9923. Start fval 0.017925, end fval 0.017925.
Next guess for x0 in direction 1 is 0.9945. Step size: 0.0023.
Optimization successful for x0=0.9945. Start fval 0.008943, end fval 0.008943.
Next guess for x0 in direction 1 is 0.9961. Step size: 0.0016.
Optimization successful for x0=0.9961. Start fval 0.004462, end fval 0.004462.
Next guess for x0 in direction 1 is 0.9973. Step size: 0.0011.
Optimization successful for x0=0.9973. Start fval 0.002226, end fval 0.002226.
Next guess for x0 in direction 1 is 0.9983. Step size: 0.0010.
Optimization successful for x0=0.9983. Start fval 0.000892, end fval 0.000892.
Next guess for x0 in direction 1 is 0.9993. Step size: 0.0010.
Optimization successful for x0=0.9993. Start fval 0.000157, end fval 0.000157.
Next guess for x0 in direction 1 is 1.0003. Step size: 0.0010.
Optimization successful for x0=1.0003. Start fval 0.000023, end fval 0.000023.
Next guess for x0 in direction 1 is 1.0013. Step size: 0.0010.
Optimization successful for x0=1.0013. Start fval 0.000493, end fval 0.000493.
Next guess for x0 in direction 1 is 1.0023. Step size: 0.0010.
Optimization successful for x0=1.0023. Start fval 0.001567, end fval 0.001567.
Next guess for x0 in direction 1 is 1.0033. Step size: 0.0010.
Optimization successful for x0=1.0033. Start fval 0.003249, end fval 0.003249.
Next guess for x0 in direction 1 is 1.0043. Step size: 0.0010.
Optimization successful for x0=1.0043. Start fval 0.005541, end fval 0.005541.
Next guess for x0 in direction 1 is 1.0053. Step size: 0.0010.
Optimization successful for x0=1.0053. Start fval 0.008444, end fval 0.008444.
Next guess for x0 in direction 1 is 1.0065. Step size: 0.0012.
Optimization successful for x0=1.0065. Start fval 0.012662, end fval 0.012662.
Next guess for x0 in direction 1 is 1.0079. Step size: 0.0014.
Optimization successful for x0=1.0079. Start fval 0.018990, end fval 0.018990.
Next guess for x0 in direction 1 is 1.0097. Step size: 0.0018.
Optimization successful for x0=1.0097. Start fval 0.028481, end fval 0.028481.
Next guess for x0 in direction 1 is 1.0118. Step size: 0.0022.
Optimization successful for x0=1.0118. Start fval 0.042716, end fval 0.042716.
Next guess for x0 in direction 1 is 1.0145. Step size: 0.0026.
Optimization successful for x0=1.0145. Start fval 0.064064, end fval 0.064064.
Next guess for x0 in direction 1 is 1.0177. Step size: 0.0032.
Optimization successful for x0=1.0177. Start fval 0.096082, end fval 0.096082.
Next guess for x0 in direction 1 is 1.0216. Step size: 0.0039.
Optimization successful for x0=1.0216. Start fval 0.144100, end fval 0.144100.
Next guess for x0 in direction 1 is 1.0264. Step size: 0.0048.
Optimization successful for x0=1.0264. Start fval 0.216116, end fval 0.216116.
Next guess for x0 in direction 1 is 1.0322. Step size: 0.0058.
Optimization successful for x0=1.0322. Start fval 0.324120, end fval 0.324120.
Next guess for x0 in direction 1 is 1.0393. Step size: 0.0071.
Optimization successful for x0=1.0393. Start fval 0.486094, end fval 0.486094.
Next guess for x0 in direction 1 is 1.0479. Step size: 0.0086.
Optimization successful for x0=1.0479. Start fval 0.729006, end fval 0.729006.
Next guess for x0 in direction 1 is 1.0583. Step size: 0.0104.
Optimization successful for x0=1.0583. Start fval 1.093294, end fval 1.093294.
Next guess for x0 in direction 1 is 1.0709. Step size: 0.0126.
Optimization successful for x0=1.0709. Start fval 1.639819, end fval 1.639819.
Next guess for x0 in direction 1 is 1.0861. Step size: 0.0152.
Optimization successful for x0=1.0861. Start fval 2.459285, end fval 2.459285.
Next guess for x0 in direction 1 is 1.1044. Step size: 0.0183.
Optimization successful for x0=1.1044. Start fval 3.687557, end fval 3.687556.
Next guess for x0 in direction 1 is 1.1264. Step size: 0.0219.
Optimization successful for x0=1.1264. Start fval 5.528705, end fval 5.528703.
Next guess for x0 in direction 1 is 1.1526. Step size: 0.0262.
Optimization successful for x0=1.1526. Start fval 8.289367, end fval 8.289364.
Next guess for x0 in direction 1 is 1.1838. Step size: 0.0312.
Optimization successful for x0=1.1838. Start fval 12.431452, end fval 12.431446.
Next guess for x0 in direction 1 is 1.2209. Step size: 0.0370.
Optimization successful for x0=1.2209. Start fval 18.643180, end fval 18.643169.
Next guess for x0 in direction 1 is 1.2646. Step size: 0.0437.
Optimization successful for x0=1.2646. Start fval 27.951109, end fval 27.951087.
Next guess for x0 in direction 1 is 1.3159. Step size: 0.0513.
Optimization successful for x0=1.3159. Start fval 41.905878, end fval 41.905836.
Next guess for x0 in direction 1 is 1.3759. Step size: 0.0600.
Optimization successful for x0=1.3759. Start fval 62.854236, end fval 62.854161.
Next guess for x0 in direction 1 is 1.4456. Step size: 0.0697.
Optimization successful for x0=1.4456. Start fval 94.238413, end fval 94.238283.
Next guess for x0 in direction 1 is 1.5261. Step size: 0.0805.
Optimization successful for x0=1.5261. Start fval 141.280015, end fval 141.279792.
Next guess for x0 in direction 1 is 1.6189. Step size: 0.0928.
Optimization successful for x0=1.6189. Start fval 211.912334, end fval 211.911959.
Next guess for x0 in direction 1 is 1.7189. Step size: 0.1000.
Optimization successful for x0=1.7189. Start fval 310.806167, end fval 310.805666.
Next guess for x0 in direction 1 is 1.8189. Step size: 0.1000.
Optimization successful for x0=1.8189. Start fval 436.951322, end fval 436.950804.
Next guess for x0 in direction 1 is 1.9189. Step size: 0.1000.
Optimization successful for x0=1.9189. Start fval 594.306833, end fval 594.306354.
Next guess for x0 in direction 1 is 2.0189. Step size: 0.1000.
Optimization successful for x0=2.0189. Start fval 787.076769, end fval 787.076321.
Next guess for x0 in direction 1 is 2.1189. Step size: 0.1000.
Optimization successful for x0=2.1189. Start fval 1019.709815, end fval 1019.709395.
Next guess for x0 in direction 1 is 2.2189. Step size: 0.1000.
Optimization successful for x0=2.2189. Start fval 1296.899037, end fval 1296.898649.
Next guess for x0 in direction 1 is 2.3189. Step size: 0.1000.
Optimization successful for x0=2.3189. Start fval 1623.581637, end fval 1623.581271.
Next guess for x0 in direction 1 is 2.4189. Step size: 0.1000.
Optimization successful for x0=2.4189. Start fval 2004.938674, end fval 2004.938325.
Next guess for x0 in direction 1 is 2.5189. Step size: 0.1000.
Optimization successful for x0=2.5189. Start fval 2446.394900, end fval 2446.394527.
Next guess for x0 in direction 1 is 2.6189. Step size: 0.1000.
Optimization successful for x0=2.6189. Start fval 2953.618358, end fval 2953.618062.
Next guess for x0 in direction 1 is 2.7189. Step size: 0.1000.
Optimization successful for x0=2.7189. Start fval 3532.520723, end fval 3532.520393.
Next guess for x0 in direction 1 is 2.8189. Step size: 0.1000.
Optimization successful for x0=2.8189. Start fval 4189.256408, end fval 4189.256102.
Next guess for x0 in direction 1 is 2.9189. Step size: 0.1000.
Optimization successful for x0=2.9189. Start fval 4930.223028, end fval 4930.222740.
Next guess for x0 in direction 1 is 3.0189. Step size: 0.1000.
Optimization successful for x0=3.0189. Start fval 5762.060970, end fval 5762.060696.
Next guess for x0 in direction 1 is 3.1189. Step size: 0.1000.
Optimization successful for x0=3.1189. Start fval 6691.653324, end fval 6691.653066.
Next guess for x0 in direction 1 is 3.2189. Step size: 0.1000.
Optimization successful for x0=3.2189. Start fval 7726.125805, end fval 7726.125522.
Next guess for x0 in direction 1 is 3.3189. Step size: 0.1000.
Optimization successful for x0=3.3189. Start fval 8872.846472, end fval 8872.846249.
Next guess for x0 in direction 1 is 3.4189. Step size: 0.1000.
Optimization successful for x0=3.4189. Start fval 10139.426089, end fval 10139.425759.
Next guess for x0 in direction 1 is 3.5189. Step size: 0.1000.
Optimization successful for x0=3.5189. Start fval 11533.717123, end fval 11533.716920.
Next guess for x0 in direction 1 is 3.6189. Step size: 0.1000.
Optimization successful for x0=3.6189. Start fval 13063.815024, end fval 13063.814743.
Next guess for x0 in direction 1 is 3.7189. Step size: 0.1000.
Optimization successful for x0=3.7189. Start fval 14738.056598, end fval 14738.056402.
Next guess for x0 in direction 1 is 3.8189. Step size: 0.1000.
Optimization successful for x0=3.8189. Start fval 16565.021350, end fval 16565.021050.
Next guess for x0 in direction 1 is 3.9189. Step size: 0.1000.
Optimization successful for x0=3.9189. Start fval 18553.530073, end fval 18553.529892.
Next guess for x0 in direction 1 is 4.0189. Step size: 0.1000.
Optimization successful for x0=4.0189. Start fval 20712.646217, end fval 20712.645994.
Next guess for x0 in direction 1 is 4.1189. Step size: 0.1000.
Optimization successful for x0=4.1189. Start fval 23051.674465, end fval 23051.674246.
Next guess for x0 in direction 1 is 4.2189. Step size: 0.1000.
Optimization successful for x0=4.2189. Start fval 25580.161529, end fval 25580.161336.
Next guess for x0 in direction 1 is 4.3189. Step size: 0.1000.
Optimization successful for x0=4.3189. Start fval 28307.895869, end fval 28307.895672.
Next guess for x0 in direction 1 is 4.4189. Step size: 0.1000.
Optimization successful for x0=4.4189. Start fval 31244.907526, end fval 31244.907335.
Next guess for x0 in direction 1 is 4.5189. Step size: 0.1000.
Optimization successful for x0=4.5189. Start fval 34401.468210, end fval 34401.468028.
Next guess for x0 in direction 1 is 4.6189. Step size: 0.1000.
Optimization successful for x0=4.6189. Start fval 37788.091199, end fval 37788.091023.
Next guess for x0 in direction 1 is 4.7189. Step size: 0.1000.
Optimization successful for x0=4.7189. Start fval 41415.531287, end fval 41415.531116.
Next guess for x0 in direction 1 is 4.8189. Step size: 0.1000.
Optimization successful for x0=4.8189. Start fval 45294.784755, end fval 45294.784590.
Next guess for x0 in direction 1 is 4.9189. Step size: 0.1000.
Optimization successful for x0=4.9189. Start fval 49437.089324, end fval 49437.089163.
Next guess for x0 in direction 1 is 5.0000. Step size: 0.0811.
Optimization successful for x0=5.0000. Start fval 52998.356797, end fval 52998.240312.
Next guess for x3 in direction -1 is 0.9846. Step size: -0.0145.
Optimization successful for x3=0.9846. Start fval 4.090908, end fval 4.048984.
Next guess for x3 in direction -1 is 0.9692. Step size: -0.0155.
Optimization successful for x3=0.9692. Start fval 4.247754, end fval 4.247752.
Next guess for x3 in direction -1 is 0.9508. Step size: -0.0183.
Optimization successful for x3=0.9508. Start fval 4.650448, end fval 4.650444.
Next guess for x3 in direction -1 is 0.9288. Step size: -0.0221.
Optimization successful for x3=0.9288. Start fval 5.358464, end fval 5.358457.
Next guess for x3 in direction -1 is 0.9019. Step size: -0.0269.
Optimization successful for x3=0.9019. Start fval 6.523985, end fval 6.523967.
Next guess for x3 in direction -1 is 0.8686. Step size: -0.0333.
Optimization successful for x3=0.8686. Start fval 8.375228, end fval 8.375187.
Next guess for x3 in direction -1 is 0.8268. Step size: -0.0418.
Optimization successful for x3=0.8268. Start fval 11.254313, end fval 11.254197.
Next guess for x3 in direction -1 is 0.7730. Step size: -0.0538.
Optimization successful for x3=0.7730. Start fval 15.674491, end fval 15.674166.
Next guess for x3 in direction -1 is 0.7015. Step size: -0.0715.
Optimization successful for x3=0.7015. Start fval 22.407555, end fval 22.406469.
Next guess for x3 in direction -1 is 0.6015. Step size: -0.1000.
Optimization successful for x3=0.6015. Start fval 32.610099, end fval 32.605537.
Next guess for x3 in direction -1 is 0.5015. Step size: -0.1000.
Optimization successful for x3=0.5015. Start fval 42.677918, end fval 42.670160.
Next guess for x3 in direction -1 is 0.4015. Step size: -0.1000.
Optimization successful for x3=0.4015. Start fval 51.701828, end fval 51.690945.
Next guess for x3 in direction -1 is 0.3015. Step size: -0.1000.
Optimization successful for x3=0.3015. Start fval 59.040685, end fval 59.024409.
Next guess for x3 in direction -1 is 0.2015. Step size: -0.1000.
Optimization successful for x3=0.2015. Start fval 64.327867, end fval 64.300053.
Next guess for x3 in direction -1 is 0.1015. Step size: -0.1000.
Optimization successful for x3=0.1015. Start fval 67.487812, end fval 67.427868.
Next guess for x3 in direction -1 is 0.0015. Step size: -0.1000.
Optimization successful for x3=0.0015. Start fval 68.805334, end fval 66.053400.
Next guess for x3 in direction -1 is -0.0055. Step size: -0.0070.
Optimization successful for x3=-0.0055. Start fval 68.214138, end fval 66.123180.
Next guess for x3 in direction -1 is -0.0289. Step size: -0.0234.
Optimization successful for x3=-0.0289. Start fval 66.333291, end fval 66.330862.
Next guess for x3 in direction -1 is -0.0850. Step size: -0.0561.
Optimization successful for x3=-0.0850. Start fval 66.747076, end fval 66.720079.
Next guess for x3 in direction -1 is -0.1850. Step size: -0.1000.
Optimization successful for x3=-0.1850. Start fval 67.408489, end fval 67.203920.
Next guess for x3 in direction -1 is -0.2850. Step size: -0.1000.
Optimization successful for x3=-0.2850. Start fval 67.546068, end fval 67.449467.
Next guess for x3 in direction -1 is -0.3850. Step size: -0.1000.
Optimization successful for x3=-0.3850. Start fval 67.612660, end fval 67.561281.
Next guess for x3 in direction -1 is -0.4754. Step size: -0.0904.
Optimization successful for x3=-0.4754. Start fval 67.832786, end fval 67.828543.
Next guess for x3 in direction -1 is -0.5376. Step size: -0.0622.
Optimization successful for x3=-0.5376. Start fval 68.332778, end fval 68.331691.
Next guess for x3 in direction -1 is -0.5938. Step size: -0.0562.
Optimization successful for x3=-0.5938. Start fval 69.189241, end fval 69.188999.
Next guess for x3 in direction -1 is -0.6492. Step size: -0.0553.
Optimization successful for x3=-0.6492. Start fval 70.576481, end fval 70.576299.
Next guess for x3 in direction -1 is -0.7060. Step size: -0.0569.
Optimization successful for x3=-0.7060. Start fval 72.758771, end fval 72.758587.
Next guess for x3 in direction -1 is -0.7659. Step size: -0.0599.
Optimization successful for x3=-0.7659. Start fval 76.136562, end fval 76.136356.
Next guess for x3 in direction -1 is -0.8298. Step size: -0.0639.
Optimization successful for x3=-0.8298. Start fval 81.297094, end fval 81.296822.
Next guess for x3 in direction -1 is -0.8989. Step size: -0.0690.
Optimization successful for x3=-0.8989. Start fval 89.127246, end fval 89.126936.
Next guess for x3 in direction -1 is -0.9740. Step size: -0.0752.
Optimization successful for x3=-0.9740. Start fval 100.972893, end fval 100.972304.
Next guess for x3 in direction -1 is -1.0562. Step size: -0.0822.
Optimization successful for x3=-1.0562. Start fval 118.806859, end fval 118.806453.
Next guess for x3 in direction -1 is -1.1465. Step size: -0.0903.
Optimization successful for x3=-1.1465. Start fval 145.637862, end fval 145.637116.
Next guess for x3 in direction -1 is -1.2465. Step size: -0.1000.
Optimization successful for x3=-1.2465. Start fval 186.205311, end fval 186.204367.
Next guess for x3 in direction -1 is -1.3465. Step size: -0.1000.
Optimization successful for x3=-1.3465. Start fval 240.646635, end fval 240.645685.
Next guess for x3 in direction -1 is -1.4465. Step size: -0.1000.
Optimization successful for x3=-1.4465. Start fval 311.757465, end fval 311.755710.
Next guess for x3 in direction -1 is -1.5465. Step size: -0.1000.
Optimization successful for x3=-1.5465. Start fval 402.579277, end fval 402.578617.
Next guess for x3 in direction -1 is -1.6465. Step size: -0.1000.
Optimization successful for x3=-1.6465. Start fval 516.404454, end fval 516.402681.
Next guess for x3 in direction -1 is -1.7465. Step size: -0.1000.
Optimization successful for x3=-1.7465. Start fval 656.765777, end fval 656.764933.
Next guess for x3 in direction -1 is -1.8465. Step size: -0.1000.
Optimization successful for x3=-1.8465. Start fval 827.447617, end fval 827.445545.
Next guess for x3 in direction -1 is -1.9465. Step size: -0.1000.
Optimization successful for x3=-1.9465. Start fval 1032.472995, end fval 1032.472512.
Next guess for x3 in direction -1 is -2.0465. Step size: -0.1000.
Optimization successful for x3=-2.0465. Start fval 1276.117851, end fval 1276.116272.
Next guess for x3 in direction -1 is -2.1465. Step size: -0.1000.
Optimization successful for x3=-2.1465. Start fval 1562.894833, end fval 1562.894230.
Next guess for x3 in direction -1 is -2.2465. Step size: -0.1000.
Optimization successful for x3=-2.2465. Start fval 1897.567481, end fval 1897.566909.
Next guess for x3 in direction -1 is -2.3465. Step size: -0.1000.
Optimization successful for x3=-2.3465. Start fval 2285.139384, end fval 2285.136335.
Next guess for x3 in direction -1 is -2.4465. Step size: -0.1000.
Optimization successful for x3=-2.4465. Start fval 2730.855454, end fval 2730.854660.
Next guess for x3 in direction -1 is -2.5465. Step size: -0.1000.
Optimization successful for x3=-2.5465. Start fval 3240.214580, end fval 3240.210425.
Next guess for x3 in direction -1 is -2.6465. Step size: -0.1000.
Optimization successful for x3=-2.6465. Start fval 3818.943013, end fval 3818.942227.
Next guess for x3 in direction -1 is -2.7465. Step size: -0.1000.
Optimization successful for x3=-2.7465. Start fval 4473.029414, end fval 4473.028590.
Next guess for x3 in direction -1 is -2.8465. Step size: -0.1000.
Optimization successful for x3=-2.8465. Start fval 5208.691816, end fval 5208.684174.
Next guess for x3 in direction -1 is -2.9465. Step size: -0.1000.
Optimization successful for x3=-2.9465. Start fval 6032.386593, end fval 6032.385436.
Next guess for x3 in direction -1 is -3.0465. Step size: -0.1000.
Optimization successful for x3=-3.0465. Start fval 6950.841382, end fval 6950.826902.
Next guess for x3 in direction -1 is -3.1465. Step size: -0.1000.
Optimization successful for x3=-3.1465. Start fval 7971.126779, end fval 7970.970073.
Next guess for x3 in direction -1 is -3.2465. Step size: -0.1000.
Optimization successful for x3=-3.2465. Start fval 9100.017763, end fval 9100.005426.
Next guess for x3 in direction -1 is -3.3465. Step size: -0.1000.
Optimization successful for x3=-3.3465. Start fval 10345.369689, end fval 10345.367697.
Next guess for x3 in direction -1 is -3.4465. Step size: -0.1000.
Optimization successful for x3=-3.4465. Start fval 11714.735429, end fval 11714.711943.
Next guess for x3 in direction -1 is -3.5465. Step size: -0.1000.
Optimization successful for x3=-3.5465. Start fval 13217.260247, end fval 13215.996883.
Next guess for x3 in direction -1 is -3.6465. Step size: -0.1000.
Optimization successful for x3=-3.6465. Start fval 14857.538796, end fval 14857.353227.
Next guess for x3 in direction -1 is -3.7465. Step size: -0.1000.
Optimization successful for x3=-3.7465. Start fval 16647.961094, end fval 16647.205103.
Next guess for x3 in direction -1 is -3.8465. Step size: -0.1000.
Optimization successful for x3=-3.8465. Start fval 18594.229283, end fval 18594.193276.
Next guess for x3 in direction -1 is -3.9465. Step size: -0.1000.
Optimization successful for x3=-3.9465. Start fval 20707.208684, end fval 20707.205247.
Next guess for x3 in direction -1 is -4.0465. Step size: -0.1000.
Optimization successful for x3=-4.0465. Start fval 22995.372033, end fval 22995.370613.
Next guess for x3 in direction -1 is -4.1465. Step size: -0.1000.
Optimization successful for x3=-4.1465. Start fval 25468.061769, end fval 25468.060966.
Next guess for x3 in direction -1 is -4.2465. Step size: -0.1000.
Optimization successful for x3=-4.2465. Start fval 28134.890558, end fval 28134.889505.
Next guess for x3 in direction -1 is -4.3465. Step size: -0.1000.
Optimization successful for x3=-4.3465. Start fval 31005.711955, end fval 31005.711214.
Next guess for x3 in direction -1 is -4.4465. Step size: -0.1000.
Optimization successful for x3=-4.4465. Start fval 34090.623408, end fval 34090.622723.
Next guess for x3 in direction -1 is -4.5465. Step size: -0.1000.
Optimization successful for x3=-4.5465. Start fval 37399.962927, end fval 37399.962371.
Next guess for x3 in direction -1 is -4.6465. Step size: -0.1000.
Optimization successful for x3=-4.6465. Start fval 40944.310712, end fval 40944.309915.
Next guess for x3 in direction -1 is -4.7465. Step size: -0.1000.
Optimization successful for x3=-4.7465. Start fval 44734.487267, end fval 44734.486843.
Next guess for x3 in direction -1 is -4.8465. Step size: -0.1000.
Optimization successful for x3=-4.8465. Start fval 48781.556927, end fval 48781.555935.
Next guess for x3 in direction -1 is -4.9465. Step size: -0.1000.
Optimization successful for x3=-4.9465. Start fval 53096.822133, end fval 53096.821604.
Next guess for x3 in direction -1 is -5.0000. Step size: -0.0535.
Optimization successful for x3=-5.0000. Start fval 55520.978530, end fval 55520.096728.
Next guess for x3 in direction 1 is 1.0244. Step size: 0.0253.
Optimization successful for x3=1.0244. Start fval 4.184053, end fval 4.184044.
Next guess for x3 in direction 1 is 1.0427. Step size: 0.0183.
Optimization successful for x3=1.0427. Start fval 4.584373, end fval 4.584367.
Next guess for x3 in direction 1 is 1.0627. Step size: 0.0200.
Optimization successful for x3=1.0627. Start fval 5.289418, end fval 5.289413.
Next guess for x3 in direction 1 is 1.0855. Step size: 0.0228.
Optimization successful for x3=1.0855. Start fval 6.450237, end fval 6.450230.
Next guess for x3 in direction 1 is 1.1117. Step size: 0.0262.
Optimization successful for x3=1.1117. Start fval 8.293541, end fval 8.293527.
Next guess for x3 in direction 1 is 1.1420. Step size: 0.0304.
Optimization successful for x3=1.1420. Start fval 11.163474, end fval 11.163452.
Next guess for x3 in direction 1 is 1.1773. Step size: 0.0353.
Optimization successful for x3=1.1773. Start fval 15.566839, end fval 15.566799.
Next guess for x3 in direction 1 is 1.2183. Step size: 0.0410.
Optimization successful for x3=1.2183. Start fval 22.266543, end fval 22.266475.
Next guess for x3 in direction 1 is 1.2660. Step size: 0.0477.
Optimization successful for x3=1.2660. Start fval 32.421332, end fval 32.421214.
Next guess for x3 in direction 1 is 1.3213. Step size: 0.0553.
Optimization successful for x3=1.3213. Start fval 47.735839, end fval 47.735579.
Next guess for x3 in direction 1 is 1.3852. Step size: 0.0639.
Optimization successful for x3=1.3852. Start fval 70.776341, end fval 70.776016.
Next guess for x3 in direction 1 is 1.4589. Step size: 0.0737.
Optimization successful for x3=1.4589. Start fval 105.432184, end fval 105.431501.
Next guess for x3 in direction 1 is 1.5436. Step size: 0.0846.
Optimization successful for x3=1.5436. Start fval 157.430277, end fval 157.429370.
Next guess for x3 in direction 1 is 1.6436. Step size: 0.1000.
Optimization successful for x3=1.6436. Start fval 238.318939, end fval 238.317100.
Next guess for x3 in direction 1 is 1.7436. Step size: 0.1000.
Optimization successful for x3=1.7436. Start fval 343.638667, end fval 343.637096.
Next guess for x3 in direction 1 is 1.8436. Step size: 0.1000.
Optimization successful for x3=1.8436. Start fval 477.164872, end fval 477.163467.
Next guess for x3 in direction 1 is 1.9436. Step size: 0.1000.
Optimization successful for x3=1.9436. Start fval 642.916908, end fval 642.915639.
Next guess for x3 in direction 1 is 2.0436. Step size: 0.1000.
Optimization successful for x3=2.0436. Start fval 845.159128, end fval 845.157980.
Next guess for x3 in direction 1 is 2.1436. Step size: 0.1000.
Optimization successful for x3=2.1436. Start fval 1088.400521, end fval 1088.399469.
Next guess for x3 in direction 1 is 2.2436. Step size: 0.1000.
Optimization successful for x3=2.2436. Start fval 1377.394374, end fval 1377.393405.
Next guess for x3 in direction 1 is 2.3436. Step size: 0.1000.
Optimization successful for x3=2.3436. Start fval 1717.138042, end fval 1717.137148.
Next guess for x3 in direction 1 is 2.4436. Step size: 0.1000.
Optimization successful for x3=2.4436. Start fval 2112.872733, end fval 2112.871878.
Next guess for x3 in direction 1 is 2.5436. Step size: 0.1000.
Optimization successful for x3=2.5436. Start fval 2570.083161, end fval 2570.082384.
Next guess for x3 in direction 1 is 2.6436. Step size: 0.1000.
Optimization successful for x3=2.6436. Start fval 3094.497601, end fval 3094.496876.
Next guess for x3 in direction 1 is 2.7436. Step size: 0.1000.
Optimization successful for x3=2.7436. Start fval 3692.087484, end fval 3692.086806.
Next guess for x3 in direction 1 is 2.8436. Step size: 0.1000.
Optimization successful for x3=2.8436. Start fval 4369.067344, end fval 4369.066713.
Next guess for x3 in direction 1 is 2.9436. Step size: 0.1000.
Optimization successful for x3=2.9436. Start fval 5131.894723, end fval 5131.894062.
Next guess for x3 in direction 1 is 3.0436. Step size: 0.1000.
Optimization successful for x3=3.0436. Start fval 5987.269675, end fval 5987.269137.
Next guess for x3 in direction 1 is 3.1436. Step size: 0.1000.
Optimization successful for x3=3.1436. Start fval 6942.135471, end fval 6942.134889.
Next guess for x3 in direction 1 is 3.2436. Step size: 0.1000.
Optimization successful for x3=3.2436. Start fval 8003.677364, end fval 8003.676833.
Next guess for x3 in direction 1 is 3.3436. Step size: 0.1000.
Optimization successful for x3=3.3436. Start fval 9179.323442, end fval 9179.322944.
Next guess for x3 in direction 1 is 3.4436. Step size: 0.1000.
Optimization successful for x3=3.4436. Start fval 10476.744026, end fval 10476.743563.
Next guess for x3 in direction 1 is 3.5436. Step size: 0.1000.
Optimization successful for x3=3.5436. Start fval 11903.851790, end fval 11903.851264.
Next guess for x3 in direction 1 is 3.6436. Step size: 0.1000.
Optimization successful for x3=3.6436. Start fval 13468.801258, end fval 13468.800854.
Next guess for x3 in direction 1 is 3.7436. Step size: 0.1000.
Optimization successful for x3=3.7436. Start fval 15179.989658, end fval 15179.989202.
Next guess for x3 in direction 1 is 3.8436. Step size: 0.1000.
Optimization successful for x3=3.8436. Start fval 17046.055617, end fval 17046.055205.
Next guess for x3 in direction 1 is 3.9436. Step size: 0.1000.
Optimization successful for x3=3.9436. Start fval 19075.880115, end fval 19075.879722.
Next guess for x3 in direction 1 is 4.0436. Step size: 0.1000.
Optimization successful for x3=4.0436. Start fval 21278.585872, end fval 21278.585525.
Next guess for x3 in direction 1 is 4.1436. Step size: 0.1000.
Optimization successful for x3=4.1436. Start fval 23663.537634, end fval 23663.537119.
Next guess for x3 in direction 1 is 4.2436. Step size: 0.1000.
Optimization successful for x3=4.2436. Start fval 26240.341223, end fval 26240.340906.
Next guess for x3 in direction 1 is 4.3436. Step size: 0.1000.
Optimization successful for x3=4.3436. Start fval 29018.845335, end fval 29018.844883.
Next guess for x3 in direction 1 is 4.4436. Step size: 0.1000.
Optimization successful for x3=4.4436. Start fval 32009.139087, end fval 32009.138799.
Next guess for x3 in direction 1 is 4.5436. Step size: 0.1000.
Optimization successful for x3=4.5436. Start fval 35221.554353, end fval 35221.553947.
Next guess for x3 in direction 1 is 4.6436. Step size: 0.1000.
Optimization successful for x3=4.6436. Start fval 38666.663493, end fval 38666.663196.
Next guess for x3 in direction 1 is 4.7436. Step size: 0.1000.
Optimization successful for x3=4.7436. Start fval 42355.281271, end fval 42355.280905.
Next guess for x3 in direction 1 is 4.8436. Step size: 0.1000.
Optimization successful for x3=4.8436. Start fval 46298.463227, end fval 46298.462963.
Next guess for x3 in direction 1 is 4.9436. Step size: 0.1000.
Optimization successful for x3=4.9436. Start fval 50507.506993, end fval 50507.506639.
Next guess for x3 in direction 1 is 5.0000. Step size: 0.0564.
Optimization successful for x3=5.0000. Start fval 53005.512653, end fval 53004.718573.
Next guess for x0 in direction -1 is 0.9837. Step size: -0.0161.
Optimization successful for x0=0.9837. Start fval 0.213033, end fval 0.078708.
Next guess for x0 in direction -1 is 0.9827. Step size: -0.0010.
Optimization successful for x0=0.9827. Start fval 0.092336, end fval 0.088551.
Next guess for x0 in direction -1 is 0.9817. Step size: -0.0010.
Optimization successful for x0=0.9817. Start fval 0.098963, end fval 0.098963.
Next guess for x0 in direction -1 is 0.9807. Step size: -0.0010.
Optimization successful for x0=0.9807. Start fval 0.109939, end fval 0.109939.
Next guess for x0 in direction -1 is 0.9797. Step size: -0.0010.
Optimization successful for x0=0.9797. Start fval 0.121479, end fval 0.121479.
Next guess for x0 in direction -1 is 0.9787. Step size: -0.0010.
Optimization successful for x0=0.9787. Start fval 0.133581, end fval 0.133581.
Next guess for x0 in direction -1 is 0.9777. Step size: -0.0010.
Optimization successful for x0=0.9777. Start fval 0.146242, end fval 0.146242.
Next guess for x0 in direction -1 is 0.9763. Step size: -0.0014.
Optimization successful for x0=0.9763. Start fval 0.165224, end fval 0.165224.
Next guess for x0 in direction -1 is 0.9743. Step size: -0.0020.
Optimization successful for x0=0.9743. Start fval 0.193692, end fval 0.193692.
Next guess for x0 in direction -1 is 0.9715. Step size: -0.0027.
Optimization successful for x0=0.9715. Start fval 0.236381, end fval 0.236381.
Next guess for x0 in direction -1 is 0.9678. Step size: -0.0037.
Optimization successful for x0=0.9678. Start fval 0.300398, end fval 0.300398.
Next guess for x0 in direction -1 is 0.9630. Step size: -0.0049.
Optimization successful for x0=0.9630. Start fval 0.396402, end fval 0.396402.
Next guess for x0 in direction -1 is 0.9566. Step size: -0.0064.
Optimization successful for x0=0.9566. Start fval 0.540387, end fval 0.540387.
Next guess for x0 in direction -1 is 0.9484. Step size: -0.0082.
Optimization successful for x0=0.9484. Start fval 0.756347, end fval 0.756347.
Next guess for x0 in direction -1 is 0.9379. Step size: -0.0104.
Optimization successful for x0=0.9379. Start fval 1.080273, end fval 1.080273.
Next guess for x0 in direction -1 is 0.9247. Step size: -0.0132.
Optimization successful for x0=0.9247. Start fval 1.565876, end fval 1.565876.
Next guess for x0 in direction -1 is 0.9079. Step size: -0.0168.
Optimization successful for x0=0.9079. Start fval 2.294018, end fval 2.294018.
Next guess for x0 in direction -1 is 0.8867. Step size: -0.0212.
Optimization successful for x0=0.8867. Start fval 3.385858, end fval 3.385856.
Next guess for x0 in direction -1 is 0.8597. Step size: -0.0270.
Optimization successful for x0=0.8597. Start fval 5.023116, end fval 5.023113.
Next guess for x0 in direction -1 is 0.8251. Step size: -0.0346.
Optimization successful for x0=0.8251. Start fval 7.478496, end fval 7.478486.
Next guess for x0 in direction -1 is 0.7802. Step size: -0.0449.
Optimization successful for x0=0.7802. Start fval 11.161603, end fval 11.161575.
Next guess for x0 in direction -1 is 0.7206. Step size: -0.0596.
Optimization successful for x0=0.7206. Start fval 16.688208, end fval 16.688122.
Next guess for x0 in direction -1 is 0.6385. Step size: -0.0821.
Optimization successful for x0=0.6385. Start fval 24.977066, end fval 24.976768.
Next guess for x0 in direction -1 is 0.5385. Step size: -0.1000.
Optimization successful for x0=0.5385. Start fval 35.257917, end fval 35.257206.
Next guess for x0 in direction -1 is 0.4385. Step size: -0.1000.
Optimization successful for x0=0.4385. Start fval 44.799704, end fval 44.798904.
Next guess for x0 in direction -1 is 0.3385. Step size: -0.1000.
Optimization successful for x0=0.3385. Start fval 52.860006, end fval 52.859334.
Next guess for x0 in direction -1 is 0.2385. Step size: -0.1000.
Optimization successful for x0=0.2385. Start fval 58.966312, end fval 58.966025.
Next guess for x0 in direction -1 is 0.1385. Step size: -0.1000.
Optimization successful for x0=0.1385. Start fval 62.923346, end fval 62.922929.
Next guess for x0 in direction -1 is 0.0385. Step size: -0.1000.
Optimization successful for x0=0.0385. Start fval 64.809905, end fval 64.799721.
Next guess for x0 in direction -1 is -0.0615. Step size: -0.1000.
Optimization successful for x0=-0.0615. Start fval 64.862088, end fval 64.787901.
Next guess for x0 in direction -1 is -0.0732. Step size: -0.0117.
Optimization successful for x0=-0.0732. Start fval 64.664934, end fval 64.664473.
Next guess for x0 in direction -1 is -0.0943. Step size: -0.0211.
Optimization successful for x0=-0.0943. Start fval 64.374490, end fval 64.374423.
Next guess for x0 in direction -1 is -0.1232. Step size: -0.0288.
Optimization successful for x0=-0.1232. Start fval 63.834746, end fval 63.834546.
Next guess for x0 in direction -1 is -0.1591. Step size: -0.0360.
Optimization successful for x0=-0.1591. Start fval 62.920627, end fval 62.920359.
Next guess for x0 in direction -1 is -0.2026. Step size: -0.0435.
Optimization successful for x0=-0.2026. Start fval 61.446145, end fval 61.445924.
Next guess for x0 in direction -1 is -0.2549. Step size: -0.0522.
Optimization successful for x0=-0.2549. Start fval 59.132532, end fval 59.132425.
Next guess for x0 in direction -1 is -0.3179. Step size: -0.0630.
Optimization successful for x0=-0.3179. Start fval 55.560810, end fval 55.560781.
Next guess for x0 in direction -1 is -0.3950. Step size: -0.0771.
Optimization successful for x0=-0.3950. Start fval 50.101554, end fval 50.101434.
Next guess for x0 in direction -1 is -0.4950. Step size: -0.1000.
Optimization successful for x0=-0.4950. Start fval 41.529257, end fval 41.528568.
Next guess for x0 in direction -1 is -0.5950. Step size: -0.1000.
Optimization successful for x0=-0.5950. Start fval 31.862418, end fval 31.861190.
Next guess for x0 in direction -1 is -0.6950. Step size: -0.1000.
Optimization successful for x0=-0.6950. Start fval 21.992861, end fval 21.991574.
Next guess for x0 in direction -1 is -0.7950. Step size: -0.1000.
Optimization successful for x0=-0.7950. Start fval 13.074281, end fval 13.073082.
Next guess for x0 in direction -1 is -0.8950. Step size: -0.1000.
Optimization successful for x0=-0.8950. Start fval 6.517666, end fval 6.516551.
Next guess for x0 in direction -1 is -0.9950. Step size: -0.1000.
Optimization successful for x0=-0.9950. Start fval 3.988543, end fval 3.987526.
Next guess for x0 in direction -1 is -1.0708. Step size: -0.0758.
Optimization successful for x0=-1.0708. Start fval 5.918710, end fval 5.918304.
Next guess for x0 in direction -1 is -1.1130. Step size: -0.0422.
Optimization successful for x0=-1.1130. Start fval 8.813840, end fval 8.813789.
Next guess for x0 in direction -1 is -1.1547. Step size: -0.0416.
Optimization successful for x0=-1.1547. Start fval 13.156482, end fval 13.156458.
Next guess for x0 in direction -1 is -1.1995. Step size: -0.0448.
Optimization successful for x0=-1.1995. Start fval 19.670345, end fval 19.670317.
Next guess for x0 in direction -1 is -1.2493. Step size: -0.0498.
Optimization successful for x0=-1.2493. Start fval 29.438688, end fval 29.438647.
Next guess for x0 in direction -1 is -1.3057. Step size: -0.0564.
Optimization successful for x0=-1.3057. Start fval 44.085081, end fval 44.085018.
Next guess for x0 in direction -1 is -1.3700. Step size: -0.0643.
Optimization successful for x0=-1.3700. Start fval 66.036600, end fval 66.036498.
Next guess for x0 in direction -1 is -1.4435. Step size: -0.0736.
Optimization successful for x0=-1.4435. Start fval 98.989103, end fval 98.988937.
Next guess for x0 in direction -1 is -1.5275. Step size: -0.0840.
Optimization successful for x0=-1.5275. Start fval 148.341101, end fval 148.340831.
Next guess for x0 in direction -1 is -1.6275. Step size: -0.1000.
Optimization successful for x0=-1.6275. Start fval 225.991746, end fval 225.991254.
Next guess for x0 in direction -1 is -1.7275. Step size: -0.1000.
Optimization successful for x0=-1.7275. Start fval 327.491440, end fval 327.490898.
Next guess for x0 in direction -1 is -1.8275. Step size: -0.1000.
Optimization successful for x0=-1.8275. Start fval 456.575083, end fval 456.574571.
Next guess for x0 in direction -1 is -1.9275. Step size: -0.1000.
Optimization successful for x0=-1.9275. Start fval 617.222930, end fval 617.222454.
Next guess for x0 in direction -1 is -2.0275. Step size: -0.1000.
Optimization successful for x0=-2.0275. Start fval 813.660165, end fval 813.659720.
Next guess for x0 in direction -1 is -2.1275. Step size: -0.1000.
Optimization successful for x0=-2.1275. Start fval 1050.356615, end fval 1050.356199.
Next guess for x0 in direction -1 is -2.2275. Step size: -0.1000.
Optimization successful for x0=-2.2275. Start fval 1332.026466, end fval 1332.026078.
Next guess for x0 in direction -1 is -2.3275. Step size: -0.1000.
Optimization successful for x0=-2.3275. Start fval 1663.628004, end fval 1663.627641.
Next guess for x0 in direction -1 is -2.4275. Step size: -0.1000.
Optimization successful for x0=-2.4275. Start fval 2050.363371, end fval 2050.363025.
Next guess for x0 in direction -1 is -2.5275. Step size: -0.1000.
Optimization successful for x0=-2.5275. Start fval 2497.678374, end fval 2497.678001.
Next guess for x0 in direction -1 is -2.6275. Step size: -0.1000.
Optimization successful for x0=-2.6275. Start fval 3011.262091, end fval 3011.261797.
Next guess for x0 in direction -1 is -2.7275. Step size: -0.1000.
Optimization successful for x0=-2.7275. Start fval 3597.047230, end fval 3597.046901.
Next guess for x0 in direction -1 is -2.8275. Step size: -0.1000.
Optimization successful for x0=-2.8275. Start fval 4261.209211, end fval 4261.208905.
Next guess for x0 in direction -1 is -2.9275. Step size: -0.1000.
Optimization successful for x0=-2.9275. Start fval 5010.166650, end fval 5010.166363.
Next guess for x0 in direction -1 is -3.0275. Step size: -0.1000.
Optimization successful for x0=-3.0275. Start fval 5850.580923, end fval 5850.580651.
Next guess for x0 in direction -1 is -3.1275. Step size: -0.1000.
Optimization successful for x0=-3.1275. Start fval 6789.356099, end fval 6789.355842.
Next guess for x0 in direction -1 is -3.2275. Step size: -0.1000.
Optimization successful for x0=-3.2275. Start fval 7833.638861, end fval 7833.638579.
Next guess for x0 in direction -1 is -3.3275. Step size: -0.1000.
Optimization successful for x0=-3.3275. Start fval 8990.818227, end fval 8990.818003.
Next guess for x0 in direction -1 is -3.4275. Step size: -0.1000.
Optimization successful for x0=-3.4275. Start fval 10268.525910, end fval 10268.525582.
Next guess for x0 in direction -1 is -3.5275. Step size: -0.1000.
Optimization successful for x0=-3.5275. Start fval 11674.635326, end fval 11674.635122.
Next guess for x0 in direction -1 is -3.6275. Step size: -0.1000.
Optimization successful for x0=-3.6275. Start fval 13217.262854, end fval 13217.262574.
Next guess for x0 in direction -1 is -3.7275. Step size: -0.1000.
Optimization successful for x0=-3.7275. Start fval 14904.766235, end fval 14904.766040.
Next guess for x0 in direction -1 is -3.8275. Step size: -0.1000.
Optimization successful for x0=-3.8275. Start fval 16745.745895, end fval 16745.745596.
Next guess for x0 in direction -1 is -3.9275. Step size: -0.1000.
Optimization successful for x0=-3.9275. Start fval 18749.043544, end fval 18749.043362.
Next guess for x0 in direction -1 is -4.0275. Step size: -0.1000.
Optimization successful for x0=-4.0275. Start fval 20923.743541, end fval 20923.743318.
Next guess for x0 in direction -1 is -4.1275. Step size: -0.1000.
Optimization successful for x0=-4.1275. Start fval 23279.171478, end fval 23279.171260.
Next guess for x0 in direction -1 is -4.2275. Step size: -0.1000.
Optimization successful for x0=-4.2275. Start fval 25824.894967, end fval 25824.894774.
Next guess for x0 in direction -1 is -4.3275. Step size: -0.1000.
Optimization successful for x0=-4.3275. Start fval 28570.723364, end fval 28570.723167.
Next guess for x0 in direction -1 is -4.4275. Step size: -0.1000.
Optimization successful for x0=-4.4275. Start fval 31526.707601, end fval 31526.707411.
Next guess for x0 in direction -1 is -4.5275. Step size: -0.1000.
Optimization successful for x0=-4.5275. Start fval 34703.140277, end fval 34703.140095.
Next guess for x0 in direction -1 is -4.6275. Step size: -0.1000.
Optimization successful for x0=-4.6275. Start fval 38110.555552, end fval 38110.555376.
Next guess for x0 in direction -1 is -4.7275. Step size: -0.1000.
Optimization successful for x0=-4.7275. Start fval 41759.729099, end fval 41759.728929.
Next guess for x0 in direction -1 is -4.8275. Step size: -0.1000.
Optimization successful for x0=-4.8275. Start fval 45661.678078, end fval 45661.677913.
Next guess for x0 in direction -1 is -4.9275. Step size: -0.1000.
Optimization successful for x0=-4.9275. Start fval 49827.661080, end fval 49827.660919.
Next guess for x0 in direction -1 is -5.0000. Step size: -0.0725.
Optimization successful for x0=-5.0000. Start fval 53018.484076, end fval 53018.241857.
Next guess for x0 in direction 1 is 1.0025. Step size: 0.0028.
Optimization successful for x0=1.0025. Start fval 0.239446, end fval 0.001948.
Next guess for x0 in direction 1 is 1.0035. Step size: 0.0010.
Optimization successful for x0=1.0035. Start fval 0.830136, end fval 0.003789.
Next guess for x0 in direction 1 is 1.0045. Step size: 0.0010.
Optimization successful for x0=1.0045. Start fval 0.006240, end fval 0.006240.
Next guess for x0 in direction 1 is 1.0055. Step size: 0.0010.
Optimization successful for x0=1.0055. Start fval 0.009302, end fval 0.009302.
Next guess for x0 in direction 1 is 1.0065. Step size: 0.0010.
Optimization successful for x0=1.0065. Start fval 0.012979, end fval 0.012979.
Next guess for x0 in direction 1 is 1.0075. Step size: 0.0010.
Optimization successful for x0=1.0075. Start fval 0.017273, end fval 0.017273.
Next guess for x0 in direction 1 is 1.0085. Step size: 0.0010.
Optimization successful for x0=1.0085. Start fval 0.022184, end fval 0.022184.
Next guess for x0 in direction 1 is 1.0095. Step size: 0.0010.
Optimization successful for x0=1.0095. Start fval 0.027716, end fval 0.027716.
Next guess for x0 in direction 1 is 1.0105. Step size: 0.0010.
Optimization successful for x0=1.0105. Start fval 0.033870, end fval 0.033870.
Next guess for x0 in direction 1 is 1.0115. Step size: 0.0010.
Optimization successful for x0=1.0115. Start fval 0.040648, end fval 0.040648.
Next guess for x0 in direction 1 is 1.0125. Step size: 0.0010.
Optimization successful for x0=1.0125. Start fval 0.048053, end fval 0.048053.
Next guess for x0 in direction 1 is 1.0135. Step size: 0.0010.
Optimization successful for x0=1.0135. Start fval 0.056087, end fval 0.056087.
Next guess for x0 in direction 1 is 1.0145. Step size: 0.0010.
Optimization successful for x0=1.0145. Start fval 0.064752, end fval 0.064752.
Next guess for x0 in direction 1 is 1.0155. Step size: 0.0010.
Optimization successful for x0=1.0155. Start fval 0.074049, end fval 0.074049.
Next guess for x0 in direction 1 is 1.0165. Step size: 0.0010.
Optimization successful for x0=1.0165. Start fval 0.083981, end fval 0.083981.
Next guess for x0 in direction 1 is 1.0175. Step size: 0.0010.
Optimization successful for x0=1.0175. Start fval 0.094551, end fval 0.094551.
Next guess for x0 in direction 1 is 1.0185. Step size: 0.0010.
Optimization successful for x0=1.0185. Start fval 0.105759, end fval 0.105759.
Next guess for x0 in direction 1 is 1.0195. Step size: 0.0010.
Optimization successful for x0=1.0195. Start fval 0.117608, end fval 0.117608.
Next guess for x0 in direction 1 is 1.0205. Step size: 0.0010.
Optimization successful for x0=1.0205. Start fval 0.130101, end fval 0.130101.
Next guess for x0 in direction 1 is 1.0215. Step size: 0.0010.
Optimization successful for x0=1.0215. Start fval 0.143240, end fval 0.143240.
Next guess for x0 in direction 1 is 1.0228. Step size: 0.0013.
Optimization successful for x0=1.0228. Start fval 0.160727, end fval 0.160727.
Next guess for x0 in direction 1 is 1.0246. Step size: 0.0018.
Optimization successful for x0=1.0246. Start fval 0.186947, end fval 0.186947.
Next guess for x0 in direction 1 is 1.0270. Step size: 0.0024.
Optimization successful for x0=1.0270. Start fval 0.226265, end fval 0.226265.
Next guess for x0 in direction 1 is 1.0302. Step size: 0.0033.
Optimization successful for x0=1.0302. Start fval 0.285227, end fval 0.285227.
Next guess for x0 in direction 1 is 1.0345. Step size: 0.0043.
Optimization successful for x0=1.0345. Start fval 0.373650, end fval 0.373650.
Next guess for x0 in direction 1 is 1.0401. Step size: 0.0055.
Optimization successful for x0=1.0401. Start fval 0.506272, end fval 0.506272.
Next guess for x0 in direction 1 is 1.0471. Step size: 0.0070.
Optimization successful for x0=1.0471. Start fval 0.705213, end fval 0.705213.
Next guess for x0 in direction 1 is 1.0559. Step size: 0.0088.
Optimization successful for x0=1.0559. Start fval 1.003672, end fval 1.003672.
Next guess for x0 in direction 1 is 1.0669. Step size: 0.0109.
Optimization successful for x0=1.0669. Start fval 1.451297, end fval 1.451297.
Next guess for x0 in direction 1 is 1.0802. Step size: 0.0134.
Optimization successful for x0=1.0802. Start fval 2.122039, end fval 2.122039.
Next guess for x0 in direction 1 is 1.0966. Step size: 0.0163.
Optimization successful for x0=1.0966. Start fval 3.128016, end fval 3.128015.
Next guess for x0 in direction 1 is 1.1163. Step size: 0.0198.
Optimization successful for x0=1.1163. Start fval 4.637416, end fval 4.637415.
Next guess for x0 in direction 1 is 1.1401. Step size: 0.0238.
Optimization successful for x0=1.1401. Start fval 6.900782, end fval 6.900780.
Next guess for x0 in direction 1 is 1.1686. Step size: 0.0285.
Optimization successful for x0=1.1686. Start fval 10.292955, end fval 10.292951.
Next guess for x0 in direction 1 is 1.2025. Step size: 0.0339.
Optimization successful for x0=1.2025. Start fval 15.377604, end fval 15.377596.
Next guess for x0 in direction 1 is 1.2427. Step size: 0.0402.
Optimization successful for x0=1.2427. Start fval 23.003307, end fval 23.003291.
Next guess for x0 in direction 1 is 1.2900. Step size: 0.0474.
Optimization successful for x0=1.2900. Start fval 34.448960, end fval 34.448930.
Next guess for x0 in direction 1 is 1.3455. Step size: 0.0555.
Optimization successful for x0=1.3455. Start fval 51.595802, end fval 51.595747.
Next guess for x0 in direction 1 is 1.4102. Step size: 0.0647.
Optimization successful for x0=1.4102. Start fval 77.298146, end fval 77.298048.
Next guess for x0 in direction 1 is 1.4852. Step size: 0.0751.
Optimization successful for x0=1.4852. Start fval 115.883223, end fval 115.883052.
Next guess for x0 in direction 1 is 1.5718. Step size: 0.0865.
Optimization successful for x0=1.5718. Start fval 173.683838, end fval 173.683548.
Next guess for x0 in direction 1 is 1.6718. Step size: 0.1000.
Optimization successful for x0=1.6718. Start fval 261.037226, end fval 261.036740.
Next guess for x0 in direction 1 is 1.7718. Step size: 0.1000.
Optimization successful for x0=1.7718. Start fval 373.861168, end fval 373.860636.
Next guess for x0 in direction 1 is 1.8718. Step size: 0.1000.
Optimization successful for x0=1.8718. Start fval 515.999112, end fval 515.998616.
Next guess for x0 in direction 1 is 1.9718. Step size: 0.1000.
Optimization successful for x0=1.9718. Start fval 691.539717, end fval 691.539255.
Next guess for x0 in direction 1 is 2.0718. Step size: 0.1000.
Optimization successful for x0=2.0718. Start fval 904.816402, end fval 904.815969.
Next guess for x0 in direction 1 is 2.1718. Step size: 0.1000.
Optimization successful for x0=2.1718. Start fval 1160.407093, end fval 1160.406694.
Next guess for x0 in direction 1 is 2.2718. Step size: 0.1000.
Optimization successful for x0=2.2718. Start fval 1463.133979, end fval 1463.133603.
Next guess for x0 in direction 1 is 2.3718. Step size: 0.1000.
Optimization successful for x0=2.3718. Start fval 1818.063215, end fval 1818.062855.
Next guess for x0 in direction 1 is 2.4718. Step size: 0.1000.
Optimization successful for x0=2.4718. Start fval 2230.504705, end fval 2230.504367.
Next guess for x0 in direction 1 is 2.5718. Step size: 0.1000.
Optimization successful for x0=2.5718. Start fval 2706.011962, end fval 2706.011601.
Next guess for x0 in direction 1 is 2.6718. Step size: 0.1000.
Optimization successful for x0=2.6718. Start fval 3250.381681, end fval 3250.381392.
Next guess for x0 in direction 1 is 2.7718. Step size: 0.1000.
Optimization successful for x0=2.7718. Start fval 3869.654087, end fval 3869.653766.
Next guess for x0 in direction 1 is 2.8718. Step size: 0.1000.
Optimization successful for x0=2.8718. Start fval 4570.112084, end fval 4570.111786.
Next guess for x0 in direction 1 is 2.9718. Step size: 0.1000.
Optimization successful for x0=2.9718. Start fval 5358.281692, end fval 5358.281412.
Next guess for x0 in direction 1 is 3.0718. Step size: 0.1000.
Optimization successful for x0=3.0718. Start fval 6240.931637, end fval 6240.931374.
Next guess for x0 in direction 1 is 3.1718. Step size: 0.1000.
Optimization successful for x0=3.1718. Start fval 7225.073322, end fval 7225.073033.
Next guess for x0 in direction 1 is 3.2718. Step size: 0.1000.
Optimization successful for x0=3.2718. Start fval 8317.960535, end fval 8317.960308.
Next guess for x0 in direction 1 is 3.3718. Step size: 0.1000.
Optimization successful for x0=3.3718. Start fval 9527.089833, end fval 9527.089498.
Next guess for x0 in direction 1 is 3.4718. Step size: 0.1000.
Optimization successful for x0=3.4718. Start fval 10860.199500, end fval 10860.199294.
Next guess for x0 in direction 1 is 3.5718. Step size: 0.1000.
Optimization successful for x0=3.5718. Start fval 12325.270862, end fval 12325.270576.
Next guess for x0 in direction 1 is 3.6718. Step size: 0.1000.
Optimization successful for x0=3.6718. Start fval 13930.526622, end fval 13930.526422.
Next guess for x0 in direction 1 is 3.7718. Step size: 0.1000.
Optimization successful for x0=3.7718. Start fval 15684.432231, end fval 15684.431916.
Next guess for x0 in direction 1 is 3.8718. Step size: 0.1000.
Optimization successful for x0=3.8718. Start fval 17595.694433, end fval 17595.694250.
Next guess for x0 in direction 1 is 3.9718. Step size: 0.1000.
Optimization successful for x0=3.9718. Start fval 19673.262696, end fval 19673.262489.
Next guess for x0 in direction 1 is 4.0718. Step size: 0.1000.
Optimization successful for x0=4.0718. Start fval 21926.327789, end fval 21926.327571.
Next guess for x0 in direction 1 is 4.1718. Step size: 0.1000.
Optimization successful for x0=4.1718. Start fval 24364.322443, end fval 24364.322236.
Next guess for x0 in direction 1 is 4.2718. Step size: 0.1000.
Optimization successful for x0=4.2718. Start fval 26996.921179, end fval 26996.920978.
Next guess for x0 in direction 1 is 4.3718. Step size: 0.1000.
Optimization successful for x0=4.3718. Start fval 29834.040182, end fval 29834.039989.
Next guess for x0 in direction 1 is 4.4718. Step size: 0.1000.
Optimization successful for x0=4.4718. Start fval 32885.837294, end fval 32885.837107.
Next guess for x0 in direction 1 is 4.5718. Step size: 0.1000.
Optimization successful for x0=4.5718. Start fval 36162.711944, end fval 36162.711762.
Next guess for x0 in direction 1 is 4.6718. Step size: 0.1000.
Optimization successful for x0=4.6718. Start fval 39675.305109, end fval 39675.304935.
Next guess for x0 in direction 1 is 4.7718. Step size: 0.1000.
Optimization successful for x0=4.7718. Start fval 43434.499273, end fval 43434.499104.
Next guess for x0 in direction 1 is 4.8718. Step size: 0.1000.
Optimization successful for x0=4.8718. Start fval 47451.418376, end fval 47451.418212.
Next guess for x0 in direction 1 is 4.9718. Step size: 0.1000.
Optimization successful for x0=4.9718. Start fval 51737.427777, end fval 51737.427618.
Next guess for x0 in direction 1 is 5.0000. Step size: 0.0282.
Optimization successful for x0=5.0000. Start fval 52999.839025, end fval 52998.239891.
Next guess for x3 in direction -1 is 0.9860. Step size: -0.0145.
Optimization successful for x3=0.9860. Start fval 0.212545, end fval 0.058195.
Next guess for x3 in direction -1 is 0.9850. Step size: -0.0010.
Optimization successful for x3=0.9850. Start fval 0.071559, end fval 0.066728.
Next guess for x3 in direction -1 is 0.9840. Step size: -0.0010.
Optimization successful for x3=0.9840. Start fval 0.075833, end fval 0.075833.
Next guess for x3 in direction -1 is 0.9830. Step size: -0.0010.
Optimization successful for x3=0.9830. Start fval 0.085509, end fval 0.085509.
Next guess for x3 in direction -1 is 0.9820. Step size: -0.0010.
Optimization successful for x3=0.9820. Start fval 0.095754, end fval 0.095754.
Next guess for x3 in direction -1 is 0.9810. Step size: -0.0010.
Optimization successful for x3=0.9810. Start fval 0.106565, end fval 0.106565.
Next guess for x3 in direction -1 is 0.9800. Step size: -0.0010.
Optimization successful for x3=0.9800. Start fval 0.117941, end fval 0.117941.
Next guess for x3 in direction -1 is 0.9790. Step size: -0.0010.
Optimization successful for x3=0.9790. Start fval 0.129879, end fval 0.129879.
Next guess for x3 in direction -1 is 0.9780. Step size: -0.0010.
Optimization successful for x3=0.9780. Start fval 0.142378, end fval 0.142378.
Next guess for x3 in direction -1 is 0.9767. Step size: -0.0013.
Optimization successful for x3=0.9767. Start fval 0.159432, end fval 0.159432.
Next guess for x3 in direction -1 is 0.9749. Step size: -0.0018.
Optimization successful for x3=0.9749. Start fval 0.185005, end fval 0.185005.
Next guess for x3 in direction -1 is 0.9724. Step size: -0.0025.
Optimization successful for x3=0.9724. Start fval 0.223355, end fval 0.223355.
Next guess for x3 in direction -1 is 0.9689. Step size: -0.0034.
Optimization successful for x3=0.9689. Start fval 0.280864, end fval 0.280864.
Next guess for x3 in direction -1 is 0.9644. Step size: -0.0045.
Optimization successful for x3=0.9644. Start fval 0.367106, end fval 0.367106.
Next guess for x3 in direction -1 is 0.9584. Step size: -0.0059.
Optimization successful for x3=0.9584. Start fval 0.496449, end fval 0.496449.
Next guess for x3 in direction -1 is 0.9508. Step size: -0.0077.
Optimization successful for x3=0.9508. Start fval 0.690444, end fval 0.690444.
Next guess for x3 in direction -1 is 0.9410. Step size: -0.0098.
Optimization successful for x3=0.9410. Start fval 0.981423, end fval 0.981423.
Next guess for x3 in direction -1 is 0.9285. Step size: -0.0124.
Optimization successful for x3=0.9285. Start fval 1.417876, end fval 1.417875.
Next guess for x3 in direction -1 is 0.9128. Step size: -0.0157.
Optimization successful for x3=0.9128. Start fval 2.072581, end fval 2.072580.
Next guess for x3 in direction -1 is 0.8929. Step size: -0.0199.
Optimization successful for x3=0.8929. Start fval 3.054385, end fval 3.054380.
Next guess for x3 in direction -1 is 0.8676. Step size: -0.0253.
Optimization successful for x3=0.8676. Start fval 4.526626, end fval 4.526612.
Next guess for x3 in direction -1 is 0.8352. Step size: -0.0323.
Optimization successful for x3=0.8352. Start fval 6.734212, end fval 6.734168.
Next guess for x3 in direction -1 is 0.7934. Step size: -0.0418.
Optimization successful for x3=0.7934. Start fval 10.044624, end fval 10.044509.
Next guess for x3 in direction -1 is 0.7383. Step size: -0.0551.
Optimization successful for x3=0.7383. Start fval 15.010063, end fval 15.009697.
Next guess for x3 in direction -1 is 0.6634. Step size: -0.0749.
Optimization successful for x3=0.6634. Start fval 22.460228, end fval 22.458888.
Next guess for x3 in direction -1 is 0.5634. Step size: -0.1000.
Optimization successful for x3=0.5634. Start fval 32.812297, end fval 32.807338.
Next guess for x3 in direction -1 is 0.4634. Step size: -0.1000.
Optimization successful for x3=0.4634. Start fval 42.664171, end fval 42.656079.
Next guess for x3 in direction -1 is 0.3634. Step size: -0.1000.
Optimization successful for x3=0.3634. Start fval 51.213285, end fval 51.202046.
Next guess for x3 in direction -1 is 0.2634. Step size: -0.1000.
Optimization successful for x3=0.2634. Start fval 57.932071, end fval 57.915322.
Next guess for x3 in direction -1 is 0.1634. Step size: -0.1000.
Optimization successful for x3=0.1634. Start fval 62.581964, end fval 62.554659.
Next guess for x3 in direction -1 is 0.0634. Step size: -0.1000.
Optimization successful for x3=0.0634. Start fval 65.255627, end fval 65.204538.
Next guess for x3 in direction -1 is -0.0366. Step size: -0.1000.
Optimization successful for x3=-0.0366. Start fval 66.484391, end fval 66.391913.
Next guess for x3 in direction -1 is -0.1366. Step size: -0.1000.
Optimization successful for x3=-0.1366. Start fval 67.250346, end fval 66.999350.
Next guess for x3 in direction -1 is -0.2366. Step size: -0.1000.
Optimization successful for x3=-0.2366. Start fval 67.599142, end fval 67.358691.
Next guess for x3 in direction -1 is -0.3366. Step size: -0.1000.
Optimization successful for x3=-0.3366. Start fval 67.588816, end fval 67.508285.
Next guess for x3 in direction -1 is -0.4366. Step size: -0.1000.
Optimization successful for x3=-0.4366. Start fval 67.677589, end fval 67.669120.
Next guess for x3 in direction -1 is -0.5037. Step size: -0.0670.
Optimization successful for x3=-0.5037. Start fval 68.013064, end fval 68.011051.
Next guess for x3 in direction -1 is -0.5607. Step size: -0.0570.
Optimization successful for x3=-0.5607. Start fval 68.627597, end fval 68.627304.
Next guess for x3 in direction -1 is -0.6153. Step size: -0.0546.
Optimization successful for x3=-0.6153. Start fval 69.653623, end fval 69.653434.
Next guess for x3 in direction -1 is -0.6705. Step size: -0.0552.
Optimization successful for x3=-0.6705. Start fval 71.293672, end fval 71.293496.
Next guess for x3 in direction -1 is -0.7280. Step size: -0.0575.
Optimization successful for x3=-0.7280. Start fval 73.855524, end fval 73.855337.
Next guess for x3 in direction -1 is -0.7890. Step size: -0.0610.
Optimization successful for x3=-0.7890. Start fval 77.799294, end fval 77.799051.
Next guess for x3 in direction -1 is -0.8546. Step size: -0.0655.
Optimization successful for x3=-0.8546. Start fval 83.805839, end fval 83.805570.
Next guess for x3 in direction -1 is -0.9256. Step size: -0.0710.
Optimization successful for x3=-0.9256. Start fval 92.907790, end fval 92.907330.
Next guess for x3 in direction -1 is -1.0031. Step size: -0.0775.
Optimization successful for x3=-1.0031. Start fval 106.646153, end fval 106.645800.
Next guess for x3 in direction -1 is -1.0880. Step size: -0.0849.
Optimization successful for x3=-1.0880. Start fval 127.316428, end fval 127.315953.
Next guess for x3 in direction -1 is -1.1880. Step size: -0.1000.
Optimization successful for x3=-1.1880. Start fval 160.967157, end fval 160.966386.
Next guess for x3 in direction -1 is -1.2880. Step size: -0.1000.
Optimization successful for x3=-1.2880. Start fval 206.971698, end fval 206.970868.
Next guess for x3 in direction -1 is -1.3880. Step size: -0.1000.
Optimization successful for x3=-1.3880. Start fval 267.980638, end fval 267.979876.
Next guess for x3 in direction -1 is -1.4880. Step size: -0.1000.
Optimization successful for x3=-1.4880. Start fval 346.892400, end fval 346.891680.
Next guess for x3 in direction -1 is -1.5880. Step size: -0.1000.
Optimization successful for x3=-1.5880. Start fval 446.852347, end fval 446.851690.
Next guess for x3 in direction -1 is -1.6880. Step size: -0.1000.
Optimization successful for x3=-1.6880. Start fval 571.252370, end fval 571.251776.
Next guess for x3 in direction -1 is -1.7880. Step size: -0.1000.
Optimization successful for x3=-1.7880. Start fval 723.730337, end fval 723.729784.
Next guess for x3 in direction -1 is -1.8880. Step size: -0.1000.
Optimization successful for x3=-1.8880. Start fval 908.169605, end fval 908.169082.
Next guess for x3 in direction -1 is -1.9880. Step size: -0.1000.
Optimization successful for x3=-1.9880. Start fval 1128.698643, end fval 1128.698152.
Next guess for x3 in direction -1 is -2.0880. Step size: -0.1000.
Optimization successful for x3=-2.0880. Start fval 1389.690707, end fval 1389.690249.
Next guess for x3 in direction -1 is -2.1880. Step size: -0.1000.
Optimization successful for x3=-2.1880. Start fval 1695.763508, end fval 1695.763079.
Next guess for x3 in direction -1 is -2.2880. Step size: -0.1000.
Optimization successful for x3=-2.2880. Start fval 2051.778953, end fval 2051.778536.
Next guess for x3 in direction -1 is -2.3880. Step size: -0.1000.
Optimization successful for x3=-2.3880. Start fval 2462.842839, end fval 2462.842355.
Next guess for x3 in direction -1 is -2.4880. Step size: -0.1000.
Optimization successful for x3=-2.4880. Start fval 2934.304655, end fval 2934.304069.
Next guess for x3 in direction -1 is -2.5880. Step size: -0.1000.
Optimization successful for x3=-2.5880. Start fval 3471.757253, end fval 3471.756889.
Next guess for x3 in direction -1 is -2.6880. Step size: -0.1000.
Optimization successful for x3=-2.6880. Start fval 4081.037547, end fval 4081.036900.
Next guess for x3 in direction -1 is -2.7880. Step size: -0.1000.
Optimization successful for x3=-2.7880. Start fval 4768.224418, end fval 4768.224093.
Next guess for x3 in direction -1 is -2.8880. Step size: -0.1000.
Optimization successful for x3=-2.8880. Start fval 5539.641318, end fval 5539.640366.
Next guess for x3 in direction -1 is -2.9880. Step size: -0.1000.
Optimization successful for x3=-2.9880. Start fval 6401.852356, end fval 6401.851624.
Next guess for x3 in direction -1 is -3.0880. Step size: -0.1000.
Optimization successful for x3=-3.0880. Start fval 7361.666327, end fval 7361.666050.
Next guess for x3 in direction -1 is -3.1880. Step size: -0.1000.
Optimization successful for x3=-3.1880. Start fval 8426.134704, end fval 8426.134441.
Next guess for x3 in direction -1 is -3.2880. Step size: -0.1000.
Optimization successful for x3=-3.2880. Start fval 9602.550390, end fval 9602.550075.
Next guess for x3 in direction -1 is -3.3880. Step size: -0.1000.
Optimization successful for x3=-3.3880. Start fval 10898.448926, end fval 10898.448695.
Next guess for x3 in direction -1 is -3.4880. Step size: -0.1000.
Optimization successful for x3=-3.4880. Start fval 12321.608646, end fval 12321.608286.
Next guess for x3 in direction -1 is -3.5880. Step size: -0.1000.
Optimization successful for x3=-3.5880. Start fval 13880.049381, end fval 13880.049147.
Next guess for x3 in direction -1 is -3.6880. Step size: -0.1000.
Optimization successful for x3=-3.6880. Start fval 15582.033956, end fval 15582.033637.
Next guess for x3 in direction -1 is -3.7880. Step size: -0.1000.
Optimization successful for x3=-3.7880. Start fval 17436.066484, end fval 17436.066265.
Next guess for x3 in direction -1 is -3.8880. Step size: -0.1000.
Optimization successful for x3=-3.8880. Start fval 19450.893756, end fval 19450.893523.
Next guess for x3 in direction -1 is -3.9880. Step size: -0.1000.
Optimization successful for x3=-3.9880. Start fval 21635.504027, end fval 21635.503695.
Next guess for x3 in direction -1 is -4.0880. Step size: -0.1000.
Optimization successful for x3=-4.0880. Start fval 23999.127357, end fval 23999.127129.
Next guess for x3 in direction -1 is -4.1880. Step size: -0.1000.
Optimization successful for x3=-4.1880. Start fval 26551.236034, end fval 26551.235862.
Next guess for x3 in direction -1 is -4.2880. Step size: -0.1000.
Optimization successful for x3=-4.2880. Start fval 29301.543910, end fval 29301.543693.
Next guess for x3 in direction -1 is -4.3880. Step size: -0.1000.
Optimization successful for x3=-4.3880. Start fval 32260.006296, end fval 32260.006078.
Next guess for x3 in direction -1 is -4.4880. Step size: -0.1000.
Optimization successful for x3=-4.4880. Start fval 35436.820309, end fval 35436.820110.
Next guess for x3 in direction -1 is -4.5880. Step size: -0.1000.
Optimization successful for x3=-4.5880. Start fval 38842.424669, end fval 38842.424482.
Next guess for x3 in direction -1 is -4.6880. Step size: -0.1000.
Optimization successful for x3=-4.6880. Start fval 42487.499612, end fval 42487.499427.
Next guess for x3 in direction -1 is -4.7880. Step size: -0.1000.
Optimization successful for x3=-4.7880. Start fval 46382.966853, end fval 46382.966674.
Next guess for x3 in direction -1 is -4.8880. Step size: -0.1000.
Optimization successful for x3=-4.8880. Start fval 50539.989573, end fval 50539.989402.
Next guess for x3 in direction -1 is -4.9880. Step size: -0.1000.
Optimization successful for x3=-4.9880. Start fval 54969.972369, end fval 54969.972204.
Next guess for x3 in direction -1 is -5.0000. Step size: -0.0120.
Optimization successful for x3=-5.0000. Start fval 55522.507822, end fval 55520.110281.
Next guess for x3 in direction 1 is 1.0031. Step size: 0.0026.
Optimization successful for x3=1.0031. Start fval 0.288022, end fval 0.002984.
Next guess for x3 in direction 1 is 1.0041. Step size: 0.0010.
Optimization successful for x3=1.0041. Start fval 0.831864, end fval 0.005194.
Next guess for x3 in direction 1 is 1.0051. Step size: 0.0010.
Optimization successful for x3=1.0051. Start fval 0.008015, end fval 0.008015.
Next guess for x3 in direction 1 is 1.0061. Step size: 0.0010.
Optimization successful for x3=1.0061. Start fval 0.011450, end fval 0.011450.
Next guess for x3 in direction 1 is 1.0071. Step size: 0.0010.
Optimization successful for x3=1.0071. Start fval 0.015500, end fval 0.015500.
Next guess for x3 in direction 1 is 1.0081. Step size: 0.0010.
Optimization successful for x3=1.0081. Start fval 0.020169, end fval 0.020169.
Next guess for x3 in direction 1 is 1.0091. Step size: 0.0010.
Optimization successful for x3=1.0091. Start fval 0.025458, end fval 0.025458.
Next guess for x3 in direction 1 is 1.0101. Step size: 0.0010.
Optimization successful for x3=1.0101. Start fval 0.031369, end fval 0.031369.
Next guess for x3 in direction 1 is 1.0111. Step size: 0.0010.
Optimization successful for x3=1.0111. Start fval 0.037904, end fval 0.037904.
Next guess for x3 in direction 1 is 1.0121. Step size: 0.0010.
Optimization successful for x3=1.0121. Start fval 0.045065, end fval 0.045065.
Next guess for x3 in direction 1 is 1.0131. Step size: 0.0010.
Optimization successful for x3=1.0131. Start fval 0.052854, end fval 0.052854.
Next guess for x3 in direction 1 is 1.0141. Step size: 0.0010.
Optimization successful for x3=1.0141. Start fval 0.061274, end fval 0.061274.
Next guess for x3 in direction 1 is 1.0151. Step size: 0.0010.
Optimization successful for x3=1.0151. Start fval 0.070327, end fval 0.070327.
Next guess for x3 in direction 1 is 1.0161. Step size: 0.0010.
Optimization successful for x3=1.0161. Start fval 0.080014, end fval 0.080014.
Next guess for x3 in direction 1 is 1.0171. Step size: 0.0010.
Optimization successful for x3=1.0171. Start fval 0.090338, end fval 0.090338.
Next guess for x3 in direction 1 is 1.0181. Step size: 0.0010.
Optimization successful for x3=1.0181. Start fval 0.101301, end fval 0.101301.
Next guess for x3 in direction 1 is 1.0191. Step size: 0.0010.
Optimization successful for x3=1.0191. Start fval 0.112904, end fval 0.112904.
Next guess for x3 in direction 1 is 1.0201. Step size: 0.0010.
Optimization successful for x3=1.0201. Start fval 0.125151, end fval 0.125151.
Next guess for x3 in direction 1 is 1.0211. Step size: 0.0010.
Optimization successful for x3=1.0211. Start fval 0.138042, end fval 0.138042.
Next guess for x3 in direction 1 is 1.0222. Step size: 0.0011.
Optimization successful for x3=1.0222. Start fval 0.152927, end fval 0.152927.
Next guess for x3 in direction 1 is 1.0238. Step size: 0.0015.
Optimization successful for x3=1.0238. Start fval 0.175250, end fval 0.175250.
Next guess for x3 in direction 1 is 1.0259. Step size: 0.0021.
Optimization successful for x3=1.0259. Start fval 0.208725, end fval 0.208725.
Next guess for x3 in direction 1 is 1.0288. Step size: 0.0029.
Optimization successful for x3=1.0288. Start fval 0.258923, end fval 0.258923.
Next guess for x3 in direction 1 is 1.0327. Step size: 0.0039.
Optimization successful for x3=1.0327. Start fval 0.334201, end fval 0.334201.
Next guess for x3 in direction 1 is 1.0377. Step size: 0.0050.
Optimization successful for x3=1.0377. Start fval 0.447103, end fval 0.447103.
Next guess for x3 in direction 1 is 1.0441. Step size: 0.0064.
Optimization successful for x3=1.0441. Start fval 0.616452, end fval 0.616452.
Next guess for x3 in direction 1 is 1.0522. Step size: 0.0081.
Optimization successful for x3=1.0522. Start fval 0.870505, end fval 0.870505.
Next guess for x3 in direction 1 is 1.0622. Step size: 0.0100.
Optimization successful for x3=1.0622. Start fval 1.251591, end fval 1.251590.
Next guess for x3 in direction 1 is 1.0746. Step size: 0.0124.
Optimization successful for x3=1.0746. Start fval 1.823134, end fval 1.823134.
Next guess for x3 in direction 1 is 1.0897. Step size: 0.0151.
Optimization successful for x3=1.0897. Start fval 2.680029, end fval 2.680028.
Next guess for x3 in direction 1 is 1.1080. Step size: 0.0183.
Optimization successful for x3=1.1080. Start fval 3.964543, end fval 3.964540.
Next guess for x3 in direction 1 is 1.1301. Step size: 0.0221.
Optimization successful for x3=1.1301. Start fval 5.890028, end fval 5.890022.
Next guess for x3 in direction 1 is 1.1566. Step size: 0.0265.
Optimization successful for x3=1.1566. Start fval 8.776882, end fval 8.776870.
Next guess for x3 in direction 1 is 1.1883. Step size: 0.0316.
Optimization successful for x3=1.1883. Start fval 13.107352, end fval 13.107328.
Next guess for x3 in direction 1 is 1.2259. Step size: 0.0376.
Optimization successful for x3=1.2259. Start fval 19.604659, end fval 19.604614.
Next guess for x3 in direction 1 is 1.2702. Step size: 0.0444.
Optimization successful for x3=1.2702. Start fval 29.339914, end fval 29.339789.
Next guess for x3 in direction 1 is 1.3223. Step size: 0.0521.
Optimization successful for x3=1.3223. Start fval 43.932373, end fval 43.932225.
Next guess for x3 in direction 1 is 1.3832. Step size: 0.0609.
Optimization successful for x3=1.3832. Start fval 65.830051, end fval 65.829671.
Next guess for x3 in direction 1 is 1.4540. Step size: 0.0708.
Optimization successful for x3=1.4540. Start fval 98.653093, end fval 98.652621.
Next guess for x3 in direction 1 is 1.5358. Step size: 0.0818.
Optimization successful for x3=1.5358. Start fval 147.839512, end fval 147.838519.
Next guess for x3 in direction 1 is 1.6358. Step size: 0.1000.
Optimization successful for x3=1.6358. Start fval 226.941214, end fval 226.939787.
Next guess for x3 in direction 1 is 1.7358. Step size: 0.1000.
Optimization successful for x3=1.7358. Start fval 330.192737, end fval 330.191174.
Next guess for x3 in direction 1 is 1.8358. Step size: 0.1000.
Optimization successful for x3=1.8358. Start fval 461.348873, end fval 461.347465.
Next guess for x3 in direction 1 is 1.9358. Step size: 0.1000.
Optimization successful for x3=1.9358. Start fval 624.410107, end fval 624.408830.
Next guess for x3 in direction 1 is 2.0358. Step size: 0.1000.
Optimization successful for x3=2.0358. Start fval 823.621565, end fval 823.620423.
Next guess for x3 in direction 1 is 2.1358. Step size: 0.1000.
Optimization successful for x3=2.1358. Start fval 1063.473107, end fval 1063.472053.
Next guess for x3 in direction 1 is 2.2358. Step size: 0.1000.
Optimization successful for x3=2.2358. Start fval 1348.698855, end fval 1348.697888.
Next guess for x3 in direction 1 is 2.3358. Step size: 0.1000.
Optimization successful for x3=2.3358. Start fval 1684.277078, end fval 1684.276183.
Next guess for x3 in direction 1 is 2.4358. Step size: 0.1000.
Optimization successful for x3=2.4358. Start fval 2075.429877, end fval 2075.429049.
Next guess for x3 in direction 1 is 2.5358. Step size: 0.1000.
Optimization successful for x3=2.5358. Start fval 2527.623027, end fval 2527.622227.
Next guess for x3 in direction 1 is 2.6358. Step size: 0.1000.
Optimization successful for x3=2.6358. Start fval 3046.565626, end fval 3046.564901.
Next guess for x3 in direction 1 is 2.7358. Step size: 0.1000.
Optimization successful for x3=2.7358. Start fval 3638.210194, end fval 3638.209515.
Next guess for x3 in direction 1 is 2.8358. Step size: 0.1000.
Optimization successful for x3=2.8358. Start fval 4308.752254, end fval 4308.751620.
Next guess for x3 in direction 1 is 2.9358. Step size: 0.1000.
Optimization successful for x3=2.9358. Start fval 5064.630370, end fval 5064.629707.
Next guess for x3 in direction 1 is 3.0358. Step size: 0.1000.
Optimization successful for x3=3.0358. Start fval 5912.525638, end fval 5912.525099.
Next guess for x3 in direction 1 is 3.1358. Step size: 0.1000.
Optimization successful for x3=3.1358. Start fval 6859.362384, end fval 6859.361800.
Next guess for x3 in direction 1 is 3.2358. Step size: 0.1000.
Optimization successful for x3=3.2358. Start fval 7912.306924, end fval 7912.306392.
Next guess for x3 in direction 1 is 3.3358. Step size: 0.1000.
Optimization successful for x3=3.3358. Start fval 9078.768423, end fval 9078.767923.
Next guess for x3 in direction 1 is 3.4358. Step size: 0.1000.
Optimization successful for x3=3.4358. Start fval 10366.398286, end fval 10366.397822.
Next guess for x3 in direction 1 is 3.5358. Step size: 0.1000.
Optimization successful for x3=3.5358. Start fval 11783.090283, end fval 11783.089756.
Next guess for x3 in direction 1 is 3.6358. Step size: 0.1000.
Optimization successful for x3=3.6358. Start fval 13336.980040, end fval 13336.979635.
Next guess for x3 in direction 1 is 3.7358. Step size: 0.1000.
Optimization successful for x3=3.7358. Start fval 15036.445897, end fval 15036.445440.
Next guess for x3 in direction 1 is 3.8358. Step size: 0.1000.
Optimization successful for x3=3.8358. Start fval 16890.107597, end fval 16890.107185.
Next guess for x3 in direction 1 is 3.9358. Step size: 0.1000.
Optimization successful for x3=3.9358. Start fval 18906.827246, end fval 18906.826852.
Next guess for x3 in direction 1 is 4.0358. Step size: 0.1000.
Optimization successful for x3=4.0358. Start fval 21095.708696, end fval 21095.708348.
Next guess for x3 in direction 1 is 4.1358. Step size: 0.1000.
Optimization successful for x3=4.1358. Start fval 23466.097828, end fval 23466.097311.
Next guess for x3 in direction 1 is 4.2358. Step size: 0.1000.
Optimization successful for x3=4.2358. Start fval 26027.581607, end fval 26027.581288.
Next guess for x3 in direction 1 is 4.3358. Step size: 0.1000.
Optimization successful for x3=4.3358. Start fval 28789.989876, end fval 28789.989423.
Next guess for x3 in direction 1 is 4.4358. Step size: 0.1000.
Optimization successful for x3=4.4358. Start fval 31763.392906, end fval 31763.392617.
Next guess for x3 in direction 1 is 4.5358. Step size: 0.1000.
Optimization successful for x3=4.5358. Start fval 34958.103727, end fval 34958.103319.
Next guess for x3 in direction 1 is 4.6358. Step size: 0.1000.
Optimization successful for x3=4.6358. Start fval 38384.675861, end fval 38384.675562.
Next guess for x3 in direction 1 is 4.7358. Step size: 0.1000.
Optimization successful for x3=4.7358. Start fval 42053.905236, end fval 42053.904869.
Next guess for x3 in direction 1 is 4.8358. Step size: 0.1000.
Optimization successful for x3=4.8358. Start fval 45976.828562, end fval 45976.828297.
Next guess for x3 in direction 1 is 4.9358. Step size: 0.1000.
Optimization successful for x3=4.9358. Start fval 50164.724645, end fval 50164.724290.
Next guess for x3 in direction 1 is 5.0000. Step size: 0.0642.
Optimization successful for x3=5.0000. Start fval 53000.376844, end fval 52999.837663.

CPU times: user 10.5 s, sys: 341 ms, total: 10.9 s
Wall time: 10.6 s

# specify the parameters, for which profiles should be computed
visualize.profiles(
    result1,
    profile_indices=[0, 3],
    reference=[ref, ref2],
    profile_list_ids=[0, 1],
);

visualize.profiles(
    result4,
    profile_indices=[0, 3],
    reference=[ref4],
);

As we can see here, the second optimum disagrees only in the very first value. Here it becomes apparent that it is only a local optimum, as the profile for the second optimum is very flat. Comparing the profiles of proplem 1 and 4, we can see, that while the convergence of problem4 was quite bad, the profiles look really similar.

Profile approximation

When computing the profiles is computationally too demanding, it is possible to employ to at least consider a normal approximation with covariance matrix given by the Hessian or FIM at the optimal parameters.

result1 = profile.approximate_parameter_profile(
    problem=problem1,
    result=result1,
    profile_index=np.array([0, 1, 3, 5]),
    result_index=0,
    n_steps=1000,
)

Computing Hessian/FIM as not available in result.
/home/docs/checkouts/readthedocs.org/user_builds/pypesto/envs/stable/lib/python3.11/site-packages/pypesto/profile/approximate.py:101: RuntimeWarning: divide by zero encountered in log
  fvals = -np.log(ys)

These approximate profiles require at most one additional function evaluation, can however yield substantial approximation errors:

axes = visualize.profiles(
    result1,
    profile_indices=[0, 3],
    profile_list_ids=[0, 2],
    ratio_min=0.01,
    colors=[(1, 0, 0, 1), (0, 0, 1, 1)],
    legends=[
        "Optimization-based profile",
        "Local profile approximation",
    ],
);

visualize.profile_cis(
    result1, confidence_level=0.95, profile_list=2, show_bounds=True
);