Custom Objective Function
pyPESTO can not only do parameter estimation for PEtab and AMICI models, but is able to do so on any provided function. This is done by providing the objective with the function as well as possibly gradient and hessian. In this notebook, we will show a few different ways on how to do this. As sometimes manually providing the gradient and hessian is tedious, we will try to emphasize on the importance of those two.
After this notebook, you should …
… be able to create an objective from a given function.
… be able to potentially add a gradient and hessian to the objective.
… be able to run parameter estimation on the objective.
… know the importance of gradient and hessian in terms of optimization speed and accuracy.
[1]:
# install if not done yet
# %pip install pypesto --quiet
[2]:
import matplotlib.pyplot as plt
import numpy as np
import scipy as sp
from IPython.display import Markdown, display
import pypesto
import pypesto.optimize as optimize
import pypesto.profile as profile
import pypesto.visualize as visualize
# set a random seed
np.random.seed(1912)
%matplotlib inline
1. Objective + Problem Definition
In the following we will use the Rosenbrock Banana function, which we can directly get from scipy.
The first creation of the objective function is rather straightforward: We create it by providing a function, as well as gradient and hessian.
[3]:
# first type of objective defined through callables
objective1 = pypesto.Objective(
fun=sp.optimize.rosen,
grad=sp.optimize.rosen_der,
hess=sp.optimize.rosen_hess,
)
The second option is to provide a function that returns objective value, gradient and hessian (last two optional) all as a tuple. In this case, we just need to notify the pyPESTO objective of this through boolean values.
[4]:
# second type of objective
def rosen2(x):
return (
sp.optimize.rosen(x),
sp.optimize.rosen_der(x),
sp.optimize.rosen_hess(x),
)
objective2 = pypesto.Objective(fun=rosen2, grad=True, hess=True)
For later comparisons, we create two other objectives. One that is only provided with function and gradient, and one that only has the functional value, forcing it to rely on finite differences in optimization.
[5]:
# no hessian objective
objective3 = pypesto.Objective(
fun=sp.optimize.rosen,
grad=sp.optimize.rosen_der,
)
# neither hessian nor gradient objective
objective4 = pypesto.Objective(
fun=sp.optimize.rosen,
)
To get from objective to a usable parameter estimation problem, we need to additionally provide the bounds of our parameters.
[6]:
dim_full = 15
lb = -5 * np.ones((dim_full, 1))
ub = 5 * np.ones((dim_full, 1))
# for the sake of comparison, we create 20 starts within these bounds
x_guesses = np.random.uniform(-5, 5, (20, dim_full))
problem1 = pypesto.Problem(
objective=objective1, lb=lb, ub=ub, x_guesses=x_guesses
)
problem2 = pypesto.Problem(
objective=objective2, lb=lb, ub=ub, x_guesses=x_guesses
)
problem3 = pypesto.Problem(
objective=objective3, lb=lb, ub=ub, x_guesses=x_guesses
)
problem4 = pypesto.Problem(
objective=objective4, lb=lb, ub=ub, x_guesses=x_guesses
)
Illustration
The Rosenbrock function is a function, which is often used to test optimization algorithms. It is defined as
\[f(x) = \sum_{i=1}^{n-1} 100 (x_{i+1} - x_i^2)^2 + (1 - x_i)^2, \quad x \in \mathbb{R}^n\]
This function has a global minimum at \(x^* = (1, \dots, 1)\) with \(f(x^*) = 0\). If \(n\geq 4\), the function has an additional local minimum at \(x^* = (-1, 1, \dots, 1)\) with \(f(x^*) = 4\).
We will illustrate the function for \(n=2\).
[7]:
x = np.arange(-2, 2, 0.1)
y = np.arange(-2, 2, 0.1)
x, y = np.meshgrid(x, y)
z = np.zeros_like(x)
for j in range(0, x.shape[0]):
for k in range(0, x.shape[1]):
z[j, k] = objective1([x[j, k], y[j, k]], (0,))
[8]:
fig = plt.figure()
fig.set_size_inches(*(14, 10))
ax = plt.axes(projection="3d")
ax.plot_surface(X=x, Y=y, Z=z)
plt.xlabel("x axis")
plt.ylabel("y axis")
ax.set_title("cost function values");
And a contour plot:
[9]:
fig = plt.figure()
fig.set_size_inches(*(14, 10))
ax = plt.axes()
ax.contourf(x, y, z, 100, norm="log");
2. Optimization
[10]:
# optimizer
optimizer = optimize.ScipyOptimizer()
# engine
# In this notebook, it is faster to use a single core engine, due to the
# overhead of multiprocessing. But in general with more expensive problems
# it is recommended to use the MultiProcessEngine.
engine = pypesto.engine.SingleCoreEngine()
# starts
n_starts = 20
As a first comparison, we time each optimization. We also use the same optimizer and engine for all optimizations.
[11]:
%%time
# run optimization of problem 1
result1 = optimize.minimize(
problem=problem1, optimizer=optimizer, n_starts=n_starts, engine=engine
)
# run optimization of problem 2
result2 = optimize.minimize(
problem=problem2, optimizer=optimizer, n_starts=n_starts, engine=engine
)
# run optimization of problem 3
result3 = optimize.minimize(
problem=problem3, optimizer=optimizer, n_starts=n_starts, engine=engine
)
# run optimization of problem 4
result4 = optimize.minimize(
problem=problem4, optimizer=optimizer, n_starts=n_starts, engine=engine
)
/home/docs/checkouts/readthedocs.org/user_builds/pypesto/envs/v0.5.7/lib/python3.11/site-packages/pypesto/optimize/optimizer.py:255: UserWarning: scipy.optimize.minimize does not support passing fun and hess as one function. Hence for each evaluation of hess, fun will be evaluated again. This can lead to increased computation times. If possible, separate fun and hess.
return minimize(
CPU times: user 4.06 s, sys: 0 ns, total: 4.06 s
Wall time: 2.05 s
As a first step, let us take a look at the different result summaries:
[12]:
display(
Markdown("# Result 1\n" + result1.optimize_result.summary(disp_best=False))
)
display(
Markdown("# Result 2\n" + result2.optimize_result.summary(disp_best=False))
)
display(
Markdown("# Result 3\n" + result3.optimize_result.summary(disp_best=False))
)
display(
Markdown("# Result 4\n" + result4.optimize_result.summary(disp_best=False))
)
Result 1
Optimization Result
number of starts: 20
best value: 7.541162891095075e-11, id=3
worst value: 3.9866238147031865, id=6
number of non-finite values: 0
execution time summary:
Mean execution time: 0.013s
Maximum execution time: 0.016s, id=0
Minimum execution time: 0.008s, id=13
summary of optimizer messages:
Count
Message
20
CONVERGENCE: RELATIVE REDUCTION OF F <= FACTR*EPSMCH
best value found (approximately) 15 time(s)
number of plateaus found: 2
Result 2
Optimization Result
number of starts: 20
best value: 7.541162891095075e-11, id=3
worst value: 3.9866238147031865, id=6
number of non-finite values: 0
execution time summary:
Mean execution time: 0.017s
Maximum execution time: 0.021s, id=11
Minimum execution time: 0.011s, id=13
summary of optimizer messages:
Count
Message
20
CONVERGENCE: RELATIVE REDUCTION OF F <= FACTR*EPSMCH
best value found (approximately) 15 time(s)
number of plateaus found: 2
Result 3
Optimization Result
number of starts: 20
best value: 7.541162891095075e-11, id=3
worst value: 3.9866238147031865, id=6
number of non-finite values: 0
execution time summary:
Mean execution time: 0.013s
Maximum execution time: 0.017s, id=7
Minimum execution time: 0.009s, id=13
summary of optimizer messages:
Count
Message
20
CONVERGENCE: RELATIVE REDUCTION OF F <= FACTR*EPSMCH
best value found (approximately) 15 time(s)
number of plateaus found: 2
Result 4
Optimization Result
number of starts: 20
best value: 0.10830108740299478, id=9
worst value: 10.221950223304326, id=11
number of non-finite values: 0
execution time summary:
Mean execution time: 0.059s
Maximum execution time: 0.062s, id=19
Minimum execution time: 0.057s, id=7
summary of optimizer messages:
Count
Message
20
STOP: TOTAL NO. OF F,G EVALUATIONS EXCEEDS LIMIT
best value found (approximately) 1 time(s)
number of plateaus found: 5
Here we can see already a big difference between the first three and the fourth. The one without gradients took approximately five times as long to finish the optimization as the other three. The best value found is also not the same as for the others. But the biggest difference is probably the fact that while the first three all converged in all their starts, the one without gradient reach the maximum number of evaluations in most to all cases. Keep in mind: All starts were the same for all problems.
A small detail here: When comparing the first three results, one may notice two things. For one, leaving out the hessian seems not make any difference. And additionally, while they are rather close in speed compared to the fourth one, the second one sticks out to be somewhat slower. This is mainly due to the fact that we chose the scipy optimizer “l-bfgs-b”, which does not support the usage of a hessian, for the sake of comparing all four of them. This also explains why the second one is slower, as (by construction), whether needed or not, problem2 will evaluate the hessian.
Visualization
[13]:
# waterfalls
visualize.waterfall(result1)
visualize.waterfall(result2)
visualize.waterfall(result3)
visualize.waterfall(result4);
We can see here already the stark difference between the problem definitions. In order to compare things easier, we can also plot all results in one waterfall plot:
[14]:
# plot one list of waterfalls
visualize.waterfall(
[result1, result2, result3, result4],
legends=["Problem 1", "Problem 2", "Problem 3", "Problem 4"],
);
We can also take a look at the parameters, that each optimizer found:
[15]:
# plot parameters
ax = visualize.parameters(
result1,
)
ax.set_title("Estimated parameters problem 1")
ax2 = visualize.parameters(
[result4, result1, result2, result3],
legends=["Problem 4", "Problem 1", "Problem 2", "Problem 3"],
)
ax2.set_title("Estimated parameters all problems");
3. Profiling
We want to create profiles for our parameters to know more about their uncertainties. We shall create profiles for problem 1 and 4. For problem 1 specifically, we create two profiles, as we have seen, that there are two distinct optima, so we want to start our profile likelihood from both optima.
Note that when running profiles, the cost function is interpreted as a negative log likelihood function. This has some implications on the stopping criteria of the algorithm and on the confidence intervals. Therefore a meaningful statistical interpretation of the results is only possible if the cost function is a negative log likelihood function or a negative log posterior function. The same holds for sampling.
[16]:
# we create references for each "best point":
ref = {
"x": result1.optimize_result.x[0],
"fval": result1.optimize_result.fval[0],
"color": [0.2, 0.4, 1.0, 1.0],
"legend": "First optimum problem 1",
}
ref = visualize.create_references(ref)[0]
# we create references for each "best point":
ref2 = {
"x": result1.optimize_result.x[-1],
"fval": result1.optimize_result.fval[-1],
"color": [0.4, 1.0, 0.2, 1.0],
"legend": "Second optimum problem 1",
}
ref2 = visualize.create_references(ref2)[0]
# we create references for each "best point":
ref4 = {
"x": result4.optimize_result.x[0],
"fval": result4.optimize_result.fval[0],
"color": [0.2, 0.4, 1.0, 1.0],
"legend": "First optimum problem 4",
}
ref4 = visualize.create_references(ref4)[0];
[17]:
%%time
# compute profiles
profile_options = profile.ProfileOptions(whole_path=True)
result1 = profile.parameter_profile(
problem=problem1,
result=result1,
optimizer=optimizer,
profile_index=np.array([0, 3]),
result_index=0,
profile_options=profile_options,
filename=None,
)
# compute profiles from second optimum
result1 = profile.parameter_profile(
problem=problem1,
result=result1,
optimizer=optimizer,
profile_index=np.array([0, 3]),
result_index=-1,
profile_options=profile_options,
filename=None,
)
result4 = profile.parameter_profile(
problem=problem4,
result=result4,
optimizer=optimizer,
profile_index=np.array([0, 3]),
result_index=0,
profile_options=profile_options,
filename=None,
)
Next guess for x0 in direction -1 is 0.9837. Step size: -0.0163.
Optimization successful for x0=0.9837. Start fval 0.104551, end fval 0.078386.
Next guess for x0 in direction -1 is 0.9800. Step size: -0.0037.
Optimization successful for x0=0.9800. Start fval 0.117532, end fval 0.117532.
Next guess for x0 in direction -1 is 0.9755. Step size: -0.0046.
Optimization successful for x0=0.9755. Start fval 0.176282, end fval 0.176282.
Next guess for x0 in direction -1 is 0.9699. Step size: -0.0056.
Optimization successful for x0=0.9699. Start fval 0.264400, end fval 0.264400.
Next guess for x0 in direction -1 is 0.9629. Step size: -0.0069.
Optimization successful for x0=0.9629. Start fval 0.396568, end fval 0.396567.
Next guess for x0 in direction -1 is 0.9544. Step size: -0.0086.
Optimization successful for x0=0.9544. Start fval 0.594810, end fval 0.594808.
Next guess for x0 in direction -1 is 0.9438. Step size: -0.0106.
Optimization successful for x0=0.9438. Start fval 0.892165, end fval 0.892165.
Next guess for x0 in direction -1 is 0.9306. Step size: -0.0132.
Optimization successful for x0=0.9306. Start fval 1.337870, end fval 1.337870.
Next guess for x0 in direction -1 is 0.9142. Step size: -0.0164.
Optimization successful for x0=0.9142. Start fval 2.006274, end fval 2.006273.
Next guess for x0 in direction -1 is 0.8937. Step size: -0.0206.
Optimization successful for x0=0.8937. Start fval 3.008621, end fval 3.008620.
Next guess for x0 in direction -1 is 0.8677. Step size: -0.0259.
Optimization successful for x0=0.8677. Start fval 4.511700, end fval 4.511697.
Next guess for x0 in direction -1 is 0.8347. Step size: -0.0330.
Optimization successful for x0=0.8347. Start fval 6.765640, end fval 6.765632.
Next guess for x0 in direction -1 is 0.7920. Step size: -0.0426.
Optimization successful for x0=0.7920. Start fval 10.145850, end fval 10.145827.
Next guess for x0 in direction -1 is 0.7359. Step size: -0.0562.
Optimization successful for x0=0.7359. Start fval 15.216551, end fval 15.216483.
Next guess for x0 in direction -1 is 0.6594. Step size: -0.0764.
Optimization successful for x0=0.6594. Start fval 22.824022, end fval 22.823795.
Next guess for x0 in direction -1 is 0.5594. Step size: -0.1000.
Optimization successful for x0=0.5594. Start fval 33.140851, end fval 33.140180.
Next guess for x0 in direction -1 is 0.4594. Step size: -0.1000.
Optimization successful for x0=0.4594. Start fval 42.907315, end fval 42.906498.
Next guess for x0 in direction -1 is 0.3594. Step size: -0.1000.
Optimization successful for x0=0.3594. Start fval 51.325351, end fval 51.324669.
Next guess for x0 in direction -1 is 0.2594. Step size: -0.1000.
Optimization successful for x0=0.2594. Start fval 57.865527, end fval 57.865160.
Next guess for x0 in direction -1 is 0.1594. Step size: -0.1000.
Optimization successful for x0=0.1594. Start fval 62.274016, end fval 62.273758.
Next guess for x0 in direction -1 is 0.0594. Step size: -0.1000.
Optimization successful for x0=0.0594. Start fval 64.574694, end fval 64.568963.
Next guess for x0 in direction -1 is -0.0406. Step size: -0.1000.
Optimization successful for x0=-0.0406. Start fval 64.998257, end fval 64.943113.
Next guess for x0 in direction -1 is -0.1018. Step size: -0.0612.
Optimization successful for x0=-0.1018. Start fval 64.278273, end fval 64.251117.
Next guess for x0 in direction -1 is -0.1526. Step size: -0.0508.
Optimization successful for x0=-0.1526. Start fval 63.110589, end fval 63.107157.
Next guess for x0 in direction -1 is -0.2067. Step size: -0.0541.
Optimization successful for x0=-0.2067. Start fval 61.289678, end fval 61.288854.
Next guess for x0 in direction -1 is -0.2680. Step size: -0.0613.
Optimization successful for x0=-0.2680. Start fval 58.458484, end fval 58.458280.
Next guess for x0 in direction -1 is -0.3401. Step size: -0.0721.
Optimization successful for x0=-0.3401. Start fval 54.110079, end fval 54.110038.
Next guess for x0 in direction -1 is -0.4274. Step size: -0.0874.
Optimization successful for x0=-0.4274. Start fval 47.488175, end fval 47.487908.
Next guess for x0 in direction -1 is -0.5274. Step size: -0.1000.
Optimization successful for x0=-0.5274. Start fval 38.479847, end fval 38.478960.
Next guess for x0 in direction -1 is -0.6274. Step size: -0.1000.
Optimization successful for x0=-0.6274. Start fval 28.636923, end fval 28.635656.
Next guess for x0 in direction -1 is -0.7274. Step size: -0.1000.
Optimization successful for x0=-0.7274. Start fval 18.936603, end fval 18.935364.
Next guess for x0 in direction -1 is -0.8274. Step size: -0.1000.
Optimization successful for x0=-0.8274. Start fval 10.616394, end fval 10.615148.
Next guess for x0 in direction -1 is -0.9274. Step size: -0.1000.
Optimization successful for x0=-0.9274. Start fval 5.169777, end fval 5.168673.
Next guess for x0 in direction -1 is -1.0274. Step size: -0.1000.
Optimization successful for x0=-1.0274. Start fval 4.344490, end fval 4.343506.
Next guess for x0 in direction -1 is -1.0662. Step size: -0.0387.
Optimization successful for x0=-1.0662. Start fval 5.684664, end fval 5.684601.
Next guess for x0 in direction -1 is -1.1004. Step size: -0.0342.
Optimization successful for x0=-1.1004. Start fval 7.795629, end fval 7.795617.
Next guess for x0 in direction -1 is -1.1364. Step size: -0.0361.
Optimization successful for x0=-1.1364. Start fval 11.062264, end fval 11.062251.
Next guess for x0 in direction -1 is -1.1764. Step size: -0.0399.
Optimization successful for x0=-1.1764. Start fval 16.060584, end fval 16.060566.
Next guess for x0 in direction -1 is -1.2215. Step size: -0.0452.
Optimization successful for x0=-1.2215. Start fval 23.653544, end fval 23.653517.
Next guess for x0 in direction -1 is -1.2731. Step size: -0.0516.
Optimization successful for x0=-1.2731. Start fval 35.128631, end fval 35.128587.
Next guess for x0 in direction -1 is -1.3323. Step size: -0.0592.
Optimization successful for x0=-1.3323. Start fval 52.443069, end fval 52.442995.
Next guess for x0 in direction -1 is -1.4001. Step size: -0.0679.
Optimization successful for x0=-1.4001. Start fval 78.475427, end fval 78.475304.
Next guess for x0 in direction -1 is -1.4779. Step size: -0.0778.
Optimization successful for x0=-1.4779. Start fval 117.581784, end fval 117.581581.
Next guess for x0 in direction -1 is -1.5669. Step size: -0.0890.
Optimization successful for x0=-1.5669. Start fval 176.281368, end fval 176.281037.
Next guess for x0 in direction -1 is -1.6669. Step size: -0.1000.
Optimization successful for x0=-1.6669. Start fval 262.887353, end fval 262.886854.
Next guess for x0 in direction -1 is -1.7669. Step size: -0.1000.
Optimization successful for x0=-1.7669. Start fval 374.782877, end fval 374.782343.
Next guess for x0 in direction -1 is -1.8669. Step size: -0.1000.
Optimization successful for x0=-1.8669. Start fval 515.799420, end fval 515.798923.
Next guess for x0 in direction -1 is -1.9669. Step size: -0.1000.
Optimization successful for x0=-1.9669. Start fval 690.013693, end fval 690.013229.
Next guess for x0 in direction -1 is -2.0669. Step size: -0.1000.
Optimization successful for x0=-2.0669. Start fval 901.747187, end fval 901.746753.
Next guess for x0 in direction -1 is -2.1669. Step size: -0.1000.
Optimization successful for x0=-2.1669. Start fval 1155.565919, end fval 1155.565519.
Next guess for x0 in direction -1 is -2.2669. Step size: -0.1000.
Optimization successful for x0=-2.2669. Start fval 1456.280182, end fval 1456.279805.
Next guess for x0 in direction -1 is -2.3669. Step size: -0.1000.
Optimization successful for x0=-2.3669. Start fval 1808.944245, end fval 1808.943885.
Next guess for x0 in direction -1 is -2.4669. Step size: -0.1000.
Optimization successful for x0=-2.4669. Start fval 2218.856138, end fval 2218.855799.
Next guess for x0 in direction -1 is -2.5669. Step size: -0.1000.
Optimization successful for x0=-2.5669. Start fval 2691.557510, end fval 2691.557147.
Next guess for x0 in direction -1 is -2.6669. Step size: -0.1000.
Optimization successful for x0=-2.6669. Start fval 3232.833196, end fval 3232.832906.
Next guess for x0 in direction -1 is -2.7669. Step size: -0.1000.
Optimization successful for x0=-2.7669. Start fval 3848.711577, end fval 3848.711255.
Next guess for x0 in direction -1 is -2.8669. Step size: -0.1000.
Optimization successful for x0=-2.8669. Start fval 4545.463713, end fval 4545.463414.
Next guess for x0 in direction -1 is -2.9669. Step size: -0.1000.
Optimization successful for x0=-2.9669. Start fval 5329.603791, end fval 5329.603510.
Next guess for x0 in direction -1 is -3.0669. Step size: -0.1000.
Optimization successful for x0=-3.0669. Start fval 6207.888708, end fval 6207.888444.
Next guess for x0 in direction -1 is -3.1669. Step size: -0.1000.
Optimization successful for x0=-3.1669. Start fval 7187.318044, end fval 7187.317754.
Next guess for x0 in direction -1 is -3.2669. Step size: -0.1000.
Optimization successful for x0=-3.2669. Start fval 8275.133772, end fval 8275.133544.
Next guess for x0 in direction -1 is -3.3669. Step size: -0.1000.
Optimization successful for x0=-3.3669. Start fval 9478.820634, end fval 9478.820297.
Next guess for x0 in direction -1 is -3.4669. Step size: -0.1000.
Optimization successful for x0=-3.4669. Start fval 10806.105106, end fval 10806.104899.
Next guess for x0 in direction -1 is -3.5669. Step size: -0.1000.
Optimization successful for x0=-3.5669. Start fval 12264.956713, end fval 12264.956426.
Next guess for x0 in direction -1 is -3.6669. Step size: -0.1000.
Optimization successful for x0=-3.6669. Start fval 13863.586356, end fval 13863.586157.
Next guess for x0 in direction -1 is -3.7669. Step size: -0.1000.
Optimization successful for x0=-3.7669. Start fval 15610.447693, end fval 15610.447377.
Next guess for x0 in direction -1 is -3.8669. Step size: -0.1000.
Optimization successful for x0=-3.8669. Start fval 17514.235672, end fval 17514.235487.
Next guess for x0 in direction -1 is -3.9669. Step size: -0.1000.
Optimization successful for x0=-3.9669. Start fval 19583.887972, end fval 19583.887765.
Next guess for x0 in direction -1 is -4.0669. Step size: -0.1000.
Optimization successful for x0=-4.0669. Start fval 21828.583580, end fval 21828.583360.
Next guess for x0 in direction -1 is -4.1669. Step size: -0.1000.
Optimization successful for x0=-4.1669. Start fval 24257.743440, end fval 24257.743232.
Next guess for x0 in direction -1 is -4.2669. Step size: -0.1000.
Optimization successful for x0=-4.2669. Start fval 26881.030294, end fval 26881.030092.
Next guess for x0 in direction -1 is -4.3669. Step size: -0.1000.
Optimization successful for x0=-4.3669. Start fval 29708.348550, end fval 29708.348356.
Next guess for x0 in direction -1 is -4.4669. Step size: -0.1000.
Optimization successful for x0=-4.4669. Start fval 32749.844273, end fval 32749.844085.
Next guess for x0 in direction -1 is -4.5669. Step size: -0.1000.
Optimization successful for x0=-4.5669. Start fval 36015.905120, end fval 36015.904938.
Next guess for x0 in direction -1 is -4.6669. Step size: -0.1000.
Optimization successful for x0=-4.6669. Start fval 39517.160298, end fval 39517.160123.
Next guess for x0 in direction -1 is -4.7669. Step size: -0.1000.
Optimization successful for x0=-4.7669. Start fval 43264.480521, end fval 43264.480352.
Next guess for x0 in direction -1 is -4.8669. Step size: -0.1000.
Optimization successful for x0=-4.8669. Start fval 47268.977962, end fval 47268.977798.
Next guess for x0 in direction -1 is -4.9669. Step size: -0.1000.
Optimization successful for x0=-4.9669. Start fval 51542.006218, end fval 51542.006059.
Next guess for x0 in direction -1 is -5.0000. Step size: -0.0331.
Optimization successful for x0=-5.0000. Start fval 53019.631873, end fval 53018.240792.
Next guess for x0 in direction 1 is 1.0160. Step size: 0.0160.
Optimization successful for x0=1.0160. Start fval 0.104757, end fval 0.078894.
Next guess for x0 in direction 1 is 1.0196. Step size: 0.0036.
Optimization successful for x0=1.0196. Start fval 0.118292, end fval 0.118292.
Next guess for x0 in direction 1 is 1.0239. Step size: 0.0043.
Optimization successful for x0=1.0239. Start fval 0.177411, end fval 0.177411.
Next guess for x0 in direction 1 is 1.0292. Step size: 0.0053.
Optimization successful for x0=1.0292. Start fval 0.266072, end fval 0.266072.
Next guess for x0 in direction 1 is 1.0357. Step size: 0.0064.
Optimization successful for x0=1.0357. Start fval 0.399040, end fval 0.399039.
Next guess for x0 in direction 1 is 1.0435. Step size: 0.0078.
Optimization successful for x0=1.0435. Start fval 0.598451, end fval 0.598449.
Next guess for x0 in direction 1 is 1.0530. Step size: 0.0095.
Optimization successful for x0=1.0530. Start fval 0.897503, end fval 0.897503.
Next guess for x0 in direction 1 is 1.0645. Step size: 0.0115.
Optimization successful for x0=1.0645. Start fval 1.345979, end fval 1.345979.
Next guess for x0 in direction 1 is 1.0783. Step size: 0.0139.
Optimization successful for x0=1.0783. Start fval 2.018040, end fval 2.018040.
Next guess for x0 in direction 1 is 1.0951. Step size: 0.0167.
Optimization successful for x0=1.0951. Start fval 3.025813, end fval 3.025813.
Next guess for x0 in direction 1 is 1.1152. Step size: 0.0201.
Optimization successful for x0=1.1152. Start fval 4.537670, end fval 4.537669.
Next guess for x0 in direction 1 is 1.1392. Step size: 0.0241.
Optimization successful for x0=1.1392. Start fval 6.805804, end fval 6.805802.
Next guess for x0 in direction 1 is 1.1679. Step size: 0.0287.
Optimization successful for x0=1.1679. Start fval 10.204888, end fval 10.204884.
Next guess for x0 in direction 1 is 1.2020. Step size: 0.0341.
Optimization successful for x0=1.2020. Start fval 15.299574, end fval 15.299565.
Next guess for x0 in direction 1 is 1.2424. Step size: 0.0403.
Optimization successful for x0=1.2424. Start fval 22.939873, end fval 22.939857.
Next guess for x0 in direction 1 is 1.2899. Step size: 0.0475.
Optimization successful for x0=1.2899. Start fval 34.408825, end fval 34.408795.
Next guess for x0 in direction 1 is 1.3455. Step size: 0.0556.
Optimization successful for x0=1.3455. Start fval 51.590100, end fval 51.590044.
Next guess for x0 in direction 1 is 1.4103. Step size: 0.0648.
Optimization successful for x0=1.4103. Start fval 77.343268, end fval 77.343168.
Next guess for x0 in direction 1 is 1.4855. Step size: 0.0752.
Optimization successful for x0=1.4855. Start fval 116.003275, end fval 116.003102.
Next guess for x0 in direction 1 is 1.5721. Step size: 0.0866.
Optimization successful for x0=1.5721. Start fval 173.918630, end fval 173.918338.
Next guess for x0 in direction 1 is 1.6721. Step size: 0.1000.
Optimization successful for x0=1.6721. Start fval 261.345162, end fval 261.344675.
Next guess for x0 in direction 1 is 1.7721. Step size: 0.1000.
Optimization successful for x0=1.7721. Start fval 374.253764, end fval 374.253233.
Next guess for x0 in direction 1 is 1.8721. Step size: 0.1000.
Optimization successful for x0=1.8721. Start fval 516.488644, end fval 516.488148.
Next guess for x0 in direction 1 is 1.9721. Step size: 0.1000.
Optimization successful for x0=1.9721. Start fval 692.139218, end fval 692.138756.
Next guess for x0 in direction 1 is 2.0721. Step size: 0.1000.
Optimization successful for x0=2.0721. Start fval 905.539662, end fval 905.539230.
Next guess for x0 in direction 1 is 2.1721. Step size: 0.1000.
Optimization successful for x0=2.1721. Start fval 1161.268658, end fval 1161.268260.
Next guess for x0 in direction 1 is 2.2721. Step size: 0.1000.
Optimization successful for x0=2.2721. Start fval 1464.149151, end fval 1464.148776.
Next guess for x0 in direction 1 is 2.3721. Step size: 0.1000.
Optimization successful for x0=2.3721. Start fval 1819.248051, end fval 1819.247691.
Next guess for x0 in direction 1 is 2.4721. Step size: 0.1000.
Optimization successful for x0=2.4721. Start fval 2231.876015, end fval 2231.875677.
Next guess for x0 in direction 1 is 2.5721. Step size: 0.1000.
Optimization successful for x0=2.5721. Start fval 2707.587309, end fval 2707.586948.
Next guess for x0 in direction 1 is 2.6721. Step size: 0.1000.
Optimization successful for x0=2.6721. Start fval 3252.179382, end fval 3252.179093.
Next guess for x0 in direction 1 is 2.7721. Step size: 0.1000.
Optimization successful for x0=2.7721. Start fval 3871.693211, end fval 3871.692890.
Next guess for x0 in direction 1 is 2.8721. Step size: 0.1000.
Optimization successful for x0=2.8721. Start fval 4572.412452, end fval 4572.412153.
Next guess for x0 in direction 1 is 2.9721. Step size: 0.1000.
Optimization successful for x0=2.9721. Start fval 5360.863876, end fval 5360.863595.
Next guess for x0 in direction 1 is 3.0721. Step size: 0.1000.
Optimization successful for x0=3.0721. Start fval 6243.816960, end fval 6243.816697.
Next guess for x0 in direction 1 is 3.1721. Step size: 0.1000.
Optimization successful for x0=3.1721. Start fval 7228.283857, end fval 7228.283568.
Next guess for x0 in direction 1 is 3.2721. Step size: 0.1000.
Optimization successful for x0=3.2721. Start fval 8321.519109, end fval 8321.518881.
Next guess for x0 in direction 1 is 3.3721. Step size: 0.1000.
Optimization successful for x0=3.3721. Start fval 9531.020017, end fval 9531.019682.
Next guess for x0 in direction 1 is 3.4721. Step size: 0.1000.
Optimization successful for x0=3.4721. Start fval 10864.525620, end fval 10864.525413.
Next guess for x0 in direction 1 is 3.5721. Step size: 0.1000.
Optimization successful for x0=3.5721. Start fval 12330.017991, end fval 12330.017705.
Next guess for x0 in direction 1 is 3.6721. Step size: 0.1000.
Optimization successful for x0=3.6721. Start fval 13935.720582, end fval 13935.720383.
Next guess for x0 in direction 1 is 3.7721. Step size: 0.1000.
Optimization successful for x0=3.7721. Start fval 15690.099595, end fval 15690.099280.
Next guess for x0 in direction 1 is 3.8721. Step size: 0.1000.
Optimization successful for x0=3.8721. Start fval 17601.862521, end fval 17601.862338.
Next guess for x0 in direction 1 is 3.9721. Step size: 0.1000.
Optimization successful for x0=3.9721. Start fval 19679.959576, end fval 19679.959370.
Next guess for x0 in direction 1 is 4.0721. Step size: 0.1000.
Optimization successful for x0=4.0721. Start fval 21933.582281, end fval 21933.582062.
Next guess for x0 in direction 1 is 4.1721. Step size: 0.1000.
Optimization successful for x0=4.1721. Start fval 24372.164111, end fval 24372.163904.
Next guess for x0 in direction 1 is 4.2721. Step size: 0.1000.
Optimization successful for x0=4.2721. Start fval 27005.380337, end fval 27005.380136.
Next guess for x0 in direction 1 is 4.3721. Step size: 0.1000.
Optimization successful for x0=4.3721. Start fval 29843.147892, end fval 29843.147698.
Next guess for x0 in direction 1 is 4.4721. Step size: 0.1000.
Optimization successful for x0=4.4721. Start fval 32895.625364, end fval 32895.625176.
Next guess for x0 in direction 1 is 4.5721. Step size: 0.1000.
Optimization successful for x0=4.5721. Start fval 36173.212931, end fval 36173.212750.
Next guess for x0 in direction 1 is 4.6721. Step size: 0.1000.
Optimization successful for x0=4.6721. Start fval 39686.552318, end fval 39686.552144.
Next guess for x0 in direction 1 is 4.7721. Step size: 0.1000.
Optimization successful for x0=4.7721. Start fval 43446.526755, end fval 43446.526586.
Next guess for x0 in direction 1 is 4.8721. Step size: 0.1000.
Optimization successful for x0=4.8721. Start fval 47464.260928, end fval 47464.260765.
Next guess for x0 in direction 1 is 4.9721. Step size: 0.1000.
Optimization successful for x0=4.9721. Start fval 51751.120947, end fval 51751.120788.
Next guess for x0 in direction 1 is 5.0000. Step size: 0.0279.
Optimization successful for x0=5.0000. Start fval 52999.853188, end fval 52998.240265.
Next guess for x3 in direction -1 is 0.9855. Step size: -0.0145.
Optimization successful for x3=0.9855. Start fval 0.104276, end fval 0.062466.
Next guess for x3 in direction -1 is 0.9822. Step size: -0.0033.
Optimization successful for x3=0.9822. Start fval 0.093695, end fval 0.093695.
Next guess for x3 in direction -1 is 0.9781. Step size: -0.0041.
Optimization successful for x3=0.9781. Start fval 0.140528, end fval 0.140528.
Next guess for x3 in direction -1 is 0.9732. Step size: -0.0050.
Optimization successful for x3=0.9732. Start fval 0.210773, end fval 0.210773.
Next guess for x3 in direction -1 is 0.9670. Step size: -0.0061.
Optimization successful for x3=0.9670. Start fval 0.316132, end fval 0.316132.
Next guess for x3 in direction -1 is 0.9594. Step size: -0.0076.
Optimization successful for x3=0.9594. Start fval 0.474162, end fval 0.474162.
Next guess for x3 in direction -1 is 0.9500. Step size: -0.0094.
Optimization successful for x3=0.9500. Start fval 0.711199, end fval 0.711199.
Next guess for x3 in direction -1 is 0.9384. Step size: -0.0116.
Optimization successful for x3=0.9384. Start fval 1.066749, end fval 1.066748.
Next guess for x3 in direction -1 is 0.9239. Step size: -0.0145.
Optimization successful for x3=0.9239. Start fval 1.599608, end fval 1.599607.
Next guess for x3 in direction -1 is 0.9058. Step size: -0.0181.
Optimization successful for x3=0.9058. Start fval 2.398664, end fval 2.398660.
Next guess for x3 in direction -1 is 0.8830. Step size: -0.0227.
Optimization successful for x3=0.8830. Start fval 3.596968, end fval 3.596960.
Next guess for x3 in direction -1 is 0.8542. Step size: -0.0288.
Optimization successful for x3=0.8542. Start fval 5.394191, end fval 5.394168.
Next guess for x3 in direction -1 is 0.8174. Step size: -0.0369.
Optimization successful for x3=0.8174. Start fval 8.090153, end fval 8.090079.
Next guess for x3 in direction -1 is 0.7694. Step size: -0.0480.
Optimization successful for x3=0.7694. Start fval 12.134799, end fval 12.134595.
Next guess for x3 in direction -1 is 0.7055. Step size: -0.0639.
Optimization successful for x3=0.7055. Start fval 18.199476, end fval 18.198791.
Next guess for x3 in direction -1 is 0.6166. Step size: -0.0889.
Optimization successful for x3=0.6166. Start fval 27.297956, end fval 27.295193.
Next guess for x3 in direction -1 is 0.5166. Step size: -0.1000.
Optimization successful for x3=0.5166. Start fval 37.533446, end fval 37.527062.
Next guess for x3 in direction -1 is 0.4166. Step size: -0.1000.
Optimization successful for x3=0.4166. Start fval 46.859878, end fval 46.850579.
Next guess for x3 in direction -1 is 0.3166. Step size: -0.1000.
Optimization successful for x3=0.3166. Start fval 54.602560, end fval 54.588993.
Next guess for x3 in direction -1 is 0.2166. Step size: -0.1000.
Optimization successful for x3=0.2166. Start fval 60.365480, end fval 60.344613.
Next guess for x3 in direction -1 is 0.1166. Step size: -0.1000.
Optimization successful for x3=0.1166. Start fval 64.057359, end fval 64.021187.
Next guess for x3 in direction -1 is 0.0166. Step size: -0.1000.
Optimization successful for x3=0.0166. Start fval 65.954546, end fval 65.887193.
Next guess for x3 in direction -1 is -0.0834. Step size: -0.1000.
Optimization successful for x3=-0.0834. Start fval 66.859828, end fval 66.710031.
Next guess for x3 in direction -1 is -0.1834. Step size: -0.1000.
Optimization successful for x3=-0.1834. Start fval 67.524789, end fval 67.197833.
Next guess for x3 in direction -1 is -0.2834. Step size: -0.1000.
Optimization successful for x3=-0.2834. Start fval 67.589263, end fval 67.447060.
Next guess for x3 in direction -1 is -0.3834. Step size: -0.1000.
Optimization successful for x3=-0.3834. Start fval 67.576592, end fval 67.559020.
Next guess for x3 in direction -1 is -0.4750. Step size: -0.0916.
Optimization successful for x3=-0.4750. Start fval 67.831384, end fval 67.826156.
Next guess for x3 in direction -1 is -0.5374. Step size: -0.0624.
Optimization successful for x3=-0.5374. Start fval 68.330074, end fval 68.329219.
Next guess for x3 in direction -1 is -0.5937. Step size: -0.0563.
Optimization successful for x3=-0.5937. Start fval 69.186678, end fval 69.186279.
Next guess for x3 in direction -1 is -0.6491. Step size: -0.0554.
Optimization successful for x3=-0.6491. Start fval 70.573409, end fval 70.573231.
Next guess for x3 in direction -1 is -0.7059. Step size: -0.0569.
Optimization successful for x3=-0.7059. Start fval 72.755205, end fval 72.755029.
Next guess for x3 in direction -1 is -0.7658. Step size: -0.0599.
Optimization successful for x3=-0.7658. Start fval 76.132235, end fval 76.132040.
Next guess for x3 in direction -1 is -0.8298. Step size: -0.0639.
Optimization successful for x3=-0.8298. Start fval 81.291631, end fval 81.291373.
Next guess for x3 in direction -1 is -0.8988. Step size: -0.0690.
Optimization successful for x3=-0.8988. Start fval 89.120106, end fval 89.119810.
Next guess for x3 in direction -1 is -0.9740. Step size: -0.0752.
Optimization successful for x3=-0.9740. Start fval 100.963242, end fval 100.962778.
Next guess for x3 in direction -1 is -1.0561. Step size: -0.0822.
Optimization successful for x3=-1.0561. Start fval 118.793739, end fval 118.793316.
Next guess for x3 in direction -1 is -1.1464. Step size: -0.0903.
Optimization successful for x3=-1.1464. Start fval 145.619299, end fval 145.618721.
Next guess for x3 in direction -1 is -1.2464. Step size: -0.1000.
Optimization successful for x3=-1.2464. Start fval 186.179973, end fval 186.179193.
Next guess for x3 in direction -1 is -1.3464. Step size: -0.1000.
Optimization successful for x3=-1.3464. Start fval 240.612887, end fval 240.612095.
Next guess for x3 in direction -1 is -1.4464. Step size: -0.1000.
Optimization successful for x3=-1.4464. Start fval 311.713509, end fval 311.712780.
Next guess for x3 in direction -1 is -1.5464. Step size: -0.1000.
Optimization successful for x3=-1.5464. Start fval 402.524656, end fval 402.523969.
Next guess for x3 in direction -1 is -1.6464. Step size: -0.1000.
Optimization successful for x3=-1.6464. Start fval 516.335776, end fval 516.335147.
Next guess for x3 in direction -1 is -1.7464. Step size: -0.1000.
Optimization successful for x3=-1.7464. Start fval 656.682523, end fval 656.681946.
Next guess for x3 in direction -1 is -1.8464. Step size: -0.1000.
Optimization successful for x3=-1.8464. Start fval 827.346235, end fval 827.345703.
Next guess for x3 in direction -1 is -1.9464. Step size: -0.1000.
Optimization successful for x3=-1.9464. Start fval 1032.353536, end fval 1032.353033.
Next guess for x3 in direction -1 is -2.0464. Step size: -0.1000.
Optimization successful for x3=-2.0464. Start fval 1275.975935, end fval 1275.975465.
Next guess for x3 in direction -1 is -2.1464. Step size: -0.1000.
Optimization successful for x3=-2.1464. Start fval 1562.729547, end fval 1562.729107.
Next guess for x3 in direction -1 is -2.2464. Step size: -0.1000.
Optimization successful for x3=-2.2464. Start fval 1897.374789, end fval 1897.374361.
Next guess for x3 in direction -1 is -2.3464. Step size: -0.1000.
Optimization successful for x3=-2.3464. Start fval 2284.916065, end fval 2284.915665.
Next guess for x3 in direction -1 is -2.4464. Step size: -0.1000.
Optimization successful for x3=-2.4464. Start fval 2730.601639, end fval 2730.601263.
Next guess for x3 in direction -1 is -2.5464. Step size: -0.1000.
Optimization successful for x3=-2.5464. Start fval 3239.923399, end fval 3239.920426.
Next guess for x3 in direction -1 is -2.6464. Step size: -0.1000.
Optimization successful for x3=-2.6464. Start fval 3818.615360, end fval 3818.614816.
Next guess for x3 in direction -1 is -2.7464. Step size: -0.1000.
Optimization successful for x3=-2.7464. Start fval 4472.663577, end fval 4472.654973.
Next guess for x3 in direction -1 is -2.8464. Step size: -0.1000.
Optimization successful for x3=-2.8464. Start fval 5208.287968, end fval 5208.269902.
Next guess for x3 in direction -1 is -2.9464. Step size: -0.1000.
Optimization successful for x3=-2.9464. Start fval 6031.926607, end fval 6031.923332.
Next guess for x3 in direction -1 is -3.0464. Step size: -0.1000.
Optimization successful for x3=-3.0464. Start fval 6950.323610, end fval 6950.322259.
Next guess for x3 in direction -1 is -3.1464. Step size: -0.1000.
Optimization successful for x3=-3.1464. Start fval 7970.417666, end fval 7970.395219.
Next guess for x3 in direction -1 is -3.2464. Step size: -0.1000.
Optimization successful for x3=-3.2464. Start fval 9100.436050, end fval 9099.366265.
Next guess for x3 in direction -1 is -3.3464. Step size: -0.1000.
Optimization successful for x3=-3.3464. Start fval 10344.658643, end fval 10344.657269.
Next guess for x3 in direction -1 is -3.4464. Step size: -0.1000.
Optimization successful for x3=-3.4464. Start fval 11713.946798, end fval 11713.946587.
Next guess for x3 in direction -1 is -3.5464. Step size: -0.1000.
Optimization successful for x3=-3.5464. Start fval 13215.154044, end fval 13215.152734.
Next guess for x3 in direction -1 is -3.6464. Step size: -0.1000.
Optimization successful for x3=-3.6464. Start fval 14856.438658, end fval 14856.438471.
Next guess for x3 in direction -1 is -3.7464. Step size: -0.1000.
Optimization successful for x3=-3.7464. Start fval 16646.207876, end fval 16646.206615.
Next guess for x3 in direction -1 is -3.8464. Step size: -0.1000.
Optimization successful for x3=-3.8464. Start fval 18593.104234, end fval 18593.104050.
Next guess for x3 in direction -1 is -3.9464. Step size: -0.1000.
Optimization successful for x3=-3.9464. Start fval 20706.018805, end fval 20706.017522.
Next guess for x3 in direction -1 is -4.0464. Step size: -0.1000.
Optimization successful for x3=-4.0464. Start fval 22994.077992, end fval 22994.077823.
Next guess for x3 in direction -1 is -4.1464. Step size: -0.1000.
Optimization successful for x3=-4.1464. Start fval 25466.656683, end fval 25466.655304.
Next guess for x3 in direction -1 is -4.2464. Step size: -0.1000.
Optimization successful for x3=-4.2464. Start fval 28133.364748, end fval 28133.364543.
Next guess for x3 in direction -1 is -4.3464. Step size: -0.1000.
Optimization successful for x3=-4.3464. Start fval 31004.060721, end fval 31004.060484.
Next guess for x3 in direction -1 is -4.4464. Step size: -0.1000.
Optimization successful for x3=-4.4464. Start fval 34088.839927, end fval 34088.836719.
Next guess for x3 in direction -1 is -4.5464. Step size: -0.1000.
Optimization successful for x3=-4.5464. Start fval 37398.037506, end fval 37398.035173.
Next guess for x3 in direction -1 is -4.6464. Step size: -0.1000.
Optimization successful for x3=-4.6464. Start fval 40942.234708, end fval 40942.234499.
Next guess for x3 in direction -1 is -4.7464. Step size: -0.1000.
Optimization successful for x3=-4.7464. Start fval 44732.256162, end fval 44732.255961.
Next guess for x3 in direction -1 is -4.8464. Step size: -0.1000.
Optimization successful for x3=-4.8464. Start fval 48779.162522, end fval 48779.162329.
Next guess for x3 in direction -1 is -4.9464. Step size: -0.1000.
Optimization successful for x3=-4.9464. Start fval 53094.257998, end fval 53094.257812.
Next guess for x3 in direction -1 is -5.0000. Step size: -0.0536.
Optimization successful for x3=-5.0000. Start fval 55520.770217, end fval 55520.095768.
Next guess for x3 in direction 1 is 1.0143. Step size: 0.0143.
Optimization successful for x3=1.0143. Start fval 0.104134, end fval 0.062988.
Next guess for x3 in direction 1 is 1.0175. Step size: 0.0032.
Optimization successful for x3=1.0175. Start fval 0.094466, end fval 0.094466.
Next guess for x3 in direction 1 is 1.0214. Step size: 0.0039.
Optimization successful for x3=1.0214. Start fval 0.141677, end fval 0.141677.
Next guess for x3 in direction 1 is 1.0262. Step size: 0.0047.
Optimization successful for x3=1.0262. Start fval 0.212482, end fval 0.212482.
Next guess for x3 in direction 1 is 1.0319. Step size: 0.0058.
Optimization successful for x3=1.0319. Start fval 0.318669, end fval 0.318669.
Next guess for x3 in direction 1 is 1.0389. Step size: 0.0070.
Optimization successful for x3=1.0389. Start fval 0.477920, end fval 0.477920.
Next guess for x3 in direction 1 is 1.0475. Step size: 0.0085.
Optimization successful for x3=1.0475. Start fval 0.716747, end fval 0.716747.
Next guess for x3 in direction 1 is 1.0578. Step size: 0.0103.
Optimization successful for x3=1.0578. Start fval 1.074909, end fval 1.074909.
Next guess for x3 in direction 1 is 1.0703. Step size: 0.0125.
Optimization successful for x3=1.0703. Start fval 1.612357, end fval 1.612357.
Next guess for x3 in direction 1 is 1.0854. Step size: 0.0151.
Optimization successful for x3=1.0854. Start fval 2.417987, end fval 2.417985.
Next guess for x3 in direction 1 is 1.1035. Step size: 0.0181.
Optimization successful for x3=1.1035. Start fval 3.625532, end fval 3.625529.
Next guess for x3 in direction 1 is 1.1253. Step size: 0.0218.
Optimization successful for x3=1.1253. Start fval 5.435687, end fval 5.435681.
Next guess for x3 in direction 1 is 1.1513. Step size: 0.0260.
Optimization successful for x3=1.1513. Start fval 8.150093, end fval 8.150081.
Next guess for x3 in direction 1 is 1.1824. Step size: 0.0310.
Optimization successful for x3=1.1824. Start fval 12.223277, end fval 12.223255.
Next guess for x3 in direction 1 is 1.2191. Step size: 0.0368.
Optimization successful for x3=1.2191. Start fval 18.330132, end fval 18.330090.
Next guess for x3 in direction 1 is 1.2625. Step size: 0.0434.
Optimization successful for x3=1.2625. Start fval 27.481306, end fval 27.481227.
Next guess for x3 in direction 1 is 1.3135. Step size: 0.0510.
Optimization successful for x3=1.3135. Start fval 41.202354, end fval 41.202213.
Next guess for x3 in direction 1 is 1.3731. Step size: 0.0596.
Optimization successful for x3=1.3731. Start fval 61.803088, end fval 61.802755.
Next guess for x3 in direction 1 is 1.4424. Step size: 0.0692.
Optimization successful for x3=1.4424. Start fval 92.659667, end fval 92.659253.
Next guess for x3 in direction 1 is 1.5224. Step size: 0.0801.
Optimization successful for x3=1.5224. Start fval 138.915279, end fval 138.914379.
Next guess for x3 in direction 1 is 1.6147. Step size: 0.0922.
Optimization successful for x3=1.6147. Start fval 208.353216, end fval 208.352027.
Next guess for x3 in direction 1 is 1.7147. Step size: 0.1000.
Optimization successful for x3=1.7147. Start fval 306.202573, end fval 306.200665.
Next guess for x3 in direction 1 is 1.8147. Step size: 0.1000.
Optimization successful for x3=1.8147. Start fval 431.142660, end fval 431.141205.
Next guess for x3 in direction 1 is 1.9147. Step size: 0.1000.
Optimization successful for x3=1.9147. Start fval 587.123328, end fval 587.122033.
Next guess for x3 in direction 1 is 2.0147. Step size: 0.1000.
Optimization successful for x3=2.0147. Start fval 778.337773, end fval 778.336606.
Next guess for x3 in direction 1 is 2.1147. Step size: 0.1000.
Optimization successful for x3=2.1147. Start fval 1009.224175, end fval 1009.223103.
Next guess for x3 in direction 1 is 2.2147. Step size: 0.1000.
Optimization successful for x3=2.2147. Start fval 1284.465104, end fval 1284.464120.
Next guess for x3 in direction 1 is 2.3147. Step size: 0.1000.
Optimization successful for x3=2.3147. Start fval 1608.987303, end fval 1608.986396.
Next guess for x3 in direction 1 is 2.4147. Step size: 0.1000.
Optimization successful for x3=2.4147. Start fval 1987.961410, end fval 1987.960573.
Next guess for x3 in direction 1 is 2.5147. Step size: 0.1000.
Optimization successful for x3=2.5147. Start fval 2426.801785, end fval 2426.800969.
Next guess for x3 in direction 1 is 2.6147. Step size: 0.1000.
Optimization successful for x3=2.6147. Start fval 2931.166107, end fval 2931.165384.
Next guess for x3 in direction 1 is 2.7147. Step size: 0.1000.
Optimization successful for x3=2.7147. Start fval 3506.955625, end fval 3506.954921.
Next guess for x3 in direction 1 is 2.8147. Step size: 0.1000.
Optimization successful for x3=2.8147. Start fval 4160.314453, end fval 4160.313813.
Next guess for x3 in direction 1 is 2.9147. Step size: 0.1000.
Optimization successful for x3=2.9147. Start fval 4897.629881, end fval 4897.629283.
Next guess for x3 in direction 1 is 3.0147. Step size: 0.1000.
Optimization successful for x3=3.0147. Start fval 5725.532026, end fval 5725.531386.
Next guess for x3 in direction 1 is 3.1147. Step size: 0.1000.
Optimization successful for x3=3.1147. Start fval 6650.893425, end fval 6650.892912.
Next guess for x3 in direction 1 is 3.2147. Step size: 0.1000.
Optimization successful for x3=3.2147. Start fval 7680.829798, end fval 7680.829237.
Next guess for x3 in direction 1 is 3.3147. Step size: 0.1000.
Optimization successful for x3=3.3147. Start fval 8822.698743, end fval 8822.698232.
Next guess for x3 in direction 1 is 3.4147. Step size: 0.1000.
Optimization successful for x3=3.4147. Start fval 10084.100635, end fval 10084.100166.
Next guess for x3 in direction 1 is 3.5147. Step size: 0.1000.
Optimization successful for x3=3.5147. Start fval 11472.878101, end fval 11472.877566.
Next guess for x3 in direction 1 is 3.6147. Step size: 0.1000.
Optimization successful for x3=3.6147. Start fval 12997.115631, end fval 12997.115222.
Next guess for x3 in direction 1 is 3.7147. Step size: 0.1000.
Optimization successful for x3=3.7147. Start fval 14665.140472, end fval 14665.139998.
Next guess for x3 in direction 1 is 3.8147. Step size: 0.1000.
Optimization successful for x3=3.8147. Start fval 16485.521217, end fval 16485.520856.
Next guess for x3 in direction 1 is 3.9147. Step size: 0.1000.
Optimization successful for x3=3.9147. Start fval 18467.069194, end fval 18467.068670.
Next guess for x3 in direction 1 is 4.0147. Step size: 0.1000.
Optimization successful for x3=4.0147. Start fval 20618.836643, end fval 20618.836298.
Next guess for x3 in direction 1 is 4.1147. Step size: 0.1000.
Optimization successful for x3=4.1147. Start fval 22950.118861, end fval 22950.118328.
Next guess for x3 in direction 1 is 4.2147. Step size: 0.1000.
Optimization successful for x3=4.2147. Start fval 25470.451591, end fval 25470.451275.
Next guess for x3 in direction 1 is 4.3147. Step size: 0.1000.
Optimization successful for x3=4.3147. Start fval 28189.613723, end fval 28189.613264.
Next guess for x3 in direction 1 is 4.4147. Step size: 0.1000.
Optimization successful for x3=4.4147. Start fval 31117.624472, end fval 31117.624181.
Next guess for x3 in direction 1 is 4.5147. Step size: 0.1000.
Optimization successful for x3=4.5147. Start fval 34264.745882, end fval 34264.745476.
Next guess for x3 in direction 1 is 4.6147. Step size: 0.1000.
Optimization successful for x3=4.6147. Start fval 37641.480488, end fval 37641.480188.
Next guess for x3 in direction 1 is 4.7147. Step size: 0.1000.
Optimization successful for x3=4.7147. Start fval 41258.573226, end fval 41258.572859.
Next guess for x3 in direction 1 is 4.8147. Step size: 0.1000.
Optimization successful for x3=4.8147. Start fval 45127.009839, end fval 45127.009573.
Next guess for x3 in direction 1 is 4.9147. Step size: 0.1000.
Optimization successful for x3=4.9147. Start fval 49258.018165, end fval 49258.017811.
Next guess for x3 in direction 1 is 5.0000. Step size: 0.0853.
Optimization successful for x3=5.0000. Start fval 52999.935680, end fval 52999.839709.
Next guess for x0 in direction -1 is -1.0095. Step size: -0.0162.
Optimization successful for x0=-1.0095. Start fval 4.091226, end fval 4.065046.
Next guess for x0 in direction -1 is -1.0247. Step size: -0.0152.
Optimization successful for x0=-1.0247. Start fval 4.287694, end fval 4.287694.
Next guess for x0 in direction -1 is -1.0420. Step size: -0.0173.
Optimization successful for x0=-1.0420. Start fval 4.725729, end fval 4.725728.
Next guess for x0 in direction -1 is -1.0620. Step size: -0.0199.
Optimization successful for x0=-1.0620. Start fval 5.487467, end fval 5.487462.
Next guess for x0 in direction -1 is -1.0850. Step size: -0.0231.
Optimization successful for x0=-1.0850. Start fval 6.733542, end fval 6.733540.
Next guess for x0 in direction -1 is -1.1117. Step size: -0.0267.
Optimization successful for x0=-1.1117. Start fval 8.704287, end fval 8.704271.
Next guess for x0 in direction -1 is -1.1429. Step size: -0.0311.
Optimization successful for x0=-1.1429. Start fval 11.763791, end fval 11.763785.
Next guess for x0 in direction -1 is -1.1791. Step size: -0.0362.
Optimization successful for x0=-1.1791. Start fval 16.452848, end fval 16.452836.
Next guess for x0 in direction -1 is -1.2212. Step size: -0.0421.
Optimization successful for x0=-1.2212. Start fval 23.579418, end fval 23.579356.
Next guess for x0 in direction -1 is -1.2701. Step size: -0.0489.
Optimization successful for x0=-1.2701. Start fval 34.366185, end fval 34.366148.
Next guess for x0 in direction -1 is -1.3268. Step size: -0.0567.
Optimization successful for x0=-1.3268. Start fval 50.633356, end fval 50.633192.
Next guess for x0 in direction -1 is -1.3923. Step size: -0.0655.
Optimization successful for x0=-1.3923. Start fval 75.096513, end fval 75.096407.
Next guess for x0 in direction -1 is -1.4678. Step size: -0.0755.
Optimization successful for x0=-1.4678. Start fval 111.880214, end fval 111.879904.
Next guess for x0 in direction -1 is -1.5544. Step size: -0.0866.
Optimization successful for x0=-1.5544. Start fval 167.076961, end fval 167.076661.
Next guess for x0 in direction -1 is -1.6544. Step size: -0.1000.
Optimization successful for x0=-1.6544. Start fval 250.786808, end fval 250.786313.
Next guess for x0 in direction -1 is -1.7544. Step size: -0.1000.
Optimization successful for x0=-1.7544. Start fval 359.325843, end fval 359.324902.
Next guess for x0 in direction -1 is -1.8544. Step size: -0.1000.
Optimization successful for x0=-1.8544. Start fval 496.494403, end fval 496.493897.
Next guess for x0 in direction -1 is -1.9544. Step size: -0.1000.
Optimization successful for x0=-1.9544. Start fval 666.339857, end fval 666.338702.
Next guess for x0 in direction -1 is -2.0544. Step size: -0.1000.
Optimization successful for x0=-2.0544. Start fval 873.151437, end fval 873.150979.
Next guess for x0 in direction -1 is -2.1544. Step size: -0.1000.
Optimization successful for x0=-2.1544. Start fval 1121.466698, end fval 1121.466274.
Next guess for x0 in direction -1 is -2.2544. Step size: -0.1000.
Optimization successful for x0=-2.2544. Start fval 1416.064806, end fval 1416.062950.
Next guess for x0 in direction -1 is -2.3544. Step size: -0.1000.
Optimization successful for x0=-2.3544. Start fval 1761.967827, end fval 1761.967365.
Next guess for x0 in direction -1 is -2.4544. Step size: -0.1000.
Optimization successful for x0=-2.4544. Start fval 2164.447652, end fval 2164.444500.
Next guess for x0 in direction -1 is -2.5544. Step size: -0.1000.
Optimization successful for x0=-2.5544. Start fval 2629.008696, end fval 2629.008201.
Next guess for x0 in direction -1 is -2.6544. Step size: -0.1000.
Optimization successful for x0=-2.6544. Start fval 3161.413490, end fval 3161.413042.
Next guess for x0 in direction -1 is -2.7544. Step size: -0.1000.
Optimization successful for x0=-2.7544. Start fval 3767.657182, end fval 3767.651605.
Next guess for x0 in direction -1 is -2.8544. Step size: -0.1000.
Optimization successful for x0=-2.8544. Start fval 4453.975080, end fval 4453.973636.
Next guess for x0 in direction -1 is -2.9544. Step size: -0.1000.
Optimization successful for x0=-2.9544. Start fval 5226.864855, end fval 5226.853557.
Next guess for x0 in direction -1 is -3.0544. Step size: -0.1000.
Optimization successful for x0=-3.0544. Start fval 6093.028865, end fval 6093.027235.
Next guess for x0 in direction -1 is -3.1544. Step size: -0.1000.
Optimization successful for x0=-3.1544. Start fval 7059.465044, end fval 7059.455176.
Next guess for x0 in direction -1 is -3.2544. Step size: -0.1000.
Optimization successful for x0=-3.2544. Start fval 8133.359106, end fval 8133.357925.
Next guess for x0 in direction -1 is -3.3544. Step size: -0.1000.
Optimization successful for x0=-3.3544. Start fval 9322.191444, end fval 9322.180899.
Next guess for x0 in direction -1 is -3.4544. Step size: -0.1000.
Optimization successful for x0=-3.4544. Start fval 10633.630804, end fval 10633.629429.
Next guess for x0 in direction -1 is -3.5544. Step size: -0.1000.
Optimization successful for x0=-3.5544. Start fval 12075.643332, end fval 12075.641999.
Next guess for x0 in direction -1 is -3.6544. Step size: -0.1000.
Optimization successful for x0=-3.6544. Start fval 13656.400370, end fval 13656.382434.
Next guess for x0 in direction -1 is -3.7544. Step size: -0.1000.
Optimization successful for x0=-3.7544. Start fval 15384.543609, end fval 15384.300171.
Next guess for x0 in direction -1 is -3.8544. Step size: -0.1000.
Optimization successful for x0=-3.8544. Start fval 17268.079010, end fval 17268.037410.
Next guess for x0 in direction -1 is -3.9544. Step size: -0.1000.
Optimization successful for x0=-3.9544. Start fval 19316.620006, end fval 19316.519751.
Next guess for x0 in direction -1 is -4.0544. Step size: -0.1000.
Optimization successful for x0=-4.0544. Start fval 21538.910139, end fval 21538.893167.
Next guess for x0 in direction -1 is -4.1544. Step size: -0.1000.
Optimization successful for x0=-4.1544. Start fval 23944.551539, end fval 23944.547639.
Next guess for x0 in direction -1 is -4.2544. Step size: -0.1000.
Optimization successful for x0=-4.2544. Start fval 26543.117683, end fval 26543.073885.
Next guess for x0 in direction -1 is -4.3544. Step size: -0.1000.
Optimization successful for x0=-4.3544. Start fval 29345.487818, end fval 29344.415278.
Next guess for x0 in direction -1 is -4.4544. Step size: -0.1000.
Optimization successful for x0=-4.4544. Start fval 32358.780757, end fval 32358.641873.
Next guess for x0 in direction -1 is -4.5544. Step size: -0.1000.
Optimization successful for x0=-4.5544. Start fval 35596.419549, end fval 35596.135786.
Next guess for x0 in direction -1 is -4.6544. Step size: -0.1000.
Optimization successful for x0=-4.6544. Start fval 39067.524302, end fval 39067.491253.
Next guess for x0 in direction -1 is -4.7544. Step size: -0.1000.
Optimization successful for x0=-4.7544. Start fval 42783.554290, end fval 42783.547756.
Next guess for x0 in direction -1 is -4.8544. Step size: -0.1000.
Optimization successful for x0=-4.8544. Start fval 46755.389637, end fval 46755.386727.
Next guess for x0 in direction -1 is -4.9544. Step size: -0.1000.
Optimization successful for x0=-4.9544. Start fval 50994.332547, end fval 50994.331443.
Next guess for x0 in direction -1 is -5.0000. Step size: -0.0456.
Optimization successful for x0=-5.0000. Start fval 53019.250902, end fval 53018.238191.
Next guess for x0 in direction 1 is -0.9769. Step size: 0.0164.
Optimization successful for x0=-0.9769. Start fval 4.091058, end fval 4.064563.
Next guess for x0 in direction 1 is -0.9608. Step size: 0.0161.
Optimization successful for x0=-0.9608. Start fval 4.286412, end fval 4.286412.
Next guess for x0 in direction 1 is -0.9417. Step size: 0.0191.
Optimization successful for x0=-0.9417. Start fval 4.724152, end fval 4.724151.
Next guess for x0 in direction 1 is -0.9187. Step size: 0.0230.
Optimization successful for x0=-0.9187. Start fval 5.485010, end fval 5.485002.
Next guess for x0 in direction 1 is -0.8907. Step size: 0.0280.
Optimization successful for x0=-0.8907. Start fval 6.729873, end fval 6.729868.
Next guess for x0 in direction 1 is -0.8559. Step size: 0.0348.
Optimization successful for x0=-0.8559. Start fval 8.700141, end fval 8.700113.
Next guess for x0 in direction 1 is -0.8119. Step size: 0.0440.
Optimization successful for x0=-0.8119. Start fval 11.758015, end fval 11.757989.
Next guess for x0 in direction 1 is -0.7550. Step size: 0.0570.
Optimization successful for x0=-0.7550. Start fval 16.447979, end fval 16.447875.
Next guess for x0 in direction 1 is -0.6786. Step size: 0.0764.
Optimization successful for x0=-0.6786. Start fval 23.587007, end fval 23.586779.
Next guess for x0 in direction 1 is -0.5786. Step size: 0.1000.
Optimization successful for x0=-0.5786. Start fval 33.496223, end fval 33.495504.
Next guess for x0 in direction 1 is -0.4786. Step size: 0.1000.
Optimization successful for x0=-0.4786. Start fval 43.037676, end fval 43.036846.
Next guess for x0 in direction 1 is -0.3786. Step size: 0.1000.
Optimization successful for x0=-0.3786. Start fval 51.362809, end fval 51.362090.
Next guess for x0 in direction 1 is -0.2786. Step size: 0.1000.
Optimization successful for x0=-0.2786. Start fval 57.890278, end fval 57.889717.
Next guess for x0 in direction 1 is -0.1786. Step size: 0.1000.
Optimization successful for x0=-0.1786. Start fval 62.312805, end fval 62.312654.
Next guess for x0 in direction 1 is -0.0786. Step size: 0.1000.
Optimization successful for x0=-0.0786. Start fval 64.602625, end fval 64.599129.
Next guess for x0 in direction 1 is 0.0214. Step size: 0.1000.
Optimization successful for x0=0.0214. Start fval 64.967118, end fval 64.927888.
Next guess for x0 in direction 1 is 0.0770. Step size: 0.0555.
Optimization successful for x0=0.0770. Start fval 64.331973, end fval 64.311007.
Next guess for x0 in direction 1 is 0.1257. Step size: 0.0487.
Optimization successful for x0=0.1257. Start fval 63.281402, end fval 63.277087.
Next guess for x0 in direction 1 is 0.1779. Step size: 0.0522.
Optimization successful for x0=0.1779. Start fval 61.624416, end fval 61.622928.
Next guess for x0 in direction 1 is 0.2371. Step size: 0.0592.
Optimization successful for x0=0.2371. Start fval 59.036785, end fval 59.036291.
Next guess for x0 in direction 1 is 0.3063. Step size: 0.0692.
Optimization successful for x0=0.3063. Start fval 55.056269, end fval 55.056178.
Next guess for x0 in direction 1 is 0.3893. Step size: 0.0830.
Optimization successful for x0=0.3893. Start fval 48.988248, end fval 48.988064.
Next guess for x0 in direction 1 is 0.4893. Step size: 0.1000.
Optimization successful for x0=0.4893. Start fval 40.100195, end fval 40.099442.
Next guess for x0 in direction 1 is 0.5893. Step size: 0.1000.
Optimization successful for x0=0.5893. Start fval 30.074399, end fval 30.073222.
Next guess for x0 in direction 1 is 0.6893. Step size: 0.1000.
Optimization successful for x0=0.6893. Start fval 19.787767, end fval 19.786509.
Next guess for x0 in direction 1 is 0.7893. Step size: 0.1000.
Optimization successful for x0=0.7893. Start fval 10.379042, end fval 10.377833.
Next guess for x0 in direction 1 is 0.8574. Step size: 0.0681.
Optimization successful for x0=0.8574. Start fval 5.179808, end fval 5.179444.
Next guess for x0 in direction 1 is 0.9019. Step size: 0.0445.
Optimization successful for x0=0.9019. Start fval 2.585595, end fval 2.585532.
Next guess for x0 in direction 1 is 0.9319. Step size: 0.0300.
Optimization successful for x0=0.9319. Start fval 1.292063, end fval 1.292048.
Next guess for x0 in direction 1 is 0.9524. Step size: 0.0206.
Optimization successful for x0=0.9524. Start fval 0.645010, end fval 0.645006.
Next guess for x0 in direction 1 is 0.9667. Step size: 0.0142.
Optimization successful for x0=0.9667. Start fval 0.321858, end fval 0.321857.
Next guess for x0 in direction 1 is 0.9766. Step size: 0.0099.
Optimization successful for x0=0.9766. Start fval 0.160874, end fval 0.160874.
Next guess for x0 in direction 1 is 0.9835. Step size: 0.0069.
Optimization successful for x0=0.9835. Start fval 0.080268, end fval 0.080268.
Next guess for x0 in direction 1 is 0.9884. Step size: 0.0049.
Optimization successful for x0=0.9884. Start fval 0.040049, end fval 0.040049.
Next guess for x0 in direction 1 is 0.9918. Step size: 0.0034.
Optimization successful for x0=0.9918. Start fval 0.019982, end fval 0.019982.
Next guess for x0 in direction 1 is 0.9942. Step size: 0.0024.
Optimization successful for x0=0.9942. Start fval 0.009970, end fval 0.009970.
Next guess for x0 in direction 1 is 0.9959. Step size: 0.0017.
Optimization successful for x0=0.9959. Start fval 0.004974, end fval 0.004974.
Next guess for x0 in direction 1 is 0.9971. Step size: 0.0012.
Optimization successful for x0=0.9971. Start fval 0.002482, end fval 0.002482.
Next guess for x0 in direction 1 is 0.9981. Step size: 0.0010.
Optimization successful for x0=0.9981. Start fval 0.001057, end fval 0.001057.
Next guess for x0 in direction 1 is 0.9991. Step size: 0.0010.
Optimization successful for x0=0.9991. Start fval 0.000230, end fval 0.000230.
Next guess for x0 in direction 1 is 1.0001. Step size: 0.0010.
Optimization successful for x0=1.0001. Start fval 0.000005, end fval 0.000005.
Next guess for x0 in direction 1 is 1.0011. Step size: 0.0010.
Optimization successful for x0=1.0011. Start fval 0.000382, end fval 0.000382.
Next guess for x0 in direction 1 is 1.0021. Step size: 0.0010.
Optimization successful for x0=1.0021. Start fval 0.001365, end fval 0.001365.
Next guess for x0 in direction 1 is 1.0031. Step size: 0.0010.
Optimization successful for x0=1.0031. Start fval 0.002954, end fval 0.002954.
Next guess for x0 in direction 1 is 1.0041. Step size: 0.0010.
Optimization successful for x0=1.0041. Start fval 0.005153, end fval 0.005153.
Next guess for x0 in direction 1 is 1.0051. Step size: 0.0010.
Optimization successful for x0=1.0051. Start fval 0.007962, end fval 0.007962.
Next guess for x0 in direction 1 is 1.0063. Step size: 0.0011.
Optimization successful for x0=1.0063. Start fval 0.011939, end fval 0.011939.
Next guess for x0 in direction 1 is 1.0077. Step size: 0.0014.
Optimization successful for x0=1.0077. Start fval 0.017906, end fval 0.017906.
Next guess for x0 in direction 1 is 1.0094. Step size: 0.0017.
Optimization successful for x0=1.0094. Start fval 0.026855, end fval 0.026855.
Next guess for x0 in direction 1 is 1.0115. Step size: 0.0021.
Optimization successful for x0=1.0115. Start fval 0.040276, end fval 0.040276.
Next guess for x0 in direction 1 is 1.0140. Step size: 0.0026.
Optimization successful for x0=1.0140. Start fval 0.060405, end fval 0.060405.
Next guess for x0 in direction 1 is 1.0172. Step size: 0.0031.
Optimization successful for x0=1.0172. Start fval 0.090595, end fval 0.090595.
Next guess for x0 in direction 1 is 1.0210. Step size: 0.0038.
Optimization successful for x0=1.0210. Start fval 0.135871, end fval 0.135871.
Next guess for x0 in direction 1 is 1.0256. Step size: 0.0046.
Optimization successful for x0=1.0256. Start fval 0.203774, end fval 0.203774.
Next guess for x0 in direction 1 is 1.0313. Step size: 0.0057.
Optimization successful for x0=1.0313. Start fval 0.305611, end fval 0.305611.
Next guess for x0 in direction 1 is 1.0382. Step size: 0.0069.
Optimization successful for x0=1.0382. Start fval 0.458336, end fval 0.458336.
Next guess for x0 in direction 1 is 1.0465. Step size: 0.0084.
Optimization successful for x0=1.0465. Start fval 0.687378, end fval 0.687378.
Next guess for x0 in direction 1 is 1.0567. Step size: 0.0101.
Optimization successful for x0=1.0567. Start fval 1.030866, end fval 1.030866.
Next guess for x0 in direction 1 is 1.0689. Step size: 0.0123.
Optimization successful for x0=1.0689. Start fval 1.546098, end fval 1.546098.
Next guess for x0 in direction 1 is 1.0837. Step size: 0.0148.
Optimization successful for x0=1.0837. Start fval 2.318402, end fval 2.318402.
Next guess for x0 in direction 1 is 1.1015. Step size: 0.0178.
Optimization successful for x0=1.1015. Start fval 3.476053, end fval 3.476053.
Next guess for x0 in direction 1 is 1.1229. Step size: 0.0214.
Optimization successful for x0=1.1229. Start fval 5.211629, end fval 5.211627.
Next guess for x0 in direction 1 is 1.1485. Step size: 0.0256.
Optimization successful for x0=1.1485. Start fval 7.814760, end fval 7.814757.
Next guess for x0 in direction 1 is 1.1790. Step size: 0.0305.
Optimization successful for x0=1.1790. Start fval 11.722051, end fval 11.722046.
Next guess for x0 in direction 1 is 1.2151. Step size: 0.0361.
Optimization successful for x0=1.2151. Start fval 17.576869, end fval 17.576859.
Next guess for x0 in direction 1 is 1.2578. Step size: 0.0427.
Optimization successful for x0=1.2578. Start fval 26.351500, end fval 26.351480.
Next guess for x0 in direction 1 is 1.3079. Step size: 0.0501.
Optimization successful for x0=1.3079. Start fval 39.511371, end fval 39.511333.
Next guess for x0 in direction 1 is 1.3666. Step size: 0.0587.
Optimization successful for x0=1.3666. Start fval 59.259237, end fval 59.259169.
Next guess for x0 in direction 1 is 1.4348. Step size: 0.0682.
Optimization successful for x0=1.4348. Start fval 88.841822, end fval 88.841702.
Next guess for x0 in direction 1 is 1.5137. Step size: 0.0789.
Optimization successful for x0=1.5137. Start fval 133.200047, end fval 133.199840.
Next guess for x0 in direction 1 is 1.6046. Step size: 0.0909.
Optimization successful for x0=1.6046. Start fval 199.757977, end fval 199.757628.
Next guess for x0 in direction 1 is 1.7046. Step size: 0.1000.
Optimization successful for x0=1.7046. Start fval 295.058202, end fval 295.057706.
Next guess for x0 in direction 1 is 1.8046. Step size: 0.1000.
Optimization successful for x0=1.8046. Start fval 417.062744, end fval 417.062222.
Next guess for x0 in direction 1 is 1.9046. Step size: 0.1000.
Optimization successful for x0=1.9046. Start fval 569.695516, end fval 569.695031.
Next guess for x0 in direction 1 is 2.0046. Step size: 0.1000.
Optimization successful for x0=2.0046. Start fval 757.125517, end fval 757.125065.
Next guess for x0 in direction 1 is 2.1046. Step size: 0.1000.
Optimization successful for x0=2.1046. Start fval 983.766408, end fval 983.765984.
Next guess for x0 in direction 1 is 2.2046. Step size: 0.1000.
Optimization successful for x0=2.2046. Start fval 1254.276264, end fval 1254.275873.
Next guess for x0 in direction 1 is 2.3046. Step size: 0.1000.
Optimization successful for x0=2.3046. Start fval 1573.557338, end fval 1573.556969.
Next guess for x0 in direction 1 is 2.4046. Step size: 0.1000.
Optimization successful for x0=2.4046. Start fval 1946.755770, end fval 1946.755417.
Next guess for x0 in direction 1 is 2.5046. Step size: 0.1000.
Optimization successful for x0=2.5046. Start fval 2379.261381, end fval 2379.261049.
Next guess for x0 in direction 1 is 2.6046. Step size: 0.1000.
Optimization successful for x0=2.6046. Start fval 2876.707537, end fval 2876.707181.
Next guess for x0 in direction 1 is 2.7046. Step size: 0.1000.
Optimization successful for x0=2.7046. Start fval 3444.970729, end fval 3444.970444.
Next guess for x0 in direction 1 is 2.8046. Step size: 0.1000.
Optimization successful for x0=2.8046. Start fval 4090.170922, end fval 4090.170606.
Next guess for x0 in direction 1 is 2.9046. Step size: 0.1000.
Optimization successful for x0=2.9046. Start fval 4818.670719, end fval 4818.670425.
Next guess for x0 in direction 1 is 3.0046. Step size: 0.1000.
Optimization successful for x0=3.0046. Start fval 5637.075787, end fval 5637.075511.
Next guess for x0 in direction 1 is 3.1046. Step size: 0.1000.
Optimization successful for x0=3.1046. Start fval 6552.234464, end fval 6552.234204.
Next guess for x0 in direction 1 is 3.2046. Step size: 0.1000.
Optimization successful for x0=3.2046. Start fval 7571.237722, end fval 7571.237437.
Next guess for x0 in direction 1 is 3.3046. Step size: 0.1000.
Optimization successful for x0=3.3046. Start fval 8701.418891, end fval 8701.418666.
Next guess for x0 in direction 1 is 3.4046. Step size: 0.1000.
Optimization successful for x0=3.4046. Start fval 9950.354025, end fval 9950.353694.
Next guess for x0 in direction 1 is 3.5046. Step size: 0.1000.
Optimization successful for x0=3.5046. Start fval 11325.860891, end fval 11325.860687.
Next guess for x0 in direction 1 is 3.6046. Step size: 0.1000.
Optimization successful for x0=3.6046. Start fval 12836.000253, end fval 12835.999971.
Next guess for x0 in direction 1 is 3.7046. Step size: 0.1000.
Optimization successful for x0=3.7046. Start fval 14489.074240, end fval 14489.074043.
Next guess for x0 in direction 1 is 3.8046. Step size: 0.1000.
Optimization successful for x0=3.8046. Start fval 16293.627692, end fval 16293.627391.
Next guess for x0 in direction 1 is 3.9046. Step size: 0.1000.
Optimization successful for x0=3.9046. Start fval 18258.446748, end fval 18258.446565.
Next guess for x0 in direction 1 is 4.0046. Step size: 0.1000.
Optimization successful for x0=4.0046. Start fval 20392.560211, end fval 20392.559986.
Next guess for x0 in direction 1 is 4.1046. Step size: 0.1000.
Optimization successful for x0=4.1046. Start fval 22705.238127, end fval 22705.237908.
Next guess for x0 in direction 1 is 4.2046. Step size: 0.1000.
Optimization successful for x0=4.2046. Start fval 25205.992582, end fval 25205.992387.
Next guess for x0 in direction 1 is 4.3046. Step size: 0.1000.
Optimization successful for x0=4.3046. Start fval 27904.577412, end fval 27904.577214.
Next guess for x0 in direction 1 is 4.4046. Step size: 0.1000.
Optimization successful for x0=4.4046. Start fval 30810.988048, end fval 30810.987857.
Next guess for x0 in direction 1 is 4.5046. Step size: 0.1000.
Optimization successful for x0=4.5046. Start fval 33935.461593, end fval 33935.461410.
Next guess for x0 in direction 1 is 4.6046. Step size: 0.1000.
Optimization successful for x0=4.6046. Start fval 37288.476724, end fval 37288.476547.
Next guess for x0 in direction 1 is 4.7046. Step size: 0.1000.
Optimization successful for x0=4.7046. Start fval 40880.753645, end fval 40880.753473.
Next guess for x0 in direction 1 is 4.8046. Step size: 0.1000.
Optimization successful for x0=4.8046. Start fval 44723.254047, end fval 44723.253881.
Next guess for x0 in direction 1 is 4.9046. Step size: 0.1000.
Optimization successful for x0=4.9046. Start fval 48827.181073, end fval 48827.180912.
Next guess for x0 in direction 1 is 5.0000. Step size: 0.0954.
Optimization successful for x0=5.0000. Start fval 52998.248690, end fval 52998.240327.
Next guess for x3 in direction -1 is 0.9846. Step size: -0.0145.
Optimization successful for x3=0.9846. Start fval 4.090908, end fval 4.048984.
Next guess for x3 in direction -1 is 0.9692. Step size: -0.0155.
Optimization successful for x3=0.9692. Start fval 4.247755, end fval 4.247753.
Next guess for x3 in direction -1 is 0.9508. Step size: -0.0183.
Optimization successful for x3=0.9508. Start fval 4.650448, end fval 4.650445.
Next guess for x3 in direction -1 is 0.9288. Step size: -0.0221.
Optimization successful for x3=0.9288. Start fval 5.358466, end fval 5.358458.
Next guess for x3 in direction -1 is 0.9019. Step size: -0.0269.
Optimization successful for x3=0.9019. Start fval 6.523987, end fval 6.523970.
Next guess for x3 in direction -1 is 0.8686. Step size: -0.0333.
Optimization successful for x3=0.8686. Start fval 8.375232, end fval 8.375190.
Next guess for x3 in direction -1 is 0.8268. Step size: -0.0418.
Optimization successful for x3=0.8268. Start fval 11.254319, end fval 11.254202.
Next guess for x3 in direction -1 is 0.7730. Step size: -0.0538.
Optimization successful for x3=0.7730. Start fval 15.674499, end fval 15.674175.
Next guess for x3 in direction -1 is 0.7015. Step size: -0.0715.
Optimization successful for x3=0.7015. Start fval 22.407568, end fval 22.406482.
Next guess for x3 in direction -1 is 0.6015. Step size: -0.1000.
Optimization successful for x3=0.6015. Start fval 32.610112, end fval 32.605550.
Next guess for x3 in direction -1 is 0.5015. Step size: -0.1000.
Optimization successful for x3=0.5015. Start fval 42.677931, end fval 42.670172.
Next guess for x3 in direction -1 is 0.4015. Step size: -0.1000.
Optimization successful for x3=0.4015. Start fval 51.701840, end fval 51.690955.
Next guess for x3 in direction -1 is 0.3015. Step size: -0.1000.
Optimization successful for x3=0.3015. Start fval 59.040694, end fval 59.024417.
Next guess for x3 in direction -1 is 0.2015. Step size: -0.1000.
Optimization successful for x3=0.2015. Start fval 64.327869, end fval 64.300059.
Next guess for x3 in direction -1 is 0.1015. Step size: -0.1000.
Optimization successful for x3=0.1015. Start fval 67.487827, end fval 67.427871.
Next guess for x3 in direction -1 is 0.0015. Step size: -0.1000.
Optimization successful for x3=0.0015. Start fval 68.805330, end fval 66.053309.
Next guess for x3 in direction -1 is -0.0055. Step size: -0.0070.
Optimization successful for x3=-0.0055. Start fval 68.214186, end fval 66.123202.
Next guess for x3 in direction -1 is -0.0291. Step size: -0.0236.
Optimization successful for x3=-0.0291. Start fval 66.333545, end fval 66.332367.
Next guess for x3 in direction -1 is -0.0856. Step size: -0.0565.
Optimization successful for x3=-0.0856. Start fval 66.750850, end fval 66.723491.
Next guess for x3 in direction -1 is -0.1856. Step size: -0.1000.
Optimization successful for x3=-0.1856. Start fval 67.412121, end fval 67.205975.
Next guess for x3 in direction -1 is -0.2856. Step size: -0.1000.
Optimization successful for x3=-0.2856. Start fval 67.544872, end fval 67.450274.
Next guess for x3 in direction -1 is -0.3856. Step size: -0.1000.
Optimization successful for x3=-0.3856. Start fval 67.613127, end fval 67.562064.
Next guess for x3 in direction -1 is -0.4756. Step size: -0.0899.
Optimization successful for x3=-0.4756. Start fval 67.833319, end fval 67.829162.
Next guess for x3 in direction -1 is -0.5377. Step size: -0.0621.
Optimization successful for x3=-0.5377. Start fval 68.333199, end fval 68.332122.
Next guess for x3 in direction -1 is -0.5938. Step size: -0.0562.
Optimization successful for x3=-0.5938. Start fval 69.189375, end fval 69.189133.
Next guess for x3 in direction -1 is -0.6492. Step size: -0.0553.
Optimization successful for x3=-0.6492. Start fval 70.576163, end fval 70.575981.
Next guess for x3 in direction -1 is -0.7060. Step size: -0.0568.
Optimization successful for x3=-0.7060. Start fval 72.757765, end fval 72.757583.
Next guess for x3 in direction -1 is -0.7659. Step size: -0.0599.
Optimization successful for x3=-0.7659. Start fval 76.134553, end fval 76.134323.
Next guess for x3 in direction -1 is -0.8298. Step size: -0.0639.
Optimization successful for x3=-0.8298. Start fval 81.293528, end fval 81.293282.
Next guess for x3 in direction -1 is -0.8988. Step size: -0.0690.
Optimization successful for x3=-0.8988. Start fval 89.121440, end fval 89.121066.
Next guess for x3 in direction -1 is -0.9740. Step size: -0.0752.
Optimization successful for x3=-0.9740. Start fval 100.963564, end fval 100.963235.
Next guess for x3 in direction -1 is -1.0561. Step size: -0.0822.
Optimization successful for x3=-1.0561. Start fval 118.793006, end fval 118.792565.
Next guess for x3 in direction -1 is -1.1464. Step size: -0.0903.
Optimization successful for x3=-1.1464. Start fval 145.616704, end fval 145.616129.
Next guess for x3 in direction -1 is -1.2464. Step size: -0.1000.
Optimization successful for x3=-1.2464. Start fval 186.176447, end fval 186.175645.
Next guess for x3 in direction -1 is -1.3464. Step size: -0.1000.
Optimization successful for x3=-1.3464. Start fval 240.608221, end fval 240.607399.
Next guess for x3 in direction -1 is -1.4464. Step size: -0.1000.
Optimization successful for x3=-1.4464. Start fval 311.707485, end fval 311.706741.
Next guess for x3 in direction -1 is -1.5464. Step size: -0.1000.
Optimization successful for x3=-1.5464. Start fval 402.517060, end fval 402.516390.
Next guess for x3 in direction -1 is -1.6464. Step size: -0.1000.
Optimization successful for x3=-1.6464. Start fval 516.326437, end fval 516.325802.
Next guess for x3 in direction -1 is -1.7464. Step size: -0.1000.
Optimization successful for x3=-1.7464. Start fval 656.671198, end fval 656.670601.
Next guess for x3 in direction -1 is -1.8464. Step size: -0.1000.
Optimization successful for x3=-1.8464. Start fval 827.332652, end fval 827.331590.
Next guess for x3 in direction -1 is -1.9464. Step size: -0.1000.
Optimization successful for x3=-1.9464. Start fval 1032.336813, end fval 1032.336337.
Next guess for x3 in direction -1 is -2.0464. Step size: -0.1000.
Optimization successful for x3=-2.0464. Start fval 1275.956713, end fval 1275.955266.
Next guess for x3 in direction -1 is -2.1464. Step size: -0.1000.
Optimization successful for x3=-2.1464. Start fval 1562.706099, end fval 1562.705519.
Next guess for x3 in direction -1 is -2.2464. Step size: -0.1000.
Optimization successful for x3=-2.2464. Start fval 1897.348025, end fval 1897.347466.
Next guess for x3 in direction -1 is -2.3464. Step size: -0.1000.
Optimization successful for x3=-2.3464. Start fval 2284.886012, end fval 2284.883104.
Next guess for x3 in direction -1 is -2.4464. Step size: -0.1000.
Optimization successful for x3=-2.4464. Start fval 2730.565038, end fval 2730.564637.
Next guess for x3 in direction -1 is -2.5464. Step size: -0.1000.
Optimization successful for x3=-2.5464. Start fval 3239.884223, end fval 3239.879760.
Next guess for x3 in direction -1 is -2.6464. Step size: -0.1000.
Optimization successful for x3=-2.6464. Start fval 3818.568904, end fval 3818.567820.
Next guess for x3 in direction -1 is -2.7464. Step size: -0.1000.
Optimization successful for x3=-2.7464. Start fval 4472.608098, end fval 4472.607108.
Next guess for x3 in direction -1 is -2.8464. Step size: -0.1000.
Optimization successful for x3=-2.8464. Start fval 5208.219852, end fval 5208.219002.
Next guess for x3 in direction -1 is -2.9464. Step size: -0.1000.
Optimization successful for x3=-2.9464. Start fval 6031.868705, end fval 6031.852514.
Next guess for x3 in direction -1 is -3.0464. Step size: -0.1000.
Optimization successful for x3=-3.0464. Start fval 6950.696033, end fval 6950.242705.
Next guess for x3 in direction -1 is -3.1464. Step size: -0.1000.
Optimization successful for x3=-3.1464. Start fval 7970.388461, end fval 7970.314844.
Next guess for x3 in direction -1 is -3.2464. Step size: -0.1000.
Optimization successful for x3=-3.2464. Start fval 9099.842822, end fval 9099.279180.
Next guess for x3 in direction -1 is -3.3464. Step size: -0.1000.
Optimization successful for x3=-3.3464. Start fval 10344.597341, end fval 10344.566233.
Next guess for x3 in direction -1 is -3.4464. Step size: -0.1000.
Optimization successful for x3=-3.4464. Start fval 11713.856390, end fval 11713.852844.
Next guess for x3 in direction -1 is -3.5464. Step size: -0.1000.
Optimization successful for x3=-3.5464. Start fval 13215.059814, end fval 13215.034945.
Next guess for x3 in direction -1 is -3.6464. Step size: -0.1000.
Optimization successful for x3=-3.6464. Start fval 14857.790340, end fval 14856.315678.
Next guess for x3 in direction -1 is -3.7464. Step size: -0.1000.
Optimization successful for x3=-3.7464. Start fval 16646.282205, end fval 16646.066335.
Next guess for x3 in direction -1 is -3.8464. Step size: -0.1000.
Optimization successful for x3=-3.8464. Start fval 18593.756795, end fval 18592.953332.
Next guess for x3 in direction -1 is -3.9464. Step size: -0.1000.
Optimization successful for x3=-3.9464. Start fval 20705.895938, end fval 20705.859074.
Next guess for x3 in direction -1 is -4.0464. Step size: -0.1000.
Optimization successful for x3=-4.0464. Start fval 22993.916239, end fval 22993.912807.
Next guess for x3 in direction -1 is -4.1464. Step size: -0.1000.
Optimization successful for x3=-4.1464. Start fval 25466.487208, end fval 25466.485980.
Next guess for x3 in direction -1 is -4.2464. Step size: -0.1000.
Optimization successful for x3=-4.2464. Start fval 28133.193058, end fval 28133.191249.
Next guess for x3 in direction -1 is -4.3464. Step size: -0.1000.
Optimization successful for x3=-4.3464. Start fval 31003.884843, end fval 31003.883914.
Next guess for x3 in direction -1 is -4.4464. Step size: -0.1000.
Optimization successful for x3=-4.4464. Start fval 34088.661000, end fval 34088.660236.
Next guess for x3 in direction -1 is -4.5464. Step size: -0.1000.
Optimization successful for x3=-4.5464. Start fval 37397.859062, end fval 37397.858483.
Next guess for x3 in direction -1 is -4.6464. Step size: -0.1000.
Optimization successful for x3=-4.6464. Start fval 40942.059140, end fval 40942.058212.
Next guess for x3 in direction -1 is -4.7464. Step size: -0.1000.
Optimization successful for x3=-4.7464. Start fval 44732.081203, end fval 44732.080764.
Next guess for x3 in direction -1 is -4.8464. Step size: -0.1000.
Optimization successful for x3=-4.8464. Start fval 48778.989821, end fval 48778.988741.
Next guess for x3 in direction -1 is -4.9464. Step size: -0.1000.
Optimization successful for x3=-4.9464. Start fval 53094.087001, end fval 53094.086080.
Next guess for x3 in direction -1 is -5.0000. Step size: -0.0536.
Optimization successful for x3=-5.0000. Start fval 55520.963046, end fval 55520.095292.
Next guess for x3 in direction 1 is 1.0135. Step size: 0.0143.
Optimization successful for x3=1.0135. Start fval 4.090764, end fval 4.049508.
Next guess for x3 in direction 1 is 1.0282. Step size: 0.0147.
Optimization successful for x3=1.0282. Start fval 4.248520, end fval 4.248518.
Next guess for x3 in direction 1 is 1.0450. Step size: 0.0168.
Optimization successful for x3=1.0450. Start fval 4.651277, end fval 4.651275.
Next guess for x3 in direction 1 is 1.0644. Step size: 0.0194.
Optimization successful for x3=1.0644. Start fval 5.360534, end fval 5.360530.
Next guess for x3 in direction 1 is 1.0867. Step size: 0.0224.
Optimization successful for x3=1.0867. Start fval 6.527484, end fval 6.527477.
Next guess for x3 in direction 1 is 1.1127. Step size: 0.0260.
Optimization successful for x3=1.1127. Start fval 8.380232, end fval 8.380219.
Next guess for x3 in direction 1 is 1.1430. Step size: 0.0303.
Optimization successful for x3=1.1430. Start fval 11.263977, end fval 11.263955.
Next guess for x3 in direction 1 is 1.1782. Step size: 0.0352.
Optimization successful for x3=1.1782. Start fval 15.687974, end fval 15.687935.
Next guess for x3 in direction 1 is 1.2191. Step size: 0.0410.
Optimization successful for x3=1.2191. Start fval 22.418676, end fval 22.418608.
Next guess for x3 in direction 1 is 1.2668. Step size: 0.0477.
Optimization successful for x3=1.2668. Start fval 32.619942, end fval 32.619824.
Next guess for x3 in direction 1 is 1.3221. Step size: 0.0553.
Optimization successful for x3=1.3221. Start fval 48.004199, end fval 48.003947.
Next guess for x3 in direction 1 is 1.3861. Step size: 0.0640.
Optimization successful for x3=1.3861. Start fval 71.149005, end fval 71.148679.
Next guess for x3 in direction 1 is 1.4599. Step size: 0.0738.
Optimization successful for x3=1.4599. Start fval 105.962261, end fval 105.961602.
Next guess for x3 in direction 1 is 1.5447. Step size: 0.0847.
Optimization successful for x3=1.5447. Start fval 158.196576, end fval 158.195671.
Next guess for x3 in direction 1 is 1.6447. Step size: 0.1000.
Optimization successful for x3=1.6447. Start fval 239.333170, end fval 239.331386.
Next guess for x3 in direction 1 is 1.7447. Step size: 0.1000.
Optimization successful for x3=1.7447. Start fval 344.940916, end fval 344.939347.
Next guess for x3 in direction 1 is 1.8447. Step size: 0.1000.
Optimization successful for x3=1.8447. Start fval 478.797759, end fval 478.796356.
Next guess for x3 in direction 1 is 1.9447. Step size: 0.1000.
Optimization successful for x3=1.9447. Start fval 644.925792, end fval 644.924523.
Next guess for x3 in direction 1 is 2.0447. Step size: 0.1000.
Optimization successful for x3=2.0447. Start fval 847.592048, end fval 847.590900.
Next guess for x3 in direction 1 is 2.1447. Step size: 0.1000.
Optimization successful for x3=2.1447. Start fval 1091.308199, end fval 1091.307146.
Next guess for x3 in direction 1 is 2.2447. Step size: 0.1000.
Optimization successful for x3=2.2447. Start fval 1380.830207, end fval 1380.829237.
Next guess for x3 in direction 1 is 2.3447. Step size: 0.1000.
Optimization successful for x3=2.3447. Start fval 1721.158099, end fval 1721.157203.
Next guess for x3 in direction 1 is 2.4447. Step size: 0.1000.
Optimization successful for x3=2.4447. Start fval 2117.535749, end fval 2117.534895.
Next guess for x3 in direction 1 is 2.5447. Step size: 0.1000.
Optimization successful for x3=2.5447. Start fval 2575.450548, end fval 2575.449771.
Next guess for x3 in direction 1 is 2.6447. Step size: 0.1000.
Optimization successful for x3=2.6447. Start fval 3100.633431, end fval 3100.632706.
Next guess for x3 in direction 1 is 2.7447. Step size: 0.1000.
Optimization successful for x3=2.7447. Start fval 3699.058494, end fval 3699.057815.
Next guess for x3 in direction 1 is 2.8447. Step size: 0.1000.
Optimization successful for x3=2.8447. Start fval 4376.942932, end fval 4376.942300.
Next guess for x3 in direction 1 is 2.9447. Step size: 0.1000.
Optimization successful for x3=2.9447. Start fval 5140.746943, end fval 5140.746285.
Next guess for x3 in direction 1 is 3.0447. Step size: 0.1000.
Optimization successful for x3=3.0447. Start fval 5997.173250, end fval 5997.172712.
Next guess for x3 in direction 1 is 3.1447. Step size: 0.1000.
Optimization successful for x3=3.1447. Start fval 6953.167769, end fval 6953.167188.
Next guess for x3 in direction 1 is 3.2447. Step size: 0.1000.
Optimization successful for x3=3.2447. Start fval 8015.918417, end fval 8015.917887.
Next guess for x3 in direction 1 is 3.3447. Step size: 0.1000.
Optimization successful for x3=3.3447. Start fval 9192.855934, end fval 9192.855436.
Next guess for x3 in direction 1 is 3.4447. Step size: 0.1000.
Optimization successful for x3=3.4447. Start fval 10491.653294, end fval 10491.652831.
Next guess for x3 in direction 1 is 3.5447. Step size: 0.1000.
Optimization successful for x3=3.5447. Start fval 11920.225823, end fval 11920.225298.
Next guess for x3 in direction 1 is 3.6447. Step size: 0.1000.
Optimization successful for x3=3.6447. Start fval 13486.730698, end fval 13486.730294.
Next guess for x3 in direction 1 is 3.7447. Step size: 0.1000.
Optimization successful for x3=3.7447. Start fval 15199.567797, end fval 15199.567341.
Next guess for x3 in direction 1 is 3.8447. Step size: 0.1000.
Optimization successful for x3=3.8447. Start fval 17067.378396, end fval 17067.377985.
Next guess for x3 in direction 1 is 3.9447. Step size: 0.1000.
Optimization successful for x3=3.9447. Start fval 19099.046125, end fval 19099.045732.
Next guess for x3 in direction 1 is 4.0447. Step size: 0.1000.
Optimization successful for x3=4.0447. Start fval 21303.696353, end fval 21303.696006.
Next guess for x3 in direction 1 is 4.1447. Step size: 0.1000.
Optimization successful for x3=4.1447. Start fval 23690.696472, end fval 23690.695956.
Next guess for x3 in direction 1 is 4.2447. Step size: 0.1000.
Optimization successful for x3=4.2447. Start fval 26269.654951, end fval 26269.654634.
Next guess for x3 in direction 1 is 4.3447. Step size: 0.1000.
Optimization successful for x3=4.3447. Start fval 29050.423134, end fval 29050.422682.
Next guess for x3 in direction 1 is 4.4447. Step size: 0.1000.
Optimization successful for x3=4.4447. Start fval 32043.092782, end fval 32043.092493.
Next guess for x3 in direction 1 is 4.5447. Step size: 0.1000.
Optimization successful for x3=4.5447. Start fval 35257.998416, end fval 35257.998009.
Next guess for x3 in direction 1 is 4.6447. Step size: 0.1000.
Optimization successful for x3=4.6447. Start fval 38705.715039, end fval 38705.714741.
Next guess for x3 in direction 1 is 4.7447. Step size: 0.1000.
Optimization successful for x3=4.7447. Start fval 42397.060061, end fval 42397.059694.
Next guess for x3 in direction 1 is 4.8447. Step size: 0.1000.
Optimization successful for x3=4.8447. Start fval 46343.091664, end fval 46343.091399.
Next guess for x3 in direction 1 is 4.9447. Step size: 0.1000.
Optimization successful for x3=4.9447. Start fval 50555.110125, end fval 50555.109770.
Next guess for x3 in direction 1 is 5.0000. Step size: 0.0553.
Optimization successful for x3=5.0000. Start fval 53005.552650, end fval 53004.718835.
Next guess for x0 in direction -1 is 0.9837. Step size: -0.0161.
Optimization successful for x0=0.9837. Start fval 0.213084, end fval 0.078732.
Next guess for x0 in direction -1 is 0.9827. Step size: -0.0010.
Optimization successful for x0=0.9827. Start fval 0.092372, end fval 0.088577.
Next guess for x0 in direction -1 is 0.9817. Step size: -0.0010.
Optimization successful for x0=0.9817. Start fval 0.098989, end fval 0.098989.
Next guess for x0 in direction -1 is 0.9807. Step size: -0.0010.
Optimization successful for x0=0.9807. Start fval 0.109967, end fval 0.109967.
Next guess for x0 in direction -1 is 0.9797. Step size: -0.0010.
Optimization successful for x0=0.9797. Start fval 0.121509, end fval 0.121509.
Next guess for x0 in direction -1 is 0.9787. Step size: -0.0010.
Optimization successful for x0=0.9787. Start fval 0.133612, end fval 0.133612.
Next guess for x0 in direction -1 is 0.9777. Step size: -0.0010.
Optimization successful for x0=0.9777. Start fval 0.146274, end fval 0.146274.
Next guess for x0 in direction -1 is 0.9763. Step size: -0.0014.
Optimization successful for x0=0.9763. Start fval 0.165254, end fval 0.165254.
Next guess for x0 in direction -1 is 0.9743. Step size: -0.0020.
Optimization successful for x0=0.9743. Start fval 0.193717, end fval 0.193717.
Next guess for x0 in direction -1 is 0.9715. Step size: -0.0027.
Optimization successful for x0=0.9715. Start fval 0.236399, end fval 0.236399.
Next guess for x0 in direction -1 is 0.9678. Step size: -0.0037.
Optimization successful for x0=0.9678. Start fval 0.300406, end fval 0.300406.
Next guess for x0 in direction -1 is 0.9630. Step size: -0.0049.
Optimization successful for x0=0.9630. Start fval 0.396394, end fval 0.396394.
Next guess for x0 in direction -1 is 0.9566. Step size: -0.0064.
Optimization successful for x0=0.9566. Start fval 0.540357, end fval 0.540357.
Next guess for x0 in direction -1 is 0.9484. Step size: -0.0082.
Optimization successful for x0=0.9484. Start fval 0.756282, end fval 0.756282.
Next guess for x0 in direction -1 is 0.9379. Step size: -0.0104.
Optimization successful for x0=0.9379. Start fval 1.080157, end fval 1.080156.
Next guess for x0 in direction -1 is 0.9247. Step size: -0.0132.
Optimization successful for x0=0.9247. Start fval 1.565682, end fval 1.565682.
Next guess for x0 in direction -1 is 0.9079. Step size: -0.0168.
Optimization successful for x0=0.9079. Start fval 2.293710, end fval 2.293709.
Next guess for x0 in direction -1 is 0.8867. Step size: -0.0212.
Optimization successful for x0=0.8867. Start fval 3.385376, end fval 3.385375.
Next guess for x0 in direction -1 is 0.8597. Step size: -0.0270.
Optimization successful for x0=0.8597. Start fval 5.022375, end fval 5.022371.
Next guess for x0 in direction -1 is 0.8252. Step size: -0.0346.
Optimization successful for x0=0.8252. Start fval 7.477364, end fval 7.477355.
Next guess for x0 in direction -1 is 0.7802. Step size: -0.0449.
Optimization successful for x0=0.7802. Start fval 11.159884, end fval 11.159856.
Next guess for x0 in direction -1 is 0.7206. Step size: -0.0596.
Optimization successful for x0=0.7206. Start fval 16.685616, end fval 16.685530.
Next guess for x0 in direction -1 is 0.6386. Step size: -0.0820.
Optimization successful for x0=0.6386. Start fval 24.973158, end fval 24.972860.
Next guess for x0 in direction -1 is 0.5386. Step size: -0.1000.
Optimization successful for x0=0.5386. Start fval 35.254110, end fval 35.253400.
Next guess for x0 in direction -1 is 0.4386. Step size: -0.1000.
Optimization successful for x0=0.4386. Start fval 44.796328, end fval 44.795528.
Next guess for x0 in direction -1 is 0.3386. Step size: -0.1000.
Optimization successful for x0=0.3386. Start fval 52.857287, end fval 52.856655.
Next guess for x0 in direction -1 is 0.2386. Step size: -0.1000.
Optimization successful for x0=0.2386. Start fval 58.964424, end fval 58.964139.
Next guess for x0 in direction -1 is 0.1386. Step size: -0.1000.
Optimization successful for x0=0.1386. Start fval 62.922248, end fval 62.921831.
Next guess for x0 in direction -1 is 0.0386. Step size: -0.1000.
Optimization successful for x0=0.0386. Start fval 64.809452, end fval 64.799436.
Next guess for x0 in direction -1 is -0.0614. Step size: -0.1000.
Optimization successful for x0=-0.0614. Start fval 64.862450, end fval 64.788254.
Next guess for x0 in direction -1 is -0.0731. Step size: -0.0116.
Optimization successful for x0=-0.0731. Start fval 64.666249, end fval 64.665795.
Next guess for x0 in direction -1 is -0.0941. Step size: -0.0211.
Optimization successful for x0=-0.0941. Start fval 64.377257, end fval 64.377189.
Next guess for x0 in direction -1 is -0.1229. Step size: -0.0288.
Optimization successful for x0=-0.1229. Start fval 63.839693, end fval 63.839490.
Next guess for x0 in direction -1 is -0.1588. Step size: -0.0359.
Optimization successful for x0=-0.1588. Start fval 62.928854, end fval 62.928588.
Next guess for x0 in direction -1 is -0.2023. Step size: -0.0435.
Optimization successful for x0=-0.2023. Start fval 61.459310, end fval 61.459003.
Next guess for x0 in direction -1 is -0.2545. Step size: -0.0522.
Optimization successful for x0=-0.2545. Start fval 59.152864, end fval 59.152707.
Next guess for x0 in direction -1 is -0.3174. Step size: -0.0629.
Optimization successful for x0=-0.3174. Start fval 55.591830, end fval 55.591802.
Next guess for x0 in direction -1 is -0.3944. Step size: -0.0770.
Optimization successful for x0=-0.3944. Start fval 50.148558, end fval 50.148438.
Next guess for x0 in direction -1 is -0.4944. Step size: -0.1000.
Optimization successful for x0=-0.4944. Start fval 41.585016, end fval 41.584338.
Next guess for x0 in direction -1 is -0.5944. Step size: -0.1000.
Optimization successful for x0=-0.5944. Start fval 31.922373, end fval 31.921182.
Next guess for x0 in direction -1 is -0.6944. Step size: -0.1000.
Optimization successful for x0=-0.6944. Start fval 22.050849, end fval 22.049596.
Next guess for x0 in direction -1 is -0.7944. Step size: -0.1000.
Optimization successful for x0=-0.7944. Start fval 13.122608, end fval 13.121376.
Next guess for x0 in direction -1 is -0.8944. Step size: -0.1000.
Optimization successful for x0=-0.8944. Start fval 6.546967, end fval 6.545846.
Next guess for x0 in direction -1 is -0.9944. Step size: -0.1000.
Optimization successful for x0=-0.9944. Start fval 3.988028, end fval 3.987009.
Next guess for x0 in direction -1 is -1.0707. Step size: -0.0763.
Optimization successful for x0=-1.0707. Start fval 5.914780, end fval 5.914365.
Next guess for x0 in direction -1 is -1.1130. Step size: -0.0422.
Optimization successful for x0=-1.1130. Start fval 8.807910, end fval 8.807858.
Next guess for x0 in direction -1 is -1.1546. Step size: -0.0416.
Optimization successful for x0=-1.1546. Start fval 13.147572, end fval 13.147549.
Next guess for x0 in direction -1 is -1.1994. Step size: -0.0448.
Optimization successful for x0=-1.1994. Start fval 19.656949, end fval 19.656921.
Next guess for x0 in direction -1 is -1.2492. Step size: -0.0498.
Optimization successful for x0=-1.2492. Start fval 29.418622, end fval 29.418582.
Next guess for x0 in direction -1 is -1.3056. Step size: -0.0564.
Optimization successful for x0=-1.3056. Start fval 44.054921, end fval 44.054858.
Next guess for x0 in direction -1 is -1.3699. Step size: -0.0643.
Optimization successful for x0=-1.3699. Start fval 65.991410, end fval 65.991309.
Next guess for x0 in direction -1 is -1.4434. Step size: -0.0735.
Optimization successful for x0=-1.4434. Start fval 98.921108, end fval 98.920942.
Next guess for x0 in direction -1 is -1.5274. Step size: -0.0840.
Optimization successful for x0=-1.5274. Start fval 148.239103, end fval 148.238834.
Next guess for x0 in direction -1 is -1.6274. Step size: -0.1000.
Optimization successful for x0=-1.6274. Start fval 225.856112, end fval 225.855619.
Next guess for x0 in direction -1 is -1.7274. Step size: -0.1000.
Optimization successful for x0=-1.7274. Start fval 327.316662, end fval 327.316119.
Next guess for x0 in direction -1 is -1.8274. Step size: -0.1000.
Optimization successful for x0=-1.8274. Start fval 456.355281, end fval 456.354768.
Next guess for x0 in direction -1 is -1.9274. Step size: -0.1000.
Optimization successful for x0=-1.9274. Start fval 616.951848, end fval 616.951372.
Next guess for x0 in direction -1 is -2.0274. Step size: -0.1000.
Optimization successful for x0=-2.0274. Start fval 813.331176, end fval 813.330731.
Next guess for x0 in direction -1 is -2.1274. Step size: -0.1000.
Optimization successful for x0=-2.1274. Start fval 1049.962720, end fval 1049.962303.
Next guess for x0 in direction -1 is -2.2274. Step size: -0.1000.
Optimization successful for x0=-2.2274. Start fval 1331.560289, end fval 1331.559903.
Next guess for x0 in direction -1 is -2.3274. Step size: -0.1000.
Optimization successful for x0=-2.3274. Start fval 1663.081805, end fval 1663.081442.
Next guess for x0 in direction -1 is -2.4274. Step size: -0.1000.
Optimization successful for x0=-2.4274. Start fval 2049.729033, end fval 2049.728686.
Next guess for x0 in direction -1 is -2.5274. Step size: -0.1000.
Optimization successful for x0=-2.5274. Start fval 2496.947408, end fval 2496.947036.
Next guess for x0 in direction -1 is -2.6274. Step size: -0.1000.
Optimization successful for x0=-2.6274. Start fval 3010.425643, end fval 3010.425348.
Next guess for x0 in direction -1 is -2.7274. Step size: -0.1000.
Optimization successful for x0=-2.7274. Start fval 3596.096068, end fval 3596.095739.
Next guess for x0 in direction -1 is -2.8274. Step size: -0.1000.
Optimization successful for x0=-2.8274. Start fval 4260.133738, end fval 4260.133432.
Next guess for x0 in direction -1 is -2.9274. Step size: -0.1000.
Optimization successful for x0=-2.9274. Start fval 5008.956897, end fval 5008.956610.
Next guess for x0 in direction -1 is -3.0274. Step size: -0.1000.
Optimization successful for x0=-3.0274. Start fval 5849.226551, end fval 5849.226279.
Next guess for x0 in direction -1 is -3.1274. Step size: -0.1000.
Optimization successful for x0=-3.1274. Start fval 6787.846399, end fval 6787.846142.
Next guess for x0 in direction -1 is -3.2274. Step size: -0.1000.
Optimization successful for x0=-3.2274. Start fval 7831.962754, end fval 7831.962472.
Next guess for x0 in direction -1 is -3.3274. Step size: -0.1000.
Optimization successful for x0=-3.3274. Start fval 8988.964265, end fval 8988.964042.
Next guess for x0 in direction -1 is -3.4274. Step size: -0.1000.
Optimization successful for x0=-3.4274. Start fval 10266.482277, end fval 10266.481949.
Next guess for x0 in direction -1 is -3.5274. Step size: -0.1000.
Optimization successful for x0=-3.5274. Start fval 11672.389834, end fval 11672.389631.
Next guess for x0 in direction -1 is -3.6274. Step size: -0.1000.
Optimization successful for x0=-3.6274. Start fval 13214.802949, end fval 13214.802670.
Next guess for x0 in direction -1 is -3.7274. Step size: -0.1000.
Optimization successful for x0=-3.7274. Start fval 14902.078992, end fval 14902.078797.
Next guess for x0 in direction -1 is -3.8274. Step size: -0.1000.
Optimization successful for x0=-3.8274. Start fval 16742.818019, end fval 16742.817720.
Next guess for x0 in direction -1 is -3.9274. Step size: -0.1000.
Optimization successful for x0=-3.9274. Start fval 18745.861374, end fval 18745.861192.
Next guess for x0 in direction -1 is -4.0274. Step size: -0.1000.
Optimization successful for x0=-4.0274. Start fval 20920.293046, end fval 20920.292823.
Next guess for x0 in direction -1 is -4.1274. Step size: -0.1000.
Optimization successful for x0=-4.1274. Start fval 23275.438259, end fval 23275.438041.
Next guess for x0 in direction -1 is -4.2274. Step size: -0.1000.
Optimization successful for x0=-4.2274. Start fval 25820.864256, end fval 25820.864063.
Next guess for x0 in direction -1 is -4.3274. Step size: -0.1000.
Optimization successful for x0=-4.3274. Start fval 28566.380023, end fval 28566.379827.
Next guess for x0 in direction -1 is -4.4274. Step size: -0.1000.
Optimization successful for x0=-4.4274. Start fval 31522.036128, end fval 31522.035937.
Next guess for x0 in direction -1 is -4.5274. Step size: -0.1000.
Optimization successful for x0=-4.5274. Start fval 34698.124797, end fval 34698.124615.
Next guess for x0 in direction -1 is -4.6274. Step size: -0.1000.
Optimization successful for x0=-4.6274. Start fval 38105.179824, end fval 38105.179649.
Next guess for x0 in direction -1 is -4.7274. Step size: -0.1000.
Optimization successful for x0=-4.7274. Start fval 41753.976517, end fval 41753.976346.
Next guess for x0 in direction -1 is -4.8274. Step size: -0.1000.
Optimization successful for x0=-4.8274. Start fval 45655.531661, end fval 45655.531496.
Next guess for x0 in direction -1 is -4.9274. Step size: -0.1000.
Optimization successful for x0=-4.9274. Start fval 49821.103484, end fval 49821.103324.
Next guess for x0 in direction -1 is -5.0000. Step size: -0.0726.
Optimization successful for x0=-5.0000. Start fval 53018.480538, end fval 53018.240940.
Next guess for x0 in direction 1 is 1.0160. Step size: 0.0163.
Optimization successful for x0=1.0160. Start fval 0.212794, end fval 0.078556.
Next guess for x0 in direction 1 is 1.0170. Step size: 0.0010.
Optimization successful for x0=1.0170. Start fval 0.092447, end fval 0.088782.
Next guess for x0 in direction 1 is 1.0180. Step size: 0.0010.
Optimization successful for x0=1.0180. Start fval 0.099646, end fval 0.099646.
Next guess for x0 in direction 1 is 1.0190. Step size: 0.0010.
Optimization successful for x0=1.0190. Start fval 0.111151, end fval 0.111151.
Next guess for x0 in direction 1 is 1.0200. Step size: 0.0010.
Optimization successful for x0=1.0200. Start fval 0.123297, end fval 0.123297.
Next guess for x0 in direction 1 is 1.0210. Step size: 0.0010.
Optimization successful for x0=1.0210. Start fval 0.136088, end fval 0.136088.
Next guess for x0 in direction 1 is 1.0220. Step size: 0.0010.
Optimization successful for x0=1.0220. Start fval 0.149978, end fval 0.149978.
Next guess for x0 in direction 1 is 1.0235. Step size: 0.0015.
Optimization successful for x0=1.0235. Start fval 0.170809, end fval 0.170809.
Next guess for x0 in direction 1 is 1.0255. Step size: 0.0020.
Optimization successful for x0=1.0255. Start fval 0.202046, end fval 0.202046.
Next guess for x0 in direction 1 is 1.0283. Step size: 0.0028.
Optimization successful for x0=1.0283. Start fval 0.248888, end fval 0.248888.
Next guess for x0 in direction 1 is 1.0320. Step size: 0.0037.
Optimization successful for x0=1.0320. Start fval 0.319132, end fval 0.319132.
Next guess for x0 in direction 1 is 1.0368. Step size: 0.0048.
Optimization successful for x0=1.0368. Start fval 0.424483, end fval 0.424482.
Next guess for x0 in direction 1 is 1.0429. Step size: 0.0062.
Optimization successful for x0=1.0429. Start fval 0.582501, end fval 0.582501.
Next guess for x0 in direction 1 is 1.0507. Step size: 0.0078.
Optimization successful for x0=1.0507. Start fval 0.819551, end fval 0.819551.
Next guess for x0 in direction 1 is 1.0604. Step size: 0.0097.
Optimization successful for x0=1.0604. Start fval 1.175157, end fval 1.175157.
Next guess for x0 in direction 1 is 1.0723. Step size: 0.0119.
Optimization successful for x0=1.0723. Start fval 1.708447, end fval 1.708447.
Next guess for x0 in direction 1 is 1.0869. Step size: 0.0146.
Optimization successful for x0=1.0869. Start fval 2.507671, end fval 2.507670.
Next guess for x0 in direction 1 is 1.1047. Step size: 0.0177.
Optimization successful for x0=1.1047. Start fval 3.705780, end fval 3.705779.
Next guess for x0 in direction 1 is 1.1261. Step size: 0.0214.
Optimization successful for x0=1.1261. Start fval 5.502026, end fval 5.502025.
Next guess for x0 in direction 1 is 1.1518. Step size: 0.0257.
Optimization successful for x0=1.1518. Start fval 8.195928, end fval 8.195925.
Next guess for x0 in direction 1 is 1.1825. Step size: 0.0307.
Optimization successful for x0=1.1825. Start fval 12.238885, end fval 12.238880.
Next guess for x0 in direction 1 is 1.2190. Step size: 0.0365.
Optimization successful for x0=1.2190. Start fval 18.298731, end fval 18.298720.
Next guess for x0 in direction 1 is 1.2622. Step size: 0.0431.
Optimization successful for x0=1.2622. Start fval 27.380006, end fval 27.379985.
Next guess for x0 in direction 1 is 1.3129. Step size: 0.0507.
Optimization successful for x0=1.3129. Start fval 40.997304, end fval 40.997264.
Next guess for x0 in direction 1 is 1.3723. Step size: 0.0594.
Optimization successful for x0=1.3723. Start fval 61.439685, end fval 61.439613.
Next guess for x0 in direction 1 is 1.4412. Step size: 0.0690.
Optimization successful for x0=1.4412. Start fval 92.059985, end fval 92.059859.
Next guess for x0 in direction 1 is 1.5211. Step size: 0.0798.
Optimization successful for x0=1.5211. Start fval 137.964247, end fval 137.964032.
Next guess for x0 in direction 1 is 1.6130. Step size: 0.0920.
Optimization successful for x0=1.6130. Start fval 206.868191, end fval 206.867827.
Next guess for x0 in direction 1 is 1.7130. Step size: 0.1000.
Optimization successful for x0=1.7130. Start fval 304.278558, end fval 304.278060.
Next guess for x0 in direction 1 is 1.8130. Step size: 0.1000.
Optimization successful for x0=1.8130. Start fval 428.715227, end fval 428.714708.
Next guess for x0 in direction 1 is 1.9130. Step size: 0.1000.
Optimization successful for x0=1.9130. Start fval 584.122825, end fval 584.122344.
Next guess for x0 in direction 1 is 2.0130. Step size: 0.1000.
Optimization successful for x0=2.0130. Start fval 774.691034, end fval 774.690584.
Next guess for x0 in direction 1 is 2.1130. Step size: 0.1000.
Optimization successful for x0=2.1130. Start fval 1004.854171, end fval 1004.853749.
Next guess for x0 in direction 1 is 2.2130. Step size: 0.1000.
Optimization successful for x0=2.2130. Start fval 1279.290948, end fval 1279.290558.
Next guess for x0 in direction 1 is 2.3130. Step size: 0.1000.
Optimization successful for x0=2.3130. Start fval 1602.924227, end fval 1602.923861.
Next guess for x0 in direction 1 is 2.4130. Step size: 0.1000.
Optimization successful for x0=2.4130. Start fval 1980.920746, end fval 1980.920396.
Next guess for x0 in direction 1 is 2.5130. Step size: 0.1000.
Optimization successful for x0=2.5130. Start fval 2418.690942, end fval 2418.690568.
Next guess for x0 in direction 1 is 2.6130. Step size: 0.1000.
Optimization successful for x0=2.6130. Start fval 2921.888556, end fval 2921.888259.
Next guess for x0 in direction 1 is 2.7130. Step size: 0.1000.
Optimization successful for x0=2.7130. Start fval 3496.410973, end fval 3496.410642.
Next guess for x0 in direction 1 is 2.8130. Step size: 0.1000.
Optimization successful for x0=2.8130. Start fval 4148.398322, end fval 4148.398015.
Next guess for x0 in direction 1 is 2.9130. Step size: 0.1000.
Optimization successful for x0=2.9130. Start fval 4884.233945, end fval 4884.233657.
Next guess for x0 in direction 1 is 3.0130. Step size: 0.1000.
Optimization successful for x0=3.0130. Start fval 5710.543963, end fval 5710.543688.
Next guess for x0 in direction 1 is 3.1130. Step size: 0.1000.
Optimization successful for x0=3.1130. Start fval 6634.197206, end fval 6634.196947.
Next guess for x0 in direction 1 is 3.2130. Step size: 0.1000.
Optimization successful for x0=3.2130. Start fval 7662.305137, end fval 7662.304854.
Next guess for x0 in direction 1 is 3.3130. Step size: 0.1000.
Optimization successful for x0=3.3130. Start fval 8802.221569, end fval 8802.221345.
Next guess for x0 in direction 1 is 3.4130. Step size: 0.1000.
Optimization successful for x0=3.4130. Start fval 10061.543024, end fval 10061.542694.
Next guess for x0 in direction 1 is 3.5130. Step size: 0.1000.
Optimization successful for x0=3.5130. Start fval 11448.107736, end fval 11448.107533.
Next guess for x0 in direction 1 is 3.6130. Step size: 0.1000.
Optimization successful for x0=3.6130. Start fval 12969.996924, end fval 12969.996642.
Next guess for x0 in direction 1 is 3.7130. Step size: 0.1000.
Optimization successful for x0=3.7130. Start fval 14635.533167, end fval 14635.532970.
Next guess for x0 in direction 1 is 3.8130. Step size: 0.1000.
Optimization successful for x0=3.8130. Start fval 16453.281749, end fval 16453.281449.
Next guess for x0 in direction 1 is 3.9130. Step size: 0.1000.
Optimization successful for x0=3.9130. Start fval 18432.049248, end fval 18432.049065.
Next guess for x0 in direction 1 is 4.0130. Step size: 0.1000.
Optimization successful for x0=4.0130. Start fval 20580.884898, end fval 20580.884673.
Next guess for x0 in direction 1 is 4.1130. Step size: 0.1000.
Optimization successful for x0=4.1130. Start fval 22909.079173, end fval 22909.078953.
Next guess for x0 in direction 1 is 4.2130. Step size: 0.1000.
Optimization successful for x0=4.2130. Start fval 25426.164578, end fval 25426.164385.
Next guess for x0 in direction 1 is 4.3130. Step size: 0.1000.
Optimization successful for x0=4.3130. Start fval 28141.915371, end fval 28141.915174.
Next guess for x0 in direction 1 is 4.4130. Step size: 0.1000.
Optimization successful for x0=4.4130. Start fval 31066.347394, end fval 31066.347203.
Next guess for x0 in direction 1 is 4.5130. Step size: 0.1000.
Optimization successful for x0=4.5130. Start fval 34209.718159, end fval 34209.717976.
Next guess for x0 in direction 1 is 4.6130. Step size: 0.1000.
Optimization successful for x0=4.6130. Start fval 37582.526747, end fval 37582.526571.
Next guess for x0 in direction 1 is 4.7130. Step size: 0.1000.
Optimization successful for x0=4.7130. Start fval 41195.513764, end fval 41195.513593.
Next guess for x0 in direction 1 is 4.8130. Step size: 0.1000.
Optimization successful for x0=4.8130. Start fval 45059.661300, end fval 45059.661134.
Next guess for x0 in direction 1 is 4.9130. Step size: 0.1000.
Optimization successful for x0=4.9130. Start fval 49186.192888, end fval 49186.192728.
Next guess for x0 in direction 1 is 5.0000. Step size: 0.0870.
Optimization successful for x0=5.0000. Start fval 52998.297778, end fval 52998.240764.
Next guess for x3 in direction -1 is 0.9860. Step size: -0.0145.
Optimization successful for x3=0.9860. Start fval 0.212582, end fval 0.058059.
Next guess for x3 in direction -1 is 0.9850. Step size: -0.0010.
Optimization successful for x3=0.9850. Start fval 0.071421, end fval 0.066582.
Next guess for x3 in direction -1 is 0.9840. Step size: -0.0010.
Optimization successful for x3=0.9840. Start fval 0.075678, end fval 0.075678.
Next guess for x3 in direction -1 is 0.9830. Step size: -0.0010.
Optimization successful for x3=0.9830. Start fval 0.085344, end fval 0.085344.
Next guess for x3 in direction -1 is 0.9820. Step size: -0.0010.
Optimization successful for x3=0.9820. Start fval 0.095580, end fval 0.095580.
Next guess for x3 in direction -1 is 0.9810. Step size: -0.0010.
Optimization successful for x3=0.9810. Start fval 0.106381, end fval 0.106381.
Next guess for x3 in direction -1 is 0.9800. Step size: -0.0010.
Optimization successful for x3=0.9800. Start fval 0.117748, end fval 0.117748.
Next guess for x3 in direction -1 is 0.9790. Step size: -0.0010.
Optimization successful for x3=0.9790. Start fval 0.129677, end fval 0.129677.
Next guess for x3 in direction -1 is 0.9780. Step size: -0.0010.
Optimization successful for x3=0.9780. Start fval 0.142166, end fval 0.142166.
Next guess for x3 in direction -1 is 0.9767. Step size: -0.0013.
Optimization successful for x3=0.9767. Start fval 0.159096, end fval 0.159096.
Next guess for x3 in direction -1 is 0.9749. Step size: -0.0018.
Optimization successful for x3=0.9749. Start fval 0.184482, end fval 0.184482.
Next guess for x3 in direction -1 is 0.9724. Step size: -0.0025.
Optimization successful for x3=0.9724. Start fval 0.222552, end fval 0.222552.
Next guess for x3 in direction -1 is 0.9690. Step size: -0.0034.
Optimization successful for x3=0.9690. Start fval 0.279640, end fval 0.279640.
Next guess for x3 in direction -1 is 0.9645. Step size: -0.0045.
Optimization successful for x3=0.9645. Start fval 0.365252, end fval 0.365252.
Next guess for x3 in direction -1 is 0.9586. Step size: -0.0059.
Optimization successful for x3=0.9586. Start fval 0.493648, end fval 0.493648.
Next guess for x3 in direction -1 is 0.9509. Step size: -0.0076.
Optimization successful for x3=0.9509. Start fval 0.686224, end fval 0.686224.
Next guess for x3 in direction -1 is 0.9412. Step size: -0.0098.
Optimization successful for x3=0.9412. Start fval 0.975073, end fval 0.975073.
Next guess for x3 in direction -1 is 0.9288. Step size: -0.0124.
Optimization successful for x3=0.9288. Start fval 1.408332, end fval 1.408331.
Next guess for x3 in direction -1 is 0.9131. Step size: -0.0157.
Optimization successful for x3=0.9131. Start fval 2.058300, end fval 2.058298.
Next guess for x3 in direction -1 is 0.8933. Step size: -0.0198.
Optimization successful for x3=0.8933. Start fval 3.033012, end fval 3.033007.
Next guess for x3 in direction -1 is 0.8681. Step size: -0.0252.
Optimization successful for x3=0.8681. Start fval 4.494629, end fval 4.494616.
Next guess for x3 in direction -1 is 0.8359. Step size: -0.0322.
Optimization successful for x3=0.8359. Start fval 6.686282, end fval 6.686240.
Next guess for x3 in direction -1 is 0.7942. Step size: -0.0416.
Optimization successful for x3=0.7942. Start fval 9.972755, end fval 9.972643.
Next guess for x3 in direction -1 is 0.7394. Step size: -0.0548.
Optimization successful for x3=0.7394. Start fval 14.902165, end fval 14.901808.
Next guess for x3 in direction -1 is 0.6649. Step size: -0.0745.
Optimization successful for x3=0.6649. Start fval 22.298550, end fval 22.297249.
Next guess for x3 in direction -1 is 0.5649. Step size: -0.1000.
Optimization successful for x3=0.5649. Start fval 32.650631, end fval 32.645720.
Next guess for x3 in direction -1 is 0.4649. Step size: -0.1000.
Optimization successful for x3=0.4649. Start fval 42.517319, end fval 42.509264.
Next guess for x3 in direction -1 is 0.3649. Step size: -0.1000.
Optimization successful for x3=0.3649. Start fval 51.091879, end fval 51.080595.
Next guess for x3 in direction -1 is 0.2649. Step size: -0.1000.
Optimization successful for x3=0.2649. Start fval 57.842036, end fval 57.825401.
Next guess for x3 in direction -1 is 0.1649. Step size: -0.1000.
Optimization successful for x3=0.1649. Start fval 62.524808, end fval 62.497694.
Next guess for x3 in direction -1 is 0.0649. Step size: -0.1000.
Optimization successful for x3=0.0649. Start fval 65.227255, end fval 65.176261.
Next guess for x3 in direction -1 is -0.0351. Step size: -0.1000.
Optimization successful for x3=-0.0351. Start fval 66.472281, end fval 66.379698.
Next guess for x3 in direction -1 is -0.1351. Step size: -0.1000.
Optimization successful for x3=-0.1351. Start fval 67.239877, end fval 66.991746.
Next guess for x3 in direction -1 is -0.2351. Step size: -0.1000.
Optimization successful for x3=-0.2351. Start fval 67.594157, end fval 67.354908.
Next guess for x3 in direction -1 is -0.3351. Step size: -0.1000.
Optimization successful for x3=-0.3351. Start fval 67.585864, end fval 67.506750.
Next guess for x3 in direction -1 is -0.4351. Step size: -0.1000.
Optimization successful for x3=-0.4351. Start fval 67.673130, end fval 67.664391.
Next guess for x3 in direction -1 is -0.5024. Step size: -0.0673.
Optimization successful for x3=-0.5024. Start fval 68.003577, end fval 68.001462.
Next guess for x3 in direction -1 is -0.5595. Step size: -0.0571.
Optimization successful for x3=-0.5595. Start fval 68.610770, end fval 68.610469.
Next guess for x3 in direction -1 is -0.6141. Step size: -0.0546.
Optimization successful for x3=-0.6141. Start fval 69.625943, end fval 69.625757.
Next guess for x3 in direction -1 is -0.6693. Step size: -0.0552.
Optimization successful for x3=-0.6693. Start fval 71.249741, end fval 71.249566.
Next guess for x3 in direction -1 is -0.7267. Step size: -0.0574.
Optimization successful for x3=-0.7267. Start fval 73.787144, end fval 73.786959.
Next guess for x3 in direction -1 is -0.7877. Step size: -0.0610.
Optimization successful for x3=-0.7877. Start fval 77.694493, end fval 77.694254.
Next guess for x3 in direction -1 is -0.8531. Step size: -0.0654.
Optimization successful for x3=-0.8531. Start fval 83.646569, end fval 83.646302.
Next guess for x3 in direction -1 is -0.9240. Step size: -0.0709.
Optimization successful for x3=-0.9240. Start fval 92.666536, end fval 92.666103.
Next guess for x3 in direction -1 is -1.0013. Step size: -0.0774.
Optimization successful for x3=-1.0013. Start fval 106.282847, end fval 106.282497.
Next guess for x3 in direction -1 is -1.0861. Step size: -0.0847.
Optimization successful for x3=-1.0861. Start fval 126.770017, end fval 126.769538.
Next guess for x3 in direction -1 is -1.1861. Step size: -0.1000.
Optimization successful for x3=-1.1861. Start fval 160.205871, end fval 160.205091.
Next guess for x3 in direction -1 is -1.2861. Step size: -0.1000.
Optimization successful for x3=-1.2861. Start fval 205.946639, end fval 205.945797.
Next guess for x3 in direction -1 is -1.3861. Step size: -0.1000.
Optimization successful for x3=-1.3861. Start fval 266.638101, end fval 266.637328.
Next guess for x3 in direction -1 is -1.4861. Step size: -0.1000.
Optimization successful for x3=-1.4861. Start fval 345.173895, end fval 345.173165.
Next guess for x3 in direction -1 is -1.5861. Step size: -0.1000.
Optimization successful for x3=-1.5861. Start fval 444.694604, end fval 444.693941.
Next guess for x3 in direction -1 is -1.6861. Step size: -0.1000.
Optimization successful for x3=-1.6861. Start fval 568.587357, end fval 568.586755.
Next guess for x3 in direction -1 is -1.7861. Step size: -0.1000.
Optimization successful for x3=-1.7861. Start fval 720.485252, end fval 720.484692.
Next guess for x3 in direction -1 is -1.8861. Step size: -0.1000.
Optimization successful for x3=-1.8861. Start fval 904.266889, end fval 904.266363.
Next guess for x3 in direction -1 is -1.9861. Step size: -0.1000.
Optimization successful for x3=-1.9861. Start fval 1124.055999, end fval 1124.055506.
Next guess for x3 in direction -1 is -2.0861. Step size: -0.1000.
Optimization successful for x3=-2.0861. Start fval 1384.221093, end fval 1384.220632.
Next guess for x3 in direction -1 is -2.1861. Step size: -0.1000.
Optimization successful for x3=-2.1861. Start fval 1689.375143, end fval 1689.373638.
Next guess for x3 in direction -1 is -2.2861. Step size: -0.1000.
Optimization successful for x3=-2.2861. Start fval 2044.374456, end fval 2044.374062.
Next guess for x3 in direction -1 is -2.3861. Step size: -0.1000.
Optimization successful for x3=-2.3861. Start fval 2454.323316, end fval 2454.320231.
Next guess for x3 in direction -1 is -2.4861. Step size: -0.1000.
Optimization successful for x3=-2.4861. Start fval 2924.560526, end fval 2924.559708.
Next guess for x3 in direction -1 is -2.5861. Step size: -0.1000.
Optimization successful for x3=-2.5861. Start fval 3460.681486, end fval 3460.680762.
Next guess for x3 in direction -1 is -2.6861. Step size: -0.1000.
Optimization successful for x3=-2.6861. Start fval 4068.515680, end fval 4068.514989.
Next guess for x3 in direction -1 is -2.7861. Step size: -0.1000.
Optimization successful for x3=-2.7861. Start fval 4754.137805, end fval 4754.127024.
Next guess for x3 in direction -1 is -2.8861. Step size: -0.1000.
Optimization successful for x3=-2.8861. Start fval 5523.948349, end fval 5523.849535.
Next guess for x3 in direction -1 is -2.9861. Step size: -0.1000.
Optimization successful for x3=-2.9861. Start fval 6384.237741, end fval 6384.237449.
Next guess for x3 in direction -1 is -3.0861. Step size: -0.1000.
Optimization successful for x3=-3.0861. Start fval 7342.094542, end fval 7342.094229.
Next guess for x3 in direction -1 is -3.1861. Step size: -0.1000.
Optimization successful for x3=-3.1861. Start fval 8404.466233, end fval 8404.465987.
Next guess for x3 in direction -1 is -3.2861. Step size: -0.1000.
Optimization successful for x3=-3.2861. Start fval 9578.641604, end fval 9578.641326.
Next guess for x3 in direction -1 is -3.3861. Step size: -0.1000.
Optimization successful for x3=-3.3861. Start fval 10872.151513, end fval 10872.151296.
Next guess for x3 in direction -1 is -3.4861. Step size: -0.1000.
Optimization successful for x3=-3.4861. Start fval 12292.769537, end fval 12292.769218.
Next guess for x3 in direction -1 is -3.5861. Step size: -0.1000.
Optimization successful for x3=-3.5861. Start fval 13848.510904, end fval 13848.510696.
Next guess for x3 in direction -1 is -3.6861. Step size: -0.1000.
Optimization successful for x3=-3.6861. Start fval 15547.633716, end fval 15547.633390.
Next guess for x3 in direction -1 is -3.7861. Step size: -0.1000.
Optimization successful for x3=-3.7861. Start fval 17398.637332, end fval 17398.637142.
Next guess for x3 in direction -1 is -3.8861. Step size: -0.1000.
Optimization successful for x3=-3.8861. Start fval 19410.263938, end fval 19410.263721.
Next guess for x3 in direction -1 is -3.9861. Step size: -0.1000.
Optimization successful for x3=-3.9861. Start fval 21591.497050, end fval 21591.496824.
Next guess for x3 in direction -1 is -4.0861. Step size: -0.1000.
Optimization successful for x3=-4.0861. Start fval 23951.562218, end fval 23951.562003.
Next guess for x3 in direction -1 is -4.1861. Step size: -0.1000.
Optimization successful for x3=-4.1861. Start fval 26499.926821, end fval 26499.926611.
Next guess for x3 in direction -1 is -4.2861. Step size: -0.1000.
Optimization successful for x3=-4.2861. Start fval 29246.299948, end fval 29246.299746.
Next guess for x3 in direction -1 is -4.3861. Step size: -0.1000.
Optimization successful for x3=-4.3861. Start fval 32200.632393, end fval 32200.632198.
Next guess for x3 in direction -1 is -4.4861. Step size: -0.1000.
Optimization successful for x3=-4.4861. Start fval 35373.116579, end fval 35373.116390.
Next guess for x3 in direction -1 is -4.5861. Step size: -0.1000.
Optimization successful for x3=-4.5861. Start fval 38774.186514, end fval 38774.186333.
Next guess for x3 in direction -1 is -4.6861. Step size: -0.1000.
Optimization successful for x3=-4.6861. Start fval 42414.517750, end fval 42414.517576.
Next guess for x3 in direction -1 is -4.7861. Step size: -0.1000.
Optimization successful for x3=-4.7861. Start fval 46305.027336, end fval 46305.027166.
Next guess for x3 in direction -1 is -4.8861. Step size: -0.1000.
Optimization successful for x3=-4.8861. Start fval 50456.873767, end fval 50456.873602.
Next guess for x3 in direction -1 is -4.9861. Step size: -0.1000.
Optimization successful for x3=-4.9861. Start fval 54881.456960, end fval 54881.456800.
Next guess for x3 in direction -1 is -5.0000. Step size: -0.0139.
Optimization successful for x3=-5.0000. Start fval 55522.390146, end fval 55520.096017.
Next guess for x3 in direction 1 is 1.0148. Step size: 0.0143.
Optimization successful for x3=1.0148. Start fval 0.212428, end fval 0.067626.
Next guess for x3 in direction 1 is 1.0158. Step size: 0.0010.
Optimization successful for x3=1.0158. Start fval 0.081765, end fval 0.077128.
Next guess for x3 in direction 1 is 1.0168. Step size: 0.0010.
Optimization successful for x3=1.0168. Start fval 0.087266, end fval 0.087266.
Next guess for x3 in direction 1 is 1.0178. Step size: 0.0010.
Optimization successful for x3=1.0178. Start fval 0.098043, end fval 0.098043.
Next guess for x3 in direction 1 is 1.0188. Step size: 0.0010.
Optimization successful for x3=1.0188. Start fval 0.109460, end fval 0.109460.
Next guess for x3 in direction 1 is 1.0198. Step size: 0.0010.
Optimization successful for x3=1.0198. Start fval 0.121519, end fval 0.121519.
Next guess for x3 in direction 1 is 1.0208. Step size: 0.0010.
Optimization successful for x3=1.0208. Start fval 0.134222, end fval 0.134222.
Next guess for x3 in direction 1 is 1.0218. Step size: 0.0010.
Optimization successful for x3=1.0218. Start fval 0.147572, end fval 0.147572.
Next guess for x3 in direction 1 is 1.0232. Step size: 0.0014.
Optimization successful for x3=1.0232. Start fval 0.167200, end fval 0.167200.
Next guess for x3 in direction 1 is 1.0252. Step size: 0.0019.
Optimization successful for x3=1.0252. Start fval 0.196634, end fval 0.196634.
Next guess for x3 in direction 1 is 1.0278. Step size: 0.0026.
Optimization successful for x3=1.0278. Start fval 0.240773, end fval 0.240773.
Next guess for x3 in direction 1 is 1.0313. Step size: 0.0035.
Optimization successful for x3=1.0313. Start fval 0.306963, end fval 0.306963.
Next guess for x3 in direction 1 is 1.0360. Step size: 0.0046.
Optimization successful for x3=1.0360. Start fval 0.406231, end fval 0.406231.
Next guess for x3 in direction 1 is 1.0419. Step size: 0.0059.
Optimization successful for x3=1.0419. Start fval 0.555124, end fval 0.555124.
Next guess for x3 in direction 1 is 1.0494. Step size: 0.0075.
Optimization successful for x3=1.0494. Start fval 0.778479, end fval 0.778479.
Next guess for x3 in direction 1 is 1.0588. Step size: 0.0094.
Optimization successful for x3=1.0588. Start fval 1.113561, end fval 1.113561.
Next guess for x3 in direction 1 is 1.0704. Step size: 0.0116.
Optimization successful for x3=1.0704. Start fval 1.616075, end fval 1.616075.
Next guess for x3 in direction 1 is 1.0846. Step size: 0.0142.
Optimization successful for x3=1.0846. Start fval 2.369007, end fval 2.369006.
Next guess for x3 in direction 1 is 1.1018. Step size: 0.0172.
Optimization successful for x3=1.1018. Start fval 3.497831, end fval 3.497829.
Next guess for x3 in direction 1 is 1.1226. Step size: 0.0208.
Optimization successful for x3=1.1226. Start fval 5.190553, end fval 5.190548.
Next guess for x3 in direction 1 is 1.1477. Step size: 0.0250.
Optimization successful for x3=1.1477. Start fval 7.730048, end fval 7.730038.
Next guess for x3 in direction 1 is 1.1776. Step size: 0.0299.
Optimization successful for x3=1.1776. Start fval 11.539330, end fval 11.539311.
Next guess for x3 in direction 1 is 1.2132. Step size: 0.0356.
Optimization successful for x3=1.2132. Start fval 17.247710, end fval 17.247672.
Next guess for x3 in direction 1 is 1.2553. Step size: 0.0421.
Optimization successful for x3=1.2553. Start fval 25.803997, end fval 25.803928.
Next guess for x3 in direction 1 is 1.3049. Step size: 0.0496.
Optimization successful for x3=1.3049. Start fval 38.639026, end fval 38.638839.
Next guess for x3 in direction 1 is 1.3629. Step size: 0.0580.
Optimization successful for x3=1.3629. Start fval 57.891731, end fval 57.891513.
Next guess for x3 in direction 1 is 1.4303. Step size: 0.0675.
Optimization successful for x3=1.4303. Start fval 86.735572, end fval 86.735024.
Next guess for x3 in direction 1 is 1.5085. Step size: 0.0782.
Optimization successful for x3=1.5085. Start fval 129.994194, end fval 129.993522.
Next guess for x3 in direction 1 is 1.5986. Step size: 0.0901.
Optimization successful for x3=1.5986. Start fval 194.881995, end fval 194.880609.
Next guess for x3 in direction 1 is 1.6986. Step size: 0.1000.
Optimization successful for x3=1.6986. Start fval 288.722496, end fval 288.721031.
Next guess for x3 in direction 1 is 1.7986. Step size: 0.1000.
Optimization successful for x3=1.7986. Start fval 409.042151, end fval 409.040682.
Next guess for x3 in direction 1 is 1.8986. Step size: 0.1000.
Optimization successful for x3=1.8986. Start fval 559.749794, end fval 559.748476.
Next guess for x3 in direction 1 is 1.9986. Step size: 0.1000.
Optimization successful for x3=1.9986. Start fval 744.999634, end fval 744.998451.
Next guess for x3 in direction 1 is 2.0986. Step size: 0.1000.
Optimization successful for x3=2.0986. Start fval 969.190509, end fval 969.189421.
Next guess for x3 in direction 1 is 2.1986. Step size: 0.1000.
Optimization successful for x3=2.1986. Start fval 1236.965659, end fval 1236.964663.
Next guess for x3 in direction 1 is 2.2986. Step size: 0.1000.
Optimization successful for x3=2.2986. Start fval 1553.212560, end fval 1553.211642.
Next guess for x3 in direction 1 is 2.3986. Step size: 0.1000.
Optimization successful for x3=2.3986. Start fval 1923.062609, end fval 1923.061758.
Next guess for x3 in direction 1 is 2.4986. Step size: 0.1000.
Optimization successful for x3=2.4986. Start fval 2351.890915, end fval 2351.890127.
Next guess for x3 in direction 1 is 2.5986. Step size: 0.1000.
Optimization successful for x3=2.5986. Start fval 2845.316145, end fval 2845.315378.
Next guess for x3 in direction 1 is 2.6986. Step size: 0.1000.
Optimization successful for x3=2.6986. Start fval 3409.200155, end fval 3409.199461.
Next guess for x3 in direction 1 is 2.7986. Step size: 0.1000.
Optimization successful for x3=2.7986. Start fval 4049.648140, end fval 4049.647490.
Next guess for x3 in direction 1 is 2.8986. Step size: 0.1000.
Optimization successful for x3=2.8986. Start fval 4773.008195, end fval 4773.007588.
Next guess for x3 in direction 1 is 2.9986. Step size: 0.1000.
Optimization successful for x3=2.9986. Start fval 5585.871375, end fval 5585.870732.
Next guess for x3 in direction 1 is 3.0986. Step size: 0.1000.
Optimization successful for x3=3.0986. Start fval 6495.071172, end fval 6495.070654.
Next guess for x3 in direction 1 is 3.1986. Step size: 0.1000.
Optimization successful for x3=3.1986. Start fval 7507.684256, end fval 7507.683691.
Next guess for x3 in direction 1 is 3.2986. Step size: 0.1000.
Optimization successful for x3=3.2986. Start fval 8631.029203, end fval 8631.028688.
Next guess for x3 in direction 1 is 3.3986. Step size: 0.1000.
Optimization successful for x3=3.3986. Start fval 9872.667382, end fval 9872.666909.
Next guess for x3 in direction 1 is 3.4986. Step size: 0.1000.
Optimization successful for x3=3.4986. Start fval 11240.402424, end fval 11240.401886.
Next guess for x3 in direction 1 is 3.5986. Step size: 0.1000.
Optimization successful for x3=3.5986. Start fval 12742.279842, end fval 12742.279430.
Next guess for x3 in direction 1 is 3.6986. Step size: 0.1000.
Optimization successful for x3=3.6986. Start fval 14386.587916, end fval 14386.587440.
Next guess for x3 in direction 1 is 3.7986. Step size: 0.1000.
Optimization successful for x3=3.7986. Start fval 16181.856284, end fval 16181.855921.
Next guess for x3 in direction 1 is 3.8986. Step size: 0.1000.
Optimization successful for x3=3.8986. Start fval 18136.857330, end fval 18136.856802.
Next guess for x3 in direction 1 is 3.9986. Step size: 0.1000.
Optimization successful for x3=3.9986. Start fval 20260.604358, end fval 20260.604010.
Next guess for x3 in direction 1 is 4.0986. Step size: 0.1000.
Optimization successful for x3=4.0986. Start fval 22562.353745, end fval 22562.353209.
Next guess for x3 in direction 1 is 4.1986. Step size: 0.1000.
Optimization successful for x3=4.1986. Start fval 25051.602318, end fval 25051.602001.
Next guess for x3 in direction 1 is 4.2986. Step size: 0.1000.
Optimization successful for x3=4.2986. Start fval 27738.090067, end fval 27738.089604.
Next guess for x3 in direction 1 is 4.3986. Step size: 0.1000.
Optimization successful for x3=4.3986. Start fval 30631.797303, end fval 30631.797010.
Next guess for x3 in direction 1 is 4.4986. Step size: 0.1000.
Optimization successful for x3=4.4986. Start fval 33742.947189, end fval 33742.946779.
Next guess for x3 in direction 1 is 4.5986. Step size: 0.1000.
Optimization successful for x3=4.5986. Start fval 37082.003371, end fval 37082.003068.
Next guess for x3 in direction 1 is 4.6986. Step size: 0.1000.
Optimization successful for x3=4.6986. Start fval 40659.671917, end fval 40659.671546.
Next guess for x3 in direction 1 is 4.7986. Step size: 0.1000.
Optimization successful for x3=4.7986. Start fval 44486.899698, end fval 44486.899430.
Next guess for x3 in direction 1 is 4.8986. Step size: 0.1000.
Optimization successful for x3=4.8986. Start fval 48574.875698, end fval 48574.875339.
Next guess for x3 in direction 1 is 4.9986. Step size: 0.1000.
Optimization successful for x3=4.9986. Start fval 52935.029598, end fval 52935.029345.
Next guess for x3 in direction 1 is 5.0000. Step size: 0.0014.
Optimization successful for x3=5.0000. Start fval 53003.834278, end fval 52999.837769.
CPU times: user 9.21 s, sys: 147 ms, total: 9.36 s
Wall time: 4.99 s
[18]:
# specify the parameters, for which profiles should be computed
visualize.profiles(
result1,
profile_indices=[0, 3],
reference=[ref, ref2],
profile_list_ids=[0, 1],
);
[19]:
visualize.profiles(
result4,
profile_indices=[0, 3],
reference=[ref4],
);
As we can see here, the second optimum disagrees only in the very first value. Here it becomes apparent that it is only a local optimum, as the profile for the second optimum is very flat. Comparing the profiles of proplem 1 and 4, we can see, that while the convergence of problem4 was quite bad, the profiles look really similar.
Profile approximation
When computing the profiles is computationally too demanding, it is possible to employ to at least consider a normal approximation with covariance matrix given by the Hessian or FIM at the optimal parameters.
[20]:
result1 = profile.approximate_parameter_profile(
problem=problem1,
result=result1,
profile_index=np.array([0, 1, 3, 5]),
result_index=0,
n_steps=1000,
)
Computing Hessian/FIM as not available in result.
/home/docs/checkouts/readthedocs.org/user_builds/pypesto/envs/v0.5.7/lib/python3.11/site-packages/pypesto/profile/approximate.py:101: RuntimeWarning: divide by zero encountered in log
fvals = -np.log(ys)
These approximate profiles require at most one additional function evaluation, can however yield substantial approximation errors:
[21]:
axes = visualize.profiles(
result1,
profile_indices=[0, 3],
profile_list_ids=[0, 2],
ratio_min=0.01,
colors=[(1, 0, 0, 1), (0, 0, 1, 1)],
legends=[
"Optimization-based profile",
"Local profile approximation",
],
);
[22]:
visualize.profile_cis(
result1, confidence_level=0.95, profile_list=2, show_bounds=True
);
