05_trening.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "836d8ea3",
   "metadata": {},
   "source": [
    "# 1 Introduction\n",
    "First, we have to activate the environment. The first run may take a while as external libraries will be downloaded and compiled."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "25a8f509",
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "\u001b[32m\u001b[1m  Activating\u001b[22m\u001b[39m project at `~/code/OpenScience21.jl`\n"
     ]
    }
   ],
   "source": [
    "Pkg.activate(\".\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "670e2ad9",
   "metadata": {},
   "source": [
    "# 2. The Algorithm\n",
    "In this notebook, I will describe the training process on a real device and a noisy simulator. Technically the algorithm is the same as in the notebook [04_algorithm_evaluation](04_algorithm_evaluation.ipynb) except for the use of the error mitigation technic which was not necessary on the simulator written in Julia. \n",
    "\n",
    "We will use here the codes described in the notebooks:\n",
    "* [01_solution](01_solution.ipynb)\n",
    "* [03_trotter_step](03_trotter_step.ipynb)\n",
    "* [04_algorithm_evaluation](04_algorithm_evaluation.ipynb)\n",
    "Therefore in the beginning we import the script with includes all necessary functions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "aeb5501d",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "evaluate (generic function with 1 method)"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# The init file contains useful scripts and imports as well as connections to the IBM Qiskit account.\n",
    "include(\"src/Challenge/init.jl\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d4a8ec9b",
   "metadata": {},
   "source": [
    "First, we have to find the parameter for the U4 gate in trotter steps (see [03_trotter_step](03_trotter_step.ipynb)), at the same time we generate the whole circuit with ten trotter steps, this is our goal to achieve."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "cab31209",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "                                                                            »\n",
       " q_0: ──────────────────────────────────────────────────────────────────────»\n",
       "      ┌──────────────────────────────┐                                 ┌───┐»\n",
       " q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────┤ X ├»\n",
       "      └──────────────────────────────┘                                 └─┬─┘»\n",
       " q_2: ───────────────────────────────────────────────────────────────────┼──»\n",
       "                   ┌───┐                    ┌────────────────────┐       │  »\n",
       " q_3: ─────────────┤ X ├────────────────────┤ U3(π,-1.3417,6.11) ├───────■──»\n",
       "                   └───┘                    └────────────────────┘          »\n",
       " q_4: ──────────────────────────────────────────────────────────────────────»\n",
       "                   ┌───┐              ┌───────────────────────────────┐     »\n",
       " q_5: ─────────────┤ X ├──────────────┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "                   └───┘              └───────────────────────────────┘     »\n",
       " q_6: ──────────────────────────────────────────────────────────────────────»\n",
       "                                                                            »\n",
       "c0: 3/══════════════════════════════════════════════════════════════════════»\n",
       "                                                                            »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────┐                 ┌───┐┌───────────────────────────────┐»\n",
       "« q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├»\n",
       "«      └───────────┘  │              └─┬─┘└───────────────────────────────┘»\n",
       "« q_2: ───────────────┼────────────────┼───────────────────────────────────»\n",
       "«       ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    »\n",
       "« q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────»\n",
       "«       └──────────┘└───┘└──────────┘          └──────────────────────┘    »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_5: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c0: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c0: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────────┐                                     »\n",
       "« q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────────»\n",
       "«      └──────────────────────────────┘                                     »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌─────────────────────────┐   ┌───┐┌───────────┐                   »\n",
       "« q_3: ──┤ U3(3.1416,4.5878,2.466) ├───┤ X ├┤ Rz(3π/10) ├──■────────────────»\n",
       "«        └─────────────────────────┘   └─┬─┘└───────────┘  │                »\n",
       "« q_4: ──────────────────────────────────┼─────────────────┼────────────────»\n",
       "«                                        │  ┌───────────┐┌─┴─┐┌────────────┐»\n",
       "« q_5: ──────────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├»\n",
       "«                                           └───────────┘└───┘└────────────┘»\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«                                                               ┌───┐»\n",
       "« q_1: ─────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                               └─┬─┘»\n",
       "« q_2: ───────────────────────────────────────────────────────────┼──»\n",
       "«      ┌───┐┌────────────────────────────┐┌────────────────────┐  │  »\n",
       "« q_3: ┤ X ├┤ U3(-3.1416,4.6026,0.91001) ├┤ U3(π,-1.3417,6.11) ├──■──»\n",
       "«      └─┬─┘└────────────────────────────┘└────────────────────┘     »\n",
       "« q_4: ──┼───────────────────────────────────────────────────────────»\n",
       "«        │  ┌────────────────────────────┐         ┌─┐               »\n",
       "« q_5: ──■──┤ U3(6.2832,-1.4344,-5.8688) ├─────────┤M├───────────────»\n",
       "«           └────────────────────────────┘         └╥┘               »\n",
       "« q_6: ─────────────────────────────────────────────╫────────────────»\n",
       "«                                                   ║                »\n",
       "«c0: 3/═════════════════════════════════════════════╩════════════════»\n",
       "«                                                   2                »\n",
       "«                                                                             »\n",
       "« q_0: ───────────────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────┐                 ┌───┐┌───────────────────────────────┐┌─┐»\n",
       "« q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├┤M├»\n",
       "«      └───────────┘  │              └─┬─┘└───────────────────────────────┘└╥┘»\n",
       "« q_2: ───────────────┼────────────────┼────────────────────────────────────╫─»\n",
       "«       ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐     ║ »\n",
       "« q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├─────╫─»\n",
       "«       └──────────┘└───┘└──────────┘          └──────────────────────┘     ║ »\n",
       "« q_4: ─────────────────────────────────────────────────────────────────────╫─»\n",
       "«                                                                           ║ »\n",
       "« q_5: ─────────────────────────────────────────────────────────────────────╫─»\n",
       "«                                                                           ║ »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────╫─»\n",
       "«                                                                           ║ »\n",
       "«c0: 3/═════════════════════════════════════════════════════════════════════╩═»\n",
       "«                                                                           0 »\n",
       "«         \n",
       "« q_0: ───\n",
       "«         \n",
       "« q_1: ───\n",
       "«         \n",
       "« q_2: ───\n",
       "«      ┌─┐\n",
       "« q_3: ┤M├\n",
       "«      └╥┘\n",
       "« q_4: ─╫─\n",
       "«       ║ \n",
       "« q_5: ─╫─\n",
       "«       ║ \n",
       "« q_6: ─╫─\n",
       "«       ║ \n",
       "«c0: 3/═╩═\n",
       "«       1 "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "t = π\n",
    "trotter_steps = 10\n",
    "qc_full, params, params2, params3 = generate_circuit(trotter_steps, trotter_steps, t, init=true)\n",
    "addMeasuresOS(qc_full)\n",
    "# Execute simulation\n",
    "check_simulation_err(qc_full, t)\n",
    "qc_full"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0a8d63b5",
   "metadata": {},
   "source": [
    "The below method compares the results of the execution of two circuits."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "b7a85997",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "check_circuits_err (generic function with 1 method)"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "function check_circuits_err(qc1, qc2)\n",
    "    sym1 = execute(backend, qc1)\n",
    "    sym2 = execute(backend, qc2)\n",
    "\n",
    "    sum(abs.(sym1 - sym2))\n",
    "end"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1bd9d8be",
   "metadata": {},
   "source": [
    "As was described in [01_solution](01_solution.ipynb) we have to iterate 5 times the QML algorithm to find the best ansact parameter. So let's begin :)\n",
    "\n",
    "# 3. Step 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "e3923088",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "                                                                           »\n",
       "q_0: ──────────────────────────────────────────────────────────────────────»\n",
       "     ┌──────────────────────────────┐                                 ┌───┐»\n",
       "q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────┤ X ├»\n",
       "     └──────────────────────────────┘                                 └─┬─┘»\n",
       "q_2: ───────────────────────────────────────────────────────────────────┼──»\n",
       "                  ┌───┐                    ┌────────────────────┐       │  »\n",
       "q_3: ─────────────┤ X ├────────────────────┤ U3(π,-1.3417,6.11) ├───────■──»\n",
       "                  └───┘                    └────────────────────┘          »\n",
       "q_4: ──────────────────────────────────────────────────────────────────────»\n",
       "                  ┌───┐              ┌───────────────────────────────┐     »\n",
       "q_5: ─────────────┤ X ├──────────────┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "                  └───┘              └───────────────────────────────┘     »\n",
       "q_6: ──────────────────────────────────────────────────────────────────────»\n",
       "                                                                           »\n",
       "«                                                                         »\n",
       "«q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«     ┌───────────┐                 ┌───┐┌───────────────────────────────┐»\n",
       "«q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├»\n",
       "«     └───────────┘  │              └─┬─┘└───────────────────────────────┘»\n",
       "«q_2: ───────────────┼────────────────┼───────────────────────────────────»\n",
       "«      ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    »\n",
       "«q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────»\n",
       "«      └──────────┘└───┘└──────────┘          └──────────────────────┘    »\n",
       "«q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                         »\n",
       "«q_5: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                         »\n",
       "«q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                         »\n",
       "«                                                                          »\n",
       "«q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«       ┌──────────────────────┐                                           »\n",
       "«q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«       └──────────────────────┘                                           »\n",
       "«q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«     ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "«q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«     └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "«q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                  │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "«q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                     └───────────┘└───┘└────────────┘     »\n",
       "«q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«                                                                         »\n",
       "«q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                    ┌───┐»\n",
       "«q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                    └─┬─┘»\n",
       "«q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«     ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "«q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«     └────────────────────────────┘    └────────────────────────┘        »\n",
       "«q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«     ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "«q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«     └────────────────────────────┘└───────────────────────────────┘     »\n",
       "«q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                         »\n",
       "«                                                                   »\n",
       "«q_0: ──────────────────────────────────────────────────────────────»\n",
       "«     ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "«q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«     └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "«q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«     ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "«q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«     └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "«q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«                                                                          »\n",
       "«q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«     ┌──────────────────────────────┐                                     »\n",
       "«q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────────»\n",
       "«     └──────────────────────────────┘                                     »\n",
       "«q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«       ┌─────────────────────────┐   ┌───┐┌───────────┐                   »\n",
       "«q_3: ──┤ U3(3.1416,4.5878,2.466) ├───┤ X ├┤ Rz(3π/10) ├──■────────────────»\n",
       "«       └─────────────────────────┘   └─┬─┘└───────────┘  │                »\n",
       "«q_4: ──────────────────────────────────┼─────────────────┼────────────────»\n",
       "«                                       │  ┌───────────┐┌─┴─┐┌────────────┐»\n",
       "«q_5: ──────────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├»\n",
       "«                                          └───────────┘└───┘└────────────┘»\n",
       "«q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«                                                                   »\n",
       "«q_0: ──────────────────────────────────────────────────────────────»\n",
       "«                                                              ┌───┐»\n",
       "«q_1: ─────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                              └─┬─┘»\n",
       "«q_2: ───────────────────────────────────────────────────────────┼──»\n",
       "«     ┌───┐┌────────────────────────────┐┌────────────────────┐  │  »\n",
       "«q_3: ┤ X ├┤ U3(-3.1416,4.6026,0.91001) ├┤ U3(π,-1.3417,6.11) ├──■──»\n",
       "«     └─┬─┘└────────────────────────────┘└────────────────────┘     »\n",
       "«q_4: ──┼───────────────────────────────────────────────────────────»\n",
       "«       │  ┌────────────────────────────┐                           »\n",
       "«q_5: ──■──┤ U3(6.2832,-1.4344,-5.8688) ├───────────────────────────»\n",
       "«          └────────────────────────────┘                           »\n",
       "«q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«                                                                         \n",
       "«q_0: ────────────────────────────────────────────────────────────────────\n",
       "«     ┌───────────┐                 ┌───┐┌───────────────────────────────┐\n",
       "«q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├\n",
       "«     └───────────┘  │              └─┬─┘└───────────────────────────────┘\n",
       "«q_2: ───────────────┼────────────────┼───────────────────────────────────\n",
       "«      ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    \n",
       "«q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────\n",
       "«      └──────────┘└───┘└──────────┘          └──────────────────────┘    \n",
       "«q_4: ────────────────────────────────────────────────────────────────────\n",
       "«                                                                         \n",
       "«q_5: ────────────────────────────────────────────────────────────────────\n",
       "«                                                                         \n",
       "«q_6: ────────────────────────────────────────────────────────────────────\n",
       "«                                                                         "
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "const st = 2\n",
    "step1_check_qc, _, _, _ = generate_circuit(trotter_steps, 8, t, params, params2, params3, init=false)\n",
    "step1_step_qc_exp, _, _, _ = generate_circuit(trotter_steps, st, t, params, params2, params3, init=true)\n",
    "step1_step_qc_exp"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "86d9a54f",
   "metadata": {},
   "source": [
    "We have to define our step ansact."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "c1ce29ec",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "                                                                   »\n",
       "q_0: ──────────────────────────────────────────────────────────────»\n",
       "     ┌────────────────────────────┐                                »\n",
       "q_1: ┤ U3(5.0888,3.4908,0.094319) ├──────────────────■─────────────»\n",
       "     └────────────────────────────┘                  │             »\n",
       "q_2: ────────────────────────────────────────────────┼─────────────»\n",
       "     ┌────────────────────────────┐                ┌─┴─┐           »\n",
       "q_3: ┤ U3(5.0888,3.4908,0.094319) ├──■─────────────┤ X ├───────────»\n",
       "     └────────────────────────────┘  │             └───┘           »\n",
       "q_4: ────────────────────────────────┼─────────────────────────────»\n",
       "     ┌────────────────────────────┐┌─┴─┐┌─────────────────────────┐»\n",
       "q_5: ┤ U3(5.0888,3.4908,0.094319) ├┤ X ├┤ U3(3.7829,3.5114,0.755) ├»\n",
       "     └────────────────────────────┘└───┘└─────────────────────────┘»\n",
       "q_6: ──────────────────────────────────────────────────────────────»\n",
       "                                                                   »\n",
       "«                                                                »\n",
       "«q_0: ───────────────────────────────────────────────────────────»\n",
       "«     ┌─────────────────────────┐     ┌─────────────────────────┐»\n",
       "«q_1: ┤ U3(3.7829,3.5114,0.755) ├──■──┤ U3(3.7185,4.933,3.7355) ├»\n",
       "«     └─────────────────────────┘  │  └─────────────────────────┘»\n",
       "«q_2: ─────────────────────────────┼─────────────────────────────»\n",
       "«     ┌─────────────────────────┐┌─┴─┐                           »\n",
       "«q_3: ┤ U3(3.7829,3.5114,0.755) ├┤ X ├─────────────■─────────────»\n",
       "«     └─────────────────────────┘└───┘             │             »\n",
       "«q_4: ─────────────────────────────────────────────┼─────────────»\n",
       "«                                                ┌─┴─┐           »\n",
       "«q_5: ───────────────────────────────────────────┤ X ├───────────»\n",
       "«                                                └───┘           »\n",
       "«q_6: ───────────────────────────────────────────────────────────»\n",
       "«                                                                »\n",
       "«                                \n",
       "«q_0: ───────────────────────────\n",
       "«                                \n",
       "«q_1: ───────────────────────────\n",
       "«                                \n",
       "«q_2: ───────────────────────────\n",
       "«     ┌─────────────────────────┐\n",
       "«q_3: ┤ U3(3.7185,4.933,3.7355) ├\n",
       "«     └─────────────────────────┘\n",
       "«q_4: ───────────────────────────\n",
       "«     ┌─────────────────────────┐\n",
       "«q_5: ┤ U3(3.7185,4.933,3.7355) ├\n",
       "«     └─────────────────────────┘\n",
       "«q_6: ───────────────────────────\n",
       "«                                "
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "step1_ansact = generate_ansact()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "651a36da",
   "metadata": {},
   "source": [
    "In the definition of the start parameter, we can do this twofold, first, we can rand it, the second, we can use the previously found parameter (for instance if we break the optimization process)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "595eeef6",
   "metadata": {},
   "outputs": [],
   "source": [
    "#step1_start_params = [6.490463894513841, 3.434943430067894, 5.375354561541277, 4.7906997798464115, 2.849325024133124, 2.7673620360366824, 1.4940499436354768, 4.487752591524359, 3.2948988322626382, 2.0225225509500486, -1.2343170007923738, 1.0431091490261049, 1.8837296276360387, 1.2169677999557502, 5.940807695305212, 5.421210358780618, 0.3173688878579456, -6.965567540712155, 4.835967484868803, 3.0127993733543517, 4.4620544822135475, 1.378337396849606, 1.980959799643362, 3.6789144092845376, 5.417860886313657, 1.8687391611628605, 5.092938820960128]\n",
    "step1_start_params = getRandParameters(step1_ansact)\n",
    "nothing"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "73df7cb8",
   "metadata": {},
   "source": [
    "Let's generate circuit to optimization."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "bb3a9e8d",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "                                                                            »\n",
       " q_0: ──────────────────────────────────────────────────────────────────────»\n",
       "      ┌──────────────────────────────┐                                 ┌───┐»\n",
       " q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────┤ X ├»\n",
       "      └──────────────────────────────┘                                 └─┬─┘»\n",
       " q_2: ───────────────────────────────────────────────────────────────────┼──»\n",
       "                   ┌───┐                    ┌────────────────────┐       │  »\n",
       " q_3: ─────────────┤ X ├────────────────────┤ U3(π,-1.3417,6.11) ├───────■──»\n",
       "                   └───┘                    └────────────────────┘          »\n",
       " q_4: ──────────────────────────────────────────────────────────────────────»\n",
       "                   ┌───┐              ┌───────────────────────────────┐     »\n",
       " q_5: ─────────────┤ X ├──────────────┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "                   └───┘              └───────────────────────────────┘     »\n",
       " q_6: ──────────────────────────────────────────────────────────────────────»\n",
       "                                                                            »\n",
       "c1: 3/══════════════════════════════════════════════════════════════════════»\n",
       "                                                                            »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────┐                 ┌───┐┌───────────────────────────────┐»\n",
       "« q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├»\n",
       "«      └───────────┘  │              └─┬─┘└───────────────────────────────┘»\n",
       "« q_2: ───────────────┼────────────────┼───────────────────────────────────»\n",
       "«       ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    »\n",
       "« q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────»\n",
       "«       └──────────┘└───┘└──────────┘          └──────────────────────┘    »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_5: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c1: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c1: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c1: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c1: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────────┐                                     »\n",
       "« q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────────»\n",
       "«      └──────────────────────────────┘                                     »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌─────────────────────────┐   ┌───┐┌───────────┐                   »\n",
       "« q_3: ──┤ U3(3.1416,4.5878,2.466) ├───┤ X ├┤ Rz(3π/10) ├──■────────────────»\n",
       "«        └─────────────────────────┘   └─┬─┘└───────────┘  │                »\n",
       "« q_4: ──────────────────────────────────┼─────────────────┼────────────────»\n",
       "«                                        │  ┌───────────┐┌─┴─┐┌────────────┐»\n",
       "« q_5: ──────────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├»\n",
       "«                                           └───────────┘└───┘└────────────┘»\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c1: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌───┐┌────────────────────────────┐   ┌────────────────────┐     │  »\n",
       "« q_3: ┤ X ├┤ U3(-3.1416,4.6026,0.91001) ├───┤ U3(π,-1.3417,6.11) ├─────■──»\n",
       "«      └─┬─┘└────────────────────────────┘   └────────────────────┘        »\n",
       "« q_4: ──┼─────────────────────────────────────────────────────────────────»\n",
       "«        │  ┌────────────────────────────┐┌──────────────────────────┐     »\n",
       "« q_5: ──■──┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.1403,0.4794,2.3991) ├─────»\n",
       "«           └────────────────────────────┘└──────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c1: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────┐                 ┌───┐┌───────────────────────────────┐»\n",
       "« q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├»\n",
       "«      └───────────┘  │              └─┬─┘└───────────────────────────────┘»\n",
       "« q_2: ───────────────┼────────────────┼───────────────────────────────────»\n",
       "«       ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    »\n",
       "« q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────»\n",
       "«       └──────────┘└───┘└──────────┘          └──────────────────────┘    »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_5: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c1: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                     »\n",
       "« q_0: ───────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────┐                                   »\n",
       "« q_1: ┤ U3(3.5111,3.3522,4.4175) ├───────────────────■───────────────»\n",
       "«      └──────────────────────────┘                   │               »\n",
       "« q_2: ───────────────────────────────────────────────┼───────────────»\n",
       "«        ┌─────────────────────┐                    ┌─┴─┐             »\n",
       "« q_3: ──┤ U3(3,5.3779,4.3022) ├─────■──────────────┤ X ├─────────────»\n",
       "«        └─────────────────────┘     │              └───┘             »\n",
       "« q_4: ──────────────────────────────┼────────────────────────────────»\n",
       "«                                  ┌─┴─┐┌────────────────────────────┐»\n",
       "« q_5: ────────────────────────────┤ X ├┤ U3(0.019422,4.2058,4.6314) ├»\n",
       "«                                  └───┘└────────────────────────────┘»\n",
       "« q_6: ───────────────────────────────────────────────────────────────»\n",
       "«                                                                     »\n",
       "«c1: 3/═══════════════════════════════════════════════════════════════»\n",
       "«                                                                     »\n",
       "«                                                                   »\n",
       "« q_0: ─────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────┐     ┌──────────────────────────┐»\n",
       "« q_1: ┤ U3(3.1764,5.8487,1.6088) ├──■──┤ U3(5.7792,3.6716,6.0105) ├»\n",
       "«      └──────────────────────────┘  │  └──────────────────────────┘»\n",
       "« q_2: ──────────────────────────────┼──────────────────────────────»\n",
       "«      ┌──────────────────────────┐┌─┴─┐                            »\n",
       "« q_3: ┤ U3(4.7995,2.2739,4.6524) ├┤ X ├─────────────■──────────────»\n",
       "«      └──────────────────────────┘└───┘             │              »\n",
       "« q_4: ──────────────────────────────────────────────┼──────────────»\n",
       "«                                                  ┌─┴─┐            »\n",
       "« q_5: ────────────────────────────────────────────┤ X ├────────────»\n",
       "«                                                  └───┘            »\n",
       "« q_6: ─────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«c1: 3/═════════════════════════════════════════════════════════════»\n",
       "«                                                                   »\n",
       "«                                            \n",
       "« q_0: ──────────────────────────────────────\n",
       "«                                   ┌─┐      \n",
       "« q_1: ─────────────────────────────┤M├──────\n",
       "«                                   └╥┘      \n",
       "« q_2: ──────────────────────────────╫───────\n",
       "«       ┌─────────────────────────┐  ║ ┌─┐   \n",
       "« q_3: ─┤ U3(2.4199,6.1116,2.444) ├──╫─┤M├───\n",
       "«       └─────────────────────────┘  ║ └╥┘   \n",
       "« q_4: ──────────────────────────────╫──╫────\n",
       "«      ┌───────────────────────────┐ ║  ║ ┌─┐\n",
       "« q_5: ┤ U3(0.77918,1.1214,4.2393) ├─╫──╫─┤M├\n",
       "«      └───────────────────────────┘ ║  ║ └╥┘\n",
       "« q_6: ──────────────────────────────╫──╫──╫─\n",
       "«                                    ║  ║  ║ \n",
       "«c1: 3/══════════════════════════════╩══╩══╩═\n",
       "«                                    0  1  2 "
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Set parameters\n",
    "setparameters!(step1_ansact, step1_start_params)\n",
    "\n",
    "# Generate step qc\n",
    "step1_qc = generate_empty_circuit()\n",
    "# append\n",
    "append!(step1_qc, step1_step_qc_exp)\n",
    "append!(step1_qc, step1_ansact)\n",
    "# Add measures\n",
    "addMeasuresOS(step1_qc)\n",
    "step1_qc"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "25d1e70d",
   "metadata": {},
   "source": [
    "Now, we have to decide which device we will use in the notebook: Julia Simulator, Noisy simulator, or a real device."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "deb05425",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "JuliaSim::ExecutePlace = 2"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "@enum ExecutePlace NoisySim RealDevice JuliaSim\n",
    "#useExecutePlace = NoisySim\n",
    "useExecutePlace = JuliaSim\n",
    "#useExecutePlace = RealDevice"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "27efa6f7",
   "metadata": {},
   "source": [
    "Let's define some helper functions. One of the arguments passed to gradient descent method is Optimization Function, we have two types of these functions. One is dedicated to Julia simulator where we can use Zygote to calculate derivative, the secound one use parametr shift rules (and we run the whole circuit multiple times to mitigate the stochastic error)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "9e3eaf1d",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "create_op (generic function with 1 method)"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# \n",
    "function create_julia_op(step_qc)\n",
    "    step_loss(params) = loss_expected_zero_state(execute(backend, step_qc, params))\n",
    "    step_dloss(params) = real(step_loss'(params))\n",
    "    step_of = OptimizationFunction(false, (x) -> (step_loss(x), step_dloss(x)), step_loss)\n",
    "    \n",
    "    return step_of\n",
    "end\n",
    "\n",
    "function call_N_qderivative(step_qc, use_backend, x, N)\n",
    "    y  = 0.0\n",
    "    dy = zeros(27)\n",
    "    for i in 1:N\n",
    "        tmp_y, tmp_dy = qderivative(use_backend, step_qc, loss_expected_zero_state, x)\n",
    "        y = y + tmp_y\n",
    "        dy = dy + tmp_dy\n",
    "    end\n",
    "    return y/N, dy/N\n",
    "end\n",
    "\n",
    "function call_N_loss_expected_zero_state(step_qc, use_backend, x, N)\n",
    "    y  = 0.0\n",
    "    for i in 1:N\n",
    "        tmp_y = qexecute(use_backend, step_qc, loss_expected_zero_state, x)\n",
    "        y = y + tmp_y\n",
    "    end\n",
    "    return y/N\n",
    "end\n",
    "\n",
    "\n",
    "function create_dev_op(step_qc, use_backend)\n",
    "#     step_of = OptimizationFunction(\n",
    "#                     false,\n",
    "#                     (x) -> qderivative(use_backend, step_qc, loss_expected_zero_state, x),\n",
    "#                     (x) -> loss_expected_zero_state(execute(use_backend, setAndConvert(step_qc, x))))\n",
    "    step_of = OptimizationFunction(\n",
    "            false,\n",
    "            (x) -> call_N_qderivative(step_qc, use_backend, x, 30),\n",
    "            (x) -> call_N_loss_expected_zero_state(step_qc, use_backend, x, 30))\n",
    "\n",
    "    return step_of\n",
    "end\n",
    "\n",
    "function create_op(use_execute_place, step_qc)\n",
    "    if use_execute_place == JuliaSim   \n",
    "        step_of = create_julia_op(step_qc)\n",
    "    else\n",
    "        if use_execute_place == NoisySim\n",
    "            useBackend = qiskitBackendNoisySim\n",
    "        else \n",
    "            useBackend = qiskitBackendJakarta\n",
    "        end\n",
    "\n",
    "        step_of = create_dev_op(step_qc, useBackend)\n",
    "    end\n",
    "    \n",
    "    return step_of\n",
    "end"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "4548c8ff",
   "metadata": {},
   "outputs": [],
   "source": [
    "step1_of = create_op(useExecutePlace, step1_qc)\n",
    "nothing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "5501b2e7",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "3.511063015761353, 3.3521816009889287, 4.417544608304454, 3.0000206986664795, 5.37791992968064, 4.302210559633711, 4.140333720650437, 0.47940136077064527, 2.399075738492638, 3.176448959358504, 5.848718706465899, 1.6088474019541905, 4.799479126222303, 2.2738709304324836, 4.652447795687345, 5.779154796524375, 3.671615131596173, 6.01045747161123, 0.01942182523261238, 4.2057667390962825, 4.631432468115318, 2.419875873608716, 6.111645876540686, 2.4440182664126504, 0.7791835921234573, 1.1214380984040069, 4.239334999579106\n",
      "====================================\n",
      "Start iteration 1, value: 4.0277669767380955, best: 4.0277669767380955, dval: 3.5610184174832678\n",
      "====================================\n",
      "3.5142051610684333, 3.345805086113054, 4.422946596485339, 2.977714333793373, 5.378355445351012, 4.300855386221823, 4.163460544652262, 0.47142235186479486, 2.395031317178146, 3.2120591435333368, 5.855095142668443, 1.6024708870783158, 4.8069176984052575, 2.2801491628240695, 4.650517719236731, 5.7868300555025085, 3.671615131596173, 6.016833907813774, 0.019257849775306635, 4.200637342869952, 4.626783534201114, 2.431270411765285, 6.111645876540686, 2.452953511944178, 0.7813521945251032, 1.1214380984040069, 4.261431381713494\n",
      "====================================\n",
      "Start iteration 2, value: 3.7053447026224857, best: 3.7053447026224857, dval: 3.053321334546793\n",
      "====================================\n",
      "3.5244962935719424, 3.3101004004901498, 4.457195615202784, 2.8402503262434817, 5.378675598873947, 4.293893256154398, 4.285534360804874, 0.43229616245487085, 2.3673034512419866, 3.426220970974371, 5.892909882947011, 1.5667662014554118, 4.860614982001618, 2.331827781978891, 4.643120913746539, 5.834822981080012, 3.671615131596173, 6.054648648092342, 0.01883394264143931, 4.172496593265707, 4.6011978728850185, 2.5020359076618197, 6.111645876540686, 2.4999193261825887, 0.7976414438619223, 1.1214380984040069, 4.386124481432723\n",
      "====================================\n",
      "Start iteration 3, value: 2.4433937502870373, best: 2.4433937502870373, dval: 1.6698978816525523\n",
      "====================================\n",
      "3.5256469535731854, 3.2840019272670573, 4.487135900536298, 2.662178934843011, 5.378449765677379, 4.281462547545908, 4.399083118133403, 0.40473631871911847, 2.348012413544018, 3.68473067111458, 5.931375726880506, 1.5406677282323193, 4.946408277122833, 2.429409211656799, 4.643774058609856, 5.903668821435081, 3.671615131596173, 6.093114492025837, 0.01900545250097949, 4.145775990854649, 4.576931114527121, 2.5783556507762384, 6.111645876540686, 2.5485807023718916, 1.0105625403878353, 1.1214380984040069, 4.520085041777075\n",
      "====================================\n",
      "Start iteration 4, value: 1.570493865288302, best: 1.570493865288302, dval: 1.0078246503076767\n",
      "====================================\n",
      "3.524783285375592, 3.2797310896593426, 4.494831711417926, 2.375609021273941, 5.377897998433979, 4.241551103508115, 4.519644993587949, 0.35494589031140533, 2.3537415626489775, 4.0782406875454305, 5.979015431215603, 1.5363968906246048, 5.165918670864691, 2.5804179186953977, 4.644512970002523, 6.040557306908154, 3.671615131596173, 6.140754196360934, 0.019204016290088024, 3.8010630337609737, 4.38981675136859, 2.656706387580455, 6.111645876540686, 2.6074279990099973, 1.0865285743525241, 1.1214380984040069, 4.830763395433222\n",
      "====================================\n",
      "Start iteration 5, value: 0.7796600483922257, best: 0.7796600483922257, dval: 0.4819825530578897\n",
      "====================================\n",
      "3.5224402790662244, 3.2772792994957434, 4.50809638415434, 2.0352047899249284, 5.356406924696602, 4.137176222681723, 4.566936417481755, 0.3443771406351751, 2.450146209998703, 4.438928740794044, 5.980480842376648, 1.5339451004610059, 6.229339196812069, 3.2717438377879664, 4.64717235138086, 6.634814819203387, 3.671615131596173, 6.142219607521978, 0.019792029858832695, 3.8835298454497544, 4.436239174463373, 3.700202502216189, 6.111645876540686, 2.7096045056754137, 1.062399373238838, 1.1214380984040069, 4.913477551121413\n",
      "====================================\n",
      "Start iteration 6, value: 0.6398038033528023, best: 0.6398038033528023, dval: 0.4334896812845803\n",
      "====================================\n",
      "3.524290741124221, 3.2742195665863014, 4.582388673541886, 2.1871584015836536, 5.325232908941993, 4.170395711469071, 4.652131860401947, 0.31578576341592796, 2.380442345055988, 4.6094107607155195, 5.982003863159676, 1.530885367551564, 5.635993298214063, 2.904452909259032, 4.645762245800983, 6.543198915026146, 3.671615131596173, 6.143742628305007, 0.01950404659020889, 3.8491268664081892, 4.416238224401056, 3.1146819437345497, 6.111645876540686, 2.6583359202246872, 0.9963900769079951, 1.1214380984040069, 5.516697038204188\n",
      "====================================\n",
      "Start iteration 7, value: 0.33221251690164805, best: 0.33221251690164805, dval: 0.1857773897490687\n",
      "Start iteration 8, value: 1.0905276314553345, best: 0.33221251690164805, dval: 0.9209240535435272\n",
      "Big value increase: val: 1.0905276314553345, e.val: 0.33221251690164805, max(α): 32.91416816765552\n",
      "Start iteration 9, value: 1.193009923164181, best: 0.33221251690164805, dval: 1.0335671616414077\n",
      "Big value increase: val: 1.193009923164181, e.val: 0.33221251690164805, max(α): 18.527627697423316\n",
      "Start iteration 10, value: 0.5348968704308219, best: 0.33221251690164805, dval: 0.5336699549558037\n",
      "Big value increase: val: 0.5348968704308219, e.val: 0.33221251690164805, max(α): 73.97982706868802\n",
      "Start iteration 11, value: 2.736068601527504, best: 0.33221251690164805, dval: 2.365811229344188\n",
      "Big value increase: val: 2.736068601527504, e.val: 0.33221251690164805, max(α): 90.04185169417451\n",
      "Start iteration 12, value: 2.808992813651844, best: 0.33221251690164805, dval: 2.8766342860672154\n",
      "Big value increase: val: 2.808992813651844, e.val: 0.33221251690164805, max(α): 46.695655862184104\n",
      "Start iteration 13, value: 0.7109130774904802, best: 0.33221251690164805, dval: 0.6664159283074617\n",
      "Big value increase: val: 0.7109130774904802, e.val: 0.33221251690164805, max(α): 235.5119079056349\n",
      "Start iteration 14, value: 4.652379448609227, best: 0.33221251690164805, dval: 6.722388705707628\n",
      "Big value increase: val: 4.652379448609227, e.val: 0.33221251690164805, max(α): 786.2459157051305\n",
      "Start iteration 15, value: 0.5877717339715375, best: 0.33221251690164805, dval: 0.5441486343726233\n",
      "Big value increase: val: 0.5877717339715375, e.val: 0.33221251690164805, max(α): 168.32416819864372\n",
      "Start iteration 16, value: 0.5280043193945767, best: 0.33221251690164805, dval: 0.4766640230960396\n",
      "Big value increase: val: 0.5280043193945767, e.val: 0.33221251690164805, max(α): 171.7339434070839\n",
      "====================================\n",
      "3.5242911992859094, 3.2735718541971863, 7.4765335172873035, 2.4599252181434927, 5.295157522279975, 4.194883406716101, 4.679530416017433, 0.28734907326213266, 2.1915326518669613, 7.398062284967091, 5.98040456041902, 1.5302376551624475, -1.159337316665767, 7.840705606240329, 4.645291508569255, 5.825966983283224, 3.671615131596173, 6.1421433255643505, -0.026138571051503093, 3.8716188924965165, 4.429082800547533, 3.102396645959649, 6.111645876540686, -0.7147944765961094, 0.7844763496558281, 1.1214380984040069, 5.367186596343891\n",
      "====================================\n",
      "Start iteration 17, value: 0.3283142150374956, best: 0.3283142150374956, dval: 0.34335483769166014\n",
      "Start iteration 18, value: 0.6017694629490652, best: 0.3283142150374956, dval: 0.7764660521601934\n",
      "Big value increase: val: 0.6017694629490652, e.val: 0.3283142150374956, max(α): 3418.8086427674525\n",
      "Start iteration 19, value: 4.505319485612955, best: 0.3283142150374956, dval: 4.275157378606962\n",
      "Big value increase: val: 4.505319485612955, e.val: 0.3283142150374956, max(α): 733.2975486321742\n",
      "Start iteration 20, value: 1.4141033170935169, best: 0.3283142150374956, dval: 1.493812526871274\n",
      "Big value increase: val: 1.4141033170935169, e.val: 0.3283142150374956, max(α): 19.843245880207355\n",
      "Start iteration 21, value: 0.7155699611441089, best: 0.3283142150374956, dval: 0.5385705646579921\n",
      "Big value increase: val: 0.7155699611441089, e.val: 0.3283142150374956, max(α): 25.59097029357368\n",
      "====================================\n",
      "3.5242911949247753, 3.2728334526635208, 7.6525180905164545, 2.3716185992711867, 5.296035884464072, 4.193768697766797, 4.6743963447013055, 0.2520610183143194, 2.190283426306526, 7.472106191905369, 5.9804238917263195, 1.5294992536286403, -1.5000313988607208, -34.03880955532793, 4.645291119968104, 5.958942232515827, 3.671615131596173, 6.14216265687165, -0.09728348914802416, 3.8716995521304063, 4.429104183501473, 2.737671650947694, 6.111645876540686, -1.5797555868968343, 0.7842722168208673, 1.1214380984040069, 5.378162282960449\n",
      "====================================\n",
      "Start iteration 22, value: 0.28935042814060546, best: 0.28935042814060546, dval: 0.2398844089741175\n",
      "====================================\n",
      "3.5242911960380363, 3.2724623583239865, 7.652435567358438, 2.3697039268985525, 5.29596888621905, 4.193787582420254, 4.671091766207176, 0.26235237502954006, 2.190145561029483, 7.3738881468363875, 5.980428337844255, 1.5291281592890344, -1.358085964954492, -117.08640418744534, 4.645291289892896, 6.015069777491392, 3.671615131596173, 6.1421671029895855, -0.10115060344243117, 3.8716897715706535, 4.429098243199148, 2.7364752655050104, 6.111645876540686, -2.0615154730578626, 0.7831936852273252, 1.1214380984040069, 5.37097259131945\n",
      "====================================\n",
      "Start iteration 23, value: 0.2130507485499535, best: 0.2130507485499535, dval: 0.1530369138795472\n",
      "Start iteration 24, value: 0.29083334957753326, best: 0.2130507485499535, dval: 0.2172621668556086\n",
      "Big value increase: val: 0.29083334957753326, e.val: 0.2130507485499535, max(α): 481.15924786347574\n",
      "Start iteration 25, value: 0.6592484842531185, best: 0.2130507485499535, dval: 0.5012847680734658\n",
      "Big value increase: val: 0.6592484842531185, e.val: 0.2130507485499535, max(α): 481.45847521439083\n",
      "Start iteration 26, value: 0.33488860260321796, best: 0.2130507485499535, dval: 0.22868598787866706\n",
      "Big value increase: val: 0.33488860260321796, e.val: 0.2130507485499535, max(α): 8273.18107253488\n",
      "Start iteration 27, value: 0.2702945354892117, best: 0.2130507485499535, dval: 0.15559862662756246\n",
      "Big value increase: val: 0.2702945354892117, e.val: 0.2130507485499535, max(α): 3604.8086634734955\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 28, value: 0.2728625501048178, best: 0.2130507485499535, dval: 0.12724265251757394\n",
      "Big value increase: val: 0.2728625501048178, e.val: 0.2130507485499535, max(α): 21839.598126592817\n",
      "Start iteration 29, value: 0.37041178924195467, best: 0.2130507485499535, dval: 0.46356889558322334\n",
      "Big value increase: val: 0.37041178924195467, e.val: 0.2130507485499535, max(α): 12014.552772730103\n",
      "Start iteration 30, value: 0.6195599531018594, best: 0.2130507485499535, dval: 0.5904068732443479\n",
      "Big value increase: val: 0.6195599531018594, e.val: 0.2130507485499535, max(α): 6415.028933900358\n",
      "Start iteration 31, value: 1.0256566031074725, best: 0.2130507485499535, dval: 1.240841321479641\n",
      "Big value increase: val: 1.0256566031074725, e.val: 0.2130507485499535, max(α): 4024.1327111153773\n",
      "Start iteration 32, value: 2.115987367078882, best: 0.2130507485499535, dval: 2.2180910379252055\n",
      "Big value increase: val: 2.115987367078882, e.val: 0.2130507485499535, max(α): 1395.6006254830213\n",
      "Start iteration 33, value: 2.032166316824992, best: 0.2130507485499535, dval: 2.0942028894735394\n",
      "Big value increase: val: 2.032166316824992, e.val: 0.2130507485499535, max(α): 577.1897136236279\n",
      "Start iteration 34, value: 0.2847599864023914, best: 0.2130507485499535, dval: 0.24773139861761337\n",
      "Big value increase: val: 0.2847599864023914, e.val: 0.2130507485499535, max(α): 243.77056547153703\n",
      "Start iteration 35, value: 0.7293034828849683, best: 0.2130507485499535, dval: 0.9347634766249553\n",
      "Big value increase: val: 0.7293034828849683, e.val: 0.2130507485499535, max(α): 216.76192379578114\n",
      "Start iteration 36, value: 0.4118810932661133, best: 0.2130507485499535, dval: 0.5087071760769932\n",
      "Big value increase: val: 0.4118810932661133, e.val: 0.2130507485499535, max(α): 171.66354274348166\n",
      "Start iteration 37, value: 0.3663239729456407, best: 0.2130507485499535, dval: 0.3316244920295981\n",
      "Big value increase: val: 0.3663239729456407, e.val: 0.2130507485499535, max(α): 200.66658631219568\n",
      "Start iteration 38, value: 0.48311672626204427, best: 0.2130507485499535, dval: 0.6435664464367539\n",
      "Big value increase: val: 0.48311672626204427, e.val: 0.2130507485499535, max(α): 56.88610514350932\n",
      "Start iteration 39, value: 0.2974209485507695, best: 0.2130507485499535, dval: 0.3173152514340663\n",
      "Big value increase: val: 0.2974209485507695, e.val: 0.2130507485499535, max(α): 60.47543607146752\n",
      "====================================\n",
      "3.524291196035274, 3.032507856574498, 7.661550028523938, 1.8949264987638261, 5.295209586807102, 4.193706236110965, 4.6707037616361795, 0.2615417685844803, 2.190476572366343, 7.373240021020585, 5.980446432155208, 1.2891736574933021, -1.3776209170579512, -3.6318458243469545, 4.645296874150045, -12.472436696778892, 3.671615131596173, 6.142185197300539, -0.13340460724359798, 3.8712588377754917, 4.425459624424573, 2.7418501036969825, 6.111645876540686, -1.5955474552319493, 0.6745647946853846, 1.1214380984040069, 5.7354535330300545\n",
      "====================================\n",
      "Start iteration 40, value: 0.20372399279302425, best: 0.20372399279302425, dval: 0.2304383414236506\n",
      "Start iteration 41, value: 2.652975593045517, best: 0.20372399279302425, dval: 2.670756045363916\n",
      "Big value increase: val: 2.652975593045517, e.val: 0.20372399279302425, max(α): 48.25894364711151\n",
      "====================================\n",
      "3.52429119603278, 3.03293414590405, 7.6612622164461195, 1.895556982081746, 5.295209044514092, 4.193706316527271, 4.670703762605938, 0.2615439255426485, 2.1904766180108037, 7.373239217077729, 5.980446432155205, 1.2895999468229369, -1.3830932169523558, -3.624378306364985, 4.645296900692943, -6.23534772431114, 3.671615131596173, 6.1421851973005355, -0.13137880383331837, 3.871258822830225, 4.425459472985371, 2.7418504942425272, 6.111645876540686, -1.5946613729123842, 0.674559844112022, 1.1214380984040069, 5.735420455848934\n",
      "====================================\n",
      "Start iteration 42, value: 0.20035826737252535, best: 0.20035826737252535, dval: 0.22733936102631944\n",
      "====================================\n",
      "3.524291195976108, 3.032955312951913, 7.66122699989621, 1.8956221008154508, 5.295208719825924, 4.19370633565927, 4.670703762714258, 0.2615457682910886, 2.1904766183907247, 7.37323858261682, 5.980446432155203, 1.2896211138708038, -1.3865213277974637, -3.6193759087891655, 4.645297029335012, -6.259418151052328, 3.671615131596173, 6.142185197300534, -0.13130014859464656, 3.871258821736733, 4.42545946246024, 2.741850813286406, 6.111645876540686, -1.5939968213629976, 0.6745556831036075, 1.1214380984040069, 5.735408192039678\n",
      "====================================\n",
      "Start iteration 43, value: 0.19901006352381198, best: 0.19901006352381198, dval: 0.22543396060206722\n",
      "====================================\n",
      "3.5242911932177794, 3.0336088485490618, 7.658864702542462, 1.8990381864356254, 5.295128528296869, 4.1937078755361545, 4.670703770511259, 0.2615862096664059, 2.190476623225606, 7.373233010384949, 5.980446432155201, 1.2902746494680757, -1.7921119823176979, -3.60371711787108, 4.645318624171447, -6.286184979868369, 3.671615131596173, 6.142185197300532, -0.12865099625982332, 3.871258795094325, 4.42545919982312, 2.741862843505278, 6.111645876540686, -1.589433293728237, 0.674462066300969, 1.1214380984040069, 5.7354118517063855\n",
      "====================================\n",
      "Start iteration 44, value: 0.15243715056611368, best: 0.15243715056611368, dval: 0.08220344765585262\n",
      "====================================\n",
      "3.5242911931989145, 3.0343283910420706, 7.655162779299813, 1.8996220524211935, 5.294087550988352, 4.193711510944223, 4.670703769827721, 0.26156875915223704, 2.190476620147269, 7.373232177798432, 5.980446432155201, 1.2909941919612202, -1.8047687947774043, -3.6158654421186274, 4.646594873083967, -6.322177608146931, 3.671615131596173, 6.142185197300532, -0.12709254541355447, 3.8712585004637523, 4.425455659560793, 2.7418778552109306, 6.111645876540686, -1.592897956577119, 0.6743246485940199, 1.1214380984040069, 5.735415557048278\n",
      "====================================\n",
      "Start iteration 45, value: 0.15135205436588078, best: 0.15135205436588078, dval: 0.08259251880470382\n",
      "Start iteration 46, value: 0.5404257724386256, best: 0.15135205436588078, dval: 0.5384267577169851\n",
      "Big value increase: val: 0.5404257724386256, e.val: 0.15135205436588078, max(α): 13.729088753265957\n",
      "====================================\n",
      "3.524291193186315, 3.0408649749005305, 7.530732722375297, 1.9141704591928703, 5.212552573544407, 4.193921559475641, 4.670703763741349, 0.261560292419846, 2.1904761989883945, 7.373229891519896, 5.980446432155204, 1.297530775820912, -1.8048759358857254, -3.7005080207487477, 4.761154738481275, -6.285920462921537, 3.671615131596173, 6.142185197300535, -0.12503378639482537, 3.8712502853205386, 4.425393185529597, 2.7419064413606296, 6.111645876540686, -1.657055624795, 0.6354975028102242, 1.1214380984040069, 5.735439530116037\n",
      "====================================\n",
      "Start iteration 47, value: 0.1335316464842587, best: 0.1335316464842587, dval: 0.037349582146745386\n",
      "====================================\n",
      "3.5242911931677434, 3.034049606073353, 7.523404625000285, 1.919174738134278, 5.205695338962747, 4.193985551696165, 4.670703763214331, 0.261560301727571, 2.1904761815257205, 7.373229930105457, 5.980446432155204, 1.2907154069924494, -1.8050236814512082, -3.7167523287216455, 4.787530291415186, -6.289526134817597, 3.671615131596173, 6.142185197300535, -0.1279958565913746, 3.871247758799601, 4.425376786307622, 2.74191396016448, 6.111645876540686, -1.6676633931622347, 0.6291909492800246, 1.1214380984040069, 5.735444778245189\n",
      "====================================\n",
      "Start iteration 48, value: 0.13192652700411817, best: 0.13192652700411817, dval: 0.031376610372484515\n",
      "Start iteration 49, value: 0.19254063338653876, best: 0.13192652700411817, dval: 0.23908384677221917\n",
      "Big value increase: val: 0.19254063338653876, e.val: 0.13192652700411817, max(α): 33.73695088398332\n",
      "====================================\n",
      "3.524291193147736, 3.0218225612532206, 7.471677243821168, 2.0460146250196782, 5.182637413906751, 4.194425758460743, 4.67070376305698, 0.2615603018555385, 2.190476142376423, 7.37323211213907, 5.980446432155198, 1.278488362170012, -1.8059728667858863, -3.7470839551991246, 4.804306282722385, -6.317755467662207, 3.671615131596173, 6.142185197300529, -0.14839064909794875, 3.8712195702360206, 4.425242699999043, 2.741929586674977, 6.111645876540686, -1.7050516930535045, 0.6112342802599218, 1.1214380984040069, 5.735556826603044\n",
      "====================================\n",
      "Start iteration 50, value: 0.1308508916603427, best: 0.1308508916603427, dval: 0.04626555660720075\n",
      "====================================\n",
      "3.5242911931478513, 3.015470666902457, 7.4648582547930316, 1.969462666253281, 5.191093671015777, 4.194602367940678, 4.67070376256504, 0.26156030090586657, 2.1904761252250005, 7.3732327143112455, 5.980446432155199, 1.272136467818051, -1.8056162368100357, -3.753783466390824, 4.803974202628609, -6.337683398883581, 3.671615131596173, 6.14218519730053, -0.16373456458933314, 3.871219256913973, 4.4252475129573465, 2.7419259926498185, 6.111645876540686, -1.70676273248016, 0.603008267370268, 1.1214380984040069, 5.735558917574418\n",
      "====================================\n",
      "Start iteration 51, value: 0.12797706685869947, best: 0.12797706685869947, dval: 0.022336030739897123\n",
      "====================================\n",
      "3.5242911931477363, 2.966638302869021, 7.451727241321393, 1.9622290678123275, 5.233116354561751, 4.195279092838387, 4.670703762400115, 0.2615603000986034, 2.1904761115547617, 7.373235936861677, 5.980446432155202, 1.2233041037754102, -1.8055598489758984, -3.769603035906597, 4.802370083384671, -6.346634460777603, 3.671615131596173, 6.142185197300533, -0.16294517776120043, 3.871218914076089, 4.425244289324306, 2.741922637955001, 6.111645876540686, -1.7108814281604194, 0.5935434173807778, 1.1214380984040069, 5.735561805657594\n",
      "====================================\n",
      "Start iteration 52, value: 0.12737508837370473, best: 0.12737508837370473, dval: 0.04751043434704694\n",
      "====================================\n",
      "3.52429119314753, 2.991791658994851, 7.436674113964041, 1.9504824082037826, 5.206814515742081, 4.196209086090436, 4.670703761985541, 0.2615602992311541, 2.190476120015307, 7.3732442218964, 5.98044643215521, 1.2484574599059817, -1.8055839163994851, -3.840434529023844, 4.799911297482724, -6.355180474087999, 3.671615131596173, 6.142185197300541, -0.16210868503779174, 3.8712180167327634, 4.425238190836316, 2.741878091158943, 6.111645876540686, -1.747960018316909, 0.5904473463104514, 1.1214380984040069, 5.735570610899446\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 53, value: 0.1261566590544469, best: 0.1261566590544469, dval: 0.029170881023239767\n",
      "====================================\n",
      "3.5242911931471377, 2.9824893232849887, 7.4290394711911185, 1.9493795130770473, 5.219431304393027, 4.1966453220447555, 4.670703761756134, 0.2615601925296448, 2.190476126277672, 7.3732688294871345, 5.980446432155301, 1.2391551241943657, -1.8056171598485342, -3.8353636461398883, 4.788480330360732, -6.358883358977123, 3.671615131596173, 6.142185197300631, -0.16034117243169518, 3.871217368562787, 4.4252349578157295, 2.74161314036039, 6.111645876540686, -1.7378681748352636, 0.582539764222474, 1.1214380984040069, 5.73559507418305\n",
      "====================================\n",
      "Start iteration 54, value: 0.12552037225839946, best: 0.12552037225839946, dval: 0.02729349173485285\n",
      "====================================\n",
      "3.524291193141437, 2.9737791305120087, 7.40311194891313, 1.9491556635327298, 5.255974430972347, 4.198522839394898, 4.670703760877041, 0.2615589538848678, 2.1904761398246833, 7.373365249891051, 5.980446432156148, 1.2304449314197432, -1.806127997282178, -3.8393202806668443, 4.75117047938795, -6.357956219200681, 3.671615131596173, 6.142185197301479, -0.15339282111182004, 3.8712150143092776, 4.425226545106471, 2.6543742287976864, 6.111645876540686, -1.7395239001296907, 0.5777560979822016, 1.1214380984040069, 5.735976484025035\n",
      "====================================\n",
      "Start iteration 55, value: 0.12420945137759591, best: 0.12420945137759591, dval: 0.03172257207930987\n",
      "Start iteration 56, value: 0.1249588049076983, best: 0.12420945137759591, dval: 0.08643766076378656\n",
      "====================================\n",
      "3.5242911931196224, 2.9352813467966397, 7.200260543550247, 1.9492670009045003, 5.295797520629355, 4.213645681646788, 4.670703761234157, 0.26155484201774704, 2.1904761405389386, 7.3737483955182, 5.9804464321671515, 1.1919471476971237, -1.8069754423913296, -3.855617228696288, 4.759675250829046, -6.360085112702896, 3.671615131596173, 6.142185197312482, -0.07913467584657832, 3.8712094637934666, 4.4252094950656, 2.6764237574544456, 6.111645876540686, -1.7451804273694718, 0.5456315474450522, 1.1214380984040069, 5.7373230292008115\n",
      "====================================\n",
      "Start iteration 57, value: 0.12171246693259771, best: 0.12171246693259771, dval: 0.06412478148233568\n",
      "Start iteration 58, value: 0.13072587186810325, best: 0.12171246693259771, dval: 0.08199198776796415\n",
      "====================================\n",
      "3.5242911931022003, 2.9320751077225227, 7.248639149659404, 1.9496692251954992, 5.301798524112348, 4.218157233796388, 4.670703762944722, 0.26155886602644973, 2.1904761162985307, 7.374232836607431, 5.98044643220231, 1.1744440335712174, -1.8069734100754664, -3.8813121807682847, 4.75248563979308, -6.421169563694739, 3.671615131596173, 6.142185197347641, -0.16477388908184404, 3.871371356583722, 4.425399978486668, 2.583965095019499, 6.111645876540686, -1.7615136114651053, 0.5260558690781358, 1.1214380984040069, 5.7361902960422455\n",
      "====================================\n",
      "Start iteration 59, value: 0.11911662216662913, best: 0.11911662216662913, dval: 0.051811356629422406\n",
      "====================================\n",
      "3.524291193095127, 2.9311051133257604, 7.246618766734473, 1.949877248101277, 5.305115870596072, 4.220188036462356, 4.670703763873344, 0.26155758444973404, 2.1904761190012767, 7.374486878666901, 5.980446432340993, 1.1673334963546331, -1.8069749191421696, -3.9019597645336495, 4.752209990262493, -6.419643933458748, 3.671615131596173, 6.142185197486324, -0.14232406278276033, 3.871286444850316, 4.42530380282562, 2.628614585689492, 6.111645876540686, -1.7763549818726545, 0.5449523438481408, 1.1214380984040069, 5.736616337270524\n",
      "====================================\n",
      "Start iteration 60, value: 0.11749270120278471, best: 0.11749270120278471, dval: 0.03272522340404359\n",
      "Start iteration 61, value: 0.1467904303709493, best: 0.11749270120278471, dval: 0.1874959261419914\n",
      "Big value increase: val: 0.1467904303709493, e.val: 0.11749270120278471, max(α): 69.53033023385926\n",
      "Start iteration 62, value: 0.7297264246802413, best: 0.11749270120278471, dval: 1.0926265197422667\n",
      "Big value increase: val: 0.7297264246802413, e.val: 0.11749270120278471, max(α): 259.47922052452805\n",
      "====================================\n",
      "3.524291193089033, 2.9077306233303806, 7.241351699986928, 1.9501936249294278, 5.328360424934734, 4.267012423286739, 4.670703765256131, 0.26155692264837654, 2.1904761183410644, 7.423387288104605, 5.98044643656874, 0.9959869591111198, -1.8069805375514143, -3.9079042803639648, 4.751315247456118, -6.408907044829417, 3.671615131596173, 6.142185201714071, -0.14302328377477483, 3.8712825611813453, 4.425238663799127, 2.6362542668521667, 6.111645876540686, -1.7743227479500554, 0.5731865923195514, 1.1214380984040069, 5.736805000175667\n",
      "====================================\n",
      "Start iteration 63, value: 0.11743720511192188, best: 0.11743720511192188, dval: 0.08045282158662764\n",
      "====================================\n",
      "3.5242911930885645, 2.9107269035010255, 7.23786886804383, 1.9501913702847606, 5.336637177808781, 4.302977524918405, 4.670703765253719, 0.26155687866809185, 2.190476118651577, 7.405501698161589, 5.980446438023004, 1.0179511701785238, -1.806983205527792, -3.9080380285650387, 4.751294309726969, -6.405751944888551, 3.671615131596173, 6.142185203168335, -0.14135096384399165, 3.87127603762662, 4.425221948854518, 2.6361829916257613, 6.111645876540686, -1.7743409807084476, 0.5765941688234062, 1.1214380984040069, 5.737017433940805\n",
      "====================================\n",
      "Start iteration 64, value: 0.11445722413266006, best: 0.11445722413266006, dval: 0.057425168503345114\n",
      "====================================\n",
      "3.524291193086034, 2.9138864950351007, 7.2291835621432305, 1.9501914114485221, 5.408367338857677, 4.335937215494825, 4.670703765255382, 0.2615567782249047, 2.1904761266060597, 7.390734339034225, 5.980446456286156, 1.0411125340660246, -1.8069894562969906, -3.908100810709429, 4.751223763999579, -6.4072484489810595, 3.671615131596173, 6.142185221431487, -0.12384335654151592, 3.8711530176781137, 4.424984187401635, 2.6360898965700983, 6.111645876540686, -1.7743294146459834, 0.6258728737830846, 1.1214380984040069, 5.738400637749042\n",
      "====================================\n",
      "Start iteration 65, value: 0.11175942449793644, best: 0.11175942449793644, dval: 0.03526215073629436\n",
      "Start iteration 66, value: 0.12049576828916816, best: 0.11175942449793644, dval: 0.10243614056465597\n",
      "====================================\n",
      "3.524291193094468, 2.913078007862113, 7.222274246609651, 1.950191391974107, 5.396918183921871, 4.450703378570264, 4.670703765253905, 0.26155679857341174, 2.1904761590672255, 7.392987189248424, 5.980446578310418, 0.9817296770755916, -1.8069898985473805, -3.9081799264118566, 4.751127952664724, -6.4111495743695865, 3.671615131596173, 6.142185343455749, -0.029901595457739752, 3.869574695403033, 4.423489343289367, 2.635574144149172, 6.111645876540686, -1.774244124705653, 0.6207512818779348, 1.1214380984040069, 5.769285701720389\n",
      "====================================\n",
      "Start iteration 67, value: 0.10813142837757482, best: 0.10813142837757482, dval: 0.04629379451127513\n",
      "====================================\n",
      "3.5242911931027274, 2.9129569232676022, 7.221250131645366, 1.9501912657128069, 5.39772939781129, 4.450379494833971, 4.670703765251627, 0.2615567960332476, 2.1904761661117016, 7.35566634281887, 5.9804466860559, 0.9584416089275758, -1.8069893783341335, -3.9081648744255997, 4.751118851688914, -6.421224016671472, 3.671615131596173, 6.142185451201231, -0.016862565104662768, 3.8692390045675626, 4.423170060570474, 2.6348984418253005, 6.111645876540686, -1.7742080327159528, 0.6220364349779527, 1.1214380984040069, 5.775442799727979\n",
      "====================================\n",
      "Start iteration 68, value: 0.10762111156017297, best: 0.10762111156017297, dval: 0.044439841733272284\n",
      "====================================\n",
      "3.524291193131568, 2.9127998324941773, 7.218879386970007, 1.9501906624966814, 5.401147778523997, 4.450606839554624, 4.670703765227442, 0.26155679241133983, 2.1904761899276433, 7.386675825366944, 5.980447935124631, 0.9282285116154632, -1.8069842711808966, -3.9080492487595877, 4.751020463707701, -6.449640854660164, 3.671615131596173, 6.142186700269962, 0.016693614970638086, 3.8649826317813796, 4.418989098019866, 2.6187016407589914, 6.111645876540686, -1.7739424547526266, 0.6223710283873909, 1.1214380984040069, 5.854247686519338\n",
      "====================================\n",
      "Start iteration 69, value: 0.10675008964857448, best: 0.10675008964857448, dval: 0.03852090500574984\n",
      "====================================\n",
      "3.5242911931696304, 2.9126574910288743, 7.209995008817316, 1.9501828513706498, 5.406034181253749, 4.450892941985163, 4.6707037644778415, 0.2615567846944803, 2.19047617691238, 7.377764512468585, 5.980454999866412, 0.9008521326660123, -1.8069809221464406, -3.9080358374413366, 4.750667689493386, -6.450752929020322, 3.671615131596173, 6.142193765011743, -0.008548119767117134, 3.8674328292707973, 4.421423722075522, 2.5132915875696775, 6.111645876540686, -1.773643175248314, 0.6229048630894799, 1.1214380984040069, 5.804425885732032\n",
      "====================================\n",
      "Start iteration 70, value: 0.10460568472680196, best: 0.10460568472680196, dval: 0.054007846495930434\n",
      "====================================\n",
      "3.5242911932031706, 2.9127646956929234, 7.1936833357173, 1.9501869688349938, 5.412147951816004, 4.451894027583372, 4.670703764549124, 0.2615567653106609, 2.19047617871278, 7.381924008947046, 5.980515987649192, 0.921470688909693, -1.8069836552999659, -3.90801426372726, 4.750531238545469, -6.451922508777225, 3.671615131596173, 6.142254752794523, -0.007224575065415521, 3.866498013028402, 4.420498865478498, 2.5411582637118446, 6.111645876540686, -1.7432033444308435, 0.6237424135372099, 1.1214380984040069, 5.808903180926573\n",
      "====================================\n",
      "Start iteration 71, value: 0.10342957732347101, best: 0.10342957732347101, dval: 0.03959197517217644\n",
      "====================================\n",
      "3.5242911932930765, 2.912756862493675, 7.167053719433246, 1.9502115494175172, 5.446292981080688, 4.455088331263947, 4.670703764534959, 0.26155671906688527, 2.1904761773594763, 7.384173775722103, 5.984345855455128, 0.9199641382320339, -1.8069848792173975, -3.9080331395953034, 4.750115246347158, -6.457643015423499, 3.671615131596173, 6.14608462060046, -0.008353051104600193, 3.861560333822623, 4.415758819529138, 2.53373817353455, 6.111645876540686, -1.7618324880317129, 0.6248903109138819, 1.1214380984040069, 5.806315105590873\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 72, value: 0.10182960985329065, best: 0.10182960985329065, dval: 0.03831036605821768\n",
      "====================================\n",
      "3.5242911934416363, 2.9127479249785657, 7.06182803308474, 1.95158169928849, 5.461905220240903, 4.550573719102616, 4.67070376451911, 0.2615567285697532, 2.1904761745017383, 7.3892263309736625, 6.023241347237617, 0.9182451956879453, -1.8069858129910805, -3.908044117387343, 4.749144048853777, -6.471553207828061, 3.671615131596173, 6.1849801123829575, -0.010753141623488623, 3.862699214556773, 4.416860335183872, 2.520107157215397, 6.111645876540686, -1.7553711874510942, 0.626136156120185, 1.1214380984040069, 5.8020906858719075\n",
      "====================================\n",
      "Start iteration 73, value: 0.10027262549361969, best: 0.10027262549361969, dval: 0.07460920145546149\n",
      "Start iteration 74, value: 1.2391168206525423, best: 0.10027262549361969, dval: 1.5206562354155522\n",
      "Big value increase: val: 1.2391168206525423, e.val: 0.10027262549361969, max(α): 73.6827208379171\n",
      "====================================\n",
      "3.5242912007405076, 2.912744902798177, 7.071200202237823, 1.9541643512587779, 5.498627117867011, 4.449149863006059, 4.670703764540316, 0.26155672858539725, 2.1904761744192487, 7.381117353160483, 6.051122369621669, 0.9176639430262643, -1.8069829351091107, -3.9080440427241023, 4.717869939577488, -6.576415033916698, 3.671615131596173, 6.212861134767015, -0.010755794260725792, 3.862719033007765, 4.416879820762203, 2.5179967737416797, 6.111645876540686, -1.7552771822461795, 0.6263232071991629, 1.1214380984040069, 5.805766471564639\n",
      "====================================\n",
      "Start iteration 75, value: 0.09646358036638078, best: 0.09646358036638078, dval: 0.036551906013533586\n",
      "====================================\n",
      "3.5242911982841316, 2.9127436678835004, 7.071550617960637, 1.9543626664188938, 5.499419512111565, 4.45657824814574, 4.670703764540739, 0.26155672841220556, 2.1904761741248064, 7.3810600659109245, 6.075936239287607, 0.9174264332318449, -1.8069818131179256, -3.908044269077129, 4.688454831217765, -6.553367224561111, 3.671615131596173, 6.237675004432958, -0.01077724632026825, 3.862725472350187, 4.416886418918111, 2.5165668528400666, 6.111645876540686, -1.7553988451512608, 0.6258896376439511, 1.1214380984040069, 5.805720162745105\n",
      "====================================\n",
      "Start iteration 76, value: 0.09441374817209285, best: 0.09441374817209285, dval: 0.03819234138871176\n",
      "====================================\n",
      "3.5242911956818, 2.912670452459129, 7.072208739161524, 1.9576012675358303, 5.503259935964195, 4.474647560229179, 4.67070376454409, 0.2615567278813281, 2.190476173020233, 7.38093522217404, 6.187972333825179, 0.9033449904258657, -1.806966989443691, -3.9080458560621865, 4.672907242942207, -6.545409781802294, 3.671615131596173, 6.3497110989705545, -0.010821346328131615, 3.862722549291704, 4.4168836630417285, 2.5092511149181465, 6.111645876540686, -1.7558444253303098, 0.6246783166085382, 1.1214380984040069, 5.8056601068962586\n",
      "====================================\n",
      "Start iteration 77, value: 0.09009036502373695, best: 0.09009036502373695, dval: 0.05990226774245187\n",
      "Start iteration 78, value: 0.5915725940032704, best: 0.09009036502373695, dval: 0.7663389627120402\n",
      "Big value increase: val: 0.5915725940032704, e.val: 0.09009036502373695, max(α): 38.643385098254626\n",
      "====================================\n",
      "3.524291193510187, 2.9123181585354203, 7.072222593990955, 1.9586058822771537, 5.514614867951996, 4.4847712606472605, 4.670703764546828, 0.261556725413878, 2.1904761729106714, 7.379594977012248, 6.473272718862012, 0.8355886838797923, -1.8069521718208088, -3.9081001374150994, 4.683826805586547, -6.552319344219531, 3.671615131596173, 6.635011484007449, -0.010822459233334737, 3.862722551508337, 4.416883666074232, 2.498340574815917, 6.111645876540686, -1.7573109687705237, 0.6239703967246898, 1.1214380984040069, 5.8056595502459025\n",
      "====================================\n",
      "Start iteration 79, value: 0.08695816577994656, best: 0.08695816577994656, dval: 0.08349708679033363\n",
      "====================================\n",
      "3.5242911862578503, 2.912121735959658, 7.072234796388322, 1.9587872268647666, 5.515411428221604, 4.484741253433531, 4.6707037645488505, 0.26155672511247247, 2.190476172863533, 7.379596915126234, 6.436696629421969, 0.797810943872787, -1.8069401436479662, -3.9081087290241663, 4.6841787708991, -6.554228201555029, 3.671615131596173, 6.598435394567398, -0.010822884638718468, 3.8627226007023068, 4.416883722456782, 2.4918748481601867, 6.111645876540686, -1.7571603946212093, 0.6237012657565809, 1.1214380984040069, 5.805658851111291\n",
      "====================================\n",
      "Start iteration 80, value: 0.08569525043706902, best: 0.08569525043706902, dval: 0.07954377361698461\n",
      "====================================\n",
      "3.52429081090214, 2.9121045230481966, 7.072228075239789, 1.9588254554762807, 5.53143884800335, 4.484765218123909, 4.670703764582481, 0.2615567201734627, 2.190476172864288, 7.379597987689296, 6.368714492155048, 0.7945004033637246, -1.8069168085151002, -3.9081511650527254, 4.685815116563287, -6.563416219733887, 3.671615131596173, 6.530453257300462, -0.010822668199568663, 3.862722637696767, 4.416883764255589, 2.476170042186176, 6.111645876540686, -1.756910606499572, 0.6237696291357804, 1.1214380984040069, 5.805658819226911\n",
      "====================================\n",
      "Start iteration 81, value: 0.08364768551109829, best: 0.08364768551109829, dval: 0.0697116651783384\n",
      "====================================\n",
      "3.524287170283099, 2.912117497289157, 7.07221480954044, 1.9588682213618964, 5.64507654112582, 4.484811092735238, 4.6707037652341645, 0.2615566687968912, 2.190476172863655, 7.379600951662228, 6.362096693133865, 0.7969957249930193, -1.8068772437486729, -3.9083237503526655, 4.693045318001083, -6.603864825609642, 3.671615131596173, 6.523835458279278, -0.010821364839848503, 3.8627226469008282, 4.416883774053136, 2.4426815894808174, 6.111645876540686, -1.7566238182027776, 0.623873701039042, 1.1214380984040069, 5.805658757940375\n",
      "====================================\n",
      "Start iteration 82, value: 0.07663260162074063, best: 0.07663260162074063, dval: 0.04881381462837964\n",
      "Start iteration 83, value: 0.08989919359662271, best: 0.07663260162074063, dval: 0.13907454731512647\n",
      "Big value increase: val: 0.08989919359662271, e.val: 0.07663260162074063, max(α): 34.74364555738207\n",
      "====================================\n",
      "3.524287672132476, 2.9121658226398206, 7.072130251865893, 1.9590616502301477, 5.871241580063704, 4.485035157260948, 4.6707037669229745, 0.2615563576371633, 2.1904761728620064, 7.379614447056742, 6.399976137004272, 0.8062900870389844, -1.806876054646534, -3.9110924984943605, 4.691819466241585, -7.020576810305548, 3.671615131596173, 6.561714902149695, -0.010824880416903717, 3.8627227229099192, 4.416883860366026, 2.423551536690249, 6.111645876540686, -1.7552246522493264, 0.6244071842538125, 1.1214380984040069, 5.805658566501334\n",
      "====================================\n",
      "Start iteration 84, value: 0.07363102168873428, best: 0.07363102168873428, dval: 0.09030719847059214\n",
      "Start iteration 85, value: 0.17629450626598003, best: 0.07363102168873428, dval: 0.36194857264921443\n",
      "Big value increase: val: 0.17629450626598003, e.val: 0.07363102168873428, max(α): 10.097167771902205\n",
      "Start iteration 86, value: 0.5992987541812743, best: 0.07363102168873428, dval: 1.023861576717518\n",
      "Big value increase: val: 0.5992987541812743, e.val: 0.07363102168873428, max(α): 23.66984423720838\n",
      "====================================\n",
      "3.5242871518695877, 2.9122511266714337, 7.072039848387375, 1.959081287484389, 6.139226910547715, 4.485419180148018, 4.670703768055927, 0.2615560475417806, 2.1904761728520654, 7.3796316662681285, 6.483925697506482, 0.8226965185061722, -1.8068753443106094, -3.9936652498198253, 4.689450182550642, -7.0309825792181, 3.671615131596173, 6.645664462651929, -0.010871167162208302, 3.8627231648293834, 4.416884377879469, 2.280611152715359, 6.111645876540686, -1.715776775944104, 0.6348479228283715, 1.1214380984040069, 5.805655023574189\n",
      "====================================\n",
      "Start iteration 87, value: 0.06158382791442009, best: 0.06158382791442009, dval: 0.11210178870607905\n",
      "====================================\n",
      "3.5242871684480077, 2.912257110248801, 7.072033301774504, 1.9590814999277038, 6.1032764774375785, 4.485466022186657, 4.670703768069229, 0.26155600860892186, 2.1904761728489146, 7.379634941943903, 6.480042276169706, 0.8238473334225231, -1.8068753559933974, -3.9926930288820577, 4.689230723210664, -7.047019371181161, 3.671615131596173, 6.641781041315152, -0.01109518909395285, 3.862723785139592, 4.416885090060773, 2.28828778555859, 6.111645876540686, -1.6959602339037056, 0.6407193984043876, 1.1214380984040069, 5.8055352002881335\n",
      "====================================\n",
      "Start iteration 88, value: 0.0594514003421513, best: 0.0594514003421513, dval: 0.1043032785882047\n",
      "====================================\n",
      "3.524287154394897, 2.912334475633603, 7.071990340690078, 1.959091652045144, 6.073865878956893, 4.4860925236762945, 4.670703768091526, 0.26155589485851993, 2.1904761725638044, 7.37967757426013, 6.444795249638015, 0.8387269335970318, -1.8068753733744132, -3.9936024908598706, 4.687962453006518, -7.044475914935785, 3.671615131596173, 6.606534014783453, -0.01521155832952839, 3.8627286435019648, 4.416890630284921, 2.29512734440823, 6.111645876540686, -1.6015667412888304, 0.6890660375743483, 1.1214380984040069, 5.802738130285791\n",
      "====================================\n",
      "Start iteration 89, value: 0.05608793073770366, best: 0.05608793073770366, dval: 0.11027381627521786\n",
      "Start iteration 90, value: 0.07600192059464231, best: 0.05608793073770366, dval: 0.16307801344690143\n",
      "Big value increase: val: 0.07600192059464231, e.val: 0.05608793073770366, max(α): 12.890326570058962\n",
      "Start iteration 91, value: 0.10200119359042358, best: 0.05608793073770366, dval: 0.21392995744189797\n",
      "Big value increase: val: 0.10200119359042358, e.val: 0.05608793073770366, max(α): 6.585484842352543\n",
      "====================================\n",
      "3.524286851842524, 2.9134724315606375, 7.071824127423192, 1.9591176769846914, 6.094824198595477, 4.490880777830057, 4.6707037994818865, 0.26155505257872075, 2.190476169338161, 7.380438456688803, 6.45717104225676, 1.0575887573157894, -1.8068753555591326, -4.006483757503948, 4.679121497394607, -7.0280639728970895, 3.671615131596173, 6.618909807402201, -0.27395547364910944, 3.862730998270764, 4.4168932556222815, 2.2848652491922734, 6.111645876540686, -1.5984480509443004, 0.6990666775527673, 1.1214380984040069, 5.743138739404425\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 92, value: 0.04488494194439983, best: 0.04488494194439983, dval: 0.04646651397559777\n",
      "====================================\n",
      "3.524286632588683, 2.913318066806677, 7.071830460539047, 1.9591440874527262, 6.106827107911059, 4.490664227226794, 4.670703908973808, 0.2615548319955711, 2.190476169287022, 7.380492462196243, 6.455290166271845, 1.0278999523567787, -1.8068753543038825, -4.054900162401486, 4.6814486538955675, -7.030150023675151, 3.671615131596173, 6.617028931417286, -0.25508340406692914, 3.8627309154379392, 4.41689321363993, 2.2826456387228062, 6.111645876540686, -1.596812579665257, 0.6990305783830232, 1.1214380984040069, 5.75104206832864\n",
      "====================================\n",
      "Start iteration 93, value: 0.04301815077553887, best: 0.04301815077553887, dval: 0.04388020362798917\n",
      "====================================\n",
      "3.52428627516593, 2.9131174858726836, 7.0718288449269, 1.9592204345972688, 6.130118375893117, 4.490807335902829, 4.670704395855321, 0.26155108950831246, 2.190476169113507, 7.3806567224006425, 6.448030822553267, 0.9893224398415483, -1.806875350541664, -4.061034858046618, 4.681273211804753, -7.035235147948015, 3.671615131596173, 6.609769587698708, -0.2424920853037148, 3.862730943563031, 4.416893236677805, 2.2641126394207203, 6.111645876540686, -1.588641904285269, 0.6990460684247113, 1.1214380984040069, 5.756688846306587\n",
      "====================================\n",
      "Start iteration 94, value: 0.04141048236297922, best: 0.04141048236297922, dval: 0.0452175336990296\n",
      "====================================\n",
      "3.5242859981568166, 2.9131801820149157, 7.07182702895841, 1.9595661367036634, 6.143208328982023, 4.491000539927744, 4.670707489653541, 0.26142454928656705, 2.190476168152626, 7.384079806237795, 6.443506940589189, 1.0013807205737406, -1.8068753460133393, -4.074991211992818, 4.680988759388925, -7.04875737300927, 3.671615131596173, 6.60524570573463, -0.24221731515834383, 3.8627309368530027, 4.416893230870501, 2.229300239087966, 6.111645876540686, -1.5075579257836864, 0.6990621925707063, 1.1214380984040069, 5.757925693309571\n",
      "====================================\n",
      "Start iteration 95, value: 0.03815426752801695, best: 0.03815426752801695, dval: 0.05389294436218736\n",
      "====================================\n",
      "3.524285517982776, 2.913339294628799, 7.071698466697845, 1.9786883677885165, 6.303372305257457, 4.491600227246426, 4.6707308665766325, 0.26063846256457873, 2.190476166757168, 7.42793279633783, 6.4213538713141824, 1.0319826762592348, -1.806875198708483, -4.093070760042329, 4.681223539539234, -7.259028444796893, 3.671615131596173, 6.583092636459624, -0.2424899464454759, 3.862730929751968, 4.416893224536422, 2.192825168408202, 6.111645876540686, -1.4634698603332428, 0.699102406158409, 1.1214380984040069, 5.757330474701244\n",
      "====================================\n",
      "Start iteration 96, value: 0.035860192530374146, best: 0.035860192530374146, dval: 0.08724998807263015\n",
      "Start iteration 97, value: 0.045367536570820655, best: 0.035860192530374146, dval: 0.10540036862412622\n",
      "Big value increase: val: 0.045367536570820655, e.val: 0.035860192530374146, max(α): 17.72891482445965\n",
      "Start iteration 98, value: 0.036531338568150294, best: 0.035860192530374146, dval: 0.08571385412479574\n",
      "====================================\n",
      "3.5242850619430897, 2.914036686082402, 7.070804335240947, 1.9801873645994488, 6.278513197077439, 4.505653750789124, 4.6712305278689845, 0.2502429103162499, 2.1904760036571402, 7.566991929535229, 6.406520328302894, 1.1661112147689674, -1.8068701233141644, -4.181293543929179, 4.683862839679106, -7.1642939130010355, 3.671615131596173, 6.5682590934483365, -0.25109707010668797, 3.8627307874813956, 4.416893163663346, 2.1114494950932534, 6.111645876540686, -1.250618751516751, 0.6993855283942405, 1.1214380984040069, 5.752941122410843\n",
      "====================================\n",
      "Start iteration 99, value: 0.03553578665934368, best: 0.03553578665934368, dval: 0.07513373466101142\n",
      "====================================\n",
      "3.5242851888840154, 2.9135078356996025, 7.070989350231604, 1.9804429475617888, 6.277395782964995, 4.506302235937227, 4.67207532940167, 0.23595837606512096, 2.190474727053425, 7.4999390491135856, 6.402383290393372, 1.133106522353926, -1.806864054690181, -4.218181024546046, 4.6839488544580945, -7.195157297214105, 3.671615131596173, 6.564122055538815, -0.38372254798461414, 3.862730725302741, 4.416893140569032, 2.1111999667927264, 6.111645876540686, -1.3780691888729506, 0.6995105269254869, 1.1214380984040069, 5.749377460353339\n",
      "====================================\n",
      "Start iteration 100, value: 0.02426103587248404, best: 0.02426103587248404, dval: 0.06630533304482994\n",
      "Start iteration 101, value: 0.03758167978335853, best: 0.02426103587248404, dval: 0.1403936836021616\n",
      "Big value increase: val: 0.03758167978335853, e.val: 0.02426103587248404, max(α): 8.851102850341396\n",
      "Start iteration 102, value: 0.026945268854324196, best: 0.02426103587248404, dval: 0.08356861927834763\n",
      "Big value increase: val: 0.026945268854324196, e.val: 0.02426103587248404, max(α): 35.464101928242336\n",
      "====================================\n",
      "3.524285185138792, 2.9135676132771366, 7.0578337061338825, 2.0011514528708902, 6.277145909129403, 4.5088662561160895, 4.749204526180628, 0.0604578955567047, 2.190474651911935, 7.4942230017145715, 6.378795609002508, 1.1368371437621878, -1.8068531748793446, -4.223136336955443, 4.684102267947458, -7.23576264992939, 3.671615131596173, 6.540534374147953, -0.39274129602709057, 3.8627306583105496, 4.416893066094166, 2.1104858663962895, 6.111645876540686, -1.3084047772526943, 0.7352676821202304, 1.1214380984040069, 5.7948848304784555\n",
      "====================================\n",
      "Start iteration 103, value: 0.013775110933674133, best: 0.013775110933674133, dval: 0.04340315504626058\n",
      "====================================\n",
      "3.52428518854937, 2.9135618831130525, 7.052235533246654, 2.001295027945145, 6.272845714057122, 4.509447008884672, 4.738412137506133, 0.053583666683743786, 2.190474639720901, 7.495333358921021, 6.381828397393666, 1.1364795335396547, -1.8068506729891962, -4.224076625968035, 4.684055229979342, -7.245527074639203, 3.671615131596173, 6.54356716253911, -0.39540388375140223, 3.862730651901352, 4.416892991113848, 2.110153765114051, 6.111645876540686, -1.3090734948663965, 0.7358832484071332, 1.1214380984040069, 5.814109727425605\n",
      "====================================\n",
      "Start iteration 104, value: 0.013007644694629233, best: 0.013007644694629233, dval: 0.041090908370754575\n",
      "====================================\n",
      "3.5242852049007976, 2.9135522027040617, 7.047731521664463, 2.001917412968389, 6.2502232695559385, 4.517927380017799, 4.739186371044593, 0.01775712933656006, 2.1904745217234476, 7.528797139592702, 6.38102333369733, 1.135875394956066, -1.8065641598949485, -4.227290203568699, 4.683660521410855, -7.312315268355522, 3.671615131596173, 6.542762098842774, -0.41009385755878824, 3.8627305909337797, 4.416891975805775, 2.0198908771428443, 6.111645876540686, -1.3086707713697938, 0.743360028809643, 1.1214380984040069, 5.8194110528651875\n",
      "====================================\n",
      "Start iteration 105, value: 0.00825311402799963, best: 0.00825311402799963, dval: 0.024974300846925652\n",
      "====================================\n",
      "3.5242852126175337, 2.913558075437509, 7.041918891903804, 2.0053571525137226, 6.252640297415705, 4.631501417970204, 4.739985534054042, -0.025668809798323325, 2.190474352548177, 7.508097090954539, 6.380025014104075, 1.1362419027007495, -1.8064860589872835, -4.236258078899635, 4.683980004533109, -7.340307429146158, 3.671615131596173, 6.541763779249519, -0.42412757385654504, 3.862729340677536, 4.4168645731539815, 2.020090418418229, 6.111645876540686, -1.308205747532069, 0.8244602626509974, 1.1214380984040069, 5.827903391192641\n",
      "====================================\n",
      "Start iteration 106, value: 0.0081648918874318, best: 0.0081648918874318, dval: 0.037528592717525566\n",
      "====================================\n",
      "3.5242852301472296, 2.9135539008183065, 7.045643154674492, 2.0059012050213396, 6.255396789276499, 4.567031161714649, 4.741273959974253, -0.07519111364884605, 2.190474427460879, 7.513954445954781, 6.378698171586107, 1.1359813715047464, -1.8063938397518802, -4.232417964485981, 4.686393682474004, -7.331912313510709, 3.671615131596173, 6.540436936731551, -0.4140063632890084, 3.862726531055904, 4.416857804536143, 2.0198913600332777, 6.111645876540686, -1.3075208319136122, 0.7687113737069884, 1.1214380984040069, 5.837368141913009\n",
      "====================================\n",
      "Start iteration 107, value: 0.006372384348178539, best: 0.006372384348178539, dval: 0.024701769147359\n",
      "====================================\n",
      "3.5242852865835252, 2.9135507197586694, 7.045943162745507, 2.0064886887344606, 6.254945306646748, 4.57182082538365, 4.7483100688127955, -0.04626806414449306, 2.1904744037459976, 7.5202801321946415, 6.376949494706113, 1.1357828467455986, -1.8063202681576156, -4.225999399873051, 4.685891950194549, -7.338856320419321, 3.671615131596173, 6.538688259851557, -0.41466650622585505, 3.8627063028603286, 4.416845647066387, 2.0195080153770566, 6.111645876540686, -1.303262878193533, 0.7789261006683424, 1.1214380984040069, 5.842951468697525\n",
      "====================================\n",
      "Start iteration 108, value: 0.0057252645188750435, best: 0.0057252645188750435, dval: 0.023104594151071634\n",
      "====================================\n",
      "3.5242854725127915, 2.913542169376699, 7.046546313781803, 2.00706831939026, 6.255110068484081, 4.587934424299046, 4.763826719421901, -0.048029124066614026, 2.1904742874413086, 7.516583475475867, 6.371229332708724, 1.135249231310813, -1.8052333595148442, -4.228431669928242, 4.686143766063787, -7.345160009752776, 3.671615131596173, 6.532968097854168, -0.41496651424253544, 3.8625977718202202, 4.416782868639807, 2.0139625850249914, 6.111645876540686, -1.2904030954359103, 0.7767477435131899, 1.1214380984040069, 5.908501180571913\n",
      "====================================\n",
      "Start iteration 109, value: 0.004858970602303876, best: 0.004858970602303876, dval: 0.025331356231224122\n",
      "====================================\n",
      "3.52428586362178, 2.913530336781698, 7.047205950678549, 2.0073164252369877, 6.255087869979232, 4.608240223613908, 4.774098177898246, -0.05030586447162648, 2.190474067176723, 7.502459099850029, 6.359422976249289, 1.1345107782980746, -1.8024270518047016, -4.275684040963851, 4.686075150546758, -7.353776331883906, 3.671615131596173, 6.5211617413947325, -0.41528114806009725, 3.8621404757720366, 4.413751408037793, 1.9508784895324063, 6.111645876540686, -1.249684779334007, 0.7762616573137725, 1.1214380984040069, 5.890824582616619\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 110, value: 0.0034681991143038528, best: 0.0034681991143038528, dval: 0.019570513124983285\n",
      "Start iteration 111, value: 0.0050959769556569185, best: 0.0034681991143038528, dval: 0.04323371284929386\n",
      "Big value increase: val: 0.0050959769556569185, e.val: 0.0034681991143038528, max(α): 12.761636182394975\n",
      "Start iteration 112, value: 0.006723150155126584, best: 0.0034681991143038528, dval: 0.06436131338746631\n",
      "Big value increase: val: 0.006723150155126584, e.val: 0.0034681991143038528, max(α): 10.799080074443797\n",
      "====================================\n",
      "3.5242859307399033, 2.9135404186676697, 7.046597483023691, 2.0060460132400744, 6.2552572079829964, 4.678442571718817, 4.775479644211836, -0.06693571001375659, 2.1904717773920064, 7.51386047173614, 6.33548495707175, 1.1351399724071636, -1.8018559793810907, -4.255219732093407, 4.686081418938404, -7.353448635925127, 3.671615131596173, 6.497223722217194, -0.41547687392823596, 3.8566753527417843, 4.373056179200223, 1.9441872560624076, 6.111645876540686, -1.2188394499874282, 0.7804878732625578, 1.1214380984040069, 5.93968690537989\n",
      "====================================\n",
      "Start iteration 113, value: 0.0017472749730957577, best: 0.0017472749730957577, dval: 0.015656588341358746\n",
      "====================================\n",
      "3.5242859783538796, 2.9135383816369647, 7.046720376250964, 2.00498670336893, 6.255289272662827, 4.678315255943502, 4.778048036745162, -0.06738357361031407, 2.1904707512758406, 7.514785068516511, 6.340463925311198, 1.1350128446333427, -1.801770500320642, -4.257095729966511, 4.686079075066649, -7.353430666503506, 3.671615131596173, 6.502202690456642, -0.41547846079144124, 3.856138597709639, 4.370902998079323, 1.942718865121854, 6.111645876540686, -1.214420501754809, 0.780441446270498, 1.1214380984040069, 5.943867871552487\n",
      "====================================\n",
      "Start iteration 114, value: 0.00159866721892706, best: 0.00159866721892706, dval: 0.014969203399817665\n",
      "Start iteration 115, value: 0.0016309682005282487, best: 0.00159866721892706, dval: 0.022476185470691967\n",
      "====================================\n",
      "3.524288539804553, 2.9115676987181356, 7.048150137422334, 1.9798775035230798, 6.256184021228005, 4.683698045069862, 4.827426999157527, -0.07222925926553644, 2.1904499401000788, 7.51934634147543, 6.3427634065066965, 1.1311420729571606, -1.7984657810185523, -4.274462145138683, 4.686075308421181, -7.35383901709835, 3.671615131596173, 6.50450217165214, -0.4155010698893201, 3.8432269386171987, 4.34603743848208, 1.9267302673717233, 6.111645876540686, -1.1770906806083496, 0.7804113880720123, 1.1214380984040069, 5.9513273095224495\n",
      "====================================\n",
      "Start iteration 116, value: 0.001412149280900803, best: 0.001412149280900803, dval: 0.01841923296562037\n",
      "====================================\n",
      "3.5242999315274948, 2.910291589484741, 7.049223869166458, 1.9792928766830815, 6.256012270094348, 4.686007326009198, 4.766649659666324, -0.07224922271371167, 2.190438854508168, 7.519678388050315, 6.342020446876257, 1.1274484699025862, -1.7967871598732565, -4.2717459379656715, 4.686072116122118, -7.354455579480384, 3.671615131596173, 6.5037592120217, -0.4155227297586457, 3.844420802446551, 4.354968671012949, 1.9156446727967553, 6.111645876540686, -1.1597367341305072, 0.7804112187970295, 1.1214380984040069, 5.958691597051881\n",
      "====================================\n",
      "Start iteration 117, value: 0.001179366317257064, best: 0.001179366317257064, dval: 0.012973013109796289\n",
      "====================================\n",
      "3.5242984961386514, 2.908903780869429, 7.049335067616068, 1.9796314948005864, 6.256144584563249, 4.690298768745423, 4.791766219344906, -0.07227042576860633, 2.1902957250134136, 7.520009597373483, 6.34229023175596, 1.1234315613131507, -1.7956681136222974, -4.2737006107337265, 4.686072928016519, -7.355671958345439, 3.671615131596173, 6.504028996901404, -0.41558527772800535, 3.8433826105688595, 4.3504508311569685, 1.9185836814147463, 6.111645876540686, -1.1711872982694842, 0.7804113866938082, 1.1214380984040069, 5.956853067393952\n",
      "====================================\n",
      "Start iteration 118, value: 0.0008979789223022782, best: 0.0008979789223022782, dval: 0.008289483786815741\n",
      "Start iteration 119, value: 0.0010444449759714268, best: 0.0008979789223022782, dval: 0.018624187799177173\n",
      "Big value increase: val: 0.0010444449759714268, e.val: 0.0008979789223022782, max(α): 7.61229782324823\n",
      "Start iteration 120, value: 0.004266112298007828, best: 0.0008979789223022782, dval: 0.05593437161835785\n",
      "Big value increase: val: 0.004266112298007828, e.val: 0.0008979789223022782, max(α): 34.03627083202361\n",
      "====================================\n",
      "3.5242987392230924, 2.909536977417954, 7.049272360907986, 1.9796264637085041, 6.2566905853644785, 4.7034345910378415, 4.7916435161585165, -0.07250210857639763, 2.18998256701712, 7.52295947537232, 6.342410963142813, 1.1252643015242356, -1.7805751353568253, -4.275259565233153, 4.6860726834376525, -7.3646785309534915, 3.671615131596173, 6.504149728288256, -0.4156794470960515, 3.835782033679756, 4.348645863328023, 1.9185394658175696, 6.111645876540686, -1.1581514051457917, 0.7804166623591711, 1.1214380984040069, 5.957607714937175\n",
      "====================================\n",
      "Start iteration 121, value: 0.0007052772379625814, best: 0.0007052772379625814, dval: 0.009746510498661088\n",
      "====================================\n",
      "3.5242988094225365, 2.90954404060315, 7.049271689212783, 1.9796030767544106, 6.257440074966002, 4.703590215502383, 4.791629917236945, -0.07269133210929607, 2.189946852726829, 7.523192804051291, 6.342407479936367, 1.1252847453872947, -1.7766687281516702, -4.276762164389598, 4.686072682835584, -7.365236423791135, 3.671615131596173, 6.50414624508181, -0.4156866288538922, 3.834356472512147, 4.34859984528469, 1.9185394377716036, 6.111645876540686, -1.1581137689953094, 0.7804180612762189, 1.1214380984040069, 5.957636188249824\n",
      "====================================\n",
      "Start iteration 122, value: 0.0006883031128200657, best: 0.0006883031128200657, dval: 0.009406445018921482\n",
      "====================================\n",
      "3.5242990377577756, 2.909558050920097, 7.049270732146325, 1.9794879906318512, 6.278171472737937, 4.704698683424846, 4.791610363236616, -0.07592632633875863, 2.1898361721710753, 7.525623840553359, 6.342403486317616, 1.125325297205366, -1.776469638803615, -4.277739967961652, 4.686072681876348, -7.3741901684265505, 3.671615131596173, 6.50414225146306, -0.4157339024163207, 3.832584670167142, 4.348342554230545, 1.9185394650945609, 6.111645876540686, -1.1580736412129913, 0.7804393123810754, 1.1214380984040069, 5.957632260538211\n",
      "====================================\n",
      "Start iteration 123, value: 0.0005467830265848816, best: 0.0005467830265848816, dval: 0.007045993774939851\n",
      "Start iteration 124, value: 0.0005871205715101803, best: 0.0005467830265848816, dval: 0.008961650058750492\n",
      "====================================\n",
      "3.5243017911244183, 2.9098413279197177, 7.049258594119954, 1.9787035124686982, 6.283492933367055, 4.713467584763168, 4.790969255651054, -0.07920833575898399, 2.18917701331093, 7.537848880855462, 6.342404681198708, 1.1255867073149475, -1.7769583511122062, -4.277638837373599, 4.686072681332158, -7.387072145009246, 3.671615131596173, 6.504143446344152, -0.41591203276734795, 3.832746348332056, 4.347896051722367, 1.9185394479399867, 6.111645876540686, -1.1577964036434605, 0.7807166621294134, 1.1214380984040069, 5.957623852044806\n",
      "====================================\n",
      "Start iteration 125, value: 0.00047728211737768574, best: 0.00047728211737768574, dval: 0.00769692753323209\n",
      "====================================\n",
      "3.5243040354390582, 2.909984814706097, 7.049257442950446, 1.9754452372752163, 6.306471402424057, 4.718483910300782, 4.764312883137845, -0.08208958162325893, 2.1870997252904445, 7.532727898112869, 6.34240236761783, 1.1257744998684862, -1.7767265556136194, -4.277720456130265, 4.686072680914134, -7.385646352522178, 3.671615131596173, 6.504141132763274, -0.4161984027997624, 3.8328889146053995, 4.347873470270445, 1.9185394440479164, 6.111645876540686, -1.1568680898648118, 0.7855678865581347, 1.1214380984040069, 5.957623469632693\n",
      "====================================\n",
      "Start iteration 126, value: 0.0003822097463884841, best: 0.0003822097463884841, dval: 0.008690921853386435\n",
      "Start iteration 127, value: 0.0004488847658002474, best: 0.0003822097463884841, dval: 0.01284451840595957\n",
      "Big value increase: val: 0.0004488847658002474, e.val: 0.0003822097463884841, max(α): 4.911418567148327\n",
      "====================================\n",
      "3.524377571795773, 2.9099851091809317, 7.049257115464256, 1.9761916421263275, 6.303754527891893, 4.72445198584871, 4.76991879367057, -0.08048059924114127, 2.1779231353967616, 7.532624516701453, 6.3423346832553955, 1.1257748852710903, -1.7754392788183866, -4.281468856404969, 4.6860726749218395, -7.386742936999725, 3.671615131596173, 6.504073448400839, -0.41658290854916635, 3.833439084030688, 4.347909003819695, 1.918539374226063, 6.111645876540686, -1.1232572297873047, 0.8026855860871877, 1.1214380984040069, 5.95762332537701\n",
      "====================================\n",
      "Start iteration 128, value: 0.00034246051774687656, best: 0.00034246051774687656, dval: 0.009860314087978458\n",
      "====================================\n",
      "3.5247552853664694, 2.9099842263506366, 7.049258787767166, 1.9755950261121302, 6.303765728807222, 4.725327891547396, 4.76249923370382, -0.08046986735839214, 2.174039863443644, 7.533206826013219, 6.342207079717548, 1.1257737298409656, -1.7741538664459147, -4.284928364643797, 4.686072694023618, -7.386782024559461, 3.671615131596173, 6.503945844862992, -0.41664604646200804, 3.833313111010487, 4.347895899741236, 1.918539220437197, 6.111645876540686, -1.1465990985825298, 0.8040843700430855, 1.1214380984040069, 5.957623496581418\n",
      "====================================\n",
      "Start iteration 129, value: 0.00023670509696353774, best: 0.00023670509696353774, dval: 0.004554448401857626\n",
      "====================================\n",
      "3.5267184123941457, 2.9099849275454863, 7.049258278047343, 1.9755765984736282, 6.303776958821491, 4.724697991304698, 4.767294244241414, -0.08045894657126738, 2.1758796412569414, 7.540863232933164, 6.341561365894224, 1.1257746475503572, -1.773246906888582, -4.285170771584735, 4.686072762750788, -7.387028717329519, 3.671615131596173, 6.503300131039667, -0.41660399006807264, 3.833300612113354, 4.347893289624144, 1.9185385247471605, 6.111645876540686, -1.1423308237183067, 0.8084443553262569, 1.1214380984040069, 5.957628965048174\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 130, value: 0.00021059681688720164, best: 0.00021059681688720164, dval: 0.005358021077040011\n",
      "====================================\n",
      "3.539808051098958, 2.9099922136056438, 7.049255183242464, 1.9755575330780681, 6.30380734179736, 4.724503914235781, 4.768489713188832, -0.08045000444619874, 2.1775308864379674, 7.535320439566919, 6.340508308216918, 1.1257841833959736, -1.7682486730668365, -4.285451684330632, 4.686073058377985, -7.388139136623759, 3.671615131596173, 6.502247073362361, -0.416511166143054, 3.8332822451682054, 4.347887993603943, 1.9185344387020689, 6.111645876540686, -1.142463166585734, 0.8061400316097616, 1.1214380984040069, 5.957632703750839\n",
      "====================================\n",
      "Start iteration 131, value: 0.0001882440194379408, best: 0.0001882440194379408, dval: 0.005839821532026194\n",
      "Start iteration 132, value: 0.0004136375055380899, best: 0.0001882440194379408, dval: 0.01473128740233498\n",
      "Big value increase: val: 0.0004136375055380899, e.val: 0.0001882440194379408, max(α): 26.36462888593607\n",
      "Start iteration 133, value: 0.00019423656351567325, best: 0.0001882440194379408, dval: 0.005979625505477648\n",
      "Start iteration 134, value: 0.00020470085863924604, best: 0.0001882440194379408, dval: 0.006713948847510254\n",
      "====================================\n",
      "3.5396879254831353, 2.9099986524766868, 7.049252910705807, 1.971104470351103, 6.303939279070794, 4.724938621678275, 4.774775677590341, -0.08049007257741617, 2.1885656256619264, 7.544736690261377, 6.341664555519276, 1.125792610457909, -1.7695452685848707, -4.288155934579774, 4.6860730747437, -7.3875771239634735, 3.671615131596173, 6.503403320664719, -0.4164798147383966, 3.832218036765993, 4.347849394304117, 1.91849468608582, 6.111645876540686, -1.142871444264003, 0.8064663850423939, 1.1214380984040069, 5.957619805602183\n",
      "====================================\n",
      "Start iteration 135, value: 0.00015714672042895568, best: 0.00015714672042895568, dval: 0.00319196427762089\n",
      "====================================\n",
      "3.5397181680020213, 2.909998758448625, 7.04925289669412, 1.971041387212011, 6.303971008851813, 4.724995911229076, 4.775654007131903, -0.08049294728337461, 2.1823061515356708, 7.544042964073511, 6.341748029823991, 1.125793004580536, -1.7694283819559993, -4.290698949989727, 4.6860730701382804, -7.387590858920702, 3.671615131596173, 6.503486794969435, -0.41650159921093544, 3.8304997618037246, 4.347796848166232, 1.9181309905545836, 6.111645876540686, -1.1429449940372463, 0.8064324238984252, 1.1214380984040069, 5.957610665235443\n",
      "====================================\n",
      "Start iteration 136, value: 0.00013619835878323725, best: 0.00013619835878323725, dval: 0.0035477379450421873\n",
      "====================================\n",
      "3.539826361876958, 2.9099988872772804, 7.049252881718831, 1.9708201322151757, 6.304284004959, 4.725049551333552, 4.776831883092624, -0.08049303684418618, 2.1824522434150952, 7.542976901061234, 6.341689636480032, 1.1257934837100945, -1.7695114600483228, -4.292015170251156, 4.686073068604268, -7.387851280032233, 3.671615131596173, 6.5034284016254755, -0.41650495384234226, 3.828806069337817, 4.347628407460893, 1.9074681860950096, 6.111645876540686, -1.1429211949447546, 0.8064551226036071, 1.1214380984040069, 5.957580125815243\n",
      "====================================\n",
      "Start iteration 137, value: 0.00013415718064654084, best: 0.00013415718064654084, dval: 0.004309046286764855\n",
      "====================================\n",
      "3.5400286271703005, 2.909999095276884, 7.049252857748703, 1.9617907498387521, 6.308189103898963, 4.72513385851462, 4.77992783064647, -0.08049312789320619, 2.1838237760493424, 7.536383604738262, 6.341466814390211, 1.1257942572861133, -1.7696235405711223, -4.2919369102667355, 4.686073070004219, -7.38884651322693, 3.671615131596173, 6.5032055795356545, -0.4165173869505845, 3.8281673335326047, 4.34744393046843, 1.913687694689114, 6.111645876540686, -1.1428764050376996, 0.8065536096047301, 1.1214380984040069, 5.95700303790316\n",
      "====================================\n",
      "Start iteration 138, value: 0.0001209120361701069, best: 0.0001209120361701069, dval: 0.0033660567241061805\n",
      "====================================\n",
      "3.540338728108746, 2.9099992411640114, 7.049252832582743, 1.9660177408848003, 6.3096100757647315, 4.7255653061461125, 4.7801776967179865, -0.08049305585703134, 2.182517151882306, 7.541671574709736, 6.341129771252772, 1.12579479985822, -1.7696879024738608, -4.291849385023993, 4.686073068914949, -7.390126431280303, 3.671615131596173, 6.502868536398216, -0.4165348555646145, 3.827679624268361, 4.347318003768874, 1.9121948750205167, 6.111645876540686, -1.1390418237268147, 0.8066864863123737, 1.1214380984040069, 5.954749102478943\n",
      "====================================\n",
      "Start iteration 139, value: 9.614262866800137e-5, best: 9.614262866800137e-5, dval: 0.003069107209609229\n",
      "====================================\n",
      "3.541480844115964, 2.90999969641499, 7.049252473439984, 1.964501640454966, 6.323526345491522, 4.730024512077551, 4.779941414950117, -0.08049300526007848, 2.180166554053767, 7.543092901411179, 6.341270107917512, 1.1257964929924074, -1.7699877473891898, -4.291896737102824, 4.68607306767981, -7.3931718226854946, 3.671615131596173, 6.503008873062956, -0.4165532274399046, 3.8271185879646294, 4.347141460243159, 1.9119156595329936, 6.111645876540686, -1.1394357269113484, 0.8069924210595463, 1.1214380984040069, 5.949161906386528\n",
      "====================================\n",
      "Start iteration 140, value: 8.636729609251942e-5, best: 8.636729609251942e-5, dval: 0.005733249048572538\n",
      "Start iteration 141, value: 0.00010039786901550346, best: 8.636729609251942e-5, dval: 0.004856130006502693\n",
      "Big value increase: val: 0.00010039786901550346, e.val: 8.636729609251942e-5, max(α): 24.96047101163382\n",
      "====================================\n",
      "3.5420541690208216, 2.910004216631855, 7.0492508610556674, 1.9575248552964557, 6.31904233487558, 4.731233038249433, 4.779600383765388, -0.08049292629222889, 2.182404535391727, 7.547121275857367, 6.341434580235811, 1.1258133042329448, -1.7701136853217023, -4.291979037457473, 4.686073065214178, -7.396037447467429, 3.671615131596173, 6.5031733453812555, -0.4165322753718386, 3.825352848144141, 4.346509641290932, 1.9080842097898472, 6.111645876540686, -1.1388589649907463, 0.8099356848579478, 1.1214380984040069, 5.959491727925539\n",
      "====================================\n",
      "Start iteration 142, value: 6.978769549671957e-5, best: 6.978769549671957e-5, dval: 0.0031382515160211406\n",
      "====================================\n",
      "3.54258311250001, 2.910004835642268, 7.049250157648935, 1.9616657840805773, 6.318474834243256, 4.732581379192569, 4.77959172078514, -0.08049291985035018, 2.1820014835708346, 7.545612685074063, 6.340809518597224, 1.1258156064085407, -1.7702236413280863, -4.291999624545346, 4.686073064852168, -7.397166259121729, 3.671615131596173, 6.502548283742666, -0.4165393864454755, 3.826679972166781, 4.346506628882438, 1.9090208691949901, 6.111645876540686, -1.1386532617869873, 0.8163033390736217, 1.1214380984040069, 5.953848460398562\n",
      "====================================\n",
      "Start iteration 143, value: 5.9807282618934e-5, best: 5.9807282618934e-5, dval: 0.0026122865318830638\n",
      "====================================\n",
      "3.552529711392489, 2.9100063420472555, 7.049249875290492, 1.959977387735274, 6.318859012301574, 4.733530814113321, 4.779580781263902, -0.08049291687471004, 2.1808170712797583, 7.545358477304485, 6.340861493258526, 1.1258212089133226, -1.7702533177668422, -4.292067149212401, 4.686073060551058, -7.397165413461982, 3.671615131596173, 6.502600258403968, -0.4165400954398605, 3.8260676858927125, 4.346500566956312, 1.9086494042072053, 6.111645876540686, -1.1384922848520522, 0.8118994698710267, 1.1214380984040069, 5.95356095179557\n",
      "====================================\n",
      "Start iteration 144, value: 5.179730942773917e-5, best: 5.179730942773917e-5, dval: 0.004007485162304043\n",
      "Start iteration 145, value: 0.0004730402368451608, best: 5.179730942773917e-5, dval: 0.02058635662349595\n",
      "Big value increase: val: 0.0004730402368451608, e.val: 5.179730942773917e-5, max(α): 24.427524691865816\n",
      "====================================\n",
      "3.55227712341382, 2.910076918199162, 7.049247816935936, 1.9600111455333384, 6.319552987279984, 4.733823892608114, 4.779582670121183, -0.08049291689001067, 2.181983141847472, 7.545788168095755, 6.340870919460622, 1.1260836902724858, -1.7711818144113056, -4.295828227456768, 4.686072681458076, -7.3971639195747745, 3.671615131596173, 6.502609684606064, -0.41653929325228134, 3.825872688076472, 4.346499493352002, 1.9086546080362257, 6.111645876540686, -1.137864011800877, 0.8125704979273451, 1.1214380984040069, 5.952932141779149\n",
      "====================================\n",
      "Start iteration 146, value: 4.090294635728126e-5, best: 4.090294635728126e-5, dval: 0.0035086199298471343\n",
      "====================================\n",
      "3.5514359581466644, 2.910091294955739, 7.049247657495535, 1.9600043173743296, 6.319817873953243, 4.733946575551593, 4.779583562385204, -0.08049291686928747, 2.181970360195256, 7.545827121612917, 6.340874730503097, 1.1261371591922933, -1.772134912067345, -4.2964351462802535, 4.686072605021886, -7.397162659524154, 3.671615131596173, 6.502613495648538, -0.41653934016898203, 3.8257856524416076, 4.346499098492261, 1.9081089492158927, 6.111645876540686, -1.137844512755696, 0.8126336404561828, 1.1214380984040069, 5.95198287812829\n",
      "====================================\n",
      "Start iteration 147, value: 3.723940417728678e-5, best: 3.723940417728678e-5, dval: 0.0032404087371821245\n",
      "====================================\n",
      "3.5498839559203166, 2.910110568535558, 7.049247680432569, 1.9599823209994423, 6.323018117320652, 4.733979532522772, 4.77958556838338, -0.0804929168346168, 2.1819440584733583, 7.547052542679377, 6.3408776079328675, 1.1262088399979222, -1.7730847972685986, -4.296488264160841, 4.68606680191034, -7.397154792295364, 3.671615131596173, 6.502616373078309, -0.4165393999770138, 3.8256473193931306, 4.346498949850205, 1.9049535226744936, 6.111645876540686, -1.1377361490564184, 0.8126088693921478, 1.1214380984040069, 5.952073840754658\n",
      "====================================\n",
      "Start iteration 148, value: 2.7210248500492138e-5, best: 2.7210248500492138e-5, dval: 0.0014054971378790193\n",
      "====================================\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "3.5503753701823246, 2.9101434672012196, 7.049247659106665, 1.9599599141398927, 6.325434267339583, 4.734014732842726, 4.779585062000308, -0.08049291678083968, 2.1819097109165493, 7.548032438072252, 6.340877682455684, 1.1263311941677683, -1.775684175524461, -4.296547440717939, 4.686031908716811, -7.397152257438622, 3.671615131596173, 6.502616447601126, -0.41653948200993324, 3.8255863932617324, 4.346499026099706, 1.906836484267602, 6.111645876540686, -1.1367530700337776, 0.8123851224777244, 1.1214380984040069, 5.95261077603475\n",
      "====================================\n",
      "Start iteration 149, value: 2.370069497579489e-5, best: 2.370069497579489e-5, dval: 0.001977395070723642\n",
      "====================================\n",
      "3.5511872483102622, 2.91013497256133, 7.04924767000703, 1.9598360651127875, 6.3259022840347505, 4.734062631291074, 4.779584368951727, -0.08049291660596411, 2.1818532625117752, 7.551289310550261, 6.340877611041898, 1.126299601560866, -1.7745038597529441, -4.296641290703013, 4.685911261963389, -7.397152907202046, 3.671615131596173, 6.50261637618734, -0.4165396203096759, 3.825499581381696, 4.346499244124309, 1.9056894091552878, 6.111645876540686, -1.1368155192075722, 0.8121597877226026, 1.1214380984040069, 5.953643857533007\n",
      "====================================\n",
      "Start iteration 150, value: 2.2537104852463003e-5, best: 2.2537104852463003e-5, dval: 0.0014032894021257444\n",
      "Start iteration 151, value: 0.0005507983959133142, best: 2.2537104852463003e-5, dval: 0.02251707539586363\n",
      "Big value increase: val: 0.0005507983959133142, e.val: 2.2537104852463003e-5, max(α): 226.4933368837576\n",
      "====================================\n",
      "3.5513163320096206, 2.910135833508312, 7.049247667540847, 1.9598349616814938, 6.328524869734221, 4.734124738346258, 4.779583424823111, -0.08049291209220996, 2.1817537633087762, 7.5503726970903555, 6.340877630747744, 1.1263028035282154, -1.7746475225938811, -4.2966748742536405, 4.685591117161933, -7.397153886749069, 3.671615131596173, 6.5026163958931855, -0.41654369703748606, 3.825039643204676, 4.346499243305118, 1.9057350524524124, 6.111645876540686, -1.1367320967078864, 0.8127630237299374, 1.1214380984040069, 5.951582526775195\n",
      "====================================\n",
      "Start iteration 152, value: 2.0576478407453732e-5, best: 2.0576478407453732e-5, dval: 0.002183102592334417\n",
      "Start iteration 153, value: 2.0911472150770213e-5, best: 2.0576478407453732e-5, dval: 0.0013581494564659825\n",
      "====================================\n",
      "3.551803124527394, 2.910136714808566, 7.049247667129984, 1.959834765749678, 6.3264903660143075, 4.734155023195503, 4.779583069543465, -0.08049290746304455, 2.1817005990206852, 7.549774155498971, 6.340877631145194, 1.1263057911441887, -1.7747099566714266, -4.29671729291317, 4.685517849320093, -7.397153908806844, 3.671615131596173, 6.502616396290636, -0.4165447513796692, 3.8248033183279624, 4.346499244695192, 1.9056895813315076, 6.111645876540686, -1.1367308838763677, 0.8128017661729982, 1.1214380984040069, 5.9515679332731946\n",
      "====================================\n",
      "Start iteration 154, value: 1.8793517413868594e-5, best: 1.8793517413868594e-5, dval: 0.0013821750104222943\n",
      "====================================\n",
      "3.552085935766836, 2.9101372771634106, 7.049247667025879, 1.9598346891574077, 6.326531038823298, 4.73416975963682, 4.779582917549779, -0.0804929052586727, 2.181673962761411, 7.5496134571222155, 6.3408776312854656, 1.1263070743423915, -1.7747731235201116, -4.29692255954538, 4.685432289375855, -7.397153922850531, 3.671615131596173, 6.502616396430907, -0.4165464429871374, 3.824594622555646, 4.346499246011676, 1.9056889649793878, 6.111645876540686, -1.1367296434754355, 0.8128105986038702, 1.1214380984040069, 5.951563008393889\n",
      "====================================\n",
      "Start iteration 155, value: 1.8060894921753266e-5, best: 1.8060894921753266e-5, dval: 0.0013377541785325395\n",
      "====================================\n",
      "3.554637021988542, 2.9101461923171694, 7.049247666669592, 1.9598345548011715, 6.326764782240868, 4.734506276355689, 4.779581896236113, -0.08049283887298089, 2.1807162886881124, 7.5494709351102465, 6.34087763164508, 1.1263274172084548, -1.7771186860313117, -4.297882278951139, 4.682603453905869, -7.397153950737087, 3.671615131596173, 6.502616396790522, -0.4168686848078593, 3.824587612618345, 4.3464992492315595, 1.905688085553258, 6.111645876540686, -1.1367254446705897, 0.812851679292117, 1.1214380984040069, 5.9515504321916985\n",
      "====================================\n",
      "Start iteration 156, value: 1.3192669072869884e-5, best: 1.3192669072869884e-5, dval: 0.001881042541150981\n",
      "Start iteration 157, value: 1.3690588397083766e-5, best: 1.3192669072869884e-5, dval: 0.0017970363718153304\n",
      "====================================\n",
      "3.5549277706390203, 2.910143945488924, 7.049247666829489, 1.959833164828205, 6.32738390002742, 4.734469050638811, 4.779582948842319, -0.08049278312531098, 2.1805471319556764, 7.549021227102282, 6.340877630943447, 1.1263222903281678, -1.7762408262573726, -4.299108230942478, 4.682676466560788, -7.397153901861702, 3.671615131596173, 6.5026163960888885, -0.4168999910266348, 3.824584021527167, 4.346499250879508, 1.9056876065261843, 6.111645876540686, -1.13667644348163, 0.8128487471170093, 1.1214380984040069, 5.951563629922939\n",
      "====================================\n",
      "Start iteration 158, value: 1.1753653502531761e-5, best: 1.1753653502531761e-5, dval: 0.001608603161618656\n",
      "====================================\n",
      "3.5549383910311243, 2.9101459683664443, 7.049247666830928, 1.9598324652894892, 6.327654670408488, 4.7344688412812355, 4.779583370065534, -0.08049274919806267, 2.1805458994243523, 7.549337398934826, 6.340877623912999, 1.126325062744787, -1.7764109229218867, -4.298740508955311, 4.682565106505281, -7.397153836481171, 3.671615131596173, 6.502616389058441, -0.41690244497241974, 3.8245829693667, 4.346499256587668, 1.9056877733512225, 6.111645876540686, -1.1366233131129522, 0.8128527185570485, 1.1214380984040069, 5.951568323054975\n",
      "====================================\n",
      "Start iteration 159, value: 1.1165129718068991e-5, best: 1.1165129718068991e-5, dval: 0.0015096318522792168\n",
      "====================================\n",
      "3.5549577499910154, 2.910151213687486, 7.0492476668325015, 1.9598295303637037, 6.331784792507932, 4.734468992341751, 4.77959066433224, -0.08049059090944376, 2.180544613100279, 7.549463634993129, 6.340877427627963, 1.126332251620576, -1.776475651502213, -4.298809582214058, 4.682421426256363, -7.397153606718528, 3.671615131596173, 6.502616192773405, -0.4169060840106199, 3.8245813379335485, 4.346499253498801, 1.905688358305435, 6.111645876540686, -1.1364771750595888, 0.8130065582043531, 1.1214380984040069, 5.952968278333329\n",
      "====================================\n",
      "Start iteration 160, value: 9.267908387083937e-6, best: 9.267908387083937e-6, dval: 0.0013982587715554232\n",
      "====================================\n",
      "3.5549810253956013, 2.910158890473362, 7.049247666831103, 1.9598195112365415, 6.330631129886036, 4.73446914424431, 4.779586751269451, -0.08048692818949862, 2.180543190392353, 7.549454349384994, 6.340876731681452, 1.1263427728946196, -1.7765482769854763, -4.2987879916775205, 4.6822470498008055, -7.3971537528907625, 3.671615131596173, 6.502615496826894, -0.4169100141602311, 3.8245789351508983, 4.346499248462072, 1.9056879216928044, 6.111645876540686, -1.136404966344222, 0.8133865404708246, 1.1214380984040069, 5.951966769976544\n",
      "====================================\n",
      "Start iteration 161, value: 8.514783122232747e-6, best: 8.514783122232747e-6, dval: 0.0011425207151517236\n",
      "====================================\n",
      "3.5550850092620108, 2.9101707916651085, 7.049247666830314, 1.9594314684353895, 6.330803181277183, 4.734469352598615, 4.779583124043004, -0.08047373429131968, 2.1805393641190194, 7.549404044846965, 6.340872461856236, 1.1263590838484259, -1.7765545794368096, -4.298803152500631, 4.681996907037699, -7.397153936127122, 3.671615131596173, 6.502611227001678, -0.41691544851487505, 3.8245751146187055, 4.346499166275986, 1.9056873879883818, 6.111645876540686, -1.1355180027101122, 0.8133215812758723, 1.1214380984040069, 5.951729963924295\n",
      "====================================\n",
      "Start iteration 162, value: 8.236640709257576e-6, best: 8.236640709257576e-6, dval: 0.0010911335255589932\n",
      "====================================\n",
      "3.5572929580456627, 2.9102048674646293, 7.049247666829811, 1.9591677030456407, 6.331392688224434, 4.734539733152681, 4.779575791292751, -0.07916439691024599, 2.180517539972052, 7.549210246997687, 6.340819248316082, 1.1264057857925458, -1.7765498699190814, -4.298821980221694, 4.681344756652038, -7.397154920047319, 3.671615131596173, 6.502558013461524, -0.41699260611327554, 3.8245690526926603, 4.346499060640792, 1.9056865580906968, 6.111645876540686, -1.1361858287577447, 0.8133560836268251, 1.1214380984040069, 5.951697276170318\n",
      "====================================\n",
      "Start iteration 163, value: 5.681778246649679e-6, best: 5.681778246649679e-6, dval: 0.0009022988283795622\n",
      "Start iteration 164, value: 7.693778355217426e-6, best: 5.681778246649679e-6, dval: 0.0016946097315147222\n",
      "Big value increase: val: 7.693778355217426e-6, e.val: 5.681778246649679e-6, max(α): 15.182575131523574\n",
      "Start iteration 165, value: 2.541090143704002e-5, best: 5.681778246649679e-6, dval: 0.004632127542186771\n",
      "Big value increase: val: 2.541090143704002e-5, e.val: 5.681778246649679e-6, max(α): 11.395845051299283\n",
      "====================================\n",
      "3.5572892843306145, 2.910618150120864, 7.049247666825068, 1.958745058496729, 6.333913630426415, 4.735758910094421, 4.779594501825727, -0.07908812390916929, 2.180470555498037, 7.549480409897164, 6.340644448091464, 1.1269722025395816, -1.7767229596482692, -4.298879210455557, 4.68129667897159, -7.397154437258257, 3.671615131596173, 6.502383213236908, -0.4173726206419419, 3.824515159011465, 4.3464988438448, 1.9056864418056991, 6.111645876540686, -1.1373519647529207, 0.8137494658512273, 1.1214380984040069, 5.951665168559129\n",
      "====================================\n",
      "Start iteration 166, value: 3.615252421173817e-6, best: 3.615252421173817e-6, dval: 0.0007944694919883172\n",
      "====================================\n",
      "3.557292647053583, 2.9105936527846006, 7.049247666825438, 1.9587565301151395, 6.333996068273385, 4.735767572604534, 4.779595047811253, -0.07907486368738671, 2.18046558402915, 7.549474524533367, 6.340609316550248, 1.1269386281775609, -1.7766210243289364, -4.298888251354377, 4.6812841154189675, -7.397154482922949, 3.671615131596173, 6.5023480816956924, -0.41740405552609766, 3.824510691428925, 4.3464988461443514, 1.9056857599329562, 6.111645876540686, -1.1370966857093627, 0.8137742589232022, 1.1214380984040069, 5.951666264038426\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 167, value: 3.482522605084326e-6, best: 3.482522605084326e-6, dval: 0.000782467758335785\n",
      "Start iteration 168, value: 3.6151224291841757e-6, best: 3.482522605084326e-6, dval: 0.0006609017736190631\n",
      "====================================\n",
      "3.558054021335294, 2.910586178152678, 7.049247666825787, 1.958637544360896, 6.333991969423401, 4.735775267258694, 4.779594921454793, -0.07849667048841652, 2.1798213332122516, 7.54844183523595, 6.340298186276692, 1.126928383961804, -1.7764163592215416, -4.298971445002538, 4.680922830425027, -7.3971561565620325, 3.671615131596173, 6.502036951422136, -0.41771996633452235, 3.824482704869257, 4.346498834083474, 1.905673596706011, 6.111645876540686, -1.1362799112031838, 0.8143757498889025, 1.1214380984040069, 5.951685823746867\n",
      "====================================\n",
      "Start iteration 169, value: 2.923699730511328e-6, best: 2.923699730511328e-6, dval: 0.0004995926969530995\n",
      "====================================\n",
      "3.5581186283909614, 2.9106128423996087, 7.0492476668255435, 1.9585554195417358, 6.334038986098036, 4.7357770116499704, 4.779596156815385, -0.0784013372967974, 2.179875991579512, 7.54914427071575, 6.340341693675526, 1.1269404471972895, -1.7764359231557527, -4.299024945798117, 4.680796006526639, -7.397155862386733, 3.671615131596173, 6.502080458820971, -0.4176472399016902, 3.8243891544053, 4.346498601676346, 1.9056661981457899, 6.111645876540686, -1.1364891205036447, 0.8139931383225282, 1.1214380984040069, 5.951696651589204\n",
      "====================================\n",
      "Start iteration 170, value: 2.4981648542278305e-6, best: 2.4981648542278305e-6, dval: 0.0004922799060423019\n",
      "Start iteration 171, value: 4.2869878427388215e-6, best: 2.4981648542278305e-6, dval: 0.0013240317452076211\n",
      "Big value increase: val: 4.2869878427388215e-6, e.val: 2.4981648542278305e-6, max(α): 24.821961794857607\n",
      "====================================\n",
      "3.5581299457464257, 2.9107861832777413, 7.049247666825404, 1.9581162198210866, 6.335840457533033, 4.735777011245655, 4.779643732353349, -0.07798583339459235, 2.1798835224640345, 7.550538461024704, 6.3403584345140755, 1.1270188687569749, -1.776438875246584, -4.299411363656795, 4.680785341971965, -7.397154488981248, 3.671615131596173, 6.50209719965952, -0.41736025596797666, 3.8238965114462675, 4.34649588566113, 1.9055078882463472, 6.111645876540686, -1.136726586111552, 0.8140104923994936, 1.1214380984040069, 5.951697539205988\n",
      "====================================\n",
      "Start iteration 172, value: 2.0727298558397413e-6, best: 2.0727298558397413e-6, dval: 0.0007735650750508236\n",
      "Start iteration 173, value: 5.432680671132139e-6, best: 2.0727298558397413e-6, dval: 0.0019383683414805342\n",
      "Big value increase: val: 5.432680671132139e-6, e.val: 2.0727298558397413e-6, max(α): 20.018358525166065\n",
      "====================================\n",
      "3.5581389271888106, 2.9109351689911107, 7.049247666824968, 1.9580168685320702, 6.335614758317235, 4.73577721249857, 4.7796427932849985, -0.07748383429760107, 2.1798819465913044, 7.549506689393465, 6.340351276923304, 1.1270862717385401, -1.7764437990188484, -4.299914073925141, 4.680785134692009, -7.397154869867628, 3.671615131596173, 6.502090042068748, -0.41767656919272866, 3.823823932330235, 4.346495761139777, 1.9050799819854174, 6.111645876540686, -1.1366153639783343, 0.8140590785417194, 1.1214380984040069, 5.951686129005577\n",
      "====================================\n",
      "Start iteration 174, value: 1.4280197265575272e-6, best: 1.4280197265575272e-6, dval: 0.00047863825124328657\n",
      "====================================\n",
      "3.5581535032176075, 2.9109586885080896, 7.04924766682491, 1.9579033247119313, 6.335583502471202, 4.73577724733651, 4.779643343929186, -0.07736337952236577, 2.17988147140321, 7.549634299817355, 6.340347075477503, 1.1270969122592553, -1.7764439340695946, -4.2996721866795955, 4.680784862187597, -7.3971548788493555, 3.671615131596173, 6.502085840622947, -0.41769804706281655, 3.82382792141304, 4.346495740134056, 1.9049288120583134, 6.111645876540686, -1.1365553201019514, 0.8141448475824276, 1.1214380984040069, 5.95167279762878\n",
      "====================================\n",
      "Start iteration 175, value: 1.3297200884758538e-6, best: 1.3297200884758538e-6, dval: 0.00044461898354544033\n",
      "Start iteration 176, value: 1.357656505870163e-5, best: 1.3297200884758538e-6, dval: 0.0033071126278077373\n",
      "Big value increase: val: 1.357656505870163e-5, e.val: 1.3297200884758538e-6, max(α): 18.16061614843966\n",
      "====================================\n",
      "3.558197965115962, 2.911457339870687, 7.049247666824702, 1.9578560886367862, 6.335597007661809, 4.735777309974086, 4.77964518493627, -0.0768096994677896, 2.1798795266608164, 7.549634075530563, 6.340328696751752, 1.1273225083103053, -1.7764439485552206, -4.299864828157815, 4.680784865107297, -7.397155349142248, 3.671615131596173, 6.502067461897196, -0.4183664647891793, 3.823827379050111, 4.346495738402415, 1.9049289400759617, 6.111645876540686, -1.1364995641041036, 0.8141509116843905, 1.1214380984040069, 5.951664873643505\n",
      "====================================\n",
      "Start iteration 177, value: 1.0974436604492604e-6, best: 1.0974436604492604e-6, dval: 0.0003396376210494101\n",
      "====================================\n",
      "3.5583418090614534, 2.911681126818559, 7.049247666824654, 1.9577989579152018, 6.335600413405638, 4.735777309487892, 4.77964533981782, -0.0768304078254194, 2.1798795662920396, 7.549634100491217, 6.340326761818377, 1.1274237522965915, -1.776443924055346, -4.299871332032137, 4.680784879612945, -7.397155341840226, 3.671615131596173, 6.502065526963822, -0.4183413672580102, 3.8238268246596103, 4.346495737164381, 1.9049275940517356, 6.111645876540686, -1.1364697970578281, 0.8141463222797537, 1.1214380984040069, 5.951679228727051\n",
      "====================================\n",
      "Start iteration 178, value: 1.0096253263288766e-6, best: 1.0096253263288766e-6, dval: 0.0002896415424322382\n",
      "====================================\n",
      "3.5588671346651117, 2.911672985923718, 7.04924766682468, 1.957687595949725, 6.335618273363499, 4.735777308981041, 4.779645723695044, -0.07685575749711719, 2.1798795596640925, 7.549634156351303, 6.340288256449583, 1.1274200692549599, -1.7764438728619545, -4.299884858867501, 4.6807849434599405, -7.397155326348271, 3.671615131596173, 6.502027021595027, -0.418333394872995, 3.8238209171344635, 4.346495736437052, 1.9049240029742909, 6.111645876540686, -1.1363483006591957, 0.8141074470092395, 1.1214380984040069, 5.951878123077184\n",
      "====================================\n",
      "Start iteration 179, value: 8.970846920574875e-7, best: 8.970846920574875e-7, dval: 0.0004146459648123879\n",
      "====================================\n",
      "3.558821413758093, 2.911675166691413, 0.7660623596451392, 1.9575230363250617, 6.335677515743231, 4.7357773089924295, 4.779646547704605, -0.07689416505449397, 2.1798795505633346, 1.2664489359524005, 6.340281804306229, 1.1274210558612685, -1.776443797273392, -4.299915933445503, 4.680785201738203, -1.1139700010163613, 3.671615131596173, 6.502020569451673, -0.41833884686449196, 3.823806149086179, 4.346495735535834, 1.9049046812873456, 6.111645876540686, -1.1362661942580545, 0.8141346276299941, 1.1214380984040069, 5.951882071006834\n",
      "====================================\n",
      "Find solution in iteration 179, value: 8.486462549330973e-7\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(8.486462549330973e-7, Number[3.558821413758093, 2.911675166691413, 0.7660623596451392, 1.9575230363250617, 6.335677515743231, 4.7357773089924295, 4.779646547704605, -0.07689416505449397, 2.1798795505633346, 1.2664489359524005  …  6.502020569451673, -0.41833884686449196, 3.823806149086179, 4.346495735535834, 1.9049046812873456, 6.111645876540686, -1.1362661942580545, 0.8141346276299941, 1.1214380984040069, 5.951882071006834], 179)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "val, xparams, itr = gradientDescent(step1_of, step1_start_params, α=0.01, maxItr=200,\n",
    "                              argsArePeriodic=true, isExpectedZero=true, ϵ=1e-6, debug=true, useBigValInc=true)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d43ae502",
   "metadata": {},
   "source": [
    "We define the function to check if we found correct solution."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "ac98a483",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "check_err_of_ansact (generic function with 2 methods)"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "function check_err_of_ansact(param, check_qc=nothing)\n",
    "    # Generate ansact from previous step\n",
    "    ansact = generate_ansact()\n",
    "    setparameters!(ansact, param)\n",
    "    inv_ansact = inv(ansact)\n",
    "    bindparameters!(inv_ansact)\n",
    "\n",
    "    # Generate qc\n",
    "    step_qc = generate_empty_circuit()\n",
    "    # append\n",
    "    append!(step_qc, inv_ansact)\n",
    "    if check_qc != nothing\n",
    "        append!(step_qc, check_qc)\n",
    "    end\n",
    "    # Add measures\n",
    "    addMeasuresOS(step_qc)\n",
    "    \n",
    "    return check_circuits_err(qc_full, step_qc)\n",
    "end"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9db5dc01",
   "metadata": {},
   "source": [
    "Check if step one finish in proper way."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "333b7f46",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.00013915404660343796"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "check_err_of_ansact(step1_start_params, step1_check_qc)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f846cad1",
   "metadata": {},
   "source": [
    "Is worth seeing the code of qderivative function available in QuantumCircuits library: https://github.com/Adgnitio/QuantumCircuits.jl/blob/main/src/Execute/Execute.jl\n",
    "\n",
    "This method calculates the loss function, and the derivative of the loss function using the parameter shift rule (_\"Quantum Circuit Learning\"_ https://arxiv.org/abs/1803.00745, _\"Evaluating analytic gradients on quantum hardware\"_ https://arxiv.org/abs/1811.11184) and additionally, it performs the measured error mitigation as described in the notebook [01_solution](01_solution.ipynb). The _Zero Noise Extrapolation_ method is not included because I haven't known about it during the implementation but I'm going to add it in the future.\n",
    "\n",
    "The parameter for step 1 was found on the **real device**. The code used in training can be found in [sol_step1](src/Challenge/steps/sol_step1.jl) (the code works in exactly the same way as the code above but has had more logging and checks). The log of execution of the code on a real device can be found in [sol_res_step1_Jakarta_1](src/Challenge/steps/sol_res_step1_Jakarta_1.txt) and [sol_res_step1_Jakarta_2](src/Challenge/steps/sol_res_step1_Jakarta_2.txt).\n",
    "\n",
    "It is worth noting that the printing of the solution can be used to stop the current optimization process and start it again from the previously founded the best solution. This is not necessary for the Julia simulator but in the real device (and even on the simulator) some noises can impact the calculation of derivatives. If we can execute gradient descent many times this doesn't matter because finally, gradient descent finds the proper direction but on the real device, we would like to have as few circuits run as possible.\n",
    "\n",
    "# 4. Step 2\n",
    "We do in similar way as in step 1 but we in the addition we add the inverse of the ansact with parameters from step 1.\n",
    "\n",
    "First we generate the check circuit and the 2 trotter step circuit which will be used in steps from 2 to 5."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "aa2cb05a",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "                                                                              »\n",
       "q_0: ─────────────────────────────────────────────────────────────────────────»\n",
       "      ┌──────────────────────────────┐┌───┐┌───────────┐                 ┌───┐»\n",
       "q_1: ─┤ U3(1.4078e-06,2.4775,3.4032) ├┤ X ├┤ Rz(12π/5) ├──■──────────────┤ X ├»\n",
       "      └──────────────────────────────┘└─┬─┘└───────────┘  │              └─┬─┘»\n",
       "q_2: ───────────────────────────────────┼─────────────────┼────────────────┼──»\n",
       "           ┌────────────────────┐       │   ┌──────────┐┌─┴─┐┌──────────┐  │  »\n",
       "q_3: ──────┤ U3(π,-1.3417,6.11) ├───────■───┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■──»\n",
       "           └────────────────────┘           └──────────┘└───┘└──────────┘     »\n",
       "q_4: ─────────────────────────────────────────────────────────────────────────»\n",
       "     ┌───────────────────────────────┐                                        »\n",
       "q_5: ┤ U3(4.7938e-05,0.15858,2.4322) ├────────────────────────────────────────»\n",
       "     └───────────────────────────────┘                                        »\n",
       "q_6: ─────────────────────────────────────────────────────────────────────────»\n",
       "                                                                              »\n",
       "«                                                                      »\n",
       "«q_0: ─────────────────────────────────────────────────────────────────»\n",
       "«     ┌───────────────────────────────┐  ┌──────────────────────┐      »\n",
       "«q_1: ┤ U3(-1.4649e-06,2.8517,8.5461) ├──┤ U3(2π,1.5109,2.6464) ├──────»\n",
       "«     └───────────────────────────────┘  └──────────────────────┘      »\n",
       "«q_2: ─────────────────────────────────────────────────────────────────»\n",
       "«          ┌──────────────────────┐    ┌─────────────────────────┐┌───┐»\n",
       "«q_3: ─────┤ U3(π,-2.183,-5.7269) ├────┤ U3(3.1416,4.5878,2.466) ├┤ X ├»\n",
       "«          └──────────────────────┘    └─────────────────────────┘└─┬─┘»\n",
       "«q_4: ──────────────────────────────────────────────────────────────┼──»\n",
       "«                                                                   │  »\n",
       "«q_5: ──────────────────────────────────────────────────────────────■──»\n",
       "«                                                                      »\n",
       "«q_6: ─────────────────────────────────────────────────────────────────»\n",
       "«                                                                      »\n",
       "«                                                                        »\n",
       "«q_0: ───────────────────────────────────────────────────────────────────»\n",
       "«                                                                        »\n",
       "«q_1: ───────────────────────────────────────────────────────────────────»\n",
       "«                                                                        »\n",
       "«q_2: ───────────────────────────────────────────────────────────────────»\n",
       "«     ┌───────────┐                   ┌───┐┌────────────────────────────┐»\n",
       "«q_3: ┤ Rz(3π/10) ├──■────────────────┤ X ├┤ U3(-3.1416,4.6026,0.91001) ├»\n",
       "«     └───────────┘  │                └─┬─┘└────────────────────────────┘»\n",
       "«q_4: ───────────────┼──────────────────┼────────────────────────────────»\n",
       "«     ┌───────────┐┌─┴─┐┌────────────┐  │  ┌────────────────────────────┐»\n",
       "«q_5: ┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(6.2832,-1.4344,-5.8688) ├»\n",
       "«     └───────────┘└───┘└────────────┘     └────────────────────────────┘»\n",
       "«q_6: ───────────────────────────────────────────────────────────────────»\n",
       "«                                                                        »\n",
       "«                                                                            »\n",
       "«q_0: ───────────────────────────────────────────────────────────────────────»\n",
       "«                                      ┌───┐┌────────────┐                   »\n",
       "«q_1: ─────────────────────────────────┤ X ├┤ Rz(13π/10) ├──■────────────────»\n",
       "«                                      └─┬─┘└────────────┘  │                »\n",
       "«q_2: ───────────────────────────────────┼──────────────────┼────────────────»\n",
       "«         ┌────────────────────────┐     │  ┌────────────┐┌─┴─┐┌────────────┐»\n",
       "«q_3: ────┤ U3(π,-0.079534,5.6483) ├─────■──┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├»\n",
       "«         └────────────────────────┘        └────────────┘└───┘└────────────┘»\n",
       "«q_4: ───────────────────────────────────────────────────────────────────────»\n",
       "«     ┌───────────────────────────────┐                                      »\n",
       "«q_5: ┤ U3(4.7938e-05,0.15858,2.4322) ├──────────────────────────────────────»\n",
       "«     └───────────────────────────────┘                                      »\n",
       "«q_6: ───────────────────────────────────────────────────────────────────────»\n",
       "«                                                                            »\n",
       "«                                                                       »\n",
       "«q_0: ──────────────────────────────────────────────────────────────────»\n",
       "«     ┌───┐┌──────────────────────┐┌──────────────────────────────┐     »\n",
       "«q_1: ┤ X ├┤ U3(-π,1.4201,4.0067) ├┤ U3(1.4078e-06,2.4775,3.4032) ├─────»\n",
       "«     └─┬─┘└──────────────────────┘└──────────────────────────────┘     »\n",
       "«q_2: ──┼───────────────────────────────────────────────────────────────»\n",
       "«       │  ┌──────────────────────┐  ┌─────────────────────────┐   ┌───┐»\n",
       "«q_3: ──■──┤ U3(2π,2.9701,2.2974) ├──┤ U3(3.1416,4.5878,2.466) ├───┤ X ├»\n",
       "«          └──────────────────────┘  └─────────────────────────┘   └─┬─┘»\n",
       "«q_4: ───────────────────────────────────────────────────────────────┼──»\n",
       "«                                                                    │  »\n",
       "«q_5: ───────────────────────────────────────────────────────────────■──»\n",
       "«                                                                       »\n",
       "«q_6: ──────────────────────────────────────────────────────────────────»\n",
       "«                                                                       »\n",
       "«                                                                        »\n",
       "«q_0: ───────────────────────────────────────────────────────────────────»\n",
       "«                                                                        »\n",
       "«q_1: ───────────────────────────────────────────────────────────────────»\n",
       "«                                                                        »\n",
       "«q_2: ───────────────────────────────────────────────────────────────────»\n",
       "«     ┌───────────┐                   ┌───┐┌────────────────────────────┐»\n",
       "«q_3: ┤ Rz(3π/10) ├──■────────────────┤ X ├┤ U3(-3.1416,4.6026,0.91001) ├»\n",
       "«     └───────────┘  │                └─┬─┘└────────────────────────────┘»\n",
       "«q_4: ───────────────┼──────────────────┼────────────────────────────────»\n",
       "«     ┌───────────┐┌─┴─┐┌────────────┐  │  ┌────────────────────────────┐»\n",
       "«q_5: ┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(6.2832,-1.4344,-5.8688) ├»\n",
       "«     └───────────┘└───┘└────────────┘     └────────────────────────────┘»\n",
       "«q_6: ───────────────────────────────────────────────────────────────────»\n",
       "«                                                                        »\n",
       "«                                                                   »\n",
       "«q_0: ──────────────────────────────────────────────────────────────»\n",
       "«                           ┌───┐┌───────────┐                 ┌───┐»\n",
       "«q_1: ──────────────────────┤ X ├┤ Rz(12π/5) ├──■──────────────┤ X ├»\n",
       "«                           └─┬─┘└───────────┘  │              └─┬─┘»\n",
       "«q_2: ────────────────────────┼─────────────────┼────────────────┼──»\n",
       "«     ┌────────────────────┐  │   ┌──────────┐┌─┴─┐┌──────────┐  │  »\n",
       "«q_3: ┤ U3(π,-1.3417,6.11) ├──■───┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■──»\n",
       "«     └────────────────────┘      └──────────┘└───┘└──────────┘     »\n",
       "«q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«                                      \n",
       "«q_0: ─────────────────────────────────\n",
       "«     ┌───────────────────────────────┐\n",
       "«q_1: ┤ U3(-1.4649e-06,2.8517,8.5461) ├\n",
       "«     └───────────────────────────────┘\n",
       "«q_2: ─────────────────────────────────\n",
       "«          ┌──────────────────────┐    \n",
       "«q_3: ─────┤ U3(π,-2.183,-5.7269) ├────\n",
       "«          └──────────────────────┘    \n",
       "«q_4: ─────────────────────────────────\n",
       "«                                      \n",
       "«q_5: ─────────────────────────────────\n",
       "«                                      \n",
       "«q_6: ─────────────────────────────────\n",
       "«                                      "
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# The parameters from previous step\n",
    "step1_params = step1_start_params\n",
    "# The parameter wich I found on real deviece\n",
    "#step1_params = [6.490463894513841, 3.434943430067894, 5.375354561541277, 4.7906997798464115, 2.849325024133124, 2.7673620360366824, 1.4940499436354768, 4.487752591524359, 3.2948988322626382, 2.0225225509500486, -1.2343170007923738, 1.0431091490261049, 1.8837296276360387, 1.2169677999557502, 5.940807695305212, 5.421210358780618, 0.3173688878579456, -6.965567540712155, 4.835967484868803, 3.0127993733543517, 4.4620544822135475, 1.378337396849606, 1.980959799643362, 3.6789144092845376, 5.417860886313657, 1.8687391611628605, 5.092938820960128]\n",
    "\n",
    "step2_check_qc, _, _, _ = generate_circuit(trotter_steps, 6, t, params, params2, params3, init=false)\n",
    "trotter_step_qc_exp, _, _, _ = generate_circuit(trotter_steps, st, t, params, params2, params3, init=false)\n",
    "trotter_step_qc_exp"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "85fb8072",
   "metadata": {},
   "source": [
    "Next, we define the helper method which create the optimization circuit for steps from 2 to 5."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "30785983",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "generate_step_ansact (generic function with 1 method)"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "function generate_step_ansact(prev_step_params)\n",
    "    # Generate ansact from previous step\n",
    "    prev_step_ansact = generate_ansact()\n",
    "    setparameters!(prev_step_ansact, prev_step_params)\n",
    "    prev_step_inv_ansact = inv(prev_step_ansact)\n",
    "    bindparameters!(prev_step_inv_ansact)\n",
    "\n",
    "    # Generate asnact for current step\n",
    "    ansact = generate_ansact()\n",
    "    start_params = getRandParameters(ansact)\n",
    "    # Set parameters\n",
    "    setparameters!(ansact, start_params)\n",
    "\n",
    "    # Generate step qc\n",
    "    step_qc = generate_empty_circuit()\n",
    "    # append\n",
    "    append!(step_qc, prev_step_inv_ansact)\n",
    "    append!(step_qc, trotter_step_qc_exp)\n",
    "    append!(step_qc, ansact)\n",
    "    # Add measures\n",
    "    addMeasuresOS(step_qc)\n",
    "\n",
    "    return start_params, step_qc\n",
    "end"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "793afe43",
   "metadata": {},
   "source": [
    "We generate the optimization circuit."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "f34759d7",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "                                                                          »\n",
       " q_0: ────────────────────────────────────────────────────────────────────»\n",
       "        ┌──────────────────────────┐                                      »\n",
       " q_1: ──┤ U3(1.114,-6.502,-3.6716) ├──────────────────────■───────────────»\n",
       "        └──────────────────────────┘                      │               »\n",
       " q_2: ────────────────────────────────────────────────────┼───────────────»\n",
       "       ┌────────────────────────────┐                   ┌─┴─┐             »\n",
       " q_3: ─┤ U3(-1.9049,1.1363,-6.1116) ├───■───────────────┤ X ├─────────────»\n",
       "       └────────────────────────────┘   │               └───┘             »\n",
       " q_4: ──────────────────────────────────┼─────────────────────────────────»\n",
       "      ┌──────────────────────────────┐┌─┴─┐┌─────────────────────────────┐»\n",
       " q_5: ┤ U3(-0.81413,-5.9519,-1.1214) ├┤ X ├┤ U3(0.41834,-4.3465,-3.8238) ├»\n",
       "      └──────────────────────────────┘└───┘└─────────────────────────────┘»\n",
       " q_6: ────────────────────────────────────────────────────────────────────»\n",
       "                                                                          »\n",
       "c2: 3/════════════════════════════════════════════════════════════════════»\n",
       "                                                                          »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────────┐     ┌──────────────────────────────┐»\n",
       "« q_1: ┤ U3(-1.2664,-1.1274,-6.3403) ├──■──┤ U3(-3.5588,-0.76606,-2.9117) ├»\n",
       "«      └─────────────────────────────┘  │  └──────────────────────────────┘»\n",
       "« q_2: ─────────────────────────────────┼──────────────────────────────────»\n",
       "«       ┌───────────────────────────┐ ┌─┴─┐                                »\n",
       "« q_3: ─┤ U3(1.7764,-4.6808,4.2999) ├─┤ X ├───────────────■────────────────»\n",
       "«       └───────────────────────────┘ └───┘               │                »\n",
       "« q_4: ───────────────────────────────────────────────────┼────────────────»\n",
       "«                                                       ┌─┴─┐              »\n",
       "« q_5: ─────────────────────────────────────────────────┤ X ├──────────────»\n",
       "«                                                       └───┘              »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c2: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                            »\n",
       "« q_0: ──────────────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────────┐                                 ┌───┐»\n",
       "« q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────┤ X ├»\n",
       "«      └──────────────────────────────┘                                 └─┬─┘»\n",
       "« q_2: ───────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌─────────────────────────────┐       ┌────────────────────┐       │  »\n",
       "« q_3: ┤ U3(-1.9575,-4.7358,-6.3357) ├───────┤ U3(π,-1.3417,6.11) ├───────■──»\n",
       "«      └─────────────────────────────┘       └────────────────────┘          »\n",
       "« q_4: ──────────────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(-4.7796,-2.1799,0.076894) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └──────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ──────────────────────────────────────────────────────────────────────»\n",
       "«                                                                            »\n",
       "«c2: 3/══════════════════════════════════════════════════════════════════════»\n",
       "«                                                                            »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────┐                 ┌───┐┌───────────────────────────────┐»\n",
       "« q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├»\n",
       "«      └───────────┘  │              └─┬─┘└───────────────────────────────┘»\n",
       "« q_2: ───────────────┼────────────────┼───────────────────────────────────»\n",
       "«       ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    »\n",
       "« q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────»\n",
       "«       └──────────┘└───┘└──────────┘          └──────────────────────┘    »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_5: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c2: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌──────────────────────┐                                           »\n",
       "« q_1: ──┤ U3(2π,1.5109,2.6464) ├───────────────────────────────────────────»\n",
       "«        └──────────────────────┘                                           »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌─────────────────────────┐┌───┐┌───────────┐                   ┌───┐»\n",
       "« q_3: ┤ U3(3.1416,4.5878,2.466) ├┤ X ├┤ Rz(3π/10) ├──■────────────────┤ X ├»\n",
       "«      └─────────────────────────┘└─┬─┘└───────────┘  │                └─┬─┘»\n",
       "« q_4: ─────────────────────────────┼─────────────────┼──────────────────┼──»\n",
       "«                                   │  ┌───────────┐┌─┴─┐┌────────────┐  │  »\n",
       "« q_5: ─────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├──■──»\n",
       "«                                      └───────────┘└───┘└────────────┘     »\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c2: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌────────────────────────────┐    ┌────────────────────────┐     │  »\n",
       "« q_3: ┤ U3(-3.1416,4.6026,0.91001) ├────┤ U3(π,-0.079534,5.6483) ├─────■──»\n",
       "«      └────────────────────────────┘    └────────────────────────┘        »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────────────────────┐┌───────────────────────────────┐     »\n",
       "« q_5: ┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(4.7938e-05,0.15858,2.4322) ├─────»\n",
       "«      └────────────────────────────┘└───────────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c2: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                    »\n",
       "« q_0: ──────────────────────────────────────────────────────────────»\n",
       "«      ┌────────────┐                   ┌───┐┌──────────────────────┐»\n",
       "« q_1: ┤ Rz(13π/10) ├──■────────────────┤ X ├┤ U3(-π,1.4201,4.0067) ├»\n",
       "«      └────────────┘  │                └─┬─┘└──────────────────────┘»\n",
       "« q_2: ────────────────┼──────────────────┼──────────────────────────»\n",
       "«      ┌────────────┐┌─┴─┐┌────────────┐  │  ┌──────────────────────┐»\n",
       "« q_3: ┤ Ry(5.3407) ├┤ X ├┤ Ry(5.3407) ├──■──┤ U3(2π,2.9701,2.2974) ├»\n",
       "«      └────────────┘└───┘└────────────┘     └──────────────────────┘»\n",
       "« q_4: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_5: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "« q_6: ──────────────────────────────────────────────────────────────»\n",
       "«                                                                    »\n",
       "«c2: 3/══════════════════════════════════════════════════════════════»\n",
       "«                                                                    »\n",
       "«                                                                           »\n",
       "« q_0: ─────────────────────────────────────────────────────────────────────»\n",
       "«      ┌──────────────────────────────┐                                     »\n",
       "« q_1: ┤ U3(1.4078e-06,2.4775,3.4032) ├─────────────────────────────────────»\n",
       "«      └──────────────────────────────┘                                     »\n",
       "« q_2: ─────────────────────────────────────────────────────────────────────»\n",
       "«        ┌─────────────────────────┐   ┌───┐┌───────────┐                   »\n",
       "« q_3: ──┤ U3(3.1416,4.5878,2.466) ├───┤ X ├┤ Rz(3π/10) ├──■────────────────»\n",
       "«        └─────────────────────────┘   └─┬─┘└───────────┘  │                »\n",
       "« q_4: ──────────────────────────────────┼─────────────────┼────────────────»\n",
       "«                                        │  ┌───────────┐┌─┴─┐┌────────────┐»\n",
       "« q_5: ──────────────────────────────────■──┤ Ry(7π/10) ├┤ X ├┤ Ry(5.3407) ├»\n",
       "«                                           └───────────┘└───┘└────────────┘»\n",
       "« q_6: ─────────────────────────────────────────────────────────────────────»\n",
       "«                                                                           »\n",
       "«c2: 3/═════════════════════════════════════════════════════════════════════»\n",
       "«                                                                           »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                     ┌───┐»\n",
       "« q_1: ───────────────────────────────────────────────────────────────┤ X ├»\n",
       "«                                                                     └─┬─┘»\n",
       "« q_2: ─────────────────────────────────────────────────────────────────┼──»\n",
       "«      ┌───┐┌────────────────────────────┐   ┌────────────────────┐     │  »\n",
       "« q_3: ┤ X ├┤ U3(-3.1416,4.6026,0.91001) ├───┤ U3(π,-1.3417,6.11) ├─────■──»\n",
       "«      └─┬─┘└────────────────────────────┘   └────────────────────┘        »\n",
       "« q_4: ──┼─────────────────────────────────────────────────────────────────»\n",
       "«        │  ┌────────────────────────────┐┌──────────────────────────┐     »\n",
       "« q_5: ──■──┤ U3(6.2832,-1.4344,-5.8688) ├┤ U3(5.4572,5.7067,6.1566) ├─────»\n",
       "«           └────────────────────────────┘└──────────────────────────┘     »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c2: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                          »\n",
       "« q_0: ────────────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────┐                 ┌───┐┌───────────────────────────────┐»\n",
       "« q_1: ┤ Rz(12π/5) ├──■──────────────┤ X ├┤ U3(-1.4649e-06,2.8517,8.5461) ├»\n",
       "«      └───────────┘  │              └─┬─┘└───────────────────────────────┘»\n",
       "« q_2: ───────────────┼────────────────┼───────────────────────────────────»\n",
       "«       ┌──────────┐┌─┴─┐┌──────────┐  │       ┌──────────────────────┐    »\n",
       "« q_3: ─┤ Ry(3π/5) ├┤ X ├┤ Ry(8π/5) ├──■───────┤ U3(π,-2.183,-5.7269) ├────»\n",
       "«       └──────────┘└───┘└──────────┘          └──────────────────────┘    »\n",
       "« q_4: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_5: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "« q_6: ────────────────────────────────────────────────────────────────────»\n",
       "«                                                                          »\n",
       "«c2: 3/════════════════════════════════════════════════════════════════════»\n",
       "«                                                                          »\n",
       "«                                                                   »\n",
       "« q_0: ─────────────────────────────────────────────────────────────»\n",
       "«       ┌────────────────────────┐                                  »\n",
       "« q_1: ─┤ U3(5.73,3.0955,4.6423) ├───────────────────■──────────────»\n",
       "«       └────────────────────────┘                   │              »\n",
       "« q_2: ──────────────────────────────────────────────┼──────────────»\n",
       "«      ┌─────────────────────────┐                 ┌─┴─┐            »\n",
       "« q_3: ┤ U3(6.206,4.7274,1.8108) ├──■──────────────┤ X ├────────────»\n",
       "«      └─────────────────────────┘  │              └───┘            »\n",
       "« q_4: ─────────────────────────────┼───────────────────────────────»\n",
       "«                                 ┌─┴─┐┌───────────────────────────┐»\n",
       "« q_5: ───────────────────────────┤ X ├┤ U3(0.12522,4.7307,1.3983) ├»\n",
       "«                                 └───┘└───────────────────────────┘»\n",
       "« q_6: ─────────────────────────────────────────────────────────────»\n",
       "«                                                                   »\n",
       "«c2: 3/═════════════════════════════════════════════════════════════»\n",
       "«                                                                   »\n",
       "«                                                                  »\n",
       "« q_0: ────────────────────────────────────────────────────────────»\n",
       "«      ┌───────────────────────────┐     ┌────────────────────────┐»\n",
       "« q_1: ┤ U3(3.1525,5.2939,0.53456) ├──■──┤ U3(2.6127,1.289,3.227) ├»\n",
       "«      └───────────────────────────┘  │  └────────────────────────┘»\n",
       "« q_2: ───────────────────────────────┼────────────────────────────»\n",
       "«       ┌──────────────────────────┐┌─┴─┐                          »\n",
       "« q_3: ─┤ U3(4.8666,5.1873,2.5621) ├┤ X ├────────────■─────────────»\n",
       "«       └──────────────────────────┘└───┘            │             »\n",
       "« q_4: ──────────────────────────────────────────────┼─────────────»\n",
       "«                                                  ┌─┴─┐           »\n",
       "« q_5: ────────────────────────────────────────────┤ X ├───────────»\n",
       "«                                                  └───┘           »\n",
       "« q_6: ────────────────────────────────────────────────────────────»\n",
       "«                                                                  »\n",
       "«c2: 3/════════════════════════════════════════════════════════════»\n",
       "«                                                                  »\n",
       "«                                           \n",
       "« q_0: ─────────────────────────────────────\n",
       "«                                  ┌─┐      \n",
       "« q_1: ────────────────────────────┤M├──────\n",
       "«                                  └╥┘      \n",
       "« q_2: ─────────────────────────────╫───────\n",
       "«      ┌─────────────────────────┐  ║ ┌─┐   \n",
       "« q_3: ┤ U3(2.975,5.1508,1.6618) ├──╫─┤M├───\n",
       "«      └─────────────────────────┘  ║ └╥┘   \n",
       "« q_4: ─────────────────────────────╫──╫────\n",
       "«      ┌──────────────────────────┐ ║  ║ ┌─┐\n",
       "« q_5: ┤ U3(4.7153,1.6179,4.9518) ├─╫──╫─┤M├\n",
       "«      └──────────────────────────┘ ║  ║ └╥┘\n",
       "« q_6: ─────────────────────────────╫──╫──╫─\n",
       "«                                   ║  ║  ║ \n",
       "«c2: 3/═════════════════════════════╩══╩══╩═\n",
       "«                                   0  1  2 "
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "step2_start_params, step2_qc = generate_step_ansact(step1_params)\n",
    "step2_qc"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3177ad60",
   "metadata": {},
   "source": [
    "And optimization function object."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "id": "e5daba06",
   "metadata": {},
   "outputs": [],
   "source": [
    "step2_of = create_op(useExecutePlace, step2_qc)\n",
    "nothing"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fdb6a4c5",
   "metadata": {},
   "source": [
    "Now we can find the best parameters."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "7ea15796",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "5.730022034267372, 3.0954841371265096, 4.642308363935754, 6.205985258973753, 4.727424036800263, 1.810806444535643, 5.457195601981444, 5.706667707995723, 6.1565570825105285, 3.152486933178031, 5.2938796132478405, 0.5345574246193956, 4.866603124854936, 5.187308475308523, 2.5620874824372075, 2.6126642763984718, 1.2889500630074973, 3.227041167713116, 0.12522034088555156, 4.730742889364116, 1.3982509897150546, 2.974960300950706, 5.1508335548441195, 1.6618292698849835, 4.715283712074324, 1.617949724057262, 4.951791693788761\n",
      "====================================\n",
      "Start iteration 1, value: 2.80307004788904, best: 2.80307004788904, dval: 2.5199352889096227\n",
      "====================================\n",
      "5.7171968442959304, 3.0983711877822127, 4.649491052656561, 6.199086094324643, 4.728017714333281, 1.8111664544487702, 5.456456077830602, 5.7017079583157, 6.14901827262559, 3.1272875802889346, 5.291018203345254, 0.5374444752750989, 4.85315520573859, 5.188556438842406, 2.562216692724674, 2.609579623767475, 1.2889500630074973, 3.22417975781053, 0.12996163339141312, 4.735867109292221, 1.4031875845860389, 2.98425124680747, 5.1508335548441195, 1.6626197031963001, 4.7104287088205306, 1.617949724057262, 4.94846847882644\n",
      "====================================\n",
      "Start iteration 2, value: 2.668072736826772, best: 2.668072736826772, dval: 2.339597119572394\n",
      "====================================\n",
      "5.460239150704117, 3.117548159630695, 4.722938735506448, 6.136215336423882, 4.740844121490057, 1.8133096161017175, 5.443350500864813, 5.614007621355194, 6.074382474449888, 2.8003665870732886, 5.267652780548352, 0.5566214471235827, 4.647098237900673, 5.204029005662519, 2.5623926392003384, 2.5191865930797506, 1.2889500630074973, 3.200814335013632, 0.15796816560912477, 4.807932629586563, 1.4750084608813057, 3.1177880881613165, 5.1508335548441195, 1.6667093829164454, 4.681959941349784, 1.617949724057262, 4.853162035910925\n",
      "====================================\n",
      "Start iteration 3, value: 1.43074010966307, best: 1.43074010966307, dval: 1.014442396742718\n",
      "====================================\n",
      "5.127246681219827, 3.1112852396800967, 4.7426205763232065, 6.129867876813501, 4.768226006204436, 1.8185399836951732, 5.423410743080898, 5.523005786697636, 6.0456917152626435, 2.550099572822292, 5.264341976000541, 0.5503585271729838, 4.4410582106273155, 5.227233799809379, 2.562598597409535, 2.0940986588321544, 1.2889500630074973, 3.1975035304658213, 0.15210560174731766, 4.840341998161315, 1.508060521693263, 3.28180770559432, 5.1508335548441195, 1.6668161787470919, 4.687835667246041, 1.617949724057262, 4.765665508913279\n",
      "====================================\n",
      "Start iteration 4, value: 0.8192997157292472, best: 0.8192997157292472, dval: 0.45933611055157114\n",
      "====================================\n",
      "4.860291012409115, 3.1000660463189633, 4.736299561526762, 6.133544125385183, 6.209365927978209, 1.8453173327650125, 5.344441770929157, 5.448065099240529, 6.04576698625028, 2.3430100842233057, 5.26625610223221, 0.5391393338118494, 4.100522745442352, 5.375286470118747, 2.563930272080111, 2.1484430811404307, 1.2889500630074973, 3.1994176566974897, 0.1425213686084132, 4.846205899625153, 1.512226229745097, 3.7117510008159127, 5.1508335548441195, 1.666936433534412, 4.697400615535087, 1.617949724057262, 4.596631919341689\n",
      "====================================\n",
      "Start iteration 5, value: 0.5413359626046981, best: 0.5413359626046981, dval: 0.5891499892065106\n",
      "====================================\n",
      "4.45680202036404, 3.0703672551564565, 4.719538795995281, 6.137915784825217, 5.259969180531919, 1.8248293860777294, 5.313311767302741, 5.495941549402604, 6.045842376517454, 2.2499227611656716, 5.268322295945266, 0.5094405426493398, 4.1036653174939595, 5.256722184451568, 2.5670945393347386, 2.255954816862668, 1.2889500630074973, 3.2014838504105456, 0.09363118375654934, 4.84250974879257, 1.509164734132649, 3.7979485542433817, 5.1508335548441195, 1.6668858773318258, 4.750595705477221, 1.617949724057262, 4.603876027500338\n",
      "====================================\n",
      "Start iteration 6, value: 0.32522312527726077, best: 0.32522312527726077, dval: 0.23877711020913117\n",
      "Start iteration 7, value: 0.5375633159884897, best: 0.32522312527726077, dval: 0.5876726630797132\n",
      "Big value increase: val: 0.5375633159884897, e.val: 0.32522312527726077, max(α): 16.142376989235313\n",
      "Start iteration 8, value: 0.7336994784207352, best: 0.32522312527726077, dval: 0.7033114469775532\n",
      "Big value increase: val: 0.7336994784207352, e.val: 0.32522312527726077, max(α): 18.372481382927283\n",
      "Start iteration 9, value: 1.5691736680795085, best: 0.32522312527726077, dval: 1.3075623143714141\n",
      "Big value increase: val: 1.5691736680795085, e.val: 0.32522312527726077, max(α): 40.60597120646925\n",
      "====================================\n",
      "4.4568012986244225, 2.4420682645112546, 4.697869981744422, 5.761045410962802, 5.859441755412211, 1.833004122719728, 5.286627353366116, 5.494303386321864, 6.045843728517613, 2.2586680450315413, 5.270406872594023, -0.11885844799591361, 4.778370283421495, 5.538019587522044, 2.5776154171352803, 2.460169670437133, 1.2889500630074973, 3.2035684270593046, -0.04954707545849661, 4.843056631726404, 1.509122215217079, 3.592128893471909, 5.1508335548441195, 1.6668944097699918, 5.152871989179055, 1.617949724057262, 3.9501818450745403\n",
      "====================================\n",
      "Start iteration 10, value: 0.20598286016838516, best: 0.20598286016838516, dval: 0.21179204193808526\n",
      "====================================\n",
      "4.456800449767799, 2.5289424671320377, 4.697469854498241, 5.756756511418746, 5.894721095684315, 1.8330652796899654, 5.286369286281359, 5.494159763020069, 6.045843710245806, 2.2566443531339018, 5.270612680069654, -0.031984245375123566, 4.652748988429463, 5.540056267886408, 2.5773181939629923, 2.426289565759301, 1.2889500630074973, 3.2037742345349356, -0.054778944810410735, 4.843056400771773, 1.5091217805810715, 3.832431023796004, 5.1508335548441195, 1.6666576202531895, 5.176511509875507, 1.617949724057262, 4.071679123512347\n",
      "====================================\n",
      "Start iteration 11, value: 0.137281469700365, best: 0.137281469700365, dval: 0.16050015810353774\n",
      "Start iteration 12, value: 0.5343848654649652, best: 0.137281469700365, dval: 0.6427031249574182\n",
      "Big value increase: val: 0.5343848654649652, e.val: 0.137281469700365, max(α): 27.698219531341405\n",
      "====================================\n",
      "4.456800015623264, 2.74254569621836, 4.6974511081033645, 5.75686559189339, 5.882047022842113, 1.833050438141312, 5.285479867444408, 5.494162611355526, 6.0458437125598, 2.248049095307081, 5.272034845774298, 0.18161898371121638, 4.5999177452015285, 5.541616679590658, 2.571187891950359, 2.39906888281612, 1.2889500630074973, 3.2051964002395827, -0.08082104782408872, 4.843056400139025, 1.5091217805670363, 3.8394767808463914, 5.1508335548441195, 1.666436482991732, 5.360819317044718, 1.617949724057262, 4.222676400133477\n",
      "====================================\n",
      "Start iteration 13, value: 0.1060695450370533, best: 0.1060695450370533, dval: 0.13369479059470754\n",
      "====================================\n",
      "4.456798519344392, 2.690407971986494, 4.697564419749381, 5.756774457000344, 5.878631355260448, 1.8330411603869405, 5.285225548079986, 5.4941722029673175, 6.0458437124545, 2.243546280516658, 5.27725944382385, 0.12948125947934563, 4.610459664609897, 5.53976872627545, 2.572304044528279, 2.404247409323178, 1.2889500630074973, 3.210420998289143, -0.07690493227743445, 4.84305639638755, 1.509121779801102, 3.8429157600333013, 5.1508335548441195, 1.6663435952887429, 5.363326009763397, 1.617949724057262, 4.31481156498858\n",
      "====================================\n",
      "Start iteration 14, value: 0.09493451475264997, best: 0.09493451475264997, dval: 0.11201411269467826\n",
      "====================================\n",
      "4.4567481746457895, 2.6580823063925427, 4.698491999608256, 5.756186056137685, 5.865800297289708, 1.833012161003026, 5.283029930444167, 5.494182374077685, 6.045843712314356, 2.0176723164055113, 5.304252544196696, 0.09715559388539152, 4.62492170647768, 5.538659854918834, 2.573251710373937, 2.4090984505708772, 1.2889500630074973, 3.2374140986620352, -0.07906261998524908, 4.843056396402618, 1.5091217798392718, 3.860773546353086, 5.1508335548441195, 1.664847247886212, 5.369322245935435, 1.617949724057262, 4.327378360474822\n",
      "====================================\n",
      "Start iteration 15, value: 0.07655599374284482, best: 0.07655599374284482, dval: 0.08489163859454137\n",
      "====================================\n",
      "4.45672472567703, 2.6693480972426658, 4.7024172517200755, 5.755953969558336, 5.795060097506569, 1.8329362068030643, 4.997576246498669, 5.49418908179392, 6.045843712319316, 2.038154879366375, 5.388739251159253, 0.10842138473551555, 4.643430644112096, 5.539440016216792, 2.573285462795706, 2.441499763303155, 1.2889500630074973, 3.3219008056247374, -0.08285411798817231, 4.843056396417758, 1.5091217798796448, 3.8503202108386705, 5.1508335548441195, 1.651795424729678, 5.3818391305676005, 1.617949724057262, 4.380053304650991\n",
      "====================================\n",
      "Start iteration 16, value: 0.06534406899786044, best: 0.06534406899786044, dval: 0.11851208302343463\n",
      "====================================\n",
      "4.456692639190288, 2.690750352879538, 4.825038520754929, 5.755714526136706, 5.810655745582018, 1.83295559774888, 5.164473059948105, 5.494184844769257, 6.045843712314375, 2.027717042799133, 5.520951424225895, 0.12982364037238942, 4.710888059997687, 5.541306991694885, 2.5733222354301906, 2.4192759782896798, 1.2889500630074973, 3.454112978691606, -0.08017343360176349, 4.843056396461965, 1.5091217800409782, 3.8573775029366177, 5.1508335548441195, 1.3811015719132396, 5.372925154754393, 1.617949724057262, 4.352313709713084\n",
      "====================================\n",
      "Start iteration 17, value: 0.04819575878353182, best: 0.04819575878353182, dval: 0.09129616417966652\n",
      "Start iteration 18, value: 0.2808092517766184, best: 0.04819575878353182, dval: 0.4023504404089288\n",
      "Big value increase: val: 0.2808092517766184, e.val: 0.04819575878353182, max(α): 155.40780618774266\n",
      "Start iteration 19, value: 0.28419132102938527, best: 0.04819575878353182, dval: 0.3007769247647037\n",
      "Big value increase: val: 0.28419132102938527, e.val: 0.04819575878353182, max(α): 21.571455639073083\n",
      "====================================\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "4.45669248338909, 2.776286516302747, 5.493582606866006, 5.755449054494228, 6.0069335229370004, 1.833035765697031, 5.138769549314229, 5.494186734949932, 6.045843712296401, 1.941960975774032, 5.54702260298233, 0.2153598037956057, 4.7235444579538965, 5.638965132261408, 2.5733208248625155, 2.4140300921973745, 1.2889500630074973, 3.4801841574480865, -0.08023310152029128, 4.843056396260334, 1.5091217788488298, 3.8821904248103722, 5.1508335548441195, 1.1951045919670924, 5.375575977255886, 1.617949724057262, 4.076712783961421\n",
      "====================================\n",
      "Start iteration 20, value: 0.04502664218386256, best: 0.04502664218386256, dval: 0.09678454656847651\n",
      "====================================\n",
      "4.456692442315214, 2.7625907433671, 5.354094141494649, 5.755445840157282, 5.986116423094888, 1.833032527481932, 5.013267853722959, 5.494189412502151, 6.045843712298518, 1.9084077213657622, 5.599334884411532, 0.20166403085995763, 4.721987382733901, 5.6496248250027215, 2.573320701947912, 2.4127156988354908, 1.2889500630074973, 3.53249643887738, -0.08024695682366166, 4.843056396135511, 1.5091217782976947, 3.883729893524795, 5.1508335548441195, 1.189995327318484, 5.377296820537514, 1.617949724057262, 4.1631329003539825\n",
      "====================================\n",
      "Start iteration 21, value: 0.031133470136746923, best: 0.031133470136746923, dval: 0.07915744198941048\n",
      "Start iteration 22, value: 0.048852717718239805, best: 0.031133470136746923, dval: 0.13258072722695957\n",
      "Big value increase: val: 0.048852717718239805, e.val: 0.031133470136746923, max(α): 11.028271808611825\n",
      "Start iteration 23, value: 0.4324004655533916, best: 0.031133470136746923, dval: 0.5595711646295715\n",
      "Big value increase: val: 0.4324004655533916, e.val: 0.031133470136746923, max(α): 32.02708369141458\n",
      "====================================\n",
      "4.456692431906073, 2.7826178265096444, 5.306595799741693, 5.755406079963239, 5.992293890633346, 1.8330244262224162, 5.057815318651174, 5.494187919158019, 6.045843712302601, 1.9078876572004417, 5.709877057759183, 0.2216911140025049, 4.721963703070819, 5.786936527453371, 2.573316085993392, 2.4078038977893508, 1.2889500630074973, 3.6430386122252223, -0.0802498725680201, 4.8430563961186515, 1.509121778229956, 3.9218625203831183, 5.1508335548441195, 1.1959790611926053, 5.382768603318222, 1.617949724057262, 4.4126507273195195\n",
      "====================================\n",
      "Start iteration 24, value: 0.020922264702504564, best: 0.020922264702504564, dval: 0.06336306821120474\n",
      "====================================\n",
      "4.4566924389261, 2.7829088886988806, 5.308393187436371, 5.755402436184888, 5.99231044458349, 1.8330235846482235, 5.053710490126426, 5.4941873465425966, 6.045843712304209, 1.9078112463961998, 5.714831344335726, 0.22198217619174104, 4.721958121561127, 5.785985844176916, 2.5733144535837034, 2.4068570232112583, 1.2889500630074973, 3.6479928988017734, -0.08026607338533615, 4.843056396124743, 1.5091217782560244, 3.9771512096011845, 5.1508335548441195, 1.1971880784924847, 5.391980242270743, 1.617949724057262, 4.383705819027847\n",
      "====================================\n",
      "Start iteration 25, value: 0.0202726300633893, best: 0.0202726300633893, dval: 0.05952372758750041\n",
      "====================================\n",
      "4.456692507576711, 2.78352451192434, 5.324291926874403, 5.755346142896769, 5.99261601684955, 1.8330221927914656, 5.042533992395959, 5.494178468923295, 6.045843712304253, 1.9071758697896264, 5.718296727394569, 0.22259779941720045, 4.721922536219431, 5.784370389649045, 2.573308260558406, 2.395623211042258, 1.2889500630074973, 3.651458281860622, -0.08030823868131343, 4.843056396176624, 1.5091217785001028, 3.9428441308263573, 5.1508335548441195, 1.2462874272639644, 5.427776003360484, 1.617949724057262, 4.356094997216327\n",
      "====================================\n",
      "Start iteration 26, value: 0.017333832995957723, best: 0.017333832995957723, dval: 0.05635083578504765\n",
      "====================================\n",
      "4.456692517604379, 2.786696040982786, 5.322751907317525, 5.75474285175406, 5.993913357457055, 1.833022548051095, 5.046899044182037, 5.494132445086283, 6.045843712304212, 1.9054968573552464, 5.715875576189855, 0.22576932847564601, 4.721869449269087, 5.785691540473364, 2.5732434906187422, 2.353651200626466, 1.2889500630074973, 3.649037130655904, -0.08031677422240692, 4.843056396262673, 1.5091217788845643, 3.946870908205203, 5.1508335548441195, 1.3142429425286817, 5.437310127917504, 1.617949724057262, 4.353713877720467\n",
      "====================================\n",
      "Start iteration 27, value: 0.015406283746284503, best: 0.015406283746284503, dval: 0.04191554965890154\n",
      "Start iteration 28, value: 0.01721605633498499, best: 0.015406283746284503, dval: 0.04996720504112889\n",
      "Big value increase: val: 0.01721605633498499, e.val: 0.015406283746284503, max(α): 13.888902980809783\n",
      "====================================\n",
      "4.4566925156984425, 2.791621655708652, 5.313784567022161, 5.753162788145718, 6.054277819536891, 1.8330542044763243, 5.063388743951278, 5.493610682660952, 6.045843712304066, 1.902816040598787, 5.711300106955972, 0.23069494320151132, 4.721489172791128, 5.800948533856249, 2.5727159459467024, 2.3524314720510424, 1.2889500630074973, 3.6444616614220138, -0.08034540136154995, 4.843056396383334, 1.5091217794805116, 3.953924666362867, 5.1508335548441195, 1.4286802457450483, 5.453631229596587, 1.617949724057262, 4.352780457958679\n",
      "====================================\n",
      "Start iteration 29, value: 0.013587553784276655, best: 0.013587553784276655, dval: 0.03098618702496469\n",
      "====================================\n",
      "4.456692513618517, 2.792174613948416, 5.296090910629253, 5.753158297833675, 6.099648292864627, 1.8330979001405552, 5.082908092931886, 5.493498628771508, 6.045843712304077, 1.9024139090146748, 5.726093578150814, 0.23124790144127513, 4.721455757055043, 5.849921779179664, 2.5726754889521715, 2.3502523329062788, 1.2889500630074973, 3.659255132616877, -0.08034780719674876, 4.8430563963794855, 1.5091217794273821, 3.9518912870889675, 5.1508335548441195, 1.3709436771583852, 5.454378177462371, 1.617949724057262, 4.352755859540833\n",
      "====================================\n",
      "Start iteration 30, value: 0.012120308673358287, best: 0.012120308673358287, dval: 0.029299909104729887\n",
      "====================================\n",
      "4.456692512182269, 2.791724512877976, 5.292989110340244, 5.753080276451117, 6.087728673756145, 1.8330743837718764, 5.093408689577351, 5.493205592203587, 6.045843712304118, 1.901468353073484, 5.7585181264564005, 0.23079780037083544, 4.721401915988288, 5.831881110139027, 2.5719193195280146, 2.3415704808246103, 1.2889500630074973, 3.6916796809225096, -0.08035444916302026, 4.8430563963832105, 1.5091217794756342, 3.9529417376646054, 5.1508335548441195, 1.397359195168251, 5.455572963494361, 1.617949724057262, 4.352716263978577\n",
      "====================================\n",
      "Start iteration 31, value: 0.011015587928119385, best: 0.011015587928119385, dval: 0.02098203994355749\n",
      "====================================\n",
      "4.456692511811381, 2.791718148132791, 5.288365573514179, 5.752885397124389, 6.097247213462019, 1.8330836718654584, 5.088345029256573, 5.492623976215277, 6.045843712304142, 1.8998441668696469, 5.760275588905008, 0.23079143562565016, 4.7210679135635925, 5.8410612556830195, 2.563424076519928, 2.3304297896993584, 1.2889500630074973, 3.69343714337112, -0.0803804146969826, 4.84305639638742, 1.509121779527936, 3.955198973398486, 5.1508335548441195, 1.4021379484890768, 5.461031580035542, 1.617949724057262, 4.35271389217235\n",
      "====================================\n",
      "Start iteration 32, value: 0.010365133318652327, best: 0.010365133318652327, dval: 0.020663376697248305\n",
      "====================================\n",
      "4.456692511176251, 2.79171154136076, 5.2737317132646275, 5.737384832104605, 6.20694730078992, 1.8335233719816686, 5.087845395686964, 5.485971222330895, 6.045843712304159, 1.8957371032028756, 5.762754824821321, 0.23078482885361923, 4.720081796556573, 5.857332948068652, 2.5176623992868907, 2.3176618866650376, 1.2889500630074973, 3.6959163792874365, -0.08041566932096716, 4.843056396454005, 1.5091217803709571, 3.9644546162431387, 5.1508335548441195, 1.415742380845652, 5.468824987978167, 1.617949724057262, 4.352716128651011\n",
      "====================================\n",
      "Start iteration 33, value: 0.00904523919526316, best: 0.00904523919526316, dval: 0.031308823607391935\n",
      "Start iteration 34, value: 0.009240699390830954, best: 0.00904523919526316, dval: 0.02541736837081543\n",
      "====================================\n",
      "4.456692508329954, 2.7915922208114994, 5.278487045340372, 5.653586516433098, 6.184037051042767, 1.833387237331348, 5.08756136287645, 5.489187201998549, 6.04584371230417, 1.8993988457874509, 5.7672823544269445, 0.23077071856912715, 4.720040650889288, 5.851746999641531, 2.511838905414506, 2.3083393539095614, 1.2889500630074973, 3.700443908893067, -0.08046039690784215, 4.84305639650948, 1.5091217812919617, 3.9715034152354116, 5.1508335548441195, 1.4302295148029396, 5.502565278356158, 1.617949724057262, 4.352722073807585\n",
      "====================================\n",
      "Start iteration 35, value: 0.009019317442762036, best: 0.009019317442762036, dval: 0.03262265360727741\n",
      "Start iteration 36, value: 0.015077252628521103, best: 0.009019317442762036, dval: 0.08318518956155765\n",
      "Big value increase: val: 0.015077252628521103, e.val: 0.009019317442762036, max(α): 11.446210019564472\n",
      "====================================\n",
      "4.456692508154331, 2.791405323581715, 5.280009580218803, 5.701729971422594, 6.184542241513213, 1.833435057449369, 5.087076823900897, 5.490328375900575, 6.045843712304161, 1.9004542532881086, 5.797295353073972, 0.23073401340847957, 4.720120357345519, 5.841106378271032, 2.5115663624137072, 2.3142152503860274, 1.2889500630074973, 3.7304569075401344, -0.08046159185430529, 4.843056396511359, 1.5091217813236844, 3.9696823678283883, 5.1508335548441195, 1.417938794515495, 5.503405493495033, 1.617949724057262, 4.352721789906689\n",
      "====================================\n",
      "Start iteration 37, value: 0.007400044722043593, best: 0.007400044722043593, dval: 0.020225697085010666\n",
      "====================================\n",
      "4.456692500853273, 2.791344096273546, 5.280077478111262, 5.700691394478611, 6.184927169649609, 1.8334375669372664, 5.08695338894742, 5.489950879011654, 6.045843712304141, 1.9009401694958161, 5.805924908722531, 0.23072198884190387, 4.720191945635902, 5.843001092419652, 2.5113656130041795, 2.3148641753474535, 1.2889500630074973, 3.7390864631887046, -0.08046079829145926, 4.843056396511385, 1.5091217813240447, 3.9692465916490276, 5.1508335548441195, 1.412978038052896, 5.5027970089193206, 1.617949724057262, 4.352721813887889\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 38, value: 0.007313570536299746, best: 0.007313570536299746, dval: 0.019011989856180023\n",
      "====================================\n",
      "4.456692467902669, 2.790385007512949, 5.280242524868121, 5.696627059419771, 6.187437825682683, 1.8334759432321193, 5.086210508374536, 5.489152997896085, 6.045843712303966, 1.9017496752549221, 5.807499320536488, 0.230533631277302, 4.720226326193257, 5.8541679002924045, 2.510464239014887, 2.321261156988329, 1.2889500630074973, 3.7406608750026638, -0.0804547210846085, 4.843056396511422, 1.5091217813245088, 3.966411590225206, 5.1508335548441195, 1.4073935986625217, 5.499435391905937, 1.617949724057262, 4.352721972429118\n",
      "====================================\n",
      "Start iteration 39, value: 0.007162246750386172, best: 0.007162246750386172, dval: 0.020306787293032633\n",
      "Start iteration 40, value: 0.052593489976771754, best: 0.007162246750386172, dval: 0.22018101060135747\n",
      "Big value increase: val: 0.052593489976771754, e.val: 0.007162246750386172, max(α): 551.2646637280263\n",
      "====================================\n",
      "4.456678118080486, 2.753869116822719, 5.288339952209056, 5.695092233312174, 6.312090718296983, 1.833591753145001, 5.07526799505034, 5.488797782556149, 6.045843712301846, 1.901638967887011, 5.812545633997435, 0.22336219467804638, 4.720223270354552, 5.868720873519591, 2.49983715772907, 2.3212528318845305, 1.2889500630074973, 3.745707188463618, -0.08045465682615273, 4.84305639651156, 1.5091217813262667, 3.9627284691197207, 5.1508335548441195, 1.4075811892003016, 5.499419130923776, 1.617949724057262, 4.352721928665571\n",
      "====================================\n",
      "Start iteration 41, value: 0.006817071656691453, best: 0.006817071656691453, dval: 0.025026476656263286\n",
      "====================================\n",
      "4.456652910183426, 2.7510384776931716, 5.322947702575116, 5.677023269209721, 6.245893532398082, 1.8335471049939962, 5.075646777710135, 5.4902449531483395, 6.045843712302731, 1.9014605213525808, 5.818516255442752, 0.22280627919387735, 4.720245670322747, 5.861039389246467, 2.4738314587788457, 2.3209876152453597, 1.2889500630074973, 3.751677809908943, -0.08045464404078174, 4.843056396511728, 1.509121781328614, 3.962133343629731, 5.1508335548441195, 1.4080922595835392, 5.499387702043671, 1.617949724057262, 4.352721926980812\n",
      "====================================\n",
      "Start iteration 42, value: 0.005484801197173964, best: 0.005484801197173964, dval: 0.009643865142319463\n",
      "====================================\n",
      "4.45661831298536, 2.7118811392563047, 5.304346667359354, 5.672085040635465, 6.261934664658156, 1.8335494272189354, 5.075571629401766, 5.4904529790922485, 6.045843712303124, 1.9014668109580661, 5.820544385641706, 0.21511608282491027, 4.720261173262857, 5.860912727058782, 2.4569985670404675, 2.3209116662588274, 1.2889500630074973, 3.7537059401078996, -0.08045465616800679, 4.843056396511768, 1.509121781329089, 3.962076365179809, 5.1508335548441195, 1.4078180506986349, 5.4994076425657035, 1.617949724057262, 4.3527219236068495\n",
      "====================================\n",
      "Start iteration 43, value: 0.005020068947189763, best: 0.005020068947189763, dval: 0.015761798648729675\n",
      "Start iteration 44, value: 0.018213894362933206, best: 0.005020068947189763, dval: 0.09394067627092659\n",
      "Big value increase: val: 0.018213894362933206, e.val: 0.005020068947189763, max(α): 49.58039802027548\n",
      "Start iteration 45, value: 0.02511069349663059, best: 0.005020068947189763, dval: 0.1473182249274118\n",
      "Big value increase: val: 0.02511069349663059, e.val: 0.005020068947189763, max(α): 14.719285792470446\n",
      "====================================\n",
      "4.455735626846147, 2.690694172114555, 5.318507446535205, 5.66520874608968, 6.366663905222825, 1.8335479051249166, 5.0756218715489, 5.490548445320719, 6.0458437123037205, 1.90150629898753, 5.830304379561825, 0.21095512745135744, 4.720457718992393, 5.860330389780852, 2.382602520106278, 2.319998603656034, 1.2889500630074973, 3.7634659340280336, -0.08045466838475815, 4.843056396511857, 1.5091217813301037, 3.961990660969491, 5.1508335548441195, 1.4076608873188847, 5.499407253136109, 1.617949724057262, 4.352721300603071\n",
      "====================================\n",
      "Start iteration 46, value: 0.004569355224489689, best: 0.004569355224489689, dval: 0.025706701870796267\n",
      "====================================\n",
      "4.452772030410535, 2.6886449808249693, 5.319541985968426, 5.65923478993777, 6.343539841865732, 1.8335478210464657, 5.075616740297221, 5.490681342364369, 6.045843712303756, 1.9015120948844817, 5.831578364502253, 0.21055268223818494, 4.7207696179506184, 5.860320231765762, 2.3864632764384015, 2.3199261891494616, 1.2889500630074973, 3.7647399189684636, -0.08045466944893741, 4.843056396511861, 1.509121781330153, 3.9620021725100405, 5.1508335548441195, 1.4075095936742825, 5.499407336411894, 1.617949724057262, 4.3527212970199125\n",
      "====================================\n",
      "Start iteration 47, value: 0.00420547468808947, best: 0.00420547468808947, dval: 0.018996886385829692\n",
      "====================================\n",
      "4.4457874775000015, 2.686067537236275, 5.319906329262247, 5.649220035185299, 6.327127672237804, 1.8335476781828843, 5.075609069877146, 5.490894255018167, 6.045843712303835, 1.9020762726501332, 5.834532620800599, 0.2100464923867232, 4.725822928920676, 5.860307713503875, 2.3944407353839123, 2.319742697197181, 1.2889500630074973, 3.7676941752668136, -0.080454673390572, 4.843056396511926, 1.5091217813307474, 3.962052029119714, 5.1508335548441195, 1.406680109882033, 5.499407586765512, 1.617949724057262, 4.352721263965499\n",
      "====================================\n",
      "Start iteration 48, value: 0.003938770247152262, best: 0.003938770247152262, dval: 0.015435881089732317\n",
      "Start iteration 49, value: 0.004732425818505158, best: 0.003938770247152262, dval: 0.02566566833906868\n",
      "Big value increase: val: 0.004732425818505158, e.val: 0.003938770247152262, max(α): 20.995635790071244\n",
      "Start iteration 50, value: 0.010936080441338219, best: 0.003938770247152262, dval: 0.08766949584507283\n",
      "Big value increase: val: 0.010936080441338219, e.val: 0.003938770247152262, max(α): 81.50181687575754\n",
      "====================================\n",
      "4.445656352811099, 2.684490626101168, 5.321139013571741, 5.6490283800848475, 6.329525972649764, 1.8335473190849279, 5.075512735763247, 5.4909542429321965, 6.045843712303832, 1.9302373472518968, 5.850609846474079, 0.20973679931846367, 4.745867986033659, 5.860297810222999, 2.38525996461422, 2.2978885702629426, 1.2889500630074973, 3.783771400940315, -0.08045474179490457, 4.843056396512236, 1.5091217813335247, 3.9624267098033887, 5.1508335548441195, 1.3830798812878793, 5.499410830338935, 1.617949724057262, 4.352719340513345\n",
      "====================================\n",
      "Start iteration 51, value: 0.003383148253980912, best: 0.003383148253980912, dval: 0.016563013025042317\n",
      "====================================\n",
      "4.445684831031533, 2.6844617949623197, 5.321059600304954, 5.64916787349224, 6.329601533939118, 1.8335473525446506, 5.0754768274386475, 5.490936793643588, 6.045843712303821, 1.9289320965347803, 5.844152597135121, 0.20973113710728855, 4.74534945631991, 5.860297499910302, 2.3778078494883075, 2.295248341246279, 1.2889500630074973, 3.7773141516013533, -0.08045475254439491, 4.843056396512264, 1.5091217813337654, 3.9624411649485096, 5.1508335548441195, 1.385528074012318, 5.499413906061595, 1.617949724057262, 4.352713093318283\n",
      "====================================\n",
      "Start iteration 52, value: 0.0033580566493711644, best: 0.0033580566493711644, dval: 0.01737949998984961\n",
      "====================================\n",
      "4.445710620784838, 2.6844114290925045, 5.3208978573807375, 5.649669706780617, 6.330304999929191, 1.8335475813066997, 5.074712493464065, 5.490891770639939, 6.045843712303785, 1.9278731871202555, 5.847181440881528, 0.20972124564263248, 4.74503420112584, 5.8602968040273, 2.3782877015185986, 2.2958976429962084, 1.2889500630074973, 3.7803429953477625, -0.08045495112604607, 4.843056396512333, 1.5091217813344495, 3.9624811626921717, 5.1508335548441195, 1.3887084733395825, 5.499494367813445, 1.617949724057262, 4.3525077588493595\n",
      "====================================\n",
      "Start iteration 53, value: 0.0033236834406428, best: 0.0033236834406428, dval: 0.016611731510326744\n",
      "====================================\n",
      "4.445719715406975, 2.6841725380047814, 5.320525367828491, 5.65214684987665, 6.340259417540712, 1.833550435982127, 5.058175072211926, 5.486996321014831, 6.0458437123034985, 1.9248244375905554, 5.847456957677961, 0.20967432929313753, 4.744859578980619, 5.860295716881425, 2.378252969869908, 2.2955506716399743, 1.2889500630074973, 3.7806185121441964, -0.08046272796795774, 4.843056396513029, 1.509121781340777, 3.9637336072881513, 5.1508335548441195, 1.3881574416440239, 5.501756008435166, 1.617949724057262, 4.343713399267548\n",
      "====================================\n",
      "Start iteration 54, value: 0.002977077097033183, best: 0.002977077097033183, dval: 0.007245081248410034\n",
      "====================================\n",
      "4.445710756722995, 2.6838097786281496, 5.320476029224656, 5.65120647453395, 6.356054959390451, 1.833552224527084, 5.048865830711858, 5.485530718907143, 6.045843712303129, 1.9244325076408773, 5.847748153794346, 0.20960308617620568, 4.7450247358691735, 5.860293620930356, 2.378217943797925, 2.2951782109000396, 1.2889500630074973, 3.7809097082605816, -0.08046654111355055, 4.84305639651523, 1.509121781357585, 3.9682960780534025, 5.1508335548441195, 1.3874461755265401, 5.5029155758508095, 1.617949724057262, 4.34152721435997\n",
      "====================================\n",
      "Start iteration 55, value: 0.0028596396310614806, best: 0.0028596396310614806, dval: 0.009681163543517668\n",
      "====================================\n",
      "4.4456871584450175, 2.6828589624212698, 5.320515285902364, 5.649278358661354, 6.36033107746425, 1.8335511866925, 5.048022764356975, 5.486392737412188, 6.045843712303305, 1.9238371989396992, 5.84827814908889, 0.20941635327673827, 4.745462056532409, 5.8602881673053915, 2.378156741171891, 2.2943409287294667, 1.2889500630074973, 3.781439703555126, -0.08046724469912417, 4.843056396526362, 1.5091217814617335, 3.9673326267645206, 5.1508335548441195, 1.3842708482353159, 5.50306312844454, 1.617949724057262, 4.341895759946195\n",
      "====================================\n",
      "Start iteration 56, value: 0.0028216207300834732, best: 0.0028216207300834732, dval: 0.009533593741198887\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 57, value: 0.00309432963157865, best: 0.0028216207300834732, dval: 0.01919386145195573\n",
      "====================================\n",
      "4.4391266078666245, 2.680257648174885, 5.320548613017085, 5.638395579524171, 6.440759977595858, 1.833549726761622, 5.024560316768026, 5.487958156463789, 6.0458437123039666, 1.9122674381218299, 5.86001031286016, 0.20890547541397322, 4.779241794586407, 5.860176770829848, 2.3764701125667416, 2.267295056418316, 1.2889500630074973, 3.793171867326404, -0.08046846089473701, 4.843056396635908, 1.5091217824039134, 3.9668964416136228, 5.1508335548441195, 1.3849759876466792, 5.503339095456392, 1.617949724057262, 4.3418216676202555\n",
      "====================================\n",
      "Start iteration 58, value: 0.0025670256148909204, best: 0.0025670256148909204, dval: 0.01830394526669578\n",
      "====================================\n",
      "4.435301723247849, 2.679660853562728, 5.3205526883874965, 5.638312298244125, 6.372319791227707, 1.8335420913115972, 5.0247335576829535, 5.488835624575664, 6.0458437123112105, 1.9104272570965255, 5.865428208253893, 0.20865869342009344, 4.7771989708448555, 5.860045069089819, 2.350441107377903, 2.256733018233865, 1.2889500630074973, 3.7985897627201406, -0.08046899110222325, 4.843056396801335, 1.5091217835704078, 3.966832450689256, 5.1508335548441195, 1.3854664638979064, 5.5034348404868565, 1.617949724057262, 4.341764035392087\n",
      "====================================\n",
      "Start iteration 59, value: 0.002438097805622438, best: 0.002438097805622438, dval: 0.01674954662340166\n",
      "====================================\n",
      "4.436807926590653, 2.6759712030803335, 5.320557872924654, 5.638367795589298, 6.410712063284077, 1.8335441629705131, 5.024593924214358, 5.488418327924842, 6.045843712308993, 1.9121376087685087, 5.864602173864947, 0.2071329770610362, 4.773981733769298, 5.860003806396943, 2.354829271763595, 2.261501326081436, 1.2889500630074973, 3.797763728331194, -0.0804694555769167, 4.843056396812183, 1.5091217836865551, 3.966893290471994, 5.1508335548441195, 1.385699574969336, 5.50357650472021, 1.617949724057262, 4.341638184055673\n",
      "====================================\n",
      "Start iteration 60, value: 0.002002518891223756, best: 0.002002518891223756, dval: 0.010341638555806179\n",
      "====================================\n",
      "4.4364098107646, 2.6642489068724844, 5.320569513152127, 5.638353112458442, 6.417219340760352, 1.83354328452899, 5.02453254652552, 5.488432153765693, 6.045843712309617, 1.91713904100755, 5.865155033860226, 0.20228566180031748, 4.774986943465844, 5.859932388391944, 2.352313358086791, 2.2608492286208435, 1.2889500630074973, 3.798316588326474, -0.08047435838372763, 4.843056396824653, 1.5091217838292803, 3.966960921979994, 5.1508335548441195, 1.3862435142360887, 5.505094332050858, 1.617949724057262, 4.337703447461856\n",
      "====================================\n",
      "Start iteration 61, value: 0.0018967837865413607, best: 0.0018967837865413607, dval: 0.00982606838358828\n",
      "====================================\n",
      "4.435685104693842, 2.6667202282596887, 5.320572017788381, 5.638334304535433, 6.456786231565938, 1.8335250912861047, 5.024553841875935, 5.488420086589082, 6.0458437123117825, 1.9243689914661806, 5.867423664226868, 0.20330758392734202, 4.776536443215217, 5.858571258057506, 2.3476248078567994, 2.25919491442531, 1.2889500630074973, 3.80058521869312, -0.08048300441718609, 4.843056396871212, 1.5091217844102904, 3.9670169481282693, 5.1508335548441195, 1.401420736802723, 5.507054457939575, 1.617949724057262, 4.336362940598474\n",
      "====================================\n",
      "Start iteration 62, value: 0.0018803955875939323, best: 0.0018803955875939323, dval: 0.012380153288836522\n",
      "====================================\n",
      "4.43456510932894, 2.6649597787730857, 5.3205698684766025, 5.638303047294379, 6.4250525742410085, 1.8334931014693643, 5.024594426762172, 5.488430156637105, 6.045843712315054, 1.9240255905350712, 5.8712512594949375, 0.20257961617163708, 4.804025453870376, 5.85197359086492, 2.315360939020065, 2.257032416291898, 1.2889500630074973, 3.8044128139611977, -0.08051050790395664, 4.84305639705138, 1.5091217862580082, 3.9672068223699806, 5.1508335548441195, 1.398473687413893, 5.513935097530233, 1.617949724057262, 4.330145644856509\n",
      "====================================\n",
      "Start iteration 63, value: 0.0017689005656025113, best: 0.0017689005656025113, dval: 0.013221914932481427\n",
      "====================================\n",
      "4.433585930549527, 2.6625450698193625, 5.320538868334025, 5.638253861563484, 6.441961483643862, 1.8335023538024957, 5.024565958960423, 5.488435131256287, 6.045843712314512, 1.924343230491989, 5.870939140354081, 0.20158110398989051, 4.783824942589541, 5.849420525671037, 2.3282246534514854, 2.256530132726595, 1.2889500630074973, 3.804100694820341, -0.0805544606598722, 4.843056396961245, 1.5091217853364722, 3.9674270229024557, 5.1508335548441195, 1.3937356175686046, 5.541061207759006, 1.617949724057262, 4.334377397693147\n",
      "====================================\n",
      "Start iteration 64, value: 0.0016878687510371373, best: 0.0016878687510371373, dval: 0.013964134602639344\n",
      "====================================\n",
      "4.432125682007485, 2.6615538794594933, 5.320562094663917, 5.63815921428785, 6.45016877876109, 1.8335383831266332, 5.024584046202843, 5.4884806616098585, 6.04584371231378, 1.925612635357859, 5.87117344308347, 0.2011712344496161, 4.792554351324937, 5.842743792892874, 2.326929334203528, 2.2557510049597016, 1.2889500630074973, 3.8043349975497303, -0.0805160034446181, 4.843056396975933, 1.5091217854383843, 3.9676406779404925, 5.1508335548441195, 1.3919352048447426, 5.518646169652915, 1.617949724057262, 4.335250510819986\n",
      "====================================\n",
      "Start iteration 65, value: 0.0014194547535696178, best: 0.0014194547535696178, dval: 0.007228196171760792\n",
      "====================================\n",
      "4.4311989973385595, 2.6588095954713946, 5.320563434201416, 5.638035471642618, 6.458661982955774, 1.8335275800847775, 5.024583337555902, 5.488656557971094, 6.045843712313854, 1.9286582881619165, 5.871724100478593, 0.2000364388925519, 4.790977940661626, 5.822420309634108, 2.324859119596297, 2.251257804218384, 1.2889500630074973, 3.804885654944854, -0.08051621359462742, 4.843056397119651, 1.509121785679172, 3.9780401629646978, 5.1508335548441195, 1.3904684041381397, 5.5180613830157315, 1.617949724057262, 4.334501312935105\n",
      "====================================\n",
      "Start iteration 66, value: 0.0013144426342834592, best: 0.0013144426342834592, dval: 0.00699150107878399\n",
      "Start iteration 67, value: 0.004274006479504683, best: 0.0013144426342834592, dval: 0.05599916234599578\n",
      "Big value increase: val: 0.004274006479504683, e.val: 0.0013144426342834592, max(α): 18.983075165642735\n",
      "====================================\n",
      "4.430948464579028, 2.65302508078032, 5.320562650221965, 5.637977445892571, 6.495689093093631, 1.8335396372956776, 5.024581408094789, 5.488825870478424, 6.045843712313806, 1.9353087409410696, 5.871655862947755, 0.19764447013142059, 4.791023378665803, 5.826098193605133, 2.310190046697067, 2.236526837681417, 1.2889500630074973, 3.804817417414016, -0.0805195724971582, 4.843056397186799, 1.5091217856787726, 3.974930144572691, 5.1508335548441195, 1.3887147180683084, 5.518054971832404, 1.617949724057262, 4.33388981124878\n",
      "====================================\n",
      "Start iteration 68, value: 0.001099262528522895, best: 0.001099262528522895, dval: 0.008560579871479956\n",
      "====================================\n",
      "4.429721003563584, 2.641584171538907, 5.3205630646662305, 5.637960654737874, 6.493355055484186, 1.8335390533912332, 5.024581235560327, 5.489106806926874, 6.045843712313807, 1.9385673172288833, 5.872177474882801, 0.19291351188065742, 4.791141300752523, 5.812785901952953, 2.2955935391417253, 2.220881543245445, 1.2889500630074973, 3.8053390293490654, -0.08070875222676034, 4.84305639750309, 1.5091217857695858, 3.974360067282704, 5.1508335548441195, 1.3883381743939633, 5.518096252514109, 1.617949724057262, 4.333564285641572\n",
      "====================================\n",
      "Start iteration 69, value: 0.0009431884144005119, best: 0.0009431884144005119, dval: 0.005285835567731928\n",
      "====================================\n",
      "4.42997893921211, 2.6412177265500794, 5.32056328613355, 5.637967237667862, 6.494681842988191, 1.8335394406994503, 5.0245808909841525, 5.489126171235888, 6.045843712313806, 1.9438716434670043, 5.872148195973719, 0.1927619823206579, 4.791342639114552, 5.8209605591917, 2.2869251717092296, 2.2213487931821994, 1.2889500630074973, 3.8053097504399833, -0.08067206795657111, 4.843056397487897, 1.50912178575327, 3.9743819645555383, 5.1508335548441195, 1.3878656906200681, 5.51806417840897, 1.617949724057262, 4.333530260164553\n",
      "====================================\n",
      "Start iteration 70, value: 0.0008865559879680851, best: 0.0008865559879680851, dval: 0.005351873121048047\n",
      "====================================\n",
      "4.429854460616713, 2.6408324601888262, 5.32056359642679, 5.638107415452507, 6.501673339688204, 1.833550908546919, 5.024577228925927, 5.489153119777493, 6.0458437123138005, 1.9545897958068794, 5.872172890337299, 0.19260266988909736, 4.791927884828334, 5.823737348991072, 2.29021602911048, 2.2210670582283427, 1.2889500630074973, 3.805334444803563, -0.08062730499488113, 4.843056397470201, 1.5091217857219612, 3.974404651282072, 5.1508335548441195, 1.387175346237328, 5.5179759783719255, 1.617949724057262, 4.333551485474883\n",
      "====================================\n",
      "Start iteration 71, value: 0.000868387333843851, best: 0.000868387333843851, dval: 0.0039014882818999425\n",
      "====================================\n",
      "4.429685802661511, 2.6380852363093865, 5.3205640430589884, 5.638578013610094, 6.505085381328831, 1.8335799188747461, 5.024563919393113, 5.489233852017617, 6.045843712313789, 1.948902674172798, 5.872222456194579, 0.19146665865040227, 4.7923085296626775, 5.822104081741961, 2.287590842680025, 2.22072178221862, 1.2889500630074973, 3.805384010660843, -0.08057302582990473, 4.843056397482125, 1.5091217857410208, 3.974404609148868, 5.1508335548441195, 1.3865582973462953, 5.517642878377996, 1.617949724057262, 4.3335477336338\n",
      "====================================\n",
      "Start iteration 72, value: 0.0008301080873087339, best: 0.0008301080873087339, dval: 0.003570052372200705\n",
      "====================================\n",
      "4.429437477428927, 2.632871345745904, 5.320565583455561, 5.638866485160444, 6.523223435330158, 1.8336779871439337, 5.024142158066098, 5.4901304362504275, 6.045843712313667, 1.949067411414867, 5.872719472072827, 0.1893106500623255, 4.792989465192748, 5.820858820519961, 2.2803297055628446, 2.219186443155065, 1.2889500630074973, 3.805881026539091, -0.08048910793210995, 4.84305639786906, 1.5091217861780182, 3.974404650227163, 5.1508335548441195, 1.3814551623518652, 5.516569289322745, 1.617949724057262, 4.33354287363577\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 73, value: 0.0007900971878419545, best: 0.0007900971878419545, dval: 0.006363062813700249\n",
      "Start iteration 74, value: 0.0008818962791044491, best: 0.0007900971878419545, dval: 0.010540737593963248\n",
      "Big value increase: val: 0.0008818962791044491, e.val: 0.0007900971878419545, max(α): 10.514672279584875\n",
      "Start iteration 75, value: 0.0040989187200492685, best: 0.0007900971878419545, dval: 0.05750508110784344\n",
      "Big value increase: val: 0.0040989187200492685, e.val: 0.0007900971878419545, max(α): 45.821397324625664\n",
      "Start iteration 76, value: 0.020090472368432113, best: 0.0007900971878419545, dval: 0.11495332197979834\n",
      "Big value increase: val: 0.020090472368432113, e.val: 0.0007900971878419545, max(α): 41.117589304805655\n",
      "Start iteration 77, value: 0.003746919332071329, best: 0.0007900971878419545, dval: 0.054971997248263516\n",
      "Big value increase: val: 0.003746919332071329, e.val: 0.0007900971878419545, max(α): 3.7810967883501996\n",
      "Start iteration 78, value: 0.6852340160299641, best: 0.0007900971878419545, dval: 1.0420863596552445\n",
      "Big value increase: val: 0.6852340160299641, e.val: 0.0007900971878419545, max(α): 41.25632302510737\n",
      "Start iteration 79, value: 0.002558447021393122, best: 0.0007900971878419545, dval: 0.0335631223256803\n",
      "Big value increase: val: 0.002558447021393122, e.val: 0.0007900971878419545, max(α): 1.0130173988167963\n",
      "Start iteration 80, value: 0.002301337259594035, best: 0.0007900971878419545, dval: 0.0270580169919981\n",
      "Big value increase: val: 0.002301337259594035, e.val: 0.0007900971878419545, max(α): 1.0011706837228556\n",
      "Start iteration 81, value: 0.0018953670876321964, best: 0.0007900971878419545, dval: 0.023867532640718905\n",
      "Big value increase: val: 0.0018953670876321964, e.val: 0.0007900971878419545, max(α): 1.5708373680133785\n",
      "Start iteration 82, value: 0.0010951363643969373, best: 0.0007900971878419545, dval: 0.01396737156492489\n",
      "Big value increase: val: 0.0010951363643969373, e.val: 0.0007900971878419545, max(α): 4.029246660676773\n",
      "Start iteration 83, value: 0.0008046525741439108, best: 0.0007900971878419545, dval: 0.010678874742627423\n",
      "====================================\n",
      "4.429437477227184, 2.561711691635192, 5.320583003443922, 5.637236603628354, 6.584639277023019, 1.8336802767353162, 5.016681757036001, 5.491773516972239, 6.045843712313403, 1.9505492601840881, 5.873730744442273, 0.15988524814425553, 4.8500413373447016, 5.822252936478934, 2.19776759324933, 2.1853852656029744, 1.2889500630074973, 3.806892206443546, -0.08049485194411732, 4.843056399592235, 1.5091217877612775, 3.9744053559113923, 5.1508335548441195, 1.395324633845138, 5.516225729365916, 1.617949724057262, 4.329588332698997\n",
      "====================================\n",
      "Start iteration 84, value: 0.0006801489561970455, best: 0.0006801489561970455, dval: 0.009253727390993886\n",
      "====================================\n",
      "4.4294374778970855, 2.582345364528366, 5.3205307241894, 5.635805960698397, 6.58635395912526, 1.8336821833959183, 5.001744867740473, 5.491760824574342, 6.04584371231341, 1.9544974547371134, 5.873730731305296, 0.16841752848647107, 4.851034708007467, 5.826083303069067, 2.1994751003706754, 2.174376315009027, 1.2889500630074973, 3.8068920304916185, -0.08059341544688126, 4.843056399599962, 1.5091217877655614, 3.97440818341878, 5.1508335548441195, 1.39431621279538, 5.516370254949743, 1.617949724057262, 4.327626508186964\n",
      "====================================\n",
      "Start iteration 85, value: 0.00046716028127941, best: 0.00046716028127941, dval: 0.0052484259810716\n",
      "Start iteration 86, value: 0.0004945448260778978, best: 0.00046716028127941, dval: 0.009063708891611788\n",
      "====================================\n",
      "4.429437477628014, 2.5800599008212854, 5.320460029602424, 5.630031240076746, 6.592101066060551, 1.8337051862642526, 4.991635930692091, 5.491761644976523, 6.045843712313403, 1.9637272276491093, 5.87373074999565, 0.16747246082150777, 4.8499498378656885, 5.822999003742309, 2.200427468803131, 2.1649632327872474, 1.2889500630074973, 3.8068922808234578, -0.08044293826733781, 4.843056399591731, 1.509121787760463, 3.9744171248486064, 5.1508335548441195, 1.3945817936508265, 5.516376804292349, 1.617949724057262, 4.330893400978376\n",
      "====================================\n",
      "Start iteration 87, value: 0.0004058136730487133, best: 0.0004058136730487133, dval: 0.004522819785693503\n",
      "====================================\n",
      "4.429437477579691, 2.5801030657366866, 5.3204202428630865, 5.630336827357869, 6.596560266513094, 1.8337206522570304, 4.991737710487554, 5.491760684688671, 6.045843712313398, 1.9664831784581855, 5.873730790873062, 0.16757634614458783, 4.849738733644049, 5.81511748333747, 2.2001342080287944, 2.168810156751845, 1.2889500630074973, 3.8068928283207635, -0.08037950512923582, 4.843056399587332, 1.5091217877515437, 3.974463335210537, 5.1508335548441195, 1.391162845613974, 5.5163734268325975, 1.617949724057262, 4.3307608208207515\n",
      "====================================\n",
      "Start iteration 88, value: 0.0003730486179240852, best: 0.0003730486179240852, dval: 0.0035247026337568155\n",
      "Start iteration 89, value: 0.0005315031898712988, best: 0.0003730486179240852, dval: 0.00990594589853835\n",
      "Big value increase: val: 0.0005315031898712988, e.val: 0.0003730486179240852, max(α): 42.64414658731223\n",
      "====================================\n",
      "4.429437477444763, 2.580197721304554, 5.320362519113276, 5.629701339029422, 6.598582933360871, 1.8337896566447534, 4.9928118739661835, 5.491760703097893, 6.045843712313355, 1.9670008630264466, 5.873731979737912, 0.16780415440409246, 4.8323401936015316, 5.8114208119350055, 2.1969689462223023, 2.1677947127153447, 1.2889500630074973, 3.8069087515473354, -0.07600282355587017, 4.843056399584949, 1.5091217877439618, 3.9780475859345, 5.1508335548441195, 1.387785333600462, 5.5162262211706485, 1.617949724057262, 4.321834686381993\n",
      "====================================\n",
      "Start iteration 90, value: 0.0003647162305025907, best: 0.0003647162305025907, dval: 0.00479058486621059\n",
      "====================================\n",
      "4.429437476006332, 2.5802048438207836, 5.320377533637995, 5.629843191197299, 6.599254354554262, 1.8337962453339274, 4.993421415040554, 5.491760766665299, 6.045843712313291, 1.9673651514298665, 5.873786660412159, 0.1678212962168997, 4.8403452172369645, 5.8116877728158896, 2.196701871622343, 2.1678457398700637, 1.2889500630074973, 3.807641124756144, -0.06999490634090802, 4.8430563995819575, 1.509121787735277, 3.9801885252420175, 5.1508335548441195, 1.3835323545877014, 5.516143803733403, 1.617949724057262, 4.329779826181833\n",
      "====================================\n",
      "Start iteration 91, value: 0.00032810275837725985, best: 0.00032810275837725985, dval: 0.003435302936694251\n",
      "====================================\n",
      "4.429437476181508, 2.5802121408828427, 5.320367654845866, 5.630113647959392, 6.6001483173105875, 1.8338048686529396, 4.992918303234099, 5.4917607642089505, 6.045843712313259, 1.9679090996503987, 5.874098950811072, 0.16783885811045346, 4.839139734889967, 5.811779967461578, 2.1963702134341037, 2.167805382784659, 1.2889500630074973, 3.8118238296090885, -0.07179709108798593, 4.843056399582906, 1.5091217877376253, 3.9815578782453316, 5.1508335548441195, 1.3838606558634536, 5.516166087625384, 1.617949724057262, 4.327816903362631\n",
      "====================================\n",
      "Start iteration 92, value: 0.00030857074052668466, best: 0.00030857074052668466, dval: 0.002798935040513959\n",
      "Start iteration 93, value: 0.0006017582231594508, best: 0.00030857074052668466, dval: 0.017758667214434434\n",
      "Big value increase: val: 0.0006017582231594508, e.val: 0.00030857074052668466, max(α): 17.25452069171216\n",
      "====================================\n",
      "4.429437476179354, 2.5804521037150048, 5.320354318844727, 5.634586377460457, 6.605263822962444, 1.8339794324699188, 4.989559203268258, 5.491760680021918, 6.045843712312826, 1.9728177268702172, 5.874557306648407, 0.1684163784441404, 4.839064439430254, 5.811871447549977, 2.191436876014661, 2.1676545044240703, 1.2889500630074973, 3.8179628822084406, -0.07182091645302724, 4.8430563995843015, 1.5091217877399117, 3.980427924289463, 5.1508335548441195, 1.3839182085166946, 5.5161649541250055, 1.617949724057262, 4.32794970563336\n",
      "====================================\n",
      "Start iteration 94, value: 0.000283574864096965, best: 0.000283574864096965, dval: 0.00349068726563756\n",
      "====================================\n",
      "4.429437476176858, 2.581321244383193, 5.320354879290328, 5.631462918907872, 6.607163614020639, 1.8340647556185596, 4.989933968794657, 5.491760704909627, 6.045843712310952, 1.9751646630928164, 5.8745758688167475, 0.17050814575739703, 4.839059276297494, 5.81189391940819, 2.19134282410073, 2.1674746104756872, 1.2889500630074973, 3.818211497189459, -0.07164913109811712, 4.843056399584198, 1.5091217877396725, 3.980824486002034, 5.1508335548441195, 1.384076617427204, 5.516163792239146, 1.617949724057262, 4.32808006687769\n",
      "====================================\n",
      "Start iteration 95, value: 0.0002698677187725504, best: 0.0002698677187725504, dval: 0.003018895625179152\n",
      "====================================\n",
      "4.429437475775375, 2.5815835660053095, 5.320356659587222, 5.630330779373012, 6.606827468869896, 1.8347905648485596, 4.989626295616926, 5.491760739520525, 6.045843712280597, 1.9750926144005434, 5.874597391962185, 0.171139477157235, 4.839048761085063, 5.811925394125563, 2.1912528037997707, 2.1663235068799516, 1.2889500630074973, 3.8184997704286827, -0.07146997046082092, 4.843056399583974, 1.509121787738992, 3.9821438525618773, 5.1508335548441195, 1.3842680369009275, 5.516162479000467, 1.617949724057262, 4.328130421912804\n",
      "====================================\n",
      "Start iteration 96, value: 0.0002628132290279726, best: 0.0002628132290279726, dval: 0.002359658595273345\n",
      "====================================\n",
      "4.429437473316066, 2.581755877447489, 5.320371462603594, 5.630566953135486, 6.606949469793775, 1.8509275982090896, 4.988625577317556, 5.491761716255067, 6.045843711727824, 1.9751021290307185, 5.87481774881504, 0.17155418038726886, 4.838802371777085, 5.81227761439596, 2.1911644919349245, 2.163329141199957, 1.2889500630074973, 3.8214511505576865, -0.07105846574409976, 4.843056399582793, 1.5091217877347864, 3.982785532808075, 5.1508335548441195, 1.384436110067232, 5.516159032580127, 1.617949724057262, 4.32813343946436\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 97, value: 0.00024322025990773232, best: 0.00024322025990773232, dval: 0.003218197142005219\n",
      "Start iteration 98, value: 0.00041774564489365347, best: 0.00024322025990773232, dval: 0.01384188751444787\n",
      "Big value increase: val: 0.00041774564489365347, e.val: 0.00024322025990773232, max(α): 17.6416854703939\n",
      "Start iteration 99, value: 0.000246499319007565, best: 0.00024322025990773232, dval: 0.0049890259153584915\n",
      "Start iteration 100, value: 0.0002538834444277348, best: 0.00024322025990773232, dval: 0.005821946384557686\n",
      "====================================\n",
      "4.429437472700365, 2.582851421873656, 5.320935257936612, 5.630713409357327, 6.607010024445611, 1.8527802408461116, 4.97736869653742, 5.491801785174459, 6.045843711629797, 1.9752689849499416, 5.874967955683954, 0.17419083530948373, 4.837980918863554, 5.8121973542248675, 2.1908244732119417, 2.1505767345199773, 1.2889500630074973, 3.8232033284550977, -0.0709642599902049, 4.8430563995864, 1.5091217877413168, 3.9858367793914105, 5.1508335548441195, 1.3846175363138784, 5.516158247961426, 1.617949724057262, 4.3281321413658755\n",
      "====================================\n",
      "Start iteration 101, value: 0.00022434208388920763, best: 0.00022434208388920763, dval: 0.002820513693365112\n",
      "====================================\n",
      "4.429437472436675, 2.5829392897837704, 5.321133120306148, 5.630728150614115, 6.6070358080340545, 1.853172272633698, 4.977453881534664, 5.491805461815264, 6.0458437115954595, 1.975332353187631, 5.875022831778121, 0.17456695066185002, 4.83780416385902, 5.812165278407654, 2.190631237649126, 2.150789276421921, 1.2889500630074973, 3.8232663424358986, -0.07087118471760344, 4.843056399596325, 1.5091217878681835, 3.9858437090700414, 5.1508335548441195, 1.3846995614017705, 5.516157476056051, 1.617949724057262, 4.328132201250533\n",
      "====================================\n",
      "Start iteration 102, value: 0.00022182354941360509, best: 0.00022182354941360509, dval: 0.0026903668223848265\n",
      "Start iteration 103, value: 0.000948987872981493, best: 0.00022182354941360509, dval: 0.019597232902195408\n",
      "Big value increase: val: 0.000948987872981493, e.val: 0.00022182354941360509, max(α): 53.152950023442436\n",
      "====================================\n",
      "4.429437398379623, 2.5837820381412535, 5.327112349119974, 5.634442141523467, 6.60721466024739, 1.853777185177472, 4.978896692238158, 5.49182320390668, 6.045843711546437, 1.9759431029053123, 5.878323377037024, 0.17817430396088113, 4.831439174774192, 5.8117516734456345, 2.1842024600887857, 2.1517092895264756, 1.2889500630074973, 3.827056344234253, -0.07056181805592475, 4.843056399607523, 1.5091217879786436, 3.985844055459202, 5.1508335548441195, 1.384798852573779, 5.516153735155059, 1.617949724057262, 4.328132201436592\n",
      "====================================\n",
      "Start iteration 104, value: 0.00020133583482906633, best: 0.00020133583482906633, dval: 0.0036646630142989634\n",
      "====================================\n",
      "4.429436864344629, 2.5837750800858394, 5.332390200577277, 5.633022866979895, 6.60731889196546, 1.8538553053176046, 4.9794542160808275, 5.491826615934139, 6.045843711488133, 1.9765300028217574, 5.876422001087133, 0.1781445202610024, 4.831208261785748, 5.8125787613028095, 2.184863430790283, 2.151541175410115, 1.2889500630074973, 3.824873002481857, -0.07026446402258758, 4.843056399586699, 1.5091217877372873, 3.985847164762301, 5.1508335548441195, 1.3847565037726315, 5.516150597048094, 1.617949724057262, 4.328132202764291\n",
      "====================================\n",
      "Start iteration 105, value: 0.00019002337154624326, best: 0.00019002337154624326, dval: 0.0028827611933930214\n",
      "====================================\n",
      "4.429406010669245, 2.583765906019751, 5.332401773471196, 5.633582133365378, 6.6074555396665735, 1.8552282259483774, 4.979913131969236, 5.491837224359915, 6.045843711455389, 1.978693819631358, 5.876782876209976, 0.17810525100906466, 4.830597772832325, 5.812658726034997, 2.185349574039516, 2.151618009052955, 1.2889500630074973, 3.8252873938194307, -0.06997234788621741, 4.843056399384538, 1.5091217857994528, 3.9858546756192337, 5.1508335548441195, 1.3846970718583844, 5.516146323167024, 1.617949724057262, 4.328132202032154\n",
      "====================================\n",
      "Start iteration 106, value: 0.00018179670478746737, best: 0.00018179670478746737, dval: 0.00248391434958474\n",
      "====================================\n",
      "4.428996473396592, 2.5837645637098565, 5.3323906933342915, 5.63606401133784, 6.607767819565182, 1.8574959162945905, 4.9868791883432415, 5.492067403558148, 6.045843711417629, 1.9829329069814323, 5.876894307003133, 0.17809950530101087, 4.828296668606881, 5.81265260794006, 2.1852623305381806, 2.151575513759673, 1.2889500630074973, 3.825415349315669, -0.06880346470569247, 4.843056398919415, 1.5091217807535322, 3.985921749935972, 5.1508335548441195, 1.3843256620202338, 5.51612036185939, 1.617949724057262, 4.328132199337539\n",
      "====================================\n",
      "Start iteration 107, value: 0.00017335525944015253, best: 0.00017335525944015253, dval: 0.0023120410965598026\n",
      "====================================\n",
      "4.4286984498859105, 2.583763081598219, 5.3323051370248145, 5.639523557626693, 6.608214328245849, 1.8578064038543822, 4.981336786407385, 5.4937258211317275, 6.045843711418609, 1.984796877525843, 5.876824291206996, 0.17809316117674523, 4.823462193335308, 5.812657725511323, 2.185114775122032, 2.1514948863334693, 1.2889500630074973, 3.8253349504807925, -0.06942899246233397, 4.843056398733681, 1.5091217787257825, 3.986052505470303, 5.1508335548441195, 1.384120522628364, 5.5161308953164685, 1.617949724057262, 4.328132195299213\n",
      "====================================\n",
      "Start iteration 108, value: 0.00016394629116671394, best: 0.00016394629116671394, dval: 0.003244859216518056\n",
      "Start iteration 109, value: 0.00017194607162412855, best: 0.00016394629116671394, dval: 0.004105116001643969\n",
      "====================================\n",
      "4.423963485077171, 2.5837686553907626, 5.332383394284647, 5.638748156428203, 6.609425023808075, 1.8592663783165146, 4.984217130462422, 5.496140281280874, 6.04584371141667, 1.9895268662022065, 5.8766297432006755, 0.17810219983499195, 4.823943290083069, 5.812640161888533, 2.1845289183921563, 2.151338346147541, 1.2889500630074973, 3.8251115518493592, -0.06891837492767176, 4.843056399171561, 1.5091217835047455, 3.9865570474745358, 5.1508335548441195, 1.3840792214829605, 5.5161198331359875, 1.617949724057262, 4.328132189587148\n",
      "====================================\n",
      "Start iteration 110, value: 0.00014989458702468304, best: 0.00014989458702468304, dval: 0.0027190171747735747\n",
      "====================================\n",
      "4.423715384296064, 2.5837731562829336, 5.3324451102127846, 5.638791304323384, 6.6101471394672595, 1.8594825455683606, 4.9831055928723345, 5.4958604014023855, 6.045843711414285, 1.9882799561054159, 5.876045542828604, 0.17826822669553366, 4.823031135356566, 5.81262063337936, 2.1835009469664164, 2.1513118143702763, 1.2889500630074973, 3.8244407170971972, -0.06895924226345164, 4.843056400428155, 1.509121796082858, 3.986627096569304, 5.1508335548441195, 1.3841349290373193, 5.516119324658696, 1.617949724057262, 4.328132173463951\n",
      "====================================\n",
      "Start iteration 111, value: 0.0001444055012843935, best: 0.0001444055012843935, dval: 0.0021037524969676202\n",
      "====================================\n",
      "4.423293291529445, 2.5837946432167276, 5.332621961985173, 5.638896176796709, 6.609990831829579, 1.8594945686821194, 4.982002792596703, 5.495948990475201, 6.045843711392497, 1.9885279569364043, 5.876107232336109, 0.17906082692343334, 4.82252114348097, 5.812560720337553, 2.1799860410540153, 2.1512620266990834, 1.2889500630074973, 3.824511554890969, -0.06895016412787561, 4.843056410461002, 1.5091218897592735, 3.9868511457318054, 5.1508335548441195, 1.3848769204230045, 5.516118647387046, 1.617949724057262, 4.328132054810342\n",
      "====================================\n",
      "Start iteration 112, value: 0.00013712780512499615, best: 0.00013712780512499615, dval: 0.001346952928904445\n",
      "====================================\n",
      "4.422104609822347, 2.5838024869230845, 5.333345827983309, 5.638964593338379, 6.610106475250438, 1.8595068333904294, 4.976683731499658, 5.496068744772052, 6.045843711347667, 1.988840410730638, 5.876374983916528, 0.1793501619912234, 4.8215717583546525, 5.812391563048089, 2.179296008961129, 2.14802949908978, 1.2889500630074973, 3.8248190128688826, -0.0689391905045039, 4.843056419233856, 1.5091219677333914, 3.9872825071486235, 5.1508335548441195, 1.386683691166351, 5.516117021096202, 1.617949724057262, 4.328130671188683\n",
      "====================================\n",
      "Start iteration 113, value: 0.0001357315985961187, best: 0.0001357315985961187, dval: 0.0029399423011707837\n",
      "Start iteration 114, value: 0.00014823278476879036, best: 0.0001357315985961187, dval: 0.004282500935579914\n",
      "====================================\n",
      "4.420735711311848, 2.5838215646836753, 5.3347758975551125, 5.638939071083102, 6.610379323934489, 1.8595527227491926, 4.978577363742728, 5.496351831807663, 6.045843711005704, 1.9910511080522924, 5.87605986032569, 0.18005389373521014, 4.821894915503695, 5.8120683884904585, 2.176482293251615, 2.151647226644236, 1.2889500630074973, 3.8244571578169717, -0.06892363300613688, 4.8430564418255875, 1.5091220786256203, 3.992358734997305, 5.1508335548441195, 1.387404976570584, 5.516113866225098, 1.617949724057262, 4.328122879695277\n",
      "====================================\n",
      "Start iteration 115, value: 0.00012917272358881873, best: 0.00012917272358881873, dval: 0.0017124770866991934\n",
      "Start iteration 116, value: 0.00013461538635141504, best: 0.00012917272358881873, dval: 0.003218438679967836\n",
      "====================================\n",
      "4.420418679956344, 2.583830269883385, 5.334896711609314, 5.638937894729171, 6.6105616679270955, 1.8598894661370837, 4.978172863122087, 5.497099969002015, 6.045843707726873, 1.9953344799486827, 5.876123376074337, 0.18032506614148922, 4.81690047751956, 5.811912545153631, 2.173225179521308, 2.150217015654298, 1.2889500630074973, 3.8245300926755217, -0.06892330310913411, 4.843056440089461, 1.5091220657635942, 3.9891203547642817, 5.1508335548441195, 1.386897249204451, 5.516112221182328, 1.617949724057262, 4.328075666529962\n",
      "====================================\n",
      "Start iteration 117, value: 0.00012472433909931137, best: 0.00012472433909931137, dval: 0.0028558337462024075\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "4.420259748817746, 2.583836762250109, 5.334979758674182, 5.638948449727218, 6.611033626790561, 1.8661175650543407, 4.978201575210984, 5.50401546638511, 6.045843703007436, 1.9958965276064247, 5.876139373922542, 0.18137089815273463, 4.818771585119015, 5.811837479983379, 2.1740228405746524, 2.1502028259194264, 1.2889500630074973, 3.8245484629351942, -0.06892286250815953, 4.843056439432846, 1.5091220569930828, 3.9893781074717714, 5.1508335548441195, 1.3857614308741721, 5.516109239362656, 1.617949724057262, 4.327979259589286\n",
      "====================================\n",
      "Start iteration 118, value: 0.00011726926248097424, best: 0.00011726926248097424, dval: 0.002654505080732991\n",
      "Start iteration 119, value: 0.00013103103541491952, best: 0.00011726926248097424, dval: 0.003616064166318442\n",
      "Big value increase: val: 0.00013103103541491952, e.val: 0.00011726926248097424, max(α): 8.456008749208815\n",
      "====================================\n",
      "4.420259748514766, 2.583840969987072, 5.3378511007023155, 5.638946996513713, 6.6135645304289294, 1.8667993280578623, 4.978149892069991, 5.502407651352576, 6.045843691295411, 1.9960963767611593, 5.876137231686331, 0.1820487073704559, 4.818461432300657, 5.811545741575368, 2.171799790253361, 2.1502043336916614, 1.2889500630074973, 3.824546003014649, -0.06892256188299137, 4.84305644331588, 1.5091221049226293, 3.990138094183827, 5.1508335548441195, 1.3908759948191207, 5.516100665309848, 1.617949724057262, 4.327195888762948\n",
      "====================================\n",
      "Start iteration 120, value: 0.00010406812548210398, best: 0.00010406812548210398, dval: 0.0013535429932965434\n",
      "Start iteration 121, value: 0.00011164033091792066, best: 0.00010406812548210398, dval: 0.0026521819821464145\n",
      "====================================\n",
      "4.420259747300915, 2.5838415530972076, 5.338201857499167, 5.638982186777708, 6.6151871011332055, 1.868303642945045, 4.978128839411612, 5.506772050716647, 6.045843686331376, 1.9967453917710178, 5.876139280921782, 0.1824066908603018, 4.8184568581408955, 5.8114158423548075, 2.1711156774151714, 2.1501980213479976, 1.2889500630074973, 3.824548356142824, -0.06892223759662591, 4.8430564437409265, 1.5091221086220163, 3.9906724631236976, 5.1508335548441195, 1.390596611271735, 5.516077187094187, 1.617949724057262, 4.318555269047046\n",
      "====================================\n",
      "Start iteration 122, value: 9.297260590865829e-5, best: 9.297260590865829e-5, dval: 0.0014030067946785157\n",
      "Start iteration 123, value: 9.548479185214625e-5, best: 9.297260590865829e-5, dval: 0.002521968124902449\n",
      "====================================\n",
      "4.420259722828168, 2.5838417618025624, 5.338689429943094, 5.638949003784133, 6.618182986059555, 1.86967108759144, 4.978062042122185, 5.5090073974711515, 6.045843679738923, 1.9994778206786166, 5.876139240914034, 0.18303658391593475, 4.818453471118585, 5.8098631975222474, 2.1681051260685935, 2.1501841415809326, 1.2889500630074973, 3.824548310202101, -0.0689217917646727, 4.843056443780935, 1.509122108954041, 3.992333119854312, 5.1508335548441195, 1.3912383990533503, 5.515840559683757, 1.617949724057262, 4.318879698590624\n",
      "====================================\n",
      "Start iteration 124, value: 8.527549916827072e-5, best: 8.527549916827072e-5, dval: 0.0013641733545543683\n",
      "====================================\n",
      "4.420259695532322, 2.583841838479354, 5.338885777801629, 5.638940937436619, 6.61882162491201, 1.8701527581197055, 4.978027415681256, 5.509772480483279, 6.045843677239321, 1.9989979666003959, 5.876139230146629, 0.18314460541639158, 4.818446055792955, 5.808234505055442, 2.1677986073501403, 2.150147909089921, 1.2889500630074973, 3.8245482978379366, -0.06892149515933704, 4.84305644379334, 1.5091221090590694, 3.9923612659916885, 5.1508335548441195, 1.3918862429659427, 5.515489136724304, 1.617949724057262, 4.318484046387579\n",
      "====================================\n",
      "Start iteration 125, value: 8.267962126882332e-5, best: 8.267962126882332e-5, dval: 0.0012167828720345344\n",
      "Start iteration 126, value: 0.17628110943943767, best: 8.267962126882332e-5, dval: 0.450771313197749\n",
      "Big value increase: val: 0.17628110943943767, e.val: 8.267962126882332e-5, max(α): 1367.7023585805666\n",
      "Start iteration 127, value: 0.0003053480150946033, best: 8.267962126882332e-5, dval: 0.010036672794911175\n",
      "Big value increase: val: 0.0003053480150946033, e.val: 8.267962126882332e-5, max(α): 1.8347387320882875\n",
      "Start iteration 128, value: 0.00023769060607369013, best: 8.267962126882332e-5, dval: 0.008522684432485841\n",
      "Big value increase: val: 0.00023769060607369013, e.val: 8.267962126882332e-5, max(α): 1.813890539688734\n",
      "Start iteration 129, value: 9.709762635221363e-5, best: 8.267962126882332e-5, dval: 0.0032679754667939067\n",
      "Big value increase: val: 9.709762635221363e-5, e.val: 8.267962126882332e-5, max(α): 2.8011355912278106\n",
      "====================================\n",
      "4.420259683096154, 2.583842211211193, 5.341345030594701, 5.638646082020438, 6.623564511511566, 1.8748691617607371, 4.977786530757668, 5.520395136504267, 6.0458436439662355, 1.9994939611064935, 5.876139205628782, 0.18366970631972665, 4.818226999994488, 5.80812277861174, 2.1671497713392056, 2.150002218084339, 1.2889500630074973, 3.824548269684198, -0.06892305157598863, 4.843056443832615, 1.5091221093617535, 3.992564368936186, 5.1508335548441195, 1.3943395959741587, 5.516062591033778, 1.617949724057262, 4.308179417708071\n",
      "====================================\n",
      "Start iteration 130, value: 8.011740266586626e-5, best: 8.011740266586626e-5, dval: 0.0025789522358818304\n",
      "====================================\n",
      "4.420259673195917, 2.5838422436318766, 5.342037964957432, 5.638622941122298, 6.62358689125319, 1.8748268564914217, 4.977744056374745, 5.517959518030733, 6.04584364340019, 1.9995288558597755, 5.876139200410641, 0.18371538023603579, 4.818211485259378, 5.808087527395599, 2.1669133353401007, 2.149985524447538, 1.2889500630074973, 3.8245482636921793, -0.0689229692125836, 4.843056443833698, 1.5091221093705234, 3.992618906442396, 5.1508335548441195, 1.3945445874614117, 5.516074931760508, 1.617949724057262, 4.308189403620003\n",
      "====================================\n",
      "Start iteration 131, value: 7.655464158233626e-5, best: 7.655464158233626e-5, dval: 0.0019836792322796906\n",
      "====================================\n",
      "4.420259654667195, 2.583842351670098, 5.343345523496012, 5.638522630485523, 6.623596881425505, 1.8747736179499555, 4.977477776657676, 5.517568617049828, 6.045843642513875, 2.0011092710187075, 5.876139192813791, 0.1838675833406467, 4.818127181955898, 5.8078691550437735, 2.1656962137854023, 2.1499488622515806, 1.2889500630074973, 3.8245482549686747, -0.06892218303295593, 4.8430564438346515, 1.5091221093784384, 3.992844717964891, 5.1508335548441195, 1.3949031766374533, 5.51609099421662, 1.617949724057262, 4.308233273899371\n",
      "====================================\n",
      "Start iteration 132, value: 7.342863856442126e-5, best: 7.342863856442126e-5, dval: 0.0016634308037103904\n",
      "Start iteration 133, value: 8.08883384963601e-5, best: 7.342863856442126e-5, dval: 0.003690437023025496\n",
      "Big value increase: val: 8.08883384963601e-5, e.val: 7.342863856442126e-5, max(α): 7.198675995592499\n",
      "Start iteration 134, value: 0.00010527853189374455, best: 7.342863856442126e-5, dval: 0.006351672741197356\n",
      "Big value increase: val: 0.00010527853189374455, e.val: 7.342863856442126e-5, max(α): 25.8149653176179\n",
      "====================================\n",
      "4.420259400902836, 2.5838428318306708, 5.344883140583898, 5.637898176825249, 6.623687536735998, 1.8781331368174379, 4.97507656080174, 5.5181838125038505, 6.0458436245278016, 2.0008924321442083, 5.876138010273877, 0.18454402848108625, 4.817924251550704, 5.80768230146901, 2.16028312272237, 2.147695459008861, 1.2889500630074973, 3.824546897051643, -0.06890604197209615, 4.843056443834682, 1.5091221093787028, 3.996103471467452, 5.1508335548441195, 1.3953351406383714, 5.516158135044653, 1.617949724057262, 4.312618173283697\n",
      "====================================\n",
      "Start iteration 135, value: 6.192156587582042e-5, best: 6.192156587582042e-5, dval: 0.0010890634967814228\n",
      "====================================\n",
      "4.420257877791602, 2.5838428924550207, 5.345025332795783, 5.637899701899894, 6.623798759185193, 1.87941238551369, 4.973615322386413, 5.51845265811431, 6.045843608787361, 2.000936612791454, 5.876104458464697, 0.18462943542434657, 4.817889148749943, 5.807653252137138, 2.1605851360632813, 2.1456359535115355, 1.2889500630074973, 3.8245083693262094, -0.06890524764363312, 4.843056443834676, 1.5091221093786653, 3.9954740859643363, 5.1508335548441195, 1.395339580432507, 5.516157810653119, 1.617949724057262, 4.312203517813276\n",
      "====================================\n",
      "Start iteration 136, value: 6.000218465446544e-5, best: 6.000218465446544e-5, dval: 0.001052859308572504\n",
      "Start iteration 137, value: 0.00030762995784321524, best: 6.000218465446544e-5, dval: 0.013151508745608498\n",
      "Big value increase: val: 0.00030762995784321524, e.val: 6.000218465446544e-5, max(α): 71.35485226889276\n",
      "Start iteration 138, value: 6.11535777913415e-5, best: 6.000218465446544e-5, dval: 0.0020903259757289044\n",
      "Start iteration 139, value: 0.00011871792569942889, best: 6.000218465446544e-5, dval: 0.006543261427173985\n",
      "Big value increase: val: 0.00011871792569942889, e.val: 6.11535777913415e-5, max(α): 0.29224226850928614\n",
      "====================================\n",
      "4.420246136109588, 2.583842970860142, 5.345974198587062, 5.637904220742172, 6.623974386688752, 1.8838458423054216, 4.973082171021354, 5.5185033053089345, 6.04584332217636, 2.0046992830164423, 5.875700840883133, 0.18470959686961425, 4.817868415060271, 5.807499818778155, 2.1595070986665763, 2.145461855301934, 1.2889500630074973, 3.8240448930564512, -0.06890453667632152, 4.843056443834684, 1.5091221093787226, 3.995648396188117, 5.1508335548441195, 1.3954194747738948, 5.516157487533385, 1.617949724057262, 4.3122618253558045\n",
      "====================================\n",
      "Start iteration 140, value: 5.722737460724432e-5, best: 5.722737460724432e-5, dval: 0.0016964874381874273\n",
      "====================================\n",
      "4.420221041564793, 2.583842978694496, 5.345977182078057, 5.6379043137949765, 6.6239772392460905, 1.8837426296279267, 4.973076125361544, 5.518510339399416, 6.0458433366469935, 2.004548468681982, 5.875752118703028, 0.18472762216109886, 4.817866443740149, 5.807496520724316, 2.1551969639652016, 2.144299518180335, 1.2889500630074973, 3.8241037756566443, -0.06890481913239385, 4.8430564438346915, 1.5091221093787806, 3.995818750415684, 5.1508335548441195, 1.3957129589356971, 5.516157485351172, 1.617949724057262, 4.31169715225562\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 141, value: 5.6868295314175645e-5, best: 5.6868295314175645e-5, dval: 0.001467491919692518\n",
      "====================================\n",
      "4.420060226008414, 2.5838429749131278, 5.345982122047011, 5.637904481818574, 6.623980437478872, 1.8837852324157758, 4.973069683206281, 5.518524650915277, 6.045843323699275, 2.0046497133697296, 5.875994582805127, 0.1847189219846301, 4.817842033985686, 5.807485387179898, 2.1574285410860408, 2.1443718438349975, 1.2889500630074973, 3.824382198507198, -0.06890459334109347, 4.843056443834688, 1.5091221093787504, 3.9960668848018464, 5.1508335548441195, 1.396103071953724, 5.516157483074741, 1.617949724057262, 4.311915982301013\n",
      "====================================\n",
      "Start iteration 142, value: 5.5140223921715145e-5, best: 5.5140223921715145e-5, dval: 0.0014412326696634226\n",
      "Start iteration 143, value: 5.721348128821369e-5, best: 5.5140223921715145e-5, dval: 0.0026867212176856503\n",
      "Start iteration 144, value: 0.00014640124265102972, best: 5.5140223921715145e-5, dval: 0.009294100159937368\n",
      "Big value increase: val: 0.00014640124265102972, e.val: 5.721348128821369e-5, max(α): 11.32802560733188\n",
      "====================================\n",
      "4.41135745481673, 2.5838429785676746, 5.345967840381365, 5.637890091714982, 6.623942290678278, 1.8834327519657028, 4.973031418562858, 5.518699919565937, 6.045843411629767, 2.0051122297769375, 5.875445378359966, 0.1847626862878284, 4.816416607849264, 5.80733737413305, 2.1574409619576107, 2.1479854414174677, 1.2889500630074973, 3.8237515440481054, -0.06890458526739544, 4.843056443834679, 1.5091221093787441, 3.996328671116299, 5.1508335548441195, 1.4007031137363828, 5.51615748286492, 1.617949724057262, 4.310928917658929\n",
      "====================================\n",
      "Start iteration 145, value: 5.0963466488952237e-5, best: 5.0963466488952237e-5, dval: 0.0020367313632117523\n",
      "====================================\n",
      "4.411472361883992, 2.5838429840751176, 5.345962767920338, 5.637896202301076, 6.623951060830601, 1.8834723123588017, 4.973014993867854, 5.518715619007304, 6.045843419838782, 2.0053661110127923, 5.875380379603956, 0.1849112106408092, 4.816404872973213, 5.807338083232901, 2.1574331901635575, 2.148392150240567, 1.2889500630074973, 3.8236769056221527, -0.06890463248700784, 4.843056443834679, 1.509122109378744, 3.9963142167447354, 5.1508335548441195, 1.4010024316325258, 5.516157483266338, 1.617949724057262, 4.310816554410477\n",
      "====================================\n",
      "Start iteration 146, value: 5.031394291751386e-5, best: 5.031394291751386e-5, dval: 0.0019570460734555373\n",
      "====================================\n",
      "4.411922787302525, 2.583843003918231, 5.345916959783144, 5.637961847929675, 6.623974294230509, 1.8836966252372838, 4.972611608437949, 5.518769661703816, 6.045843454805125, 2.0074217669015124, 5.875324659175425, 0.18544633839538915, 4.816180756664907, 5.807337944121561, 2.1574006016467084, 2.1483721789453654, 1.2889500630074973, 3.823612921550236, -0.06890664863011262, 4.843056443834678, 1.5091221093787435, 3.9963126906645625, 5.1508335548441195, 1.4010564957332683, 5.516157504390609, 1.617949724057262, 4.310413766510489\n",
      "====================================\n",
      "Start iteration 147, value: 4.7467633700912394e-5, best: 4.7467633700912394e-5, dval: 0.0016449064554303061\n",
      "====================================\n",
      "4.412116094091329, 2.5838430245937833, 5.344576345496426, 5.638814636445253, 6.62401100732512, 1.884297283717933, 4.9704858568211705, 5.518980791740821, 6.045843591835687, 2.007694438342307, 5.875353916328869, 0.18600391530713237, 4.815359841819977, 5.807337801932053, 2.157364894808486, 2.148351088386086, 1.2889500630074973, 3.823646517699071, -0.06891415871341812, 4.843056443834674, 1.5091221093787417, 3.9963140767239014, 5.1508335548441195, 1.4010155239259054, 5.516157596013562, 1.617949724057262, 4.310514627669518\n",
      "====================================\n",
      "Start iteration 148, value: 4.378509209556061e-5, best: 4.378509209556061e-5, dval: 0.0009442706837211601\n",
      "====================================\n",
      "4.411991017652399, 2.583843056580157, 5.344512109136163, 5.638611281397133, 6.624003807996487, 1.8845661868131265, 4.970085068869179, 5.522912767258625, 6.045843568742761, 2.0082818333909493, 5.875357766348713, 0.1868665216843688, 4.814911460925393, 5.8073375069234485, 2.157236335483225, 2.148321356548953, 1.2889500630074973, 3.8236509386978503, -0.0689140355182245, 4.843056443834674, 1.5091221093787417, 3.9963155803323005, 5.1508335548441195, 1.4010479063324563, 5.516157597388772, 1.617949724057262, 4.310636955604379\n",
      "====================================\n",
      "Start iteration 149, value: 4.223052040740286e-5, best: 4.223052040740286e-5, dval: 0.0010563669542254586\n",
      "Start iteration 150, value: 7.885696054741597e-5, best: 4.223052040740286e-5, dval: 0.006012342819534555\n",
      "Big value increase: val: 7.885696054741597e-5, e.val: 4.223052040740286e-5, max(α): 45.66708311759875\n",
      "Start iteration 151, value: 4.4090321009685305e-5, best: 4.223052040740286e-5, dval: 0.0018319224703177983\n",
      "Start iteration 152, value: 4.507764935445835e-5, best: 4.223052040740286e-5, dval: 0.00242220037133839\n",
      "====================================\n",
      "4.411899608198938, 2.583843179412166, 5.344898094206061, 5.637485973388239, 6.624001792570543, 1.887621359686832, 4.966609251235197, 5.5226133491570915, 6.045843497832872, 2.009400371886786, 5.875361419903931, 0.19017904705881583, 4.813457371562239, 5.807326998201737, 2.156363764428135, 2.1483201360606183, 1.2889500630074973, 3.8236551340952296, -0.06891368458707872, 4.843056443834859, 1.5091221093787883, 3.9963428680476323, 5.1508335548441195, 1.4011026543387401, 5.516157595140296, 1.617949724057262, 4.310595474016449\n",
      "====================================\n",
      "Start iteration 153, value: 3.9429044613378155e-5, best: 3.9429044613378155e-5, dval: 0.001668031030061988\n",
      "====================================\n",
      "4.41184560856392, 2.583843178835753, 5.344994974117743, 5.637466387574114, 6.624000376417332, 1.8875895067373611, 4.966639459421493, 5.5226603511600425, 6.045843456172928, 2.009495738492517, 5.875364882037049, 0.19014377345731925, 4.813358655770889, 5.807267423512421, 2.156247756892182, 2.1483187434190243, 1.2889500630074973, 3.823659109681566, -0.06891365256332893, 4.843056443834988, 1.5091221093788225, 3.996492594040957, 5.1508335548441195, 1.404282961074894, 5.516157594911665, 1.617949724057262, 4.310595240763079\n",
      "====================================\n",
      "Start iteration 154, value: 3.81147841381327e-5, best: 3.81147841381327e-5, dval: 0.0015245138365534705\n",
      "====================================\n",
      "4.411660413341342, 2.583843178737354, 5.345013827104761, 5.63745684607562, 6.623999987766265, 1.8875874287721488, 4.9668880348550735, 5.52274872547567, 6.045843441496694, 2.0100368062153877, 5.875438668198268, 0.19013775193452792, 4.813389367343648, 5.807142416874068, 2.1555972383433146, 2.148298900231462, 1.2889500630074973, 3.823743838732813, -0.06891340884433733, 4.8430564438350014, 1.5091221093788223, 3.9982430569703786, 5.1508335548441195, 1.4036051248727937, 5.516157572594793, 1.617949724057262, 4.310590477173719\n",
      "====================================\n",
      "Start iteration 155, value: 3.6243396497383054e-5, best: 3.6243396497383054e-5, dval: 0.0012912252439234162\n",
      "Start iteration 156, value: 0.911471611834721, best: 3.6243396497383054e-5, dval: 1.1128138539111612\n",
      "Big value increase: val: 0.911471611834721, e.val: 3.6243396497383054e-5, max(α): 1600.5732581650966\n",
      "====================================\n",
      "4.411653034578015, 2.583843178737341, 5.345014013220142, 5.6374568467760096, 6.6240001663650165, 1.887590996829212, 4.96688932659993, 5.524632660716301, 6.045843400167043, 2.0100367763742306, 5.875438812884165, 0.19013775111779313, 4.813355124014443, 5.805308535340737, 2.1553394504720327, 2.1482987978891352, 1.2889500630074973, 3.8237440048764175, -0.06890927346074537, 4.8430564438350014, 1.5091221093788223, 3.998243091643465, 5.1508335548441195, 1.4036051255217845, 5.516157238116303, 1.617949724057262, 4.310590183159112\n",
      "====================================\n",
      "Start iteration 157, value: 3.394904277456901e-5, best: 3.394904277456901e-5, dval: 0.000893978670520601\n",
      "====================================\n",
      "4.411638276766769, 2.5838431787376983, 5.345014235380204, 5.637456845283827, 6.624000167143071, 1.8875910056102112, 4.966889974416018, 5.524632633539053, 6.045843399748703, 2.0100368841409537, 5.875438667378082, 0.19013777298776366, 4.813355116700702, 5.8048216281364216, 2.1550964957930914, 2.148298792766584, 1.2889500630074973, 3.8237438377909885, -0.06890899958472337, 4.8430564438350014, 1.5091221093788223, 3.9982431827388933, 5.1508335548441195, 1.40360512895276, 5.516157233077235, 1.617949724057262, 4.310589569165826\n",
      "====================================\n",
      "Start iteration 158, value: 3.376220287333695e-5, best: 3.376220287333695e-5, dval: 0.0008979141590296225\n",
      "Start iteration 159, value: 6.456448994835387e-5, best: 3.376220287333695e-5, dval: 0.004003324306982789\n",
      "Big value increase: val: 6.456448994835387e-5, e.val: 3.376220287333695e-5, max(α): 62.091888388877976\n",
      "====================================\n",
      "4.411555479230864, 2.583843178780586, 5.346092768792597, 5.637456785016846, 6.624000189335944, 1.8875911677780384, 4.966890312327078, 5.524632676991689, 6.045843398755817, 2.0100369915026186, 5.875435994793167, 0.19014039668227914, 4.813355101387682, 5.804807483489079, 2.1541118466733247, 2.1482987388897397, 1.2889500630074973, 3.823740768847161, -0.068902922181374, 4.8430564438350014, 1.5091221093788223, 3.998243622607473, 5.1508335548441195, 1.4036051260283793, 5.516156809248465, 1.617949724057262, 4.309836827906305\n",
      "====================================\n",
      "Start iteration 160, value: 3.318612974252812e-5, best: 3.318612974252812e-5, dval: 0.0008949395529788389\n",
      "Start iteration 161, value: 4.117460907239033e-5, best: 3.318612974252812e-5, dval: 0.002958579872020431\n",
      "Big value increase: val: 4.117460907239033e-5, e.val: 3.318612974252812e-5, max(α): 9.24634617439585\n",
      "====================================\n",
      "4.41147357715717, 2.583843178855809, 5.346515203860075, 5.6374567622528975, 6.624000302733978, 1.8875940065319097, 4.966889392962061, 5.524632678394584, 6.045843391567517, 2.0100372139957483, 5.875400478414405, 0.19014499847809407, 4.813355100464355, 5.804819155005935, 2.15421933952201, 2.1482987388690593, 1.2889500630074973, 3.8236999851957996, -0.06890150181075531, 4.8430564438350014, 1.5091221093788223, 3.99824433705312, 5.1508335548441195, 1.4036051260001507, 5.5161567058667265, 1.617949724057262, 4.309348444404924\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 162, value: 3.2961795986790104e-5, best: 3.2961795986790104e-5, dval: 0.0008921090895758401\n",
      "Start iteration 163, value: 3.419792133943068e-5, best: 3.2961795986790104e-5, dval: 0.0015602329658521291\n",
      "====================================\n",
      "4.4091006506040165, 2.5838431832599262, 5.34660406434643, 5.637456753041592, 6.62400063935423, 1.8889443089694309, 4.966889085034504, 5.52463267907903, 6.04580861470085, 2.0100373992972655, 5.875336693557403, 0.19041442072660586, 4.813355099953033, 5.804821882108391, 2.1542645355229673, 2.1482987388654973, 1.2889500630074973, 3.8236267406967617, -0.06890103698320932, 4.8430564438350014, 1.5091221093788223, 3.9982548496415142, 5.1508335548441195, 1.4036051259872409, 5.516156678328119, 1.617949724057262, 4.3089925400272255\n",
      "====================================\n",
      "Start iteration 164, value: 3.1535683159369666e-5, best: 3.1535683159369666e-5, dval: 0.0007927975054953657\n",
      "Start iteration 165, value: 3.165154379467952e-5, best: 3.1535683159369666e-5, dval: 0.0011082666048206624\n",
      "====================================\n",
      "4.409387599085914, 2.583843184041332, 5.347151355567233, 5.637456769650258, 6.62400090281935, 1.8897923900614373, 4.966888712369253, 5.524632680157616, 6.045667536316505, 2.0100382870822084, 5.875182787023281, 0.1906205629747221, 4.813355097686189, 5.80482003346632, 2.153600313723932, 2.148298738868914, 1.2889500630074973, 3.8234500089845582, -0.06890139358796309, 4.8430564438350014, 1.5091221093788223, 3.9983455000948256, 5.1508335548441195, 1.403605125998095, 5.516156690336985, 1.617949724057262, 4.308386884288231\n",
      "====================================\n",
      "Start iteration 166, value: 3.096508649207987e-5, best: 3.096508649207987e-5, dval: 0.0009231187156953924\n",
      "====================================\n",
      "4.40952356067828, 2.5838431839961054, 5.347172369188818, 5.6374567774890965, 6.624001333759647, 1.89042336417558, 4.966887972978934, 5.524632696103935, 6.045610336084391, 2.0100408675238994, 5.874622810027621, 0.19061007105065286, 4.8133550726034064, 5.804816624230416, 2.153890090659267, 2.148298738870212, 1.2889500630074973, 3.82280698434756, -0.06890177401716503, 4.8430564438350014, 1.5091221093788223, 3.9985610419114535, 5.1508335548441195, 1.403605126001484, 5.516156707466737, 1.617949724057262, 4.307614434513208\n",
      "====================================\n",
      "Start iteration 167, value: 3.070252866114817e-5, best: 3.070252866114817e-5, dval: 0.0008666927531319202\n",
      "====================================\n",
      "4.409530552117346, 2.583843183940957, 5.347170449365749, 5.637456792607744, 6.624001588270049, 1.8906831524940282, 4.966882959012415, 5.524632737291442, 6.045586375615054, 2.0100805026495023, 5.874878243648006, 0.19059727741875082, 4.813354995451598, 5.804811412757834, 2.153872689080879, 2.148298738870144, 1.2889500630074973, 3.8231003001664203, -0.0689974717058449, 4.8430564438350014, 1.5091221093788223, 3.9991852483625405, 5.1508335548441195, 1.4036051260111564, 5.5161567720815174, 1.617949724057262, 4.307893786258709\n",
      "====================================\n",
      "Start iteration 168, value: 3.044982143685623e-5, best: 3.044982143685623e-5, dval: 0.0008462444196796759\n",
      "====================================\n",
      "4.409542489053848, 2.583843183962686, 5.347171974776942, 5.637456889416368, 6.624004367657708, 1.891026956089181, 4.965722195461793, 5.524633191244053, 6.045537342251265, 2.011720783210414, 5.874879053681552, 0.19060231816103743, 4.813352525247139, 5.804788528255261, 2.1538531386975897, 2.148298738870066, 1.2889500630074973, 3.823101230332357, -0.06997218633141866, 4.8430564438350014, 1.5091221093788223, 3.9992416596130305, 5.1508335548441195, 1.403605126062208, 5.516160976057115, 1.617949724057262, 4.307864211389099\n",
      "====================================\n",
      "Start iteration 169, value: 2.9550118908291687e-5, best: 2.9550118908291687e-5, dval: 0.0007349864760364255\n",
      "====================================\n",
      "4.409530867737271, 2.5838431839900995, 5.347173574333917, 5.637456838701818, 6.624011062805456, 1.891454227185258, 4.966072673921398, 5.52463970417341, 6.045478255615981, 2.011795462392668, 5.874878263990315, 0.19060867766032788, 4.813320989362218, 5.8047234234903735, 2.1538289437600087, 2.14829873886997, 1.2889500630074973, 3.823100323525605, -0.06936132559134536, 4.8430564438350014, 1.5091221093788223, 3.9994919528336337, 5.1508335548441195, 1.4036051263853144, 5.516158280533413, 1.617949724057262, 4.307892601836963\n",
      "====================================\n",
      "Start iteration 170, value: 2.9236199657840936e-5, best: 2.9236199657840936e-5, dval: 0.0007159929011840982\n",
      "Start iteration 171, value: 2.9361579478767253e-5, best: 2.9236199657840936e-5, dval: 0.0009688877062934975\n",
      "====================================\n",
      "4.409413799965633, 2.583843184361357, 5.347172851476576, 5.637456837987548, 6.624018633443326, 1.8914995032228514, 4.96579817551684, 5.5259459046693635, 6.045478901343972, 2.0136760237205364, 5.874701085120384, 0.19074297002388343, 4.813133949275873, 5.802779139474305, 2.153367767226191, 2.1482987388679806, 1.2889500630074973, 3.822896868063454, -0.06931968192989268, 4.8430564438350014, 1.5091221093788223, 3.9993899660602734, 5.1508335548441195, 1.4036051272758026, 5.516157289886681, 1.617949724057262, 4.307912908315799\n",
      "====================================\n",
      "Start iteration 172, value: 2.771396445248656e-5, best: 2.771396445248656e-5, dval: 0.0009449896529676455\n",
      "====================================\n",
      "4.40930438027638, 2.58384318455601, 5.347172702887026, 5.637456837803966, 6.624022286130239, 1.8915199803843257, 4.965696386871064, 5.526329155483093, 6.0454761218600925, 2.012654045995422, 5.8745183579441855, 0.19141000513291212, 4.812786360739485, 5.802678228300748, 2.1528376944154037, 2.1482987388676524, 1.2889500630074973, 3.8226870414509726, -0.06930360918422664, 4.8430564438350014, 1.5091221093788223, 4.000057138167052, 5.1508335548441195, 1.4036051272956855, 5.516155917417017, 1.617949724057262, 4.307907438203945\n",
      "====================================\n",
      "Start iteration 173, value: 2.6357733999600912e-5, best: 2.6357733999600912e-5, dval: 0.0005307372256409537\n",
      "====================================\n",
      "4.409156434190517, 2.583843184771316, 5.347172791575435, 5.6374568378846295, 6.624251412841759, 1.8917446582540545, 4.9654799584638365, 5.527442237190932, 6.04546941936786, 2.0128237712583963, 5.874246914357111, 0.19214781398728623, 4.812309526499258, 5.802171588966183, 2.1524764185980834, 2.1482987388677546, 1.2889500630074973, 3.8223753413002846, -0.06926979317986702, 4.8430564438350014, 1.5091221093788223, 3.9994829266815675, 5.1508335548441195, 1.403605127320032, 5.516149312186553, 1.617949724057262, 4.307889278230352\n",
      "====================================\n",
      "Start iteration 174, value: 2.5279669348213723e-5, best: 2.5279669348213723e-5, dval: 0.0007192086767202621\n",
      "Start iteration 175, value: 2.809052606982069e-5, best: 2.5279669348213723e-5, dval: 0.0014124288715647876\n",
      "Big value increase: val: 2.809052606982069e-5, e.val: 2.5279669348213723e-5, max(α): 16.01469088396568\n",
      "====================================\n",
      "4.409143196534292, 2.5838431853304984, 5.347173173579508, 5.63745683808634, 6.624799297957419, 1.8934386629593263, 4.964534850070419, 5.527440963960641, 6.045455452089924, 2.0134988406078085, 5.874109565299371, 0.19406401423867847, 4.8116456850358755, 5.798735404614344, 2.1521358751529887, 2.1482987388677683, 1.2889500630074973, 3.822217622628586, -0.06919293533447021, 4.8430564438350014, 1.5091221093788223, 4.001099869404186, 5.1508335548441195, 1.403605127415622, 5.516114078680503, 1.617949724057262, 4.307753063393553\n",
      "====================================\n",
      "Start iteration 176, value: 2.440175894512829e-5, best: 2.440175894512829e-5, dval: 0.0007999748885905572\n",
      "====================================\n",
      "4.409122668242825, 2.5838431852363515, 5.347173425989495, 5.637456838251797, 6.624985437098485, 1.894581834037667, 4.964183862187576, 5.527669561485569, 6.045449005818723, 2.0138298288726415, 5.873973601995062, 0.19374139234835835, 4.811301937831652, 5.79983640824143, 2.152148159311044, 2.148298738867735, 1.2889500630074973, 3.8220614952251073, -0.06915626221315059, 4.8430564438350014, 1.5091221093788223, 4.000638940915287, 5.1508335548441195, 1.403605127395015, 5.516101907939186, 1.617949724057262, 4.307617765409813\n",
      "====================================\n",
      "Start iteration 177, value: 2.2976985726933802e-5, best: 2.2976985726933802e-5, dval: 0.0007010001935241206\n",
      "Start iteration 178, value: 2.709242741681133e-5, best: 2.2976985726933802e-5, dval: 0.001565945043624775\n",
      "Big value increase: val: 2.709242741681133e-5, e.val: 2.2976985726933802e-5, max(α): 43.96077229901063\n",
      "Start iteration 179, value: 2.317122049061447e-5, best: 2.2976985726933802e-5, dval: 0.001243911792218529\n",
      "====================================\n",
      "4.4090941958172625, 2.5838431852459154, 5.347179470883593, 5.6374568382773, 6.62502719880839, 1.8945615599183472, 4.964012177535594, 5.531114857831319, 6.04541543303728, 2.014713620898248, 5.873802055921663, 0.19377416534568034, 4.811188830793377, 5.80002851569772, 2.152104576914966, 2.1482987388677, 1.2889500630074973, 3.8218645079339173, -0.06811890723231834, 4.8430564438350014, 1.5091221093788223, 4.000645930411107, 5.1508335548441195, 1.4036051274058003, 5.515707580006747, 1.617949724057262, 4.302672009925057\n",
      "====================================\n",
      "Start iteration 180, value: 2.2487616295535184e-5, best: 2.2487616295535184e-5, dval: 0.0009078638225974919\n",
      "====================================\n",
      "4.409090444804978, 2.583843185254434, 5.3471819264278855, 5.6374568382724135, 6.625077147293979, 1.8945693630032543, 4.963978885554682, 5.531074280129923, 6.045404175830947, 2.0147067658892417, 5.873623149010061, 0.19402116709321393, 4.811166774521682, 5.800009061779052, 2.151907169985296, 2.1482987388677506, 1.2889500630074973, 3.8216590681520937, -0.06797818364594935, 4.8430564438350014, 1.5091221093788223, 4.0006617117645185, 5.1508335548441195, 1.4036051274412658, 5.515694885773152, 1.617949724057262, 4.304571736775155\n",
      "====================================\n",
      "Start iteration 181, value: 2.1456876568544142e-5, best: 2.1456876568544142e-5, dval: 0.0007659294360965185\n",
      "====================================\n",
      "4.409090999140707, 2.583843185271296, 5.347206326029106, 5.637456838275044, 6.625229814219544, 1.8945761801692766, 4.963894870683644, 5.530695926080175, 6.0453569945765935, 2.0147059806241616, 5.873461988714147, 0.19451010235051758, 4.811102657910131, 5.79997501982628, 2.1508418905836577, 2.1482987388679566, 1.2889500630074973, 3.821474006905801, -0.067990144125576, 4.8430564438350014, 1.5091221093788223, 4.000723585376302, 5.1508335548441195, 1.4036051287821365, 5.5157035212162695, 1.617949724057262, 4.304732820482168\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 182, value: 2.0627687771819905e-5, best: 2.0627687771819905e-5, dval: 0.0007546123719206488\n",
      "====================================\n",
      "4.409090507832899, 2.583843185267295, 5.347352217839006, 5.637456838280288, 6.625533777214135, 1.8945981550918811, 4.963582839558343, 5.53071443106051, 6.045106907607716, 2.014706744304294, 5.873526611653746, 0.19439409099648056, 4.810345055039812, 5.799878513532257, 2.1506917064169673, 2.148298738867938, 1.2889500630074973, 3.821548213779607, -0.06798208072092242, 4.8430564438350014, 1.5091221093788223, 4.0008577471716595, 5.1508335548441195, 1.4036051358851136, 5.515705534108977, 1.617949724057262, 4.305598872887479\n",
      "====================================\n",
      "Start iteration 183, value: 1.9929463722117477e-5, best: 1.9929463722117477e-5, dval: 0.0005988932945519623\n",
      "Start iteration 184, value: 2.022977798742264e-5, best: 1.9929463722117477e-5, dval: 0.0010246869209987047\n",
      "====================================\n",
      "4.4090862555707995, 2.5838431852708394, 5.348418015140181, 5.637456838290594, 6.626835302631014, 1.894601977118, 4.962571682986124, 5.530714332792149, 6.044499102504599, 2.014710353246946, 5.874258494681861, 0.19485679512418436, 4.810358811346197, 5.799657400629853, 2.149587275507692, 2.1482987388678514, 1.2889500630074973, 3.822388639050375, -0.0679699241491793, 4.8430564438350014, 1.5091221093788223, 4.001337426469127, 5.1508335548441195, 1.403605152478944, 5.515704578582405, 1.617949724057262, 4.304537262049939\n",
      "====================================\n",
      "Start iteration 185, value: 1.8483163718137096e-5, best: 1.8483163718137096e-5, dval: 0.000711432057686423\n",
      "====================================\n",
      "4.409080444079332, 2.5838431852710464, 5.348454380976772, 5.637456838269772, 6.626693607639786, 1.894590759899803, 4.9622878119112634, 5.530769576796214, 6.044187644665269, 2.014715081997496, 5.8740855366078355, 0.19490797294605058, 4.8103541003856956, 5.799666671578725, 2.1494624675637275, 2.1482987388675765, 1.2889500630074973, 3.822190030351156, -0.06796578658222206, 4.8430564438350014, 1.5091221093788223, 4.002123059898505, 5.1508335548441195, 1.4036051604200168, 5.515704196834484, 1.617949724057262, 4.3047463120532035\n",
      "====================================\n",
      "Start iteration 186, value: 1.823271791621279e-5, best: 1.823271791621279e-5, dval: 0.0007438389692963621\n",
      "====================================\n",
      "4.409023532925469, 2.5838431852716828, 5.3485713224258955, 5.637456838136484, 6.626438780629989, 1.894495188696059, 4.961535578504089, 5.531388525981486, 6.043427759854245, 2.0157431003793476, 5.873951767485874, 0.19506534663296327, 4.810347413781955, 5.799659782717102, 2.149239899436397, 2.148298738861267, 1.2889500630074973, 3.822036422539215, -0.06792743218110203, 4.8430564438350014, 1.5091221093788223, 4.001673731610498, 5.1508335548441195, 1.403605177787457, 5.515701337317247, 1.617949724057262, 4.304844741227007\n",
      "====================================\n",
      "Start iteration 187, value: 1.7220868938224825e-5, best: 1.7220868938224825e-5, dval: 0.0007683482721468904\n",
      "Start iteration 188, value: 3.892340633207571e-5, best: 1.7220868938224825e-5, dval: 0.003845271310036365\n",
      "Big value increase: val: 3.892340633207571e-5, e.val: 1.7220868938224825e-5, max(α): 70.52211768435129\n",
      "Start iteration 189, value: 1.7616222306368103e-5, best: 1.7220868938224825e-5, dval: 0.000914925244859699\n",
      "Start iteration 190, value: 2.0824217778841417e-5, best: 1.7220868938224825e-5, dval: 0.0017402699631259557\n",
      "Big value increase: val: 2.0824217778841417e-5, e.val: 1.7616222306368103e-5, max(α): 4.787326090052129\n",
      "====================================\n",
      "4.408936718218833, 2.5838431852723014, 5.348610839105868, 5.637456837957835, 6.626046660077733, 1.8948813427328004, 4.961439091859111, 5.533213855955021, 6.043349021762631, 2.016140726007289, 5.873352694977714, 0.19520545592037863, 4.810339693288659, 5.799637574067724, 2.147997176651755, 2.1482987382118655, 1.2889500630074973, 3.8213485043124624, -0.06766729258292956, 4.8430564438350014, 1.5091221093788223, 4.001880217354983, 5.1508335548441195, 1.4036052240892407, 5.515638782429041, 1.617949724057262, 4.304237684100183\n",
      "====================================\n",
      "Start iteration 191, value: 1.6340264368090075e-5, best: 1.6340264368090075e-5, dval: 0.0005084471624454134\n",
      "====================================\n",
      "4.408921714741298, 2.5838431852723445, 5.348646310647385, 5.637456837943729, 6.626065251394957, 1.8949583007463238, 4.961281458099329, 5.53320110502552, 6.043283213023307, 2.0170051414150483, 5.873480555419059, 0.19521887223680331, 4.810339434730283, 5.799637162516833, 2.1473282678182626, 2.148298737490426, 1.2889500630074973, 3.8214953271542447, -0.06763899786963996, 4.8430564438350014, 1.5091221093788223, 4.002481039504983, 5.1508335548441195, 1.4036055068242226, 5.515414741258452, 1.617949724057262, 4.303662048318559\n",
      "====================================\n",
      "Start iteration 192, value: 1.5833783639716993e-5, best: 1.5833783639716993e-5, dval: 0.0005852654531598028\n",
      "Start iteration 193, value: 3.7266784786853536e-5, best: 1.5833783639716993e-5, dval: 0.004675075507226685\n",
      "Big value increase: val: 3.7266784786853536e-5, e.val: 1.5833783639716993e-5, max(α): 62.39441852990187\n",
      "====================================\n",
      "4.408863188195982, 2.5838431852723454, 5.349127812929528, 5.637456835032549, 6.626346810871934, 1.8952702913763104, 4.960420733431314, 5.533200876399196, 6.042450493673802, 2.0170046921488356, 5.8735126223336485, 0.19521918001901373, 4.81033042082056, 5.799565706628907, 2.146993351341576, 2.148298712040552, 1.2889500630074973, 3.821532149767068, -0.06730272052823767, 4.8430564438350014, 1.5091221093788223, 4.002796063930997, 5.1508335548441195, 1.4036086116080047, 5.514725648540379, 1.617949724057262, 4.303646849878608\n",
      "====================================\n",
      "Start iteration 194, value: 1.558804392978077e-5, best: 1.558804392978077e-5, dval: 0.0007361863982044969\n",
      "Start iteration 195, value: 1.5679086009767942e-5, best: 1.558804392978077e-5, dval: 0.0011061261538969913\n",
      "====================================\n",
      "4.407199306703073, 2.5838431852723467, 5.349060811732375, 5.637456632350549, 6.626397775581839, 1.8952360813740816, 4.959997174107144, 5.533201314177969, 6.042552263825495, 2.0170241159340616, 5.873513693187688, 0.19521960922139775, 4.810233462875084, 5.799553142404809, 2.1465596687460025, 2.1482986735808884, 1.2889500630074973, 3.821533379434599, -0.06754982148118929, 4.8430564438350014, 1.5091221093788223, 4.002808338259522, 5.1508335548441195, 1.4036096959578521, 5.515606949329082, 1.617949724057262, 4.303549830228455\n",
      "====================================\n",
      "Start iteration 196, value: 1.4375879524151216e-5, best: 1.4375879524151216e-5, dval: 0.0005580167752828533\n",
      "====================================\n",
      "4.407187053484818, 2.583843185272348, 5.349064997938896, 5.637456555506977, 6.6264738814759205, 1.8952385900444624, 4.959946611191893, 5.533201151367189, 6.042544800189105, 2.0170445171236953, 5.873512888818055, 0.1952200065080068, 4.8101546443971985, 5.799535168873289, 2.146130846603403, 2.1482986369411985, 1.2889500630074973, 3.8215324557725654, -0.0675629864159496, 4.8430564438350014, 1.5091221093788223, 4.002823617755396, 5.1508335548441195, 1.4036110686178203, 5.515637901308941, 1.617949724057262, 4.303512736605205\n",
      "====================================\n",
      "Start iteration 197, value: 1.422441552181811e-5, best: 1.422441552181811e-5, dval: 0.0005772178107506451\n",
      "====================================\n",
      "4.407127428181746, 2.5838431852723494, 5.349071279677481, 5.637454245450381, 6.627401549924837, 1.8952434029228584, 4.959364321119224, 5.533201071382797, 6.042531884595527, 2.0171411977340417, 5.873510982759203, 0.19522042240948084, 4.809468885820047, 5.799006713850257, 2.1460265316165903, 2.148297974772863, 1.2889500630074973, 3.8215302670347953, -0.06756146430804515, 4.8430564438350014, 1.5091221093788223, 4.002858045550452, 5.1508335548441195, 1.4036494354902362, 5.51563002731249, 1.617949724057262, 4.3033980902653335\n",
      "====================================\n",
      "Start iteration 198, value: 1.3647620955184937e-5, best: 1.3647620955184937e-5, dval: 0.0007236597097684885\n",
      "====================================\n",
      "4.407028387130676, 2.583843185272351, 5.349085256237609, 5.637442830036508, 6.627288219592974, 1.8952423561469347, 4.95969481321939, 5.5332011401343095, 6.042464320705847, 2.017568397910976, 5.873511625736865, 0.19522104046301783, 4.80942990973411, 5.797265875256056, 2.1458871930966485, 2.1482963208152976, 1.2889500630074973, 3.8215310053695486, -0.06755989143947141, 4.8430564438350014, 1.5091221093788223, 4.002893705513185, 5.1508335548441195, 1.403763932878767, 5.515621715878243, 1.617949724057262, 4.303428727211307\n",
      "====================================\n",
      "Start iteration 199, value: 1.3346173020368763e-5, best: 1.3346173020368763e-5, dval: 0.0006345189527595663\n",
      "Start iteration 200, value: 5.348066026337215e-5, best: 1.3346173020368763e-5, dval: 0.006391209201755621\n",
      "Big value increase: val: 5.348066026337215e-5, e.val: 1.3346173020368763e-5, max(α): 22.700215153937474\n",
      "Find solution in iteration 200, value: 1.3346173020368763e-5\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(1.3346173020368763e-5, Number[4.407028387130676, 2.583843185272351, 5.349085256237609, 5.637442830036508, 6.627288219592974, 1.8952423561469347, 4.95969481321939, 5.5332011401343095, 6.042464320705847, 2.017568397910976  …  3.8215310053695486, -0.06755989143947141, 4.8430564438350014, 1.5091221093788223, 4.002893705513185, 5.1508335548441195, 1.403763932878767, 5.515621715878243, 1.617949724057262, 4.303428727211307], 200)"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "val, xparams, itr = gradientDescent(step2_of, step2_start_params, α=0.01, maxItr=200,\n",
    "                              argsArePeriodic=true, isExpectedZero=true, ϵ=1e-6, debug=true, useBigValInc=true)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a378380e",
   "metadata": {},
   "source": [
    "Check if step one finish in proper way."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "id": "b3069a16",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.0008184931687979157"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "check_err_of_ansact(step2_start_params, step2_check_qc)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "39613809",
   "metadata": {},
   "source": [
    "The parameter for step 2 was found on the noisy simulator. The code used in training can be found in [sol_step2](src/Challenge/steps/sol_step2.jl) (the code works in exactly the same way as the code above but has had more logging and checks). The log of execution of the code on a noisy simulator can be found in [sol_res_step2_1](src/Challenge/steps/sol_res_step2_1.txt).\n",
    "\n",
    "\n",
    "# 5. Step 3"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "id": "d29ec980",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "5.179285585642374, 4.753123351964444, 0.5215840737813875, 0.38748286290394596, 5.83661299282498, 4.956008020122005, 5.4623489980178475, 3.079628017034936, 5.415525974800484, 0.8263638925606145, 2.247979499465953, 4.677226234948385, 1.8075814262338215, 1.939953469100184, 1.9852481020379247, 1.4640336713034126, 5.740062122325872, 3.2152947500151705, 3.203865076993627, 2.253612381900416, 3.474422097546678, 1.3744080904331015, 4.627180138230332, 3.8399647902484784, 0.0021954100260988796, 1.1900773401804101, 4.935281452062187\n",
      "====================================\n",
      "Start iteration 1, value: 2.6216447489255805, best: 2.6216447489255805, dval: 1.4474220501174344\n",
      "====================================\n",
      "5.188684267193688, 4.74389749108536, 0.522274882514924, 0.37582684594881177, 5.846184576955321, 4.963027345148132, 5.453351999736433, 3.0763138311077465, 5.408007208258421, 0.8204822677553716, 2.2335052789647785, 4.668000374069302, 1.8022528242640508, 1.9346613594517161, 1.9858821500022603, 1.4742351718083757, 5.740062122325872, 3.200820529513996, 3.2070091005034644, 2.255970962425837, 3.4724277380846913, 1.3679677763718843, 4.627180138230332, 3.842396198719938, -0.0015775335208119386, 1.1900773401804101, 4.935256898883029\n",
      "====================================\n",
      "Start iteration 2, value: 2.4885114484307524, best: 2.4885114484307524, dval: 1.3393255287844104\n",
      "====================================\n",
      "5.300438859110529, 4.624396443770717, 0.5249280391600436, 0.11259787398030607, 5.942604928619578, 5.0348561017904725, 5.331621512712771, 3.042064759232854, 5.263092940768447, 0.709657353392547, 2.0541683975608507, 4.54849932675466, 1.6994420829525456, 1.8840621328594074, 1.9868267158985704, 1.6392604568999145, 5.740062122325872, 3.0214836481100673, 3.2325162534966387, 2.2667838054312264, 3.465208124334094, 1.195428637835568, 4.627180138230332, 3.853006063572366, -0.17390802056900664, 1.1900773401804101, 4.935266872245101\n",
      "====================================\n",
      "Start iteration 3, value: 1.1807381346166979, best: 1.1807381346166979, dval: 0.6135274779126004\n",
      "Start iteration 4, value: 2.272113808036335, best: 1.1807381346166979, dval: 1.8533671550758384\n",
      "Big value increase: val: 2.272113808036335, e.val: 1.1807381346166979, max(α): 7.592396078309236\n",
      "====================================\n",
      "5.33035854368288, 3.800427938613073, 0.5259951528493295, -0.05779509026159951, 6.076482777823278, 5.104500693388488, 5.107326321812015, 3.0340863986370774, 5.2125305896687655, 0.6965044258057491, 1.945864656361206, 3.7245308215970327, 1.6941371747246157, 1.8535538641743425, 1.9866840699574615, 1.6785430535264645, 5.740062122325872, 2.9131799069104223, 3.232600107655999, 2.2511412082228692, 3.4670438867173736, 0.9061202712859311, 4.627180138230332, 3.8517502147046128, -0.6253919416369871, 1.1900773401804101, 4.935300740805794\n",
      "====================================\n",
      "Start iteration 5, value: 0.8608223091208911, best: 0.8608223091208911, dval: 0.5069574775468795\n",
      "====================================\n",
      "5.316188486922069, 4.121041530720242, 0.526641036789778, -0.0618540195551225, 6.038754854489199, 5.091360526706371, 5.172723771617775, 3.031247977747131, 5.218735179655431, 0.6928614360565433, 1.975282109175075, 4.045144413704195, 1.6991055943941245, 1.851574410603802, 1.986397358614036, 1.6910197946197048, 5.740062122325872, 2.9425973597242914, 3.2325889780331782, 2.235776989157997, 3.4678300796926695, 0.948144256879764, 4.627180138230332, 3.85040058010098, -0.9360421862329, 1.1900773401804101, 4.935288238854665\n",
      "====================================\n",
      "Start iteration 6, value: 0.6149875547230542, best: 0.6149875547230542, dval: 0.28542034894118207\n",
      "====================================\n",
      "5.308120379124226, 4.182650474265538, 0.5310163153968964, -0.06644175933134368, 6.000333605619238, 5.079835258835066, 5.200136985812002, 3.026897835783917, 5.214803502193354, 0.6944858567279668, 1.97543103544278, 4.10675335724949, 1.714365648642779, 1.8483980416688854, 1.9860181197578861, 1.6901426236583723, 5.740062122325872, 2.9427462859919964, 3.2325860423897645, 2.2163201562913772, 3.4688429820208544, 1.0059178150631478, 4.627180138230332, 3.84918664685786, -1.1044581966815614, 1.1900773401804101, 4.935287290991804\n",
      "====================================\n",
      "Start iteration 7, value: 0.5851163120648516, best: 0.5851163120648516, dval: 0.23122152024744286\n",
      "====================================\n",
      "5.299590116933073, 4.1684094864095, 0.5468132526899446, -0.09239354951701748, 5.97805888527393, 5.074397285799803, 5.206256929887884, 2.9871174106160625, 5.197832963093551, 0.6983600072266916, 1.9752863705488355, 4.092512369393453, 1.862179090629834, 1.825089524445616, 1.9842759120655018, 1.6890301704592412, 5.740062122325872, 2.942601621098052, 3.2325864427453106, 2.131908727014294, 3.4731641974756844, 1.0065786205901985, 4.627180138230332, 3.8378554997136027, -1.1452810887108134, 1.1900773401804101, 4.935287951902719\n",
      "====================================\n",
      "Start iteration 8, value: 0.5248237277723505, best: 0.5248237277723505, dval: 0.1555623421504348\n",
      "Start iteration 9, value: 1.8977332463265122, best: 0.5248237277723505, dval: 1.214353398755439\n",
      "Big value increase: val: 1.8977332463265122, e.val: 0.5248237277723505, max(α): 31.083426326547073\n",
      "Start iteration 10, value: 0.5379877997950223, best: 0.5248237277723505, dval: 0.33280994175066214\n",
      "Start iteration 11, value: 0.6752319798533112, best: 0.5248237277723505, dval: 0.4452510134000021\n",
      "Big value increase: val: 0.6752319798533112, e.val: 0.5379877997950223, max(α): 0.2451146464787559\n",
      "Start iteration 12, value: 0.5859321006454626, best: 0.5248237277723505, dval: 0.39553156058975536\n",
      "====================================\n",
      "5.269022373733808, 4.040133433150419, 0.48498256907257853, -0.9190430413417238, 5.977947544021642, 5.072912926616642, 5.6948521437549875, 3.8298872518870946, 4.279884270772679, 0.7072165190128635, 1.973913032017526, 3.9554726684549673, 2.2538684653440546, 1.5774943843527467, 1.983453615156803, 1.4576945070855782, 5.740062122325872, 2.9415213082098286, 3.2325862768184908, 2.1000281369709826, 3.4746589425241807, 1.0089889728247496, 4.627180138230332, 3.83942819194507, -1.1904364798850895, 1.1900773401804101, 4.935292029112776\n",
      "====================================\n",
      "Start iteration 13, value: 0.48898024532286055, best: 0.48898024532286055, dval: 0.3497260799317987\n",
      "Start iteration 14, value: 0.5041218681092173, best: 0.48898024532286055, dval: 0.38003162819391756\n",
      "====================================\n",
      "5.2609031316802755, 4.099129188819678, 0.5254938896928751, -0.8895939839107597, 5.977897833504018, 5.073210701518768, 5.858517104491801, 3.338939353689108, 4.213667190450369, 0.714796452754243, 1.9740029963779397, 3.981580833001064, 2.2519070460122226, 1.6516480567488487, 1.983363267194859, 1.3121924954948028, 5.740062122325872, 2.94155769076656, 3.2325862259232365, 2.0936621218738827, 3.4749777572836216, 1.011043194483906, 4.627180138230332, 3.844222585375785, -1.1923096989078181, 1.1900773401804101, 4.9352918736707645\n",
      "====================================\n",
      "Start iteration 15, value: 0.3602176817778203, best: 0.3602176817778203, dval: 0.16056012996296443\n",
      "====================================\n",
      "5.257611139299235, 4.089167657911084, 0.5233272502881721, -0.8984900269025385, 5.9778773128746625, 5.0730671243076015, 5.863762070043119, 3.340507533703306, 4.220811296596003, 0.718548263378893, 1.9739867677006904, 3.969274312669454, 2.250322316130365, 1.6811829019878668, 1.983429073312411, 1.0469780917389753, 5.740062122325872, 2.9415511277146136, 3.2325862208998837, 2.095967520950157, 3.4748422134295947, 1.089979442299409, 4.627180138230332, 3.873909884235442, -1.1932592046601391, 1.1900773401804101, 4.9352918725444015\n",
      "====================================\n",
      "Start iteration 16, value: 0.34625526221158665, best: 0.34625526221158665, dval: 0.19611326895308773\n",
      "Start iteration 17, value: 0.4967167181393142, best: 0.34625526221158665, dval: 0.48980272171790545\n",
      "Big value increase: val: 0.4967167181393142, e.val: 0.34625526221158665, max(α): 5.710555200903687\n",
      "====================================\n",
      "5.24505362440931, 4.014403807146436, 0.5240504143036308, -0.9263731151670864, 5.977695404358597, 5.061797237347245, 5.903137490331796, 3.3405510640945146, 4.223670780576608, 0.8215791627531315, 1.9739850343571381, 3.8769107133444924, 2.2486628124012937, 1.7586382207932503, 1.9837321694655858, 1.1547034671944363, 5.740062122325872, 2.941550426731804, 3.232585641935868, 2.098029536487431, 3.4746872713818164, 1.2147011134555983, 4.627180138230332, 4.300170974032515, -1.202511536497237, 1.1900773401804101, 4.935291872684493\n",
      "====================================\n",
      "Start iteration 18, value: 0.28300317592964236, best: 0.28300317592964236, dval: 0.27439874807006953\n",
      "====================================\n",
      "5.201038228405693, 3.9850206247466664, 0.5241187196877679, -0.9319271059492497, 5.9777199375640615, 5.0636261021101046, 5.903521578019935, 3.3401928999916946, 4.214747146421951, 1.372085725571437, 1.9739895976314874, 3.840610596933851, 2.2479430543491143, 1.5420545795461496, 1.9837389370460492, 1.1440088470122434, 5.740062122325872, 2.9415522721691207, 3.2325855050057535, 2.098539625562532, 3.474661860557425, 1.2364291983913533, 4.627180138230332, 4.213178083250751, -1.2145372145825688, 1.1900773401804101, 4.935291872484807\n",
      "====================================\n",
      "Start iteration 19, value: 0.27708643599472127, best: 0.27708643599472127, dval: 0.3143197374148454\n",
      "Start iteration 20, value: 2.0200776798728897, best: 0.27708643599472127, dval: 2.159555148465006\n",
      "Big value increase: val: 2.0200776798728897, e.val: 0.27708643599472127, max(α): 39.58010968450816\n",
      "Start iteration 21, value: 0.304385224055422, best: 0.27708643599472127, dval: 0.29153674437659133\n",
      "====================================\n",
      "5.124939053155238, 3.9861014128294077, 0.5242267049826882, -0.958355833207096, 5.977818344970126, 5.069222575192816, 5.904590495314822, 3.3397875334006257, 4.175075434584903, 0.8148207351502104, 1.9740128753015287, 3.841945515036201, 2.246281490354353, 1.6041014915405496, 1.9837390974895042, 1.1424501835077376, 5.740062122325872, 2.9415616859097056, 3.2325853495665866, 2.099521525706793, 3.47461375167328, 1.3562996054094185, 4.627180138230332, 4.242774722586477, -1.2648376398962844, 1.1900773401804101, 4.93529187228348\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 22, value: 0.23876697165158386, best: 0.23876697165158386, dval: 0.19312706338659355\n",
      "====================================\n",
      "5.0711610581000155, 3.9861047200575146, 0.5242645844688463, -0.9642447098084294, 5.977818261533169, 5.068908894411822, 5.904653275483749, 3.3397474870215946, 4.173268689288687, 0.8311952886342447, 1.974088680529367, 3.841951154901133, 2.2460590569253873, 1.6243769038174398, 1.9837402493759257, 1.142202336856739, 5.740062122325872, 2.941592342360657, 3.2325852837210047, 2.0995670404841023, 3.474611315979243, 1.2867268265588727, 4.627180138230332, 4.589903958461503, -1.2687315731646485, 1.1900773401804101, 4.9352918720266015\n",
      "====================================\n",
      "Start iteration 23, value: 0.23623362531542383, best: 0.23623362531542383, dval: 0.22947473473711782\n",
      "====================================\n",
      "4.731642990189093, 3.98610158392225, 0.5312355329653698, -0.9870545426237554, 5.977818343936684, 5.069125050520955, 5.9046288222798795, 3.3395809537705063, 4.17066240304394, 1.003430188843028, 1.9748341536012595, 3.8419458068033516, 2.245963562015374, 1.6061730828355676, 1.9837521700603533, 1.1406219490247105, 5.740062122325872, 2.9418938197035254, 3.2325852878046013, 2.099530318042369, 3.47461336809016, 1.2989978544394032, 4.627180138230332, 4.332350579564484, -1.2997139713395809, 1.1900773401804101, 4.935291870687983\n",
      "====================================\n",
      "Start iteration 24, value: 0.16465275693006506, best: 0.16465275693006506, dval: 0.15910627283697698\n",
      "====================================\n",
      "4.732576480884706, 3.9860994649800277, 0.5686851490260959, -1.0541472296337768, 5.977818327709647, 5.069150790692211, 5.9046345741086235, 3.3391724739020923, 4.168221723119568, 1.2180446728413818, 1.9756844841757082, 3.8419421933398876, 2.246006709392994, 1.6115115832257356, 1.9837627607464596, 1.1382500450790396, 5.740062122325872, 2.942237702550284, 3.2325852839680214, 2.0995164173320147, 3.4746135397211915, 1.313785966037296, 4.627180138230332, 4.444124915280886, -1.3315993733576519, 1.1900773401804101, 4.935291867820054\n",
      "====================================\n",
      "Start iteration 25, value: 0.13562800529872057, best: 0.13562800529872057, dval: 0.1774673644440925\n",
      "Start iteration 26, value: 0.36528895642429104, best: 0.13562800529872057, dval: 0.6191662780620971\n",
      "Big value increase: val: 0.36528895642429104, e.val: 0.13562800529872057, max(α): 25.08698437679614\n",
      "Start iteration 27, value: 0.5399235953863005, best: 0.13562800529872057, dval: 0.5898738609418048\n",
      "Big value increase: val: 0.5399235953863005, e.val: 0.13562800529872057, max(α): 62.18400862738199\n",
      "====================================\n",
      "4.732546405064259, 3.986109021375326, 0.7167943196996538, -1.4712702198899381, 5.977818341690285, 5.069172972963934, 5.904920366167141, 3.3584460234434372, 4.169263312059481, 1.1989784463958841, 1.9879397268404397, 3.8419584900019204, 2.24591656870214, 1.611434684868181, 1.9838909169162455, 0.8806861965881694, 5.740062122325872, 2.947193854736156, 3.2325852808880087, 2.0995561267765743, 3.4746129952375355, 1.527745675237717, 4.627180138230332, 4.534297032275197, -1.4163306600725811, 1.1900773401804101, 4.935286704249177\n",
      "====================================\n",
      "Start iteration 28, value: 0.09759527095413363, best: 0.09759527095413363, dval: 0.15565696345993577\n",
      "Start iteration 29, value: 0.5985167728778409, best: 0.09759527095413363, dval: 0.8679814106719315\n",
      "Big value increase: val: 0.5985167728778409, e.val: 0.09759527095413363, max(α): 15.585850428433924\n",
      "====================================\n",
      "4.73251680648456, 3.9861100114143073, 0.7330516789498646, -1.3216789555504167, 5.977818349496185, 5.0691824740185485, 5.90506115773872, 3.3522139937071684, 4.16893912554754, 1.2090967300363313, 1.9882384883450444, 3.841960178330017, 2.245855951205074, 1.6104147817363317, 1.9842069334281507, 0.7642391438899888, 5.740062122325872, 2.9473146771078222, 3.2325852811390865, 2.0995928689844794, 3.4746125579590235, 1.4675770228318339, 4.627180138230332, 4.533096654000774, -1.40791335633749, 1.1900773401804101, 4.935281562089296\n",
      "====================================\n",
      "Start iteration 30, value: 0.08492169649148686, best: 0.08492169649148686, dval: 0.1503289191477698\n",
      "====================================\n",
      "4.731681692841794, 3.9861104873706124, 0.742503786560146, -1.2857437795641204, 5.977818664539547, 5.069192486974251, 5.905134947652118, 3.3501129365612687, 4.168792164195508, 1.2161634855166594, 1.9882753418428367, 3.8419609899853326, 2.245478367016829, 1.6089900593959552, 1.9842307299634547, 0.7735626420422792, 5.740062122325872, 2.947329581059432, 3.232585281270775, 2.099677384571291, 3.474611797725644, 1.4680093920308404, 4.627180138230332, 4.532445087823059, -1.4039612802063461, 1.1900773401804101, 4.935279805638903\n",
      "====================================\n",
      "Start iteration 31, value: 0.08350799820425475, best: 0.08350799820425475, dval: 0.14552123166209463\n",
      "====================================\n",
      "4.706404100187254, 3.9861122518167025, 0.7641405826387394, -1.2790078123300852, 5.977896446775529, 5.069562104010727, 5.905519379658231, 3.325777128157524, 4.167343687606821, 1.2532088931881529, 1.988257517393808, 3.8419639989213072, 2.210234972759155, 1.5945558452159152, 1.9848884807377731, 0.7805843528719355, 5.740062122325872, 2.9473223726601834, 3.232585282051392, 2.113428047105813, 3.4745184407056953, 1.4678430440351158, 4.627180138230332, 4.531092157150204, -1.3819627253698268, 1.1900773401804101, 4.9352400155721154\n",
      "====================================\n",
      "Start iteration 32, value: 0.07254296311282477, best: 0.07254296311282477, dval: 0.11598265445329344\n",
      "Start iteration 33, value: 0.08555489055110956, best: 0.07254296311282477, dval: 0.21433706738389485\n",
      "Big value increase: val: 0.08555489055110956, e.val: 0.07254296311282477, max(α): 7.997176738582969\n",
      "Start iteration 34, value: 0.09236694743941504, best: 0.07254296311282477, dval: 0.2335096749360579\n",
      "Big value increase: val: 0.09236694743941504, e.val: 0.07254296311282477, max(α): 26.33392217306403\n",
      "====================================\n",
      "4.695118192233565, 3.9861163810338747, 0.7633427448333823, -1.2893867413903206, 5.987616974407447, 5.096342156664137, 6.063033504993182, 3.2464269593120347, 4.16097753581184, 1.4538584070889415, 1.9881159210056616, 3.8419710405363308, 1.971380299097432, 1.5923363398125092, 2.034485182146247, 0.7055094878782632, 5.740062122325872, 2.947265109555092, 3.2325852839320572, 2.204556803416211, 3.473866521749935, 1.4680053199359853, 4.627180138230332, 4.531509347811277, -1.3427826052838447, 1.1900773401804101, 4.9288145135147685\n",
      "====================================\n",
      "Start iteration 35, value: 0.03689714314757688, best: 0.03689714314757688, dval: 0.07608726900210652\n",
      "====================================\n",
      "4.693119672933673, 3.9861166216973927, 0.7628999016579366, -1.361313931392346, 6.0238674314799034, 5.102476566448443, 6.085842646746043, 3.2462250480743364, 4.16101418890395, 1.5034056640578146, 1.9879790503603503, 3.8419714509433827, 1.9707899285232615, 1.5936488588212874, 2.0754597163176647, 0.7034490633950463, 5.740062122325872, 2.947209757591324, 3.232585283514036, 2.2046655191093665, 3.47386571348167, 1.4680555784554583, 4.627180138230332, 4.531543654691318, -1.3471219820099412, 1.1900773401804101, 4.927504824759341\n",
      "====================================\n",
      "Start iteration 36, value: 0.02702667967768566, best: 0.02702667967768566, dval: 0.05981128348275759\n",
      "====================================\n",
      "4.679031287072795, 3.986116906817329, 0.7618261286571841, -1.4685250973058486, 6.157081261251543, 5.127545258153898, 6.115806517499956, 3.2460082627794358, 4.16098281516176, 1.5096538178843706, 1.9877772961831766, 3.8419719371626218, 1.9700809466102303, 1.5973046123195205, 2.1990430383970927, 0.7030306989522382, 5.740062122325872, 2.94712816602814, 3.232585282775283, 2.204789440060175, 3.4738647959628017, 1.4695912375021736, 4.627180138230332, 4.531587097613236, -1.3546940843157067, 1.1900773401804101, 4.923050542628896\n",
      "====================================\n",
      "Start iteration 37, value: 0.016844921897912125, best: 0.016844921897912125, dval: 0.06649524768221567\n",
      "====================================\n",
      "4.6851009323593455, 3.986117351812416, 0.7619525669505295, -1.4719147764817557, 6.13916509763581, 5.125693764615752, 6.163527392915125, 3.2457336000344763, 4.160944028232687, 1.5114122311692946, 1.9878634964407234, 3.841972696019316, 1.9678043785824904, 1.6048299659572343, 2.1898769193373147, 0.7033217934367484, 5.740062122325872, 2.947163026341114, 3.2325852816925935, 2.205422152082198, 3.473861365054087, 1.4800181538519186, 4.627180138230332, 4.5316444820954755, -1.3682645875691894, 1.1900773401804101, 4.924111518876723\n",
      "====================================\n",
      "Start iteration 38, value: 0.013359092419017548, best: 0.013359092419017548, dval: 0.050278370021573995\n",
      "====================================\n",
      "4.688112930478289, 3.986117854313535, 0.7624192467685663, -1.4756389578620506, 6.146668884382542, 5.1210023071162, 6.231947234914612, 3.2453727098243075, 4.160692005616005, 1.5116077738431921, 1.988078400104957, 3.841973552941896, 1.9539407976400482, 1.6353812404985517, 2.196102098271264, 0.7049007543086699, 5.740062122325872, 2.9472499356985526, 3.2325852778956263, 2.2125997089129132, 3.473830378845582, 1.4887812892836565, 4.627180138230332, 4.5318061369028895, -1.4249763057884441, 1.1900773401804101, 4.926228299443302\n",
      "====================================\n",
      "Start iteration 39, value: 0.00938810616116082, best: 0.00938810616116082, dval: 0.03365262743837123\n",
      "====================================\n",
      "4.693682207463909, 3.9861178435038607, 0.7631951505504609, -1.481802669539346, 6.210041765129072, 5.113728714695182, 6.24149849020176, 3.2448408747836, 4.159802393981054, 1.5118048890227507, 1.9882593333337537, 3.8419735345079986, 1.9457245839185406, 1.6656332314306779, 2.204494501719655, 0.716904766518129, 5.740062122325872, 2.9473231070458636, 3.232585274911206, 2.2164841115162095, 3.473808075895937, 1.4925138947486385, 4.627180138230332, 4.532065688095908, -1.4350893501465147, 1.1900773401804101, 4.924830942296419\n",
      "====================================\n",
      "Start iteration 40, value: 0.008850983252438252, best: 0.008850983252438252, dval: 0.03691228179655784\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 41, value: 0.034697803679634376, best: 0.008850983252438252, dval: 0.17266870501516723\n",
      "Big value increase: val: 0.034697803679634376, e.val: 0.008850983252438252, max(α): 17.569583012013467\n",
      "====================================\n",
      "4.6952308999433905, 3.9861178642552244, 0.7669340761578791, -1.550314991664236, 6.166868338584123, 5.102575471777804, 6.280459988112447, 3.243749909277739, 4.15980763484961, 1.516222318351947, 1.9897822065819226, 3.841973569895606, 1.9429049250322221, 1.6811022469509662, 2.288758409864721, 0.7106951831817916, 5.740062122325872, 2.947938973396635, 3.232584891901975, 2.220792442960576, 3.473746063878702, 1.494945261530955, 4.627180138230332, 4.534016550063963, -1.4348882001106766, 1.1900773401804101, 4.918137602743178\n",
      "====================================\n",
      "Start iteration 42, value: 0.004700191515204149, best: 0.004700191515204149, dval: 0.037895758593773775\n",
      "====================================\n",
      "4.695092728876813, 3.9861178647240703, 0.7670285592512383, -1.5738527562839209, 6.177632594519815, 5.110283674043552, 6.2812175233057665, 3.2435082965616187, 4.159680848428195, 1.5376605073467184, 1.99044545510591, 3.841973570695136, 1.9424270473177254, 1.7026563340982495, 2.2886248467327657, 0.7108865753575879, 5.740062122325872, 2.9482071982463487, 3.2325840288675085, 2.2206668091927786, 3.4737535125319843, 1.4951235299934325, 4.627180138230332, 4.534348194626353, -1.4537058219224286, 1.1900773401804101, 4.91730658318884\n",
      "====================================\n",
      "Start iteration 43, value: 0.0037824252451337083, best: 0.0037824252451337083, dval: 0.025839798721155598\n",
      "====================================\n",
      "4.694874736702108, 3.9861178654368694, 0.7675888195419522, -1.5773194898588734, 6.174006270857418, 5.107784091678937, 6.282412849658225, 3.243179974044696, 4.159507781036866, 1.5378251368481604, 1.9932633449183792, 3.8419735719106827, 1.941692447879895, 1.6976192919750173, 2.288757642172674, 0.7108031120451859, 5.740062122325872, 2.9493467832497426, 3.2325821791071294, 2.2207856675856616, 3.473747065512761, 1.4951937529055117, 4.627180138230332, 4.535062210639045, -1.5008275426878164, 1.1900773401804101, 4.9167211879436445\n",
      "====================================\n",
      "Start iteration 44, value: 0.0030966922445847403, best: 0.0030966922445847403, dval: 0.025921330741319526\n",
      "Start iteration 45, value: 0.021093626569452115, best: 0.0030966922445847403, dval: 0.13653259003862633\n",
      "Big value increase: val: 0.021093626569452115, e.val: 0.0030966922445847403, max(α): 174.45447160220002\n",
      "====================================\n",
      "4.694900601489937, 3.986118079382976, 0.7732218033283766, -1.5805390278080864, 6.172333621448668, 5.088454824009646, 6.318978611089147, 3.241241785315244, 4.15868138483825, 1.5384322199712286, 2.0122234010450195, 3.841973936756094, 1.926071878332214, 1.6938732658126314, 2.289890725356491, 0.7109653791872684, 5.740062122325872, 2.957014434245114, 3.2325818849493975, 2.2292472358240714, 3.4736897676537604, 1.4956033631625112, 4.627180138230332, 4.549820430824492, -1.5061499983894044, 1.1900773401804101, 4.91436578314299\n",
      "====================================\n",
      "Start iteration 46, value: 0.0027901590574611864, best: 0.0027901590574611864, dval: 0.029019430074775476\n",
      "====================================\n",
      "4.694941092942296, 3.986118077175826, 0.7719027709397382, -1.602786559831971, 6.174934184238975, 5.096995681216416, 6.317660457167145, 3.241197008908375, 4.158524546374465, 1.5391587873009447, 2.0083354802412647, 3.8419739329922087, 1.9295071861619308, 1.6927820772794424, 2.2951387402362107, 0.710992633647423, 5.740062122325872, 2.9554421171790826, 3.23258177712906, 2.2246300250744304, 3.473697502020736, 1.496036155721288, 4.627180138230332, 4.552570178154784, -1.5063773385217716, 1.1900773401804101, 4.913231819391466\n",
      "====================================\n",
      "Start iteration 47, value: 0.0023870056882586885, best: 0.0023870056882586885, dval: 0.026804616924445857\n",
      "====================================\n",
      "4.694936162966095, 3.986118078802045, 0.771667871049177, -1.602858983094306, 6.190121735373516, 5.10076625057052, 6.317904215032578, 3.2411409776767073, 4.158339260086351, 1.5407406012554723, 2.0062765319880502, 3.841973935765424, 1.9289988089572818, 1.6856910031885464, 2.3586524630275623, 0.7111033903261761, 5.740062122325872, 2.954609456319973, 3.2325781531891677, 2.2219373020171735, 3.4737020894157618, 1.4972569997254097, 4.627180138230332, 4.563460517335992, -1.5066916119477312, 1.1900773401804101, 4.9120850991529315\n",
      "====================================\n",
      "Start iteration 48, value: 0.0015320119327133343, best: 0.0015320119327133343, dval: 0.025450160555818148\n",
      "====================================\n",
      "4.694937840085572, 3.9861181599099638, 0.7718734722345207, -1.6027912170343293, 6.1880118180844566, 5.110918610205876, 6.319026518778241, 3.241068920615166, 4.158098703870466, 1.5421029629137648, 2.0073114784335186, 3.8419740740799497, 1.928236302320608, 1.6893725555331434, 2.350358827649544, 0.7117971947731354, 5.740062122325872, 2.9550279998142406, 3.232573879995382, 2.2218310539384514, 3.473703037206048, 1.4999186591659504, 4.627180138230332, 4.576680625887524, -1.5070433932051917, 1.1900773401804101, 4.910747370831645\n",
      "====================================\n",
      "Start iteration 49, value: 0.001411091799456488, best: 0.001411091799456488, dval: 0.01944615233392899\n",
      "====================================\n",
      "4.694936238459251, 3.986119016635423, 0.7744761618041717, -1.602503203968583, 6.189852282537652, 5.106640850782489, 6.318783395852435, 3.241036465878204, 4.15800385868992, 1.5692770416680766, 2.011439904848934, 3.8419755350664655, 1.9196234741111893, 1.6880209254133751, 2.353903918473804, 0.7157069742269054, 5.740062122325872, 2.956697579941116, 3.2325655019480473, 2.2216998768418765, 3.473704415598121, 1.4996607441928356, 4.627180138230332, 4.579040741310796, -1.5090517091355056, 1.1900773401804101, 4.91139788622168\n",
      "====================================\n",
      "Start iteration 50, value: 0.001360578342321448, best: 0.001360578342321448, dval: 0.02075993834306905\n",
      "====================================\n",
      "4.694934046707934, 3.986123242577513, 0.775761308274281, -1.6020461345765593, 6.203045218333522, 5.107875812305849, 6.313295938914885, 3.2408073886141056, 4.157359233775195, 1.5490954552004843, 2.0119151561203834, 3.8419827416276164, 1.9067444338124628, 1.6693322736188907, 2.3565373140834027, 0.7151190215997866, 5.740062122325872, 2.956889776676202, 3.2324569730726207, 2.2218152394667907, 3.473703479266232, 1.4991649435349939, 4.627180138230332, 4.58631213111412, -1.5407863406482967, 1.1900773401804101, 4.911462516869075\n",
      "====================================\n",
      "Start iteration 51, value: 0.0009383576052305445, best: 0.0009383576052305445, dval: 0.010544896907217138\n",
      "====================================\n",
      "4.694935681225043, 3.9861327600735343, 0.7778876799689264, -1.60128914279509, 6.196066742684232, 5.107137869433749, 6.318270167404087, 3.24009895037845, 4.142700268138786, 1.5586900498173273, 2.012812587551693, 3.8419989719534517, 1.9137237257561894, 1.6804722332253113, 2.3595674519218974, 0.7144743938893946, 5.740062122325872, 2.9572527076169965, 3.232336515094946, 2.221735376916881, 3.473704162818575, 1.49957039917278, 4.627180138230332, 4.5960229175143725, -1.546877022688086, 1.1900773401804101, 4.911544494602126\n",
      "====================================\n",
      "Start iteration 52, value: 0.0007898831261520885, best: 0.0007898831261520885, dval: 0.014604922161251976\n",
      "====================================\n",
      "4.694935724166946, 3.986152268737561, 0.77695319647555, -1.6014737171152313, 6.198357208647024, 5.1061430085427695, 6.317841247302074, 3.240672474735968, 4.15414325376399, 1.5593123706809484, 2.012243571818351, 3.842032240364917, 1.9145889808136023, 1.6742563535677137, 2.3687470366841605, 0.7148183781868493, 5.740062122325872, 2.957022591523194, 3.232296447386234, 2.2217017791041336, 3.4737045058725444, 1.4994692433101624, 4.627180138230332, 4.595279165425559, -1.5709679485021628, 1.1900773401804101, 4.911641924121126\n",
      "====================================\n",
      "Start iteration 53, value: 0.0006361419911385712, best: 0.0006361419911385712, dval: 0.01622157606423011\n",
      "Start iteration 54, value: 0.0017141306221105093, best: 0.0006361419911385712, dval: 0.03661068037225302\n",
      "Big value increase: val: 0.0017141306221105093, e.val: 0.0006361419911385712, max(α): 13.865142237765118\n",
      "====================================\n",
      "4.694935758184437, 3.9888813636455973, 0.7791404702767524, -1.6025159381944345, 6.1977204371645, 5.105528270570556, 6.3178993099820815, 3.240574143402975, 4.151431537484343, 1.5596234917445109, 2.0123183500237234, 3.8466862060186156, 1.9150872812073354, 1.6743521655738396, 2.398116863871807, 0.7166198523836355, 5.740062122325872, 2.957052832635194, 3.2322971938251035, 2.22168247296885, 3.4737045491566505, 1.4995050506420429, 4.627180138230332, 4.596722939417429, -1.568347704687016, 1.1900773401804101, 4.911890717979957\n",
      "====================================\n",
      "Start iteration 55, value: 0.0003300230763949749, best: 0.0003300230763949749, dval: 0.00902709003920523\n",
      "====================================\n",
      "4.694935870512268, 3.989222722339674, 0.7808923383352563, -1.60733807373046, 6.197638435056085, 5.105327436326546, 6.317406337231233, 3.2405644172443853, 4.151114131725568, 1.5588138054591631, 2.0123280605233203, 3.847268330016262, 1.9146906921900355, 1.6743727001893145, 2.400643555590249, 0.7164554858099116, 5.740062122325872, 2.9570567596658632, 3.2322919738250704, 2.221678499366126, 3.473704554045867, 1.499511209567475, 4.627180138230332, 4.5973887987922115, -1.5710609295628608, 1.1900773401804101, 4.912866485259297\n",
      "====================================\n",
      "Start iteration 56, value: 0.000294598358865826, best: 0.000294598358865826, dval: 0.008549937113976891\n",
      "====================================\n",
      "4.694937549955517, 3.990121726814956, 0.7877493781883727, -1.6064382603013758, 6.196655242941209, 5.104957554616658, 6.317034974129604, 3.2404585432540225, 4.147726403923632, 1.5582288119899976, 2.0124082041945117, 3.848801415559809, 1.914570508216471, 1.6748435934122183, 2.4367231792079926, 0.7164724680168416, 5.740062122325872, 2.9570891706300535, 3.2321984384621745, 2.2216702593337447, 3.473704560318361, 1.4995303953923684, 4.627180138230332, 4.612772847196505, -1.633133280774847, 1.1900773401804101, 4.915666022333109\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 57, value: 0.0002562220197728371, best: 0.0002562220197728371, dval: 0.012745347644093241\n",
      "Start iteration 58, value: 0.0009917686237074905, best: 0.0002562220197728371, dval: 0.025573537322377993\n",
      "Big value increase: val: 0.0009917686237074905, e.val: 0.0002562220197728371, max(α): 18.34957156864321\n",
      "====================================\n",
      "4.694940915676793, 3.99119433823363, 0.791853347358708, -1.6070031364285409, 6.1964548617060045, 5.104573936445226, 6.315453497964083, 3.2404279110855203, 4.145400204757905, 1.5583312003797598, 2.012672653931153, 3.850630555575266, 1.914645876068995, 1.6921076660215688, 2.4477547825370802, 0.716504961882754, 5.740062122325872, 2.957196116953038, 3.232210157408371, 2.221662387266457, 3.473704559095135, 1.4995432355930702, 4.627180138230332, 4.619959019387529, -1.6185530359644842, 1.1900773401804101, 4.925397608875297\n",
      "====================================\n",
      "Start iteration 59, value: 0.00010991117575641312, best: 0.00010991117575641312, dval: 0.006119740133055243\n",
      "====================================\n",
      "4.694939297597917, 3.991219689105386, 0.792243702834644, -1.6070999337481544, 6.197031084315719, 5.104981508724869, 6.312810698751857, 3.240371392104344, 4.142217564877671, 1.5582750897815172, 2.0127200217973256, 3.85067378678943, 1.9146433784918626, 1.686085884970392, 2.4497968394736116, 0.7165356978209302, 5.740062122325872, 2.957215273028514, 3.232215153206206, 2.2216636072290545, 3.4737045596536658, 1.499543196580095, 4.627180138230332, 4.615598278287219, -1.6171259813690884, 1.1900773401804101, 4.923296936469597\n",
      "====================================\n",
      "Start iteration 60, value: 5.8304057257469155e-5, best: 5.8304057257469155e-5, dval: 0.002612705385912485\n",
      "====================================\n",
      "4.694938778696139, 3.991297350077475, 0.7919930669391861, -1.6071199280776716, 6.19722901723901, 5.1052557657998205, 6.309391837874703, 3.240370898749676, 4.142159744789628, 1.5577268477399817, 2.0128255417545624, 3.850806223186445, 1.9146440314155426, 1.6860261689215248, 2.4489485005875355, 0.7165493239326745, 5.740062122325872, 2.9572579464362145, 3.232214938039683, 2.221662852587926, 3.473704560053187, 1.4995431574647073, 4.627180138230332, 4.614699701393353, -1.617105862967881, 1.1900773401804101, 4.922010773339982\n",
      "====================================\n",
      "Start iteration 61, value: 4.8842933141967225e-5, best: 4.8842933141967225e-5, dval: 0.0031217198313460773\n",
      "====================================\n",
      "4.694938207913526, 3.99149815793967, 0.7886187724441133, -1.6071029138998825, 6.197180860594122, 5.105334904035476, 6.307801051414175, 3.2403713729091486, 4.142213064995337, 1.5576747925877048, 2.013852959398046, 3.851148663784935, 1.9146447048031967, 1.686077726343041, 2.447092244782074, 0.7165539971985695, 5.740062122325872, 2.9576734452018227, 3.232201503508341, 2.2216615980436334, 3.47370456078912, 1.4995428051977784, 4.627180138230332, 4.61440498038514, -1.6170849019289697, 1.1900773401804101, 4.921044140725637\n",
      "====================================\n",
      "Start iteration 62, value: 4.433477698695391e-5, best: 4.433477698695391e-5, dval: 0.0034309821677576263\n",
      "====================================\n",
      "4.694936513879628, 3.993725937120065, 0.7901358595671356, -1.607037366726894, 6.197086992144163, 5.105276896835574, 6.307280654249314, 3.2403713100963003, 4.142202983288377, 1.5577070843297358, 2.0167035527988038, 3.8549477283608806, 1.9146488025989608, 1.6862225947399294, 2.4472279526830865, 0.7165609016448855, 5.740062122325872, 2.958826255888672, 3.232211876749964, 2.2216558860354394, 3.473704561482026, 1.4995379279979897, 4.627180138230332, 4.6109736819770575, -1.6170531226975453, 1.1900773401804101, 4.920878101832138\n",
      "====================================\n",
      "Start iteration 63, value: 3.3995217451852534e-5, best: 3.3995217451852534e-5, dval: 0.001905455746140169\n",
      "====================================\n",
      "4.694937635652653, 3.9941900801016414, 0.7891763886360847, -1.6070580541140207, 6.196920790706306, 5.105307617034587, 6.306697689802627, 3.240371364499799, 4.142210970934002, 1.5577077933006378, 2.015154786893065, 3.8557392382084443, 1.9146457625289652, 1.6863886719066528, 2.447121049272191, 0.7165719040117127, 5.740062122325872, 2.9581999182682, 3.232206440898193, 2.221658762455807, 3.4737045608960027, 1.4995115649742803, 4.627180138230332, 4.6139311183710525, -1.6168856915485286, 1.1900773401804101, 4.920870366248745\n",
      "====================================\n",
      "Start iteration 64, value: 2.8539384608498392e-5, best: 2.8539384608498392e-5, dval: 0.002421579521251562\n",
      "Start iteration 65, value: 0.0020053749812612987, best: 2.8539384608498392e-5, dval: 0.044696674316980434\n",
      "Big value increase: val: 0.0020053749812612987, e.val: 2.8539384608498392e-5, max(α): 81.43430760296445\n",
      "====================================\n",
      "4.694937629514134, 3.9948960367432, 0.7891031485682215, -1.6070616308058912, 6.196940428930135, 5.105307543123923, 6.295120047934853, 3.2403713698654575, 4.142211862964046, 1.5577077962596382, 2.0151441366060348, 3.8569431164440857, 1.9145915385926076, 1.6872152602781436, 2.4471210524015925, 0.7168958142470874, 5.740062122325872, 2.958195611177367, 3.2322064575448244, 2.2217395580637938, 3.4737045599003493, 1.4968764389260614, 4.627180138230332, 4.613908052453618, -1.6146491917788128, 1.1900773401804101, 4.920877011858494\n",
      "====================================\n",
      "Start iteration 66, value: 2.3136236908018912e-5, best: 2.3136236908018912e-5, dval: 0.0037007798609800524\n",
      "Start iteration 67, value: 2.9332683016896913e-5, best: 2.3136236908018912e-5, dval: 0.003975482624305568\n",
      "Big value increase: val: 2.9332683016896913e-5, e.val: 2.3136236908018912e-5, max(α): 11.903829527260285\n",
      "====================================\n",
      "4.694937628336461, 3.9963176167606376, 0.7891002093803144, -1.6068235027390065, 6.196938478006287, 5.105307858976065, 6.298605543304953, 3.240371367844447, 4.1422112662387045, 1.5577079028025822, 2.0151459753066714, 3.8593673577394676, 1.914585079917994, 1.6888049134467766, 2.4471210102136993, 0.7167447806479355, 5.740062122325872, 2.9581963547677166, 3.2322064516870745, 2.2228709904085786, 3.4737045595523592, 1.497959693570758, 4.627180138230332, 4.6139395314343155, -1.614237942848017, 1.1900773401804101, 4.920880220228817\n",
      "====================================\n",
      "Start iteration 68, value: 9.942330901954772e-6, best: 9.942330901954772e-6, dval: 0.0007682830101059801\n",
      "====================================\n",
      "4.6949376262604625, 3.9966135077572025, 0.7890984486612859, -1.6066617089077746, 6.196936329378367, 5.105307950627058, 6.298314622442464, 3.240371368053075, 4.142211292952875, 1.557707990504302, 2.015145284938527, 3.8598719450043455, 1.9145817259174662, 1.6891038503278153, 2.447120986073698, 0.7167465755791846, 5.740062122325872, 2.9581960755754, 3.2322064487372697, 2.2232779614575504, 3.4737045594306384, 1.4979122760555474, 4.627180138230332, 4.613937398090584, -1.6143303132337685, 1.1900773401804101, 4.920880654915236\n",
      "====================================\n",
      "Start iteration 69, value: 9.121052550561392e-6, best: 9.121052550561392e-6, dval: 0.000978040414734429\n",
      "====================================\n",
      "4.694937605533439, 3.996952611489313, 0.788988148917993, -1.606151811275603, 6.1968940943649455, 5.10530983587187, 6.296958139406703, 3.2403713688145097, 4.142211350665136, 1.5577083519203623, 2.0151436341414324, 3.8604502235822062, 1.914579742326795, 1.689378903708473, 2.447120876227463, 0.7167612889458918, 5.740062122325872, 2.9581954079752677, 3.2322064422121692, 2.22354125532682, 3.4737045593318614, 1.4974610233331023, 4.627180138230332, 4.613933239832169, -1.6143054254949305, 1.1900773401804101, 4.920880808964064\n",
      "====================================\n",
      "Start iteration 70, value: 7.308156676383028e-6, best: 7.308156676383028e-6, dval: 0.0008150196997188312\n",
      "Start iteration 71, value: 5.1363415554479454e-5, best: 7.308156676383028e-6, dval: 0.006939871004732229\n",
      "Big value increase: val: 5.1363415554479454e-5, e.val: 7.308156676383028e-6, max(α): 37.70497117936074\n",
      "Start iteration 72, value: 4.2521277850836145e-5, best: 7.308156676383028e-6, dval: 0.006092783486130743\n",
      "Big value increase: val: 4.2521277850836145e-5, e.val: 7.308156676383028e-6, max(α): 1.5404360882641743\n",
      "====================================\n",
      "4.6949375593198095, 3.9999759581618606, 0.7887400456994362, -1.603484515156047, 6.196704105805983, 5.105356083777249, 6.2864184229226385, 3.2403713669793137, 4.142211195834413, 1.5596581869547992, 2.015055509669334, 3.86560598109431, 1.9145797661870076, 1.6902519086135406, 2.4471111519926625, 0.7167821231444431, 5.740062122325872, 2.958159769489204, 3.2322062877126485, 2.2237592253381124, 3.4737045591554025, 1.4974390189855138, 4.627180138230332, 4.613940930792111, -1.6141233166048612, 1.1900773401804101, 4.920881621473102\n",
      "====================================\n",
      "Start iteration 73, value: 3.783491447598422e-6, best: 3.783491447598422e-6, dval: 0.0011912553485242325\n",
      "====================================\n",
      "4.69493753505699, 3.9998120472142067, 0.7887517153190751, -1.6032284711655562, 6.196652222532116, 5.10588365654378, 6.286816239861535, 3.2403713658123063, 4.142211105085612, 1.5591280579719826, 2.0150472876938452, 3.8653264613464238, 1.9145797488669385, 1.6903335133662238, 2.4471083030269494, 0.7167767319293469, 5.740062122325872, 2.958156444433724, 3.2322062260091196, 2.2237637861597417, 3.4737045591547675, 1.4972567144787021, 4.627180138230332, 4.6139585849165385, -1.6140327940676387, 1.1900773401804101, 4.920882154914232\n",
      "====================================\n",
      "Start iteration 74, value: 3.0874214530893515e-6, best: 3.0874214530893515e-6, dval: 0.0010231032102739797\n",
      "Start iteration 75, value: 1.4212829987981784e-5, best: 3.0874214530893515e-6, dval: 0.002824732118981134\n",
      "Big value increase: val: 1.4212829987981784e-5, e.val: 3.0874214530893515e-6, max(α): 25.176800935671654\n",
      "Start iteration 76, value: 5.5168989024320835e-6, best: 3.0874214530893515e-6, dval: 0.001500289321391915\n",
      "Big value increase: val: 5.5168989024320835e-6, e.val: 3.0874214530893515e-6, max(α): 66.30852227569497\n",
      "====================================\n",
      "4.694937531597097, 3.9986310525507864, 0.7887568665079278, -1.6021635657762316, 6.195268993177107, 5.10587216994078, 6.28910011966405, 3.240371363557063, 4.142210838559725, 1.5591303964703798, 2.0150468406337865, 3.8633124937909153, 1.914579623547672, 1.6904830293629338, 2.4470506110171626, 0.716659724594827, 5.740062122325872, 2.9581562636378194, 3.2322053260572896, 2.223810943206097, 3.4737045591498936, 1.4969871210071517, 4.627180138230332, 4.614122838742888, -1.614058856511335, 1.1900773401804101, 4.92095375138508\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 77, value: 1.1895540762598628e-6, best: 1.1895540762598628e-6, dval: 0.0006648195134326199\n",
      "====================================\n",
      "4.694937526287066, 3.9986757004288984, 0.7887614485615964, -1.602222352893077, 6.195116989524687, 5.10587215078546, 6.289070999951748, 3.2403713583360823, 4.142210121063459, 1.5591353959230585, 2.015045162107819, 3.8633886324736078, 1.914579537543359, 1.6904733347411915, 2.447044258618329, 0.7168021451661278, 5.740062122325872, 2.958155584823832, 3.232205323392328, 2.223860203879877, 3.473704559146185, 1.4969973576241042, 4.627180138230332, 4.614123009380571, -1.6139319438448096, 1.1900773401804101, 4.921350151387696\n",
      "====================================\n",
      "Start iteration 78, value: 1.0743606720023479e-6, best: 1.0743606720023479e-6, dval: 0.000630034118881375\n",
      "====================================\n",
      "4.6949374380324045, 3.9987094094019917, 0.7887787951180099, -1.6031063390945763, 6.194872134860197, 5.105872169930256, 6.288994511008591, 3.240371351281508, 4.142209147202213, 1.5591600265360877, 2.0148157985129633, 3.8634461168808123, 1.914574574389089, 1.6904122377595623, 2.4470129009354245, 0.7168317041609354, 5.740062122325872, 2.9580628277147025, 3.2322053199723424, 2.224989189854671, 3.4737045590790148, 1.497008233928827, 4.627180138230332, 4.6141228440780155, -1.6139180808536293, 1.1900773401804101, 4.921265733990603\n",
      "====================================\n",
      "Start iteration 79, value: 6.863658567291087e-7, best: 6.863658567291087e-7, dval: 0.00042392032159410675\n",
      "Find solution in iteration 79, value: 6.863658567291087e-7\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(6.863658567291087e-7, Number[4.6949374380324045, 3.9987094094019917, 0.7887787951180099, -1.6031063390945763, 6.194872134860197, 5.105872169930256, 6.288994511008591, 3.240371351281508, 4.142209147202213, 1.5591600265360877  …  2.9580628277147025, 3.2322053199723424, 2.224989189854671, 3.4737045590790148, 1.497008233928827, 4.627180138230332, 4.6141228440780155, -1.6139180808536293, 1.1900773401804101, 4.921265733990603], 79)"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# The parameters from previous step\n",
    "step2_params = step2_start_params\n",
    "# The parameter wich I found on real deviece\n",
    "#step2_params = [6.357739083193767, 4.110466988994183, 4.566133708100635, -4.727581603064405, 6.207391247986331, -1.3477711816915519, -0.7698439582879397, 4.677177128084215, -1.88364164245155, -6.961405873009646, 2.3088656324648755, 1.9854073372986245, -2.4954433452385736, 6.326779366664302, -0.7789648567030898, 2.995616831369772, 6.237335880828537, 0.6943207146536418, 0.37027914593259564, 0.9373275950100715, 2.0325673904575456, 1.3926281522358193, 5.042496816647515, 0.3933698184667445, 3.4025273194720507, 0.9766806621264883, 3.8089690519454855]\n",
    "\n",
    "step3_check_qc, _, _, _ = generate_circuit(trotter_steps, 4, t, params, params2, params3, init=false)\n",
    "\n",
    "step3_start_params, step3_qc = generate_step_ansact(step2_params)\n",
    "step3_of = create_op(useExecutePlace, step3_qc)\n",
    "\n",
    "val, xparams, itr = gradientDescent(step3_of, step3_start_params, α=0.01, maxItr=200,\n",
    "                              argsArePeriodic=true, isExpectedZero=true, ϵ=1e-6, debug=true, useBigValInc=true)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "id": "8fbb6f5c",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.0007146200539522847"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "check_err_of_ansact(step3_start_params, step3_check_qc)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "68882ddb",
   "metadata": {},
   "source": [
    "The parameter for step 3 was found on the noisy simulator. The code used in training can be found in [sol_step3](src/Challenge/steps/sol_step3.jl) (the code works in exactly the same way as the code above but has had more logging and checks). The log of execution of the code on a noisy simulator can be found in [sol_res_step3_1](src/Challenge/steps/sol_res_step3_1.txt).\n",
    "\n",
    "\n",
    "# 6. Step 4"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "id": "89be1ad1",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "4.132952070077372, 3.8336683961520124, 3.869424599885051, 3.255532343763136, 4.819668041489996, 1.8550633499457236, 5.904734081578966, 1.9310629356854208, 2.0315727047743017, 0.9054745754380559, 4.68871899704009, 0.29066513038441505, 4.383523160019999, 2.1342514022731183, 0.6009415884262946, 5.853399229157503, 6.0306520390775855, 0.7520358101027647, 0.8833285569740971, 2.969608324035075, 4.024333226692658, 4.4945134564951035, 6.048640247836036, 2.827620671397382, 5.002757260392745, 4.3961461296906545, 3.968748059222293\n",
      "====================================\n",
      "Start iteration 1, value: 4.544000413899647, best: 4.544000413899647, dval: 5.072514896713679\n",
      "====================================\n",
      "4.131617387554877, 3.796719198513003, 3.89764188759895, 3.2491065177850857, 4.807487726900782, 1.8708682407905015, 5.881373301574726, 1.891713883161123, 1.9877356867700973, 0.9013840612236561, 4.692997063241225, 0.2537159327454056, 4.379970179977723, 2.184976551240255, 0.5699267540226287, 5.860116981969993, 6.0306520390775855, 0.7563138763038996, 0.851140476729491, 2.9472295809169826, 4.008135497512185, 4.486175431644065, 6.048640247836036, 2.864168887544875, 5.001607270064482, 4.3961461296906545, 4.004377625980237\n",
      "====================================\n",
      "Start iteration 2, value: 3.3535037983965266, best: 3.3535037983965266, dval: 2.884504429065112\n",
      "====================================\n",
      "4.13127980902499, 3.75668863656964, 3.9210196871696983, 3.229839034933383, 4.730838322666124, 1.9284403896376399, 5.8546073278833015, 1.8354453284955397, 1.9291098147760493, 0.9031655737058132, 4.697518724107046, 0.2136853708020428, 4.370207561000346, 2.2518486796071446, 0.5277674802265239, 5.868383827213833, 6.0306520390775855, 0.7608355371697215, 0.8026151565163702, 2.92748458819335, 3.999975528486928, 4.4846831811935965, 6.048640247836036, 2.9138804679528967, 5.002414425860592, 4.3961461296906545, 4.049518613142857\n",
      "====================================\n",
      "Start iteration 3, value: 2.3661136443256856, best: 2.3661136443256856, dval: 1.7323591388834232\n",
      "====================================\n",
      "4.13145281628932, 3.710107651190822, 3.939864954718505, 3.1181152639860445, 4.262175198530191, 2.16435722601391, 5.829019887379672, 1.731579043655616, 1.8324586450013756, 0.9077424630237055, 4.703229778461515, 0.16710438542322478, 4.316724529235663, 2.3523972334225216, 0.46275908977003255, 5.880555733502531, 6.0306520390775855, 0.7665465915241918, 0.7278838793554137, 2.908028784308811, 3.9985531459916737, 4.485665675500636, 6.048640247836036, 2.9945785071924877, 5.004527482800839, 4.3961461296906545, 4.1121663650270035\n",
      "====================================\n",
      "Start iteration 4, value: 1.1395747451388665, best: 1.1395747451388665, dval: 0.7360463173312887\n",
      "====================================\n",
      "4.131940747801398, 3.6705891007031437, 3.9573343175301754, 2.77384157154106, 3.753174836213099, 2.365828328251484, 5.828948264277603, 1.6379406710166386, 1.7472122172661269, 1.2867540761948115, 4.705070599100468, 0.1275858349355468, 3.5701059504451615, 2.40512125425528, 0.40395843757316335, 5.88003331729964, 6.0306520390775855, 0.7683874121631451, 0.6856300370223235, 2.86704075200524, 3.9986575675573133, 4.4875265206806585, 6.048640247836036, 3.0377111073471474, 5.116748024739464, 4.3961461296906545, 4.138491340697366\n",
      "====================================\n",
      "Start iteration 5, value: 0.4118987776323157, best: 0.4118987776323157, dval: 0.4576184799187303\n",
      "Start iteration 6, value: 0.864697278652548, best: 0.4118987776323157, dval: 0.9238380686495247\n",
      "Big value increase: val: 0.864697278652548, e.val: 0.4118987776323157, max(α): 2.368987187996443\n",
      "====================================\n",
      "4.14094905728247, 3.3114748902590465, 3.9871548806178922, 2.79400326560392, 3.7131480859336627, 2.349609220133768, 5.828930963192509, 1.6333879799612183, 1.7387637667156943, 1.2891885409280268, 4.707880944899212, -0.23152837550854743, 3.571680723230362, 2.4120769521606276, 0.39187540684398836, 5.878741210970402, 6.0306520390775855, 0.7711977579618885, 0.6830259748191685, 2.8667613395773963, 3.9986321564634264, 4.494118674412274, 6.048640247836036, 3.0426523459456227, 5.108902405725321, 4.3961461296906545, 4.140086180088501\n",
      "====================================\n",
      "Start iteration 7, value: 0.2325869675116989, best: 0.2325869675116989, dval: 0.23600926994601112\n",
      "====================================\n",
      "4.289294448281001, 3.287333527423229, 3.992280407612573, 2.7786373950075425, 3.69691147373286, 2.3455164835803397, 5.828932644581633, 1.6340784871715697, 1.7388001288609856, 1.291810164974461, 4.706912391960572, -0.2556697383443648, 3.571143608144544, 2.41321203200865, 0.39049594852972647, 5.878317449584259, 6.0306520390775855, 0.7702292050232491, 0.6845786201813218, 2.8675268565680017, 3.998633753667504, 4.51621289767841, 6.048640247836036, 3.0436832016497966, 5.1090084213029465, 4.3961461296906545, 4.140701860560479\n",
      "====================================\n",
      "Start iteration 8, value: 0.21634084775154544, best: 0.21634084775154544, dval: 0.21107251581924646\n",
      "====================================\n",
      "4.3050376977715255, 3.2704667806489773, 4.011858984752483, 2.720407756638309, 3.6993369764982407, 2.3014626472154287, 5.8289379597274555, 1.6349755968285178, 1.7388383932430733, 1.298765347064827, 4.704676874968438, -0.27253648511861617, 3.570149840670294, 2.4186000371245964, 0.38922981361842696, 5.874167791396399, 6.0306520390775855, 0.7679936880311142, 0.6889000124552317, 2.868158376900637, 3.9986372605888083, 4.7032253398811505, 6.048640247836036, 3.0470001559081683, 5.10912308248133, 4.3961461296906545, 4.169535200336937\n",
      "====================================\n",
      "Start iteration 9, value: 0.17829615127350606, best: 0.17829615127350606, dval: 0.16312552238869737\n",
      "====================================\n",
      "4.2939091834279575, 3.08145221436917, 4.005713129404296, 2.459250376468001, 3.6971776487049537, 2.304196778754486, 5.829026772444303, 1.6412595453889847, 1.7399083680286487, 1.324486052894214, 4.684377609577707, -0.46155105139840613, 3.5708540017765076, 2.4287539970804346, 0.3899032711430132, 5.851932201464856, 6.0306520390775855, 0.7476944226403774, 0.7308761016985463, 2.8690936221155674, 3.9986419397693718, 4.86863259160514, 6.048640247836036, 3.0712315900749436, 5.109572830702272, 4.3961461296906545, 4.245608058714031\n",
      "====================================\n",
      "Start iteration 10, value: 0.15137742980705926, best: 0.15137742980705926, dval: 0.17861496084374825\n",
      "Start iteration 11, value: 0.2541373760223855, best: 0.15137742980705926, dval: 0.38680197130162264\n",
      "Big value increase: val: 0.2541373760223855, e.val: 0.15137742980705926, max(α): 11.161542236711997\n",
      "Start iteration 12, value: 0.44100535475887653, best: 0.15137742980705926, dval: 0.7012219379023747\n",
      "Big value increase: val: 0.44100535475887653, e.val: 0.15137742980705926, max(α): 30.616432305217792\n",
      "====================================\n",
      "4.290981993787326, 3.111297536751064, 3.998330083658135, 2.2822900497714538, 3.658727922073204, 2.345901969880474, 5.829043883372916, 1.6697729568910127, 1.7401059913959254, 1.480068661439279, 4.512510920140616, -0.4317057290165146, 3.632932162922579, 2.417646539653388, 0.3915510913563634, 5.681597136350543, 6.0306520390775855, 0.5758277332032387, 0.7759467002623553, 2.8821653447037665, 3.9986611274281585, 4.995192784437036, 6.048640247836036, 3.071493384928236, 5.1097695383561526, 4.3961461296906545, 4.24240382287256\n",
      "====================================\n",
      "Start iteration 13, value: 0.1077928569201351, best: 0.1077928569201351, dval: 0.09021064041070065\n",
      "Start iteration 14, value: 0.19352251834264642, best: 0.1077928569201351, dval: 0.20180964655838213\n",
      "Big value increase: val: 0.19352251834264642, e.val: 0.1077928569201351, max(α): 16.886167095933985\n",
      "====================================\n",
      "4.2900435861217705, 3.11060692285379, 3.9945932945949174, 2.4896060492752605, 3.6400424921373222, 2.3482015937661975, 5.829036234286188, 1.6957602777794374, 1.7403283771632279, 1.4798747498650013, 4.595554286762654, -0.4323963429137887, 3.8033730726623447, 2.40870532441665, 0.39645346172691703, 5.680994813210276, 6.0306520390775855, 0.6588710998252995, 0.7748919043622802, 2.8967979329812503, 3.9986617291214137, 5.002896258096065, 6.048640247836036, 3.0719762649244458, 5.109558098792561, 4.3961461296906545, 4.2422982598348575\n",
      "====================================\n",
      "Start iteration 15, value: 0.0969460694769822, best: 0.0969460694769822, dval: 0.0953176363924404\n",
      "====================================\n",
      "4.282725872107131, 3.117349752757821, 3.9904282863509026, 2.3789258688652586, 3.637121316453655, 2.348958896878064, 5.82903624815638, 1.7095482296045905, 1.74033541841261, 1.4821144686202092, 4.626887279392001, -0.4256535130097599, 3.7792119525691037, 2.404161573163514, 0.3999410249077586, 5.680701945261708, 6.0306520390775855, 0.690204092454655, 0.7805454060761366, 2.8910443107154045, 3.9986623018505063, 5.006735495529891, 6.048640247836036, 3.0720646435099823, 5.109658399213027, 4.3961461296906545, 4.242319361453436\n",
      "====================================\n",
      "Start iteration 16, value: 0.08935045955186205, best: 0.08935045955186205, dval: 0.07949669837507356\n",
      "Start iteration 17, value: 0.18811955164662209, best: 0.08935045955186205, dval: 0.28204045764007185\n",
      "Big value increase: val: 0.18811955164662209, e.val: 0.08935045955186205, max(α): 41.133848749619574\n",
      "====================================\n",
      "4.276848596873126, 3.1167782269978788, 3.972357902614362, 2.317698183499944, 3.5698459930494435, 2.3591339496814934, 5.829036145932936, 1.7362287781747008, 1.7403229557186415, 1.5452946406946972, 4.6189617567055175, -0.4262250387697021, 3.799841505698606, 2.3442339920929567, 0.45585415988866634, 5.679929876622122, 6.0306520390775855, 0.6822785697681697, 0.777125116822717, 2.8895079911578194, 3.9986623193638633, 5.0222846332206466, 6.048640247836036, 3.072228453978573, 5.109661533608936, 4.3961461296906545, 4.2423428146850535\n",
      "====================================\n",
      "Start iteration 18, value: 0.0788824527572258, best: 0.0788824527572258, dval: 0.09214153408009745\n",
      "====================================\n",
      "4.147511024316246, 3.116177167531309, 3.973816229031813, 2.317280444687844, 3.557768664149534, 2.35943638715747, 5.829036031583937, 1.7628605755157485, 1.7403226010498782, 1.537817594091635, 4.61999801995979, -0.4268260982362722, 3.8070340666748588, 2.3049765577884616, 0.408939293468628, 5.679537259504394, 6.0306520390775855, 0.6833148330224428, 0.7724604746667848, 2.889196916876641, 3.998662209945171, 5.0523414701186224, 6.048640247836036, 3.072233147082578, 5.109638692158403, 4.3961461296906545, 4.2424306452035285\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 19, value: 0.07347982907320766, best: 0.07347982907320766, dval: 0.09028631369283306\n",
      "====================================\n",
      "4.168580860799001, 3.111448084204181, 3.9737127582965437, 2.316843964891554, 3.5294911558020194, 2.3600885302282406, 5.829035120159986, 1.751066632722041, 1.740321788484499, 1.5254070343218722, 4.62225963108548, -0.43155518156340106, 3.832870586698605, 2.1551750102203378, 0.42189751872184034, 5.677475626239471, 6.0306520390775855, 0.6855764441481337, 0.7680370587778863, 2.889414334981731, 3.9986621976895265, 5.043450142363293, 6.048640247836036, 3.0722468696762926, 5.10919734790699, 4.3961461296906545, 4.242740513263217\n",
      "====================================\n",
      "Start iteration 20, value: 0.0729083051408551, best: 0.0729083051408551, dval: 0.09121489570749491\n",
      "Start iteration 21, value: 0.1311780532730132, best: 0.0729083051408551, dval: 0.2700375640818763\n",
      "Big value increase: val: 0.1311780532730132, e.val: 0.0729083051408551, max(α): 7.785413297070514\n",
      "====================================\n",
      "4.168425449094483, 3.075905741642974, 3.973690511961176, 2.3135850145959864, 3.3655953564504024, 2.3605728992807307, 5.829033962003104, 1.7545512557182288, 1.7403217651018184, 1.5218927331982404, 4.68404223017829, -0.4670975241246159, 3.869026088484151, 2.20124646989671, 0.41664936569896527, 5.643097796324874, 6.0306520390775855, 0.747359043240958, 0.76425294720814, 2.889749462765173, 3.99866219886681, 5.047701115742533, 6.048640247836036, 3.072254277651413, 5.108928987114646, 4.3961461296906545, 4.260223135684983\n",
      "====================================\n",
      "Start iteration 22, value: 0.05655832984612842, best: 0.05655832984612842, dval: 0.11847161292481662\n",
      "====================================\n",
      "4.168249096769722, 3.0795025363313164, 3.973688416665092, 2.309085942662356, 3.3460560928468235, 2.360467376003881, 5.829033875192243, 1.7549015652207227, 1.7403217926264496, 1.5234291204022503, 4.667761322255532, -0.4635007294362726, 3.8711312043159487, 2.2003206788177767, 0.4164175512299308, 5.626293841645672, 6.0306520390775855, 0.7310781353181968, 0.7633205488068264, 2.889170467811785, 3.9986621970423886, 5.048160503096903, 6.048640247836036, 3.072255258691527, 5.109091405998325, 4.3961461296906545, 4.282072501838557\n",
      "====================================\n",
      "Start iteration 23, value: 0.053692236865819296, best: 0.053692236865819296, dval: 0.11288308984497397\n",
      "====================================\n",
      "4.163696410382793, 3.0770084734583154, 3.973689950809446, 2.255624435343739, 3.3307709158964443, 2.3602940770160536, 5.8290333944403105, 1.7600414895312617, 1.7403219365882123, 1.555366459214317, 4.666969978431439, -0.4659947923092739, 3.882801380260727, 2.19847288765382, 0.41621802764696975, 5.286869221096977, 6.0306520390775855, 0.7302867914941036, 0.7528686562025724, 2.8850555405447507, 3.9986621869187258, 5.05924234527875, 6.048640247836036, 3.0722606504793557, 5.109306854924902, 4.3961461296906545, 4.301611202155057\n",
      "====================================\n",
      "Start iteration 24, value: 0.04024217055088852, best: 0.04024217055088852, dval: 0.07335292219150187\n",
      "====================================\n",
      "4.155484601300917, 3.0742161915529973, 3.9736916725916953, 2.240968641964798, 3.314404341330861, 2.360410532051236, 5.829032817971488, 1.7567982167260636, 1.7403218087408874, 1.609664996944427, 4.667513499034537, -0.46878707421459237, 3.895995742235781, 2.1962645632656046, 0.41639969000531774, 5.402016727997722, 6.0306520390775855, 0.7308303120972015, 0.7284943054628183, 2.837693800020771, 3.998662158529677, 5.0519253724059725, 6.048640247836036, 3.072397411967601, 5.109128074195019, 4.3961461296906545, 4.372646514116564\n",
      "====================================\n",
      "Start iteration 25, value: 0.03213267629272119, best: 0.03213267629272119, dval: 0.051914394165329655\n",
      "Start iteration 26, value: 0.07653360172574546, best: 0.03213267629272119, dval: 0.23282954694308536\n",
      "Big value increase: val: 0.07653360172574546, e.val: 0.03213267629272119, max(α): 39.24942903108229\n",
      "====================================\n",
      "4.151890887769955, 3.062561455271553, 3.9737517442266888, 2.21385658094372, 3.1194983065678445, 2.360944994124407, 5.829021748065472, 1.7562707554082015, 1.740316822968268, 1.6108282763234105, 4.67271442674519, -0.4804418104960383, 4.0217006805658295, 2.1707206834941726, 0.41800205563412546, 5.395557616280923, 6.0306520390775855, 0.7360312398078578, 0.5795448405634814, 2.816220009845349, 3.998662060019253, 5.052941485848425, 6.048640247836036, 3.073077632687675, 5.107573919502861, 4.3961461296906545, 4.345354559372722\n",
      "====================================\n",
      "Start iteration 27, value: 0.030750049004953005, best: 0.030750049004953005, dval: 0.07862759063442978\n",
      "====================================\n",
      "4.145212225333767, 3.0629976473945115, 3.973869740810471, 2.1188061439565953, 3.174194471816883, 2.3605991193563263, 5.829023719327876, 1.7618334830919107, 1.7403088465143421, 1.6118963462741682, 4.687668444778098, -0.4800056183730797, 4.001956172449251, 2.11336797553747, 0.4223787186236055, 5.386102735956519, 6.0306520390775855, 0.750985257840774, 0.6253162912067112, 2.7882201563157225, 3.9986620586599932, 5.053628576651233, 6.048640247836036, 3.0727858612624925, 5.107846001751024, 4.3961461296906545, 4.348808758084714\n",
      "====================================\n",
      "Start iteration 28, value: 0.01989354337537906, best: 0.01989354337537906, dval: 0.05887385535868003\n",
      "====================================\n",
      "4.124437862259042, 3.062688139581838, 3.973979037025836, 2.117692439589009, 3.1674878079989073, 2.3606468732228993, 5.829023875724232, 1.7677377418877054, 1.7402758258958193, 1.6142665678134849, 4.705814770064548, -0.48031512618575295, 3.9996990096599117, 2.0773810703634483, 0.4269470431328484, 5.374202842444599, 6.0306520390775855, 0.7691315831272334, 0.6339852602521068, 2.773700759362293, 3.9986620578235788, 5.058732083857368, 6.048640247836036, 3.072664097665899, 5.1079164045377485, 4.3961461296906545, 4.355685966772363\n",
      "====================================\n",
      "Start iteration 29, value: 0.017315774772770107, best: 0.017315774772770107, dval: 0.04277502230623295\n",
      "====================================\n",
      "4.069239833866292, 3.0598628691877194, 3.974273324205735, 2.1160984195598638, 3.1578572292735716, 2.3607123676271935, 5.829023784655077, 1.7674659388946432, 1.7400784068453279, 1.6521981555820062, 4.700312208352121, -0.4831403965798706, 4.000625104491624, 2.0730395106974697, 0.434712414347925, 5.338630180116184, 6.0306520390775855, 0.7636290214148033, 0.6333337291529731, 2.7624896250348745, 3.998662057296226, 5.068398329189942, 6.048640247836036, 3.072596968447313, 5.107961285931488, 4.3961461296906545, 4.396242493952305\n",
      "====================================\n",
      "Start iteration 30, value: 0.014166695376852898, best: 0.014166695376852898, dval: 0.041521774155121705\n",
      "Start iteration 31, value: 0.014917474860141887, best: 0.014166695376852898, dval: 0.061998567688100165\n",
      "====================================\n",
      "4.009793273827427, 3.0106639810681965, 3.975529882930803, 2.0842706152022195, 3.1211199443926376, 2.362869351402633, 5.829023697197988, 1.7671575601531027, 1.737879675558145, 1.656653730940763, 4.70237231055928, -0.5323392846993781, 4.001234560491836, 2.0746074770958933, 0.4702901537423847, 5.271465190987474, 6.0306520390775855, 0.7656891236219638, 0.632903672726679, 2.7710199745208044, 3.998662057257888, 5.0690281520827964, 6.048640247836036, 3.0722892269629343, 5.107946098041509, 4.3961461296906545, 4.370150542302624\n",
      "====================================\n",
      "Start iteration 32, value: 0.00971983085539344, best: 0.00971983085539344, dval: 0.05646502814544176\n",
      "Start iteration 33, value: 0.012540298754682506, best: 0.00971983085539344, dval: 0.0678507752982627\n",
      "Big value increase: val: 0.012540298754682506, e.val: 0.00971983085539344, max(α): 9.02560067716823\n",
      "====================================\n",
      "4.011308346489664, 3.0076308085734507, 3.9881730948432046, 2.0672898086896287, 3.097812032130914, 2.3663053688565086, 5.82902364678364, 1.7666928300789118, 1.7355251136928804, 1.6548898559511733, 4.702563305864089, -0.5552450994480488, 4.0012177670342375, 2.0753339856542703, 0.49303353210835377, 5.28143590199062, 6.0306520390775855, 0.7658801189267727, 0.6329175610499391, 2.7734920997125974, 3.9986620572663156, 5.068320533752155, 6.048640247836036, 3.071882771037861, 5.107945476656128, 4.3961461296906545, 4.370654415672598\n",
      "====================================\n",
      "Start iteration 34, value: 0.007796809678065535, best: 0.007796809678065535, dval: 0.04434784019579169\n",
      "====================================\n",
      "4.01183665343294, 3.008887692132488, 3.9839722813304115, 2.055446409195171, 3.096962571036602, 2.37433006476922, 5.829023640208133, 1.7666767624243314, 1.7149782649681988, 1.6522073831504358, 4.702647789514241, -0.5457534065048254, 4.001210954285148, 2.075553978805505, 0.4883297837906558, 5.282017320148707, 6.0306520390775855, 0.7659646025769246, 0.6329056276748526, 2.774855181306519, 3.9986620572718277, 5.068448679864434, 6.048640247836036, 3.0718144455049203, 5.107945243858392, 4.3961461296906545, 4.37071846997141\n",
      "====================================\n",
      "Start iteration 35, value: 0.0068752775136543005, best: 0.0068752775136543005, dval: 0.03869080479996062\n",
      "====================================\n",
      "4.012187280159384, 3.008485998299312, 3.982177786692318, 2.039703964685294, 3.091152755278791, 2.388244159851553, 5.829023616862284, 1.7666581548790956, 1.6698406666828423, 1.648745353515519, 4.702779063039423, -0.5487869051087937, 4.001210382720632, 2.076042551880584, 0.49093596010817675, 5.281575604235548, 6.0306520390775855, 0.766095876102106, 0.6328866591753821, 2.79605353016285, 3.998662057302779, 5.068596476675712, 6.048640247836036, 3.0716263263851555, 5.107944908941279, 4.3961461296906545, 4.370707427508189\n",
      "====================================\n",
      "Start iteration 36, value: 0.005864624621076581, best: 0.005864624621076581, dval: 0.023740484499944158\n",
      "====================================\n",
      "4.011887584768697, 3.0083758980045925, 3.9793478627514496, 2.0180278142611674, 3.081927010399888, 2.38864930749009, 5.829023249865421, 1.76666706545872, 1.6749732477108346, 1.6477107871436618, 4.703038039001527, -0.549618356982693, 4.001207614314022, 2.0763233483732995, 0.4954188537292864, 5.281027813759732, 6.0306520390775855, 0.7663548520642091, 0.6328499306934393, 2.80661142901218, 3.99866205730782, 5.068836548700866, 6.048640247836036, 3.0690256899875754, 5.107943492774527, 4.3961461296906545, 4.3706958065576105\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 37, value: 0.005561522571250858, best: 0.005561522571250858, dval: 0.018079447812540214\n",
      "====================================\n",
      "4.011223131388128, 3.008258826205177, 3.9805192573557844, 2.024086147132652, 3.0541700440402884, 2.3883432402164377, 5.829021713552338, 1.7667674501252704, 1.6736542847866642, 1.6454501687126466, 4.705722709761507, -0.5505024560421267, 4.0012099356906194, 2.076411327191548, 0.5005699107839526, 5.275692155995431, 6.0306520390775855, 0.7690395228241825, 0.6327348278016118, 2.8025948038574864, 3.998662057303406, 5.070897035908817, 6.048640247836036, 3.0522457717884532, 5.107940022643642, 4.3961461296906545, 4.370604767012844\n",
      "====================================\n",
      "Start iteration 38, value: 0.004946506012836673, best: 0.004946506012836673, dval: 0.02171750931303354\n",
      "====================================\n",
      "4.008318210878246, 3.0071771336540474, 3.980479942406068, 2.0330443951888446, 3.021504718437034, 2.3875183999797063, 5.828977573207109, 1.767067360380989, 1.674649113734862, 1.640062161232693, 4.71870165172137, -0.5586711471515391, 4.001228226183233, 2.0765140139188127, 0.5036492390418362, 5.249842489836829, 6.0306520390775855, 0.782018464784011, 0.6322199443676737, 2.7947656222981236, 3.9986620566914746, 5.137319940373972, 6.048640247836036, 3.058082296063227, 5.107918478096847, 4.3961461296906545, 4.369542842541915\n",
      "====================================\n",
      "Start iteration 39, value: 0.004289498953540395, best: 0.004289498953540395, dval: 0.01847519488104238\n",
      "====================================\n",
      "3.9996265164861207, 3.0070682881125226, 3.980434461086554, 2.025696336242539, 2.9820767949867015, 2.3881602797829027, 5.828929581445196, 1.7670558459854864, 1.6738701841437713, 1.644729508113793, 4.715419586161336, -0.5594931234205105, 4.001224121836574, 2.076518378057929, 0.5070559543076635, 5.20762378119923, 6.0306520390775855, 0.7787363992239859, 0.6313614502328019, 2.7803537480050937, 3.9986620549668443, 5.0996814234534575, 6.048640247836036, 3.053244530434984, 5.107879396295419, 4.3961461296906545, 4.364988907128611\n",
      "====================================\n",
      "Start iteration 40, value: 0.003258432393662375, best: 0.003258432393662375, dval: 0.01863091065211625\n",
      "Start iteration 41, value: 0.005514298080007195, best: 0.003258432393662375, dval: 0.05117169601621352\n",
      "Big value increase: val: 0.005514298080007195, e.val: 0.003258432393662375, max(α): 7.444643791167018\n",
      "Start iteration 42, value: 0.0034906415214750737, best: 0.003258432393662375, dval: 0.029750735710548593\n",
      "====================================\n",
      "3.9771895633768732, 3.006864747505, 3.9804451103040055, 2.028021019312086, 2.985060487976628, 2.3883031820041953, 5.828525604483224, 1.7670601740136593, 1.6707013670423139, 1.6528838362819191, 4.715420818137335, -0.5610302148512826, 4.001229807014215, 2.0765285895061747, 0.5215463084118994, 5.240339357092801, 6.0306520390775855, 0.7787376311999843, 0.5979723354766353, 2.748934794407333, 3.9986618275215733, 5.102735835983649, 6.048640247836036, 3.020651304790505, 5.107421910964124, 4.3961461296906545, 4.3646240009095845\n",
      "====================================\n",
      "Start iteration 43, value: 0.0029050964005315548, best: 0.0029050964005315548, dval: 0.02012403267391366\n",
      "Start iteration 44, value: 0.0335739230520744, best: 0.0029050964005315548, dval: 0.177539340534147\n",
      "Big value increase: val: 0.0335739230520744, e.val: 0.0029050964005315548, max(α): 403.48940916963136\n",
      "====================================\n",
      "3.9776235766474777, 3.006851717350455, 3.9804359591976928, 2.0270020054904747, 2.98192639555246, 2.3883156869012767, 5.828502985555258, 1.7670708950947152, 1.6718307948315407, 1.6511638481462245, 4.7154217441611195, -0.5611091921624446, 4.001229882957499, 2.0765288605220635, 0.5264456252542585, 5.23468995499835, 6.0306520390775855, 0.7787385572237687, 0.5961745654162272, 2.8014457385554095, 3.9986620998948395, 5.102499410633227, 6.048640247836036, 3.021663435539278, 5.107420561991765, 4.3961461296906545, 4.364639046905692\n",
      "====================================\n",
      "Start iteration 45, value: 0.002444677635093803, best: 0.002444677635093803, dval: 0.013426916495912072\n",
      "====================================\n",
      "3.977295584087977, 3.0068490921205915, 3.980452292718377, 2.017177058313879, 2.9821284588571073, 2.3883176312144934, 5.828493166299715, 1.767072334398159, 1.6701421420184763, 1.6494309967994782, 4.715422417408265, -0.5611251039918165, 4.001229884457728, 2.0765316956716156, 0.526497333686732, 5.231369456423752, 6.0306520390775855, 0.7787392304709143, 0.5946517655194393, 2.789673748086255, 3.9986620795667656, 5.1025016674062, 6.048640247836036, 3.019514778970459, 5.1074192872622275, 4.3961461296906545, 4.364612443000039\n",
      "====================================\n",
      "Start iteration 46, value: 0.0022846467049631304, best: 0.0022846467049631304, dval: 0.014069518717013313\n",
      "====================================\n",
      "3.976510097065571, 3.0068436110319077, 3.9804617964501596, 2.013675610840101, 2.9819713559768473, 2.3883212888665932, 5.82846269596881, 1.767076218069387, 1.664201879021916, 1.6501128382639958, 4.715449790405868, -0.5611583255200021, 4.0012298860128155, 2.076600996733978, 0.5265970758145152, 5.217335848664131, 6.0306520390775855, 0.7787666034685358, 0.5847944449232728, 2.78992246735652, 3.998662071131866, 5.10250465308421, 6.048640247836036, 3.0184858424935053, 5.107411378168356, 4.3961461296906545, 4.3645672239442925\n",
      "====================================\n",
      "Start iteration 47, value: 0.0020691006632171335, best: 0.0020691006632171335, dval: 0.011775480765469928\n",
      "====================================\n",
      "3.9744114772424717, 3.0061794853469648, 3.9804819737399986, 2.0059912721367867, 2.981582066159411, 2.3883975266939457, 5.8283062893168385, 1.7670779064940547, 1.641037733623067, 1.6509562002263525, 4.715639567842923, -0.5651836700152065, 4.001229890125507, 2.076846130276777, 0.5268113666403782, 5.211192399734023, 6.0306520390775855, 0.7789563809057135, 0.5615354271984738, 2.7902042384823558, 3.9986620615518436, 5.102511287772283, 6.048640247836036, 3.016559704325823, 5.107364198786258, 4.3961461296906545, 4.363956238392559\n",
      "====================================\n",
      "Start iteration 48, value: 0.0018537704701238015, best: 0.0018537704701238015, dval: 0.013137199263088886\n",
      "====================================\n",
      "3.9715857753955337, 3.00637673519913, 3.980475167137854, 1.990894983883773, 2.9805743698684797, 2.3883885843914614, 5.828194255866231, 1.7670798423633152, 1.6459893658162867, 1.652536586710737, 4.716267924722085, -0.5639881152812228, 4.001229887931594, 2.076923282225958, 0.5271846808247752, 5.199361831513204, 6.0306520390775855, 0.779584737785282, 0.5633170105871095, 2.7905755078481316, 3.998662068716508, 5.102522111586557, 6.048640247836036, 3.012866268827495, 5.10734240809524, 4.3961461296906545, 4.3617173496455965\n",
      "====================================\n",
      "Start iteration 49, value: 0.0018042437042053447, best: 0.0018042437042053447, dval: 0.011785384161973708\n",
      "Start iteration 50, value: 0.0019223118249950333, best: 0.0018042437042053447, dval: 0.019869826065908563\n",
      "====================================\n",
      "3.9693038476296056, 3.006222476273614, 3.9804767205600466, 2.0022662521914425, 2.976817567603737, 2.388410043193598, 5.827678101008539, 1.7670817657857507, 1.640201954684554, 1.6759453807287361, 4.720850488644772, -0.5649230969130749, 4.001229893967646, 2.0782308320383343, 0.530198362741989, 5.201505029801162, 6.0306520390775855, 0.7841673017109364, 0.5585331755408605, 2.793280483022974, 3.9986622615826803, 5.102874892245546, 6.048640247836036, 3.0051359031851055, 5.107236389994001, 4.3961461296906545, 4.358842280423152\n",
      "====================================\n",
      "Start iteration 51, value: 0.0015678382096835238, best: 0.0015678382096835238, dval: 0.012918354479896976\n",
      "====================================\n",
      "3.969123490222401, 3.00624450267912, 3.980474592015285, 2.0021074753838977, 2.9754030212431246, 2.3884217984404534, 5.827467460441941, 1.767083186741023, 1.638698165647079, 1.675438623946886, 4.7221487380278315, -0.564874163551947, 4.001229897504958, 2.0792923753665797, 0.5308023441515545, 5.19833759559177, 6.0306520390775855, 0.7854655510948366, 0.5536683041492655, 2.7995240279764206, 3.99866238978334, 5.107842076121673, 6.048640247836036, 2.995493840883496, 5.107141412471308, 4.3961461296906545, 4.3565399391994974\n",
      "====================================\n",
      "Start iteration 52, value: 0.0014135768896421444, best: 0.0014135768896421444, dval: 0.012294240046748811\n",
      "====================================\n",
      "3.968532683047413, 3.0063286054232674, 3.9804636895961716, 2.0019026126504342, 2.9376780404565856, 2.3884622824377915, 5.823318116104114, 1.7670875034228128, 1.6343768785539543, 1.6731574936334046, 4.722660482954164, -0.5646873228098136, 4.001229917417065, 2.085148868439074, 0.5699703405837533, 5.191092032072371, 6.0306520390775855, 0.785977296021501, 0.520188517510055, 2.823194034842778, 3.998662843157367, 5.113207595090207, 6.048640247836036, 2.97243127054484, 5.106416547717163, 4.3961461296906545, 4.327360024865335\n",
      "====================================\n",
      "Start iteration 53, value: 0.0011820614593004986, best: 0.0011820614593004986, dval: 0.017014608428931294\n",
      "====================================\n",
      "3.9678354995795635, 3.0067355550843464, 3.9804720136545226, 2.0016852227252255, 2.965100954547007, 2.3884705874449113, 5.8210989049409605, 1.7670916161212378, 1.6281516346002096, 1.667360782892526, 4.723247871457125, -0.5637832527053529, 4.001229912205964, 2.0927612495092762, 0.5578282535118699, 5.180423844119236, 6.0306520390775855, 0.7865646845248426, 0.5074648103686633, 2.8076835133512197, 3.9986624371490405, 5.123058141614471, 6.048640247836036, 2.9408563380694694, 5.105944426849918, 4.3961461296906545, 4.349809779702324\n",
      "====================================\n",
      "Start iteration 54, value: 0.0007233072879097593, best: 0.0007233072879097593, dval: 0.008883293757095984\n",
      "Start iteration 55, value: 0.009579917501388627, best: 0.0007233072879097593, dval: 0.09476179054137718\n",
      "Big value increase: val: 0.009579917501388627, e.val: 0.0007233072879097593, max(α): 39.04738885496392\n",
      "Start iteration 56, value: 0.0012843067913138248, best: 0.0007233072879097593, dval: 0.025443669372505823\n",
      "Big value increase: val: 0.0012843067913138248, e.val: 0.0007233072879097593, max(α): 16.610423480494813\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "3.9678394877459366, 3.008019993907542, 3.9804684389379776, 2.001068178421993, 2.9615836191922624, 2.3884804014485312, 5.806329907907157, 1.767092301898424, 1.6132626659762455, 1.670658819693137, 4.723508896045178, -0.5609297726508883, 4.001229896067156, 2.100078867562427, 0.5751182853760826, 5.181021491768665, 6.0306520390775855, 0.7868257091130649, 0.5041241615264542, 2.8104706903888736, 3.998662608644569, 5.120341680007646, 6.048640247836036, 2.941889179497071, 5.106354307338621, 4.3961461296906545, 4.34466172393099\n",
      "====================================\n",
      "Start iteration 57, value: 0.00047873749615280403, best: 0.00047873749615280403, dval: 0.00778024662378049\n",
      "====================================\n",
      "3.9678360022895793, 3.008258586912948, 3.980468196697536, 2.0009628594618483, 2.961479348684175, 2.3884813041689945, 5.807127393163816, 1.7670924050145072, 1.6131613080380038, 1.6707009308171665, 4.723628155458722, -0.5603997198607, 4.001229889925649, 2.1109693446001097, 0.5762550446235106, 5.180886175715869, 6.0306520390775855, 0.7869449685266856, 0.5039717931831176, 2.8109277591824653, 3.998662613875767, 5.1203671288000345, 6.048640247836036, 2.9418361281897143, 5.106430526302445, 4.3961461296906545, 4.344448675161563\n",
      "====================================\n",
      "Start iteration 58, value: 0.00045088676278809127, best: 0.00045088676278809127, dval: 0.007731191275247282\n",
      "Start iteration 59, value: 0.0032491770986986536, best: 0.00045088676278809127, dval: 0.053002797240075686\n",
      "Big value increase: val: 0.0032491770986986536, e.val: 0.00045088676278809127, max(α): 10.805198740546652\n",
      "====================================\n",
      "3.967753066946151, 3.0130452446543248, 3.980468128117733, 2.000883499028468, 2.960753902362391, 2.388481852773288, 5.807185561759945, 1.7670925904779422, 1.6127105160227624, 1.6708590402019956, 4.723920139281104, -0.5497657899717316, 4.001229862744049, 2.1105900167094753, 0.5773773495127333, 5.18062215585842, 6.0306520390775855, 0.7872369523492548, 0.5039737191210196, 2.811205000334033, 3.998662616449795, 5.121491178261034, 6.048640247836036, 2.9418088567514706, 5.106492549300021, 4.3961461296906545, 4.34419937683271\n",
      "====================================\n",
      "Start iteration 60, value: 0.0003769211279241296, best: 0.0003769211279241296, dval: 0.003987573218793186\n",
      "====================================\n",
      "3.9606918905620847, 3.0131195825657473, 3.9804681606840493, 2.000857962436188, 2.960317213730175, 2.388482010231577, 5.8069527717341245, 1.7670926573431482, 1.6126766390626137, 1.6709692576258237, 4.723971047648319, -0.5496006425597232, 4.0012298548477565, 2.110601727954076, 0.5778476629552435, 5.180615937744566, 6.0306520390775855, 0.7872878607165028, 0.503964877672085, 2.811310707179862, 3.9986626171661666, 5.121950648584418, 6.048640247836036, 2.9417959563700893, 5.1064914618376855, 4.3961461296906545, 4.344129659834409\n",
      "====================================\n",
      "Start iteration 61, value: 0.00035931715136464884, best: 0.00035931715136464884, dval: 0.004516230516464756\n",
      "====================================\n",
      "3.9606983245338, 3.0131330617266356, 3.9804685870686525, 2.000728958997571, 2.9593223169542897, 2.3884906106881103, 5.804300493396586, 1.7670926727907414, 1.6118335431837096, 1.6711148964532516, 4.725507550106317, -0.5495706975626938, 4.001229814779355, 2.110614543143848, 0.5895271094378706, 5.180621925828112, 6.0306520390775855, 0.788824363175493, 0.503944407511627, 2.811459492173885, 3.9986626184546097, 5.122319849491544, 6.048640247836036, 2.9409015935267613, 5.106490260851823, 4.3961461296906545, 4.3439971730302265\n",
      "====================================\n",
      "Start iteration 62, value: 0.00031424349062020795, best: 0.00031424349062020795, dval: 0.004646618844131464\n",
      "Start iteration 63, value: 0.0007484417235343912, best: 0.00031424349062020795, dval: 0.015677250328311645\n",
      "Big value increase: val: 0.0007484417235343912, e.val: 0.00031424349062020795, max(α): 7.630259500134026\n",
      "====================================\n",
      "3.9606981984068366, 3.0131693354161375, 3.9804804164111856, 1.9987118885757231, 2.951216309172238, 2.388544772743972, 5.798352674368598, 1.7670926699740277, 1.602251284320928, 1.6710810222410537, 4.729556321971642, -0.5494901127597249, 4.001229379581439, 2.110619093719209, 0.5892539409092931, 5.1806224028415215, 6.0306520390775855, 0.7928731350434322, 0.5039294383743594, 2.8114781935539037, 3.9986626186461973, 5.124598825881436, 6.048640247836036, 2.9406387964673346, 5.106489742669988, 4.3961461296906545, 4.343022649467202\n",
      "====================================\n",
      "Start iteration 64, value: 0.00023622728173890742, best: 0.00023622728173890742, dval: 0.0038524925798355536\n",
      "====================================\n",
      "3.9606980501666085, 3.0131830245849853, 3.980478949576214, 1.9965246737191256, 2.9524289409466524, 2.3885461752115296, 5.796838829875074, 1.7670926928392692, 1.602655943611808, 1.671089981758149, 4.73029227352364, -0.5494597012137932, 4.00122886273722, 2.110619922591831, 0.5899970328071427, 5.180616681888022, 6.0306520390775855, 0.7936090865959056, 0.5039241284058843, 2.8114780201638445, 3.9986626187776086, 5.125981030519051, 6.048640247836036, 2.9406121252024024, 5.106490221023809, 4.3961461296906545, 4.3423306136186035\n",
      "====================================\n",
      "Start iteration 65, value: 0.0002203487142457655, best: 0.0002203487142457655, dval: 0.003796697923117265\n",
      "Start iteration 66, value: 0.017413061312310785, best: 0.0002203487142457655, dval: 0.13261616669314666\n",
      "Big value increase: val: 0.017413061312310785, e.val: 0.0002203487142457655, max(α): 108.76634260223618\n",
      "Start iteration 67, value: 0.003985568085738069, best: 0.0002203487142457655, dval: 0.059910802233149346\n",
      "Big value increase: val: 0.003985568085738069, e.val: 0.0002203487142457655, max(α): 37.54535857150102\n",
      "Start iteration 68, value: 0.8126267801429836, best: 0.0002203487142457655, dval: 1.248707941524442\n",
      "Big value increase: val: 0.8126267801429836, e.val: 0.0002203487142457655, max(α): 36.38355417706647\n",
      "Start iteration 69, value: 0.001956575343660331, best: 0.0002203487142457655, dval: 0.039266868792276144\n",
      "Big value increase: val: 0.001956575343660331, e.val: 0.0002203487142457655, max(α): 1.2045567497373426\n",
      "Start iteration 70, value: 0.001560120613036059, best: 0.0002203487142457655, dval: 0.030569811003830993\n",
      "Big value increase: val: 0.001560120613036059, e.val: 0.0002203487142457655, max(α): 1.18926828310749\n",
      "Start iteration 71, value: 0.0010666234182800736, best: 0.0002203487142457655, dval: 0.018884132179645075\n",
      "Big value increase: val: 0.0010666234182800736, e.val: 0.0002203487142457655, max(α): 1.6773674227662134\n",
      "Start iteration 72, value: 0.0006033411199087163, best: 0.0002203487142457655, dval: 0.014070690618810944\n",
      "Big value increase: val: 0.0006033411199087163, e.val: 0.0002203487142457655, max(α): 1.684960018046894\n",
      "Start iteration 73, value: 0.00029458479912016855, best: 0.0002203487142457655, dval: 0.007776813059872309\n",
      "Big value increase: val: 0.00029458479912016855, e.val: 0.0002203487142457655, max(α): 2.3415978638222334\n",
      "====================================\n",
      "3.9606980279760853, 3.013014406557877, 3.9829953678905006, 1.972913652263537, 2.953779051480404, 2.3885243879145337, 5.716295140692083, 1.7670924373424417, 1.5931879850408521, 1.6710891276917301, 4.730639119054384, -0.5498342991848855, 3.9481247892919766, 2.1106228972357814, 0.6225110266730657, 5.179489552892424, 6.0306520390775855, 0.7939559321268916, 0.5036208506952095, 2.811473149920419, 3.998662509109224, 5.131512496238152, 6.048640247836036, 2.9219244513416833, 5.106489428043418, 4.3961461296906545, 4.32648538384048\n",
      "====================================\n",
      "Start iteration 74, value: 0.00014751406378261367, best: 0.00014751406378261367, dval: 0.006142788340714633\n",
      "Start iteration 75, value: 0.00016042254976211213, best: 0.00014751406378261367, dval: 0.008661640385179371\n",
      "====================================\n",
      "3.9606977750093257, 3.0130021932937088, 3.981889463203013, 1.9724323181341505, 2.9546713452489124, 2.3885256597824354, 5.7351958240357, 1.7670929304358705, 1.5814661468749942, 1.6710893144357548, 4.73079097792569, -0.5498614318945736, 3.9586052078180085, 2.1106228991577027, 0.6189640567663555, 5.160168105794864, 6.0306520390775855, 0.7941077909985431, 0.5036212720717486, 2.8114721677807912, 3.998662503469311, 5.131542355146192, 6.048640247836036, 2.92758977523578, 5.1065024559391405, 4.3961461296906545, 4.322808760989404\n",
      "====================================\n",
      "Start iteration 76, value: 8.917792126471082e-5, best: 8.917792126471082e-5, dval: 0.004988679271365162\n",
      "====================================\n",
      "3.960697757547338, 3.012964661422287, 3.9819141886958747, 1.9724819490172858, 2.954446149421297, 2.3885258175087767, 5.734016151772699, 1.7670928712989968, 1.5808423983747413, 1.6710897887753364, 4.731710841824216, -0.5498743818702796, 3.958863433515412, 2.110622902905962, 0.6160584808370511, 5.1660143695521885, 6.0306520390775855, 0.7950276548991692, 0.5036204211632809, 2.8114730612970473, 3.9986625061078183, 5.131627135761557, 6.048640247836036, 2.934584261054772, 5.106503669989011, 4.3961461296906545, 4.324265433945026\n",
      "====================================\n",
      "Start iteration 77, value: 5.904040730567939e-5, best: 5.904040730567939e-5, dval: 0.0029250018015874557\n",
      "====================================\n",
      "3.9606977353465256, 3.0129536461867192, 3.981948501201281, 1.9724475699848611, 2.95447252374675, 2.3885257065507233, 5.734994935262528, 1.7670928936985615, 1.5812068121283653, 1.6710918745727679, 4.734200854561555, -0.549878182560935, 3.959134888725976, 2.1106229060390946, 0.6165783782718852, 5.168354386476487, 6.0306520390775855, 0.797517667642191, 0.503621067329585, 2.8114729900585056, 3.998662506506111, 5.132754159460858, 6.048640247836036, 2.9319978028651734, 5.106505601608949, 4.3961461296906545, 4.325362604491255\n",
      "====================================\n",
      "Start iteration 78, value: 4.0503014358634095e-5, best: 4.0503014358634095e-5, dval: 0.002234838849100751\n",
      "====================================\n",
      "3.960697597771935, 3.0129492066303953, 3.981916545530768, 1.972400544829054, 2.954924611896863, 2.388525735434183, 5.736340402665199, 1.7670929874435513, 1.5824417519775953, 1.6711051517329414, 4.735400378438659, -0.5498797143829401, 3.960182441651919, 2.110622987218846, 0.6194373761616981, 5.168669480980833, 6.0306520390775855, 0.7987171915220326, 0.5036216525467702, 2.8114730361957694, 3.998662507112682, 5.136343574516818, 6.048640247836036, 2.932032780290537, 5.106511975434471, 4.3961461296906545, 4.326441094282785\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 79, value: 3.2515396228630875e-5, best: 3.2515396228630875e-5, dval: 0.0029027590402181253\n",
      "Start iteration 80, value: 0.006771442940113544, best: 3.2515396228630875e-5, dval: 0.07934095048690826\n",
      "Big value increase: val: 0.006771442940113544, e.val: 3.2515396228630875e-5, max(α): 125.9590035546791\n",
      "Start iteration 81, value: 4.402573810760034e-5, best: 3.2515396228630875e-5, dval: 0.004225987093212785\n",
      "Big value increase: val: 4.402573810760034e-5, e.val: 3.2515396228630875e-5, max(α): 2.965893313823727\n",
      "Start iteration 82, value: 3.381997762394252e-5, best: 3.2515396228630875e-5, dval: 0.0028969979274080515\n",
      "====================================\n",
      "3.9606975857450633, 3.0129485612876366, 3.9811542229946757, 1.9648242371631264, 2.9543550849313176, 2.3885258207754028, 5.739070222837574, 1.7670929911534907, 1.5824623191270688, 1.6712137534764069, 4.736229148255265, -0.5498799366678354, 3.9660974373670723, 2.110623257120409, 0.6178725629460889, 5.170325617305403, 6.0306520390775855, 0.7995459613405301, 0.5036219612491002, 2.8114730043045655, 3.9986625075928135, 5.136464974348046, 6.048640247836036, 2.9320602627773793, 5.106525476309086, 4.3961461296906545, 4.326449054809681\n",
      "====================================\n",
      "Start iteration 83, value: 3.093076075779017e-5, best: 3.093076075779017e-5, dval: 0.0027756569066526293\n",
      "====================================\n",
      "3.9606975788820837, 3.012948341560362, 3.9809981607036833, 1.966029970183371, 2.9543571638125337, 2.3885258259839577, 5.739050539185101, 1.7670929938161286, 1.582472267276404, 1.6712175934906013, 4.7352527971527145, -0.549879946158575, 3.968793139413831, 2.110623686219988, 0.6170119359411085, 5.17031094416008, 6.0306520390775855, 0.7985696102357513, 0.5036219172563527, 2.811473031394124, 3.9986625076123867, 5.136598947103737, 6.048640247836036, 2.9324138665285804, 5.10652548239496, 4.3961461296906545, 4.326448747999022\n",
      "====================================\n",
      "Start iteration 84, value: 2.6232080233429217e-5, best: 2.6232080233429217e-5, dval: 0.0027537929057450117\n",
      "Start iteration 85, value: 0.0001928375971125737, best: 2.6232080233429217e-5, dval: 0.012824691618805173\n",
      "Big value increase: val: 0.0001928375971125737, e.val: 2.6232080233429217e-5, max(α): 14.917333388080673\n",
      "====================================\n",
      "3.9606844103785814, 3.0129483431670554, 3.9766363310115627, 1.9695783568704135, 2.9544013078122577, 2.388525836624109, 5.739086347080036, 1.7670929949380325, 1.5824738292070033, 1.6713886885804228, 4.735628694030037, -0.5498799460891767, 3.968667530065786, 2.1107398246777316, 0.6170232804451775, 5.1703104590681335, 6.0306520390775855, 0.7989455071139314, 0.5036219172366071, 2.811473032781399, 3.998662507619386, 5.1373234334101525, 6.048640247836036, 2.9324675971709655, 5.1065254845462515, 4.3961461296906545, 4.326448664577097\n",
      "====================================\n",
      "Start iteration 86, value: 1.7890561594210293e-5, best: 1.7890561594210293e-5, dval: 0.002821135036524536\n",
      "====================================\n",
      "3.960624653322613, 3.0129483418708722, 3.9764254309668465, 1.9692202274426536, 2.9544048851220315, 2.3885258411316586, 5.739151308307031, 1.7670929944105644, 1.5824712527561884, 1.6727484353722348, 4.735649316802631, -0.5498799461451631, 3.968539589826877, 2.110757549913548, 0.6170210753835115, 5.1703138298317635, 6.0306520390775855, 0.7989661298865725, 0.5036219182508284, 2.811473027393976, 3.9986625076175035, 5.137337325992791, 6.048640247836036, 2.932424569737717, 5.106525486046819, 4.3961461296906545, 4.326448652684522\n",
      "====================================\n",
      "Start iteration 87, value: 1.4188894307290217e-5, best: 1.4188894307290217e-5, dval: 0.002129059786745102\n",
      "====================================\n",
      "3.957278054902394, 3.0129483391134877, 3.9763524711410487, 1.9692932867150186, 2.9545279262842636, 2.3885273580764057, 5.739310510218983, 1.767092991548495, 1.5824438357334487, 1.676931480807721, 4.735779024528707, -0.5498799462642636, 3.9684794717508063, 2.11123801096847, 0.6170187589377443, 5.170327015261288, 6.0306520390775855, 0.7990958376129467, 0.5036219206239677, 2.811472793973189, 3.998662507613585, 5.137368831571993, 6.048640247836036, 2.932204507794489, 5.1065254889671055, 4.3961461296906545, 4.326448659928483\n",
      "====================================\n",
      "Start iteration 88, value: 6.445450137334128e-6, best: 6.445450137334128e-6, dval: 0.0011945793236067814\n",
      "Start iteration 89, value: 1.3422974035693068e-5, best: 6.445450137334128e-6, dval: 0.0026056923589486275\n",
      "Big value increase: val: 1.3422974035693068e-5, e.val: 6.445450137334128e-6, max(α): 5.715356393590762\n",
      "====================================\n",
      "3.9572953415982974, 3.0129483284608995, 3.9751768859162153, 1.9692931958380286, 2.9544659448152433, 2.388586993628311, 5.73933294395297, 1.7670929826122885, 1.5805277752517182, 1.6771818706725385, 4.735988494453368, -0.5498799467243839, 3.9687603217853558, 2.113384153979444, 0.617017582591651, 5.17054647155364, 6.0306520390775855, 0.7993053075380875, 0.5036219306191944, 2.8114727525547574, 3.9986625075853284, 5.137312893665628, 6.048640247836036, 2.93134408221474, 5.106525472909406, 4.3961461296906545, 4.3264487278125054\n",
      "====================================\n",
      "Start iteration 90, value: 3.3307740816846184e-6, best: 3.3307740816846184e-6, dval: 0.0007102988727655246\n",
      "Start iteration 91, value: 3.228434778812805e-5, best: 3.3307740816846184e-6, dval: 0.005308607118974601\n",
      "Big value increase: val: 3.228434778812805e-5, e.val: 3.3307740816846184e-6, max(α): 85.04122500130526\n",
      "Start iteration 92, value: 4.87433953698895e-6, best: 3.3307740816846184e-6, dval: 0.001514336748126871\n",
      "Big value increase: val: 4.87433953698895e-6, e.val: 3.3307740816846184e-6, max(α): 2.7900039609741616\n",
      "====================================\n",
      "3.9572953415402305, 3.0129483214671016, 3.973551365057394, 1.9692983463780873, 2.9544632146352727, 2.388591887494549, 5.739342139115505, 1.7670929620172537, 1.5800457635379876, 1.6772649857862796, 4.73604301037504, -0.5498799470264691, 3.9717307559549524, 2.1134154567656607, 0.6170167830085601, 5.170546216204812, 6.0306520390775855, 0.7993598234598847, 0.5036219513055649, 2.811472734337995, 3.998662507551211, 5.137320433259784, 6.048640247836036, 2.9308779422743227, 5.106525326603321, 4.3961461296906545, 4.326448907539353\n",
      "====================================\n",
      "Start iteration 93, value: 2.613127112234141e-6, best: 2.613127112234141e-6, dval: 0.0008997901837877187\n",
      "====================================\n",
      "3.9572953414806595, 3.012948321744968, 3.973755095289189, 1.9692977157480065, 2.954461882837856, 2.388592139527588, 5.739348291196623, 1.7670929619997582, 1.5800381801578964, 1.6773791354488983, 4.736051790091112, -0.5498799470144672, 3.9708671258119006, 2.1134143557045717, 0.6170162423030338, 5.1705463575304185, 6.0306520390775855, 0.7993686031759761, 0.5036219964588635, 2.8114727317319788, 3.998662507550535, 5.137321968912985, 6.048640247836036, 2.9306401164358356, 5.10652534944018, 4.3961461296906545, 4.3264488945975925\n",
      "====================================\n",
      "Start iteration 94, value: 2.1899125159107796e-6, best: 2.1899125159107796e-6, dval: 0.0005478442055680821\n",
      "====================================\n",
      "3.9572953413219096, 3.012948321806421, 3.9739370218712917, 1.969297668387783, 2.954454054523456, 2.3885930656209116, 5.739357867615168, 1.7670929616488351, 1.5800233532555141, 1.6775015386002536, 4.73610106323803, -0.5498799470118129, 3.9707541715625903, 2.11341529236164, 0.6170117464089501, 5.170546604060441, 6.0306520390775855, 0.799417876323001, 0.5036220974117508, 2.8114727227311618, 3.998662507535279, 5.137336765461134, 6.048640247836036, 2.9300852536417104, 5.106525354183182, 4.3961461296906545, 4.326448899471647\n",
      "====================================\n",
      "Start iteration 95, value: 1.9726257657569495e-6, best: 1.9726257657569495e-6, dval: 0.0004583357652808706\n",
      "====================================\n",
      "3.957295331436333, 3.0129483221269173, 3.9738077499567437, 1.9692977088963637, 2.9544285844184768, 2.388594424091148, 5.7393756537863805, 1.767092960324002, 1.580022198661445, 1.6776584903947729, 4.736215879041627, -0.5498799469979697, 3.970800009198945, 2.113416846592701, 0.6169851324056775, 5.170546785047601, 6.0306520390775855, 0.7995326921268485, 0.5036222315409469, 2.8114727044689047, 3.998662507502435, 5.1374813186054915, 6.048640247836036, 2.929731126498374, 5.106525355823958, 4.3961461296906545, 4.326448916943371\n",
      "====================================\n",
      "Start iteration 96, value: 1.8311006312138553e-6, best: 1.8311006312138553e-6, dval: 0.0004941238746909993\n",
      "====================================\n",
      "3.95729522589785, 3.012948322765246, 3.973259192298018, 1.9692978357402662, 2.954135008448412, 2.388599220239372, 5.739420515553895, 1.7670929439723613, 1.5800205490519283, 1.6778029922624376, 4.736272328279796, -0.5498799469703985, 3.970880875146159, 2.113449395667943, 0.6166176747602524, 5.170549637737686, 6.0306520390775855, 0.7995891413651406, 0.5036224347288775, 2.8114724830618707, 3.998662507008678, 5.13769322281204, 6.048640247836036, 2.929559942912292, 5.10652535484738, 4.3961461296906545, 4.326448994992542\n",
      "====================================\n",
      "Start iteration 97, value: 1.50542228971658e-6, best: 1.50542228971658e-6, dval: 0.0004031906383021866\n",
      "====================================\n",
      "3.957294988944372, 3.0129483223151543, 3.973301666243325, 1.9692992426087657, 2.953977444205251, 2.388602914261231, 5.740059472327921, 1.767092333902697, 1.580018388548331, 1.6787193970544199, 4.736255559567486, -0.5498799469898392, 3.971057578529549, 2.1134479137833346, 0.6158358245912384, 5.17056096554643, 6.0306520390775855, 0.7995723726527935, 0.5036233939891045, 2.8114718600378112, 3.9986625056403073, 5.1377635165725675, 6.048640247836036, 2.9293107668799054, 5.1065253532696255, 4.3961461296906545, 4.326449391421846\n",
      "====================================\n",
      "Start iteration 98, value: 1.2557614263313258e-6, best: 1.2557614263313258e-6, dval: 0.0004376898559936282\n",
      "Start iteration 99, value: 1.8247954532267342e-6, best: 1.2557614263313258e-6, dval: 0.0008666871275222615\n",
      "Big value increase: val: 1.8247954532267342e-6, e.val: 1.2557614263313258e-6, max(α): 7.929692866157736\n",
      "====================================\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "3.957292300325639, 3.012948321358461, 3.9731752445783863, 1.9693069318609349, 2.953948144033134, 2.3886203241289965, 5.740030478949285, 1.7670921483368784, 1.5800183998430086, 1.67839920048366, 4.736206093919485, -0.5498799470311614, 3.9714572041825686, 2.113444382917182, 0.6154306093278522, 5.170548347112328, 6.0306520390775855, 0.7995229070046829, 0.5036233935902746, 2.8114694639207114, 3.998662425127379, 5.137689807790708, 6.048640247836036, 2.929185573918329, 5.106525352102298, 4.3961461296906545, 4.326450097444419\n",
      "====================================\n",
      "Start iteration 100, value: 9.755778993259065e-7, best: 9.755778993259065e-7, dval: 0.00029299229509990865\n",
      "====================================\n",
      "3.9572764819112427, 3.012948321204649, 3.9730526727175737, 1.9693468698323748, 2.9539403546498355, 2.3886222813849494, 5.740085044700873, 1.7670921054608462, 1.5800184017338357, 1.678362844836192, 4.736196745462032, -0.549879947037805, 3.971812374633678, 2.113443285104604, 0.6154157258925214, 5.170528535471352, 6.0306520390775855, 0.7995135585472093, 0.503623404997783, 2.811466672985968, 3.998662394366006, 5.137689609526961, 6.048640247836036, 2.929158261214241, 5.106525351894597, 4.3961461296906545, 4.326450230711219\n",
      "====================================\n",
      "Find solution in iteration 100, value: 8.839052720404082e-7\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(8.839052720404082e-7, Number[3.9572764819112427, 3.012948321204649, 3.9730526727175737, 1.9693468698323748, 2.9539403546498355, 2.3886222813849494, 5.740085044700873, 1.7670921054608462, 1.5800184017338357, 1.678362844836192  …  0.7995135585472093, 0.503623404997783, 2.811466672985968, 3.998662394366006, 5.137689609526961, 6.048640247836036, 2.929158261214241, 5.106525351894597, 4.3961461296906545, 4.326450230711219], 100)"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# The parameters from previous step\n",
    "step3_params = step3_start_params\n",
    "# The parameter wich I found on real deviece\n",
    "#step3_params = [5.189896155542379, 4.707110397329062, 4.325905810068413, -0.8159924212917966, 3.110011220351916, 4.667709359716189, 1.0215152198560669, 5.116208100394577, 4.395063842373562, 4.370201901371649, 4.9135180721869425, 4.949975295863072, 4.637313944153916, 4.042830477313872, -0.6901894825683017, 1.1827639351923742, 3.0974447481049743, 4.022975117724089, 0.705887140029585, 3.514630564645274, 1.755049621148228, 4.151136862582433, 5.722357530716369, 0.8667811089902828, 0.3630963695624429, 0.1785816271535451, 3.4571312587872733]\n",
    "\n",
    "step4_check_qc, _, _, _ = generate_circuit(trotter_steps, 2, t, params, params2, params3, init=false)\n",
    "\n",
    "step4_start_params, step4_qc = generate_step_ansact(step3_params)\n",
    "step4_of = create_op(useExecutePlace, step4_qc)\n",
    "\n",
    "val, xparams, itr = gradientDescent(step4_of, step4_start_params, α=0.01, maxItr=200,\n",
    "                              argsArePeriodic=true, isExpectedZero=true, ϵ=1e-6, debug=true, useBigValInc=true)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "id": "3a4b3450",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.0005320614433431119"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "check_err_of_ansact(step4_start_params, step4_check_qc)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "28e54848",
   "metadata": {},
   "source": [
    "The parameter for step 4 was found on the noisy simulator. The code used in training can be found in [sol_step4](src/Challenge/steps/sol_step4.jl) (the code works in exactly the same way as the code above but has had more logging and checks). The log of execution of the code on a noisy simulator can be found in [sol_res_step4_1](src/Challenge/steps/sol_res_step4_1.txt).\n",
    "\n",
    "\n",
    "# 7. Step 5"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6e76923b",
   "metadata": {},
   "source": [
    "The parameter for step 5 was found on the noisy simulator. The code used in training can be found in [sol_step5](src/Challenge/steps/sol_step5.jl) (the code works in exactly the same way as the code above but has had more logging and checks). The log of execution of the code on a noisy simulator can be found in [sol_res_step5_1](src/Challenge/steps/sol_res_step5_1.txt)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "id": "767f260b",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "1.4877769299024328, 3.0089057075104204, 1.3871161895815551, 5.248212159411048, 5.978097509723719, 5.322640459811362, 1.4379080078908066, 2.0268335218959703, 3.8993959688906883, 4.521580326619811, 3.6849847599083647, 4.6668411369445515, 1.8876732892405772, 2.066868129016876, 3.8281924083723253, 6.078747862615598, 2.1022283564016147, 5.316831086979245, 0.7445579751549053, 4.622656621744946, 1.8493085783016958, 6.237848148124421, 2.0219423235692116, 1.0044729120628748, 5.91955350667859, 0.97404471593805, 2.2350930660631056\n",
      "====================================\n",
      "Start iteration 1, value: 1.833604844203045, best: 1.833604844203045, dval: 1.0698744475848372\n",
      "====================================\n",
      "1.4850498457844585, 3.002173245168666, 1.384534466478679, 5.255709596227804, 5.985472374013028, 5.323246199920726, 1.430465636107199, 2.0320184059525572, 3.9014092334129646, 4.527525318620267, 3.686966707963977, 4.660108674602797, 1.8833116966015837, 2.0688059062972686, 3.832157856902801, 6.084195669810198, 2.1022283564016147, 5.318813035034857, 0.7525060864717755, 4.621965985744666, 1.8535623691279153, 6.2398616441677826, 2.0219423235692116, 1.004392491714996, 5.930252251154439, 0.97404471593805, 2.2343910908979394\n",
      "====================================\n",
      "Start iteration 2, value: 1.7734024668036925, best: 1.7734024668036925, dval: 1.0296639803974967\n",
      "====================================\n",
      "1.421170905111741, 2.7799250577318317, 1.3099391306432957, 5.4156236179389134, 6.1644889408498855, 5.329008522547203, 1.2816678054424555, 2.1874416141537676, 4.034186719978407, 4.666045280966761, 3.751517378259948, 4.4378604871659615, 1.815936806459087, 2.1301299954825716, 3.9052653009957683, 6.1734191509115, 2.1022283564016147, 5.3833637053308285, 0.9248023059413046, 4.445622936019696, 2.0752567126777812, 6.279023174622152, 2.0219423235692116, 1.002767187208115, 6.204213550110106, 0.97404471593805, 2.1609517696123417\n",
      "====================================\n",
      "Start iteration 3, value: 0.7955303872146728, best: 0.7955303872146728, dval: 0.34994954925491145\n",
      "====================================\n",
      "1.3516975146974082, 2.6298017266844704, 1.2737970030141454, 5.4416109799320065, 6.262594165273134, 5.326388898505101, 1.2502771568449411, 2.4395721451177077, 4.283725937105879, 4.73472160552309, 3.8152232880195456, 4.2877371561186, 1.798045640213357, 2.1917803636946687, 3.899989077648979, 6.165968071870222, 2.1022283564016147, 5.4470696150904265, 0.9944227191471249, 4.35766307252898, 2.5203809747345374, 6.37855776652445, 2.0219423235692116, 1.002556925417915, 6.3291846815889965, 0.97404471593805, 2.127311944533216\n",
      "====================================\n",
      "Start iteration 4, value: 0.4299575402367764, best: 0.4299575402367764, dval: 0.2964074967300736\n",
      "====================================\n",
      "1.2929718422979117, 2.518141965081945, 1.2802778106669588, 5.425266104444677, 6.293679273044191, 5.3188993929145925, 1.2510159098758111, 3.0369491132676005, 4.46656844965562, 4.883625328031931, 3.9679680002245665, 4.176077394516073, 1.6945093745490407, 2.6799801769191753, 3.8934714426230967, 6.156669589846642, 2.1022283564016147, 5.599814327295449, 1.0585260018764946, 4.4002451530837305, 2.9517263487845127, 6.929578839355445, 2.0219423235692116, 1.0027561876027522, 6.418938802778029, 0.97404471593805, 2.1345021340193457\n",
      "====================================\n",
      "Start iteration 5, value: 0.18832816020473353, best: 0.18832816020473353, dval: 0.3878429059715272\n",
      "====================================\n",
      "1.3224498691354178, 2.526801245396505, 1.2934787425010497, 5.385668168182301, 6.2768715430305795, 5.295384251018944, 1.2517864275778012, 2.904665428081761, 4.567507176943424, 5.015222136994866, 3.992761483248227, 4.184736674830634, 1.7039448343397472, 2.60238674006988, 3.861046142087755, 6.13300083654633, 2.1022283564016147, 5.62460781031911, 1.046405159329504, 4.3758344465304075, 3.0270374866699465, 6.84984620349442, 2.0219423235692116, 1.002634277730666, 6.440156400882757, 0.97404471593805, 2.1466069122319587\n",
      "====================================\n",
      "Start iteration 6, value: 0.1489647411967994, best: 0.1489647411967994, dval: 0.33297481486467795\n",
      "====================================\n",
      "1.3085317295135694, 2.530635567075092, 1.3521057782276875, 5.218374983880754, 6.2271863482091465, 5.064814892370577, 1.2560190076126239, 2.9420538339563254, 4.596197568277409, 5.007130826796341, 4.050293207359066, 4.188570996509221, 1.6970636171289168, 2.6195970872619028, 3.231523328843693, 5.989363640695986, 2.1022283564016147, 5.6821395344299495, 1.0376567076231804, 4.2237718585411335, 2.980614998378592, 6.849367964076445, 2.0219423235692116, 1.002508323873995, 6.466486272409765, 0.97404471593805, 2.1512266239164357\n",
      "====================================\n",
      "Start iteration 7, value: 0.0758888513974894, best: 0.0758888513974894, dval: 0.16878442060855547\n",
      "====================================\n",
      "1.2843664002866217, 2.5268773399327746, 1.3452799670808913, 5.12730763619716, 6.250753852035364, 5.090281157388496, 1.2559432899292644, 2.942472778856151, 4.601728123250979, 5.012510791226514, 4.0819691357338455, 4.1848127693669035, 1.6964087894074447, 2.6073461602440675, 3.533705568436808, 5.911052868416091, 2.1022283564016147, 5.71381546280473, 1.0458582902508158, 4.105438279486424, 2.9990484423172545, 6.8488868518248305, 2.0219423235692116, 1.002164959610618, 6.495879688843628, 0.97404471593805, 2.1496210699962446\n",
      "====================================\n",
      "Start iteration 8, value: 0.03580716772118307, best: 0.03580716772118307, dval: 0.0830762682163924\n",
      "====================================\n",
      "1.1772717175024576, 2.52168354109822, 1.350582232423436, 5.138973429056273, 6.245644907171731, 5.075106391625074, 1.2560159248938207, 2.942078444438519, 4.596512500100349, 5.028309068009276, 4.083984817208387, 4.179618970532348, 1.695192953221812, 2.6138705924214953, 3.5258780510619823, 5.856751326692441, 2.1022283564016147, 5.715831144279272, 1.0498860856914778, 4.177942407555032, 3.0422576361141456, 6.848323557927467, 2.0219423235692116, 1.0022870908783201, 6.515994582906107, 0.97404471593805, 2.1509306861897524\n",
      "====================================\n",
      "Start iteration 9, value: 0.02892993026130288, best: 0.02892993026130288, dval: 0.07090351354026449\n",
      "====================================\n",
      "1.220519262049769, 2.49143085008544, 1.355641837575783, 5.169337810042486, 6.163521574465535, 5.025438829011835, 1.2562308376239744, 2.941566545695892, 4.59454338631936, 5.050030040807265, 4.08231934807836, 4.149366279519566, 1.691953046228608, 2.6113064451767634, 3.5266619902279794, 5.813899434496702, 2.1022283564016147, 5.7141656751492444, 1.0595109804428489, 4.162662666791997, 3.0727580299888984, 6.843138421907288, 2.0219423235692116, 1.0022435242858867, 6.551736016335939, 0.97404471593805, 2.151936960085229\n",
      "====================================\n",
      "Start iteration 10, value: 0.02231002545341311, best: 0.02231002545341311, dval: 0.060725176109598794\n",
      "Start iteration 11, value: 4.494071946222168, best: 0.02231002545341311, dval: 7.107157552136055\n",
      "Big value increase: val: 4.494071946222168, e.val: 0.02231002545341311, max(α): 148.92886241339397\n",
      "====================================\n",
      "1.2193060267492437, 2.4906818793702294, 1.3944795994317556, 5.177241364966486, 6.167406509579039, 4.88218498255418, 1.256638968040576, 2.9415667026441557, 4.574039529498614, 5.080501562647821, 4.085763171015889, 4.148617308804355, 1.691875615498746, 2.614362827525284, 3.526650053175021, 5.770064171798228, 2.1022283564016147, 5.717609498086773, 1.0596916616283443, 4.130171564105405, 3.0372161038745125, 6.755526176929503, 2.0219423235692116, 1.0022144073074248, 6.552040905212813, 0.97404471593805, 2.151604433582515\n",
      "====================================\n",
      "Start iteration 12, value: 0.020122034298327554, best: 0.020122034298327554, dval: 0.06169893130500924\n",
      "====================================\n",
      "1.2152919222503367, 2.4898384074442603, 1.393671174634379, 5.19336421550361, 6.170479643593609, 4.887049809631192, 1.2567781068436004, 2.941567301720938, 4.574515386014068, 5.080080075559236, 4.086194100864564, 4.147773836878386, 1.6920830488917402, 2.6144542046757167, 3.526645583992049, 5.770114505252813, 2.1022283564016147, 5.718040427935448, 1.0599013981237406, 4.1186624691739615, 3.055441523462955, 6.755795376195934, 2.0219423235692116, 1.0021886067326258, 6.5522891781832495, 0.97404471593805, 2.1516066219690138\n",
      "====================================\n",
      "Start iteration 13, value: 0.018975740963649713, best: 0.018975740963649713, dval: 0.06139024676455267\n",
      "====================================\n",
      "1.183082866584063, 2.4775055503314074, 1.3927051004035071, 5.251513725286045, 6.222585500209525, 4.9034098974298255, 1.2844496107017205, 2.9415696147480226, 4.574789375158405, 5.079795829709164, 4.10420334250704, 4.135440979765533, 1.6952607884181472, 2.6178090017577014, 3.526626495304418, 5.770167220097038, 2.1022283564016147, 5.736049669577924, 1.0629363943392858, 4.077045374806408, 3.0891303864174495, 6.7573402994917595, 2.0219423235692116, 1.001896762408774, 6.554119779227182, 0.97404471593805, 2.151608766927058\n",
      "====================================\n",
      "Start iteration 14, value: 0.01442841845552375, best: 0.01442841845552375, dval: 0.04961756559392362\n",
      "====================================\n",
      "1.1942520115310933, 2.4322384803616828, 1.3934040202272362, 5.2475729007091845, 6.207534255480142, 4.897876088818521, 1.4010749263679751, 2.941570046076575, 4.574554151231727, 5.080045376257916, 4.105364943696227, 4.090173909795808, 1.710847747764865, 2.6193507460473104, 3.526603016325672, 5.770130078659185, 2.1022283564016147, 5.737211270767111, 1.071722956682646, 4.054594936478629, 3.151836174260003, 6.757262396575318, 2.0219423235692116, 1.0018267188924783, 6.556369520769441, 0.97404471593805, 2.151608972623732\n",
      "====================================\n",
      "Start iteration 15, value: 0.009358123442306888, best: 0.009358123442306888, dval: 0.03257378563740443\n",
      "====================================\n",
      "1.1900022661151581, 2.414956274283302, 1.3945193909271605, 5.241039804693858, 6.2105472648783575, 4.89091784043749, 1.4269044028287912, 2.94157050577082, 4.574147008172908, 5.083052856236596, 4.106698003588783, 4.072891703717427, 1.7098371248029325, 2.6212830816593002, 3.5265489927773124, 5.770052665440752, 2.1022283564016147, 5.738544330659668, 1.087813403656298, 4.011399799160746, 3.1036338114274256, 6.757178169863405, 2.0219423235692116, 1.0018848191493273, 6.559126736706963, 0.97404471593805, 2.151608771703999\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 16, value: 0.008045626520221588, best: 0.008045626520221588, dval: 0.033470899817990056\n",
      "Start iteration 17, value: 0.008853640784854764, best: 0.008045626520221588, dval: 0.050358652271402224\n",
      "Big value increase: val: 0.008853640784854764, e.val: 0.008045626520221588, max(α): 20.83550910453891\n",
      "====================================\n",
      "1.1903007593531911, 2.415215281437068, 1.420676810892955, 5.230108955920492, 6.206766465908266, 4.763757994837148, 1.4814371219111373, 2.9415707594831813, 4.564659168992596, 5.101671715072845, 4.124708237187929, 4.073150710871193, 1.7106505852518576, 2.6524454953433825, 3.5257507903145124, 5.770030648784451, 2.1022283564016147, 5.756554564258813, 1.1391946791866991, 4.099303441243873, 3.1075697141849306, 6.756718559246838, 2.0219423235692116, 1.0025770198542294, 6.5693820355582595, 0.97404471593805, 2.1516088240913116\n",
      "====================================\n",
      "Start iteration 18, value: 0.005243476239461476, best: 0.005243476239461476, dval: 0.03169525189640438\n",
      "Start iteration 19, value: 0.025145815899116377, best: 0.005243476239461476, dval: 0.1385103135912014\n",
      "Big value increase: val: 0.025145815899116377, e.val: 0.005243476239461476, max(α): 34.29850972948971\n",
      "====================================\n",
      "1.1902436188728631, 2.4046191837542845, 1.4282260325871097, 5.225649934242808, 6.19360935157464, 4.766290668417295, 1.4817713587582817, 2.9420128141075375, 4.559990454686841, 5.09586646814167, 4.124484442151837, 4.062554613188414, 1.7108044033777885, 2.71518440279525, 3.522168047093971, 5.770054302684313, 2.1022283564016147, 5.756330769222721, 1.1419914581282173, 4.073569348973543, 3.0937288222637664, 6.756296601175261, 2.0219423235692116, 1.058382561760741, 6.569695408910772, 0.97404471593805, 2.151608812599275\n",
      "====================================\n",
      "Start iteration 20, value: 0.0043289904148227825, best: 0.0043289904148227825, dval: 0.028274656427764246\n",
      "====================================\n",
      "1.190284038233531, 2.399334084627256, 1.4271339634892044, 5.225615435026654, 6.19262587613284, 4.7683847970670055, 1.4818055089760418, 2.942302213867526, 4.560791408860999, 5.094121226277124, 4.123894334338616, 4.057269514061388, 1.711002568947153, 2.710009912657682, 3.5214104906412893, 5.770076384240016, 2.1022283564016147, 5.755740661409501, 1.1439240182636952, 4.0017317046781695, 3.0917993729081674, 6.756283778915545, 2.0219423235692116, 1.0293798185248335, 6.569850374003515, 0.97404471593805, 2.1516088135669853\n",
      "====================================\n",
      "Start iteration 21, value: 0.004158497975051074, best: 0.004158497975051074, dval: 0.0325163768171272\n",
      "====================================\n",
      "1.1903929535703826, 2.398570199517097, 1.427434774432913, 5.225513201165618, 6.144362115104698, 4.774540448098695, 1.481841049757347, 2.9421960199951736, 4.560515090398144, 5.093404119737335, 4.1219088231960335, 4.056505628951229, 1.7119953799773446, 2.7135391849318706, 3.5156031792641835, 5.770280743333918, 2.1022283564016147, 5.753755150266918, 1.1546143818760362, 4.030586310408838, 3.0933427525103103, 6.756033574717206, 2.0219423235692116, 1.0449488030588894, 6.570583586323795, 0.97404471593805, 2.1516088146014325\n",
      "====================================\n",
      "Start iteration 22, value: 0.003376449407227662, best: 0.003376449407227662, dval: 0.024751273483427642\n",
      "====================================\n",
      "1.1904526875579222, 2.399144139936508, 1.4273135698110109, 5.2252934450740565, 6.1495734315724615, 4.812783749830004, 1.4819072765029302, 2.9422442147400645, 4.560567442324414, 5.093916136035692, 4.123163104064333, 4.057079569370639, 1.715183816713114, 2.724829932311806, 3.497092369308267, 5.771087461301237, 2.1022283564016147, 5.755009431135218, 1.2065787272544377, 4.024286621448094, 3.094131006179463, 6.751622868418259, 2.0219423235692116, 1.0445153446803783, 6.572836191085986, 0.97404471593805, 2.151608815287301\n",
      "====================================\n",
      "Start iteration 23, value: 0.002955026436825951, best: 0.002955026436825951, dval: 0.02864522240275074\n",
      "Start iteration 24, value: 0.004459083336771876, best: 0.002955026436825951, dval: 0.04920111181435707\n",
      "Big value increase: val: 0.004459083336771876, e.val: 0.002955026436825951, max(α): 30.962942857770607\n",
      "====================================\n",
      "1.190962085456736, 2.3991829330332224, 1.4273081229454678, 5.2212861889436395, 6.1488860074249585, 4.812005199037729, 1.4820615728002018, 2.9428636294379773, 4.5606525345951665, 5.095034235715211, 4.124380238183641, 4.057118362467354, 1.7346413521262853, 2.741939466139735, 3.4469850230737142, 5.791721770729168, 2.1022283564016147, 5.756226565254526, 1.1937216444126117, 3.960486257688058, 3.1011797534130663, 6.705148826899583, 2.0219423235692116, 1.0433047486955305, 6.572091317692344, 0.97404471593805, 2.1516088155630446\n",
      "====================================\n",
      "Start iteration 25, value: 0.0020561368056593783, best: 0.0020561368056593783, dval: 0.016664309838389152\n",
      "====================================\n",
      "1.1920612584903278, 2.3985972550988897, 1.4273090044925858, 5.2180344054757075, 6.149196984638125, 4.810313401973368, 1.482079328959586, 2.9436429452518866, 4.560631542701795, 5.095588937014556, 4.124528210217744, 4.056532684533022, 1.736279404163025, 2.746737449780399, 3.442810902299339, 5.780085044580222, 2.1022283564016147, 5.756374537288629, 1.1951506932604796, 3.9788369799349406, 3.10279274278386, 6.7286212700404056, 2.0219423235692116, 1.0434156731591293, 6.572075644232742, 0.97404471593805, 2.1516088157755022\n",
      "====================================\n",
      "Start iteration 26, value: 0.0017022410653598319, best: 0.0017022410653598319, dval: 0.013852783055832006\n",
      "====================================\n",
      "1.2159732418421416, 2.390968948575434, 1.427309607293075, 5.219257818870877, 6.150445467091877, 4.809774340476132, 1.4822433784636129, 2.944446346571633, 4.560612416525804, 5.101914714095214, 4.124631931681111, 4.048904378009578, 1.7357472630902435, 2.7539961617433644, 3.443612352496362, 5.782921972976717, 2.1022283564016147, 5.756478258751995, 1.2037064495205159, 3.9742881153247103, 3.1034046475739334, 6.7380865228925035, 2.0219423235692116, 1.0433767701089016, 6.57196496430021, 0.97404471593805, 2.1516088157529216\n",
      "====================================\n",
      "Start iteration 27, value: 0.0015593520102313684, best: 0.0015593520102313684, dval: 0.018500227173106825\n",
      "Start iteration 28, value: 0.001906849075317048, best: 0.0015593520102313684, dval: 0.021719791285836614\n",
      "Big value increase: val: 0.001906849075317048, e.val: 0.0015593520102313684, max(α): 36.05412244800188\n",
      "====================================\n",
      "1.2149960347396072, 2.369372872634939, 1.4273188256682066, 5.2188370937852095, 6.152815596275832, 4.808972411631656, 1.4897269789915315, 2.945829510256224, 4.560505431041684, 5.1001893491986445, 4.124644851334977, 4.027308302069115, 1.7374717226128988, 2.7655384920880173, 3.441689869428675, 5.782282593768876, 2.1022283564016147, 5.756491178405861, 1.1739934932896807, 3.9348102925830957, 3.1033831061471107, 6.750595143141899, 2.0219423235692116, 1.0427273574781786, 6.571164840052208, 0.97404471593805, 2.1516088157459285\n",
      "====================================\n",
      "Start iteration 29, value: 0.0015365164390624968, best: 0.0015365164390624968, dval: 0.012882254679554502\n",
      "====================================\n",
      "1.2123117342012546, 2.378646527925703, 1.4273261067599279, 5.2182913351727604, 6.156451591288123, 4.809107656999925, 1.5013452741361073, 2.9457562626083074, 4.560470678986792, 5.09960364391708, 4.124658946103359, 4.036581957359865, 1.740505432305652, 2.7756312054094328, 3.4404743434461644, 5.7819363141408635, 2.1022283564016147, 5.756505273174244, 1.1911622800264405, 3.9533621917489445, 3.10371177378315, 6.739748697670962, 2.0219423235692116, 1.0429472665888482, 6.571650260827167, 0.97404471593805, 2.1516088158050595\n",
      "====================================\n",
      "Start iteration 30, value: 0.0010573838682519676, best: 0.0010573838682519676, dval: 0.009910964861934286\n",
      "====================================\n",
      "1.2053715968429168, 2.3764276896930734, 1.4273366339806477, 5.2181312577654815, 6.15432510998295, 4.809025743420761, 1.5400989878434084, 2.945822400824354, 4.5604379417473515, 5.09914547746243, 4.1246503689462, 4.034363119127239, 1.7405384106875412, 2.7827058363590904, 3.4376639572567784, 5.781730814308329, 2.1022283564016147, 5.756496696017084, 1.2137244063799695, 3.9592207794842076, 3.1038856932214194, 6.739619159683073, 2.0219423235692116, 1.0430020232611799, 6.572344557016281, 0.97404471593805, 2.151608815858784\n",
      "====================================\n",
      "Start iteration 31, value: 0.0006986008009999628, best: 0.0006986008009999628, dval: 0.006412828982666867\n",
      "Start iteration 32, value: 0.0007684879055621972, best: 0.0006986008009999628, dval: 0.013441780015660237\n",
      "Big value increase: val: 0.0007684879055621972, e.val: 0.0006986008009999628, max(α): 10.08271668917903\n",
      "====================================\n",
      "1.2052652956664063, 2.3551222245475167, 1.4274283521674833, 5.2166909630649325, 6.121665371118305, 4.808772424510381, 1.5388917936082067, 2.9460907644974674, 4.560339010109471, 5.099648261909055, 4.124546893169258, 4.013057653981707, 1.7404591232353683, 2.800879084649453, 3.412383393444573, 5.781761002842102, 2.1022283564016147, 5.756393220240143, 1.2230045077615588, 3.963840794906948, 3.104186078407266, 6.739250043151745, 2.0219423235692116, 1.0430415970003863, 6.572790110670493, 0.97404471593805, 2.1516088159013034\n",
      "====================================\n",
      "Start iteration 33, value: 0.0006459482169214534, best: 0.0006459482169214534, dval: 0.009033835644180851\n",
      "====================================\n",
      "1.2050726499929774, 2.3659452770946188, 1.4274334348049245, 5.214368891391214, 6.138092515282781, 4.808800695179609, 1.550437955251083, 2.946512790449556, 4.5603287399639445, 5.099774530197178, 4.1245822098336555, 4.0238807065287965, 1.7404001848449286, 2.8066062733555923, 3.4135258686704146, 5.781748444369077, 2.1022283564016147, 5.75642853690454, 1.228960630420464, 3.9618947496374393, 3.1038381682951472, 6.738987655317815, 2.0219423235692116, 1.0430108526209874, 6.573014433823992, 0.97404471593805, 2.151608815887605\n",
      "====================================\n",
      "Start iteration 34, value: 0.00041854746412834656, best: 0.00041854746412834656, dval: 0.004375642710864998\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 35, value: 0.003449812479367688, best: 0.00041854746412834656, dval: 0.05564313949912786\n",
      "Big value increase: val: 0.003449812479367688, e.val: 0.00041854746412834656, max(α): 33.45324908382997\n",
      "====================================\n",
      "1.20501823154221, 2.3649277572851735, 1.427439200936551, 5.210519066224171, 6.13810630357702, 4.808800771792458, 1.5504374421411369, 2.94820467894342, 4.5603154200592115, 5.100845097036531, 4.124515559594492, 4.022863186719352, 1.7391283469448708, 2.8257529334385194, 3.4139333994438967, 5.781759959705628, 2.1022283564016147, 5.756361886665377, 1.2351998181644581, 3.962052875363877, 3.1042162391277075, 6.737677697706676, 2.0219423235692116, 1.0430108461350716, 6.573223572139904, 0.97404471593805, 2.1516088158833284\n",
      "====================================\n",
      "Start iteration 36, value: 0.00037097384632373296, best: 0.00037097384632373296, dval: 0.0035024657374014417\n",
      "Start iteration 37, value: 0.0003731322062552167, best: 0.00037097384632373296, dval: 0.00378640640072625\n",
      "====================================\n",
      "1.2049910472121685, 2.362841270076832, 1.427436707593228, 5.210642894244193, 6.1375856549614225, 4.80880396535695, 1.5504719368487458, 2.950388161752716, 4.560319565175141, 5.100894823121459, 4.124329135267917, 4.021741544174889, 1.7331452746519802, 2.824829224528094, 3.4144243388204063, 5.781792908858462, 2.1022283564016147, 5.756175462338802, 1.2353482697925826, 3.960092758384618, 3.11570659712142, 6.736562791788132, 2.0219423235692116, 1.0430103381150175, 6.573046981592309, 0.97404471593805, 2.151608815883355\n",
      "====================================\n",
      "Start iteration 38, value: 0.00036202137852255436, best: 0.00036202137852255436, dval: 0.0034669600512176116\n",
      "====================================\n",
      "1.2049621686544238, 2.361942538539181, 1.4274358801308498, 5.210544270837293, 6.1373415452065085, 4.808804951490033, 1.5504911801358447, 2.9547414873020705, 4.560320747482221, 5.1008640522735496, 4.122392788163121, 4.020957051847413, 1.732200912077515, 2.8250929438875874, 3.4155668660644682, 5.782358717144582, 2.1022283564016147, 5.754239115234006, 1.2350588574397698, 3.958877802951723, 3.109993791893008, 6.736067140623803, 2.0219423235692116, 1.0430089233658113, 6.573019799407631, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 39, value: 0.00033973142715536416, best: 0.00033973142715536416, dval: 0.003724350658619955\n",
      "====================================\n",
      "1.2049740204968138, 2.3615319055532384, 1.4273923106566968, 5.210124315404672, 6.1365138634911816, 4.808809713918461, 1.5507696236645505, 2.9524953835655166, 4.560328095590946, 5.100764574752066, 4.115995318224035, 4.020598615080275, 1.7327272288763775, 2.825372647524209, 3.417637407890372, 5.789443353447508, 2.1022283564016147, 5.7478416452949235, 1.2345817257255176, 3.958248845766906, 3.1112173945345516, 6.73519966794531, 2.0219423235692116, 1.0430037055372174, 6.572983844838594, 0.97404471593805, 2.1516088158833244\n",
      "====================================\n",
      "Start iteration 40, value: 0.00031742079821421565, best: 0.00031742079821421565, dval: 0.0037997754354119895\n",
      "====================================\n",
      "1.204965964484734, 2.3618061121448037, 1.4273698570454207, 5.209473401948164, 6.136710819088789, 4.808809366445667, 1.564797147848584, 2.952537225697603, 4.560344079023644, 5.100506199124522, 4.1157691393643665, 4.020837966831287, 1.7328979645701441, 2.825779353190214, 3.418073599265225, 5.786602838167033, 2.1022283564016147, 5.747615466435255, 1.2327594567214437, 3.956074370064233, 3.110907396015525, 6.735518537664123, 2.0219423235692116, 1.042949274187667, 6.572892122805328, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 41, value: 0.00031533655589049855, best: 0.00031533655589049855, dval: 0.003866062709683118\n",
      "====================================\n",
      "1.2049396337978107, 2.3616182964264185, 1.4272751050778238, 5.208866467291695, 6.136933689605525, 4.808809522630688, 1.557722737049581, 2.9524992834503445, 4.560370383421236, 5.099477777343837, 4.115420477825506, 4.02067402467072, 1.7335654540174348, 2.827076769664755, 3.4185833979698215, 5.787016659550598, 2.1022283564016147, 5.747266804896394, 1.2343956102875207, 3.9568182097270967, 3.1110267709864226, 6.737030718809326, 2.0219423235692116, 1.042961751141021, 6.572965340781707, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 42, value: 0.0002924663796842838, best: 0.0002924663796842838, dval: 0.0026898831117724703\n",
      "Start iteration 43, value: 0.000940451448406655, best: 0.0002924663796842838, dval: 0.024836458538359456\n",
      "Big value increase: val: 0.000940451448406655, e.val: 0.0002924663796842838, max(α): 103.61696612727974\n",
      "====================================\n",
      "1.2049384994391228, 2.3615019380839666, 1.4235453046149058, 5.205477208628118, 6.137250984650627, 4.808809188966672, 1.5581384054084246, 2.9524195952779, 4.560745766235311, 5.101994907601851, 4.1148093141156385, 4.020572456824187, 1.7325511537060008, 2.8410982829106337, 3.41878881601077, 5.789426133708631, 2.1022283564016147, 5.746655641186523, 1.2393858947578846, 3.9550634941631686, 3.110942484754276, 6.736916785727393, 2.0219423235692116, 1.0429402411204496, 6.573031509569683, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 44, value: 0.0002576276639407147, best: 0.0002576276639407147, dval: 0.002230970027145\n",
      "====================================\n",
      "1.204936609244055, 2.3614776860420723, 1.4194627475862311, 5.202640148490756, 6.1372087355324, 4.808809024967991, 1.5582727955630369, 2.9523850985969955, 4.561287726207207, 5.10093321404917, 4.111011078696943, 4.020551287498315, 1.7325254257473464, 2.842346354254316, 3.4187775199747903, 5.789452998013196, 2.1022283564016147, 5.742857405767809, 1.2369221885431843, 3.9529472213648176, 3.1109578124494766, 6.736876967140681, 2.0219423235692116, 1.0428641768496967, 6.57301518576422, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 45, value: 0.00024137772930932832, best: 0.00024137772930932832, dval: 0.0018737984890327061\n",
      "====================================\n",
      "1.2049035334260987, 2.3610992482536344, 1.4187900993467661, 5.202908760661659, 6.1371827650102535, 4.808808670854377, 1.5585180763778368, 2.9520682975409835, 4.561587451142294, 5.100923717155641, 4.108651480955643, 4.020220953545382, 1.7324891352258298, 2.8445203513338027, 3.418782647548808, 5.789491869597731, 2.1022283564016147, 5.740497808026498, 1.2368734710803915, 3.9514414005873855, 3.1109795275116814, 6.7368940858173225, 2.0219423235692116, 1.0427699793500746, 6.573014417813681, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 46, value: 0.00023357687175309805, best: 0.00023357687175309805, dval: 0.0021907162690611437\n",
      "====================================\n",
      "1.2044460866126152, 2.3609137371128, 1.4187607530544286, 5.203322743889288, 6.137170334909347, 4.808804501397174, 1.5658292832776335, 2.949352078324086, 4.562401235789756, 5.100932304445995, 4.107296683964786, 4.020059023023809, 1.730604723627858, 2.8595482578478997, 3.418782312018192, 5.789792443965716, 2.1022283564016147, 5.739143011035634, 1.2369010817482216, 3.94546510242767, 3.111058851115228, 6.736932126581512, 2.0219423235692116, 1.0419868011013964, 6.573014418693506, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 47, value: 0.00020514337540390035, best: 0.00020514337540390035, dval: 0.002218831439987598\n",
      "====================================\n",
      "1.2035148442782007, 2.3607059621871405, 1.4187312419661304, 5.202962621544035, 6.137156146889474, 4.808802075370163, 1.5617845258492637, 2.950149153287615, 4.563490816908823, 5.100927091391401, 4.105735400875473, 4.019877658702882, 1.7302001387967074, 2.868067655464226, 3.418782645255804, 5.790419465189171, 2.1022283564016147, 5.737581727946314, 1.2369291335353498, 3.9414645942650974, 3.111194279641983, 6.736987232768876, 2.0219423235692116, 1.0313523467308685, 6.573014419573373, 0.97404471593805, 2.1516088158833235\n",
      "====================================\n",
      "Start iteration 48, value: 0.00018629783603195643, best: 0.00018629783603195643, dval: 0.0031439270062233095\n",
      "====================================\n",
      "1.2038953498715061, 2.360333179415116, 1.418730037568408, 5.202009251431303, 6.137107929061532, 4.808799090089679, 1.5614793120566612, 2.9495443528213916, 4.563544707144358, 5.100931200040103, 4.09957015033717, 4.019552260948138, 1.730361925482093, 2.886588789712801, 3.4187832152165094, 5.796989683219762, 2.1022283564016147, 5.731416477407984, 1.236956118402255, 3.9446757220662345, 3.1114452128199668, 6.737132075664532, 2.0219423235692116, 1.0309657659305944, 6.573014419954825, 0.97404471593805, 2.151608815883324\n",
      "====================================\n",
      "Start iteration 49, value: 0.0001735286552739102, best: 0.0001735286552739102, dval: 0.003492139995098142\n",
      "Start iteration 50, value: 0.0005738658734038738, best: 0.0001735286552739102, dval: 0.016352942514007634\n",
      "Big value increase: val: 0.0005738658734038738, e.val: 0.0001735286552739102, max(α): 17.17947133965105\n",
      "====================================\n",
      "1.2038918869959254, 2.359693438755355, 1.4187290823726175, 5.20104928717465, 6.136170451431151, 4.80878173903509, 1.5626155250498839, 2.949723647408265, 4.563598820285319, 5.101209146976194, 4.091748581679942, 4.0189938387518165, 1.7296233584212384, 2.884442930815362, 3.4187838176526957, 5.7940109260371395, 2.1022283564016147, 5.723594908750721, 1.2375282188276338, 3.942032404267115, 3.1119966099579157, 6.741366137639562, 2.0219423235692116, 1.0304508323001984, 6.573014442673786, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 51, value: 0.0001401283368100071, best: 0.0001401283368100071, dval: 0.0015279860363098807\n",
      "Start iteration 52, value: 0.00021714121734043735, best: 0.0001401283368100071, dval: 0.00910983753321367\n",
      "Big value increase: val: 0.00021714121734043735, e.val: 0.0001401283368100071, max(α): 21.860166202248113\n",
      "Start iteration 53, value: 0.00014862891482858204, best: 0.0001401283368100071, dval: 0.004616365749799234\n",
      "Start iteration 54, value: 0.0001464996623500784, best: 0.0001401283368100071, dval: 0.004474701694052036\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "1.2038740669301013, 2.3595145991247937, 1.4187276324145845, 5.199341584455451, 6.135359251489106, 4.8087149987793065, 1.56734770705643, 2.9497463609142542, 4.56378027616431, 5.101780054778086, 4.088542546001231, 4.018998375875168, 1.7293059650323066, 2.895175558541921, 3.4187844258952995, 5.793760820402599, 2.1022283564016147, 5.720388873071996, 1.2443869320869982, 3.941114563800297, 3.114124027997621, 6.738608923341029, 2.0219423235692116, 1.0252782352980117, 6.573014496453551, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 55, value: 0.00011579059256720234, best: 0.00011579059256720234, dval: 0.0014035690265256362\n",
      "====================================\n",
      "1.2038620337915034, 2.3593971450548272, 1.4187210996719486, 5.197647347813419, 6.134320559511847, 4.808674951478173, 1.568813641136519, 2.949747823843214, 4.5668265496339115, 5.102001486105006, 4.087606713262778, 4.018973994637609, 1.729293550246279, 2.901816792200403, 3.4187844454391034, 5.794261692423612, 2.1022283564016147, 5.719453040333538, 1.2443191848713122, 3.9409035241708508, 3.114166430497382, 6.738575233803841, 2.0219423235692116, 0.991385871616657, 6.573014494612858, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 56, value: 0.0001131898858852609, best: 0.0001131898858852609, dval: 0.002864559190141683\n",
      "====================================\n",
      "1.20385386501135, 2.3590066876528155, 1.418724955529726, 5.1981515592699985, 6.132537528487389, 4.80846095782767, 1.5677252255337455, 2.9497468747551414, 4.565204603525289, 5.10290542462781, 4.085320364235741, 4.018892943085474, 1.729270728103065, 2.9097296422865004, 3.418784429570454, 5.79547667794388, 2.1022283564016147, 5.717166691306491, 1.2426910345624314, 3.9410301647603894, 3.1142112661650065, 6.738581188411718, 2.0219423235692116, 1.0114781078920327, 6.573014491074122, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 57, value: 8.68806329973738e-5, best: 8.68806329973738e-5, dval: 0.001085154057861794\n",
      "Start iteration 58, value: 0.0001414915946684826, best: 8.68806329973738e-5, dval: 0.005609489191643163\n",
      "Big value increase: val: 0.0001414915946684826, e.val: 8.68806329973738e-5, max(α): 33.49575054686424\n",
      "====================================\n",
      "1.2038457714276298, 2.358120150157122, 1.4187236871160915, 5.1977555002917875, 6.132457659958996, 4.77388403490314, 1.567998679673042, 2.9497474235136267, 4.565944738060826, 5.101948737140858, 4.083591743887745, 4.018708914713411, 1.7291128325316876, 2.9108992127981774, 3.418784434009592, 5.795425124250788, 2.1022283564016147, 5.715438070958487, 1.242353295414231, 3.940965434278813, 3.1142143125623467, 6.7385873275159645, 2.0219423235692116, 1.0010393298668383, 6.573014483185828, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 59, value: 8.051784330372228e-5, best: 8.051784330372228e-5, dval: 0.0017254882416560813\n",
      "====================================\n",
      "1.2038349473641434, 2.357781872603271, 1.418723572218128, 5.197730969051921, 6.132481147047526, 4.7927341721132235, 1.5679668320060383, 2.9497473903258395, 4.56618222670295, 5.101507544805671, 4.08295946102272, 4.018638694708231, 1.7291845418740825, 2.9111770027702315, 3.418784437318468, 5.795563334505884, 2.1022283564016147, 5.714805788093459, 1.2423918701586156, 3.9409727501344034, 3.1142163012509765, 6.738585276163041, 2.0219423235692116, 1.0005027312454322, 6.57301445971861, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 60, value: 7.579362250868422e-5, best: 7.579362250868422e-5, dval: 0.0014998888262208084\n",
      "====================================\n",
      "1.2038006123846103, 2.3578649669995406, 1.4187235340712097, 5.196680790640464, 6.132559945113816, 4.794343189895561, 1.5678158938181095, 2.9497473179286766, 4.566506393298569, 5.101421037670916, 4.082938179507168, 4.018655943529118, 1.7291968811169707, 2.9142785538034754, 3.418784440799515, 5.795669932816207, 2.1022283564016147, 5.714784506577907, 1.2423813576175633, 3.940987494345497, 3.114218632046196, 6.7385843092058835, 2.0219423235692116, 1.000020687786013, 6.573014392598708, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 61, value: 7.135650123833962e-5, best: 7.135650123833962e-5, dval: 0.0009883074694679722\n",
      "====================================\n",
      "1.2037185969144717, 2.3578149414568794, 1.418723457385571, 5.196380803208719, 6.132511300209828, 4.794090994630253, 1.5677400818517995, 2.94974713886389, 4.566954766539582, 5.101401299285504, 4.082916471298588, 4.018645559175131, 1.7291936769080827, 2.920270339885258, 3.4187844893636345, 5.79589634018991, 2.1022283564016147, 5.7147627983693265, 1.2423130620245983, 3.9409807694568992, 3.11422937617807, 6.73858304247489, 2.0219423235692116, 0.9994875784530739, 6.573012871339059, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 62, value: 6.774904541861382e-5, best: 6.774904541861382e-5, dval: 0.0012221535305052028\n",
      "Start iteration 63, value: 7.201725339267757e-5, best: 6.774904541861382e-5, dval: 0.0031504891341604738\n",
      "====================================\n",
      "1.2036825220332217, 2.357464663236765, 1.418723222617995, 5.195160263551593, 6.132376373194221, 4.792796796903309, 1.5678490161538947, 2.9497469602181567, 4.568229105531492, 5.101407014074008, 4.082854221168954, 4.018617436353904, 1.7291817675988705, 2.9201755776999674, 3.4187849105225485, 5.799541845841153, 2.1022283564016147, 5.714700548239692, 1.242312464527585, 3.9409669318681937, 3.1142945987591575, 6.738569571402768, 2.0219423235692116, 0.9980538723072062, 6.572959946239981, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 64, value: 6.436048986266595e-5, best: 6.436048986266595e-5, dval: 0.001250704898024326\n",
      "Start iteration 65, value: 8.366637066267604e-5, best: 6.436048986266595e-5, dval: 0.004669387241317501\n",
      "Big value increase: val: 8.366637066267604e-5, e.val: 6.436048986266595e-5, max(α): 64.9824458862249\n",
      "====================================\n",
      "1.2036642296979225, 2.357002363335168, 1.41872108404809, 5.194429096156518, 6.129998382398678, 4.789306780862797, 1.568124378082775, 2.9497472061476846, 4.569770351133353, 5.1013837480209085, 4.079409643443165, 4.018521538557521, 1.7290143982144939, 2.9206756449553253, 3.4188034100431275, 5.798849382095153, 2.1022283564016147, 5.711255970513904, 1.2423124643031784, 3.9409629111990343, 3.114690002564882, 6.738566862527153, 2.0219423235692116, 0.9970284067176114, 6.572935613865344, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 66, value: 6.177198670334493e-5, best: 6.177198670334493e-5, dval: 0.0015027630089571725\n",
      "====================================\n",
      "1.2036249457205328, 2.357042511702745, 1.4187206533089118, 5.193643405630241, 6.131315050702724, 4.789102930950358, 1.5683557915371376, 2.949748830296568, 4.569916870760509, 5.101352539789844, 4.0806513426103725, 4.018529866787671, 1.7288984798233107, 2.9246213473630522, 3.418841557025804, 5.798964015669491, 2.1022283564016147, 5.712497669681111, 1.2423124880249239, 3.94096136126634, 3.11477212708376, 6.73856320536068, 2.0219423235692116, 0.9965831284641512, 6.572926806229745, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 67, value: 5.6714019402587046e-5, best: 5.6714019402587046e-5, dval: 0.0013981964573103085\n",
      "====================================\n",
      "1.2035706415148872, 2.357032894943244, 1.418719957496973, 5.192029238825383, 6.13102221091437, 4.7883641382943045, 1.5689648406946468, 2.949757816209219, 4.570135195368725, 5.101248086458055, 4.080059630218186, 4.018527871922344, 1.7285434980843686, 2.926108716703657, 3.4202948261164194, 5.79911832614483, 2.1022283564016147, 5.711905957288925, 1.2423133441773875, 3.940959106708645, 3.114769404752037, 6.738560468856304, 2.0219423235692116, 0.9956997117024076, 6.572876125789696, 0.97404471593805, 2.151608815883327\n",
      "====================================\n",
      "Start iteration 68, value: 5.314039265000241e-5, best: 5.314039265000241e-5, dval: 0.0011513802435910991\n",
      "Start iteration 69, value: 0.00349214836304382, best: 5.314039265000241e-5, dval: 0.023627550586501567\n",
      "Big value increase: val: 0.00349214836304382, e.val: 5.314039265000241e-5, max(α): 856.6129547185194\n",
      "====================================\n",
      "1.203526448200907, 2.3570328948108297, 1.4187198232703753, 5.192770488302335, 6.12734754781776, 4.788260928518743, 1.5692115008178584, 2.9497965799366956, 4.574368106767616, 5.1012402285729905, 4.072532674454499, 4.018527871894876, 1.7234688396550342, 2.9381817952573726, 3.42072718775517, 5.800290176703564, 2.1022283564016147, 5.704379001525242, 1.2423133558671058, 3.9409589132100145, 3.1147694473099987, 6.738560488470169, 2.0219423235692116, 0.995604336120737, 6.57285642741428, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 70, value: 5.15611573628642e-5, best: 5.15611573628642e-5, dval: 0.0019093410951596668\n",
      "====================================\n",
      "1.2034018432889864, 2.357032918967827, 1.418719380139868, 5.192433537922129, 6.128958447957764, 4.797711468392091, 1.5694068941283397, 2.949822509793913, 4.584843589396664, 5.101178838427758, 4.077097525166437, 4.018527876905915, 1.7247716234222223, 2.9384129268033794, 3.4212506289315785, 5.800253010246149, 2.1022283564016147, 5.708943852237177, 1.2423134107732214, 3.94095847908912, 3.1147699618220397, 6.7385604291928916, 2.0219423235692116, 0.9953784594269827, 6.572773949043583, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 71, value: 4.004090741928608e-5, best: 4.004090741928608e-5, dval: 0.0008915948182388589\n",
      "Start iteration 72, value: 5.913930634688515e-5, best: 4.004090741928608e-5, dval: 0.004656547485309422\n",
      "Big value increase: val: 5.913930634688515e-5, e.val: 4.004090741928608e-5, max(α): 37.7496287373721\n",
      "====================================\n",
      "1.2033929410707462, 2.3570329944713917, 1.4187193623739531, 5.190719353538763, 6.1285929822826395, 4.79806994899304, 1.5706162800071748, 2.950079778594881, 4.584942923207276, 5.101152330777996, 4.076135912916739, 4.0185278925680965, 1.7248798599944575, 2.9389134767223166, 3.4233779213187523, 5.800273033711967, 2.1022283564016147, 5.70798223998748, 1.2423134202519202, 3.940958467627342, 3.11477118010112, 6.738560434636083, 2.0219423235692116, 0.9951424323401816, 6.572735577141493, 0.97404471593805, 2.151608815883326\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 73, value: 3.698572998820007e-5, best: 3.698572998820007e-5, dval: 0.0007641731142778649\n",
      "====================================\n",
      "1.203366039684573, 2.3570330143904927, 1.4187194110990216, 5.190827498748876, 6.128559294351675, 4.795765733072777, 1.570944264543103, 2.9502443320832423, 4.584933806821362, 5.101149486668533, 4.075908442156331, 4.018527896700041, 1.7249034035871311, 2.939557073742343, 3.4228523083613243, 5.800274872884309, 2.1022283564016147, 5.707754769227072, 1.2423134185794962, 3.9409585252801316, 3.1147744914004014, 6.738560436457295, 2.0219423235692116, 0.9950823191059004, 6.57271963515072, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 74, value: 3.618495525850236e-5, best: 3.618495525850236e-5, dval: 0.000732403874894233\n",
      "====================================\n",
      "1.2032475664183964, 2.3570330665047448, 1.4187193853685918, 5.190842091877173, 6.128378211394866, 4.795028769787966, 1.5712696435885702, 2.9502863543966646, 4.5849426268895614, 5.1011425928724545, 4.0743085313536165, 4.018527907510428, 1.724944514607759, 2.9459130637654494, 3.4230634299856573, 5.800380159606851, 2.1022283564016147, 5.706154858424356, 1.242313419435371, 3.940959728137256, 3.114795207670181, 6.738560438098516, 2.0219423235692116, 0.9949721911733318, 6.572713422754201, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 75, value: 3.287650164804278e-5, best: 3.287650164804278e-5, dval: 0.0007946081211100652\n",
      "====================================\n",
      "1.203213571397015, 2.3570331764445998, 1.4187193564897869, 5.190828486246862, 6.127965561741589, 4.793188490482188, 1.5717703848637097, 2.9502766712787167, 4.584952338499644, 5.101135760682651, 4.071476191515694, 4.018527930315944, 1.7250124814711987, 2.9451048361957533, 3.4234262269193914, 5.801842349394522, 2.1022283564016147, 5.703322518586432, 1.2423134210151654, 3.9409586625861377, 3.1148949704076068, 6.7385605977744385, 2.0219423235692116, 0.9948463413724162, 6.572713573228178, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 76, value: 3.183649082425864e-5, best: 3.183649082425864e-5, dval: 0.0007190807970404722\n",
      "====================================\n",
      "1.203174544967447, 2.3570334083312114, 1.4187192662207728, 5.190811509102891, 6.128145430174879, 4.78991653516712, 1.572186337572625, 2.9502856706509037, 4.585002002455856, 5.101113382969624, 4.072711515214596, 4.018527978417643, 1.7253019431087373, 2.9458134437845986, 3.424138990862621, 5.801788945870017, 2.1022283564016147, 5.704557842285335, 1.242313428482527, 3.9409555108607695, 3.115995656441121, 6.738562876849885, 2.0219423235692116, 0.9943907005628844, 6.572713725760065, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 77, value: 3.031441960871371e-5, best: 3.031441960871371e-5, dval: 0.0005595959370224245\n",
      "Start iteration 78, value: 3.5201291501315074e-5, best: 3.031441960871371e-5, dval: 0.0025543509211310433\n",
      "Big value increase: val: 3.5201291501315074e-5, e.val: 3.031441960871371e-5, max(α): 521.7693631837856\n",
      "====================================\n",
      "1.203137442298374, 2.357038685156549, 1.4187080476964053, 5.188677731199849, 6.127935942968398, 4.78502701138368, 1.5722183295216576, 2.9503020222319996, 4.585791089623636, 5.098757257095931, 4.072465108524212, 4.018529073022717, 1.7257738314647668, 2.9483971654105514, 3.4246626278337824, 5.801879224479499, 2.1022283564016147, 5.704311435594951, 1.2423136167069906, 3.940949988464542, 3.1158236963970602, 6.738566679916425, 2.0219423235692116, 0.9906392302222904, 6.5727138657489235, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 79, value: 2.8252649493634625e-5, best: 2.8252649493634625e-5, dval: 0.0011526109097838022\n",
      "====================================\n",
      "1.2031603490257676, 2.3570758893145256, 1.41870459622766, 5.189727013682057, 6.127700028932152, 4.77776601743768, 1.57220681545683, 2.9503068948196933, 4.585981933913469, 5.099441168438089, 4.072189356441311, 4.018536790515242, 1.725731209764286, 2.9498967382462844, 3.4246405124531365, 5.806303511120273, 2.1022283564016147, 5.70403568351205, 1.2423136685200322, 3.940948181716445, 3.115725542559581, 6.738571315004957, 2.0219423235692116, 0.9895634529670767, 6.572713926336279, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 80, value: 2.710864282517868e-5, best: 2.710864282517868e-5, dval: 0.001968361949946468\n",
      "Start iteration 81, value: 0.00014177151985312583, best: 2.710864282517868e-5, dval: 0.0047314036564449794\n",
      "Big value increase: val: 0.00014177151985312583, e.val: 2.710864282517868e-5, max(α): 249.6313177041882\n",
      "====================================\n",
      "1.2031604097517956, 2.3582148831710485, 1.4187042550483353, 5.188416458804092, 6.127553586978042, 4.773182291447645, 1.5721879219739223, 2.9503170302546144, 4.586328367661548, 5.099543427141551, 4.070871947916784, 4.018773059175839, 1.725762722051846, 2.961416419720165, 3.4246508975636054, 5.804771085709902, 2.1022283564016147, 5.7027182749875225, 1.2423137327016063, 3.940947805658583, 3.1157234812038097, 6.738571327770185, 2.0219423235692116, 0.987568373984182, 6.572713988392118, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 82, value: 2.6573675120048676e-5, best: 2.6573675120048676e-5, dval: 0.0014985191512295287\n",
      "Start iteration 83, value: 3.0237915885488018e-5, best: 2.6573675120048676e-5, dval: 0.0035737568286895328\n",
      "Big value increase: val: 3.0237915885488018e-5, e.val: 2.6573675120048676e-5, max(α): 44.97401748409726\n",
      "====================================\n",
      "1.2031604439405577, 2.357961724530671, 1.4187020088632354, 5.186914148064473, 6.125755528694937, 4.773540751828007, 1.572188404567986, 2.9503712545768868, 4.587549801577747, 5.099925885947031, 4.06920144333411, 4.018720544886544, 1.7257630064495704, 2.960533391206848, 3.424702240223524, 5.805016403131535, 2.1022283564016147, 5.701047770404849, 1.24231542200143, 3.9409465333443885, 3.1157215929978985, 6.738571318177317, 2.0219423235692116, 0.9790019493641903, 6.57271400300139, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 84, value: 1.7004262203584798e-5, best: 1.7004262203584798e-5, dval: 0.0009531191511045513\n",
      "====================================\n",
      "1.203160455856263, 2.3578470354355767, 1.4187018427150393, 5.186856480708287, 6.125641715685997, 4.774344280447737, 1.5721877644959843, 2.950481611479251, 4.587519582687341, 5.100054302938274, 4.069018031213743, 4.0186967542060845, 1.7257632089060488, 2.960967756334863, 3.4251500658288965, 5.805035110322641, 2.1022283564016147, 5.700864358284482, 1.2423309435722256, 3.9409467097798867, 3.1158051689549295, 6.7385713143970065, 2.0219423235692116, 0.9788361209988242, 6.572714012504728, 0.97404471593805, 2.151608815883326\n",
      "====================================\n",
      "Start iteration 85, value: 1.6323232516258447e-5, best: 1.6323232516258447e-5, dval: 0.0007009341593940607\n",
      "Start iteration 86, value: 1.9880674885857092e-5, best: 1.6323232516258447e-5, dval: 0.0015308916015358354\n",
      "Big value increase: val: 1.9880674885857092e-5, e.val: 1.6323232516258447e-5, max(α): 32.266750239615426\n",
      "Start iteration 87, value: 0.0002309911049588326, best: 1.6323232516258447e-5, dval: 0.01466577801276081\n",
      "Big value increase: val: 0.0002309911049588326, e.val: 1.6323232516258447e-5, max(α): 40.972414902364086\n",
      "====================================\n",
      "1.203160600941282, 2.357761717940274, 1.4187016079858794, 5.186578674044031, 6.12242344535887, 4.774337525315679, 1.5721888017957932, 2.9510450244007345, 4.5875188168197605, 5.100991522739867, 4.0678870890774155, 4.018679056261335, 1.7274145307006439, 2.9688266324430637, 3.4278179521185783, 5.8058638382471806, 2.1022283564016147, 5.699733416148154, 1.2424048150756617, 3.9409466722529745, 3.1158062054788425, 6.7385713142610975, 2.0219423235692116, 0.978275941316424, 6.572714052529087, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 88, value: 1.4158175985839319e-5, best: 1.4158175985839319e-5, dval: 0.0007100380579378451\n",
      "====================================\n",
      "1.203160494710204, 2.3577679032062266, 1.4187015885799672, 5.186449669190192, 6.122429607401168, 4.774336148241729, 1.5721891536185848, 2.951030643314875, 4.587519314441586, 5.101068134857204, 4.0678964456526225, 4.01868033930996, 1.7260322731030282, 2.9683454087261363, 3.4281302457672895, 5.805860499042641, 2.1022283564016147, 5.699742772723361, 1.2424125790269933, 3.9409466061406557, 3.1157818958010157, 6.738571314268097, 2.0219423235692116, 0.9782010129212116, 6.572714052996248, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 89, value: 1.3499350387923842e-5, best: 1.3499350387923842e-5, dval: 0.0006415383033320787\n",
      "====================================\n",
      "1.2031597017641582, 2.3577902090496585, 1.4187014832778584, 5.186165783065186, 6.122447012490344, 4.774334706597066, 1.5722181587930428, 2.9509813105282254, 4.5875267287063615, 5.101019884553944, 4.067909852274331, 4.018684966351381, 1.726015031699061, 2.9681329800697354, 3.4280995291172642, 5.805857803574088, 2.1022283564016147, 5.69975617934507, 1.242417394627307, 3.940946321629181, 3.115781068182587, 6.738571314274668, 2.0219423235692116, 0.9777240510797917, 6.572714052888813, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 90, value: 1.3145636159956707e-5, best: 1.3145636159956707e-5, dval: 0.0005656594246758011\n",
      "====================================\n",
      "1.2030471928379776, 2.3580629457879807, 1.4187008739266234, 5.185901387687198, 6.1224890448242215, 4.7742386846878215, 1.5724343856349137, 2.950966814318674, 4.5875794253820885, 5.100607522653441, 4.067957417298506, 4.018741541848689, 1.7259929786548942, 2.9681932305304883, 3.42800466049739, 5.805859515265417, 2.1022283564016147, 5.699803744369245, 1.2428579510618036, 3.940944289458467, 3.1157789996795695, 6.738571314298982, 2.0219423235692116, 0.9741784629453824, 6.57271405268257, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 91, value: 1.1819135794062818e-5, best: 1.1819135794062818e-5, dval: 0.00030805825037108145\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "1.203047493808263, 2.3583878826357187, 1.418700847453683, 5.185886811228395, 6.122459518865758, 4.77283132536498, 1.572577959872268, 2.950951017221273, 4.587597908028902, 5.1007421932509525, 4.068031459717497, 4.018808945543063, 1.7259504809703323, 2.9682584639491396, 3.4278838460603027, 5.805862235842653, 2.1022283564016147, 5.699877786788236, 1.2425353926790201, 3.940943653492044, 3.1157808574112336, 6.7385713148811295, 2.0219423235692116, 0.973011125440541, 6.572714052433055, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 92, value: 1.1550483346847343e-5, best: 1.1550483346847343e-5, dval: 0.00037453560382237974\n",
      "====================================\n",
      "1.2030471981809099, 2.358315341156314, 1.418700863956084, 5.185894026079379, 6.1220173097452815, 4.770835151923564, 1.5725392114480816, 2.950846944715487, 4.587603778461026, 5.100687691189386, 4.068057399479844, 4.018793897807661, 1.7259701911788634, 2.9686259911832353, 3.4279455347868515, 5.805880730385328, 2.1022283564016147, 5.699903726550583, 1.242673558895003, 3.940943775991959, 3.115784963042348, 6.7385713152548, 2.0219423235692116, 0.9729058824516909, 6.572714052467417, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 93, value: 1.1249373350907519e-5, best: 1.1249373350907519e-5, dval: 0.0003882982822762046\n",
      "Start iteration 94, value: 1.7476894702766647e-5, best: 1.1249373350907519e-5, dval: 0.00148170802504477\n",
      "Big value increase: val: 1.7476894702766647e-5, e.val: 1.1249373350907519e-5, max(α): 76.07278476464849\n",
      "====================================\n",
      "1.2030464185200964, 2.358314326262104, 1.4187008488517268, 5.185882896354505, 6.122017505739314, 4.764328483384494, 1.5725481648308135, 2.950836880776189, 4.587642437531423, 5.100407664105394, 4.068059391433924, 4.0187936872817716, 1.7260833116662855, 2.970779141897643, 3.428408409154713, 5.8064272612831935, 2.1022283564016147, 5.699905718504663, 1.2435241975503037, 3.940943761743833, 3.1158415404576845, 6.738571315403073, 2.0219423235692116, 0.9726021239739597, 6.572714052412859, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 95, value: 1.052503060364399e-5, best: 1.052503060364399e-5, dval: 0.00055677328321313\n",
      "====================================\n",
      "1.2030469599886817, 2.3583143679023144, 1.418700846382526, 5.185881368471738, 6.122006006102656, 4.764631442556056, 1.5725523253772544, 2.9508408224622618, 4.5876468955231395, 5.100183774130332, 4.068053474420643, 4.018793695919462, 1.7261946864001336, 2.9711184340310526, 3.428450554685145, 5.806723268630648, 2.1022283564016147, 5.699899801491382, 1.2429948352160383, 3.940943760233635, 3.115860295517776, 6.738571315261472, 2.0219423235692116, 0.9725716187842584, 6.572714052365482, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 96, value: 1.0272247972496763e-5, best: 1.0272247972496763e-5, dval: 0.0004297304819501761\n",
      "====================================\n",
      "1.2030485259949846, 2.3583143577518078, 1.418700471787948, 5.185875914310124, 6.121557857100006, 4.76441665141966, 1.5725635227452743, 2.950847707141359, 4.587673977231211, 5.100181791370028, 4.068014957756452, 4.018793693813879, 1.7264963803913447, 2.9711070628653995, 3.428530770013534, 5.806744967156089, 2.1022283564016147, 5.699861284827191, 1.2427283176326236, 3.9409437503414084, 3.11589231768196, 6.738571314933724, 2.0219423235692116, 0.9724123093886347, 6.572714052311545, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 97, value: 9.984946194121968e-6, best: 9.984946194121968e-6, dval: 0.0003882036135541803\n",
      "Start iteration 98, value: 1.0291591081101282e-5, best: 9.984946194121968e-6, dval: 0.0006302428077675122\n",
      "====================================\n",
      "1.2030685491466442, 2.3583143485561853, 1.4186997704415538, 5.185784163714994, 6.120965621018811, 4.763190950454689, 1.5725796885222965, 2.9508570774148812, 4.587792386633813, 5.100189724107109, 4.067981086083766, 4.018793691906373, 1.7271979276568037, 2.971198217833052, 3.4287781282394665, 5.806721445601447, 2.1022283564016147, 5.699827413154505, 1.2427500767820674, 3.9409434574419313, 3.1158929987295387, 6.7385713136548215, 2.0219423235692116, 0.9697249029895632, 6.572714052240834, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 99, value: 9.55549035054501e-6, best: 9.55549035054501e-6, dval: 0.0004146696901221776\n",
      "====================================\n",
      "1.2030778732070573, 2.3583144094083606, 1.418700497196996, 5.185752722777792, 6.121014187426249, 4.762326889304898, 1.57258164218452, 2.9508590532475707, 4.587749988421321, 5.100437997835999, 4.0679830696834856, 4.018793695301276, 1.7271818017919167, 2.971352228279771, 3.428779374672622, 5.806723422789832, 2.1022283564016147, 5.699829396754224, 1.2427450182254116, 3.9409435065434297, 3.115892270001774, 6.738571312604931, 2.0219423235692116, 0.9704106645745504, 6.572714052189269, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 100, value: 9.402775982997359e-6, best: 9.402775982997359e-6, dval: 0.0003222598752648971\n",
      "====================================\n",
      "1.2030785766751266, 2.3583144903383713, 1.4187008294095511, 5.184957622525619, 6.121006926768902, 4.7606979740808235, 1.5725843906134693, 2.950863211655483, 4.587741841225593, 5.100414463754255, 4.067984415372261, 4.018793699816308, 1.7271965946899428, 2.9718893074571926, 3.4287838037341825, 5.806725675990878, 2.1022283564016147, 5.699830742443, 1.2427467761180608, 3.940943488528445, 3.115882930168555, 6.738571311306782, 2.0219423235692116, 0.9703396175884377, 6.572714051477579, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 101, value: 9.156616557597774e-6, best: 9.156616557597774e-6, dval: 0.00042926120231809306\n",
      "====================================\n",
      "1.2030829973914676, 2.358314436225675, 1.4187007543892531, 5.185272206913691, 6.120999260974841, 4.759202083958436, 1.572599398005783, 2.950942254010051, 4.587746527466093, 5.100381440169566, 4.0679843479240105, 4.018793696797396, 1.727248097032592, 2.9740556619565943, 3.4288015152131797, 5.8067281555873596, 2.1022283564016147, 5.699830674994749, 1.2427493761224053, 3.9409434521471085, 3.1158569080684484, 6.738571303097324, 2.0219423235692116, 0.9702539648185076, 6.572714044727085, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 102, value: 8.955027267847375e-6, best: 8.955027267847375e-6, dval: 0.00045105547813933597\n",
      "====================================\n",
      "1.2030876466990446, 2.358314344798744, 1.418700673646225, 5.185174368425649, 6.120989832528343, 4.758621887446079, 1.5726248705082482, 2.9508878518821726, 4.5877517884167585, 5.100219267084082, 4.06798428021152, 4.018793691696748, 1.727340207508388, 2.973319824363735, 3.4288573516307768, 5.806736503652766, 2.1022283564016147, 5.699830607282259, 1.2427539113051211, 3.940943403483865, 3.115785511788952, 6.738571291870465, 2.0219423235692116, 0.9701436765671174, 6.572714020238719, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 103, value: 8.825885686855324e-6, best: 8.825885686855324e-6, dval: 0.00040135777934170724\n",
      "====================================\n",
      "1.2031221427316023, 2.358313986798703, 1.4187005429341573, 5.185192170493037, 6.120966237981871, 4.757129778493408, 1.5726916067099075, 2.9508035562125134, 4.587760320704283, 5.100224081748597, 4.0679841551738845, 4.018793671724163, 1.7278878008687004, 2.9734110234151974, 3.429308285599861, 5.806796049299934, 2.1022283564016147, 5.699830482244623, 1.242766699670273, 3.9409433201161628, 3.115725996131709, 6.738571256057892, 2.0219423235692116, 0.9699397692419165, 6.572713271257969, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 104, value: 8.527257527724662e-6, best: 8.527257527724662e-6, dval: 0.0003786557114096867\n",
      "Start iteration 105, value: 1.438085208919757e-5, best: 8.527257527724662e-6, dval: 0.00208759307023686\n",
      "Big value increase: val: 1.438085208919757e-5, e.val: 8.527257527724662e-6, max(α): 46.86327374736829\n",
      "====================================\n",
      "1.203134086524506, 2.358313311584806, 1.4187005011033573, 5.185193119181579, 6.120724339431015, 4.752300607717012, 1.5730318889289943, 2.9508923316255444, 4.587794801119533, 5.100225766846643, 4.067455544040171, 4.018793634054426, 1.727886218816695, 2.973740968324707, 3.431596695476961, 5.807545562088703, 2.1022283564016147, 5.6993018711109205, 1.2427666480362978, 3.9409425737081394, 3.1156212425990657, 6.738571261229977, 2.0219423235692116, 0.969663742701943, 6.572710079769924, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 106, value: 8.315523299777423e-6, best: 8.315523299777423e-6, dval: 0.0006812959337558176\n",
      "====================================\n",
      "1.2031388658629132, 2.3583134321000805, 1.4187004983117688, 5.185188849848258, 6.1206017069478555, 4.749486520697452, 1.5734004947884868, 2.9508986690288705, 4.587798318290119, 5.100222826690942, 4.067495021653115, 4.0187936407778935, 1.7279384086493321, 2.9740123663608946, 3.430519788847224, 5.807746462670674, 2.1022283564016147, 5.6993413487238636, 1.2427658024207602, 3.940942241977952, 3.1156256394085142, 6.738571267959693, 2.0219423235692116, 0.9696465739018614, 6.57270108807536, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 107, value: 7.712058719452477e-6, best: 7.712058719452477e-6, dval: 0.0005192982965193105\n",
      "====================================\n",
      "1.2031429367086022, 2.3583134545241378, 1.4187004954187823, 5.185172957866826, 6.120500685449742, 4.749916941883708, 1.5733230169882721, 2.950900554359361, 4.587808463371443, 5.1002188178676, 4.067470135758856, 4.018793642028917, 1.7281022119771174, 2.9751282112745825, 3.4305398822125666, 5.808122165662663, 2.1022283564016147, 5.6993164628296045, 1.242765777188274, 3.9409416256729646, 3.115630562888919, 6.738571264697827, 2.0219423235692116, 0.9696248980010898, 6.57269502505559, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 108, value: 7.461517872322842e-6, best: 7.461517872322842e-6, dval: 0.0004811032271333218\n",
      "====================================\n",
      "1.2031958398645939, 2.3583134812180298, 1.4187004856870538, 5.185126700793443, 6.12023956566005, 4.749639621252483, 1.5733620143126814, 2.9509029091934793, 4.587829258067662, 5.10020850698544, 4.067439211144697, 4.018793643518151, 1.7285569796048044, 2.975398740739681, 3.430567455206746, 5.807879878620852, 2.1022283564016147, 5.699285538215445, 1.2427655911943623, 3.940940731505466, 3.1156297831589903, 6.738571256552366, 2.0219423235692116, 0.9695955769851192, 6.572629031772073, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 109, value: 7.206618460228328e-6, best: 7.206618460228328e-6, dval: 0.0002845838557607632\n",
      "Start iteration 110, value: 1.9443819129049935e-5, best: 7.206618460228328e-6, dval: 0.002133915436335957\n",
      "Big value increase: val: 1.9443819129049935e-5, e.val: 7.206618460228328e-6, max(α): 279.9554689545299\n",
      "====================================\n",
      "1.2031954011141266, 2.358313481393982, 1.4187002894002947, 5.184934066466935, 6.11863299539993, 4.7479939543604255, 1.5735860632966838, 2.9509127055527764, 4.5886499308338555, 5.100204602086593, 4.06732792558673, 4.018793643527967, 1.7286808364601993, 2.975674892772128, 3.430677588517469, 5.8078319440621655, 2.1022283564016147, 5.699174252657478, 1.2427659399034217, 3.940930884580415, 3.1156276585937963, 6.738571234742279, 2.0219423235692116, 0.9692179156226697, 6.572625223583489, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 111, value: 7.096203550300405e-6, best: 7.096203550300405e-6, dval: 0.00044519186901761736\n",
      "====================================\n",
      "1.2031949438807645, 2.3583134820900185, 1.4187002804178017, 5.18489457122982, 6.118796755408941, 4.747688396220857, 1.5735787587763124, 2.9509169617847735, 4.588687614865477, 5.100201710299536, 4.0673379374473075, 4.018793643566799, 1.7287538857697065, 2.9776070679267637, 3.4307201846706814, 5.807848078735448, 2.1022283564016147, 5.699184264518056, 1.24276627780786, 3.940930397879802, 3.1156270465526865, 6.738571197069408, 2.0219423235692116, 0.9692015592924864, 6.572667872859345, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 112, value: 6.620040704800078e-6, best: 6.620040704800078e-6, dval: 0.00039080462255604645\n",
      "====================================\n",
      "1.203194854952749, 2.358313481711027, 1.4187002659500694, 5.184708281513603, 6.118830476512163, 4.746649657705865, 1.5735831013693933, 2.950930682869995, 4.588748438588802, 5.100193240706054, 4.06733925269372, 4.018793643545655, 1.728917711022826, 2.977665034645947, 3.431054080707764, 5.80786963891796, 2.1022283564016147, 5.699185579764468, 1.2427713309035437, 3.940929595249991, 3.115624359292833, 6.7385708414617715, 2.0219423235692116, 0.9691756484508514, 6.5727574354317095, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 113, value: 6.416880985820901e-6, best: 6.416880985820901e-6, dval: 0.0002606608516203049\n",
      "====================================\n",
      "1.2031946643668743, 2.3583134817153524, 1.4187000948075037, 5.184560992825198, 6.118836560668658, 4.742139264438107, 1.5735956488732625, 2.9509908815133334, 4.590186657408787, 5.100153722682857, 4.067380588120128, 4.018793643545896, 1.7294344164056028, 2.97777782755474, 3.431613130073982, 5.807899811510028, 2.1022283564016147, 5.699226915190877, 1.242775115968951, 3.9405938894615473, 3.115583746675226, 6.738570210644361, 2.0219423235692116, 0.968690283841864, 6.572738891559473, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 114, value: 5.844939896857796e-6, best: 5.844939896857796e-6, dval: 0.0003151645645901313\n",
      "====================================\n",
      "1.203194795979809, 2.3583134817197022, 1.4187000824620117, 5.1846154901143935, 6.118831320378497, 4.737810281844561, 1.5736663618438609, 2.950955039519996, 4.590314273973518, 5.100038625184316, 4.067536494828058, 4.0187936435461395, 1.7307069979924918, 2.977905424701044, 3.431974673116072, 5.807954799899682, 2.1022283564016147, 5.699382821898811, 1.2427748932588256, 3.940460594606619, 3.115363079269213, 6.738568366929648, 2.0219423235692116, 0.9686018520376393, 6.572712557039534, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 115, value: 5.565961475333702e-6, best: 5.565961475333702e-6, dval: 0.00037811860164255195\n",
      "Start iteration 116, value: 5.6002128837898316e-6, best: 5.565961475333702e-6, dval: 0.000761845674728423\n",
      "====================================\n",
      "1.2031953954709524, 2.3583134817873823, 1.4187000876016334, 5.184653311036163, 6.118786887498044, 4.734789673597899, 1.5743499866975328, 2.9507052187264216, 4.590280950045033, 5.100061154928821, 4.066869555101258, 4.018793643552191, 1.730370708603871, 2.980173911613285, 3.4327077458433966, 5.808575778098789, 2.1022283564016147, 5.698715882171995, 1.2427579784814355, 3.9401382629666397, 3.1150752635913306, 6.738564383532947, 2.0219423235692116, 0.9685790867993173, 6.572714934550799, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 117, value: 4.9216118222345726e-6, best: 4.9216118222345726e-6, dval: 0.0002683617378463839\n",
      "====================================\n",
      "1.203195501845369, 2.3583134817974716, 1.4187000787696558, 5.184636304695781, 6.11876895233543, 4.734787472756795, 1.5741729201016645, 2.9507027630013773, 4.590292736392712, 5.10005129514699, 4.066145263948715, 4.01879364355369, 1.7305532103374883, 2.980551363528187, 3.432642156187757, 5.8087246123908765, 2.1022283564016147, 5.697991591019436, 1.2427620596370001, 3.939923215353205, 3.1150842215017702, 6.738565152885252, 2.0219423235692116, 0.9685585468832966, 6.57271486725134, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 118, value: 4.783909764173966e-6, best: 4.783909764173966e-6, dval: 0.00016779916514281235\n",
      "====================================\n",
      "1.2031955064404516, 2.358313481817626, 1.4186999935964104, 5.184509464389784, 6.118766827579271, 4.734782265137743, 1.574238417377215, 2.950697860134918, 4.590529540755079, 5.100038882051105, 4.0664047430038215, 4.018793643556685, 1.7308588203708206, 2.981071297845068, 3.4325963959245884, 5.8088264761894655, 2.1022283564016147, 5.698251070074548, 1.2427730629731404, 3.938916863863601, 3.1150831698111885, 6.738569658974678, 2.0219423235692116, 0.9684741104852541, 6.572714744085708, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 119, value: 4.588140197833231e-6, best: 4.588140197833231e-6, dval: 0.00018809984010921446\n",
      "====================================\n",
      "1.2031955111879147, 2.3583134818260807, 1.4186999813771954, 5.18402098508643, 6.118764324578161, 4.734766917694142, 1.5741969821169681, 2.950692617264025, 4.590752193863816, 5.100040754773099, 4.0662621682138775, 4.018793643557942, 1.730952874405348, 2.982069527639075, 3.43263300087982, 5.8100400877882326, 2.1022283564016147, 5.698108495284601, 1.2427960454657057, 3.938712025898385, 3.1150842035790256, 6.738579566319997, 2.0219423235692116, 0.9684188442203713, 6.572714825531556, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 120, value: 4.5660817361146154e-6, best: 4.5660817361146154e-6, dval: 0.0004112109483888119\n",
      "Start iteration 121, value: 4.601857911375286e-6, best: 4.5660817361146154e-6, dval: 0.0004757134763580251\n",
      "====================================\n",
      "1.2031955084159354, 2.3583134818257387, 1.418699979662136, 5.183677227472083, 6.118537694116358, 4.734704760583046, 1.5741842237708903, 2.9506625126270825, 4.591068776441807, 5.10005056376826, 4.066097590681465, 4.018793643557891, 1.7307816854605742, 2.981888932243915, 3.4327090594730976, 5.809510593899766, 2.1022283564016147, 5.697943917752186, 1.242858208347017, 3.9385589234873333, 3.115126864795314, 6.738642106221066, 2.0219423235692116, 0.9683648181960013, 6.5727156487236424, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 122, value: 4.3204611721146575e-6, best: 4.3204611721146575e-6, dval: 0.00011770814515432715\n",
      "====================================\n",
      "1.2031955053391656, 2.3583134818294225, 1.4186999958575628, 5.183675746855256, 6.118474181176217, 4.734678251756438, 1.574183926302356, 2.9506504879259032, 4.5912704465627145, 5.10004940226128, 4.06614102343515, 4.018793643557989, 1.7307287165465228, 2.9820851552358416, 3.4327359539009312, 5.809579605562952, 2.1022283564016147, 5.697987350505872, 1.2428953884161504, 3.938556046414561, 3.1152932306235397, 6.738667550951448, 2.0219423235692116, 0.9683328169174652, 6.57271580660421, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 123, value: 4.264825061017006e-6, best: 4.264825061017006e-6, dval: 0.00010177378006238219\n",
      "====================================\n",
      "1.2031954929220172, 2.358313481848881, 1.4187000594389423, 5.1836738115212535, 6.118203403838649, 4.731247952181861, 1.5741842180646475, 2.950645890547007, 4.592021777781316, 5.1000471001408805, 4.066139805739962, 4.018793643558505, 1.7303380435424123, 2.983338443679296, 3.4328390167499006, 5.809608643075621, 2.1022283564016147, 5.697986132810684, 1.2429174476112355, 3.9385530141691834, 3.1153443310417144, 6.738690564522919, 2.0219423235692116, 0.9676884972448849, 6.572715765321235, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 124, value: 4.042089852563923e-6, best: 4.042089852563923e-6, dval: 0.00036006377215741514\n",
      "====================================\n",
      "1.2031954876076512, 2.3583134819863605, 1.4187000358474344, 5.183670821533729, 6.117629869345248, 4.731519753238868, 1.5741846168639406, 2.950640399036779, 4.592148417448195, 5.1000446154903765, 4.066138580500493, 4.018793643562151, 1.7306764403181016, 2.9843473698968235, 3.4329605420359313, 5.809646330484105, 2.1022283564016147, 5.697984907571215, 1.24296105851342, 3.9385542162023133, 3.1154107900027728, 6.738671126215392, 2.0219423235692116, 0.967530352683928, 6.572715723418451, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 125, value: 3.825991505665764e-6, best: 3.825991505665764e-6, dval: 0.000187603638828953\n",
      "Start iteration 126, value: 3.921848371858656e-6, best: 3.825991505665764e-6, dval: 0.00034148980845043143\n",
      "====================================\n",
      "1.2031954537336564, 2.3583135070514816, 1.4186999965289395, 5.183490976491323, 6.116999675367165, 4.730897686178638, 1.574186600473006, 2.9506532195587383, 4.592217943619456, 5.100040205549828, 4.066136371113663, 4.018793645641853, 1.730924273571619, 2.984156022565789, 3.433549522235554, 5.809621060656292, 2.1022283564016147, 5.697982698184385, 1.2431044201850745, 3.9385527563350187, 3.1153848550966092, 6.738635178212854, 2.0219423235692116, 0.9673166326307264, 6.5727154873541895, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 127, value: 3.7049206554326864e-6, best: 3.7049206554326864e-6, dval: 0.00021282850127241418\n",
      "Start iteration 128, value: 5.161749822253997e-6, best: 3.7049206554326864e-6, dval: 0.0012457115911169159\n",
      "Big value increase: val: 5.161749822253997e-6, e.val: 3.7049206554326864e-6, max(α): 352.07472051211295\n",
      "====================================\n",
      "1.2031954372550422, 2.3583135174920806, 1.4187000133128338, 5.183449063885127, 6.117389219910052, 4.727567989940469, 1.5742001818937807, 2.9506615205671323, 4.592217617873725, 5.1000072621293455, 4.0661392184442935, 4.01879365312636, 1.7313751146471568, 2.986174750959092, 3.4335475316414117, 5.809647355314724, 2.1022283564016147, 5.6979855455150155, 1.2429316002970747, 3.938551924025647, 3.115366509754874, 6.738635229333803, 2.0219423235692116, 0.9670988668062606, 6.57271497116121, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 129, value: 3.6451841596642526e-6, best: 3.6451841596642526e-6, dval: 0.0003623040374768614\n",
      "====================================\n",
      "1.2031954431627512, 2.3583135180111077, 1.418699955202008, 5.183448302765776, 6.1172174763068465, 4.725397957703136, 1.5742040722408888, 2.9506634056570396, 4.592219887214799, 5.100005497973507, 4.066138242517201, 4.018793653498432, 1.73137786082639, 2.9850426826701315, 3.433555192337907, 5.809654028413277, 2.1022283564016147, 5.6979845695879225, 1.2429272976510135, 3.938551050777422, 3.1153293066515495, 6.738635095386803, 2.0219423235692116, 0.9669974267531681, 6.5727148827749815, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 130, value: 3.404294321733758e-6, best: 3.404294321733758e-6, dval: 0.00021786967190220996\n",
      "====================================\n",
      "1.2031954419044923, 2.3583135188423983, 1.418699910981605, 5.183448587958377, 6.117145689855672, 4.725361971791545, 1.574213201761547, 2.9506645403241194, 4.592220671952284, 5.100002467358017, 4.066138060668048, 4.018793654094354, 1.7313808281078864, 2.985046291436605, 3.433592062899579, 5.809690957821844, 2.1022283564016147, 5.69798438773877, 1.2429307139114054, 3.93855052852634, 3.115318023883904, 6.738634909974711, 2.0219423235692116, 0.9669343713799342, 6.572714552310111, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 131, value: 3.376342123406114e-6, best: 3.376342123406114e-6, dval: 0.00020163372991399697\n",
      "====================================\n",
      "1.2031954377587235, 2.35831352678107, 1.4186996867195234, 5.183448517817223, 6.1169140109940425, 4.72530694361636, 1.5745765645719114, 2.950666721811539, 4.592224587692507, 5.099707833172786, 4.066137895340838, 4.018793659785303, 1.7315650644682004, 2.985050054084466, 3.4342748810101185, 5.8099920254468955, 2.1022283564016147, 5.69798422241156, 1.2429409618702567, 3.9385463177992373, 3.115294948202703, 6.7386163214007215, 2.0219423235692116, 0.9663815717864264, 6.572705364237306, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 132, value: 3.2255539577800765e-6, best: 3.2255539577800765e-6, dval: 0.0001652508387410337\n",
      "Start iteration 133, value: 3.596031681294771e-6, best: 3.2255539577800765e-6, dval: 0.0005689567684018923\n",
      "Big value increase: val: 3.596031681294771e-6, e.val: 3.2255539577800765e-6, max(α): 20.769540860375955\n",
      "====================================\n",
      "1.2031954393825284, 2.3583135898223393, 1.4186999950794734, 5.183447243769138, 6.116753098114709, 4.725117929968635, 1.5746244588405662, 2.950675050273537, 4.592221948736543, 5.099788368659111, 4.06613816733448, 4.018793704977328, 1.7317009163686814, 2.98506208002961, 3.434157614987099, 5.810000970875091, 2.1022283564016147, 5.697984494405202, 1.2429385354561084, 3.9385466041930637, 3.1151836174946634, 6.738617653441199, 2.0219423235692116, 0.9665342109984145, 6.572698189087675, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 134, value: 3.1807013010681106e-6, best: 3.1807013010681106e-6, dval: 0.0001609098563782503\n",
      "====================================\n",
      "1.2031954403512053, 2.358315601259507, 1.4187004277076756, 5.183443132447838, 6.116788973535363, 4.724633746176673, 1.5746306618378214, 2.9506732158718134, 4.5922205637155065, 5.099832738152474, 4.06613820825929, 4.018795146904476, 1.731811326112382, 2.9850687578236648, 3.4341301700487312, 5.810004798273785, 2.1022283564016147, 5.697984535330012, 1.2429386585013005, 3.938546716001585, 3.11516218705624, 6.738618143722316, 2.0219423235692116, 0.9665647341649601, 6.572697116159357, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 135, value: 3.1480813317258773e-6, best: 3.1480813317258773e-6, dval: 0.00015060974945257238\n",
      "Start iteration 136, value: 3.229852204235798e-6, best: 3.1480813317258773e-6, dval: 0.0006335167124071894\n",
      "Start iteration 137, value: 2.229820819171282e-5, best: 3.1480813317258773e-6, dval: 0.004390537798068861\n",
      "Big value increase: val: 2.229820819171282e-5, e.val: 3.229852204235798e-6, max(α): 14.05670987365138\n",
      "====================================\n",
      "1.203195441135837, 2.3582993165532, 1.4187420289520023, 5.183566085242112, 6.116954514419351, 4.718843128826198, 1.574593830166362, 2.950647261171092, 4.592205013285376, 5.099710675795892, 4.066139019085445, 4.018804734634457, 1.7334167215057412, 2.985216276217626, 3.4341280418411775, 5.810204766586748, 2.1022283564016147, 5.697985346156167, 1.2429462540180591, 3.9385469855125645, 3.1151108823542932, 6.738618688207158, 2.0219423235692116, 0.9666478895715438, 6.572697399535041, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 138, value: 2.980403100012532e-6, best: 2.980403100012532e-6, dval: 0.0003386116541403972\n",
      "====================================\n",
      "1.2031954417258937, 2.358303783804597, 1.4187470466972978, 5.18356797273859, 6.116924154998181, 4.718833257067119, 1.5746185360583833, 2.950635041663421, 4.592204514008515, 5.099761870525475, 4.066140109065897, 4.018804888499751, 1.732766373945119, 2.985231523051607, 3.434138703493803, 5.810237363551391, 2.1022283564016147, 5.697986436136619, 1.2429537969300701, 3.9385468068188856, 3.115107227927077, 6.738618689397499, 2.0219423235692116, 0.9666345852347616, 6.572697414733629, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 139, value: 2.8588358691777656e-6, best: 2.8588358691777656e-6, dval: 0.00015998967376941453\n",
      "Start iteration 140, value: 2.895255901993722e-6, best: 2.8588358691777656e-6, dval: 0.00025445029316707723\n",
      "====================================\n",
      "1.203195444321352, 2.3583404736581297, 1.4187550424684179, 5.183557918015437, 6.116909937456674, 4.718807660155298, 1.5748205649107916, 2.9506304822692617, 4.592203994376939, 5.099760317753775, 4.066236382060048, 4.0188074374798965, 1.7327644562838687, 2.9854065138969847, 3.4345205923506517, 5.810279829154677, 2.1022283564016147, 5.698082709130769, 1.2430757424271457, 3.9385464088119537, 3.115101244072425, 6.738618688842195, 2.0219423235692116, 0.9666262414285631, 6.572697417620971, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 141, value: 2.8083122268961227e-6, best: 2.8083122268961227e-6, dval: 0.00011903780112899204\n",
      "====================================\n",
      "1.2031954463161072, 2.3583479627180086, 1.418758033841857, 5.183549451227765, 6.116904676808783, 4.718793332480227, 1.5748054605586639, 2.9506305556665864, 4.592204245417951, 5.099761045229818, 4.066220041639606, 4.0188085411115075, 1.7327637520915047, 2.985603523204819, 3.4344943262572247, 5.81032330650629, 2.1022283564016147, 5.698066368710327, 1.2430498338120022, 3.938545001673969, 3.1150611473541283, 6.738618688733533, 2.0219423235692116, 0.9666248085990055, 6.572697416968549, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 142, value: 2.7896995643335326e-6, best: 2.7896995643335326e-6, dval: 0.00013601460360650663\n",
      "====================================\n",
      "1.2031954586069844, 2.3583713415158467, 1.4187619040125496, 5.183490132140425, 6.116848790570154, 4.716867382525358, 1.57480211291788, 2.9506304887313473, 4.592204621237089, 5.099763612799886, 4.066187718887859, 4.018811986347724, 1.7327642021330665, 2.9858129637803508, 3.434506236778511, 5.810289236672923, 2.1022283564016147, 5.69803404595858, 1.2430266498734008, 3.93853879707121, 3.1148858029641415, 6.73861868840313, 2.0219423235692116, 0.966623162280009, 6.572697415249302, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 143, value: 2.696925654759122e-6, best: 2.696925654759122e-6, dval: 0.00016401271604221668\n",
      "Start iteration 144, value: 2.742099145871499e-6, best: 2.696925654759122e-6, dval: 0.00023993557987826806\n",
      "Start iteration 145, value: 2.92237194650264e-6, best: 2.696925654759122e-6, dval: 0.0003267828812335144\n",
      "====================================\n",
      "1.2031954845745365, 2.358403397068905, 1.4187386770858221, 5.183199704864008, 6.1164719306731605, 4.715171365708135, 1.5748985745876567, 2.9506303264821385, 4.592211638252381, 5.099755248019333, 4.065781632530069, 4.018816710241275, 1.7327656254990162, 2.987208823916651, 3.434583158269634, 5.810398539452927, 2.1022283564016147, 5.697627959600791, 1.2431147187938223, 3.93843799829507, 3.114951971879375, 6.738618686767765, 2.0219423235692116, 0.9665784209102298, 6.572697405838199, 0.97404471593805, 2.1516088158833266\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 146, value: 2.6099545004586532e-6, best: 2.6099545004586532e-6, dval: 0.00021667628431487965\n",
      "====================================\n",
      "1.2031954901865718, 2.358400029198581, 1.4187286651258035, 5.183196714037536, 6.116457290453204, 4.715191087229221, 1.5749437455087563, 2.9506297484692197, 4.5922182221236225, 5.099745333607911, 4.065785102870868, 4.018815099886507, 1.732767620410246, 2.986963471019396, 3.434764502689721, 5.810527671932111, 2.1022283564016147, 5.69763142994159, 1.2432564665650654, 3.9383616021842833, 3.114961037781944, 6.738618669172167, 2.0219423235692116, 0.9665408812561755, 6.572697330806095, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 147, value: 2.542648647462854e-6, best: 2.542648647462854e-6, dval: 0.00020239884042533296\n",
      "Start iteration 148, value: 2.97123369055443e-6, best: 2.542648647462854e-6, dval: 0.0007095761099381384\n",
      "Big value increase: val: 2.97123369055443e-6, e.val: 2.542648647462854e-6, max(α): 24.76826511205028\n",
      "====================================\n",
      "1.20319549459285, 2.358400140977091, 1.4186845660877487, 5.183185528594582, 6.116407619888692, 4.715144207525238, 1.5750586381947163, 2.950601719450192, 4.59229962504958, 5.09963824094206, 4.065804338461339, 4.018815153333653, 1.7330824123857707, 2.9870374657771364, 3.4351355111459103, 5.810691746478388, 2.1022283564016147, 5.697650665532061, 1.243242414403416, 3.9382478808202377, 3.1150109577949343, 6.738618613777131, 2.0219423235692116, 0.966492131341958, 6.572697281350334, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 149, value: 2.4612149733869812e-6, best: 2.4612149733869812e-6, dval: 0.00010609544534026516\n",
      "====================================\n",
      "1.2031955044101048, 2.3584004121258793, 1.4186651077803782, 5.1831371296966005, 6.1163384786209685, 4.715075829945439, 1.5750958179057026, 2.950604420207579, 4.593706763680074, 5.0996573586173035, 4.065850856997311, 4.018815282984056, 1.7331123939083277, 2.9870551788816058, 3.4350549392238263, 5.810701697056862, 2.1022283564016147, 5.697697184068033, 1.2432244964582522, 3.938202598712931, 3.1150027114480947, 6.738618615863309, 2.0219423235692116, 0.9664782790538555, 6.572697255050802, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 150, value: 2.4292562748845817e-6, best: 2.4292562748845817e-6, dval: 0.00014640399291726905\n",
      "====================================\n",
      "1.2031955262254317, 2.3584029665543973, 1.418681041911169, 5.183032590076782, 6.116248215187666, 4.71411059526102, 1.5750808264802418, 2.9506031640814503, 4.5930838002843855, 5.099688116541148, 4.066393755019661, 4.018816504389791, 1.7331009666797905, 2.9870799609540875, 3.434992827431576, 5.810720612877589, 2.1022283564016147, 5.698240082090383, 1.2431676093700097, 3.9382154107005283, 3.114954931561276, 6.738618615181553, 2.0219423235692116, 0.9664854989308006, 6.572697217866235, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 151, value: 2.362458217727559e-6, best: 2.362458217727559e-6, dval: 0.0001725963319230727\n",
      "Start iteration 152, value: 2.4026616752069165e-6, best: 2.362458217727559e-6, dval: 0.0003959893455499075\n",
      "====================================\n",
      "1.2031955512298356, 2.358401617138616, 1.418685152039897, 5.182684187254037, 6.116135018509882, 4.712247063355187, 1.5750306563787384, 2.9506008214328086, 4.593112360303021, 5.099630121307201, 4.066238353892118, 4.018815859163603, 1.7331191366007934, 2.9871024661888628, 3.435093509483189, 5.810890169213079, 2.1022283564016147, 5.69808468096284, 1.2431484217626612, 3.9382144736422227, 3.1149456935362965, 6.738618613756653, 2.0219423235692116, 0.9664862162621723, 6.57269702192632, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 153, value: 2.268444950865519e-6, best: 2.268444950865519e-6, dval: 0.00018622265289852669\n",
      "Start iteration 154, value: 3.0071067748677956e-6, best: 2.268444950865519e-6, dval: 0.0009253908373043074\n",
      "Big value increase: val: 3.0071067748677956e-6, e.val: 2.268444950865519e-6, max(α): 1402.613590374382\n",
      "Start iteration 155, value: 3.7107241968105834e-6, best: 2.268444950865519e-6, dval: 0.000997472528237564\n",
      "Big value increase: val: 3.7107241968105834e-6, e.val: 2.268444950865519e-6, max(α): 93.0183166047013\n",
      "Start iteration 156, value: 2.3051360126418815e-6, best: 2.268444950865519e-6, dval: 0.00044799598881295477\n",
      "====================================\n",
      "1.2031955512339187, 2.3584018488421563, 1.4186851633528446, 5.18268989209513, 6.11598295604265, 4.707920130135555, 1.5750340985025684, 2.950603283491152, 4.5931037412890525, 5.09864670829912, 4.066442375226162, 4.018815991517372, 1.733148692997558, 2.987494087958318, 3.435824644390313, 5.811346173055909, 2.1022283564016147, 5.698288702296885, 1.2431140557166545, 3.9382145551334538, 3.1151289387784833, 6.738618611164002, 2.0219423235692116, 0.966552841047993, 6.572683148884459, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 157, value: 2.209997184538634e-6, best: 2.209997184538634e-6, dval: 0.0003544177191590614\n",
      "Start iteration 158, value: 4.2042094248172545e-6, best: 2.209997184538634e-6, dval: 0.0014376921301566536\n",
      "Big value increase: val: 4.2042094248172545e-6, e.val: 2.209997184538634e-6, max(α): 76.13326741583934\n",
      "====================================\n",
      "1.2031955512347412, 2.358401937710726, 1.4186851613351144, 5.182689127241644, 6.115910626895724, 4.7077126230657615, 1.575058540638576, 2.950719790873255, 4.59330494832157, 5.099167275516748, 4.066399482236891, 4.0188170956220555, 1.7331529683512072, 2.9876233905100715, 3.4357380150998593, 5.811433551454232, 2.1022283564016147, 5.698245809307647, 1.2430676829126421, 3.9382144604387705, 3.11512526075202, 6.738618610602516, 2.0219423235692116, 0.966541720526899, 6.572659014581874, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 159, value: 2.09418118559198e-6, best: 2.09418118559198e-6, dval: 0.0003106535308281533\n",
      "====================================\n",
      "1.2031955512354466, 2.358401959113072, 1.4186851611218034, 5.1826668972147765, 6.115662462176517, 4.707747548606192, 1.5750759051055534, 2.9507306175512427, 4.594221956198743, 5.099164820817645, 4.066362018209123, 4.018817361525177, 1.7331540859918841, 2.98780611627799, 3.4357260865022563, 5.811561842899866, 2.1022283564016147, 5.698208345279906, 1.2430563740536613, 3.9382143260427567, 3.1151246434480666, 6.7386186100799845, 2.0219423235692116, 0.9665403319506576, 6.572646064381898, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 160, value: 2.07122579994766e-6, best: 2.07122579994766e-6, dval: 0.0002864383891291733\n",
      "====================================\n",
      "1.2031955512396741, 2.3584020483142907, 1.418685161241133, 5.182545815383208, 6.11562171412205, 4.707771905808483, 1.5756574706370094, 2.9507548094599487, 4.593576314461021, 5.099159083349377, 4.066380409516968, 4.0188184697627, 1.7331673064470479, 2.9880521616193816, 3.4357331101659203, 5.8114751258920885, 2.1022283564016147, 5.698226736587738, 1.2430497425047042, 3.938214376905136, 3.1151228100194506, 6.738618604556992, 2.0219423235692116, 0.9665416253443746, 6.572619459653006, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 161, value: 2.0685670092935584e-6, best: 2.0685670092935584e-6, dval: 0.0002547670888733977\n",
      "====================================\n",
      "1.2031955513180255, 2.3584020116982467, 1.4186851611836393, 5.1823677680424165, 6.115564307816788, 4.70778469587102, 1.5751772102173573, 2.950744379614495, 4.593822429581778, 5.099163728457775, 4.066381647898824, 4.01881801484432, 1.7332736531031194, 2.9883948691828315, 3.4357424847985976, 5.8115108395425, 2.1022283564016147, 5.698227974969593, 1.2430556956141714, 3.938214388223944, 3.1151143241116452, 6.73861857163369, 2.0219423235692116, 0.9665424295317053, 6.572633192738907, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 162, value: 1.9519336877965703e-6, best: 1.9519336877965703e-6, dval: 0.00017159525978782675\n",
      "Start iteration 163, value: 2.128051638292876e-6, best: 1.9519336877965703e-6, dval: 0.0002268378792006226\n",
      "====================================\n",
      "1.2031955659406832, 2.3584020219365653, 1.4186851610618345, 5.182265915679426, 6.115468796552207, 4.707739975337752, 1.5752381490777616, 2.9507438930912304, 4.595157214660446, 5.0991834315672895, 4.066381100219855, 4.018818505672631, 1.7335019888042393, 2.9883867025122823, 3.435790312801923, 5.811654224037292, 2.1022283564016147, 5.698227427290625, 1.2430585493556938, 3.9382143829373257, 3.115052907073032, 6.738617424863368, 2.0219423235692116, 0.9665421889934465, 6.572631671791415, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 164, value: 1.9288670101437744e-6, best: 1.9288670101437744e-6, dval: 0.00012167601330237421\n",
      "====================================\n",
      "1.2031955776422516, 2.358402024840212, 1.418685161527808, 5.18226048324922, 6.115465566992253, 4.707702537432882, 1.5752426755005164, 2.9507433733824473, 4.594161357801767, 5.099377806000892, 4.066381485637713, 4.0188189897806055, 1.7335125067668717, 2.988395040364295, 3.4359662056443283, 5.811719883847581, 2.1022283564016147, 5.698227812708483, 1.2430660557885638, 3.938214385703497, 3.114955074824931, 6.738609562606103, 2.0219423235692116, 0.9665423716431539, 6.572633092967037, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 165, value: 1.8669608152114968e-6, best: 1.8669608152114968e-6, dval: 0.00011142740380598593\n",
      "====================================\n",
      "1.2031955856435723, 2.358402050304729, 1.4186851616493177, 5.182243959844952, 6.11545672364966, 4.706605805182022, 1.5752480401698312, 2.950742695096042, 4.594145648831481, 5.099325804157296, 4.066387805213813, 4.018823235330149, 1.7335304670682257, 2.988402695649613, 3.4359422554655965, 5.811769861129732, 2.1022283564016147, 5.698234132284583, 1.2430676149276334, 3.9382143852040863, 3.114910729767311, 6.738588687909594, 2.0219423235692116, 0.9665423861575982, 6.572632491711283, 0.97404471593805, 2.1516088158833266\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "====================================\n",
      "Start iteration 166, value: 1.8363204536541594e-6, best: 1.8363204536541594e-6, dval: 0.0001773098602398382\n",
      "Start iteration 167, value: 1.9494859061316904e-6, best: 1.8363204536541594e-6, dval: 0.0003520494447982823\n",
      "====================================\n",
      "1.2031956653695102, 2.3584020685267024, 1.4186851616703817, 5.181862623835869, 6.115231295906783, 4.704262735540799, 1.5753311177333074, 2.950740812022203, 4.594754264606427, 5.099260978720151, 4.066611880458758, 4.018826273372801, 1.7336203390790306, 2.988981755538929, 3.4360207446602, 5.812122800582783, 2.1022283564016147, 5.698458207529521, 1.2430739168197154, 3.9382143803064156, 3.1149154415579092, 6.738492967120693, 2.0219423235692116, 0.9665425998417622, 6.572629353956075, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 168, value: 1.7120873358009236e-6, best: 1.7120873358009236e-6, dval: 0.0002113525370183722\n",
      "====================================\n",
      "1.203195684470489, 2.358402040201806, 1.4186851616797354, 5.1817467100005254, 6.11518389388628, 4.70441843656224, 1.5753353450298224, 2.9507444705142416, 4.5946885387553325, 5.099200123769763, 4.066577782682499, 4.018823695332011, 1.7337691503688217, 2.9890146980085395, 3.4365609943571935, 5.812562779905285, 2.1022283564016147, 5.698424109753263, 1.2430898607295595, 3.9382143807163548, 3.1149169912624015, 6.738472683809089, 2.0219423235692116, 0.9665426242412348, 6.572628528612095, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 169, value: 1.6801991786249051e-6, best: 1.6801991786249051e-6, dval: 0.0001851279916260497\n",
      "====================================\n",
      "1.2031957102930997, 2.358402058804306, 1.4186851616896083, 5.181549525781751, 6.114831080213565, 4.704269507098066, 1.575339991151456, 2.95074894092638, 4.593892106819579, 5.099204139273508, 4.066582746820495, 4.018825388471605, 1.7338904553347103, 2.989062995104901, 3.4362768857546144, 5.812300545463347, 2.1022283564016147, 5.698429073891258, 1.2430813279597803, 3.9382143805004253, 3.1149156186178852, 6.738488250734489, 2.0219423235692116, 0.9665426914527269, 6.572627544692641, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 170, value: 1.6513525525761097e-6, best: 1.6513525525761097e-6, dval: 8.37226626152765e-5\n",
      "====================================\n",
      "1.2031958148856328, 2.3584020534995287, 1.4186851616853546, 5.181586867442356, 6.114966081519405, 4.703855728630664, 1.575344212538248, 2.9507555409329274, 4.594581785352649, 5.099210028502679, 4.066588012550696, 4.01882490564786, 1.7339240976460597, 2.989113099949408, 3.4363683159597587, 5.812416746882986, 2.1022283564016147, 5.69843433962146, 1.2430846385626806, 3.9382143802517184, 3.114888088634694, 6.738505420212399, 2.0219423235692116, 0.9665426387440017, 6.572627649639723, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 171, value: 1.5955375853088476e-6, best: 1.5955375853088476e-6, dval: 4.483240179167791e-5\n",
      "Start iteration 172, value: 1.8958038540561173e-6, best: 1.5955375853088476e-6, dval: 0.0007156313649354096\n",
      "Big value increase: val: 1.8958038540561173e-6, e.val: 1.5955375853088476e-6, max(α): 252.9883001662966\n",
      "====================================\n",
      "1.2031961939530236, 2.3584020535348422, 1.4186851616856022, 5.1815486188925055, 6.114965184893035, 4.701756598607747, 1.575490166459498, 2.95075604798415, 4.595432587764556, 5.09921006647523, 4.066617180958076, 4.018824908861966, 1.7340644416602449, 2.98949631958008, 3.4364105081920377, 5.8125835325189446, 2.1022283564016147, 5.69846350802884, 1.2430861150179728, 3.938214380227722, 3.1148384257574846, 6.738507842968733, 2.0219423235692116, 0.9665426349632728, 6.572627525373573, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 173, value: 1.5165290146840808e-6, best: 1.5165290146840808e-6, dval: 0.00011290857950707611\n",
      "Start iteration 174, value: 1.5336521850528363e-6, best: 1.5165290146840808e-6, dval: 0.00015723949388102287\n",
      "====================================\n",
      "1.203256502401339, 2.358402052074787, 1.418685161685805, 5.181395357695344, 6.114946275886768, 4.700544411918343, 1.5754729894933421, 2.95075614465123, 4.595111083126691, 5.099208920208468, 4.066568257617654, 4.018824698267126, 1.734096814641701, 2.989864550365524, 3.4364350168284434, 5.812627795700343, 2.1022283564016147, 5.698414584688417, 1.243088559493799, 3.938214380249411, 3.114805507793872, 6.738503244017813, 2.0219423235692116, 0.9665426391840775, 6.5726275282464925, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 175, value: 1.4760316877887664e-6, best: 1.4760316877887664e-6, dval: 0.0001642146103956188\n",
      "====================================\n",
      "1.2032624126895535, 2.358402051451419, 1.4186851616857379, 5.1813786037666825, 6.114940021695025, 4.700419513677485, 1.5754750257545125, 2.950756459089493, 4.595190628225621, 5.099206354825913, 4.066556584723764, 4.018824311934671, 1.7345404261342252, 2.989806493834218, 3.436551828489071, 5.8128252534369365, 2.1022283564016147, 5.698402911794528, 1.2431066566388087, 3.938214380242163, 3.114804917626025, 6.738443488006715, 2.0219423235692116, 0.9665426378976415, 6.572627528196531, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 176, value: 1.4268973765462184e-6, best: 1.4268973765462184e-6, dval: 8.943502983121618e-5\n",
      "====================================\n",
      "1.2032579230135982, 2.3584020501811875, 1.4186851616857858, 5.181322604856435, 6.1149250244293025, 4.700287550559113, 1.5754886519461309, 2.950756967223119, 4.595174763298852, 5.099205660639724, 4.066557936484346, 4.018823524708384, 1.7344313858103138, 2.9898117650041645, 3.4366648756475464, 5.812829525943816, 2.1022283564016147, 5.698404263555109, 1.2431226656038867, 3.9382143802243763, 3.1148043079740844, 6.738488643687247, 2.0219423235692116, 0.9665426359614886, 6.572627528246273, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 177, value: 1.4108838938330764e-6, best: 1.4108838938330764e-6, dval: 6.724548475916733e-5\n",
      "====================================\n",
      "1.203202950358611, 2.358402048888226, 1.4186851616859744, 5.181242598076322, 6.114850043106217, 4.699620562210533, 1.5755462254728159, 2.950758868789796, 4.595145083720229, 5.099204155900171, 4.066559710197343, 4.018822723394972, 1.7344400476655883, 2.989817877809143, 3.4366924507696965, 5.812834130543723, 2.1022283564016147, 5.698406037268107, 1.2431217308517108, 3.938214380142172, 3.114802460421999, 6.738532760433395, 2.0219423235692116, 0.9665426341002189, 6.572627528244788, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 178, value: 1.384050715225434e-6, best: 1.384050715225434e-6, dval: 7.49340754043204e-5\n",
      "====================================\n",
      "1.2031997106384387, 2.3584020458331447, 1.4186851616863023, 5.181297768790274, 6.114757900944899, 4.697887765441329, 1.5755604197737778, 2.950759530131454, 4.595142215106552, 5.099161864160196, 4.066562323606195, 4.018820830007578, 1.7344498600316214, 2.989828789702903, 3.436733067080128, 5.8128412875479265, 2.1022283564016147, 5.698408650676959, 1.243122578102248, 3.9382143799286293, 3.1147958069499375, 6.738521187451365, 2.0219423235692116, 0.9665426326504006, 6.572627528245998, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 179, value: 1.350672143399302e-6, best: 1.350672143399302e-6, dval: 0.0001616945718793672\n",
      "Start iteration 180, value: 1.3884681350679033e-6, best: 1.350672143399302e-6, dval: 0.0002412515843649883\n",
      "====================================\n",
      "1.2032073627121085, 2.3584019747607643, 1.4186851616862826, 5.181258991916423, 6.114767337400139, 4.697136009377667, 1.5758186609609175, 2.9507679864658107, 4.595140169389364, 5.09903074313741, 4.066574553549153, 4.018739890176445, 1.7344743781942993, 2.9899038253920636, 3.4368833654586024, 5.812940104053309, 2.1022283564016147, 5.698420880619917, 1.2431319523972701, 3.9382143798074773, 3.1147827012873646, 6.738501789485278, 2.0219423235692116, 0.9665426473227754, 6.572627528245522, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 181, value: 1.320947600981636e-6, best: 1.320947600981636e-6, dval: 0.00017432797015942691\n",
      "Start iteration 182, value: 1.4788605856726287e-6, best: 1.320947600981636e-6, dval: 0.0004429761721460035\n",
      "Big value increase: val: 1.4788605856726287e-6, e.val: 1.320947600981636e-6, max(α): 72.45281737537135\n",
      "====================================\n",
      "1.2032078709781313, 2.358401887609794, 1.4186851616862826, 5.181138453406108, 6.114761896302637, 4.696339867912727, 1.5757786032526162, 2.9507890927680993, 4.595239616055286, 5.098941566756985, 4.066658627371289, 4.018573159428821, 1.734528988571605, 2.990143880111154, 3.436910016552304, 5.813157543047083, 2.1022283564016147, 5.698504954442052, 1.2431371041451116, 3.938214379832048, 3.114720034159455, 6.738496797876742, 2.0219423235692116, 0.9665426933683886, 6.572627528245546, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 183, value: 1.2688214041155621e-6, best: 1.2688214041155621e-6, dval: 0.00018237672953896888\n",
      "Start iteration 184, value: 1.2735978658271105e-6, best: 1.2688214041155621e-6, dval: 0.00015307530330565893\n",
      "====================================\n",
      "1.2032141622846992, 2.3584019123389166, 1.4186851616862777, 5.180934389037273, 6.114720464370983, 4.696160117649251, 1.57577065587398, 2.9507878515673776, 4.595728773279581, 5.098921622533966, 4.066676689942451, 4.018620469345252, 1.7345460529798056, 2.990434858427256, 3.4369465436115365, 5.813295843373565, 2.1022283564016147, 5.698523017013214, 1.2431392835473107, 3.9382143798345592, 3.11472594259664, 6.738494069363895, 2.0219423235692116, 0.9665427256104813, 6.572627528245397, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 185, value: 1.2361292073350092e-6, best: 1.2361292073350092e-6, dval: 0.00013912457124293232\n",
      "Start iteration 186, value: 1.3017619454160248e-6, best: 1.2361292073350092e-6, dval: 0.00029861216388532563\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Start iteration 187, value: 1.3062570998746555e-6, best: 1.2361292073350092e-6, dval: 0.0003688046805203661\n",
      "====================================\n",
      "1.2032226956888474, 2.3584018992383213, 1.4186851616862897, 5.180670537150817, 6.114695040079525, 4.695243395971895, 1.575766220827429, 2.950791758804151, 4.595601525792082, 5.09891376944155, 4.0666726507040725, 4.018620252569853, 1.7349247294411456, 2.990459910546149, 3.4370237342555696, 5.813880646311285, 2.1022283564016147, 5.698518977774835, 1.2431445245832953, 3.938214379834971, 3.1142914913723305, 6.738494492952783, 2.0219423235692116, 0.9665427464354436, 6.572627528245135, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 188, value: 1.1915069606851965e-6, best: 1.1915069606851965e-6, dval: 0.0001525002952422784\n",
      "====================================\n",
      "1.2032250237432354, 2.358401893138114, 1.4186851616862937, 5.18065920668621, 6.114690669528554, 4.6948992308098445, 1.575765231009505, 2.95078473640595, 4.595601507231121, 5.098915528827402, 4.066673282177305, 4.018617459092986, 1.7350061354665112, 2.9904742087820884, 3.4370699715588477, 5.813778254967177, 2.1022283564016147, 5.698519609248068, 1.243147741013985, 3.9382143798350815, 3.114562913584559, 6.73851773264043, 2.0219423235692116, 0.966542767626506, 6.572627528245076, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 189, value: 1.1456091260706954e-6, best: 1.1456091260706954e-6, dval: 5.21572348843799e-5\n",
      "====================================\n",
      "1.2032287621678153, 2.358401888209222, 1.4186851616863143, 5.180649542079117, 6.1146796334851, 4.690093266122754, 1.5757649145722967, 2.9507832907042815, 4.5956014879456095, 5.098921701454719, 4.066679104146996, 4.018615201998376, 1.7349977037974917, 2.9905403842558482, 3.437095789842227, 5.813729856529343, 2.1022283564016147, 5.6985254312177585, 1.243149709752217, 3.938214379835096, 3.1145690541244724, 6.738529028014598, 2.0219423235692116, 0.9665427983032002, 6.572627528245073, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 190, value: 1.1360469891911416e-6, best: 1.1360469891911416e-6, dval: 0.000349766943908314\n",
      "====================================\n",
      "1.2032880244930413, 2.358401881626133, 1.4186851616863045, 5.1806324167726885, 6.114667821939553, 4.692370312129627, 1.5757651573782432, 2.950746813886981, 4.595601415103976, 5.098916311289854, 4.066687728895983, 4.018612187394974, 1.7350059686578683, 2.9907366884525945, 3.4371232463235866, 5.81376866271808, 2.1022283564016147, 5.6985340559667454, 1.2431519521796655, 3.9382143798351157, 3.1145755076300836, 6.738518370688449, 2.0219423235692116, 0.9665428635484267, 6.572627528245071, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 191, value: 1.085963489153785e-6, best: 1.085963489153785e-6, dval: 0.00016808524994149643\n",
      "====================================\n",
      "1.2032868418057614, 2.3584018675559935, 1.4186851616862994, 5.180560833373417, 6.114650381119831, 4.692198752361778, 1.5757655383549, 2.950771138167967, 4.5956014688398295, 5.09890942689672, 4.066683154887805, 4.01860574423547, 1.7350136150040234, 2.9906453802208155, 3.4371502582121947, 5.813789950171389, 2.1022283564016147, 5.698529481958568, 1.2431539299593788, 3.93821437983511, 3.1145773515470423, 6.7385134820199974, 2.0219423235692116, 0.9665428338041165, 6.572627528245068, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 192, value: 1.076439029480591e-6, best: 1.076439029480591e-6, dval: 0.00016576730533496287\n",
      "Start iteration 193, value: 1.2985750470429934e-6, best: 1.076439029480591e-6, dval: 0.0004040774930584301\n",
      "Big value increase: val: 1.2985750470429934e-6, e.val: 1.076439029480591e-6, max(α): 239.42305628851267\n",
      "====================================\n",
      "1.2032865807509463, 2.3584018542340672, 1.418685161686299, 5.180556520198465, 6.114482529075329, 4.691108676470394, 1.5757958206301979, 2.9508488925323877, 4.595601508536305, 5.098756294159156, 4.066689972520474, 4.018599643706402, 1.7352237610479948, 2.990664237605009, 3.437218311995054, 5.814271028858291, 2.1022283564016147, 5.698536299591237, 1.2431550752950955, 3.938214379835088, 3.1145787168911094, 6.738473879891454, 2.0219423235692116, 0.9665428208582257, 6.572627528245041, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 194, value: 1.0407314627187928e-6, best: 1.0407314627187928e-6, dval: 0.00018941870883879127\n",
      "====================================\n",
      "1.2032867985421436, 2.35840184896596, 1.4186851616863, 5.180537804062164, 6.1145608319947256, 4.690914693208202, 1.575810740214934, 2.950848782651385, 4.595601527320332, 5.098717663007346, 4.066699259926391, 4.018597231274467, 1.7353197917410175, 2.9906684901726353, 3.4372557186646646, 5.813993759670591, 2.1022283564016147, 5.698545586997154, 1.2431562690729956, 3.9382143798350877, 3.1145793723765394, 6.738445028488464, 2.0219423235692116, 0.9665428187655453, 6.572627528245039, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 195, value: 1.000159770675234e-6, best: 1.000159770675234e-6, dval: 6.109550912203332e-5\n",
      "Start iteration 196, value: 1.4208673366378746e-6, best: 1.000159770675234e-6, dval: 0.0007230117056618579\n",
      "Big value increase: val: 1.4208673366378746e-6, e.val: 1.000159770675234e-6, max(α): 457.546734285947\n",
      "====================================\n",
      "1.203288111706141, 2.358401804370233, 1.4186851616863012, 5.180510285196022, 6.114563142631571, 4.689437190277393, 1.5761864455892762, 2.9508484056769775, 4.595601528784015, 5.098718086148545, 4.067005410820785, 4.018576809489272, 1.7355932911212195, 2.9906853517002974, 3.4374202966744, 5.814020482121896, 2.1022283564016147, 5.698851737891551, 1.2431594611637455, 3.9382143798350877, 3.114579361660154, 6.738445251174643, 2.0219423235692116, 0.9665428195405437, 6.572627528245017, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Start iteration 197, value: 9.768583866784623e-7, best: 9.768583866784623e-7, dval: 0.00016889052639009958\n",
      "====================================\n",
      "1.2032986209701937, 2.358401732835358, 1.4186851616863025, 5.180460939767263, 6.114562326809425, 4.68803456772096, 1.5758429266377212, 2.950845275768344, 4.595601520615441, 5.098718519442539, 4.066828212115037, 4.018544051421596, 1.7355998365233516, 2.990684459793929, 3.4374382247083246, 5.814023045800414, 2.1022283564016147, 5.6986745391858005, 1.2431720091968603, 3.938214379835088, 3.1145793064785714, 0.45526054973003127, 2.0219423235692116, 0.9665428214975044, 6.572627528245022, 0.97404471593805, 2.1516088158833266\n",
      "====================================\n",
      "Find solution in iteration 197, value: 9.210281443498069e-7\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(9.210281443498069e-7, Number[1.2032986209701937, 2.358401732835358, 1.4186851616863025, 5.180460939767263, 6.114562326809425, 4.68803456772096, 1.5758429266377212, 2.950845275768344, 4.595601520615441, 5.098718519442539  …  5.6986745391858005, 1.2431720091968603, 3.938214379835088, 3.1145793064785714, 0.45526054973003127, 2.0219423235692116, 0.9665428214975044, 6.572627528245022, 0.97404471593805, 2.1516088158833266], 197)"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# The parameters from previous step\n",
    "step4_params = step4_start_params\n",
    "# The parameter wich I found on real deviece\n",
    "#step4_params = [1.1187171575015713, 0.5330092890891549, 2.586441510958004, 1.5178154678919513, 3.137963883844627, 4.228048049765462, 4.839509162353759, 2.9578752785288516, 4.768574523872119, 1.6545920069530968, 2.9732151650981935, 5.438796728232314, 1.3567895934397545, 2.2177922918734536, 2.0165705795863307, -0.14637716576453905, 0.4175300959136594, 4.311416597020989, 5.65363080884547, 5.1078093853571485, 2.6110312065705705, 3.9648509676298693, 2.989797720639175, 2.5851197335780856, 1.9933603087957705, 0.5174013121704684, 2.1454323563784383]\n",
    "\n",
    "step5_start_params, step5_qc = generate_step_ansact(step4_params)\n",
    "step5_of = create_op(useExecutePlace, step5_qc)\n",
    "\n",
    "val, xparams, itr = gradientDescent(step5_of, step5_start_params, α=0.01, maxItr=200,\n",
    "                              argsArePeriodic=true, isExpectedZero=true, ϵ=1e-6, debug=true, useBigValInc=true)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "id": "b7afa1ca",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.0005382235252532572"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "check_err_of_ansact(step5_start_params)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Julia 1.7.2",
   "language": "julia",
   "name": "julia-1.7"
  },
  "language_info": {
   "file_extension": ".jl",
   "mimetype": "application/julia",
   "name": "julia",
   "version": "1.7.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}