Module5HW-UpdatedWithGPU.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "## Module 5 Homework"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "9GE3Jvj8d3_M"
      },
      "outputs": [],
      "source": [
        "#Importing necessary packages\n",
        "\n",
        "import pandas as pd\n",
        "from sklearn.model_selection import train_test_split, cross_val_score, GridSearchCV\n",
        "from sklearn.linear_model import LinearRegression\n",
        "from sklearn.metrics import mean_squared_error, r2_score\n",
        "from sklearn.preprocessing import PolynomialFeatures\n",
        "from sklearn.pipeline import make_pipeline\n",
        "from sklearn.ensemble import RandomForestRegressor\n",
        "\n",
        "# Loading the data\n",
        "df_raw = pd.read_csv('/content/radar_parameters.csv')\n",
        "df = df_raw.drop(columns=['Unnamed: 0'])\n",
        "from sklearn.model_selection import train_test_split\n",
        "\n",
        "X = df.drop('R (mm/hr)', axis=1)\n",
        "y = df['R (mm/hr)']\n",
        "\n",
        "X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.3, random_state=42)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "0RT1Vyhw09_-",
        "outputId": "11a15dbd-a563-4831-d589-06f625b3065f"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Training R^2: 0.9879085512445995\n",
            "Testing R^2: 0.9890992951689396\n",
            "Training RMSE: 0.9229401590287888\n",
            "Testing RMSE: 0.9358124742086974\n"
          ]
        }
      ],
      "source": [
        "#Training a multiple linear regression model:\n",
        "from sklearn.linear_model import LinearRegression\n",
        "from sklearn.metrics import mean_squared_error, r2_score\n",
        "\n",
        "lr = LinearRegression()\n",
        "lr.fit(X_train, y_train)\n",
        "\n",
        "y_train_pred = lr.predict(X_train)\n",
        "y_test_pred = lr.predict(X_test)\n",
        "\n",
        "print(\"Training R^2:\", r2_score(y_train, y_train_pred))\n",
        "print(\"Testing R^2:\", r2_score(y_test, y_test_pred))\n",
        "print(\"Training RMSE:\", np.sqrt(mean_squared_error(y_train, y_train_pred)))\n",
        "print(\"Testing RMSE:\", np.sqrt(mean_squared_error(y_test, y_test_pred)))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "v46lnSnX1MU6",
        "outputId": "97db64e2-c7bf-45a9-b9ae-e54c3a7af923"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Baseline Training R^2: 0.27555056242697507\n",
            "Baseline Testing R^2: 0.35664291868109677\n",
            "Baseline Training RMSE: 7.143950117300888\n",
            "Baseline Testing RMSE: 7.189316160047872\n"
          ]
        }
      ],
      "source": [
        "#Baseline prediction\n",
        "#Ensuring X_train['Zh (dBZ)'] and X_test['Zh (dBZ)'] are in the correct scale before applying the baseline_prediction\n",
        "\n",
        "def baseline_prediction(Zh_dBZ):\n",
        "    # Convert Zh from dBZ to linear Z\n",
        "    Z_linear = 10**(Zh_dBZ / 10)\n",
        "    # Now apply the Z-R relationship\n",
        "    R = (Z_linear / 200)**(1/1.6)\n",
        "    return R\n",
        "\n",
        "\n",
        "baseline_train_pred = baseline_prediction(X_train['Zh (dBZ)'])\n",
        "baseline_test_pred = baseline_prediction(X_test['Zh (dBZ)'])\n",
        "\n",
        "print(\"Baseline Training R^2:\", r2_score(y_train, baseline_train_pred))\n",
        "print(\"Baseline Testing R^2:\", r2_score(y_test, baseline_test_pred))\n",
        "print(\"Baseline Training RMSE:\", np.sqrt(mean_squared_error(y_train, baseline_train_pred)))\n",
        "print(\"Baseline Testing RMSE:\", np.sqrt(mean_squared_error(y_test, baseline_test_pred)))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "scfLT2i0MLyD"
      },
      "source": [
        "## Using HPC (CUDA via GPUs on Google Colab for grid search)\n",
        "\n",
        "Environment Sanity Check\n",
        "\n",
        "Click the _Runtime_ dropdown at the top of the page, then _Change Runtime Type_ and confirm the instance type is _GPU_.\n",
        "\n",
        "You can check the output of `!nvidia-smi` to check which GPU you have.  Please uncomment the cell below if you'd like to do that.  Currently, RAPIDS runs on all available Colab GPU instances."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "67T0090Jk2KL",
        "outputId": "d9eed035-55a3-4dcc-d6d1-01f6f858e1e9"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Sun Mar 31 04:06:11 2024       \n",
            "+---------------------------------------------------------------------------------------+\n",
            "| NVIDIA-SMI 535.104.05             Driver Version: 535.104.05   CUDA Version: 12.2     |\n",
            "|-----------------------------------------+----------------------+----------------------+\n",
            "| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |\n",
            "| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |\n",
            "|                                         |                      |               MIG M. |\n",
            "|=========================================+======================+======================|\n",
            "|   0  Tesla T4                       Off | 00000000:00:04.0 Off |                    0 |\n",
            "| N/A   64C    P8              11W /  70W |      0MiB / 15360MiB |      0%      Default |\n",
            "|                                         |                      |                  N/A |\n",
            "+-----------------------------------------+----------------------+----------------------+\n",
            "                                                                                         \n",
            "+---------------------------------------------------------------------------------------+\n",
            "| Processes:                                                                            |\n",
            "|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |\n",
            "|        ID   ID                                                             Usage      |\n",
            "|=======================================================================================|\n",
            "|  No running processes found                                                           |\n",
            "+---------------------------------------------------------------------------------------+\n"
          ]
        }
      ],
      "source": [
        "!nvidia-smi"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "B0C8IV5TQnjN",
        "outputId": "1efdb5df-39ff-47ac-ec37-5659382848b2"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Cloning into 'rapidsai-csp-utils'...\n",
            "remote: Enumerating objects: 460, done.\u001b[K\n",
            "remote: Counting objects: 100% (191/191), done.\u001b[K\n",
            "remote: Compressing objects: 100% (100/100), done.\u001b[K\n",
            "remote: Total 460 (delta 131), reused 124 (delta 91), pack-reused 269\u001b[K\n",
            "Receiving objects: 100% (460/460), 126.19 KiB | 4.67 MiB/s, done.\n",
            "Resolving deltas: 100% (233/233), done.\n",
            "Collecting pynvml\n",
            "  Downloading pynvml-11.5.0-py3-none-any.whl (53 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.1/53.1 kB 1.9 MB/s eta 0:00:00\n",
            "Installing collected packages: pynvml\n",
            "Successfully installed pynvml-11.5.0\n",
            "***********************************************************************\n",
            "Woo! Your instance has a Tesla T4 GPU!\n",
            "We will install the latest stable RAPIDS via pip 24.2.*!  Please stand by, should be quick...\n",
            "***********************************************************************\n",
            "\n",
            "Looking in indexes: https://pypi.org/simple, https://pypi.nvidia.com\n",
            "Collecting cudf-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cudf-cu12/cudf_cu12-24.2.2-cp310-cp310-manylinux_2_28_x86_64.whl (464.7 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 464.7/464.7 MB 3.6 MB/s eta 0:00:00\n",
            "Collecting cuml-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cuml-cu12/cuml_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1074.6 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 GB 1.9 MB/s eta 0:00:00\n",
            "Collecting cugraph-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cugraph-cu12/cugraph_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1311.2 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 GB 1.5 MB/s eta 0:00:00\n",
            "Collecting cuspatial-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cuspatial-cu12/cuspatial_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (133.1 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 MB 13.1 MB/s eta 0:00:00\n",
            "Collecting cuproj-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cuproj-cu12/cuproj_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (917 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 917.6/917.6 kB 57.4 MB/s eta 0:00:00\n",
            "Collecting cuxfilter-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cuxfilter-cu12/cuxfilter_cu12-24.2.0-py3-none-any.whl (83 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.2/83.2 kB 11.2 MB/s eta 0:00:00\n",
            "Collecting cucim-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/cucim-cu12/cucim_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 96.3 MB/s eta 0:00:00\n",
            "Collecting pylibraft-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/pylibraft-cu12/pylibraft_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (647.0 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 647.0/647.0 MB 2.4 MB/s eta 0:00:00\n",
            "Collecting raft-dask-cu12==24.2.*\n",
            "  Downloading https://pypi.nvidia.com/raft-dask-cu12/raft_dask_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (162.9 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.9/162.9 MB 10.4 MB/s eta 0:00:00\n",
            "Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (3.9.3)\n",
            "Requirement already satisfied: cachetools in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (5.3.3)\n",
            "Collecting cuda-python<13.0a0,>=12.0 (from cudf-cu12==24.2.*)\n",
            "  Downloading cuda_python-12.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (24.5 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.5/24.5 MB 35.9 MB/s eta 0:00:00\n",
            "Requirement already satisfied: cupy-cuda12x>=12.0.0 in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (12.2.0)\n",
            "Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (2023.6.0)\n",
            "Requirement already satisfied: numba>=0.57 in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (0.58.1)\n",
            "Collecting numpy<1.25,>=1.21 (from cudf-cu12==24.2.*)\n",
            "  Downloading numpy-1.24.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 75.7 MB/s eta 0:00:00\n",
            "Collecting nvtx>=0.2.1 (from cudf-cu12==24.2.*)\n",
            "  Downloading nvtx-0.2.10-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (582 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 582.6/582.6 kB 47.8 MB/s eta 0:00:00\n",
            "Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (24.0)\n",
            "Requirement already satisfied: pandas<1.6.0dev0,>=1.3 in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (1.5.3)\n",
            "Collecting protobuf<5,>=4.21 (from cudf-cu12==24.2.*)\n",
            "  Downloading protobuf-4.25.3-cp37-abi3-manylinux2014_x86_64.whl (294 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 31.2 MB/s eta 0:00:00\n",
            "Collecting pynvjitlink-cu12 (from cudf-cu12==24.2.*)\n",
            "  Downloading https://pypi.nvidia.com/pynvjitlink-cu12/pynvjitlink_cu12-0.1.14-cp310-cp310-manylinux_2_17_x86_64.whl (24.0 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.0/24.0 MB 79.3 MB/s eta 0:00:00\n",
            "Requirement already satisfied: pyarrow<15.0.0a0,>=14.0.1 in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (14.0.2)\n",
            "Requirement already satisfied: rich in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (13.7.1)\n",
            "Collecting rmm-cu12==24.2.* (from cudf-cu12==24.2.*)\n",
            "  Downloading https://pypi.nvidia.com/rmm-cu12/rmm_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 56.8 MB/s eta 0:00:00\n",
            "Requirement already satisfied: typing_extensions>=4.0.0 in /usr/local/lib/python3.10/dist-packages (from cudf-cu12==24.2.*) (4.10.0)\n",
            "Collecting dask-cuda==24.2.* (from cuml-cu12==24.2.*)\n",
            "  Downloading dask_cuda-24.2.0-py3-none-any.whl (126 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 kB 379.0 kB/s eta 0:00:00\n",
            "Collecting dask-cudf-cu12==24.2.* (from cuml-cu12==24.2.*)\n",
            "  Downloading https://pypi.nvidia.com/dask-cudf-cu12/dask_cudf_cu12-24.2.2-py3-none-any.whl (45 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.1/45.1 kB 5.7 MB/s eta 0:00:00\n",
            "Requirement already satisfied: joblib>=0.11 in /usr/local/lib/python3.10/dist-packages (from cuml-cu12==24.2.*) (1.3.2)\n",
            "Collecting rapids-dask-dependency==24.2.* (from cuml-cu12==24.2.*)\n",
            "  Downloading https://pypi.nvidia.com/rapids-dask-dependency/rapids_dask_dependency-24.2.0-py3-none-any.whl (6.4 kB)\n",
            "Requirement already satisfied: scipy>=1.8.0 in /usr/local/lib/python3.10/dist-packages (from cuml-cu12==24.2.*) (1.11.4)\n",
            "Collecting treelite==4.0.0 (from cuml-cu12==24.2.*)\n",
            "  Downloading treelite-4.0.0-py3-none-manylinux2014_x86_64.whl (758 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 758.7/758.7 kB 58.6 MB/s eta 0:00:00\n",
            "Collecting pylibcugraph-cu12==24.2.* (from cugraph-cu12==24.2.*)\n",
            "  Downloading https://pypi.nvidia.com/pylibcugraph-cu12/pylibcugraph_cu12-24.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1312.2 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 GB 1.6 MB/s eta 0:00:00\n",
            "Collecting ucx-py-cu12==0.36.* (from cugraph-cu12==24.2.*)\n",
            "  Downloading https://pypi.nvidia.com/ucx-py-cu12/ucx_py_cu12-0.36.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.7 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.7/7.7 MB 113.0 MB/s eta 0:00:00\n",
            "Requirement already satisfied: geopandas>=0.11.0 in /usr/local/lib/python3.10/dist-packages (from cuspatial-cu12==24.2.*) (0.13.2)\n",
            "Requirement already satisfied: bokeh>=3.1 in /usr/local/lib/python3.10/dist-packages (from cuxfilter-cu12==24.2.*) (3.3.4)\n",
            "Collecting datashader>=0.15 (from cuxfilter-cu12==24.2.*)\n",
            "  Downloading datashader-0.16.0-py2.py3-none-any.whl (18.3 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.3/18.3 MB 75.0 MB/s eta 0:00:00\n",
            "Requirement already satisfied: holoviews>=1.16.0 in /usr/local/lib/python3.10/dist-packages (from cuxfilter-cu12==24.2.*) (1.17.1)\n",
            "Collecting jupyter-server-proxy (from cuxfilter-cu12==24.2.*)\n",
            "  Downloading jupyter_server_proxy-4.1.2-py3-none-any.whl (34 kB)\n",
            "Requirement already satisfied: panel>=1.0 in /usr/local/lib/python3.10/dist-packages (from cuxfilter-cu12==24.2.*) (1.3.8)\n",
            "Requirement already satisfied: lazy-loader>=0.1 in /usr/local/lib/python3.10/dist-packages (from cucim-cu12==24.2.*) (0.3)\n",
            "Requirement already satisfied: scikit-image<0.23.0a0,>=0.19.0 in /usr/local/lib/python3.10/dist-packages (from cucim-cu12==24.2.*) (0.19.3)\n",
            "Requirement already satisfied: click>=8.1 in /usr/local/lib/python3.10/dist-packages (from dask-cuda==24.2.*->cuml-cu12==24.2.*) (8.1.7)\n",
            "Collecting pynvml<11.5,>=11.0.0 (from dask-cuda==24.2.*->cuml-cu12==24.2.*)\n",
            "  Downloading pynvml-11.4.1-py3-none-any.whl (46 kB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.0/47.0 kB 6.0 MB/s eta 0:00:00\n",
            "Requirement already satisfied: zict>=2.0.0 in /usr/local/lib/python3.10/dist-packages (from dask-cuda==24.2.*->cuml-cu12==24.2.*) (3.0.0)\n",
            "Collecting dask==2024.1.1 (from rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*)\n",
            "  Downloading dask-2024.1.1-py3-none-any.whl (1.2 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 79.1 MB/s eta 0:00:00\n",
            "Collecting distributed==2024.1.1 (from rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*)\n",
            "  Downloading distributed-2024.1.1-py3-none-any.whl (1.0 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 69.9 MB/s eta 0:00:00\n",
            "Requirement already satisfied: cloudpickle>=1.5.0 in /usr/local/lib/python3.10/dist-packages (from dask==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (2.2.1)\n",
            "Requirement already satisfied: partd>=1.2.0 in /usr/local/lib/python3.10/dist-packages (from dask==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (1.4.1)\n",
            "Requirement already satisfied: pyyaml>=5.3.1 in /usr/local/lib/python3.10/dist-packages (from dask==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (6.0.1)\n",
            "Requirement already satisfied: toolz>=0.10.0 in /usr/local/lib/python3.10/dist-packages (from dask==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (0.12.1)\n",
            "Requirement already satisfied: importlib-metadata>=4.13.0 in /usr/local/lib/python3.10/dist-packages (from dask==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (7.1.0)\n",
            "Requirement already satisfied: jinja2>=2.10.3 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (3.1.3)\n",
            "Requirement already satisfied: locket>=1.0.0 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (1.0.0)\n",
            "Requirement already satisfied: msgpack>=1.0.0 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (1.0.8)\n",
            "Requirement already satisfied: psutil>=5.7.2 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (5.9.5)\n",
            "Requirement already satisfied: sortedcontainers>=2.0.5 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (2.4.0)\n",
            "Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (3.0.0)\n",
            "Requirement already satisfied: tornado>=6.0.4 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (6.3.3)\n",
            "Requirement already satisfied: urllib3>=1.24.3 in /usr/local/lib/python3.10/dist-packages (from distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (2.0.7)\n",
            "Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp) (1.3.1)\n",
            "Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp) (23.2.0)\n",
            "Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp) (1.4.1)\n",
            "Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp) (6.0.5)\n",
            "Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp) (1.9.4)\n",
            "Requirement already satisfied: async-timeout<5.0,>=4.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp) (4.0.3)\n",
            "Requirement already satisfied: contourpy>=1 in /usr/local/lib/python3.10/dist-packages (from bokeh>=3.1->cuxfilter-cu12==24.2.*) (1.2.0)\n",
            "Requirement already satisfied: pillow>=7.1.0 in /usr/local/lib/python3.10/dist-packages (from bokeh>=3.1->cuxfilter-cu12==24.2.*) (9.4.0)\n",
            "Requirement already satisfied: xyzservices>=2021.09.1 in /usr/local/lib/python3.10/dist-packages (from bokeh>=3.1->cuxfilter-cu12==24.2.*) (2023.10.1)\n",
            "Requirement already satisfied: fastrlock>=0.5 in /usr/local/lib/python3.10/dist-packages (from cupy-cuda12x>=12.0.0->cudf-cu12==24.2.*) (0.8.2)\n",
            "Requirement already satisfied: colorcet in /usr/local/lib/python3.10/dist-packages (from datashader>=0.15->cuxfilter-cu12==24.2.*) (3.1.0)\n",
            "Requirement already satisfied: multipledispatch in /usr/local/lib/python3.10/dist-packages (from datashader>=0.15->cuxfilter-cu12==24.2.*) (1.0.0)\n",
            "Requirement already satisfied: param in /usr/local/lib/python3.10/dist-packages (from datashader>=0.15->cuxfilter-cu12==24.2.*) (2.1.0)\n",
            "Collecting pyct (from datashader>=0.15->cuxfilter-cu12==24.2.*)\n",
            "  Downloading pyct-0.5.0-py2.py3-none-any.whl (15 kB)\n",
            "Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from datashader>=0.15->cuxfilter-cu12==24.2.*) (2.31.0)\n",
            "Requirement already satisfied: xarray in /usr/local/lib/python3.10/dist-packages (from datashader>=0.15->cuxfilter-cu12==24.2.*) (2023.7.0)\n",
            "Requirement already satisfied: fiona>=1.8.19 in /usr/local/lib/python3.10/dist-packages (from geopandas>=0.11.0->cuspatial-cu12==24.2.*) (1.9.6)\n",
            "Requirement already satisfied: pyproj>=3.0.1 in /usr/local/lib/python3.10/dist-packages (from geopandas>=0.11.0->cuspatial-cu12==24.2.*) (3.6.1)\n",
            "Requirement already satisfied: shapely>=1.7.1 in /usr/local/lib/python3.10/dist-packages (from geopandas>=0.11.0->cuspatial-cu12==24.2.*) (2.0.3)\n",
            "Requirement already satisfied: pyviz-comms>=0.7.4 in /usr/local/lib/python3.10/dist-packages (from holoviews>=1.16.0->cuxfilter-cu12==24.2.*) (3.0.2)\n",
            "Requirement already satisfied: llvmlite<0.42,>=0.41.0dev0 in /usr/local/lib/python3.10/dist-packages (from numba>=0.57->cudf-cu12==24.2.*) (0.41.1)\n",
            "Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas<1.6.0dev0,>=1.3->cudf-cu12==24.2.*) (2.8.2)\n",
            "Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas<1.6.0dev0,>=1.3->cudf-cu12==24.2.*) (2023.4)\n",
            "Requirement already satisfied: markdown in /usr/local/lib/python3.10/dist-packages (from panel>=1.0->cuxfilter-cu12==24.2.*) (3.6)\n",
            "Requirement already satisfied: markdown-it-py in /usr/local/lib/python3.10/dist-packages (from panel>=1.0->cuxfilter-cu12==24.2.*) (3.0.0)\n",
            "Requirement already satisfied: linkify-it-py in /usr/local/lib/python3.10/dist-packages (from panel>=1.0->cuxfilter-cu12==24.2.*) (2.0.3)\n",
            "Requirement already satisfied: mdit-py-plugins in /usr/local/lib/python3.10/dist-packages (from panel>=1.0->cuxfilter-cu12==24.2.*) (0.4.0)\n",
            "Requirement already satisfied: tqdm>=4.48.0 in /usr/local/lib/python3.10/dist-packages (from panel>=1.0->cuxfilter-cu12==24.2.*) (4.66.2)\n",
            "Requirement already satisfied: bleach in /usr/local/lib/python3.10/dist-packages (from panel>=1.0->cuxfilter-cu12==24.2.*) (6.1.0)\n",
            "Requirement already satisfied: networkx>=2.2 in /usr/local/lib/python3.10/dist-packages (from scikit-image<0.23.0a0,>=0.19.0->cucim-cu12==24.2.*) (3.2.1)\n",
            "Requirement already satisfied: imageio>=2.4.1 in /usr/local/lib/python3.10/dist-packages (from scikit-image<0.23.0a0,>=0.19.0->cucim-cu12==24.2.*) (2.31.6)\n",
            "Requirement already satisfied: tifffile>=2019.7.26 in /usr/local/lib/python3.10/dist-packages (from scikit-image<0.23.0a0,>=0.19.0->cucim-cu12==24.2.*) (2024.2.12)\n",
            "Requirement already satisfied: PyWavelets>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from scikit-image<0.23.0a0,>=0.19.0->cucim-cu12==24.2.*) (1.5.0)\n",
            "Requirement already satisfied: idna>=2.0 in /usr/local/lib/python3.10/dist-packages (from yarl<2.0,>=1.0->aiohttp) (3.6)\n",
            "Requirement already satisfied: jupyter-server>=1.0 in /usr/local/lib/python3.10/dist-packages (from jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.24.0)\n",
            "Collecting simpervisor>=1.0 (from jupyter-server-proxy->cuxfilter-cu12==24.2.*)\n",
            "  Downloading simpervisor-1.0.0-py3-none-any.whl (8.3 kB)\n",
            "Requirement already satisfied: traitlets>=4.2.1 in /usr/local/lib/python3.10/dist-packages (from jupyter-server-proxy->cuxfilter-cu12==24.2.*) (5.7.1)\n",
            "Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /usr/local/lib/python3.10/dist-packages (from rich->cudf-cu12==24.2.*) (2.16.1)\n",
            "Requirement already satisfied: certifi in /usr/local/lib/python3.10/dist-packages (from fiona>=1.8.19->geopandas>=0.11.0->cuspatial-cu12==24.2.*) (2024.2.2)\n",
            "Requirement already satisfied: click-plugins>=1.0 in /usr/local/lib/python3.10/dist-packages (from fiona>=1.8.19->geopandas>=0.11.0->cuspatial-cu12==24.2.*) (1.1.1)\n",
            "Requirement already satisfied: cligj>=0.5 in /usr/local/lib/python3.10/dist-packages (from fiona>=1.8.19->geopandas>=0.11.0->cuspatial-cu12==24.2.*) (0.7.2)\n",
            "Requirement already satisfied: six in /usr/local/lib/python3.10/dist-packages (from fiona>=1.8.19->geopandas>=0.11.0->cuspatial-cu12==24.2.*) (1.16.0)\n",
            "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2>=2.10.3->distributed==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (2.1.5)\n",
            "Requirement already satisfied: anyio<4,>=3.1.0 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (3.7.1)\n",
            "Requirement already satisfied: argon2-cffi in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (23.1.0)\n",
            "Requirement already satisfied: jupyter-client>=6.1.12 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (6.1.12)\n",
            "Requirement already satisfied: jupyter-core!=5.0.*,>=4.12 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (5.7.2)\n",
            "Requirement already satisfied: nbconvert>=6.4.4 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (6.5.4)\n",
            "Requirement already satisfied: nbformat>=5.2.0 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (5.10.3)\n",
            "Requirement already satisfied: prometheus-client in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.20.0)\n",
            "Requirement already satisfied: pyzmq>=17 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (23.2.1)\n",
            "Requirement already satisfied: Send2Trash in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.8.2)\n",
            "Requirement already satisfied: terminado>=0.8.3 in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.18.1)\n",
            "Requirement already satisfied: websocket-client in /usr/local/lib/python3.10/dist-packages (from jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.7.0)\n",
            "Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py->panel>=1.0->cuxfilter-cu12==24.2.*) (0.1.2)\n",
            "Requirement already satisfied: webencodings in /usr/local/lib/python3.10/dist-packages (from bleach->panel>=1.0->cuxfilter-cu12==24.2.*) (0.5.1)\n",
            "Requirement already satisfied: uc-micro-py in /usr/local/lib/python3.10/dist-packages (from linkify-it-py->panel>=1.0->cuxfilter-cu12==24.2.*) (1.0.3)\n",
            "Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->datashader>=0.15->cuxfilter-cu12==24.2.*) (3.3.2)\n",
            "Requirement already satisfied: sniffio>=1.1 in /usr/local/lib/python3.10/dist-packages (from anyio<4,>=3.1.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.3.1)\n",
            "Requirement already satisfied: exceptiongroup in /usr/local/lib/python3.10/dist-packages (from anyio<4,>=3.1.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.2.0)\n",
            "Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.10/dist-packages (from importlib-metadata>=4.13.0->dask==2024.1.1->rapids-dask-dependency==24.2.*->cuml-cu12==24.2.*) (3.18.1)\n",
            "Requirement already satisfied: platformdirs>=2.5 in /usr/local/lib/python3.10/dist-packages (from jupyter-core!=5.0.*,>=4.12->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (4.2.0)\n",
            "Requirement already satisfied: lxml in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (4.9.4)\n",
            "Requirement already satisfied: beautifulsoup4 in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (4.12.3)\n",
            "Requirement already satisfied: defusedxml in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.7.1)\n",
            "Requirement already satisfied: entrypoints>=0.2.2 in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.4)\n",
            "Requirement already satisfied: jupyterlab-pygments in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.3.0)\n",
            "Requirement already satisfied: mistune<2,>=0.8.1 in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.8.4)\n",
            "Requirement already satisfied: nbclient>=0.5.0 in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.10.0)\n",
            "Requirement already satisfied: pandocfilters>=1.4.1 in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.5.1)\n",
            "Requirement already satisfied: tinycss2 in /usr/local/lib/python3.10/dist-packages (from nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.2.1)\n",
            "Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.10/dist-packages (from nbformat>=5.2.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (2.19.1)\n",
            "Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.10/dist-packages (from nbformat>=5.2.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (4.19.2)\n",
            "Requirement already satisfied: ptyprocess in /usr/local/lib/python3.10/dist-packages (from terminado>=0.8.3->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.7.0)\n",
            "Requirement already satisfied: argon2-cffi-bindings in /usr/local/lib/python3.10/dist-packages (from argon2-cffi->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (21.2.0)\n",
            "Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=2.6->nbformat>=5.2.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (2023.12.1)\n",
            "Requirement already satisfied: referencing>=0.28.4 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=2.6->nbformat>=5.2.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.34.0)\n",
            "Requirement already satisfied: rpds-py>=0.7.1 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=2.6->nbformat>=5.2.0->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (0.18.0)\n",
            "Requirement already satisfied: cffi>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from argon2-cffi-bindings->argon2-cffi->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (1.16.0)\n",
            "Requirement already satisfied: soupsieve>1.2 in /usr/local/lib/python3.10/dist-packages (from beautifulsoup4->nbconvert>=6.4.4->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (2.5)\n",
            "Requirement already satisfied: pycparser in /usr/local/lib/python3.10/dist-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi->jupyter-server>=1.0->jupyter-server-proxy->cuxfilter-cu12==24.2.*) (2.21)\n",
            "Installing collected packages: nvtx, cuda-python, simpervisor, pynvml, pynvjitlink-cu12, pyct, protobuf, numpy, ucx-py-cu12, dask, treelite, rmm-cu12, distributed, rapids-dask-dependency, pylibraft-cu12, datashader, cuproj-cu12, cudf-cu12, cucim-cu12, pylibcugraph-cu12, dask-cudf-cu12, dask-cuda, cuspatial-cu12, raft-dask-cu12, cuml-cu12, cugraph-cu12, jupyter-server-proxy, cuxfilter-cu12\n",
            "  Attempting uninstall: pynvml\n",
            "    Found existing installation: pynvml 11.5.0\n",
            "    Uninstalling pynvml-11.5.0:\n",
            "      Successfully uninstalled pynvml-11.5.0\n",
            "  Attempting uninstall: protobuf\n",
            "    Found existing installation: protobuf 3.20.3\n",
            "    Uninstalling protobuf-3.20.3:\n",
            "      Successfully uninstalled protobuf-3.20.3\n",
            "  Attempting uninstall: numpy\n",
            "    Found existing installation: numpy 1.25.2\n",
            "    Uninstalling numpy-1.25.2:\n",
            "      Successfully uninstalled numpy-1.25.2\n",
            "  Attempting uninstall: dask\n",
            "    Found existing installation: dask 2023.8.1\n",
            "    Uninstalling dask-2023.8.1:\n",
            "      Successfully uninstalled dask-2023.8.1\n",
            "  Attempting uninstall: distributed\n",
            "    Found existing installation: distributed 2023.8.1\n",
            "    Uninstalling distributed-2023.8.1:\n",
            "      Successfully uninstalled distributed-2023.8.1\n",
            "ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n",
            "tensorflow-metadata 1.14.0 requires protobuf<4.21,>=3.20.3, but you have protobuf 4.25.3 which is incompatible.\n",
            "Successfully installed cucim-cu12-24.2.0 cuda-python-12.4.0 cudf-cu12-24.2.2 cugraph-cu12-24.2.0 cuml-cu12-24.2.0 cuproj-cu12-24.2.0 cuspatial-cu12-24.2.0 cuxfilter-cu12-24.2.0 dask-2024.1.1 dask-cuda-24.2.0 dask-cudf-cu12-24.2.2 datashader-0.16.0 distributed-2024.1.1 jupyter-server-proxy-4.1.2 numpy-1.24.4 nvtx-0.2.10 protobuf-4.25.3 pyct-0.5.0 pylibcugraph-cu12-24.2.0 pylibraft-cu12-24.2.0 pynvjitlink-cu12-0.1.14 pynvml-11.4.1 raft-dask-cu12-24.2.0 rapids-dask-dependency-24.2.0 rmm-cu12-24.2.0 simpervisor-1.0.0 treelite-4.0.0 ucx-py-cu12-0.36.0\n",
            "Collecting cupy-cuda12x\n",
            "  Downloading cupy_cuda12x-13.0.0-cp310-cp310-manylinux2014_x86_64.whl (88.3 MB)\n",
            "     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.3/88.3 MB 4.8 MB/s eta 0:00:00\n",
            "Requirement already satisfied: numpy<1.29,>=1.22 in /usr/local/lib/python3.10/dist-packages (from cupy-cuda12x) (1.24.4)\n",
            "Requirement already satisfied: fastrlock>=0.5 in /usr/local/lib/python3.10/dist-packages (from cupy-cuda12x) (0.8.2)\n",
            "Installing collected packages: cupy-cuda12x\n",
            "Successfully installed cupy-cuda12x-13.0.0\n",
            "\n",
            "        ***********************************************************************\n",
            "        The pip install of RAPIDS is complete.\n",
            "        \n",
            "        Please do not run any further installation from the conda based installation methods, as they may cause issues!\n",
            "        \n",
            "        Please ensure that you're pulling from the git repo to remain updated with the latest working install scripts.\n",
            "\n",
            "        Troubleshooting:\n",
            "            - If there is an installation failure, please check back on RAPIDSAI owned templates/notebooks to see how to update your personal files. \n",
            "            - If an installation failure persists when using the latest script, please make an issue on https://github.com/rapidsai-community/rapidsai-csp-utils\n",
            "        ***********************************************************************\n",
            "        \n"
          ]
        }
      ],
      "source": [
        "!git clone https://github.com/rapidsai/rapidsai-csp-utils.git\n",
        "!python rapidsai-csp-utils/colab/pip-install.py\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 36
        },
        "id": "4nLrk46BllED",
        "outputId": "3d26d114-4cc5-4463-8d29-e126c760db0b"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'24.02.02'"
            ]
          },
          "execution_count": 3,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "import cudf\n",
        "cudf.__version__"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 36
        },
        "id": "xgAFgI15ddf6",
        "outputId": "82571da5-8532-4835-fee2-e0d42dd64379"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'24.02.00'"
            ]
          },
          "execution_count": 4,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "import cuml\n",
        "cuml.__version__"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 36
        },
        "id": "JOCMWaUal1fI",
        "outputId": "4cec05ab-407d-4911-e086-af825b5d9774"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'24.02.00'"
            ]
          },
          "execution_count": 5,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "import cugraph\n",
        "cugraph.__version__"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 36
        },
        "id": "AnmtYjzvVTtv",
        "outputId": "b12e0768-0f55-4aba-98f1-3aedd6cd4141"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'24.02.00'"
            ]
          },
          "execution_count": 6,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "import cuspatial\n",
        "cuspatial.__version__"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 36
        },
        "id": "CYjcARDFVWWD",
        "outputId": "b2762fd6-6ab7-48b5-97d1-047a6cf82c68"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            },
            "text/plain": [
              "'24.02.00'"
            ]
          },
          "execution_count": 7,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "import cuxfilter\n",
        "cuxfilter.__version__"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "noxhr2151TxQ",
        "outputId": "f5592ad2-5147-44a9-a839-64438d4dce1e"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Best polynomial degree overall: 2\n",
            "Best polynomial R^2 overall: 0.9969985736508612\n"
          ]
        }
      ],
      "source": [
        "#GPU enabled Grid search over polynomial orders\n",
        "\n",
        "from sklearn.preprocessing import PolynomialFeatures\n",
        "from sklearn.pipeline import make_pipeline\n",
        "from sklearn.model_selection import GridSearchCV\n",
        "from sklearn.linear_model import LinearRegression\n",
        "\n",
        "# Storing the best degree and score\n",
        "best_degree = None\n",
        "best_score = -np.inf\n",
        "\n",
        "# Defining the total range of degrees\n",
        "total_degrees = range(22)\n",
        "\n",
        "# Splitting the total degrees into smaller batches if needed\n",
        "degree_batches = [total_degrees[i:i+5] for i in range(0, len(total_degrees), 5)]\n",
        "\n",
        "for batch in degree_batches:\n",
        "    try:\n",
        "        # Defining the range of degrees for the grid search\n",
        "        poly_params = {'polynomialfeatures__degree': batch}\n",
        "\n",
        "        # Creating a pipeline with PolynomialFeatures and LinearRegression\n",
        "        poly_model = make_pipeline(PolynomialFeatures(), LinearRegression())\n",
        "\n",
        "        # Setting up the grid search with 7-fold cross-validation\n",
        "        poly_grid = GridSearchCV(poly_model, poly_params, cv=7, scoring='r2', n_jobs=1)\n",
        "\n",
        "        # Fitting the grid search to the training data\n",
        "        poly_grid.fit(X_train, y_train)\n",
        "\n",
        "        # Checking if the best score in this batch is better than the overall best score\n",
        "        if poly_grid.best_score_ > best_score:\n",
        "            best_score = poly_grid.best_score_\n",
        "            best_degree = poly_grid.best_params_['polynomialfeatures__degree']\n",
        "\n",
        "    except MemoryError:\n",
        "        print(f\"Memory error occurred with batch: {batch}\")\n",
        "        continue\n",
        "    except Exception as e:\n",
        "        print(f\"An error occurred with batch: {batch}: {e}\")\n",
        "        continue\n",
        "\n",
        "print(\"Best polynomial degree overall:\", best_degree)\n",
        "print(\"Best polynomial R^2 overall:\", best_score)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "1DLK8xvMl5jE",
        "outputId": "4b6f0cf7-948f-4722-c58e-77432a6bdd0b"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527973532676697\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526132345199585\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526083469390869\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9525827169418335\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526445865631104\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.952664852142334\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526724219322205\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526863098144531\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526987075805664\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9526728391647339\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9518930912017822\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.951765239238739\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517444372177124\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9516982436180115\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517529010772705\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517577290534973\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517684578895569\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517873525619507\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517956376075745\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9517634510993958\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.949470043182373\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494499564170837\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494802951812744\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494595527648926\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494351148605347\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.949435830116272\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494333863258362\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494410157203674\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494589567184448\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9494351744651794\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508850574493408\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9507908225059509\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508472084999084\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508061408996582\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508227109909058\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508075714111328\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508004188537598\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508101940155029\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9508196115493774\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9507899880409241\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9507283568382263\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506245255470276\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506770372390747\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506206512451172\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506337642669678\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506269693374634\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506215453147888\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506387710571289\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506505727767944\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9506210088729858\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.949037492275238\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489300847053528\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489940404891968\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489476680755615\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489200115203857\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489170908927917\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489002823829651\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489227533340454\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489383697509766\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9489119648933411\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9477173089981079\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476258754730225\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476830363273621\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476756453514099\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476682543754578\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476639032363892\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476318955421448\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476385712623596\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.947645366191864\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9476180076599121\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9477173089981079\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476258754730225\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476830363273621\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476756453514099\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476682543754578\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476639032363892\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476318955421448\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476385712623596\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.947645366191864\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9476180076599121\n",
            "Training with: n_estimators=200, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9474319815635681\n",
            "Training with: n_estimators=400, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473738670349121\n",
            "Training with: n_estimators=600, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9474288821220398\n",
            "Training with: n_estimators=800, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473918080329895\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473822116851807\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473671317100525\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473453164100647\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473467469215393\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9473540782928467\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.947330117225647\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.947482705116272\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469761848449707\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469417333602905\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469274282455444\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469031095504761\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468613862991333\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.946836531162262\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469239711761475\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468526840209961\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467439651489258\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9465734958648682\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946287989616394\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9462250471115112\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9462032318115234\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9462332129478455\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9461703300476074\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9461877346038818\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9462672472000122\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9462450742721558\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9461431503295898\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9440286755561829\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9439263343811035\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437584280967712\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437484741210938\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437289237976074\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437351822853088\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437223076820374\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437838196754456\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9437559843063354\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9436835050582886\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9445846080780029\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9443081021308899\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9444268345832825\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9444059729576111\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9443984627723694\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9444241523742676\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9444299936294556\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9444980025291443\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9444465637207031\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9443342685699463\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9445518851280212\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.944265604019165\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9443469047546387\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9443018436431885\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9443127512931824\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9442921876907349\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9443020224571228\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9443747401237488\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9443302750587463\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9442148208618164\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.943091630935669\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9428820013999939\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9429118633270264\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9428653717041016\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9427925944328308\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9428290724754333\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9427880048751831\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9428342580795288\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9428055882453918\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9427052140235901\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9413859844207764\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9408879280090332\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9408612251281738\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.940839409828186\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9408009052276611\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9408222436904907\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9407838582992554\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9408913254737854\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9408807754516602\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.940776526927948\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9413859844207764\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9408879280090332\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9408612251281738\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.940839409828186\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9408009052276611\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9408222436904907\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9407838582992554\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9408913254737854\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9408807754516602\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.940776526927948\n",
            "Training with: n_estimators=200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9409838318824768\n",
            "Training with: n_estimators=400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9405761957168579\n",
            "Training with: n_estimators=600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9405807256698608\n",
            "Training with: n_estimators=800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9406083822250366\n",
            "Training with: n_estimators=1000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9405854940414429\n",
            "Training with: n_estimators=1200, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9406018853187561\n",
            "Training with: n_estimators=1400, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9405825138092041\n",
            "Training with: n_estimators=1600, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9406611919403076\n",
            "Training with: n_estimators=1800, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.940643846988678\n",
            "Training with: n_estimators=2000, max_depth=10, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9405443668365479\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9552183151245117\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955069899559021\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550650119781494\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550321102142334\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550876617431641\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551076292991638\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551144242286682\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551277160644531\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955136775970459\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551088213920593\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540284872055054\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539219737052917\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539024233818054\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538494944572449\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978338241577\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539039731025696\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539138674736023\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539324045181274\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539389610290527\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539043307304382\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509889483451843\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509927034378052\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509959816932678\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127305984497\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527285695075989\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515172958374\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527203440666199\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525033831596375\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525607824325562\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952513575553894\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952492356300354\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9507269263267517\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95020991563797\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501603245735168\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501399993896484\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501211047172546\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500804543495178\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500559568405151\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950140655040741\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500619769096375\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499504566192627\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493473172187805\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490894675254822\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490166306495667\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490063786506653\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490393400192261\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489728212356567\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489889144897461\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490663409233093\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490382671356201\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489288926124573\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461055397987366\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459820985794067\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945800244808197\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458041787147522\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457813501358032\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457917809486389\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457793831825256\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458358883857727\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458024501800537\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457257986068726\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470417499542236\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467754364013672\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468873143196106\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468610286712646\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468559622764587\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.946881115436554\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468916654586792\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469581842422485\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.946902334690094\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467862248420715\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946925163269043\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466536045074463\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467248916625977\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466684460639954\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466921091079712\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466747641563416\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466868042945862\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467582106590271\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467106461524963\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946588933467865\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449532628059387\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447280168533325\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447537064552307\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447000026702881\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446333050727844\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446696043014526\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446315765380859\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446736574172974\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446404576301575\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445351362228394\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942328929901123\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423058032989502\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942328929901123\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423058032989502\n",
            "Training with: n_estimators=200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942061185836792\n",
            "Training with: n_estimators=1000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391321182251\n",
            "Training with: n_estimators=1200, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=20, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872164726257\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=30, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=40, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=50, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=60, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=70, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=80, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=90, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.955218493938446\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550700783729553\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550651907920837\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550322890281677\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9550878405570984\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551078677177429\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551146626472473\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551278948783875\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551370143890381\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9551090598106384\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9540285468101501\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539220333099365\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953902542591095\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538495540618896\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9538978934288025\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539040923118591\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539139270782471\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.953932523727417\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539390802383423\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9539044499397278\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510226845741272\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510024189949036\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510369300842285\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510142803192139\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509890079498291\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.95099276304245\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509879946708679\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509960412979126\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9510127902030945\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9509884715080261\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9528093934059143\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527286291122437\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527900218963623\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527425765991211\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527572989463806\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527350068092346\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527438282966614\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527515769004822\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9527204036712646\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525949358940125\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525034427642822\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525608420372009\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524984955787659\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.952509343624115\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525042772293091\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524971842765808\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525136351585388\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9525238275527954\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9524924159049988\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504606127738953\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503529071807861\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9504228830337524\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503744840621948\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503458738327026\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503262042999268\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.950348973274231\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503633975982666\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9503360390663147\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489457011222839\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488570094108582\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489189982414246\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489098787307739\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489037394523621\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489011168479919\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488667249679565\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488741159439087\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488797783851624\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9488527178764343\n",
            "Training with: n_estimators=200, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485816359519958\n",
            "Training with: n_estimators=400, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485252499580383\n",
            "Training with: n_estimators=600, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485847353935242\n",
            "Training with: n_estimators=800, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485470056533813\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485386610031128\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485254287719727\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.94850093126297\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9485029578208923\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.948509156703949\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=1.0, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9484851956367493\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.95073002576828\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9502129554748535\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501633048057556\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501429200172424\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9501240253448486\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500833749771118\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500588178634644\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.950143575668335\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9500648975372314\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9499533176422119\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9493488669395447\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490910172462463\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.949018120765686\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490079283714294\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490408301353455\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489743113517761\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489904642105103\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490678310394287\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9490398168563843\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9489304423332214\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9461058974266052\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9459824562072754\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458006024360657\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458045363426208\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457817673683167\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457921385765076\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9457797408103943\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458362460136414\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9458028674125671\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=1, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.945726215839386\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9470425248146057\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467761516571045\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468879699707031\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468616843223572\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468566179275513\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468818306922913\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9468923807144165\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469588994979858\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9469030499458313\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9467869997024536\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9469257593154907\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946654200553894\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467254877090454\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466690421104431\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946692705154419\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466753602027893\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9466874003410339\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467588067054749\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9467112421989441\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.946589469909668\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9449535608291626\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447282552719116\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447539448738098\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9447002410888672\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446334838867188\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.944669783115387\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446317553520203\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446738958358765\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9446406364440918\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=2, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9445353150367737\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=2, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9429272413253784\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424336552619934\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424007534980774\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942371666431427\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423441290855408\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423642158508301\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9423289895057678\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.9424319863319397\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942416787147522\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=5, bootstrap=True\n",
            "R^2 Score: 0.942305862903595\n",
            "Training with: n_estimators=200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9424594640731812\n",
            "Training with: n_estimators=400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420421123504639\n",
            "Training with: n_estimators=600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942036509513855\n",
            "Training with: n_estimators=800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420612454414368\n",
            "Training with: n_estimators=1000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420391917228699\n",
            "Training with: n_estimators=1200, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420535564422607\n",
            "Training with: n_estimators=1400, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420365691184998\n",
            "Training with: n_estimators=1600, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.942111611366272\n",
            "Training with: n_estimators=1800, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9420913457870483\n",
            "Training with: n_estimators=2000, max_depth=100, max_features=0.40824829046386296, min_samples_leaf=4, min_samples_split=10, bootstrap=True\n",
            "R^2 Score: 0.9419872760772705\n",
            "Training with: n_estimators=200, max_depth=None, max_features=1.0, min_samples_leaf=1, min_samples_split=2, bootstrap=True\n"
          ]
        },
        {
          "ename": "TypeError",
          "evalue": "'<=' not supported between instances of 'NoneType' and 'int'",
          "output_type": "error",
          "traceback": [
            "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[0;31mTypeError\u001b[0m                                 Traceback (most recent call last)",
            "\u001b[0;32m<ipython-input-11-cb189fdf2b13>\u001b[0m in \u001b[0;36m<cell line: 26>\u001b[0;34m()\u001b[0m\n\u001b[1;32m     33\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     34\u001b[0m                         \u001b[0;31m# Create and train the model\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 35\u001b[0;31m                         rf = RandomForestRegressor(n_estimators=n_estimators,\n\u001b[0m\u001b[1;32m     36\u001b[0m                                                    \u001b[0mmax_depth\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mmax_depth\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     37\u001b[0m                                                    \u001b[0mmax_features\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mmax_features\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/cuml/internals/api_decorators.py\u001b[0m in \u001b[0;36minner_f\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m    342\u001b[0m             \u001b[0mkwargs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mupdate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m{\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0marg\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mk\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0marg\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mzip\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0msig\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mparameters\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0margs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m}\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    343\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 344\u001b[0;31m             \u001b[0;32mreturn\u001b[0m \u001b[0mfunc\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    345\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    346\u001b[0m         \u001b[0;31m# Set this flag to prevent auto adding this decorator twice\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32mrandomforestregressor.pyx\u001b[0m in \u001b[0;36mcuml.ensemble.randomforestregressor.RandomForestRegressor.__init__\u001b[0;34m()\u001b[0m\n",
            "\u001b[0;32m/usr/local/lib/python3.10/dist-packages/cuml/internals/api_decorators.py\u001b[0m in \u001b[0;36minner_f\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m    342\u001b[0m             \u001b[0mkwargs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mupdate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m{\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0marg\u001b[0m \u001b[0;32mfor\u001b[0m \u001b[0mk\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0marg\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mzip\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0msig\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mparameters\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0margs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m}\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    343\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 344\u001b[0;31m             \u001b[0;32mreturn\u001b[0m \u001b[0mfunc\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    345\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    346\u001b[0m         \u001b[0;31m# Set this flag to prevent auto adding this decorator twice\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;32mrandomforest_common.pyx\u001b[0m in \u001b[0;36mcuml.ensemble.randomforest_common.BaseRandomForestModel.__init__\u001b[0;34m()\u001b[0m\n",
            "\u001b[0;31mTypeError\u001b[0m: '<=' not supported between instances of 'NoneType' and 'int'"
          ]
        }
      ],
      "source": [
        "#GPU enabled Random Forest Regression\n",
        "\n",
        "import cudf\n",
        "import numpy as np\n",
        "from cuml.ensemble import RandomForestRegressor\n",
        "from cuml.metrics import r2_score\n",
        "\n",
        "# Assuming X_train and y_train are already defined and are Pandas DataFrames\n",
        "# Convert the data to cuDF DataFrames for RAPIDS\n",
        "X_train_cudf = cudf.DataFrame.from_pandas(X_train.astype('float32'))\n",
        "y_train_cudf = cudf.Series(y_train.astype('float32'))\n",
        "\n",
        "# Define your parameter grid\n",
        "rf_params = {\n",
        "    'bootstrap': [True, False],\n",
        "    'max_depth': [10, 20, 30, 40, 50, 60, 70, 80, 90, 100, None],\n",
        "    'max_features': [1.0, X_train_cudf.shape[1] ** 0.5 / X_train_cudf.shape[1]],  # Use a float for percentage of features\n",
        "    'min_samples_leaf': [1, 2, 4],\n",
        "    'min_samples_split': [2, 5, 10],\n",
        "    'n_estimators': [200, 400, 600, 800, 1000, 1200, 1400, 1600, 1800, 2000]\n",
        "}\n",
        "\n",
        "# Initialize best score and parameters\n",
        "best_score = -np.inf\n",
        "best_params = {}\n",
        "\n",
        "# Loop over the grid\n",
        "for bootstrap in rf_params['bootstrap']:\n",
        "    for max_depth in rf_params['max_depth']:\n",
        "        for max_features in rf_params['max_features']:\n",
        "            for min_samples_leaf in rf_params['min_samples_leaf']:\n",
        "                for min_samples_split in rf_params['min_samples_split']:\n",
        "                    for n_estimators in rf_params['n_estimators']:\n",
        "                        print(f\"Training with: n_estimators={n_estimators}, max_depth={max_depth}, max_features={max_features}, min_samples_leaf={min_samples_leaf}, min_samples_split={min_samples_split}, bootstrap={bootstrap}\")\n",
        "\n",
        "                        # Create and train the model\n",
        "                        rf = RandomForestRegressor(n_estimators=n_estimators,\n",
        "                                                   max_depth=max_depth,\n",
        "                                                   max_features=max_features,\n",
        "                                                   min_samples_leaf=min_samples_leaf,\n",
        "                                                   min_samples_split=min_samples_split,\n",
        "                                                   bootstrap=bootstrap,\n",
        "                                                   n_streams=1,  # For reproducibility\n",
        "                                                   random_state=42)\n",
        "                        rf.fit(X_train_cudf, y_train_cudf)\n",
        "\n",
        "                        # Make predictions and evaluate\n",
        "                        y_pred = rf.predict(X_train_cudf)\n",
        "                        score = r2_score(y_train_cudf, y_pred)\n",
        "                        print(f\"R^2 Score: {score}\")\n",
        "\n",
        "                        # Compare with the best score\n",
        "                        if score > best_score:\n",
        "                            best_score = score\n",
        "                            best_params = {\n",
        "                                'n_estimators': n_estimators,\n",
        "                                'max_depth': max_depth,\n",
        "                                'max_features': max_features,\n",
        "                                'min_samples_leaf': min_samples_leaf,\n",
        "                                'min_samples_split': min_samples_split,\n",
        "                                'bootstrap': bootstrap\n",
        "                            }\n",
        "\n",
        "# Output the best parameters and the best score\n",
        "print(\"Best Random Forest parameters:\", best_params)\n",
        "print(\"Best Random Forest R^2 score:\", best_score)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "# Interpretation\n",
        "\n",
        "To properly compare the results of the Baseline model, Multiple Linear Regression, Best Polynomial model, and the Best Optimized Random Forest Regressor in terms of $R^2$ and Root Mean Square Error (RMSE), let's summarize the performance metrics:\n",
        "\n",
        "1. Baseline:\n",
        "\n",
        "Baseline Training R^2: 0.27555056242697507\n",
        "\n",
        "Baseline Testing R^2: 0.35664291868109677\n",
        "\n",
        "Baseline Training RMSE: 7.143950117300888\n",
        "\n",
        "Baseline Testing RMSE: 7.189316160047872\n",
        "\n",
        "2. Multiple Linear Regression:\n",
        "\n",
        "Training R^2: 0.9879085512445995\n",
        "\n",
        "Testing R^2: 0.9890992951689396\n",
        "\n",
        "Training RMSE: 0.9229401590287888\n",
        "\n",
        "Testing RMSE: 0.9358124742086974\n",
        "\n",
        "3. Best Polynomial:\n",
        "\n",
        "Best polynomial degree overall: 2\n",
        "\n",
        "Best polynomial R^2 overall: 0.9969985736508612\n",
        "\n",
        "4. Best Random Forest Regressor:\n",
        "\n",
        "Number of estimators: 200\n",
        "\n",
        "Max depth: 20\n",
        "\n",
        "Max features: 1.0\n",
        "\n",
        "Min samples leaf: 1\n",
        "\n",
        "Min samples split: 2\n",
        "\n",
        "Bootstrap: True\n",
        "\n",
        "R^2 Score: 0.9552183151245117\n",
        "\n",
        "### Analysis:\n",
        "\n",
        "- **Baseline vs. Models**: All the models significantly outperform the baseline in terms of both $R^2$ and RMSE on the testing set, indicating that they are all capable of capturing the patterns in the data much more effectively than a simple baseline prediction.\n",
        "\n",
        "- **Multiple Linear Regression vs. Polynomial Regression**: The best polynomial model (degree=2) shows an exceptionally high $R^2$ score of 0.9970, indicating almost perfect prediction capability. However, it's essential to note that high degrees of polynomials can sometimes lead to overfitting.\n",
        "\n",
        "- **Best Optimized Random Forest Regressor**: The Random Forest model shows a good $R^2$ score of 0.9552, which is higher than the baseline but does not surpass the linear regression or the polynomial model in terms of the $R^2$ score reported. \n",
        "\n",
        "Explanation (Possible Reason): Polynomial models can capture more complex relationships between features and the target variable compared to linear models. If the underlying relationship in the data is not linear but has a higher order (quadratic, cubic, etc.), polynomial regression can fit these curves much better, leading to higher accuracy.\n"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "gpuType": "T4",
      "machine_shape": "hm",
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}