Predictive_Analysis_SpaceX_Machine_Learning_Prediction.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<p style=\"text-align:center\">\n",
    "    <a href=\"https://skills.network/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork26802033-2022-01-01\" target=\"_blank\">\n",
    "    <img src=\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/assets/logos/SN_web_lightmode.png\" width=\"200\" alt=\"Skills Network Logo\"  />\n",
    "    </a>\n",
    "</p>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# **Space X  Falcon 9 First Stage Landing Prediction**\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Assignment:  Machine Learning Prediction\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Estimated time needed: **60** minutes\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Space X advertises Falcon 9 rocket launches on its website with a cost of 62 million dollars; other providers cost upward of 165 million dollars each, much of the savings is because Space X can reuse the first stage. Therefore if we can determine if the first stage will land, we can determine the cost of a launch. This information can be used if an alternate company wants to bid against space X for a rocket launch.   In this lab, you will create a machine learning pipeline  to predict if the first stage will land given the data from the preceding labs.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/landing\\_1.gif)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Several examples of an unsuccessful landing are shown here:\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/crash.gif)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Most unsuccessful landings are planed. Space X; performs a controlled landing in the oceans.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Objectives\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Perform exploratory  Data Analysis and determine Training Labels\n",
    "\n",
    "*   create a column for the class\n",
    "*   Standardize the data\n",
    "*   Split into training data and test data\n",
    "\n",
    "\\-Find best Hyperparameter for SVM, Classification Trees and Logistic Regression\n",
    "\n",
    "*   Find the method performs best using test data\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "***\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Import Libraries and Define Auxiliary Functions\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will import the following libraries for the lab\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Pandas is a software library written for the Python programming language for data manipulation and analysis.\n",
    "import pandas as pd\n",
    "# NumPy is a library for the Python programming language, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions to operate on these arrays\n",
    "import numpy as np\n",
    "# Matplotlib is a plotting library for python and pyplot gives us a MatLab like plotting framework. We will use this in our plotter function to plot data.\n",
    "import matplotlib.pyplot as plt\n",
    "#Seaborn is a Python data visualization library based on matplotlib. It provides a high-level interface for drawing attractive and informative statistical graphics\n",
    "import seaborn as sns\n",
    "# Preprocessing allows us to standarsize our data\n",
    "from sklearn import preprocessing\n",
    "# Allows us to split our data into training and testing data\n",
    "from sklearn.model_selection import train_test_split\n",
    "# Allows us to test parameters of classification algorithms and find the best one\n",
    "from sklearn.model_selection import GridSearchCV\n",
    "# Logistic Regression classification algorithm\n",
    "from sklearn.linear_model import LogisticRegression\n",
    "# Support Vector Machine classification algorithm\n",
    "from sklearn.svm import SVC\n",
    "# Decision Tree classification algorithm\n",
    "from sklearn.tree import DecisionTreeClassifier\n",
    "# K Nearest Neighbors classification algorithm\n",
    "from sklearn.neighbors import KNeighborsClassifier"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This function is to plot the confusion matrix.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "def plot_confusion_matrix(y,y_predict):\n",
    "    \"this function plots the confusion matrix\"\n",
    "    from sklearn.metrics import confusion_matrix\n",
    "\n",
    "    cm = confusion_matrix(y, y_predict)\n",
    "    ax= plt.subplot()\n",
    "    sns.heatmap(cm, annot=True, ax = ax); #annot=True to annotate cells\n",
    "    ax.set_xlabel('Predicted labels')\n",
    "    ax.set_ylabel('True labels')\n",
    "    ax.set_title('Confusion Matrix'); \n",
    "    ax.xaxis.set_ticklabels(['did not land', 'land']); ax.yaxis.set_ticklabels(['did not land', 'landed'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Load the dataframe\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Load the data\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>FlightNumber</th>\n",
       "      <th>Date</th>\n",
       "      <th>BoosterVersion</th>\n",
       "      <th>PayloadMass</th>\n",
       "      <th>Orbit</th>\n",
       "      <th>LaunchSite</th>\n",
       "      <th>Outcome</th>\n",
       "      <th>Flights</th>\n",
       "      <th>GridFins</th>\n",
       "      <th>Reused</th>\n",
       "      <th>Legs</th>\n",
       "      <th>LandingPad</th>\n",
       "      <th>Block</th>\n",
       "      <th>ReusedCount</th>\n",
       "      <th>Serial</th>\n",
       "      <th>Longitude</th>\n",
       "      <th>Latitude</th>\n",
       "      <th>Class</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>2010-06-04</td>\n",
       "      <td>Falcon 9</td>\n",
       "      <td>6104.959412</td>\n",
       "      <td>LEO</td>\n",
       "      <td>CCAFS SLC 40</td>\n",
       "      <td>None None</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0</td>\n",
       "      <td>B0003</td>\n",
       "      <td>-80.577366</td>\n",
       "      <td>28.561857</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>2012-05-22</td>\n",
       "      <td>Falcon 9</td>\n",
       "      <td>525.000000</td>\n",
       "      <td>LEO</td>\n",
       "      <td>CCAFS SLC 40</td>\n",
       "      <td>None None</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0</td>\n",
       "      <td>B0005</td>\n",
       "      <td>-80.577366</td>\n",
       "      <td>28.561857</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>2013-03-01</td>\n",
       "      <td>Falcon 9</td>\n",
       "      <td>677.000000</td>\n",
       "      <td>ISS</td>\n",
       "      <td>CCAFS SLC 40</td>\n",
       "      <td>None None</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0</td>\n",
       "      <td>B0007</td>\n",
       "      <td>-80.577366</td>\n",
       "      <td>28.561857</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>2013-09-29</td>\n",
       "      <td>Falcon 9</td>\n",
       "      <td>500.000000</td>\n",
       "      <td>PO</td>\n",
       "      <td>VAFB SLC 4E</td>\n",
       "      <td>False Ocean</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0</td>\n",
       "      <td>B1003</td>\n",
       "      <td>-120.610829</td>\n",
       "      <td>34.632093</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>2013-12-03</td>\n",
       "      <td>Falcon 9</td>\n",
       "      <td>3170.000000</td>\n",
       "      <td>GTO</td>\n",
       "      <td>CCAFS SLC 40</td>\n",
       "      <td>None None</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0</td>\n",
       "      <td>B1004</td>\n",
       "      <td>-80.577366</td>\n",
       "      <td>28.561857</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   FlightNumber        Date BoosterVersion  PayloadMass Orbit    LaunchSite  \\\n",
       "0             1  2010-06-04       Falcon 9  6104.959412   LEO  CCAFS SLC 40   \n",
       "1             2  2012-05-22       Falcon 9   525.000000   LEO  CCAFS SLC 40   \n",
       "2             3  2013-03-01       Falcon 9   677.000000   ISS  CCAFS SLC 40   \n",
       "3             4  2013-09-29       Falcon 9   500.000000    PO   VAFB SLC 4E   \n",
       "4             5  2013-12-03       Falcon 9  3170.000000   GTO  CCAFS SLC 40   \n",
       "\n",
       "       Outcome  Flights  GridFins  Reused   Legs LandingPad  Block  \\\n",
       "0    None None        1     False   False  False        NaN    1.0   \n",
       "1    None None        1     False   False  False        NaN    1.0   \n",
       "2    None None        1     False   False  False        NaN    1.0   \n",
       "3  False Ocean        1     False   False  False        NaN    1.0   \n",
       "4    None None        1     False   False  False        NaN    1.0   \n",
       "\n",
       "   ReusedCount Serial   Longitude   Latitude  Class  \n",
       "0            0  B0003  -80.577366  28.561857      0  \n",
       "1            0  B0005  -80.577366  28.561857      0  \n",
       "2            0  B0007  -80.577366  28.561857      0  \n",
       "3            0  B1003 -120.610829  34.632093      0  \n",
       "4            0  B1004  -80.577366  28.561857      0  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#data = pd.read_csv(\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_2.csv\")\n",
    "\n",
    "# If you were unable to complete the previous lab correctly you can uncomment and load this csv\n",
    "\n",
    "data = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/dataset_part_2.csv')\n",
    "\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>FlightNumber</th>\n",
       "      <th>PayloadMass</th>\n",
       "      <th>Flights</th>\n",
       "      <th>Block</th>\n",
       "      <th>ReusedCount</th>\n",
       "      <th>Orbit_ES-L1</th>\n",
       "      <th>Orbit_GEO</th>\n",
       "      <th>Orbit_GTO</th>\n",
       "      <th>Orbit_HEO</th>\n",
       "      <th>Orbit_ISS</th>\n",
       "      <th>...</th>\n",
       "      <th>Serial_B1058</th>\n",
       "      <th>Serial_B1059</th>\n",
       "      <th>Serial_B1060</th>\n",
       "      <th>Serial_B1062</th>\n",
       "      <th>GridFins_False</th>\n",
       "      <th>GridFins_True</th>\n",
       "      <th>Reused_False</th>\n",
       "      <th>Reused_True</th>\n",
       "      <th>Legs_False</th>\n",
       "      <th>Legs_True</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1.0</td>\n",
       "      <td>6104.959412</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2.0</td>\n",
       "      <td>525.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3.0</td>\n",
       "      <td>677.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4.0</td>\n",
       "      <td>500.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5.0</td>\n",
       "      <td>3170.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>85</th>\n",
       "      <td>86.0</td>\n",
       "      <td>15400.000000</td>\n",
       "      <td>2.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>86</th>\n",
       "      <td>87.0</td>\n",
       "      <td>15400.000000</td>\n",
       "      <td>3.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>87</th>\n",
       "      <td>88.0</td>\n",
       "      <td>15400.000000</td>\n",
       "      <td>6.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>88</th>\n",
       "      <td>89.0</td>\n",
       "      <td>15400.000000</td>\n",
       "      <td>3.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>89</th>\n",
       "      <td>90.0</td>\n",
       "      <td>3681.000000</td>\n",
       "      <td>1.0</td>\n",
       "      <td>5.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>90 rows × 83 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    FlightNumber   PayloadMass  Flights  Block  ReusedCount  Orbit_ES-L1  \\\n",
       "0            1.0   6104.959412      1.0    1.0          0.0          0.0   \n",
       "1            2.0    525.000000      1.0    1.0          0.0          0.0   \n",
       "2            3.0    677.000000      1.0    1.0          0.0          0.0   \n",
       "3            4.0    500.000000      1.0    1.0          0.0          0.0   \n",
       "4            5.0   3170.000000      1.0    1.0          0.0          0.0   \n",
       "..           ...           ...      ...    ...          ...          ...   \n",
       "85          86.0  15400.000000      2.0    5.0          2.0          0.0   \n",
       "86          87.0  15400.000000      3.0    5.0          2.0          0.0   \n",
       "87          88.0  15400.000000      6.0    5.0          5.0          0.0   \n",
       "88          89.0  15400.000000      3.0    5.0          2.0          0.0   \n",
       "89          90.0   3681.000000      1.0    5.0          0.0          0.0   \n",
       "\n",
       "    Orbit_GEO  Orbit_GTO  Orbit_HEO  Orbit_ISS  ...  Serial_B1058  \\\n",
       "0         0.0        0.0        0.0        0.0  ...           0.0   \n",
       "1         0.0        0.0        0.0        0.0  ...           0.0   \n",
       "2         0.0        0.0        0.0        1.0  ...           0.0   \n",
       "3         0.0        0.0        0.0        0.0  ...           0.0   \n",
       "4         0.0        1.0        0.0        0.0  ...           0.0   \n",
       "..        ...        ...        ...        ...  ...           ...   \n",
       "85        0.0        0.0        0.0        0.0  ...           0.0   \n",
       "86        0.0        0.0        0.0        0.0  ...           1.0   \n",
       "87        0.0        0.0        0.0        0.0  ...           0.0   \n",
       "88        0.0        0.0        0.0        0.0  ...           0.0   \n",
       "89        0.0        0.0        0.0        0.0  ...           0.0   \n",
       "\n",
       "    Serial_B1059  Serial_B1060  Serial_B1062  GridFins_False  GridFins_True  \\\n",
       "0            0.0           0.0           0.0             1.0            0.0   \n",
       "1            0.0           0.0           0.0             1.0            0.0   \n",
       "2            0.0           0.0           0.0             1.0            0.0   \n",
       "3            0.0           0.0           0.0             1.0            0.0   \n",
       "4            0.0           0.0           0.0             1.0            0.0   \n",
       "..           ...           ...           ...             ...            ...   \n",
       "85           0.0           1.0           0.0             0.0            1.0   \n",
       "86           0.0           0.0           0.0             0.0            1.0   \n",
       "87           0.0           0.0           0.0             0.0            1.0   \n",
       "88           0.0           1.0           0.0             0.0            1.0   \n",
       "89           0.0           0.0           1.0             0.0            1.0   \n",
       "\n",
       "    Reused_False  Reused_True  Legs_False  Legs_True  \n",
       "0            1.0          0.0         1.0        0.0  \n",
       "1            1.0          0.0         1.0        0.0  \n",
       "2            1.0          0.0         1.0        0.0  \n",
       "3            1.0          0.0         1.0        0.0  \n",
       "4            1.0          0.0         1.0        0.0  \n",
       "..           ...          ...         ...        ...  \n",
       "85           0.0          1.0         0.0        1.0  \n",
       "86           0.0          1.0         0.0        1.0  \n",
       "87           0.0          1.0         0.0        1.0  \n",
       "88           0.0          1.0         0.0        1.0  \n",
       "89           1.0          0.0         0.0        1.0  \n",
       "\n",
       "[90 rows x 83 columns]"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#X = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_3.csv')\n",
    "\n",
    "# If you were unable to complete the previous lab correctly you can uncomment and load this csv\n",
    "\n",
    "X = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/dataset_part_3.csv')\n",
    "\n",
    "X.head(100)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  1\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Create a NumPy array from the column <code>Class</code> in <code>data</code>, by applying the method <code>to_numpy()</code>  then\n",
    "assign it  to the variable <code>Y</code>,make sure the output is a  Pandas series (only one bracket df\\['name of  column']).\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 1, 1, 1,\n",
       "       1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n",
       "       1, 0, 0, 0, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1,\n",
       "       1, 0, 1, 1, 1, 1, 0, 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n",
       "       1, 1])"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Y = data.Class.to_numpy()\n",
    "Y"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  2\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Standardize the data in <code>X</code> then reassign it to the variable  <code>X</code> using the transform provided below.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "# students get this \n",
    "transform = preprocessing.StandardScaler()\n",
    "X = transform.fit_transform(X)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[-1.71291154e+00, -1.94814463e-16, -6.53912840e-01, ...,\n",
       "        -8.35531692e-01,  1.93309133e+00, -1.93309133e+00],\n",
       "       [-1.67441914e+00, -1.19523159e+00, -6.53912840e-01, ...,\n",
       "        -8.35531692e-01,  1.93309133e+00, -1.93309133e+00],\n",
       "       [-1.63592675e+00, -1.16267307e+00, -6.53912840e-01, ...,\n",
       "        -8.35531692e-01,  1.93309133e+00, -1.93309133e+00],\n",
       "       ...,\n",
       "       [ 1.63592675e+00,  1.99100483e+00,  3.49060516e+00, ...,\n",
       "         1.19684269e+00, -5.17306132e-01,  5.17306132e-01],\n",
       "       [ 1.67441914e+00,  1.99100483e+00,  1.00389436e+00, ...,\n",
       "         1.19684269e+00, -5.17306132e-01,  5.17306132e-01],\n",
       "       [ 1.71291154e+00, -5.19213966e-01, -6.53912840e-01, ...,\n",
       "        -8.35531692e-01, -5.17306132e-01,  5.17306132e-01]])"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We split the data into training and testing data using the  function  <code>train_test_split</code>.   The training data is divided into validation data, a second set used for training  data; then the models are trained and hyperparameters are selected using the function <code>GridSearchCV</code>.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  3\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Use the function train_test_split to split the data X and Y into training and test data. Set the parameter test_size to  0.2 and random_state to 2. The training data and test data should be assigned to the following labels.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<code>X_train, X_test, Y_train, Y_test</code>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train, X_test, Y_train, Y_test = train_test_split(X, Y, test_size=0.2, random_state=2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "we can see we only have 18 test samples.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(18,)"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Y_test.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  4\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Create a logistic regression object  then create a  GridSearchCV object  <code>logreg_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "parameters ={'C':[0.01,0.1,1],\n",
    "             'penalty':['l2'],\n",
    "             'solver':['lbfgs']}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-1 {color: black;background-color: white;}#sk-container-id-1 pre{padding: 0;}#sk-container-id-1 div.sk-toggleable {background-color: white;}#sk-container-id-1 label.sk-toggleable__label {cursor: pointer;display: block;width: 100%;margin-bottom: 0;padding: 0.3em;box-sizing: border-box;text-align: center;}#sk-container-id-1 label.sk-toggleable__label-arrow:before {content: \"▸\";float: left;margin-right: 0.25em;color: #696969;}#sk-container-id-1 label.sk-toggleable__label-arrow:hover:before {color: black;}#sk-container-id-1 div.sk-estimator:hover label.sk-toggleable__label-arrow:before {color: black;}#sk-container-id-1 div.sk-toggleable__content {max-height: 0;max-width: 0;overflow: hidden;text-align: left;background-color: #f0f8ff;}#sk-container-id-1 div.sk-toggleable__content pre {margin: 0.2em;color: black;border-radius: 0.25em;background-color: #f0f8ff;}#sk-container-id-1 input.sk-toggleable__control:checked~div.sk-toggleable__content {max-height: 200px;max-width: 100%;overflow: auto;}#sk-container-id-1 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {content: \"▾\";}#sk-container-id-1 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-1 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-1 input.sk-hidden--visually {border: 0;clip: rect(1px 1px 1px 1px);clip: rect(1px, 1px, 1px, 1px);height: 1px;margin: -1px;overflow: hidden;padding: 0;position: absolute;width: 1px;}#sk-container-id-1 div.sk-estimator {font-family: monospace;background-color: #f0f8ff;border: 1px dotted black;border-radius: 0.25em;box-sizing: border-box;margin-bottom: 0.5em;}#sk-container-id-1 div.sk-estimator:hover {background-color: #d4ebff;}#sk-container-id-1 div.sk-parallel-item::after {content: \"\";width: 100%;border-bottom: 1px solid gray;flex-grow: 1;}#sk-container-id-1 div.sk-label:hover label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-1 div.sk-serial::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: 0;}#sk-container-id-1 div.sk-serial {display: flex;flex-direction: column;align-items: center;background-color: white;padding-right: 0.2em;padding-left: 0.2em;position: relative;}#sk-container-id-1 div.sk-item {position: relative;z-index: 1;}#sk-container-id-1 div.sk-parallel {display: flex;align-items: stretch;justify-content: center;background-color: white;position: relative;}#sk-container-id-1 div.sk-item::before, #sk-container-id-1 div.sk-parallel-item::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: -1;}#sk-container-id-1 div.sk-parallel-item {display: flex;flex-direction: column;z-index: 1;position: relative;background-color: white;}#sk-container-id-1 div.sk-parallel-item:first-child::after {align-self: flex-end;width: 50%;}#sk-container-id-1 div.sk-parallel-item:last-child::after {align-self: flex-start;width: 50%;}#sk-container-id-1 div.sk-parallel-item:only-child::after {width: 0;}#sk-container-id-1 div.sk-dashed-wrapped {border: 1px dashed gray;margin: 0 0.4em 0.5em 0.4em;box-sizing: border-box;padding-bottom: 0.4em;background-color: white;}#sk-container-id-1 div.sk-label label {font-family: monospace;font-weight: bold;display: inline-block;line-height: 1.2em;}#sk-container-id-1 div.sk-label-container {text-align: center;}#sk-container-id-1 div.sk-container {/* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */display: inline-block !important;position: relative;}#sk-container-id-1 div.sk-text-repr-fallback {display: none;}</style><div id=\"sk-container-id-1\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>GridSearchCV(cv=10, estimator=LogisticRegression(), n_jobs=-1,\n",
       "             param_grid={&#x27;C&#x27;: [0.01, 0.1, 1], &#x27;penalty&#x27;: [&#x27;l2&#x27;],\n",
       "                         &#x27;solver&#x27;: [&#x27;lbfgs&#x27;]})</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item sk-dashed-wrapped\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-1\" type=\"checkbox\" ><label for=\"sk-estimator-id-1\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">GridSearchCV</label><div class=\"sk-toggleable__content\"><pre>GridSearchCV(cv=10, estimator=LogisticRegression(), n_jobs=-1,\n",
       "             param_grid={&#x27;C&#x27;: [0.01, 0.1, 1], &#x27;penalty&#x27;: [&#x27;l2&#x27;],\n",
       "                         &#x27;solver&#x27;: [&#x27;lbfgs&#x27;]})</pre></div></div></div><div class=\"sk-parallel\"><div class=\"sk-parallel-item\"><div class=\"sk-item\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-2\" type=\"checkbox\" ><label for=\"sk-estimator-id-2\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">estimator: LogisticRegression</label><div class=\"sk-toggleable__content\"><pre>LogisticRegression()</pre></div></div></div><div class=\"sk-serial\"><div class=\"sk-item\"><div class=\"sk-estimator sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-3\" type=\"checkbox\" ><label for=\"sk-estimator-id-3\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">LogisticRegression</label><div class=\"sk-toggleable__content\"><pre>LogisticRegression()</pre></div></div></div></div></div></div></div></div></div></div>"
      ],
      "text/plain": [
       "GridSearchCV(cv=10, estimator=LogisticRegression(), n_jobs=-1,\n",
       "             param_grid={'C': [0.01, 0.1, 1], 'penalty': ['l2'],\n",
       "                         'solver': ['lbfgs']})"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#parameters ={\"C\":[0.01,0.1,1],'penalty':['l2'], 'solver':['lbfgs']}# l1 lasso l2 ridge\n",
    "lr=LogisticRegression()\n",
    "logreg_cv = GridSearchCV(lr, param_grid=parameters, cv=10, n_jobs=-1)\n",
    "logreg_cv.fit(X_train, Y_train)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We output the <code>GridSearchCV</code> object for logistic regression. We display the best parameters using the data attribute <code>best_params\\_</code> and the accuracy on the validation data using the data attribute <code>best_score\\_</code>.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "tuned hpyerparameters :(best parameters)  {'C': 0.01, 'penalty': 'l2', 'solver': 'lbfgs'}\n",
      "accuracy : 0.8464285714285713\n"
     ]
    }
   ],
   "source": [
    "print(\"tuned hpyerparameters :(best parameters) \",logreg_cv.best_params_)\n",
    "print(\"accuracy :\",logreg_cv.best_score_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  5\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Calculate the accuracy on the test data using the method <code>score</code>:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8333333333333334"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "logreg_cv.best_estimator_.score(X_test, Y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets look at the confusion matrix:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/NK7nSAAAACXBIWXMAAAsTAAALEwEAmpwYAAAfuUlEQVR4nO3dd5xdVbn/8c93JoEECKG3ACYqRQTpXami9CaCFAugAQXBinD1RwQLclUU78USEYFQBJTQQhMwRpASEkILCFcCEhIIICUQSjLz/P7Ya+BknMycc2bvc/bkfN+v137l7HLWembm5Jk1a6+1tiICMzMrn7ZmB2BmZj1zgjYzKyknaDOzknKCNjMrKSdoM7OScoI2MyspJ2jrN0lDJV0r6RVJV/SjnMMl3ZxnbM0g6QZJn212HDbwOUG3EEmHSbpX0muSZqdE8uEcij4IWBVYMSI+WW8hEXFxRHwsh3gWImknSSFpfLfjG6fjE6ss57uSLurruojYIyIuqDNcs3c4QbcISV8Dfg78kCyZrg38Etgvh+LfAzwWEQtyKKsozwPbSlqx4thngcfyqkAZ/5+y3PjD1AIkDQdOB46LiCsj4vWImB8R10bEN9M1S0r6uaRZafu5pCXTuZ0kzZT0dUlzUuv7yHTuNOBU4JDUMj+6e0tT0sjUUh2U9j8n6QlJcyXNkHR4xfHbK963naTJqetksqTtKs5NlPQ9SXekcm6WtFIv34a3gauAT6X3twOHABd3+16dLelpSa9KmiLpI+n47sB/VXyd91fE8QNJdwDzgPemY59P538l6U8V5Z8p6VZJqvbnZ63LCbo1bAsMAcb3cs23gW2ATYCNga2A71ScXw0YDowAjgbOkbR8RIwha5VfFhHLRMTvegtE0tLAL4A9ImIYsB0wrYfrVgAmpGtXBM4CJnRrAR8GHAmsAiwBfKO3uoELgc+k1x8HHgJmdbtmMtn3YAXgEuAKSUMi4sZuX+fGFe/5NDAaGAY81a28rwMbpV8+HyH73n02vMaCVcEJujWsCLzQRxfE4cDpETEnIp4HTiNLPF3mp/PzI+J64DVgvTrj6QQ2lDQ0ImZHxMM9XLMX8HhEjIuIBRFxKfAosE/FNb+PiMci4g3gcrLEukgR8XdgBUnrkSXqC3u45qKIeDHV+VNgSfr+Os+PiIfTe+Z3K28e2ffxLOAi4MsRMbOP8swAJ+hW8SKwUlcXwyKswcKtv6fSsXfK6Jbg5wHL1BpIRLxO1rVwLDBb0gRJ61cRT1dMIyr2n60jnnHA8cDO9PAXhaRvSHokdau8TPZXQ29dJwBP93YyIu4GngBE9ovErCpO0K3hTuAtYP9erplFdrOvy9r855//1XodWKpif7XKkxFxU0TsBqxO1ir+bRXxdMX0TJ0xdRkHfAm4PrVu35G6IE4CDgaWj4jlgFfIEivAoroleu2ukHQcWUt8VirfrCpO0C0gIl4hu5F3jqT9JS0labCkPST9d7rsUuA7klZON9tOJfuTvB7TgB0krZ1uUJ7SdULSqpL2S33Rb5F1lXT2UMb1wLppaOAgSYcAGwDX1RkTABExA9iRrM+9u2HAArIRH4MknQosW3H+OWBkLSM1JK0LfB84gqyr4yRJm9QXvbUaJ+gWkfpTv0Z24+95sj/Ljycb2QBZErkXeAB4EJiajtVT15+By1JZU1g4qbalOGYB/yZLll/soYwXgb3JbrK9SNby3DsiXqgnpm5l3x4RPf11cBNwI9nQu6eAN1m4+6JrEs6Lkqb2VU/qUroIODMi7o+Ix8lGgozrGiFj1hv5ZrKZWTm5BW1mVlJO0GZmOZN0XprU9VDFsR9LelTSA5LGS1qur3KcoM3M8nc+sHu3Y38GNoyID5Hd5zil+5u6c4I2M8tZREwiuwleeezmirkEdwFr9lVObxMXmuqokQf57qWZVeW8J//Y77VN5r/wRNU5Z4mV33cM2fT+LmMjYmwN1R1FNtKpV6VN0GZmDdXZUfWlKRnXkpDfIenbZOPtL+7rWidoMzOA6Gm+VL4kfY5sfP+u1SyY5QRtZgbQWWyCTkvWngTs2H2ZgUVxgjYzAyLHFrSkS4GdyBYpmwmMIRu1sSTw57Qc+F0RcWxv5ThBm5kBdOT3QKCIOLSHw72uld4TJ2gzM6jpJmGjOEGbmUFDbhLWygnazAwKv0lYDydoMzPyvUmYFydoMzNwC9rMrLQ65vd9TYM5QZuZgW8SmpmVlrs4zMxKyi1oM7OScgvazKycotM3Cc3MysktaDOzknIftJlZSXmxJDOzknIL2syspNwHbWZWUjku2J8XJ2gzM3AL2sysrCJ8k9DMrJzcgjYzK6lWGMUhaS4QizofEcvmXaeZWb+1Qgs6IoYBSPoeMBsYBwg4HFg97/rMzHLRYqM49o2IjSv2fyXpfuDUAus0M6tPCbs42gos+3VJh0tql9Qm6XDg9QLrMzOrX2dn9VuDFJmgDwMOBp5L2yfTMTOz8ilhgi6siyMingT2K6p8M7NclbCLo7AELWll4AvAyMp6IuKoouo0M6tbjjcJJZ0H7A3MiYgN07EVgMvIcuKTwMER8VJv5RTZxXE1MBy4BZhQsZmZlU++XRznA7t3O3YycGtErAPcmvZ7VeQojqUi4lsFlm9mlp8cuzgiYpKkkd0O7wfslF5fAEwEes2RRbagr5O0Z4Hlm5nlp/ibhKtGxOz0+llg1b7eUGSCPpEsSb8h6VVJcyW9WmB9Zmb1qyFBSxot6d6KbXQtVUVE0MuM6y5FjuIYVlTZZma5iz7zZcWlMRYYW2MNz0laPSJmS1odmNPXGwpdLEnS8sA6wJCuYxExqcg6zczqsqDwqd7XAJ8FfpT+vbqvNxQ5zO7zZN0cawLTgG2AO4FdiqrTzKxuOd4klHQp2Q3BlSTNBMaQJebLJR0NPEU2ka9XRbagTwS2BO6KiJ0lrQ/8sMD6zMzql+MMwYg4dBGndq2lnCIT9JsR8aYkJC0ZEY9KWq/A+szM6ldDH3SjFJmgZ0paDrgK+LOkl8ia9WZm5dMK60F3iYgD0svvSvoL2azCG4uqz8ysX1ohQaf55t09mP5dBvh33nWamfVXdLTGQ2OnkA3AVsWxrv0A3ltAnWZm/dMKLeiIGJV3mWZmhWul5UbNzAaUztYaxWFmNnC0QheHmdmA1CI3CQGQNC4iPt3XMVu0QUsO5uTLTmfwkoNpa2/n3hvu5OqfXd7ssKzJ/LkoSIu1oD9YuSOpHdi8wPoWOwvems+PDzuNt+a9Sfugdk754/d5cOJ9PHHf480OzZrIn4uClLAPOvf1oCWdImku8KGKdaDnki2t1+fqTbawt+a9CUD7oHbaB7VXsYKstQJ/LgoQndVvDVLEMLszgDMknRERp+RdfqtRWxtjrjuTVd6zGreNu4knprmVZP5cFKIVWtBdIuIUSftK+kna9u7rPZVPKfjH3CeKCm1Aic5OvrvnN/n6tscwauP3M2LdtZodkpWAPxf5i87OqrdGKSxBSzqDbMnR6Wk7UVKvy41GxNiI2CIitlhvmCccVnrj1Xk8eudDbLjjps0OxUrEn4scdXRUvzVIkc8k3AvYLSLOi4jzyB5B3mcr2t41bIVlGbrsUgAMXnIJPvjhjXn2n880OSprNn8uCtIZ1W8NUvQ46OV4d3Gk4QXXtdgZvsryHP3T42lra0NtYvKEv3P/bVOaHZY1mT8XBWmxYXZnAPelpUYF7ACcXGB9i52Zjz7FaXt9s9lhWMn4c1GQEt4kLHI96EslTSR77BXAtyLi2aLqMzPrlxZcLKkNeCHVs66kdf1UbzMrpVZqQUs6EzgEeBjo+tUUgBO0mZVOLGihtTiA/YH1IuKtAuswM8tHK7WggSeAwYATtJmVX4v1Qc8Dpkm6lYokHREnFFinmVl9WqwFfU3azMxKL1opQUfEBUWVbWaWuxa7SWhmNnC0UgvazGxAKWGCLnKxJDOzASMiqt76Iumrkh6W9JCkSyUNqSem3FvQkq6ll+c7RMS+eddpZtZvObWgJY0ATgA2iIg3JF0OfAo4v9ayiuji+En690BgNeCitH8o8FwB9ZmZ9V++XRyDgKGS5gNLAbPqLSRXEfFXAEk/jYgtKk5dK+nevOszM8tDLKh+ooqk0cDoikNjI2IsQEQ8I+knwL+AN4CbI+LmemIqsg96aUnvPBZF0ihg6QLrMzOrX2f1W+XTn9I2tqsYScsD+wGjgDXIcuER9YRU5CiOrwITJT1Bth70e4BjCqzPzKxuOU5U+SgwIyKeB5B0JbAd73b3Vq3IiSo3SloHWD8detQLJ5lZaeWXoP8FbCNpKbIujl2Burp3ixjFsUtE3CbpwG6n3ieJiLgy7zrNzPotp7WSIuJuSX8EpgILgPuAsb2/q2dFtKB3BG4D9unhXABO0GZWOnmuxRERY4Ax/S2niFEcY9K/R+ZdtplZUWJB+WYSFtHF8bXezkfEWXnXaWbWb+VbDrqQLo5h6d/1yB4Y27Xk6D7APQXUZ2bWbyVcr7+QLo7TACRNAjaLiLlp/7vAhLzrMzPLRSsk6AqrAm9X7L+djpmZlc6Ab0GnGTJrRcQDVVx+IXCPpPFpf3/qWCzEzKwRYkGzI/hPfSZoSROBfdO1U4A5ku6IiL5uBv5A0g3AR9KhIyPivn7Ga2ZWiIHagh4eEa9K+jxwYUSMkVRNC5qImEo2WNvMrNTKmKCrWSxpkKTVgYOB6wqOx8ysOULVbw1STQv6dOAm4PaImJxWqHu82LDMzBqrjC3oPhN0RFwBXFGx/wTwiSKDMjNrtOhsXMu4WotM0JL+h94fXXVCIRGZmTVBZ8cAStDUuTyemdlANKC6OCLigsp9SUtFxLziQzIza7wydnH0OYpD0raSpgOPpv2NJf2y8MjMzBooovqtUaoZZvdz4OPAiwARcT+wQ4ExmZk1XHSq6q1RqprqHRFPSwsF1VFMOGZmzTHQbhJ2eVrSdkBIGgycCDxSbFhmZo1Vxj7oahL0scDZwAhgFtmkleOKDMrMrNGigTMEq1XNRJUXgMMbEIuZWdOUcZhdNaM43ivpWknPS5oj6eo03dvMbLHRGap6a5RqRnFcAlwOrA6sQTbt+9IigzIza7QIVb01SjUJeqmIGBcRC9J2ETCk6MDMzBqps0NVb43S21ocK6SXN0g6GfgD2dochwDXNyA2M7OGGWijOKaQJeSuqI+pOBfAKUUFZWbWaI3sW65Wb2txjGpkIGZmzTQgh9kBSNoQ2ICKvueIuLCooMzMGq2Ra2xUq5qHxo4BdiJL0NcDewC3kz2128xssZBnF4ek5YBzgQ3JuoSPiog7ay2nmhb0QcDGwH0RcaSkVYGLaq3IzKzMOvO9SXg2cGNEHCRpCWCpegqpJkG/ERGdkhZIWhaYA6xVT2VmZmWVVwta0nCyFT8/BxARbwNv11NWNQn63tRc/y3ZyI7XgJqb6rW6cFbhVdgA9MasvzU7BFtM1XKTUNJoYHTFobERMTa9HgU8D/xe0sZkefPEiHi91pgUNfSMSxoJLBsRD9RaUa0GLTGihF321mxO0NaTwSu9t9/N37vXOLDqnLP1rCsXWZ+kLYC7gO0j4m5JZwOvRsT/qzWm3iaqbNbbuYiYWmtlZmZllWOLcCYwMyLuTvt/BE6up6Deujh+2su5AHapp0IzszLq6Kxm5Yu+RcSzkp6WtF5E/APYFZheT1m9TVTZud4AzcwGmpxXG/0ycHEawfEEcGQ9hVQ1UcXMbHEX5DfMLiKmAVv0txwnaDMzoLOEwxKcoM3MgM4cW9B5qeaJKpJ0hKRT0/7akrYqPjQzs8YJVPXWKNXctvwlsC1waNqfC5xTWERmZk3QgareGqWaLo6tI2IzSfcBRMRL6c6kmdlio4TPjK0qQc+X1E4axy1pZcr5tZiZ1a2MSa2aLo5fAOOBVST9gGyp0R8WGpWZWYOVsQ+6zxZ0RFwsaQrZbBgB+0fEI4VHZmbWQCV8JGFVC/avDcwDrq08FhH/KjIwM7NGKuMwu2r6oCfw7sNjh5AtpfcP4IMFxmVm1lAdzQ6gB9V0cWxUuZ9WuftSYRGZmTVBpwZmC3ohETFV0tZFBGNm1iwlnOldVR/01yp224DNgFmFRWRm1gRlHGZXTQt6WMXrBWR90n8qJhwzs+YYcKM40gSVYRHxjQbFY2bWFI2cwl2t3h55NSgiFkjavpEBmZk1w0BrQd9D1t88TdI1wBXAO0+ljYgrC47NzKxhBmof9BDgRbJnEHaNhw7ACdrMFhsDbRTHKmkEx0O8m5i7lPFrMTOr20Dr4mgHloEee86doM1ssTLQujhmR8TpDYvEzKyJOgZYC7qE4ZqZFWOgtaB3bVgUZmZNNqASdET8u5GBmJk1UxlvrNW8WJKZ2eJooI3iMDNrGQOqi8PMrJUMyAX7zcxaQd5dHGmxuXuBZyJi73rKcII2M6OQLo4TgUeAZestoC2/WMzMBq6oYeuLpDWBvYBz+xOTE7SZGdBJVL1JGi3p3optdLfifg6cRD8b5u7iMDOjtpuEETEWGNvTOUl7A3MiYoqknfoTkxO0mRm59kFvD+wraU+y5ZqXlXRRRBxRa0Hu4jAzIxvFUe3Wm4g4JSLWjIiRwKeA2+pJzlBQC1rSgb2d99NYzKxsOks42buoLo590r+rANsBt6X9nYG/46exmFnJFJGeI2IiMLHe9xeSoCPiSABJNwMbRMTstL86cH4RdZqZ9UcrTvVeqys5J88Baxdcp5lZzTpaqIujy62SbgIuTfuHALcUXKeZWc1argUdEcdLOgDYIR0aGxHji6zTzKwerXSTsNJUYG5E3CJpKUnDImJuA+o1M6ta+dJzweOgJX0B+CPwm3RoBHBVkXWamdWjs4atUYpuQR8HbAXcDRARj0tapeA6zcxq1oo3Cd+KiLelbOqNpEGU8y8JM2txZeyDLnqq918l/RcwVNJuwBXAtQXXuVj5+Md24uGHJvHo9Ns56ZvHNTsca5Lv/PAsdtjrU+x/xLHvHPvJ/57LPod+gQM+80VOOOV0Xp37WhMjHPjyXG40L0Un6JOB54EHgWOA64HvFFznYqOtrY1fnP0D9t7nCDbaeGcOOWR/PvCBdZodljXB/nvuxq/P+v5Cx7bdclPGj/s14y/8FSPXGsG54y5rUnSLh1qWG22UQhN0RHRGxG8j4pMRcVB6Xb6/I0pqqy035Z//fJIZM/7F/Pnzufzyq9l3n483Oyxrgi022Yjhyw5b6Nj2W2/OoEHtAHzog+vz3JwXmhHaYqNlbhJKepBe/hKIiA8VUe/iZo0Rq/H0zFnv7M98ZjZbbblpEyOysho/4WZ233XHZocxoEUJ+6CLuknY9YDErk7TcenfI+glcaenEowGUPtw2tqWLig8s8XHby64lPb2dvb+2M7NDmVAa5lRHBHxFICk3SKissn3LUlTyfqme3rfO08pGLTEiPJ9txps1jPPstaaa7yzv+aI1Zk169kmRmRlc9WEPzPpjns49xdn0DVayupTxqneRd8klKTtK3a2a0Cdi43J907j/e8fxciRazF48GAOPng/rr3u5maHZSVx+133ct4lV/A/Z45h6JAhzQ5nwOuMqHprlKLHQR8NnCdpOCDgJeCogutcbHR0dHDiV77D9RMuob2tjfMvuIzp0x9rdljWBN8c8yMm3/cAL7/8KrvufwRfOvrTnDvuMt6eP58vfOXbQHajcMxJX25ypANXGf9kVyMGVaQETUS8Uu173MVhPXlj1t+aHYKV0OCV3tvv/p3D3nNA1TnnkqfGN6Q/qdAWtKQlgU8AI4FBXX1kEXF6kfWamdWqlUZxdLkaeAWYArxVcF1mZnVb0IIJes2I2L3gOszM+q2MLeiiR1T8XdJGBddhZtZvLTOTsMKHgc9JmkHWxSEgPJPQzMqmjKtQFJ2g9yi4fDOzXJRxudGin0nYNaNwFcAj6c2stMo41bvoR17tK+lxYAbwV+BJ4IYi6zQzq0fLLTcKfA/YBngsIkYBuwJ3FVynmVnNIqLqrVGKTtDzI+JFoE1SW0T8Bdii4DrNzGrWiqM4Xpa0DDAJuFjSHOD1gus0M6tZXuOgJa0FXAisSrbEx9iIOLuesopuQe8HvAF8FbgR+CewT8F1mpnVLMc+6AXA1yNiA7Iu3uMkbVBPTEWP4qhsLV9QZF1mZv3REfl0XkTEbGB2ej1X0iPACGB6rWUV9cirufS8el/XRJVli6jXzKxeRUz1ljQS2BS4u573F/VElWF9X2VmVh61LMRf+Xi+ZGx6IlTlNcsAfwK+EhGv1hNT0TcJzcwGhFraz5WP5+uJpMFkyfniiLiy3picoM3MyG+qt7KF738HPBIRZ/WnLD8f0MyMXEdxbA98GthF0rS07VlPTG5Bm5mR6yiO28kGRPSbE7SZGeVcsN8J2syM1lwP2sxsQGi59aDNzAYKt6DNzEqqo6Hr1FXHCdrMjNpmEjaKE7SZGR7FYWZWWm5Bm5mVlFvQZmYl5Ra0mVlJ5TXVO09O0GZmuIvDzKy0wi1oM7Ny8lRvM7OS8lRvM7OScgvazKykOjrdB21mVkoexWFmVlLugzYzKyn3QZuZlZRb0GZmJeWbhGZmJeUuDjOzknIXh5lZSXm5UTOzkvI4aDOzknIL2syspDpLuNxoW7MDMDMrg4ioeuuLpN0l/UPS/0k6ud6Y3II2MyO/URyS2oFzgN2AmcBkSddExPRay3IL2swMiBq2PmwF/F9EPBERbwN/AParJ6bStqAXvP2Mmh1DWUgaHRFjmx2HlYs/F/mqJedIGg2Mrjg0tuJnMQJ4uuLcTGDremJyC3pgGN33JdaC/LlokogYGxFbVGyF/KJ0gjYzy9czwFoV+2umYzVzgjYzy9dkYB1JoyQtAXwKuKaegkrbB20LcT+j9cSfixKKiAWSjgduAtqB8yLi4XrKUhkXCDEzM3dxmJmVlhO0mVlJOUH3g6TvSvpGen26pI/2cM1Okq7Lqb7/6uXck5JWyqme1/Iox+qT1/df0khJD+VRljWHE3ROIuLUiLil4GoWmaDNbPHjBF0jSd+W9Jik24H1Ko6fL+mg9Hp3SY9KmgocuIhyPifpSkk3Snpc0n9XnDtU0oOSHpJ0Zjr2I2CopGmSLu4jxqskTZH0cJrx1HX8NUk/kHS/pLskrZqOj5J0Z6rz+/349liOJC0j6VZJU9PPZr90fKSkRyT9Nv2Mb5Y0NJ3bPP187weOa+oXYP3mBF0DSZuTjWncBNgT2LKHa4YAvwX2ATYHVuulyE2AQ4CNgEMkrSVpDeBMYJd0fktJ+0fEycAbEbFJRBzeR6hHRcTmwBbACZJWTMeXBu6KiI2BScAX0vGzgV9FxEbA7D7KtsZ5EzggIjYDdgZ+KqlrOvI6wDkR8UHgZeAT6fjvgS+nn7ENcE7QtfkIMD4i5kXEq/Q8+Hx9YEZEPB7ZGMaLeinv1oh4JSLeBKYD7yFL+hMj4vmIWABcDOxQY5wnpBbUXWQzmtZJx98GuvrDpwAj0+vtgUvT63E11mXFEfBDSQ8At5Ct8bBqOjcjIqal11OAkZKWA5aLiEnpuH+WA5wnqjTXWxWvO8jh5yFpJ+CjwLYRMU/SRGBIOj0/3h343r0+D4gvn8OBlYHNI2K+pCd592fZ/bMztMGxWQO4BV2bScD+koZKGkbWjdHdo2Stmfel/UNrrOMeYEdJK6V1ZQ8F/prOzZc0uI/3DwdeSsl5fWCbKuq8g6zrBrKkYOUwHJiTkvPOZH9hLVJEvAy8LOnD6ZB/lgOcE3QNImIqcBlwP3AD2Zz77te8SbbK2IR0k3BOjXXMBk4G/pLqmRIRV6fTY4EH+rhJeCMwSNIjwI/Iujn6ciJwnKQHyf6MtnK4GNgi/Vw+Q/bLvy9HAudImkbWRWIDmKd6m5mVlFvQZmYl5QRtZlZSTtBmZiXlBG1mVlJO0GZmJeUEbf9BUkda8+MhSVdIWqofZVWuUXKupA16uXYnSdvVUUePK/lVs8JfrSvHVa5gaFY0J2jrSdeaHxuSTQ8/tvKkpLpmPEbE5yNiei+X7ATUnKDNFldO0NaXvwHvT63bv0m6BpguqV3SjyVNlvSApGMAlPlfSf+QdAuwSldBkiZK2iK93j2t0nZ/WrFtJNkvgq+m1vtHJK0s6U+pjsmStk/vXTGt4PawpHOpYkLGolb4S+d+lo7fKmnldOx9ylYanJK+7vV7KPMESdPT1/+HOr+/ZovktThskVJLeQ+y2YkAmwEbRsSMlOReiYgtJS0J3CHpZmBTsmVYNyBb2Gc6cF63clcmW/Fvh1TWChHxb0m/Bl6LiJ+k6y4BfhYRt0tam+whnB8AxgC3R8TpkvYCjq7iyzkq1TEUmCzpTxHxItkKf/dGxFclnZrKPp5s1uaxEfG4pK2BX5KtMFjpZGBURLyVFioyy5UTtPVkaJoqDFkL+ndkXQ/3RMSMdPxjwIe6+pfJ1o1Yh2zlvUsjogOYJem2HsrfBpjUVVZE/HsRcXwU2ODdFTZZVtIyqY4D03snSHqpiq/pBEkHpNddK/y9CHSSTd+HbOXBK1Md2wFXVNS9ZA9lPgBcLOkq4KoqYjCriRO09eSNiNik8kBKVK9XHiJbd/imbtftmWMcbcA2aX2T7rFUrY8V/rqLVO/L3b8HPdiL7JfFPsC3JW2Ulog1y4X7oK1eNwFf7FpdT9K6kpYmW/HvkNRHvTrZQvPd3QXsIGlUeu8K6fhcYFjFdTcDX+7akbRJejkJOCwd2wNYvo9Ye1vhrw3o+ivgMLKuk1eBGZI+meqQpIUWwJfUBqwVEX8BvpXqWKaPOMxq4gRt9TqXrH95qrIHk/6G7C+y8cDj6dyFwJ3d3xgRz5Ot+HelsgcLdHUxXAsc0HWTEDiBbDW3ByRN593RJKeRJfiHybo6/tVHrL2t8Pc6sFX6GnYBTk/HDweOTvE9DOzXrcx24CJlK83dB/wiLfdplhuvZmdmVlJuQZuZlZQTtJlZSTlBm5mVlBO0mVlJOUGbmZWUE7SZWUk5QZuZldT/BxWOzr1x8gJLAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "yhat=logreg_cv.predict(X_test)\n",
    "plot_confusion_matrix(Y_test,yhat)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Examining the confusion matrix, we see that logistic regression can distinguish between the different classes.  We see that the major problem is false positives.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  6\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Create a support vector machine object then  create a  <code>GridSearchCV</code> object  <code>svm_cv</code> with cv - 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "parameters = {'kernel':('linear', 'rbf','poly','rbf', 'sigmoid'),\n",
    "              'C': np.logspace(-3, 3, 5),\n",
    "              'gamma':np.logspace(-3, 3, 5)}\n",
    "svm = SVC()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-2 {color: black;background-color: white;}#sk-container-id-2 pre{padding: 0;}#sk-container-id-2 div.sk-toggleable {background-color: white;}#sk-container-id-2 label.sk-toggleable__label {cursor: pointer;display: block;width: 100%;margin-bottom: 0;padding: 0.3em;box-sizing: border-box;text-align: center;}#sk-container-id-2 label.sk-toggleable__label-arrow:before {content: \"▸\";float: left;margin-right: 0.25em;color: #696969;}#sk-container-id-2 label.sk-toggleable__label-arrow:hover:before {color: black;}#sk-container-id-2 div.sk-estimator:hover label.sk-toggleable__label-arrow:before {color: black;}#sk-container-id-2 div.sk-toggleable__content {max-height: 0;max-width: 0;overflow: hidden;text-align: left;background-color: #f0f8ff;}#sk-container-id-2 div.sk-toggleable__content pre {margin: 0.2em;color: black;border-radius: 0.25em;background-color: #f0f8ff;}#sk-container-id-2 input.sk-toggleable__control:checked~div.sk-toggleable__content {max-height: 200px;max-width: 100%;overflow: auto;}#sk-container-id-2 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {content: \"▾\";}#sk-container-id-2 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-2 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-2 input.sk-hidden--visually {border: 0;clip: rect(1px 1px 1px 1px);clip: rect(1px, 1px, 1px, 1px);height: 1px;margin: -1px;overflow: hidden;padding: 0;position: absolute;width: 1px;}#sk-container-id-2 div.sk-estimator {font-family: monospace;background-color: #f0f8ff;border: 1px dotted black;border-radius: 0.25em;box-sizing: border-box;margin-bottom: 0.5em;}#sk-container-id-2 div.sk-estimator:hover {background-color: #d4ebff;}#sk-container-id-2 div.sk-parallel-item::after {content: \"\";width: 100%;border-bottom: 1px solid gray;flex-grow: 1;}#sk-container-id-2 div.sk-label:hover label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-2 div.sk-serial::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: 0;}#sk-container-id-2 div.sk-serial {display: flex;flex-direction: column;align-items: center;background-color: white;padding-right: 0.2em;padding-left: 0.2em;position: relative;}#sk-container-id-2 div.sk-item {position: relative;z-index: 1;}#sk-container-id-2 div.sk-parallel {display: flex;align-items: stretch;justify-content: center;background-color: white;position: relative;}#sk-container-id-2 div.sk-item::before, #sk-container-id-2 div.sk-parallel-item::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: -1;}#sk-container-id-2 div.sk-parallel-item {display: flex;flex-direction: column;z-index: 1;position: relative;background-color: white;}#sk-container-id-2 div.sk-parallel-item:first-child::after {align-self: flex-end;width: 50%;}#sk-container-id-2 div.sk-parallel-item:last-child::after {align-self: flex-start;width: 50%;}#sk-container-id-2 div.sk-parallel-item:only-child::after {width: 0;}#sk-container-id-2 div.sk-dashed-wrapped {border: 1px dashed gray;margin: 0 0.4em 0.5em 0.4em;box-sizing: border-box;padding-bottom: 0.4em;background-color: white;}#sk-container-id-2 div.sk-label label {font-family: monospace;font-weight: bold;display: inline-block;line-height: 1.2em;}#sk-container-id-2 div.sk-label-container {text-align: center;}#sk-container-id-2 div.sk-container {/* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */display: inline-block !important;position: relative;}#sk-container-id-2 div.sk-text-repr-fallback {display: none;}</style><div id=\"sk-container-id-2\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>GridSearchCV(cv=10, estimator=SVC(),\n",
       "             param_grid={&#x27;C&#x27;: array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n",
       "       1.00000000e+03]),\n",
       "                         &#x27;gamma&#x27;: array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n",
       "       1.00000000e+03]),\n",
       "                         &#x27;kernel&#x27;: (&#x27;linear&#x27;, &#x27;rbf&#x27;, &#x27;poly&#x27;, &#x27;rbf&#x27;, &#x27;sigmoid&#x27;)})</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item sk-dashed-wrapped\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-4\" type=\"checkbox\" ><label for=\"sk-estimator-id-4\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">GridSearchCV</label><div class=\"sk-toggleable__content\"><pre>GridSearchCV(cv=10, estimator=SVC(),\n",
       "             param_grid={&#x27;C&#x27;: array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n",
       "       1.00000000e+03]),\n",
       "                         &#x27;gamma&#x27;: array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n",
       "       1.00000000e+03]),\n",
       "                         &#x27;kernel&#x27;: (&#x27;linear&#x27;, &#x27;rbf&#x27;, &#x27;poly&#x27;, &#x27;rbf&#x27;, &#x27;sigmoid&#x27;)})</pre></div></div></div><div class=\"sk-parallel\"><div class=\"sk-parallel-item\"><div class=\"sk-item\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-5\" type=\"checkbox\" ><label for=\"sk-estimator-id-5\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">estimator: SVC</label><div class=\"sk-toggleable__content\"><pre>SVC()</pre></div></div></div><div class=\"sk-serial\"><div class=\"sk-item\"><div class=\"sk-estimator sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-6\" type=\"checkbox\" ><label for=\"sk-estimator-id-6\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">SVC</label><div class=\"sk-toggleable__content\"><pre>SVC()</pre></div></div></div></div></div></div></div></div></div></div>"
      ],
      "text/plain": [
       "GridSearchCV(cv=10, estimator=SVC(),\n",
       "             param_grid={'C': array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n",
       "       1.00000000e+03]),\n",
       "                         'gamma': array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n",
       "       1.00000000e+03]),\n",
       "                         'kernel': ('linear', 'rbf', 'poly', 'rbf', 'sigmoid')})"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "svm_cv = GridSearchCV(svm, param_grid=parameters, cv=10)\n",
    "svm_cv.fit(X_train, Y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "tuned hpyerparameters :(best parameters)  {'C': 1.0, 'gamma': 0.03162277660168379, 'kernel': 'sigmoid'}\n",
      "accuracy : 0.8482142857142856\n"
     ]
    }
   ],
   "source": [
    "print(\"tuned hpyerparameters :(best parameters) \",svm_cv.best_params_)\n",
    "print(\"accuracy :\",svm_cv.best_score_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  7\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Calculate the accuracy on the test data using the method <code>score</code>:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8333333333333334"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "svm_cv.best_estimator_.score(X_test, Y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can plot the confusion matrix\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/NK7nSAAAACXBIWXMAAAsTAAALEwEAmpwYAAAfuUlEQVR4nO3dd5xdVbn/8c93JoEECKG3ACYqRQTpXami9CaCFAugAQXBinD1RwQLclUU78USEYFQBJTQQhMwRpASEkILCFcCEhIIICUQSjLz/P7Ya+BknMycc2bvc/bkfN+v137l7HLWembm5Jk1a6+1tiICMzMrn7ZmB2BmZj1zgjYzKyknaDOzknKCNjMrKSdoM7OScoI2MyspJ2jrN0lDJV0r6RVJV/SjnMMl3ZxnbM0g6QZJn212HDbwOUG3EEmHSbpX0muSZqdE8uEcij4IWBVYMSI+WW8hEXFxRHwsh3gWImknSSFpfLfjG6fjE6ss57uSLurruojYIyIuqDNcs3c4QbcISV8Dfg78kCyZrg38Etgvh+LfAzwWEQtyKKsozwPbSlqx4thngcfyqkAZ/5+y3PjD1AIkDQdOB46LiCsj4vWImB8R10bEN9M1S0r6uaRZafu5pCXTuZ0kzZT0dUlzUuv7yHTuNOBU4JDUMj+6e0tT0sjUUh2U9j8n6QlJcyXNkHR4xfHbK963naTJqetksqTtKs5NlPQ9SXekcm6WtFIv34a3gauAT6X3twOHABd3+16dLelpSa9KmiLpI+n47sB/VXyd91fE8QNJdwDzgPemY59P538l6U8V5Z8p6VZJqvbnZ63LCbo1bAsMAcb3cs23gW2ATYCNga2A71ScXw0YDowAjgbOkbR8RIwha5VfFhHLRMTvegtE0tLAL4A9ImIYsB0wrYfrVgAmpGtXBM4CJnRrAR8GHAmsAiwBfKO3uoELgc+k1x8HHgJmdbtmMtn3YAXgEuAKSUMi4sZuX+fGFe/5NDAaGAY81a28rwMbpV8+HyH73n02vMaCVcEJujWsCLzQRxfE4cDpETEnIp4HTiNLPF3mp/PzI+J64DVgvTrj6QQ2lDQ0ImZHxMM9XLMX8HhEjIuIBRFxKfAosE/FNb+PiMci4g3gcrLEukgR8XdgBUnrkSXqC3u45qKIeDHV+VNgSfr+Os+PiIfTe+Z3K28e2ffxLOAi4MsRMbOP8swAJ+hW8SKwUlcXwyKswcKtv6fSsXfK6Jbg5wHL1BpIRLxO1rVwLDBb0gRJ61cRT1dMIyr2n60jnnHA8cDO9PAXhaRvSHokdau8TPZXQ29dJwBP93YyIu4GngBE9ovErCpO0K3hTuAtYP9erplFdrOvy9r855//1XodWKpif7XKkxFxU0TsBqxO1ir+bRXxdMX0TJ0xdRkHfAm4PrVu35G6IE4CDgaWj4jlgFfIEivAoroleu2ukHQcWUt8VirfrCpO0C0gIl4hu5F3jqT9JS0labCkPST9d7rsUuA7klZON9tOJfuTvB7TgB0krZ1uUJ7SdULSqpL2S33Rb5F1lXT2UMb1wLppaOAgSYcAGwDX1RkTABExA9iRrM+9u2HAArIRH4MknQosW3H+OWBkLSM1JK0LfB84gqyr4yRJm9QXvbUaJ+gWkfpTv0Z24+95sj/Ljycb2QBZErkXeAB4EJiajtVT15+By1JZU1g4qbalOGYB/yZLll/soYwXgb3JbrK9SNby3DsiXqgnpm5l3x4RPf11cBNwI9nQu6eAN1m4+6JrEs6Lkqb2VU/qUroIODMi7o+Ix8lGgozrGiFj1hv5ZrKZWTm5BW1mVlJO0GZmOZN0XprU9VDFsR9LelTSA5LGS1qur3KcoM3M8nc+sHu3Y38GNoyID5Hd5zil+5u6c4I2M8tZREwiuwleeezmirkEdwFr9lVObxMXmuqokQf57qWZVeW8J//Y77VN5r/wRNU5Z4mV33cM2fT+LmMjYmwN1R1FNtKpV6VN0GZmDdXZUfWlKRnXkpDfIenbZOPtL+7rWidoMzOA6Gm+VL4kfY5sfP+u1SyY5QRtZgbQWWyCTkvWngTs2H2ZgUVxgjYzAyLHFrSkS4GdyBYpmwmMIRu1sSTw57Qc+F0RcWxv5ThBm5kBdOT3QKCIOLSHw72uld4TJ2gzM6jpJmGjOEGbmUFDbhLWygnazAwKv0lYDydoMzPyvUmYFydoMzNwC9rMrLQ65vd9TYM5QZuZgW8SmpmVlrs4zMxKyi1oM7OScgvazKycotM3Cc3MysktaDOzknIftJlZSXmxJDOzknIL2syspNwHbWZWUjku2J8XJ2gzM3AL2sysrCJ8k9DMrJzcgjYzK6lWGMUhaS4QizofEcvmXaeZWb+1Qgs6IoYBSPoeMBsYBwg4HFg97/rMzHLRYqM49o2IjSv2fyXpfuDUAus0M6tPCbs42gos+3VJh0tql9Qm6XDg9QLrMzOrX2dn9VuDFJmgDwMOBp5L2yfTMTOz8ilhgi6siyMingT2K6p8M7NclbCLo7AELWll4AvAyMp6IuKoouo0M6tbjjcJJZ0H7A3MiYgN07EVgMvIcuKTwMER8VJv5RTZxXE1MBy4BZhQsZmZlU++XRznA7t3O3YycGtErAPcmvZ7VeQojqUi4lsFlm9mlp8cuzgiYpKkkd0O7wfslF5fAEwEes2RRbagr5O0Z4Hlm5nlp/ibhKtGxOz0+llg1b7eUGSCPpEsSb8h6VVJcyW9WmB9Zmb1qyFBSxot6d6KbXQtVUVE0MuM6y5FjuIYVlTZZma5iz7zZcWlMRYYW2MNz0laPSJmS1odmNPXGwpdLEnS8sA6wJCuYxExqcg6zczqsqDwqd7XAJ8FfpT+vbqvNxQ5zO7zZN0cawLTgG2AO4FdiqrTzKxuOd4klHQp2Q3BlSTNBMaQJebLJR0NPEU2ka9XRbagTwS2BO6KiJ0lrQ/8sMD6zMzql+MMwYg4dBGndq2lnCIT9JsR8aYkJC0ZEY9KWq/A+szM6ldDH3SjFJmgZ0paDrgK+LOkl8ia9WZm5dMK60F3iYgD0svvSvoL2azCG4uqz8ysX1ohQaf55t09mP5dBvh33nWamfVXdLTGQ2OnkA3AVsWxrv0A3ltAnWZm/dMKLeiIGJV3mWZmhWul5UbNzAaUztYaxWFmNnC0QheHmdmA1CI3CQGQNC4iPt3XMVu0QUsO5uTLTmfwkoNpa2/n3hvu5OqfXd7ssKzJ/LkoSIu1oD9YuSOpHdi8wPoWOwvems+PDzuNt+a9Sfugdk754/d5cOJ9PHHf480OzZrIn4uClLAPOvf1oCWdImku8KGKdaDnki2t1+fqTbawt+a9CUD7oHbaB7VXsYKstQJ/LgoQndVvDVLEMLszgDMknRERp+RdfqtRWxtjrjuTVd6zGreNu4knprmVZP5cFKIVWtBdIuIUSftK+kna9u7rPZVPKfjH3CeKCm1Aic5OvrvnN/n6tscwauP3M2LdtZodkpWAPxf5i87OqrdGKSxBSzqDbMnR6Wk7UVKvy41GxNiI2CIitlhvmCccVnrj1Xk8eudDbLjjps0OxUrEn4scdXRUvzVIkc8k3AvYLSLOi4jzyB5B3mcr2t41bIVlGbrsUgAMXnIJPvjhjXn2n880OSprNn8uCtIZ1W8NUvQ46OV4d3Gk4QXXtdgZvsryHP3T42lra0NtYvKEv3P/bVOaHZY1mT8XBWmxYXZnAPelpUYF7ACcXGB9i52Zjz7FaXt9s9lhWMn4c1GQEt4kLHI96EslTSR77BXAtyLi2aLqMzPrlxZcLKkNeCHVs66kdf1UbzMrpVZqQUs6EzgEeBjo+tUUgBO0mZVOLGihtTiA/YH1IuKtAuswM8tHK7WggSeAwYATtJmVX4v1Qc8Dpkm6lYokHREnFFinmVl9WqwFfU3azMxKL1opQUfEBUWVbWaWuxa7SWhmNnC0UgvazGxAKWGCLnKxJDOzASMiqt76Iumrkh6W9JCkSyUNqSem3FvQkq6ll+c7RMS+eddpZtZvObWgJY0ATgA2iIg3JF0OfAo4v9ayiuji+En690BgNeCitH8o8FwB9ZmZ9V++XRyDgKGS5gNLAbPqLSRXEfFXAEk/jYgtKk5dK+nevOszM8tDLKh+ooqk0cDoikNjI2IsQEQ8I+knwL+AN4CbI+LmemIqsg96aUnvPBZF0ihg6QLrMzOrX2f1W+XTn9I2tqsYScsD+wGjgDXIcuER9YRU5CiOrwITJT1Bth70e4BjCqzPzKxuOU5U+SgwIyKeB5B0JbAd73b3Vq3IiSo3SloHWD8detQLJ5lZaeWXoP8FbCNpKbIujl2Burp3ixjFsUtE3CbpwG6n3ieJiLgy7zrNzPotp7WSIuJuSX8EpgILgPuAsb2/q2dFtKB3BG4D9unhXABO0GZWOnmuxRERY4Ax/S2niFEcY9K/R+ZdtplZUWJB+WYSFtHF8bXezkfEWXnXaWbWb+VbDrqQLo5h6d/1yB4Y27Xk6D7APQXUZ2bWbyVcr7+QLo7TACRNAjaLiLlp/7vAhLzrMzPLRSsk6AqrAm9X7L+djpmZlc6Ab0GnGTJrRcQDVVx+IXCPpPFpf3/qWCzEzKwRYkGzI/hPfSZoSROBfdO1U4A5ku6IiL5uBv5A0g3AR9KhIyPivn7Ga2ZWiIHagh4eEa9K+jxwYUSMkVRNC5qImEo2WNvMrNTKmKCrWSxpkKTVgYOB6wqOx8ysOULVbw1STQv6dOAm4PaImJxWqHu82LDMzBqrjC3oPhN0RFwBXFGx/wTwiSKDMjNrtOhsXMu4WotM0JL+h94fXXVCIRGZmTVBZ8cAStDUuTyemdlANKC6OCLigsp9SUtFxLziQzIza7wydnH0OYpD0raSpgOPpv2NJf2y8MjMzBooovqtUaoZZvdz4OPAiwARcT+wQ4ExmZk1XHSq6q1RqprqHRFPSwsF1VFMOGZmzTHQbhJ2eVrSdkBIGgycCDxSbFhmZo1Vxj7oahL0scDZwAhgFtmkleOKDMrMrNGigTMEq1XNRJUXgMMbEIuZWdOUcZhdNaM43ivpWknPS5oj6eo03dvMbLHRGap6a5RqRnFcAlwOrA6sQTbt+9IigzIza7QIVb01SjUJeqmIGBcRC9J2ETCk6MDMzBqps0NVb43S21ocK6SXN0g6GfgD2dochwDXNyA2M7OGGWijOKaQJeSuqI+pOBfAKUUFZWbWaI3sW65Wb2txjGpkIGZmzTQgh9kBSNoQ2ICKvueIuLCooMzMGq2Ra2xUq5qHxo4BdiJL0NcDewC3kz2128xssZBnF4ek5YBzgQ3JuoSPiog7ay2nmhb0QcDGwH0RcaSkVYGLaq3IzKzMOvO9SXg2cGNEHCRpCWCpegqpJkG/ERGdkhZIWhaYA6xVT2VmZmWVVwta0nCyFT8/BxARbwNv11NWNQn63tRc/y3ZyI7XgJqb6rW6cFbhVdgA9MasvzU7BFtM1XKTUNJoYHTFobERMTa9HgU8D/xe0sZkefPEiHi91pgUNfSMSxoJLBsRD9RaUa0GLTGihF321mxO0NaTwSu9t9/N37vXOLDqnLP1rCsXWZ+kLYC7gO0j4m5JZwOvRsT/qzWm3iaqbNbbuYiYWmtlZmZllWOLcCYwMyLuTvt/BE6up6Deujh+2su5AHapp0IzszLq6Kxm5Yu+RcSzkp6WtF5E/APYFZheT1m9TVTZud4AzcwGmpxXG/0ycHEawfEEcGQ9hVQ1UcXMbHEX5DfMLiKmAVv0txwnaDMzoLOEwxKcoM3MgM4cW9B5qeaJKpJ0hKRT0/7akrYqPjQzs8YJVPXWKNXctvwlsC1waNqfC5xTWERmZk3QgareGqWaLo6tI2IzSfcBRMRL6c6kmdlio4TPjK0qQc+X1E4axy1pZcr5tZiZ1a2MSa2aLo5fAOOBVST9gGyp0R8WGpWZWYOVsQ+6zxZ0RFwsaQrZbBgB+0fEI4VHZmbWQCV8JGFVC/avDcwDrq08FhH/KjIwM7NGKuMwu2r6oCfw7sNjh5AtpfcP4IMFxmVm1lAdzQ6gB9V0cWxUuZ9WuftSYRGZmTVBpwZmC3ohETFV0tZFBGNm1iwlnOldVR/01yp224DNgFmFRWRm1gRlHGZXTQt6WMXrBWR90n8qJhwzs+YYcKM40gSVYRHxjQbFY2bWFI2cwl2t3h55NSgiFkjavpEBmZk1w0BrQd9D1t88TdI1wBXAO0+ljYgrC47NzKxhBmof9BDgRbJnEHaNhw7ACdrMFhsDbRTHKmkEx0O8m5i7lPFrMTOr20Dr4mgHloEee86doM1ssTLQujhmR8TpDYvEzKyJOgZYC7qE4ZqZFWOgtaB3bVgUZmZNNqASdET8u5GBmJk1UxlvrNW8WJKZ2eJooI3iMDNrGQOqi8PMrJUMyAX7zcxaQd5dHGmxuXuBZyJi73rKcII2M6OQLo4TgUeAZestoC2/WMzMBq6oYeuLpDWBvYBz+xOTE7SZGdBJVL1JGi3p3optdLfifg6cRD8b5u7iMDOjtpuEETEWGNvTOUl7A3MiYoqknfoTkxO0mRm59kFvD+wraU+y5ZqXlXRRRBxRa0Hu4jAzIxvFUe3Wm4g4JSLWjIiRwKeA2+pJzlBQC1rSgb2d99NYzKxsOks42buoLo590r+rANsBt6X9nYG/46exmFnJFJGeI2IiMLHe9xeSoCPiSABJNwMbRMTstL86cH4RdZqZ9UcrTvVeqys5J88Baxdcp5lZzTpaqIujy62SbgIuTfuHALcUXKeZWc1argUdEcdLOgDYIR0aGxHji6zTzKwerXSTsNJUYG5E3CJpKUnDImJuA+o1M6ta+dJzweOgJX0B+CPwm3RoBHBVkXWamdWjs4atUYpuQR8HbAXcDRARj0tapeA6zcxq1oo3Cd+KiLelbOqNpEGU8y8JM2txZeyDLnqq918l/RcwVNJuwBXAtQXXuVj5+Md24uGHJvHo9Ns56ZvHNTsca5Lv/PAsdtjrU+x/xLHvHPvJ/57LPod+gQM+80VOOOV0Xp37WhMjHPjyXG40L0Un6JOB54EHgWOA64HvFFznYqOtrY1fnP0D9t7nCDbaeGcOOWR/PvCBdZodljXB/nvuxq/P+v5Cx7bdclPGj/s14y/8FSPXGsG54y5rUnSLh1qWG22UQhN0RHRGxG8j4pMRcVB6Xb6/I0pqqy035Z//fJIZM/7F/Pnzufzyq9l3n483Oyxrgi022Yjhyw5b6Nj2W2/OoEHtAHzog+vz3JwXmhHaYqNlbhJKepBe/hKIiA8VUe/iZo0Rq/H0zFnv7M98ZjZbbblpEyOysho/4WZ233XHZocxoEUJ+6CLuknY9YDErk7TcenfI+glcaenEowGUPtw2tqWLig8s8XHby64lPb2dvb+2M7NDmVAa5lRHBHxFICk3SKissn3LUlTyfqme3rfO08pGLTEiPJ9txps1jPPstaaa7yzv+aI1Zk169kmRmRlc9WEPzPpjns49xdn0DVayupTxqneRd8klKTtK3a2a0Cdi43J907j/e8fxciRazF48GAOPng/rr3u5maHZSVx+133ct4lV/A/Z45h6JAhzQ5nwOuMqHprlKLHQR8NnCdpOCDgJeCogutcbHR0dHDiV77D9RMuob2tjfMvuIzp0x9rdljWBN8c8yMm3/cAL7/8KrvufwRfOvrTnDvuMt6eP58vfOXbQHajcMxJX25ypANXGf9kVyMGVaQETUS8Uu173MVhPXlj1t+aHYKV0OCV3tvv/p3D3nNA1TnnkqfGN6Q/qdAWtKQlgU8AI4FBXX1kEXF6kfWamdWqlUZxdLkaeAWYArxVcF1mZnVb0IIJes2I2L3gOszM+q2MLeiiR1T8XdJGBddhZtZvLTOTsMKHgc9JmkHWxSEgPJPQzMqmjKtQFJ2g9yi4fDOzXJRxudGin0nYNaNwFcAj6c2stMo41bvoR17tK+lxYAbwV+BJ4IYi6zQzq0fLLTcKfA/YBngsIkYBuwJ3FVynmVnNIqLqrVGKTtDzI+JFoE1SW0T8Bdii4DrNzGrWiqM4Xpa0DDAJuFjSHOD1gus0M6tZXuOgJa0FXAisSrbEx9iIOLuesopuQe8HvAF8FbgR+CewT8F1mpnVLMc+6AXA1yNiA7Iu3uMkbVBPTEWP4qhsLV9QZF1mZv3REfl0XkTEbGB2ej1X0iPACGB6rWUV9cirufS8el/XRJVli6jXzKxeRUz1ljQS2BS4u573F/VElWF9X2VmVh61LMRf+Xi+ZGx6IlTlNcsAfwK+EhGv1hNT0TcJzcwGhFraz5WP5+uJpMFkyfniiLiy3picoM3MyG+qt7KF738HPBIRZ/WnLD8f0MyMXEdxbA98GthF0rS07VlPTG5Bm5mR6yiO28kGRPSbE7SZGeVcsN8J2syM1lwP2sxsQGi59aDNzAYKt6DNzEqqo6Hr1FXHCdrMjNpmEjaKE7SZGR7FYWZWWm5Bm5mVlFvQZmYl5Ra0mVlJ5TXVO09O0GZmuIvDzKy0wi1oM7Ny8lRvM7OS8lRvM7OScgvazKykOjrdB21mVkoexWFmVlLugzYzKyn3QZuZlZRb0GZmJeWbhGZmJeUuDjOzknIXh5lZSXm5UTOzkvI4aDOzknIL2syspDpLuNxoW7MDMDMrg4ioeuuLpN0l/UPS/0k6ud6Y3II2MyO/URyS2oFzgN2AmcBkSddExPRay3IL2swMiBq2PmwF/F9EPBERbwN/AParJ6bStqAXvP2Mmh1DWUgaHRFjmx2HlYs/F/mqJedIGg2Mrjg0tuJnMQJ4uuLcTGDremJyC3pgGN33JdaC/LlokogYGxFbVGyF/KJ0gjYzy9czwFoV+2umYzVzgjYzy9dkYB1JoyQtAXwKuKaegkrbB20LcT+j9cSfixKKiAWSjgduAtqB8yLi4XrKUhkXCDEzM3dxmJmVlhO0mVlJOUH3g6TvSvpGen26pI/2cM1Okq7Lqb7/6uXck5JWyqme1/Iox+qT1/df0khJD+VRljWHE3ROIuLUiLil4GoWmaDNbPHjBF0jSd+W9Jik24H1Ko6fL+mg9Hp3SY9KmgocuIhyPifpSkk3Snpc0n9XnDtU0oOSHpJ0Zjr2I2CopGmSLu4jxqskTZH0cJrx1HX8NUk/kHS/pLskrZqOj5J0Z6rz+/349liOJC0j6VZJU9PPZr90fKSkRyT9Nv2Mb5Y0NJ3bPP187weOa+oXYP3mBF0DSZuTjWncBNgT2LKHa4YAvwX2ATYHVuulyE2AQ4CNgEMkrSVpDeBMYJd0fktJ+0fEycAbEbFJRBzeR6hHRcTmwBbACZJWTMeXBu6KiI2BScAX0vGzgV9FxEbA7D7KtsZ5EzggIjYDdgZ+KqlrOvI6wDkR8UHgZeAT6fjvgS+nn7ENcE7QtfkIMD4i5kXEq/Q8+Hx9YEZEPB7ZGMaLeinv1oh4JSLeBKYD7yFL+hMj4vmIWABcDOxQY5wnpBbUXWQzmtZJx98GuvrDpwAj0+vtgUvT63E11mXFEfBDSQ8At5Ct8bBqOjcjIqal11OAkZKWA5aLiEnpuH+WA5wnqjTXWxWvO8jh5yFpJ+CjwLYRMU/SRGBIOj0/3h343r0+D4gvn8OBlYHNI2K+pCd592fZ/bMztMGxWQO4BV2bScD+koZKGkbWjdHdo2Stmfel/UNrrOMeYEdJK6V1ZQ8F/prOzZc0uI/3DwdeSsl5fWCbKuq8g6zrBrKkYOUwHJiTkvPOZH9hLVJEvAy8LOnD6ZB/lgOcE3QNImIqcBlwP3AD2Zz77te8SbbK2IR0k3BOjXXMBk4G/pLqmRIRV6fTY4EH+rhJeCMwSNIjwI/Iujn6ciJwnKQHyf6MtnK4GNgi/Vw+Q/bLvy9HAudImkbWRWIDmKd6m5mVlFvQZmYl5QRtZlZSTtBmZiXlBG1mVlJO0GZmJeUEbf9BUkda8+MhSVdIWqofZVWuUXKupA16uXYnSdvVUUePK/lVs8JfrSvHVa5gaFY0J2jrSdeaHxuSTQ8/tvKkpLpmPEbE5yNiei+X7ATUnKDNFldO0NaXvwHvT63bv0m6BpguqV3SjyVNlvSApGMAlPlfSf+QdAuwSldBkiZK2iK93j2t0nZ/WrFtJNkvgq+m1vtHJK0s6U+pjsmStk/vXTGt4PawpHOpYkLGolb4S+d+lo7fKmnldOx9ylYanJK+7vV7KPMESdPT1/+HOr+/ZovktThskVJLeQ+y2YkAmwEbRsSMlOReiYgtJS0J3CHpZmBTsmVYNyBb2Gc6cF63clcmW/Fvh1TWChHxb0m/Bl6LiJ+k6y4BfhYRt0tam+whnB8AxgC3R8TpkvYCjq7iyzkq1TEUmCzpTxHxItkKf/dGxFclnZrKPp5s1uaxEfG4pK2BX5KtMFjpZGBURLyVFioyy5UTtPVkaJoqDFkL+ndkXQ/3RMSMdPxjwIe6+pfJ1o1Yh2zlvUsjogOYJem2HsrfBpjUVVZE/HsRcXwU2ODdFTZZVtIyqY4D03snSHqpiq/pBEkHpNddK/y9CHSSTd+HbOXBK1Md2wFXVNS9ZA9lPgBcLOkq4KoqYjCriRO09eSNiNik8kBKVK9XHiJbd/imbtftmWMcbcA2aX2T7rFUrY8V/rqLVO/L3b8HPdiL7JfFPsC3JW2Ulog1y4X7oK1eNwFf7FpdT9K6kpYmW/HvkNRHvTrZQvPd3QXsIGlUeu8K6fhcYFjFdTcDX+7akbRJejkJOCwd2wNYvo9Ye1vhrw3o+ivgMLKuk1eBGZI+meqQpIUWwJfUBqwVEX8BvpXqWKaPOMxq4gRt9TqXrH95qrIHk/6G7C+y8cDj6dyFwJ3d3xgRz5Ot+HelsgcLdHUxXAsc0HWTEDiBbDW3ByRN593RJKeRJfiHybo6/tVHrL2t8Pc6sFX6GnYBTk/HDweOTvE9DOzXrcx24CJlK83dB/wiLfdplhuvZmdmVlJuQZuZlZQTtJlZSTlBm5mVlBO0mVlJOUGbmZWUE7SZWUk5QZuZldT/BxWOzr1x8gJLAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "yhat=svm_cv.predict(X_test)\n",
    "plot_confusion_matrix(Y_test,yhat)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  8\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Create a decision tree classifier object then  create a  <code>GridSearchCV</code> object  <code>tree_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "parameters = {'criterion': ['gini', 'entropy'],\n",
    "     'splitter': ['best', 'random'],\n",
    "     'max_depth': [2*n for n in range(1,10)],\n",
    "     'max_features': ['sqrt', 'log2'],\n",
    "     'min_samples_leaf': [1, 2, 4],\n",
    "     'min_samples_split': [2, 5, 10]}\n",
    "\n",
    "tree = DecisionTreeClassifier()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-4 {color: black;background-color: white;}#sk-container-id-4 pre{padding: 0;}#sk-container-id-4 div.sk-toggleable {background-color: white;}#sk-container-id-4 label.sk-toggleable__label {cursor: pointer;display: block;width: 100%;margin-bottom: 0;padding: 0.3em;box-sizing: border-box;text-align: center;}#sk-container-id-4 label.sk-toggleable__label-arrow:before {content: \"▸\";float: left;margin-right: 0.25em;color: #696969;}#sk-container-id-4 label.sk-toggleable__label-arrow:hover:before {color: black;}#sk-container-id-4 div.sk-estimator:hover label.sk-toggleable__label-arrow:before {color: black;}#sk-container-id-4 div.sk-toggleable__content {max-height: 0;max-width: 0;overflow: hidden;text-align: left;background-color: #f0f8ff;}#sk-container-id-4 div.sk-toggleable__content pre {margin: 0.2em;color: black;border-radius: 0.25em;background-color: #f0f8ff;}#sk-container-id-4 input.sk-toggleable__control:checked~div.sk-toggleable__content {max-height: 200px;max-width: 100%;overflow: auto;}#sk-container-id-4 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {content: \"▾\";}#sk-container-id-4 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-4 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-4 input.sk-hidden--visually {border: 0;clip: rect(1px 1px 1px 1px);clip: rect(1px, 1px, 1px, 1px);height: 1px;margin: -1px;overflow: hidden;padding: 0;position: absolute;width: 1px;}#sk-container-id-4 div.sk-estimator {font-family: monospace;background-color: #f0f8ff;border: 1px dotted black;border-radius: 0.25em;box-sizing: border-box;margin-bottom: 0.5em;}#sk-container-id-4 div.sk-estimator:hover {background-color: #d4ebff;}#sk-container-id-4 div.sk-parallel-item::after {content: \"\";width: 100%;border-bottom: 1px solid gray;flex-grow: 1;}#sk-container-id-4 div.sk-label:hover label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-4 div.sk-serial::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: 0;}#sk-container-id-4 div.sk-serial {display: flex;flex-direction: column;align-items: center;background-color: white;padding-right: 0.2em;padding-left: 0.2em;position: relative;}#sk-container-id-4 div.sk-item {position: relative;z-index: 1;}#sk-container-id-4 div.sk-parallel {display: flex;align-items: stretch;justify-content: center;background-color: white;position: relative;}#sk-container-id-4 div.sk-item::before, #sk-container-id-4 div.sk-parallel-item::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: -1;}#sk-container-id-4 div.sk-parallel-item {display: flex;flex-direction: column;z-index: 1;position: relative;background-color: white;}#sk-container-id-4 div.sk-parallel-item:first-child::after {align-self: flex-end;width: 50%;}#sk-container-id-4 div.sk-parallel-item:last-child::after {align-self: flex-start;width: 50%;}#sk-container-id-4 div.sk-parallel-item:only-child::after {width: 0;}#sk-container-id-4 div.sk-dashed-wrapped {border: 1px dashed gray;margin: 0 0.4em 0.5em 0.4em;box-sizing: border-box;padding-bottom: 0.4em;background-color: white;}#sk-container-id-4 div.sk-label label {font-family: monospace;font-weight: bold;display: inline-block;line-height: 1.2em;}#sk-container-id-4 div.sk-label-container {text-align: center;}#sk-container-id-4 div.sk-container {/* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */display: inline-block !important;position: relative;}#sk-container-id-4 div.sk-text-repr-fallback {display: none;}</style><div id=\"sk-container-id-4\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>GridSearchCV(cv=10, estimator=DecisionTreeClassifier(),\n",
       "             param_grid={&#x27;criterion&#x27;: [&#x27;gini&#x27;, &#x27;entropy&#x27;],\n",
       "                         &#x27;max_depth&#x27;: [2, 4, 6, 8, 10, 12, 14, 16, 18],\n",
       "                         &#x27;max_features&#x27;: [&#x27;sqrt&#x27;, &#x27;log2&#x27;],\n",
       "                         &#x27;min_samples_leaf&#x27;: [1, 2, 4],\n",
       "                         &#x27;min_samples_split&#x27;: [2, 5, 10],\n",
       "                         &#x27;splitter&#x27;: [&#x27;best&#x27;, &#x27;random&#x27;]})</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item sk-dashed-wrapped\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-10\" type=\"checkbox\" ><label for=\"sk-estimator-id-10\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">GridSearchCV</label><div class=\"sk-toggleable__content\"><pre>GridSearchCV(cv=10, estimator=DecisionTreeClassifier(),\n",
       "             param_grid={&#x27;criterion&#x27;: [&#x27;gini&#x27;, &#x27;entropy&#x27;],\n",
       "                         &#x27;max_depth&#x27;: [2, 4, 6, 8, 10, 12, 14, 16, 18],\n",
       "                         &#x27;max_features&#x27;: [&#x27;sqrt&#x27;, &#x27;log2&#x27;],\n",
       "                         &#x27;min_samples_leaf&#x27;: [1, 2, 4],\n",
       "                         &#x27;min_samples_split&#x27;: [2, 5, 10],\n",
       "                         &#x27;splitter&#x27;: [&#x27;best&#x27;, &#x27;random&#x27;]})</pre></div></div></div><div class=\"sk-parallel\"><div class=\"sk-parallel-item\"><div class=\"sk-item\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-11\" type=\"checkbox\" ><label for=\"sk-estimator-id-11\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">estimator: DecisionTreeClassifier</label><div class=\"sk-toggleable__content\"><pre>DecisionTreeClassifier()</pre></div></div></div><div class=\"sk-serial\"><div class=\"sk-item\"><div class=\"sk-estimator sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-12\" type=\"checkbox\" ><label for=\"sk-estimator-id-12\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">DecisionTreeClassifier</label><div class=\"sk-toggleable__content\"><pre>DecisionTreeClassifier()</pre></div></div></div></div></div></div></div></div></div></div>"
      ],
      "text/plain": [
       "GridSearchCV(cv=10, estimator=DecisionTreeClassifier(),\n",
       "             param_grid={'criterion': ['gini', 'entropy'],\n",
       "                         'max_depth': [2, 4, 6, 8, 10, 12, 14, 16, 18],\n",
       "                         'max_features': ['sqrt', 'log2'],\n",
       "                         'min_samples_leaf': [1, 2, 4],\n",
       "                         'min_samples_split': [2, 5, 10],\n",
       "                         'splitter': ['best', 'random']})"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tree_cv = GridSearchCV(tree, param_grid=parameters, cv=10)\n",
    "tree_cv.fit(X_train, Y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "tuned hpyerparameters :(best parameters)  {'criterion': 'gini', 'max_depth': 4, 'max_features': 'sqrt', 'min_samples_leaf': 1, 'min_samples_split': 2, 'splitter': 'best'}\n",
      "accuracy : 0.875\n"
     ]
    }
   ],
   "source": [
    "print(\"tuned hpyerparameters :(best parameters) \",tree_cv.best_params_)\n",
    "print(\"accuracy :\",tree_cv.best_score_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "## TASK  9\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.6666666666666666"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tree_cv.best_estimator_.score(X_test, Y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can plot the confusion matrix\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/NK7nSAAAACXBIWXMAAAsTAAALEwEAmpwYAAAfuUlEQVR4nO3dd5xdVbn/8c93JoEECKG3ACYqRQTpXami9CaCFAugAQXBinD1RwQLclUU78USEYFQBJTQQhMwRpASEkILCFcCEhIIICUQSjLz/P7Ya+BknMycc2bvc/bkfN+v137l7HLWembm5Jk1a6+1tiICMzMrn7ZmB2BmZj1zgjYzKyknaDOzknKCNjMrKSdoM7OScoI2MyspJ2jrN0lDJV0r6RVJV/SjnMMl3ZxnbM0g6QZJn212HDbwOUG3EEmHSbpX0muSZqdE8uEcij4IWBVYMSI+WW8hEXFxRHwsh3gWImknSSFpfLfjG6fjE6ss57uSLurruojYIyIuqDNcs3c4QbcISV8Dfg78kCyZrg38Etgvh+LfAzwWEQtyKKsozwPbSlqx4thngcfyqkAZ/5+y3PjD1AIkDQdOB46LiCsj4vWImB8R10bEN9M1S0r6uaRZafu5pCXTuZ0kzZT0dUlzUuv7yHTuNOBU4JDUMj+6e0tT0sjUUh2U9j8n6QlJcyXNkHR4xfHbK963naTJqetksqTtKs5NlPQ9SXekcm6WtFIv34a3gauAT6X3twOHABd3+16dLelpSa9KmiLpI+n47sB/VXyd91fE8QNJdwDzgPemY59P538l6U8V5Z8p6VZJqvbnZ63LCbo1bAsMAcb3cs23gW2ATYCNga2A71ScXw0YDowAjgbOkbR8RIwha5VfFhHLRMTvegtE0tLAL4A9ImIYsB0wrYfrVgAmpGtXBM4CJnRrAR8GHAmsAiwBfKO3uoELgc+k1x8HHgJmdbtmMtn3YAXgEuAKSUMi4sZuX+fGFe/5NDAaGAY81a28rwMbpV8+HyH73n02vMaCVcEJujWsCLzQRxfE4cDpETEnIp4HTiNLPF3mp/PzI+J64DVgvTrj6QQ2lDQ0ImZHxMM9XLMX8HhEjIuIBRFxKfAosE/FNb+PiMci4g3gcrLEukgR8XdgBUnrkSXqC3u45qKIeDHV+VNgSfr+Os+PiIfTe+Z3K28e2ffxLOAi4MsRMbOP8swAJ+hW8SKwUlcXwyKswcKtv6fSsXfK6Jbg5wHL1BpIRLxO1rVwLDBb0gRJ61cRT1dMIyr2n60jnnHA8cDO9PAXhaRvSHokdau8TPZXQ29dJwBP93YyIu4GngBE9ovErCpO0K3hTuAtYP9erplFdrOvy9r855//1XodWKpif7XKkxFxU0TsBqxO1ir+bRXxdMX0TJ0xdRkHfAm4PrVu35G6IE4CDgaWj4jlgFfIEivAoroleu2ukHQcWUt8VirfrCpO0C0gIl4hu5F3jqT9JS0labCkPST9d7rsUuA7klZON9tOJfuTvB7TgB0krZ1uUJ7SdULSqpL2S33Rb5F1lXT2UMb1wLppaOAgSYcAGwDX1RkTABExA9iRrM+9u2HAArIRH4MknQosW3H+OWBkLSM1JK0LfB84gqyr4yRJm9QXvbUaJ+gWkfpTv0Z24+95sj/Ljycb2QBZErkXeAB4EJiajtVT15+By1JZU1g4qbalOGYB/yZLll/soYwXgb3JbrK9SNby3DsiXqgnpm5l3x4RPf11cBNwI9nQu6eAN1m4+6JrEs6Lkqb2VU/qUroIODMi7o+Ix8lGgozrGiFj1hv5ZrKZWTm5BW1mVlJO0GZmOZN0XprU9VDFsR9LelTSA5LGS1qur3KcoM3M8nc+sHu3Y38GNoyID5Hd5zil+5u6c4I2M8tZREwiuwleeezmirkEdwFr9lVObxMXmuqokQf57qWZVeW8J//Y77VN5r/wRNU5Z4mV33cM2fT+LmMjYmwN1R1FNtKpV6VN0GZmDdXZUfWlKRnXkpDfIenbZOPtL+7rWidoMzOA6Gm+VL4kfY5sfP+u1SyY5QRtZgbQWWyCTkvWngTs2H2ZgUVxgjYzAyLHFrSkS4GdyBYpmwmMIRu1sSTw57Qc+F0RcWxv5ThBm5kBdOT3QKCIOLSHw72uld4TJ2gzM6jpJmGjOEGbmUFDbhLWygnazAwKv0lYDydoMzPyvUmYFydoMzNwC9rMrLQ65vd9TYM5QZuZgW8SmpmVlrs4zMxKyi1oM7OScgvazKycotM3Cc3MysktaDOzknIftJlZSXmxJDOzknIL2syspNwHbWZWUjku2J8XJ2gzM3AL2sysrCJ8k9DMrJzcgjYzK6lWGMUhaS4QizofEcvmXaeZWb+1Qgs6IoYBSPoeMBsYBwg4HFg97/rMzHLRYqM49o2IjSv2fyXpfuDUAus0M6tPCbs42gos+3VJh0tql9Qm6XDg9QLrMzOrX2dn9VuDFJmgDwMOBp5L2yfTMTOz8ilhgi6siyMingT2K6p8M7NclbCLo7AELWll4AvAyMp6IuKoouo0M6tbjjcJJZ0H7A3MiYgN07EVgMvIcuKTwMER8VJv5RTZxXE1MBy4BZhQsZmZlU++XRznA7t3O3YycGtErAPcmvZ7VeQojqUi4lsFlm9mlp8cuzgiYpKkkd0O7wfslF5fAEwEes2RRbagr5O0Z4Hlm5nlp/ibhKtGxOz0+llg1b7eUGSCPpEsSb8h6VVJcyW9WmB9Zmb1qyFBSxot6d6KbXQtVUVE0MuM6y5FjuIYVlTZZma5iz7zZcWlMRYYW2MNz0laPSJmS1odmNPXGwpdLEnS8sA6wJCuYxExqcg6zczqsqDwqd7XAJ8FfpT+vbqvNxQ5zO7zZN0cawLTgG2AO4FdiqrTzKxuOd4klHQp2Q3BlSTNBMaQJebLJR0NPEU2ka9XRbagTwS2BO6KiJ0lrQ/8sMD6zMzql+MMwYg4dBGndq2lnCIT9JsR8aYkJC0ZEY9KWq/A+szM6ldDH3SjFJmgZ0paDrgK+LOkl8ia9WZm5dMK60F3iYgD0svvSvoL2azCG4uqz8ysX1ohQaf55t09mP5dBvh33nWamfVXdLTGQ2OnkA3AVsWxrv0A3ltAnWZm/dMKLeiIGJV3mWZmhWul5UbNzAaUztYaxWFmNnC0QheHmdmA1CI3CQGQNC4iPt3XMVu0QUsO5uTLTmfwkoNpa2/n3hvu5OqfXd7ssKzJ/LkoSIu1oD9YuSOpHdi8wPoWOwvems+PDzuNt+a9Sfugdk754/d5cOJ9PHHf480OzZrIn4uClLAPOvf1oCWdImku8KGKdaDnki2t1+fqTbawt+a9CUD7oHbaB7VXsYKstQJ/LgoQndVvDVLEMLszgDMknRERp+RdfqtRWxtjrjuTVd6zGreNu4knprmVZP5cFKIVWtBdIuIUSftK+kna9u7rPZVPKfjH3CeKCm1Aic5OvrvnN/n6tscwauP3M2LdtZodkpWAPxf5i87OqrdGKSxBSzqDbMnR6Wk7UVKvy41GxNiI2CIitlhvmCccVnrj1Xk8eudDbLjjps0OxUrEn4scdXRUvzVIkc8k3AvYLSLOi4jzyB5B3mcr2t41bIVlGbrsUgAMXnIJPvjhjXn2n880OSprNn8uCtIZ1W8NUvQ46OV4d3Gk4QXXtdgZvsryHP3T42lra0NtYvKEv3P/bVOaHZY1mT8XBWmxYXZnAPelpUYF7ACcXGB9i52Zjz7FaXt9s9lhWMn4c1GQEt4kLHI96EslTSR77BXAtyLi2aLqMzPrlxZcLKkNeCHVs66kdf1UbzMrpVZqQUs6EzgEeBjo+tUUgBO0mZVOLGihtTiA/YH1IuKtAuswM8tHK7WggSeAwYATtJmVX4v1Qc8Dpkm6lYokHREnFFinmVl9WqwFfU3azMxKL1opQUfEBUWVbWaWuxa7SWhmNnC0UgvazGxAKWGCLnKxJDOzASMiqt76Iumrkh6W9JCkSyUNqSem3FvQkq6ll+c7RMS+eddpZtZvObWgJY0ATgA2iIg3JF0OfAo4v9ayiuji+En690BgNeCitH8o8FwB9ZmZ9V++XRyDgKGS5gNLAbPqLSRXEfFXAEk/jYgtKk5dK+nevOszM8tDLKh+ooqk0cDoikNjI2IsQEQ8I+knwL+AN4CbI+LmemIqsg96aUnvPBZF0ihg6QLrMzOrX2f1W+XTn9I2tqsYScsD+wGjgDXIcuER9YRU5CiOrwITJT1Bth70e4BjCqzPzKxuOU5U+SgwIyKeB5B0JbAd73b3Vq3IiSo3SloHWD8detQLJ5lZaeWXoP8FbCNpKbIujl2Burp3ixjFsUtE3CbpwG6n3ieJiLgy7zrNzPotp7WSIuJuSX8EpgILgPuAsb2/q2dFtKB3BG4D9unhXABO0GZWOnmuxRERY4Ax/S2niFEcY9K/R+ZdtplZUWJB+WYSFtHF8bXezkfEWXnXaWbWb+VbDrqQLo5h6d/1yB4Y27Xk6D7APQXUZ2bWbyVcr7+QLo7TACRNAjaLiLlp/7vAhLzrMzPLRSsk6AqrAm9X7L+djpmZlc6Ab0GnGTJrRcQDVVx+IXCPpPFpf3/qWCzEzKwRYkGzI/hPfSZoSROBfdO1U4A5ku6IiL5uBv5A0g3AR9KhIyPivn7Ga2ZWiIHagh4eEa9K+jxwYUSMkVRNC5qImEo2WNvMrNTKmKCrWSxpkKTVgYOB6wqOx8ysOULVbw1STQv6dOAm4PaImJxWqHu82LDMzBqrjC3oPhN0RFwBXFGx/wTwiSKDMjNrtOhsXMu4WotM0JL+h94fXXVCIRGZmTVBZ8cAStDUuTyemdlANKC6OCLigsp9SUtFxLziQzIza7wydnH0OYpD0raSpgOPpv2NJf2y8MjMzBooovqtUaoZZvdz4OPAiwARcT+wQ4ExmZk1XHSq6q1RqprqHRFPSwsF1VFMOGZmzTHQbhJ2eVrSdkBIGgycCDxSbFhmZo1Vxj7oahL0scDZwAhgFtmkleOKDMrMrNGigTMEq1XNRJUXgMMbEIuZWdOUcZhdNaM43ivpWknPS5oj6eo03dvMbLHRGap6a5RqRnFcAlwOrA6sQTbt+9IigzIza7QIVb01SjUJeqmIGBcRC9J2ETCk6MDMzBqps0NVb43S21ocK6SXN0g6GfgD2dochwDXNyA2M7OGGWijOKaQJeSuqI+pOBfAKUUFZWbWaI3sW65Wb2txjGpkIGZmzTQgh9kBSNoQ2ICKvueIuLCooMzMGq2Ra2xUq5qHxo4BdiJL0NcDewC3kz2128xssZBnF4ek5YBzgQ3JuoSPiog7ay2nmhb0QcDGwH0RcaSkVYGLaq3IzKzMOvO9SXg2cGNEHCRpCWCpegqpJkG/ERGdkhZIWhaYA6xVT2VmZmWVVwta0nCyFT8/BxARbwNv11NWNQn63tRc/y3ZyI7XgJqb6rW6cFbhVdgA9MasvzU7BFtM1XKTUNJoYHTFobERMTa9HgU8D/xe0sZkefPEiHi91pgUNfSMSxoJLBsRD9RaUa0GLTGihF321mxO0NaTwSu9t9/N37vXOLDqnLP1rCsXWZ+kLYC7gO0j4m5JZwOvRsT/qzWm3iaqbNbbuYiYWmtlZmZllWOLcCYwMyLuTvt/BE6up6Deujh+2su5AHapp0IzszLq6Kxm5Yu+RcSzkp6WtF5E/APYFZheT1m9TVTZud4AzcwGmpxXG/0ycHEawfEEcGQ9hVQ1UcXMbHEX5DfMLiKmAVv0txwnaDMzoLOEwxKcoM3MgM4cW9B5qeaJKpJ0hKRT0/7akrYqPjQzs8YJVPXWKNXctvwlsC1waNqfC5xTWERmZk3QgareGqWaLo6tI2IzSfcBRMRL6c6kmdlio4TPjK0qQc+X1E4axy1pZcr5tZiZ1a2MSa2aLo5fAOOBVST9gGyp0R8WGpWZWYOVsQ+6zxZ0RFwsaQrZbBgB+0fEI4VHZmbWQCV8JGFVC/avDcwDrq08FhH/KjIwM7NGKuMwu2r6oCfw7sNjh5AtpfcP4IMFxmVm1lAdzQ6gB9V0cWxUuZ9WuftSYRGZmTVBpwZmC3ohETFV0tZFBGNm1iwlnOldVR/01yp224DNgFmFRWRm1gRlHGZXTQt6WMXrBWR90n8qJhwzs+YYcKM40gSVYRHxjQbFY2bWFI2cwl2t3h55NSgiFkjavpEBmZk1w0BrQd9D1t88TdI1wBXAO0+ljYgrC47NzKxhBmof9BDgRbJnEHaNhw7ACdrMFhsDbRTHKmkEx0O8m5i7lPFrMTOr20Dr4mgHloEee86doM1ssTLQujhmR8TpDYvEzKyJOgZYC7qE4ZqZFWOgtaB3bVgUZmZNNqASdET8u5GBmJk1UxlvrNW8WJKZ2eJooI3iMDNrGQOqi8PMrJUMyAX7zcxaQd5dHGmxuXuBZyJi73rKcII2M6OQLo4TgUeAZestoC2/WMzMBq6oYeuLpDWBvYBz+xOTE7SZGdBJVL1JGi3p3optdLfifg6cRD8b5u7iMDOjtpuEETEWGNvTOUl7A3MiYoqknfoTkxO0mRm59kFvD+wraU+y5ZqXlXRRRBxRa0Hu4jAzIxvFUe3Wm4g4JSLWjIiRwKeA2+pJzlBQC1rSgb2d99NYzKxsOks42buoLo590r+rANsBt6X9nYG/46exmFnJFJGeI2IiMLHe9xeSoCPiSABJNwMbRMTstL86cH4RdZqZ9UcrTvVeqys5J88Baxdcp5lZzTpaqIujy62SbgIuTfuHALcUXKeZWc1argUdEcdLOgDYIR0aGxHji6zTzKwerXSTsNJUYG5E3CJpKUnDImJuA+o1M6ta+dJzweOgJX0B+CPwm3RoBHBVkXWamdWjs4atUYpuQR8HbAXcDRARj0tapeA6zcxq1oo3Cd+KiLelbOqNpEGU8y8JM2txZeyDLnqq918l/RcwVNJuwBXAtQXXuVj5+Md24uGHJvHo9Ns56ZvHNTsca5Lv/PAsdtjrU+x/xLHvHPvJ/57LPod+gQM+80VOOOV0Xp37WhMjHPjyXG40L0Un6JOB54EHgWOA64HvFFznYqOtrY1fnP0D9t7nCDbaeGcOOWR/PvCBdZodljXB/nvuxq/P+v5Cx7bdclPGj/s14y/8FSPXGsG54y5rUnSLh1qWG22UQhN0RHRGxG8j4pMRcVB6Xb6/I0pqqy035Z//fJIZM/7F/Pnzufzyq9l3n483Oyxrgi022Yjhyw5b6Nj2W2/OoEHtAHzog+vz3JwXmhHaYqNlbhJKepBe/hKIiA8VUe/iZo0Rq/H0zFnv7M98ZjZbbblpEyOysho/4WZ233XHZocxoEUJ+6CLuknY9YDErk7TcenfI+glcaenEowGUPtw2tqWLig8s8XHby64lPb2dvb+2M7NDmVAa5lRHBHxFICk3SKissn3LUlTyfqme3rfO08pGLTEiPJ9txps1jPPstaaa7yzv+aI1Zk169kmRmRlc9WEPzPpjns49xdn0DVayupTxqneRd8klKTtK3a2a0Cdi43J907j/e8fxciRazF48GAOPng/rr3u5maHZSVx+133ct4lV/A/Z45h6JAhzQ5nwOuMqHprlKLHQR8NnCdpOCDgJeCogutcbHR0dHDiV77D9RMuob2tjfMvuIzp0x9rdljWBN8c8yMm3/cAL7/8KrvufwRfOvrTnDvuMt6eP58vfOXbQHajcMxJX25ypANXGf9kVyMGVaQETUS8Uu173MVhPXlj1t+aHYKV0OCV3tvv/p3D3nNA1TnnkqfGN6Q/qdAWtKQlgU8AI4FBXX1kEXF6kfWamdWqlUZxdLkaeAWYArxVcF1mZnVb0IIJes2I2L3gOszM+q2MLeiiR1T8XdJGBddhZtZvLTOTsMKHgc9JmkHWxSEgPJPQzMqmjKtQFJ2g9yi4fDOzXJRxudGin0nYNaNwFcAj6c2stMo41bvoR17tK+lxYAbwV+BJ4IYi6zQzq0fLLTcKfA/YBngsIkYBuwJ3FVynmVnNIqLqrVGKTtDzI+JFoE1SW0T8Bdii4DrNzGrWiqM4Xpa0DDAJuFjSHOD1gus0M6tZXuOgJa0FXAisSrbEx9iIOLuesopuQe8HvAF8FbgR+CewT8F1mpnVLMc+6AXA1yNiA7Iu3uMkbVBPTEWP4qhsLV9QZF1mZv3REfl0XkTEbGB2ej1X0iPACGB6rWUV9cirufS8el/XRJVli6jXzKxeRUz1ljQS2BS4u573F/VElWF9X2VmVh61LMRf+Xi+ZGx6IlTlNcsAfwK+EhGv1hNT0TcJzcwGhFraz5WP5+uJpMFkyfniiLiy3picoM3MyG+qt7KF738HPBIRZ/WnLD8f0MyMXEdxbA98GthF0rS07VlPTG5Bm5mR6yiO28kGRPSbE7SZGeVcsN8J2syM1lwP2sxsQGi59aDNzAYKt6DNzEqqo6Hr1FXHCdrMjNpmEjaKE7SZGR7FYWZWWm5Bm5mVlFvQZmYl5Ra0mVlJ5TXVO09O0GZmuIvDzKy0wi1oM7Ny8lRvM7OS8lRvM7OScgvazKykOjrdB21mVkoexWFmVlLugzYzKyn3QZuZlZRb0GZmJeWbhGZmJeUuDjOzknIXh5lZSXm5UTOzkvI4aDOzknIL2syspDpLuNxoW7MDMDMrg4ioeuuLpN0l/UPS/0k6ud6Y3II2MyO/URyS2oFzgN2AmcBkSddExPRay3IL2swMiBq2PmwF/F9EPBERbwN/AParJ6bStqAXvP2Mmh1DWUgaHRFjmx2HlYs/F/mqJedIGg2Mrjg0tuJnMQJ4uuLcTGDremJyC3pgGN33JdaC/LlokogYGxFbVGyF/KJ0gjYzy9czwFoV+2umYzVzgjYzy9dkYB1JoyQtAXwKuKaegkrbB20LcT+j9cSfixKKiAWSjgduAtqB8yLi4XrKUhkXCDEzM3dxmJmVlhO0mVlJOUH3g6TvSvpGen26pI/2cM1Okq7Lqb7/6uXck5JWyqme1/Iox+qT1/df0khJD+VRljWHE3ROIuLUiLil4GoWmaDNbPHjBF0jSd+W9Jik24H1Ko6fL+mg9Hp3SY9KmgocuIhyPifpSkk3Snpc0n9XnDtU0oOSHpJ0Zjr2I2CopGmSLu4jxqskTZH0cJrx1HX8NUk/kHS/pLskrZqOj5J0Z6rz+/349liOJC0j6VZJU9PPZr90fKSkRyT9Nv2Mb5Y0NJ3bPP187weOa+oXYP3mBF0DSZuTjWncBNgT2LKHa4YAvwX2ATYHVuulyE2AQ4CNgEMkrSVpDeBMYJd0fktJ+0fEycAbEbFJRBzeR6hHRcTmwBbACZJWTMeXBu6KiI2BScAX0vGzgV9FxEbA7D7KtsZ5EzggIjYDdgZ+KqlrOvI6wDkR8UHgZeAT6fjvgS+nn7ENcE7QtfkIMD4i5kXEq/Q8+Hx9YEZEPB7ZGMaLeinv1oh4JSLeBKYD7yFL+hMj4vmIWABcDOxQY5wnpBbUXWQzmtZJx98GuvrDpwAj0+vtgUvT63E11mXFEfBDSQ8At5Ct8bBqOjcjIqal11OAkZKWA5aLiEnpuH+WA5wnqjTXWxWvO8jh5yFpJ+CjwLYRMU/SRGBIOj0/3h343r0+D4gvn8OBlYHNI2K+pCd592fZ/bMztMGxWQO4BV2bScD+koZKGkbWjdHdo2Stmfel/UNrrOMeYEdJK6V1ZQ8F/prOzZc0uI/3DwdeSsl5fWCbKuq8g6zrBrKkYOUwHJiTkvPOZH9hLVJEvAy8LOnD6ZB/lgOcE3QNImIqcBlwP3AD2Zz77te8SbbK2IR0k3BOjXXMBk4G/pLqmRIRV6fTY4EH+rhJeCMwSNIjwI/Iujn6ciJwnKQHyf6MtnK4GNgi/Vw+Q/bLvy9HAudImkbWRWIDmKd6m5mVlFvQZmYl5QRtZlZSTtBmZiXlBG1mVlJO0GZmJeUEbf9BUkda8+MhSVdIWqofZVWuUXKupA16uXYnSdvVUUePK/lVs8JfrSvHVa5gaFY0J2jrSdeaHxuSTQ8/tvKkpLpmPEbE5yNiei+X7ATUnKDNFldO0NaXvwHvT63bv0m6BpguqV3SjyVNlvSApGMAlPlfSf+QdAuwSldBkiZK2iK93j2t0nZ/WrFtJNkvgq+m1vtHJK0s6U+pjsmStk/vXTGt4PawpHOpYkLGolb4S+d+lo7fKmnldOx9ylYanJK+7vV7KPMESdPT1/+HOr+/ZovktThskVJLeQ+y2YkAmwEbRsSMlOReiYgtJS0J3CHpZmBTsmVYNyBb2Gc6cF63clcmW/Fvh1TWChHxb0m/Bl6LiJ+k6y4BfhYRt0tam+whnB8AxgC3R8TpkvYCjq7iyzkq1TEUmCzpTxHxItkKf/dGxFclnZrKPp5s1uaxEfG4pK2BX5KtMFjpZGBURLyVFioyy5UTtPVkaJoqDFkL+ndkXQ/3RMSMdPxjwIe6+pfJ1o1Yh2zlvUsjogOYJem2HsrfBpjUVVZE/HsRcXwU2ODdFTZZVtIyqY4D03snSHqpiq/pBEkHpNddK/y9CHSSTd+HbOXBK1Md2wFXVNS9ZA9lPgBcLOkq4KoqYjCriRO09eSNiNik8kBKVK9XHiJbd/imbtftmWMcbcA2aX2T7rFUrY8V/rqLVO/L3b8HPdiL7JfFPsC3JW2Ulog1y4X7oK1eNwFf7FpdT9K6kpYmW/HvkNRHvTrZQvPd3QXsIGlUeu8K6fhcYFjFdTcDX+7akbRJejkJOCwd2wNYvo9Ye1vhrw3o+ivgMLKuk1eBGZI+meqQpIUWwJfUBqwVEX8BvpXqWKaPOMxq4gRt9TqXrH95qrIHk/6G7C+y8cDj6dyFwJ3d3xgRz5Ot+HelsgcLdHUxXAsc0HWTEDiBbDW3ByRN593RJKeRJfiHybo6/tVHrL2t8Pc6sFX6GnYBTk/HDweOTvE9DOzXrcx24CJlK83dB/wiLfdplhuvZmdmVlJuQZuZlZQTtJlZSTlBm5mVlBO0mVlJOUGbmZWUE7SZWUk5QZuZldT/BxWOzr1x8gJLAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "yhat = svm_cv.predict(X_test)\n",
    "plot_confusion_matrix(Y_test,yhat)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  10\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Create a k nearest neighbors object then  create a  <code>GridSearchCV</code> object  <code>knn_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "parameters = {'n_neighbors': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n",
    "              'algorithm': ['auto', 'ball_tree', 'kd_tree', 'brute'],\n",
    "              'p': [1,2]}\n",
    "\n",
    "KNN = KNeighborsClassifier()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-5 {color: black;background-color: white;}#sk-container-id-5 pre{padding: 0;}#sk-container-id-5 div.sk-toggleable {background-color: white;}#sk-container-id-5 label.sk-toggleable__label {cursor: pointer;display: block;width: 100%;margin-bottom: 0;padding: 0.3em;box-sizing: border-box;text-align: center;}#sk-container-id-5 label.sk-toggleable__label-arrow:before {content: \"▸\";float: left;margin-right: 0.25em;color: #696969;}#sk-container-id-5 label.sk-toggleable__label-arrow:hover:before {color: black;}#sk-container-id-5 div.sk-estimator:hover label.sk-toggleable__label-arrow:before {color: black;}#sk-container-id-5 div.sk-toggleable__content {max-height: 0;max-width: 0;overflow: hidden;text-align: left;background-color: #f0f8ff;}#sk-container-id-5 div.sk-toggleable__content pre {margin: 0.2em;color: black;border-radius: 0.25em;background-color: #f0f8ff;}#sk-container-id-5 input.sk-toggleable__control:checked~div.sk-toggleable__content {max-height: 200px;max-width: 100%;overflow: auto;}#sk-container-id-5 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {content: \"▾\";}#sk-container-id-5 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-5 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-5 input.sk-hidden--visually {border: 0;clip: rect(1px 1px 1px 1px);clip: rect(1px, 1px, 1px, 1px);height: 1px;margin: -1px;overflow: hidden;padding: 0;position: absolute;width: 1px;}#sk-container-id-5 div.sk-estimator {font-family: monospace;background-color: #f0f8ff;border: 1px dotted black;border-radius: 0.25em;box-sizing: border-box;margin-bottom: 0.5em;}#sk-container-id-5 div.sk-estimator:hover {background-color: #d4ebff;}#sk-container-id-5 div.sk-parallel-item::after {content: \"\";width: 100%;border-bottom: 1px solid gray;flex-grow: 1;}#sk-container-id-5 div.sk-label:hover label.sk-toggleable__label {background-color: #d4ebff;}#sk-container-id-5 div.sk-serial::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: 0;}#sk-container-id-5 div.sk-serial {display: flex;flex-direction: column;align-items: center;background-color: white;padding-right: 0.2em;padding-left: 0.2em;position: relative;}#sk-container-id-5 div.sk-item {position: relative;z-index: 1;}#sk-container-id-5 div.sk-parallel {display: flex;align-items: stretch;justify-content: center;background-color: white;position: relative;}#sk-container-id-5 div.sk-item::before, #sk-container-id-5 div.sk-parallel-item::before {content: \"\";position: absolute;border-left: 1px solid gray;box-sizing: border-box;top: 0;bottom: 0;left: 50%;z-index: -1;}#sk-container-id-5 div.sk-parallel-item {display: flex;flex-direction: column;z-index: 1;position: relative;background-color: white;}#sk-container-id-5 div.sk-parallel-item:first-child::after {align-self: flex-end;width: 50%;}#sk-container-id-5 div.sk-parallel-item:last-child::after {align-self: flex-start;width: 50%;}#sk-container-id-5 div.sk-parallel-item:only-child::after {width: 0;}#sk-container-id-5 div.sk-dashed-wrapped {border: 1px dashed gray;margin: 0 0.4em 0.5em 0.4em;box-sizing: border-box;padding-bottom: 0.4em;background-color: white;}#sk-container-id-5 div.sk-label label {font-family: monospace;font-weight: bold;display: inline-block;line-height: 1.2em;}#sk-container-id-5 div.sk-label-container {text-align: center;}#sk-container-id-5 div.sk-container {/* jupyter's `normalize.less` sets `[hidden] { display: none; }` but bootstrap.min.css set `[hidden] { display: none !important; }` so we also need the `!important` here to be able to override the default hidden behavior on the sphinx rendered scikit-learn.org. See: https://github.com/scikit-learn/scikit-learn/issues/21755 */display: inline-block !important;position: relative;}#sk-container-id-5 div.sk-text-repr-fallback {display: none;}</style><div id=\"sk-container-id-5\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>GridSearchCV(cv=10, estimator=KNeighborsClassifier(),\n",
       "             param_grid={&#x27;algorithm&#x27;: [&#x27;auto&#x27;, &#x27;ball_tree&#x27;, &#x27;kd_tree&#x27;, &#x27;brute&#x27;],\n",
       "                         &#x27;n_neighbors&#x27;: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n",
       "                         &#x27;p&#x27;: [1, 2]})</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item sk-dashed-wrapped\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-13\" type=\"checkbox\" ><label for=\"sk-estimator-id-13\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">GridSearchCV</label><div class=\"sk-toggleable__content\"><pre>GridSearchCV(cv=10, estimator=KNeighborsClassifier(),\n",
       "             param_grid={&#x27;algorithm&#x27;: [&#x27;auto&#x27;, &#x27;ball_tree&#x27;, &#x27;kd_tree&#x27;, &#x27;brute&#x27;],\n",
       "                         &#x27;n_neighbors&#x27;: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n",
       "                         &#x27;p&#x27;: [1, 2]})</pre></div></div></div><div class=\"sk-parallel\"><div class=\"sk-parallel-item\"><div class=\"sk-item\"><div class=\"sk-label-container\"><div class=\"sk-label sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-14\" type=\"checkbox\" ><label for=\"sk-estimator-id-14\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">estimator: KNeighborsClassifier</label><div class=\"sk-toggleable__content\"><pre>KNeighborsClassifier()</pre></div></div></div><div class=\"sk-serial\"><div class=\"sk-item\"><div class=\"sk-estimator sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-15\" type=\"checkbox\" ><label for=\"sk-estimator-id-15\" class=\"sk-toggleable__label sk-toggleable__label-arrow\">KNeighborsClassifier</label><div class=\"sk-toggleable__content\"><pre>KNeighborsClassifier()</pre></div></div></div></div></div></div></div></div></div></div>"
      ],
      "text/plain": [
       "GridSearchCV(cv=10, estimator=KNeighborsClassifier(),\n",
       "             param_grid={'algorithm': ['auto', 'ball_tree', 'kd_tree', 'brute'],\n",
       "                         'n_neighbors': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n",
       "                         'p': [1, 2]})"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "knn_cv = GridSearchCV(KNN, param_grid=parameters, cv=10)\n",
    "knn_cv.fit(X_train, Y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "tuned hpyerparameters :(best parameters)  {'algorithm': 'auto', 'n_neighbors': 10, 'p': 1}\n",
      "accuracy : 0.8482142857142858\n"
     ]
    }
   ],
   "source": [
    "print(\"tuned hpyerparameters :(best parameters) \",knn_cv.best_params_)\n",
    "print(\"accuracy :\",knn_cv.best_score_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  11\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8333333333333334"
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "knn_cv.best_estimator_.score(X_test, Y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can plot the confusion matrix\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/NK7nSAAAACXBIWXMAAAsTAAALEwEAmpwYAAAfuUlEQVR4nO3dd5xdVbn/8c93JoEECKG3ACYqRQTpXami9CaCFAugAQXBinD1RwQLclUU78USEYFQBJTQQhMwRpASEkILCFcCEhIIICUQSjLz/P7Ya+BknMycc2bvc/bkfN+v137l7HLWembm5Jk1a6+1tiICMzMrn7ZmB2BmZj1zgjYzKyknaDOzknKCNjMrKSdoM7OScoI2MyspJ2jrN0lDJV0r6RVJV/SjnMMl3ZxnbM0g6QZJn212HDbwOUG3EEmHSbpX0muSZqdE8uEcij4IWBVYMSI+WW8hEXFxRHwsh3gWImknSSFpfLfjG6fjE6ss57uSLurruojYIyIuqDNcs3c4QbcISV8Dfg78kCyZrg38Etgvh+LfAzwWEQtyKKsozwPbSlqx4thngcfyqkAZ/5+y3PjD1AIkDQdOB46LiCsj4vWImB8R10bEN9M1S0r6uaRZafu5pCXTuZ0kzZT0dUlzUuv7yHTuNOBU4JDUMj+6e0tT0sjUUh2U9j8n6QlJcyXNkHR4xfHbK963naTJqetksqTtKs5NlPQ9SXekcm6WtFIv34a3gauAT6X3twOHABd3+16dLelpSa9KmiLpI+n47sB/VXyd91fE8QNJdwDzgPemY59P538l6U8V5Z8p6VZJqvbnZ63LCbo1bAsMAcb3cs23gW2ATYCNga2A71ScXw0YDowAjgbOkbR8RIwha5VfFhHLRMTvegtE0tLAL4A9ImIYsB0wrYfrVgAmpGtXBM4CJnRrAR8GHAmsAiwBfKO3uoELgc+k1x8HHgJmdbtmMtn3YAXgEuAKSUMi4sZuX+fGFe/5NDAaGAY81a28rwMbpV8+HyH73n02vMaCVcEJujWsCLzQRxfE4cDpETEnIp4HTiNLPF3mp/PzI+J64DVgvTrj6QQ2lDQ0ImZHxMM9XLMX8HhEjIuIBRFxKfAosE/FNb+PiMci4g3gcrLEukgR8XdgBUnrkSXqC3u45qKIeDHV+VNgSfr+Os+PiIfTe+Z3K28e2ffxLOAi4MsRMbOP8swAJ+hW8SKwUlcXwyKswcKtv6fSsXfK6Jbg5wHL1BpIRLxO1rVwLDBb0gRJ61cRT1dMIyr2n60jnnHA8cDO9PAXhaRvSHokdau8TPZXQ29dJwBP93YyIu4GngBE9ovErCpO0K3hTuAtYP9erplFdrOvy9r855//1XodWKpif7XKkxFxU0TsBqxO1ir+bRXxdMX0TJ0xdRkHfAm4PrVu35G6IE4CDgaWj4jlgFfIEivAoroleu2ukHQcWUt8VirfrCpO0C0gIl4hu5F3jqT9JS0labCkPST9d7rsUuA7klZON9tOJfuTvB7TgB0krZ1uUJ7SdULSqpL2S33Rb5F1lXT2UMb1wLppaOAgSYcAGwDX1RkTABExA9iRrM+9u2HAArIRH4MknQosW3H+OWBkLSM1JK0LfB84gqyr4yRJm9QXvbUaJ+gWkfpTv0Z24+95sj/Ljycb2QBZErkXeAB4EJiajtVT15+By1JZU1g4qbalOGYB/yZLll/soYwXgb3JbrK9SNby3DsiXqgnpm5l3x4RPf11cBNwI9nQu6eAN1m4+6JrEs6Lkqb2VU/qUroIODMi7o+Ix8lGgozrGiFj1hv5ZrKZWTm5BW1mVlJO0GZmOZN0XprU9VDFsR9LelTSA5LGS1qur3KcoM3M8nc+sHu3Y38GNoyID5Hd5zil+5u6c4I2M8tZREwiuwleeezmirkEdwFr9lVObxMXmuqokQf57qWZVeW8J//Y77VN5r/wRNU5Z4mV33cM2fT+LmMjYmwN1R1FNtKpV6VN0GZmDdXZUfWlKRnXkpDfIenbZOPtL+7rWidoMzOA6Gm+VL4kfY5sfP+u1SyY5QRtZgbQWWyCTkvWngTs2H2ZgUVxgjYzAyLHFrSkS4GdyBYpmwmMIRu1sSTw57Qc+F0RcWxv5ThBm5kBdOT3QKCIOLSHw72uld4TJ2gzM6jpJmGjOEGbmUFDbhLWygnazAwKv0lYDydoMzPyvUmYFydoMzNwC9rMrLQ65vd9TYM5QZuZgW8SmpmVlrs4zMxKyi1oM7OScgvazKycotM3Cc3MysktaDOzknIftJlZSXmxJDOzknIL2syspNwHbWZWUjku2J8XJ2gzM3AL2sysrCJ8k9DMrJzcgjYzK6lWGMUhaS4QizofEcvmXaeZWb+1Qgs6IoYBSPoeMBsYBwg4HFg97/rMzHLRYqM49o2IjSv2fyXpfuDUAus0M6tPCbs42gos+3VJh0tql9Qm6XDg9QLrMzOrX2dn9VuDFJmgDwMOBp5L2yfTMTOz8ilhgi6siyMingT2K6p8M7NclbCLo7AELWll4AvAyMp6IuKoouo0M6tbjjcJJZ0H7A3MiYgN07EVgMvIcuKTwMER8VJv5RTZxXE1MBy4BZhQsZmZlU++XRznA7t3O3YycGtErAPcmvZ7VeQojqUi4lsFlm9mlp8cuzgiYpKkkd0O7wfslF5fAEwEes2RRbagr5O0Z4Hlm5nlp/ibhKtGxOz0+llg1b7eUGSCPpEsSb8h6VVJcyW9WmB9Zmb1qyFBSxot6d6KbXQtVUVE0MuM6y5FjuIYVlTZZma5iz7zZcWlMRYYW2MNz0laPSJmS1odmNPXGwpdLEnS8sA6wJCuYxExqcg6zczqsqDwqd7XAJ8FfpT+vbqvNxQ5zO7zZN0cawLTgG2AO4FdiqrTzKxuOd4klHQp2Q3BlSTNBMaQJebLJR0NPEU2ka9XRbagTwS2BO6KiJ0lrQ/8sMD6zMzql+MMwYg4dBGndq2lnCIT9JsR8aYkJC0ZEY9KWq/A+szM6ldDH3SjFJmgZ0paDrgK+LOkl8ia9WZm5dMK60F3iYgD0svvSvoL2azCG4uqz8ysX1ohQaf55t09mP5dBvh33nWamfVXdLTGQ2OnkA3AVsWxrv0A3ltAnWZm/dMKLeiIGJV3mWZmhWul5UbNzAaUztYaxWFmNnC0QheHmdmA1CI3CQGQNC4iPt3XMVu0QUsO5uTLTmfwkoNpa2/n3hvu5OqfXd7ssKzJ/LkoSIu1oD9YuSOpHdi8wPoWOwvems+PDzuNt+a9Sfugdk754/d5cOJ9PHHf480OzZrIn4uClLAPOvf1oCWdImku8KGKdaDnki2t1+fqTbawt+a9CUD7oHbaB7VXsYKstQJ/LgoQndVvDVLEMLszgDMknRERp+RdfqtRWxtjrjuTVd6zGreNu4knprmVZP5cFKIVWtBdIuIUSftK+kna9u7rPZVPKfjH3CeKCm1Aic5OvrvnN/n6tscwauP3M2LdtZodkpWAPxf5i87OqrdGKSxBSzqDbMnR6Wk7UVKvy41GxNiI2CIitlhvmCccVnrj1Xk8eudDbLjjps0OxUrEn4scdXRUvzVIkc8k3AvYLSLOi4jzyB5B3mcr2t41bIVlGbrsUgAMXnIJPvjhjXn2n880OSprNn8uCtIZ1W8NUvQ46OV4d3Gk4QXXtdgZvsryHP3T42lra0NtYvKEv3P/bVOaHZY1mT8XBWmxYXZnAPelpUYF7ACcXGB9i52Zjz7FaXt9s9lhWMn4c1GQEt4kLHI96EslTSR77BXAtyLi2aLqMzPrlxZcLKkNeCHVs66kdf1UbzMrpVZqQUs6EzgEeBjo+tUUgBO0mZVOLGihtTiA/YH1IuKtAuswM8tHK7WggSeAwYATtJmVX4v1Qc8Dpkm6lYokHREnFFinmVl9WqwFfU3azMxKL1opQUfEBUWVbWaWuxa7SWhmNnC0UgvazGxAKWGCLnKxJDOzASMiqt76Iumrkh6W9JCkSyUNqSem3FvQkq6ll+c7RMS+eddpZtZvObWgJY0ATgA2iIg3JF0OfAo4v9ayiuji+En690BgNeCitH8o8FwB9ZmZ9V++XRyDgKGS5gNLAbPqLSRXEfFXAEk/jYgtKk5dK+nevOszM8tDLKh+ooqk0cDoikNjI2IsQEQ8I+knwL+AN4CbI+LmemIqsg96aUnvPBZF0ihg6QLrMzOrX2f1W+XTn9I2tqsYScsD+wGjgDXIcuER9YRU5CiOrwITJT1Bth70e4BjCqzPzKxuOU5U+SgwIyKeB5B0JbAd73b3Vq3IiSo3SloHWD8detQLJ5lZaeWXoP8FbCNpKbIujl2Burp3ixjFsUtE3CbpwG6n3ieJiLgy7zrNzPotp7WSIuJuSX8EpgILgPuAsb2/q2dFtKB3BG4D9unhXABO0GZWOnmuxRERY4Ax/S2niFEcY9K/R+ZdtplZUWJB+WYSFtHF8bXezkfEWXnXaWbWb+VbDrqQLo5h6d/1yB4Y27Xk6D7APQXUZ2bWbyVcr7+QLo7TACRNAjaLiLlp/7vAhLzrMzPLRSsk6AqrAm9X7L+djpmZlc6Ab0GnGTJrRcQDVVx+IXCPpPFpf3/qWCzEzKwRYkGzI/hPfSZoSROBfdO1U4A5ku6IiL5uBv5A0g3AR9KhIyPivn7Ga2ZWiIHagh4eEa9K+jxwYUSMkVRNC5qImEo2WNvMrNTKmKCrWSxpkKTVgYOB6wqOx8ysOULVbw1STQv6dOAm4PaImJxWqHu82LDMzBqrjC3oPhN0RFwBXFGx/wTwiSKDMjNrtOhsXMu4WotM0JL+h94fXXVCIRGZmTVBZ8cAStDUuTyemdlANKC6OCLigsp9SUtFxLziQzIza7wydnH0OYpD0raSpgOPpv2NJf2y8MjMzBooovqtUaoZZvdz4OPAiwARcT+wQ4ExmZk1XHSq6q1RqprqHRFPSwsF1VFMOGZmzTHQbhJ2eVrSdkBIGgycCDxSbFhmZo1Vxj7oahL0scDZwAhgFtmkleOKDMrMrNGigTMEq1XNRJUXgMMbEIuZWdOUcZhdNaM43ivpWknPS5oj6eo03dvMbLHRGap6a5RqRnFcAlwOrA6sQTbt+9IigzIza7QIVb01SjUJeqmIGBcRC9J2ETCk6MDMzBqps0NVb43S21ocK6SXN0g6GfgD2dochwDXNyA2M7OGGWijOKaQJeSuqI+pOBfAKUUFZWbWaI3sW65Wb2txjGpkIGZmzTQgh9kBSNoQ2ICKvueIuLCooMzMGq2Ra2xUq5qHxo4BdiJL0NcDewC3kz2128xssZBnF4ek5YBzgQ3JuoSPiog7ay2nmhb0QcDGwH0RcaSkVYGLaq3IzKzMOvO9SXg2cGNEHCRpCWCpegqpJkG/ERGdkhZIWhaYA6xVT2VmZmWVVwta0nCyFT8/BxARbwNv11NWNQn63tRc/y3ZyI7XgJqb6rW6cFbhVdgA9MasvzU7BFtM1XKTUNJoYHTFobERMTa9HgU8D/xe0sZkefPEiHi91pgUNfSMSxoJLBsRD9RaUa0GLTGihF321mxO0NaTwSu9t9/N37vXOLDqnLP1rCsXWZ+kLYC7gO0j4m5JZwOvRsT/qzWm3iaqbNbbuYiYWmtlZmZllWOLcCYwMyLuTvt/BE6up6Deujh+2su5AHapp0IzszLq6Kxm5Yu+RcSzkp6WtF5E/APYFZheT1m9TVTZud4AzcwGmpxXG/0ycHEawfEEcGQ9hVQ1UcXMbHEX5DfMLiKmAVv0txwnaDMzoLOEwxKcoM3MgM4cW9B5qeaJKpJ0hKRT0/7akrYqPjQzs8YJVPXWKNXctvwlsC1waNqfC5xTWERmZk3QgareGqWaLo6tI2IzSfcBRMRL6c6kmdlio4TPjK0qQc+X1E4axy1pZcr5tZiZ1a2MSa2aLo5fAOOBVST9gGyp0R8WGpWZWYOVsQ+6zxZ0RFwsaQrZbBgB+0fEI4VHZmbWQCV8JGFVC/avDcwDrq08FhH/KjIwM7NGKuMwu2r6oCfw7sNjh5AtpfcP4IMFxmVm1lAdzQ6gB9V0cWxUuZ9WuftSYRGZmTVBpwZmC3ohETFV0tZFBGNm1iwlnOldVR/01yp224DNgFmFRWRm1gRlHGZXTQt6WMXrBWR90n8qJhwzs+YYcKM40gSVYRHxjQbFY2bWFI2cwl2t3h55NSgiFkjavpEBmZk1w0BrQd9D1t88TdI1wBXAO0+ljYgrC47NzKxhBmof9BDgRbJnEHaNhw7ACdrMFhsDbRTHKmkEx0O8m5i7lPFrMTOr20Dr4mgHloEee86doM1ssTLQujhmR8TpDYvEzKyJOgZYC7qE4ZqZFWOgtaB3bVgUZmZNNqASdET8u5GBmJk1UxlvrNW8WJKZ2eJooI3iMDNrGQOqi8PMrJUMyAX7zcxaQd5dHGmxuXuBZyJi73rKcII2M6OQLo4TgUeAZestoC2/WMzMBq6oYeuLpDWBvYBz+xOTE7SZGdBJVL1JGi3p3optdLfifg6cRD8b5u7iMDOjtpuEETEWGNvTOUl7A3MiYoqknfoTkxO0mRm59kFvD+wraU+y5ZqXlXRRRBxRa0Hu4jAzIxvFUe3Wm4g4JSLWjIiRwKeA2+pJzlBQC1rSgb2d99NYzKxsOks42buoLo590r+rANsBt6X9nYG/46exmFnJFJGeI2IiMLHe9xeSoCPiSABJNwMbRMTstL86cH4RdZqZ9UcrTvVeqys5J88Baxdcp5lZzTpaqIujy62SbgIuTfuHALcUXKeZWc1argUdEcdLOgDYIR0aGxHji6zTzKwerXSTsNJUYG5E3CJpKUnDImJuA+o1M6ta+dJzweOgJX0B+CPwm3RoBHBVkXWamdWjs4atUYpuQR8HbAXcDRARj0tapeA6zcxq1oo3Cd+KiLelbOqNpEGU8y8JM2txZeyDLnqq918l/RcwVNJuwBXAtQXXuVj5+Md24uGHJvHo9Ns56ZvHNTsca5Lv/PAsdtjrU+x/xLHvHPvJ/57LPod+gQM+80VOOOV0Xp37WhMjHPjyXG40L0Un6JOB54EHgWOA64HvFFznYqOtrY1fnP0D9t7nCDbaeGcOOWR/PvCBdZodljXB/nvuxq/P+v5Cx7bdclPGj/s14y/8FSPXGsG54y5rUnSLh1qWG22UQhN0RHRGxG8j4pMRcVB6Xb6/I0pqqy035Z//fJIZM/7F/Pnzufzyq9l3n483Oyxrgi022Yjhyw5b6Nj2W2/OoEHtAHzog+vz3JwXmhHaYqNlbhJKepBe/hKIiA8VUe/iZo0Rq/H0zFnv7M98ZjZbbblpEyOysho/4WZ233XHZocxoEUJ+6CLuknY9YDErk7TcenfI+glcaenEowGUPtw2tqWLig8s8XHby64lPb2dvb+2M7NDmVAa5lRHBHxFICk3SKissn3LUlTyfqme3rfO08pGLTEiPJ9txps1jPPstaaa7yzv+aI1Zk169kmRmRlc9WEPzPpjns49xdn0DVayupTxqneRd8klKTtK3a2a0Cdi43J907j/e8fxciRazF48GAOPng/rr3u5maHZSVx+133ct4lV/A/Z45h6JAhzQ5nwOuMqHprlKLHQR8NnCdpOCDgJeCogutcbHR0dHDiV77D9RMuob2tjfMvuIzp0x9rdljWBN8c8yMm3/cAL7/8KrvufwRfOvrTnDvuMt6eP58vfOXbQHajcMxJX25ypANXGf9kVyMGVaQETUS8Uu173MVhPXlj1t+aHYKV0OCV3tvv/p3D3nNA1TnnkqfGN6Q/qdAWtKQlgU8AI4FBXX1kEXF6kfWamdWqlUZxdLkaeAWYArxVcF1mZnVb0IIJes2I2L3gOszM+q2MLeiiR1T8XdJGBddhZtZvLTOTsMKHgc9JmkHWxSEgPJPQzMqmjKtQFJ2g9yi4fDOzXJRxudGin0nYNaNwFcAj6c2stMo41bvoR17tK+lxYAbwV+BJ4IYi6zQzq0fLLTcKfA/YBngsIkYBuwJ3FVynmVnNIqLqrVGKTtDzI+JFoE1SW0T8Bdii4DrNzGrWiqM4Xpa0DDAJuFjSHOD1gus0M6tZXuOgJa0FXAisSrbEx9iIOLuesopuQe8HvAF8FbgR+CewT8F1mpnVLMc+6AXA1yNiA7Iu3uMkbVBPTEWP4qhsLV9QZF1mZv3REfl0XkTEbGB2ej1X0iPACGB6rWUV9cirufS8el/XRJVli6jXzKxeRUz1ljQS2BS4u573F/VElWF9X2VmVh61LMRf+Xi+ZGx6IlTlNcsAfwK+EhGv1hNT0TcJzcwGhFraz5WP5+uJpMFkyfniiLiy3picoM3MyG+qt7KF738HPBIRZ/WnLD8f0MyMXEdxbA98GthF0rS07VlPTG5Bm5mR6yiO28kGRPSbE7SZGeVcsN8J2syM1lwP2sxsQGi59aDNzAYKt6DNzEqqo6Hr1FXHCdrMjNpmEjaKE7SZGR7FYWZWWm5Bm5mVlFvQZmYl5Ra0mVlJ5TXVO09O0GZmuIvDzKy0wi1oM7Ny8lRvM7OS8lRvM7OScgvazKykOjrdB21mVkoexWFmVlLugzYzKyn3QZuZlZRb0GZmJeWbhGZmJeUuDjOzknIXh5lZSXm5UTOzkvI4aDOzknIL2syspDpLuNxoW7MDMDMrg4ioeuuLpN0l/UPS/0k6ud6Y3II2MyO/URyS2oFzgN2AmcBkSddExPRay3IL2swMiBq2PmwF/F9EPBERbwN/AParJ6bStqAXvP2Mmh1DWUgaHRFjmx2HlYs/F/mqJedIGg2Mrjg0tuJnMQJ4uuLcTGDremJyC3pgGN33JdaC/LlokogYGxFbVGyF/KJ0gjYzy9czwFoV+2umYzVzgjYzy9dkYB1JoyQtAXwKuKaegkrbB20LcT+j9cSfixKKiAWSjgduAtqB8yLi4XrKUhkXCDEzM3dxmJmVlhO0mVlJOUH3g6TvSvpGen26pI/2cM1Okq7Lqb7/6uXck5JWyqme1/Iox+qT1/df0khJD+VRljWHE3ROIuLUiLil4GoWmaDNbPHjBF0jSd+W9Jik24H1Ko6fL+mg9Hp3SY9KmgocuIhyPifpSkk3Snpc0n9XnDtU0oOSHpJ0Zjr2I2CopGmSLu4jxqskTZH0cJrx1HX8NUk/kHS/pLskrZqOj5J0Z6rz+/349liOJC0j6VZJU9PPZr90fKSkRyT9Nv2Mb5Y0NJ3bPP187weOa+oXYP3mBF0DSZuTjWncBNgT2LKHa4YAvwX2ATYHVuulyE2AQ4CNgEMkrSVpDeBMYJd0fktJ+0fEycAbEbFJRBzeR6hHRcTmwBbACZJWTMeXBu6KiI2BScAX0vGzgV9FxEbA7D7KtsZ5EzggIjYDdgZ+KqlrOvI6wDkR8UHgZeAT6fjvgS+nn7ENcE7QtfkIMD4i5kXEq/Q8+Hx9YEZEPB7ZGMaLeinv1oh4JSLeBKYD7yFL+hMj4vmIWABcDOxQY5wnpBbUXWQzmtZJx98GuvrDpwAj0+vtgUvT63E11mXFEfBDSQ8At5Ct8bBqOjcjIqal11OAkZKWA5aLiEnpuH+WA5wnqjTXWxWvO8jh5yFpJ+CjwLYRMU/SRGBIOj0/3h343r0+D4gvn8OBlYHNI2K+pCd592fZ/bMztMGxWQO4BV2bScD+koZKGkbWjdHdo2Stmfel/UNrrOMeYEdJK6V1ZQ8F/prOzZc0uI/3DwdeSsl5fWCbKuq8g6zrBrKkYOUwHJiTkvPOZH9hLVJEvAy8LOnD6ZB/lgOcE3QNImIqcBlwP3AD2Zz77te8SbbK2IR0k3BOjXXMBk4G/pLqmRIRV6fTY4EH+rhJeCMwSNIjwI/Iujn6ciJwnKQHyf6MtnK4GNgi/Vw+Q/bLvy9HAudImkbWRWIDmKd6m5mVlFvQZmYl5QRtZlZSTtBmZiXlBG1mVlJO0GZmJeUEbf9BUkda8+MhSVdIWqofZVWuUXKupA16uXYnSdvVUUePK/lVs8JfrSvHVa5gaFY0J2jrSdeaHxuSTQ8/tvKkpLpmPEbE5yNiei+X7ATUnKDNFldO0NaXvwHvT63bv0m6BpguqV3SjyVNlvSApGMAlPlfSf+QdAuwSldBkiZK2iK93j2t0nZ/WrFtJNkvgq+m1vtHJK0s6U+pjsmStk/vXTGt4PawpHOpYkLGolb4S+d+lo7fKmnldOx9ylYanJK+7vV7KPMESdPT1/+HOr+/ZovktThskVJLeQ+y2YkAmwEbRsSMlOReiYgtJS0J3CHpZmBTsmVYNyBb2Gc6cF63clcmW/Fvh1TWChHxb0m/Bl6LiJ+k6y4BfhYRt0tam+whnB8AxgC3R8TpkvYCjq7iyzkq1TEUmCzpTxHxItkKf/dGxFclnZrKPp5s1uaxEfG4pK2BX5KtMFjpZGBURLyVFioyy5UTtPVkaJoqDFkL+ndkXQ/3RMSMdPxjwIe6+pfJ1o1Yh2zlvUsjogOYJem2HsrfBpjUVVZE/HsRcXwU2ODdFTZZVtIyqY4D03snSHqpiq/pBEkHpNddK/y9CHSSTd+HbOXBK1Md2wFXVNS9ZA9lPgBcLOkq4KoqYjCriRO09eSNiNik8kBKVK9XHiJbd/imbtftmWMcbcA2aX2T7rFUrY8V/rqLVO/L3b8HPdiL7JfFPsC3JW2Ulog1y4X7oK1eNwFf7FpdT9K6kpYmW/HvkNRHvTrZQvPd3QXsIGlUeu8K6fhcYFjFdTcDX+7akbRJejkJOCwd2wNYvo9Ye1vhrw3o+ivgMLKuk1eBGZI+meqQpIUWwJfUBqwVEX8BvpXqWKaPOMxq4gRt9TqXrH95qrIHk/6G7C+y8cDj6dyFwJ3d3xgRz5Ot+HelsgcLdHUxXAsc0HWTEDiBbDW3ByRN593RJKeRJfiHybo6/tVHrL2t8Pc6sFX6GnYBTk/HDweOTvE9DOzXrcx24CJlK83dB/wiLfdplhuvZmdmVlJuQZuZlZQTtJlZSTlBm5mVlBO0mVlJOUGbmZWUE7SZWUk5QZuZldT/BxWOzr1x8gJLAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "yhat = knn_cv.best_estimator_.predict(X_test)\n",
    "plot_confusion_matrix(Y_test,yhat)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## TASK  12\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Find the method performs best:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Authors\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://www.linkedin.com/in/joseph-s-50398b136/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork26802033-2022-01-01\">Joseph Santarcangelo</a> has a PhD in Electrical Engineering, his research focused on using machine learning, signal processing, and computer vision to determine how videos impact human cognition. Joseph has been working for IBM since he completed his PhD.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Change Log\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| Date (YYYY-MM-DD) | Version | Changed By    | Change Description      |\n",
    "| ----------------- | ------- | ------------- | ----------------------- |\n",
    "| 2021-08-31        | 1.1     | Lakshmi Holla | Modified markdown       |\n",
    "| 2020-09-20        | 1.0     | Joseph        | Modified Multiple Areas |\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Copyright © 2020 IBM Corporation. All rights reserved.\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}