2_S2_Multiple_Linear_Regression.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<center>\n",
    "    <img src=\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-SkillsNetwork/labs/Module%202/images/IDSNlogo.png\" width=\"300\" alt=\"cognitiveclass.ai logo\"  />\n",
    "</center>\n",
    "\n",
    "# Multiple Linear Regression\n",
    "\n",
    "Estimated time needed: **15** minutes\n",
    "\n",
    "## Objectives\n",
    "\n",
    "After completing this lab you will be able to:\n",
    "\n",
    "*   Use scikit-learn to implement Multiple Linear Regression\n",
    "*   Create a model, train it, test it and use the model\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1>Table of contents</h1>\n",
    "\n",
    "<div class=\"alert alert-block alert-info\" style=\"margin-top: 20px\">\n",
    "    <ol>\n",
    "        <li><a href=\"https://#understanding-data\">Understanding the Data</a></li>\n",
    "        <li><a href=\"https://#reading_data\">Reading the Data in</a></li>\n",
    "        <li><a href=\"https://#multiple_regression_model\">Multiple Regression Model</a></li>\n",
    "        <li><a href=\"https://#prediction\">Prediction</a></li>\n",
    "        <li><a href=\"https://#practice\">Practice</a></li>\n",
    "    </ol>\n",
    "</div>\n",
    "<br>\n",
    "<hr>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "### Importing Needed packages\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "import pandas as pd\n",
    "import pylab as pl\n",
    "import numpy as np\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "### Downloading Data\n",
    "\n",
    "To download the data, we will use !wget to download it from IBM Object Storage.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--2022-01-14 23:00:50--  https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-SkillsNetwork/labs/Module%202/data/FuelConsumptionCo2.csv\n",
      "Résolution de cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)… 169.63.118.104\n",
      "Connexion à cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)|169.63.118.104|:443… connecté.\n",
      "requête HTTP transmise, en attente de la réponse… 200 OK\n",
      "Taille : 72629 (71K) [text/csv]\n",
      "Sauvegarde en : « FuelConsumption.csv »\n",
      "\n",
      "FuelConsumption.csv 100%[===================>]  70,93K   320KB/s    ds 0,2s    \n",
      "\n",
      "2022-01-14 23:00:51 (320 KB/s) — « FuelConsumption.csv » sauvegardé [72629/72629]\n",
      "\n"
     ]
    }
   ],
   "source": [
    "!wget -O FuelConsumption.csv https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-SkillsNetwork/labs/Module%202/data/FuelConsumptionCo2.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Did you know?** When it comes to Machine Learning, you will likely be working with large datasets. As a business, where can you host your data? IBM is offering a unique opportunity for businesses, with 10 Tb of IBM Cloud Object Storage: [Sign up now for free](http://cocl.us/ML0101EN-IBM-Offer-CC)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"understanding_data\">Understanding the Data</h2>\n",
    "\n",
    "### `FuelConsumption.csv`:\n",
    "\n",
    "We have downloaded a fuel consumption dataset, **`FuelConsumption.csv`**, which contains model-specific fuel consumption ratings and estimated carbon dioxide emissions for new light-duty vehicles for retail sale in Canada. [Dataset source](http://open.canada.ca/data/en/dataset/98f1a129-f628-4ce4-b24d-6f16bf24dd64?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01)\n",
    "\n",
    "*   **MODELYEAR** e.g. 2014\n",
    "*   **MAKE** e.g. Acura\n",
    "*   **MODEL** e.g. ILX\n",
    "*   **VEHICLE CLASS** e.g. SUV\n",
    "*   **ENGINE SIZE** e.g. 4.7\n",
    "*   **CYLINDERS** e.g 6\n",
    "*   **TRANSMISSION** e.g. A6\n",
    "*   **FUELTYPE** e.g. z\n",
    "*   **FUEL CONSUMPTION in CITY(L/100 km)** e.g. 9.9\n",
    "*   **FUEL CONSUMPTION in HWY (L/100 km)** e.g. 8.9\n",
    "*   **FUEL CONSUMPTION COMB (L/100 km)** e.g. 9.2\n",
    "*   **CO2 EMISSIONS (g/km)** e.g. 182   --> low --> 0\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"reading_data\">Reading the data in</h2>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MODELYEAR</th>\n",
       "      <th>MAKE</th>\n",
       "      <th>MODEL</th>\n",
       "      <th>VEHICLECLASS</th>\n",
       "      <th>ENGINESIZE</th>\n",
       "      <th>CYLINDERS</th>\n",
       "      <th>TRANSMISSION</th>\n",
       "      <th>FUELTYPE</th>\n",
       "      <th>FUELCONSUMPTION_CITY</th>\n",
       "      <th>FUELCONSUMPTION_HWY</th>\n",
       "      <th>FUELCONSUMPTION_COMB</th>\n",
       "      <th>FUELCONSUMPTION_COMB_MPG</th>\n",
       "      <th>CO2EMISSIONS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>2.0</td>\n",
       "      <td>4</td>\n",
       "      <td>AS5</td>\n",
       "      <td>Z</td>\n",
       "      <td>9.9</td>\n",
       "      <td>6.7</td>\n",
       "      <td>8.5</td>\n",
       "      <td>33</td>\n",
       "      <td>196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>2.4</td>\n",
       "      <td>4</td>\n",
       "      <td>M6</td>\n",
       "      <td>Z</td>\n",
       "      <td>11.2</td>\n",
       "      <td>7.7</td>\n",
       "      <td>9.6</td>\n",
       "      <td>29</td>\n",
       "      <td>221</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX HYBRID</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>1.5</td>\n",
       "      <td>4</td>\n",
       "      <td>AV7</td>\n",
       "      <td>Z</td>\n",
       "      <td>6.0</td>\n",
       "      <td>5.8</td>\n",
       "      <td>5.9</td>\n",
       "      <td>48</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>MDX 4WD</td>\n",
       "      <td>SUV - SMALL</td>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>AS6</td>\n",
       "      <td>Z</td>\n",
       "      <td>12.7</td>\n",
       "      <td>9.1</td>\n",
       "      <td>11.1</td>\n",
       "      <td>25</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>RDX AWD</td>\n",
       "      <td>SUV - SMALL</td>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>AS6</td>\n",
       "      <td>Z</td>\n",
       "      <td>12.1</td>\n",
       "      <td>8.7</td>\n",
       "      <td>10.6</td>\n",
       "      <td>27</td>\n",
       "      <td>244</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MODELYEAR   MAKE       MODEL VEHICLECLASS  ENGINESIZE  CYLINDERS  \\\n",
       "0       2014  ACURA         ILX      COMPACT         2.0          4   \n",
       "1       2014  ACURA         ILX      COMPACT         2.4          4   \n",
       "2       2014  ACURA  ILX HYBRID      COMPACT         1.5          4   \n",
       "3       2014  ACURA     MDX 4WD  SUV - SMALL         3.5          6   \n",
       "4       2014  ACURA     RDX AWD  SUV - SMALL         3.5          6   \n",
       "\n",
       "  TRANSMISSION FUELTYPE  FUELCONSUMPTION_CITY  FUELCONSUMPTION_HWY  \\\n",
       "0          AS5        Z                   9.9                  6.7   \n",
       "1           M6        Z                  11.2                  7.7   \n",
       "2          AV7        Z                   6.0                  5.8   \n",
       "3          AS6        Z                  12.7                  9.1   \n",
       "4          AS6        Z                  12.1                  8.7   \n",
       "\n",
       "   FUELCONSUMPTION_COMB  FUELCONSUMPTION_COMB_MPG  CO2EMISSIONS  \n",
       "0                   8.5                        33           196  \n",
       "1                   9.6                        29           221  \n",
       "2                   5.9                        48           136  \n",
       "3                  11.1                        25           255  \n",
       "4                  10.6                        27           244  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"FuelConsumption.csv\")\n",
    "\n",
    "# take a look at the dataset\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's select some features that we want to use for regression.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ENGINESIZE</th>\n",
       "      <th>CYLINDERS</th>\n",
       "      <th>FUELCONSUMPTION_CITY</th>\n",
       "      <th>FUELCONSUMPTION_HWY</th>\n",
       "      <th>FUELCONSUMPTION_COMB</th>\n",
       "      <th>CO2EMISSIONS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2.0</td>\n",
       "      <td>4</td>\n",
       "      <td>9.9</td>\n",
       "      <td>6.7</td>\n",
       "      <td>8.5</td>\n",
       "      <td>196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2.4</td>\n",
       "      <td>4</td>\n",
       "      <td>11.2</td>\n",
       "      <td>7.7</td>\n",
       "      <td>9.6</td>\n",
       "      <td>221</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.5</td>\n",
       "      <td>4</td>\n",
       "      <td>6.0</td>\n",
       "      <td>5.8</td>\n",
       "      <td>5.9</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>12.7</td>\n",
       "      <td>9.1</td>\n",
       "      <td>11.1</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>12.1</td>\n",
       "      <td>8.7</td>\n",
       "      <td>10.6</td>\n",
       "      <td>244</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>11.9</td>\n",
       "      <td>7.7</td>\n",
       "      <td>10.0</td>\n",
       "      <td>230</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>11.8</td>\n",
       "      <td>8.1</td>\n",
       "      <td>10.1</td>\n",
       "      <td>232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>3.7</td>\n",
       "      <td>6</td>\n",
       "      <td>12.8</td>\n",
       "      <td>9.0</td>\n",
       "      <td>11.1</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>3.7</td>\n",
       "      <td>6</td>\n",
       "      <td>13.4</td>\n",
       "      <td>9.5</td>\n",
       "      <td>11.6</td>\n",
       "      <td>267</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   ENGINESIZE  CYLINDERS  FUELCONSUMPTION_CITY  FUELCONSUMPTION_HWY  \\\n",
       "0         2.0          4                   9.9                  6.7   \n",
       "1         2.4          4                  11.2                  7.7   \n",
       "2         1.5          4                   6.0                  5.8   \n",
       "3         3.5          6                  12.7                  9.1   \n",
       "4         3.5          6                  12.1                  8.7   \n",
       "5         3.5          6                  11.9                  7.7   \n",
       "6         3.5          6                  11.8                  8.1   \n",
       "7         3.7          6                  12.8                  9.0   \n",
       "8         3.7          6                  13.4                  9.5   \n",
       "\n",
       "   FUELCONSUMPTION_COMB  CO2EMISSIONS  \n",
       "0                   8.5           196  \n",
       "1                   9.6           221  \n",
       "2                   5.9           136  \n",
       "3                  11.1           255  \n",
       "4                  10.6           244  \n",
       "5                  10.0           230  \n",
       "6                  10.1           232  \n",
       "7                  11.1           255  \n",
       "8                  11.6           267  "
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cdf = df[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY','FUELCONSUMPTION_COMB','CO2EMISSIONS']]\n",
    "cdf.head(9)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's plot Emission values with respect to Engine size:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEHCAYAAABBW1qbAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/MnkTPAAAACXBIWXMAAAsTAAALEwEAmpwYAAAwDElEQVR4nO2df5xddXnn389MJiGTqMAksoGQGUqBdmItypTWTX+gAbHRF2i3unFHzUt9NZjQFu36smazW7XddNnWttLdJjYVJJqpLFvtyotSlERtV0ulAQFJkCUuCQSykIA/QBBI8uwf59yZM3fOuefHPeeeO3c+79fr+7r3fs/5nvPcm8z3Od/neb7PY+6OEEIIAdBXtwBCCCG6BykFIYQQk0gpCCGEmERKQQghxCRSCkIIISaRUhBCCDHJvCovbmYHgKeB48Axdx8zs1OB/wGMAAeAt7n798LzNwHvDc//bXf/UqvrL1myxEdGRqoSXwghepI777zzqLsvjTtWqVIIea27H418/jCw292vNrMPh59/18xGgbXASuB0YJeZnevux5MuPDIywp49e6qUXQgheg4zO5h0rA7z0eXAjvD9DuDNkf4b3P15d38I2A9c2HnxhBBi7lK1UnDgy2Z2p5mtD/tOc/fDAOHry8P+M4BHImMPhX1CCCE6RNXmo1Xu/piZvRy4zcy+0+Jci+mbkYMjVC7rAVasWFGOlEIIIYCKVwru/lj4+gTwtwTmoMfNbBlA+PpEePoh4MzI8OXAYzHX3O7uY+4+tnRprJ9ECCFEQSpTCma2yMxe0ngPvB64D7gJWBeetg74Yvj+JmCtmS0ws7OAc4A7qpJPCCHETKpcKZwGfN3M7iGY3P/O3W8FrgYuMbMHgUvCz7j7XuBGYB9wK3Blq8gjIcTcYmICRkagry94nZioW6LexGZz6uyxsTFXSKoQvc/EBKxfD88+O9U3OAjbt8P4eH1yzVbM7E53H4s7ph3NQoiuZ/Pm6QoBgs+bN9cjTy8jpSCE6HoefjhfvyiOlIIQoutJij5XVHr5SCkIIbqeLVsCH0KUwcGgX5SLlIIQousZHw+cysPDYBa8yslcDZ1IiCeEEG0zPi4l0Am0UhBCCDGJlIIQQohJpBSEEEJMIqUghBBiEikFIYQQk0gpCCGEmERKQQghxCRSCkIIISaRUhBCCDGJlIIQQohJpBSEEEJMUrlSMLN+M/uWmd0cfv6omT1qZneHbU3k3E1mtt/MHjCzS6uWTQghxHQ6kRDvKuB+4KWRvj9z949HTzKzUWAtsBI4HdhlZueqTrMQQnSOSlcKZrYceCPwqQynXw7c4O7Pu/tDwH7gwirlE0IIMZ2qzUefAD4EnGjq/00zu9fMrjOzU8K+M4BHIuccCvuEEEJ0iMqUgpm9CXjC3e9sOrQNOBs4HzgM/EljSMxlPOa6681sj5ntOXLkSIkSCyGEqHKlsAq4zMwOADcArzOzne7+uLsfd/cTwF8xZSI6BJwZGb8ceKz5ou6+3d3H3H1s6dKlFYovhBBzj8qUgrtvcvfl7j5C4ED+iru/w8yWRU57C3Bf+P4mYK2ZLTCzs4BzgDuqkk8IIcRM6ijH+Udmdj6BaegAcAWAu+81sxuBfcAx4EpFHgkhRGfpyOY1d/+au78pfP9Od/8Zd3+lu1/m7ocj521x97Pd/Tx3//tOyCaEmB1MTMDICPT1Ba8TE3VL1JtoR7MQIpWNG2HePDALXjdu7Oz9JyZg/Xo4eBDcg9f166UYqkBKQQjRko0bYds2OB4ac48fDz53UjFs3gzPPju979lng35RLuY+I+pz1jA2NuZ79uypWwwhepq+vuDpvBkzONG8A6mHZeglzOxOdx+LO6aVghCiJUnPjZ18nlyxIl+/KI6UghCi69myBQYHp/cNDgb9olykFIQQXc/4OGzfDsPDgcloeDj4PD5et2S9h5SCEKIlGzbk66+K8XE4cCDwIRw4IIVQFVIKQvQAVcbwb90aKID+/uBzf3/weevW9q6rfQfdiZSCEBVTdYx/XAz/u98NS5aUN+Fu3QrHjgXXP3asHIWgfQfdiUJShaiQRox/M2U8aTcYGQkm1VYMDnaXDT5J5uHhwDQkqqVVSKqUghAVMm/e1KavKP39wRN3GSTF8DfTTROu9h3Ui/YpCFETcQqhVX8RssbqP/xw8XukmcDy+ge076B7kVIQokIsrnRUi/4ixMXwx1F0wk1Lc1HEP6B9B92LlIIQFVLGbuC0p/TmGP6hIZg/f/o57Uy4n/xk6/4ieYm076B7kVIQc5q6s3+mkTUZXTSG/+hReO97p4eQrltXfMJNU2xJZqk0c5X2HXQnUgpiztKJ7J+NiTlrfzPbt+frh8Bss2PH9O+1Y0d14Z7yD/QWUgpizlJkws3L+vX5+psp4qjudJpp+Qd6i8qVgpn1m9m3zOzm8POpZnabmT0Yvp4SOXeTme03swfM7NKqZRNzm05EBrW7G7jISqOoOSeJtDQX4+OBeaosc5Wol06sFK4C7o98/jCw293PAXaHnzGzUWAtsBJ4A7DVzDIusoXIT7umnay0sxu4yEqjbHNOmmLrtLlKVEulSsHMlgNvBD4V6b4c2BG+3wG8OdJ/g7s/7+4PAfuBC6uUT8xt2jXtdIJVqwIHeJR584L+JOLMOQMD8MwzxdNetFJsqorWW1S9UvgE8CEgukfxNHc/DBC+vjzsPwN4JHLeobBPiEqoKtFbmWzePHPn87FjMyfc6OaxzZsD8000RNUMnnyymjxDZZurRL1UphTM7E3AE+5+Z9YhMX0zguHMbL2Z7TGzPUeOHGlLRiHKTvRWNlkm3LjNYzt2BCuGEydg8WJ44YXp48t8klf0UW9R5UphFXCZmR0AbgBeZ2Y7gcfNbBlA+PpEeP4h4MzI+OXAY80Xdfft7j7m7mNLly6tUHwh6ifLhJtmvqn6Sb6q6KOVK4MVTqOtXNne9UQ2KlMK7r7J3Ze7+wiBA/kr7v4O4CZgXXjaOuCL4fubgLVmtsDMzgLOAe6oSj4hZgNZJty0Sb/qJ/kqdievXAn79k3v27dPiqET1LFP4WrgEjN7ELgk/Iy77wVuBPYBtwJXunuJwYFCzD6yTLhpk34n9hGUvTu5WSGk9c8lKt+F7+6ztl1wwQUuRN3s3Ok+POxuFrzu3Nn5+w8OugcehaANDk6Xo24Z8xL9Ls1tLrNhQ/xvsmFDvusAezxhXtWOZiHaoBsqiGVZTTQ/yYNKYc5GOrELX0pBiDaYjTH6VSiysp3Co6P5+ucKndiFL6UgRBvUEaMfnXwbLW2Sj+5jWLcuvyK7+OLp97v44qljVTiF9+6dqQBGR4P+uUwnduFLKQjRBp2O0U8qztNqkm9eGSQ9VSbVeb74Yti9e3rf7t1TiqEqp/DevdMt53NdIUBnduFLKQjRBt2cIbSxWokzccWR9LTZrBDS+kV1dGIXvpSCEG3QzRXEGquVrKasMu3Sojqq3oUvpSBEDxJdrWQ1ZQ0PVyePmD1IKQjRBt0QktogabUSZ+KKY82a+P7Vq/P1i9mNlIIQLYhG7cTF83c6JLVVveSkHcXNJq4k38Ett8T379o1UwGsXh30Q+fqUojOIKUgRAJZVgF1hKTG7WlNS30Q3bx24kTsZVvKvGvX9Ps1FAKUFxFTefoGkY2krc6zoSnNhaiS4eH4lALDw1PnDA3FnzM0VJ1cGza49/cH9+nvdx8dzZf6IMv3ysvq1dOvtXp1/u9URvoGkQ2U5kKI/HRj8ZiNG2HbtumlL5P2A2zbFm/2KjuMdmICbr99et/tt880tbUyxXUifYPISJK2mA1NKwVRJVmeqM3izzErT45oMrtWieJatSoT5CX9TkNDU/cYGnKfPz9ZJiXA6yxopSBEfrI8USeFe/b1lZNsrtmvUZRnnw3SWzRkgtaprlultWgmaSf0k09Oyf3kk62rv8lZ3T1IKQiRQJaNaUnhnsePlxOimnU3chayypSW1qJMGqa4iy6KP57UL6rDvJ3Hj5oZGxvzPXv21C2GmONMTAST98MPB0/icTuDh4enUlbnoa+vvRVCK/r7g5XCihWBcmsou6T8StFx69dP7aRNO78Vjd9lZCR+xVH0dxOtMbM73X0s7phWCkK0Sbvhnq1CMatKrAfTVw7veU/21czx44ETuyFnURNP1BTXjU79uUplSsHMTjKzO8zsHjPba2YfC/s/amaPmtndYVsTGbPJzPab2QNmdmlVsglRFYsW5euPiyaKTrg/+ZPlyxjHCy/AVVflG9OIDDrvvGznDwzA0FC8Ka7T2WZFC5I80O02wIDF4fsB4JvALwAfBT4Yc/4ocA+wADgL+C7Q3+oeij4S3UDW6KA4GvsNmlt/f+vj0Xb66TPLcRZt7jP3HKSd3+p7Z41wylJSVJQHdUQfhfd+Jvw4ELZW1tHLgRvc/Xl3fwjYD1xYlXxClEG70UFplbRaZS5tTJ+PPpotjUV/fzb7f1xai6TrNeRIolWEU5RuzjY716jUp2Bm/WZ2N/AEcJu7fzM89Jtmdq+ZXWdmp4R9ZwCPRIYfCvuE6Bh5Uy20Gx2UFoqZNVTzG9+AQ4eCCfrEiUD2KIODsGNHcGxoKP6a0f5oWosNG+LPL7OwC8ysIy2FUA+VKgV3P+7u5wPLgQvN7BXANuBs4HzgMPAn4elxzzAznkHMbL2Z7TGzPUeOHKlEbjE3SbPvx5EUo5+VJHt8oz9p4j1+fGoPwfz50+V2D/LsL1489dS9bl2gwPrCv/hmpTIwANdcE3+vtMIuJ50UPy6pX3Q3HQtJNbOPAD9y949H+kaAm939FWa2CcDd/0t47EvAR9399rjrgUJSRbnMmxdvrunvDybZPGOaSQpVbYSFtjp/48bAlJK3CE5D7oaJK7qiGRiAl74UnnpqZkhqXpYsCTanNTM0BEePFrumqJZaQlLNbKmZnRy+XwhcDHzHzJZFTnsLcF/4/iZgrZktMLOzgHOAO6qST4hm0uz7eY9FSQpVzdIfrbSVh4ZscSauF18MJnL3wOz0jW/ku3aUp57K1y+6m3nppxRmGbDDzPoJlM+N7n6zmX3WzM4nMA0dAK4AcPe9ZnYjsA84Blzp7ioQKDpGf3/yJN9w0I6OTi8gPzyczYRUR1WzhrknLda/YSaDYqUdk1ZSSlExO6ky+uhed3+Vu7/S3V/h7r8f9r/T3X8m7L/M3Q9Hxmxx97Pd/Tx3//uqZBOiQdSxnOWpf98+WLly6nPWqmad2m8QpeGPyBrrXzQjaZJpLalfdDfa0SwKk1aVrNtlaHYsN0gL24ymqm4OpUzia1/LLlcrTj45vn9gINkRnFVx5fVZiB4laQPDbGjavFYf3bDZqF0Z0jaOFUnnnHdM3vOLFqPJssGu8b3zUuR3EvVCi81rSognCtENCczalaHVk717+vE48kYw5b1HkQipZhorpGaiq4s8FPmdRL20HX0URhL9BzPbHm44u87MritXTDGb6IYEZu3KkLYxbHQ0/nhzf9SEtXBh/JiyNnoViZBqZtWqqf0KDfr6gv4iJG1uS+oX3U1Wn8IXgZcBu4C/izQxR+mGBGZZZGjlc0grOL9370wF0Bx91Jzm4plnZk64q1cnP4EnPWUn9ZdRjGbz5pmhsCdOTBW8iaMb/EeiQyTZlaINuDvLeZ1u8inUx2zwKWSRccOGKd9Cf3/+QvFJpSiz/i6d8ilEyVtCNO13TPPNiO6DFj6FrErhPwNrspzbySalUC/tTqhl0KrWcJYay+1c3z173eSkexaRsSpFVlRGOZpnH62UQlbz0VXAzWb2YzN7Omw/rGTpImYFExNBgrVonqAdO7rLrNCuz6HZNBRXxjKruSzpnlnqQDcT3eF87Fh+5/CaNfn6037HvCYw0eUkaYvZ0LRSqI8ynsLbJc2ssWhRvIyLFmW7fpbvuHOn+/z56SuF/v7k1UanV1x1rRTSVl2ic9Cu+Si4BpcBHw/bm7KOq7JJKdRHXrt0FvJOGlWbNbKM37nTfWAgXSkkKa648QMDrb973Pl5KNunkPV3ar6vmRRDXbStFICrgd3Ae8J2G3B1lrFVNimF+ih7pVDEcZ02uXVCKST9Do2VQZITtvE7DQ3FHx8aipcpSQHlUQxF/u1aKewsv1PSamr+/Oxyi/IoQyncC/RFPvcD92YZW2WTUqiPsqOP0ibXuJVDN6wU2lVMeWVs9zu5x5u85s8v/m+XZeVRhtyiPFophTy5j06OvH9ZYSeG6AnKLp+Y5Mw8fjyYOuKcvEWctGWTtleijH0FVRA82yV/zsP73pevX3Q5Sdoi2oC3AweB64EdwEPA2ixjq2xaKfQOWeL940wc7Zo1WpFlfLv29qpWCq2c11UECaQ5y7VS6C4oydG8jMDZfDnwr7KOq7JJKfQOO3e69/VlUwxZI3WymDVaKZXR0fjxo6MzZS+6VyLvZJnFp5C2wa2KIIE0Vq+Ov+fq1dXdUyRTWCkAPxW+vjqutRrbiSal0DskTWRZWpJiWLw4/vzFi4PjWWzrzYqhWSGkUUbkTjNp0UdJyrWvL9vvUhXNikEKoT7aUQrbw9evxrSvtBrbiSalUC9lxp0nRelkXTnEkTbh5o38yUrz77JhQ3UmrjjSrtlqF7b2EMwNSjEf5W3ASQQ1lu8B9gIfC/tPJQhpfTB8PSUyZhOwH3gAuDTtHlIK9VF29FFRhdBqAq2iXkIaeX+XOpRClt+z03msRGdppRQy1VMws7cCt7r702b2H0Pz0R+4+7dajDFgkbs/Y2YDwNcJ0mX8GvCUu19tZh8OlcLvmtko8DngQuB0goys53qLOs2qp1AfZddTSKoTkIWitQqqqAOQ93epQoa+vvixZkE21Ky/dSdrY4jO0nY9BeA/hQrhF4FLCSKQPtlqQKiQngk/DoTNCRzVO8L+HcCbw/eXAze4+/Pu/hDBiuHCjPKJDpNUrD5LEfs42qk3kDR28eLW/UND8ceT+rOQFFp78GB5aaejdaXnzQs+R0lSJo3+iy7Kdp9O1sYQ3UNWpdB4rngjsM3dvwjMTxtkZv1mdjfwBHCbu38TOM3dDwOEry8PTz8DeCQy/FDYJ7qQsuPv4wq/xLF48fRaxKtXwy23xE+4P/pR/DUa/ddcE9Q2jjIwEPTnITpJt3q6dw+Uw7vfXVwxNNeVPn48+NysGFqxf3+28zpZG0N0EUl2pWgDbgb+EvguwSa2BcA9WcaG408mcE6/Avh+07Hvha9/Abwj0n8t8G9irrUe2APsWbFiRXlGNpGLLLbwPI7orPsUYOqaQ0Mzo4eK5ORpx1leNGqq4cwu20+Sds2sqb7z+hSU7G52QQlpLgYJfAHnhJ+XAa/PMjZyjY8AHyRwIi+LXOeB8P0mYFPk/C8Br2l1TTma6yMtcqdMh2veVmae/4ULp49buHD68VZRU2kTcJbfMc/vVMZvWWRSL5LUT9RLK6WQ1dF8NnDI3Z83s4uAVwKfcffvtxizFHjR3b9vZguBLwP/FfgV4EmfcjSf6u4fMrOVwF8z5WjeHSohOZq7kLQC8mU6XPPScKgWceJu3Bik62jliF24EJ59dupere6Rdnzx4ngz16JFQWnPZrJ8p3Z+ywzTwQyWLIEnn5zZPzQER48Wl0VURxmO5s8Dx83sJwnMOmcRTOCtWAZ81czuBf6FwKdwM0HG1UvM7EHgkvAz7r4XuBHYB9wKXNlKIfQ6ZdfETXNO5iWtgHy7BW7aoagtvNlen8Rzz029b9e3kub3mA3EKYRW/aLLSVpCRBtwV/j6IeC3wvffyjK2ytar5qOy9wCUUde3mTQzRt78OmWZjtrZLZxnA13W3zbtGnllrNp8VISyryeqhxJ8Ct8kSIp3H3BW2HdflrFVtl5VCmUnLKuisHraRNBpn0IZu4WLTp6tksGl+QyqUAp5nPbRVjTtRFU7w0V1tFIKWc1H7wZeA2xx94fM7CxgZ3nrFRGlbNNLmqmnCspOrZ3GiROBr6Kq60dZuHD651WrYPny4HsuXx58blBW2GuDDRvS++NSijdMhxCYtk4/ffrx1ath165iMl1zDcxvClCfP7/4dxQ1k6QtZkPr1ZVC2U9eaQnSilC2yaCd3EdJ98z7O2YJ12z+zbKsiFqFaxbJHpqlpnP0nkNDM6ODyk5joZDU2QVFVwpmdmP4+m0zuzfSvh06kMUsoPnJNq2/DqpYtZx/fr5+9/Rrnjgx3Um/efNUJFKDZ5+FdeumggQgWMXErWbOPTf+Pkn9AFu3BhFe7sHr1q0zzxkfn7rn4sXw4oszZdy8OfkeeYner1MrNlENLUNSzWyZux82s+G44+5eMKlBOfRqSGpa7pq6r9cYm0SWybWZl7wkPgQzK3H3TAubzXp+q/FJv22UwcFk01leGWF62Gx/f5DmI04xNKji31/MbgqHpPpUOoqDoQL4HvB0pIkKSCvxWPf1qqCKEMy8vpSs+Zei47P8hq2eyvPKWCTNRSf+/csOoRY1kmRXijbgCuBx4ABBKc6HgP+bZWyVrVd9CmUXVm/X7h1H2T6FdvwJ0RYtglMk6ipqr09q0fFxv22e3yWvjEW+U9khzp2+vigfSghJfRBYkuXcTrZeVgplpw1oNekXuV8RpVC0nnJRxVBkf0ZUKSQ5npvHR79XFkXSfL88MhZVxlU6gquo+SyqpQylcCswmOXcTrZeVQqd/iMrEu2Ud3JqpyxlkdYgS6RO9NxW10wbX+R3yStjFXtO2qWOms+iPVophay5j14FfJpgE9vzEdPTb5dmxyqAHM3lUMRpnGXMxERgS3/44eA7xdnJG7mQysx9FJUhD2U4z/PmMsrLypWwb9/M/tFR2Lu3/esXoeyCS6J6ysh99JfAV4B/Bu6MNFEBzRuP0vq7kYmJwHF78GAwoSY5TosW5elWmsNT0/rz8sAD+fo7QdxmucHBoF/MPrIqhWPu/jvu/ml339FolUo2h4kmXMvS3y5VVCCLi9+Po2hRnlaMjpZ/zawkrSharTTyRO7UsTs9jU7vXhfVklUpfNXM1pvZMjM7tdEqlWwOk2QiqiqmvIo0BVlXAGVPZu2YUZLMR2WbtqJMTASV2BorqrTKbGVXvCsLbV7rHbIqhX9HUATnn5gyHfWeMb+HaH763Lgx+Wl0fByuu276k95117X3h511kmpnNRKl4d5sVgh5nsLf9758/WVw1VUzdxu/+GLQH0fSXop2alwLMY0kD/RsaL0afVQ07LBBltj5vr72whLTZMwaJZQlW2iWlhRqmzd+Pk8kUJHfpd3zy5CxCpT7aHZB0ZBU4EOR929tOvaHrcZ2okkpxJM1dfKiRdXJmJSEr10lktaim/zqiJ/vhFLoNrR5bfbRSimkmY/WRt5vajr2hpIWK6KJdh2/We35VVb3yuP/6MtqxMzACy9MmV7qqP6W99+uCid/p0lKClhmwj3ROdL+HC3hfdzn6QfNzjSzr5rZ/Wa218yuCvs/amaPmtndYVsTGbPJzPab2QNmdmmub9JDzLX89MHCszwaZSDryPmU99+uF/6t6yy9KiogaQkRrDCCMpzN7+M+x4xdBrw6fP8S4P8Ao8BHgQ/GnD8K3AMsIKgB/V2gv9U9etV85N6ejTarqSVaG6Ds3EdZahNU2RrfqQ6zRt7fcrbb45XmYvZBC/PRvBSd8bNm9kOCVcHC8D3h55NSlM1hoJFl9Wkzux84o8WQy4Eb3P154CEz2w9cCNyeIqMoyBVXBK+NjWYNE8DBg1PRLEUjkMp++i9CQ/bGruoVK4INVVWHS46P57tH3vO7jS1bpv//AW1em9UkaYsyGzACPAy8lGClcAC4F7gOOCU8578D74iMuRb49VbX7dWVws6dM5+0zbI/QaY9RTdHrBR50kt7Sk/Kp9TJlcJcptOrj9m+2plr0G7uo3Yws8XAPxDUd/6CmZ0GHAUc+ANgmbu/x8z+Arjd3XeG464FbnH3zzddbz2wHmDFihUXHOy1PAnAggWBw7SZ+fPh+edn9jeTN4dPkVxLafdYsmTKtl8H3bBSqYvmlR+0LvQj5h5l5D4qeuMB4PPAhLt/AcDdH3f34+5+AvgrAhMRwCHgzMjw5cBjzdd09+3uPubuY0uXLq1S/NqIUwit+tulCofsU08VHyvaQ9FAoh0qUwpmZgQmoPvd/U8j/csip70FuC98fxOw1swWmNlZwDnAHVXJJ6aoIqHZqUqCUhuKBhLtUOVKYRXwTuB1TeGnf2Rm3zaze4HXAh8AcPe9wI3APoL6DVe6e41pvnoTs6AucLR8YycTmvX1VZtLSMyO8quie0mLPiqMu3+d+L0Mt7QYswVQzELFNOr6QuuC76046ST48Y/j+yHZfOQe+CmqVAyzaeNXFSgaSLRDpT4FUQ9ZU0dv3x68TkzAu941PVPnu97VOnncT/xE6/66nlYHBmbXxq8qUCpr0Q5SChWQJzNnFcRV5oqjkbb6iitmRhmdODG1jyHPPRr9a9bEH0/qb4fFi6cmv09/WpMfKJW1KE5l5qO5ShUbwaL09ZW/CSspB1I7uZFuSTASJvW3w3PPVVdrQoi5hlYKJVN1OGDDvLN+ffsrkCrt+p2MgKmz6pgQvYaUQsl0ajIsQ9FUucGrkz6FuquOCdFLSCmUTCcnw26OO0/b+1DmRK6qY0KUh5RCyXTSwdrNcedpETDnnVf82g2F0t8PGzYUD6sVQsyk8txHVTI2NuZ79nRXqeiknD9DQ3D0aLZrZLH1t8plk8dX4F5N7qM05s0r5gvImv9JCJFMbbmP5iJJSeDKSg5XRdx5HQXrizqHf+mXypVDCDEdhaTOMqoIvWyYX7ZvDybr/v7ATl+lWaa/v5hi+NrXShdFCBFBK4Ua2LgxMJ/E5SGqi61b4dixwPRz7Fj1dvqizmGFnwpRLVoplIxZsn0eAgXQyDsE5eQhqoO075lG8+okKwo/FaJatFIoQKs0FklO1kZ/I99QM0n9nSLv6uWnfzpffxzR1cnpp2cbo/BTIapFK4WctJvGIumpuE6zSJHVy/335+tPY2Cg9fFO+DmEEApJzc3ISKAImhkeDhKPpYVqJoVi9vcHT83Qfrhn3pDULDLluUeR/1JlX08IkYxCUkskqSR01lLRF12Ur79KFi4MXrth9ZLkK5APQYjOIqWQk3Ynr7vvztdfJc89F7wW+U6LF+frT6MbFJMQotoazWea2VfN7H4z22tmV4X9p5rZbWb2YPh6SmTMJjPbb2YPmNmlVcnWDu1OXlVvbitCkvO2lVP3k58MzE5R5s0L+oswPJyvXwhRDVWuFI4B/97dfxr4BeBKMxsFPgzsdvdzgN3hZ8Jja4GVwBuArWbWdcaD2TB5nXxyvvO3bg1yCOXJKTQ+DtdfPz230fXXF99l3cmcUUKIZCpTCu5+2N3vCt8/DdwPnAFcDuwIT9sBvDl8fzlwg7s/7+4PAfuBC6uSryizYfL6/vfzjymyea3M6l6dLMojhEimIz4FMxsBXgV8EzjN3Q9DoDiAl4ennQE8Ehl2KOzrKpImqe3bg30LohidLMojhEim8mnMzBYDnwfe7+4/bHVqTN+MYEQzW29me8xsz5EjR8oSMzNJUUbHj3cmdLKuus9V08k6FEKIZCpVCmY2QKAQJtz9C2H342a2LDy+DHgi7D8EnBkZvhx4rPma7r7d3cfcfWzp0qXVCZ9A3SGSZZbj7CbSivIIITpDldFHBlwL3O/ufxo5dBOwLny/DvhipH+tmS0ws7OAc4A7qpKvKN0SIllm3eeitEr3kZfxcVi3brqze9268tKDCyGyUeVKYRXwTuB1ZnZ32NYAVwOXmNmDwCXhZ9x9L3AjsA+4FbjS3btkCu5OkuztixZlG59n53MzjXQfBw+Ws3qZmAjCWRtK9/jx4HMvrYaEmA0ozUVO2plI3bOlc8h6j0ZqjWYuvhh2704fv2gRPPNMtns1k5buIy8nnRRfUW3BAvjxj/NfTwiRjNJc9CCt7O1f+Uq2a/zoR8XvX3a0UFKJTZXeFKKzSCnMMrKU4+zE4k/RQkL0JkqdPcuoohxnEbZsmZ5CHBQtJEQvoJVCD9KO3yMr4+PBaiWa5qLV6iWN1avz9QshqkGO5pzU7Wgus57C0BAcPZrt3E7Q7CBfvRp27apPHiF6FTma5xhZk/O97W3VypGXc8+dvk/h3HPrlUeIuYiUQg8Stzs4js98pnpZstIoCRrdp7BtW3qtaCFEuUgp9CDN9v4k2glJLZvt2/P1CyGqQUqhR4mmtZ4NqPKaEN2BlEKHSUpBEe0vOxInabXQiSglIcTsQkqhQzSqoWWZoPfvjz8nqV8IIcpCSqFDvOxlwWtSrqFof1LNhqT+NJLCWLspGnk2lDkVYi4gpdAhVEGsNaqnIER3IKUQw8aNMG9eYNKZN6+csMhTT23/Gr1M2TukhRDFUO6jJhrx8g0a8fKQrZh9N7J6dXwq7W5LITE+LiUgRN1opdBEWrz80FCx6z71VLFxZbBr10wFoBQSQog4pBSaSIuXL5oaou6U0rt2BY7lRpNCEELEUWWN5uvM7Akzuy/S91Eze7SpPGfj2CYz229mD5jZpVXJBa1rCzdy7zTT6L/llvz3GxiYcphmCUmdPz/+nKR+IYQoiypXCtcDb4jp/zN3Pz9stwCY2SiwFlgZjtlqZgnTc3uk1RZevz5+XKO/SBRRdMLPEh563XUzlYdZ0C+EEFVSmVJw938EslrSLwducPfn3f0hYD9wYRVybd48vTAMBJ83bw7eb90KGzZMz9a5YcOUkznJDNTfH0zccSuNF16Yun6WePzxcfjsZ6dH4nz2s3LCCiGqpw6fwm+a2b2heemUsO8M4JHIOYfCvtLJUlt41SpYvjyYkJcvDz43SIqn37EjyDOUlGuocf2s8fjR3EUHDkghCCE6Q6eVwjbgbOB84DDwJ2F/nKU91tBiZuvNbI+Z7Tly5EhuAZJSSjf608xLcfH069YFK4G+vqDF0VhhZI3Hb+X3yEK744UQcxR3r6wBI8B9aceATcCmyLEvAa9Ju/4FF1zgeenri8bgTLW+vuD48HD88f5+d7Pg+M6dU9fbudN9cDB+TKMNDk4fk0bcNfNcY+dO9/nzp4+fPz+fDEKI3gXY4wnzaqXlOM1sBLjZ3V8Rfl7m7ofD9x8Aft7d15rZSuCvCfwIpwO7gXPcvWXi5CLlONNKXfb1pecEGhycerofGYnPSdTfH5h+VqwITEN5zD9J1xweDkxJaSxZAk8+ObO/28pvCiHqoZZynGb2OeB24DwzO2Rm7wX+yMy+bWb3Aq8FPgDg7nuBG4F9wK3AlWkKoShpIadZ9hNEHdNJPoqGf6GIPyCL36MVcQqh0V9m6g4hRO9RZfTR2919mbsPuPtyd7/W3d/p7j/j7q9098saq4bw/C3ufra7n+fuf1+VXGkhp2vWxB9vpjFBJymRdjarJeVJKit/kkpdCiGSmHM7mtNCTrNuTmtM+klKJKtyqYKsqThU6lII0cycUwoQKIBjxwLfwbFj0xPdZTHRRENIk5RIkZ3PDZLyJGXNn3TNNcEu6jRU6lII0cycVAqtSNuc1hxC2q79P48MWU1S4+Pw6U9Phb0mkeRfEULMXaQUmkjbnNbsOC4ygaftISij4Ex081tSiuyLLsp+PSHE3EBKoYm8xV7yTuBpm+OKyJCGaj4LIbIipRBDnhQTeSfwtNxLVVCFiUsI0ZtIKRSg2fwD2ZVI3Ka05v4sq4k8VBE2K4ToTaQUctLuhJ22eQ7KX02U4aMQQswNpBRy0u6EnVbZDco395TtoxBC9C7z6hZgttHuhD08nJzXqMGKFfHntGPuGR+XEhBCpKOVQk7atc9nMeXI3COEqAsphZy0O2FnMeXI3COEqItKU2dXTZHU2WUwMRH4EB5+uFhqbCGEqJNaUmf3Mu2WysxSFU2V04QQdSClUAJ5JvAsIa1l71MQQoisyHzUJo0JPBqmGq3M1kyWqmrtVl4TQohWtDIfSSm0Sd4JPKncp1lgjsp6jhBCFKWucpzXmdkTZnZfpO9UM7vNzB4MX0+JHNtkZvvN7AEzu7Qqucom776FLCGtSkshhKiLKn0K1wNvaOr7MLDb3c8BdoefMbNRYC2wMhyz1cxmRbb/vBO49ikIIbqZKms0/yPQXCvscmBH+H4H8OZI/w3u/ry7PwTsBy6sSrYyyTuBa5+CEKKb6XSai9Pc/TCAux82s5eH/WcA/xw571DY1/U0Juo8+xaypJxQWgohRB10S+6juKKRsR5wM1sPrAdY0SVGdk3gQoheodP7FB43s2UA4esTYf8h4MzIecuBx+Iu4O7b3X3M3ceWLl1aqbBCCDHX6LRSuAlYF75fB3wx0r/WzBaY2VnAOcAdHZZNCCHmPJWZj8zsc8BFwBIzOwR8BLgauNHM3gs8DLwVwN33mtmNwD7gGHCluydUHhBCCFEVlSkFd397wqHVCedvARR0KYQQNaLcR0IIISaZ1WkuzOwIEJNkIjNLgKMliVMVkrEcJGM5SMZyqFvGYXePjdSZ1UqhXcxsT1L+j25BMpaDZCwHyVgO3SyjzEdCCCEmkVIQQggxyVxXCtvrFiADkrEcJGM5SMZy6FoZ57RPQQghxHTm+kpBCCFEhDmnFOKK/3QbZnammX3VzO43s71mdlXdMjVjZieZ2R1mdk8o48fqlikJM+s3s2+Z2c11y5KEmR0ws2+b2d1mVm85wQTM7GQz+xsz+074f/M1dcsUxczOC3+/Rvuhmb2/brmaMbMPhH8z95nZ58zspLplijLnzEdm9svAM8Bn3P0VdcsTR5gscJm732VmLwHuBN7s7vtqFm0SMzNgkbs/Y2YDwNeBq9z9n1OGdhwz+x1gDHipu7+pbnniMLMDwJi7d218vZntAP63u3/KzOYDg+7+/ZrFiiUs0vUo8PPu3s5eplIxszMI/lZG3f25ML3PLe5+fb2STTHnVgoJxX+6Cnc/7O53he+fBu6ny+pLeMAz4ceBsHXdE4aZLQfeCHyqbllmM2b2UuCXgWsB3P2FblUIIauB73aTQogwD1hoZvOAQRIyQtfFnFMKsw0zGwFeBXyzZlFmEJpl7iZIgX6bu3edjMAngA8BJ2qWIw0Hvmxmd4Y1Q7qNnwCOAJ8OTXGfMrNFdQvVgrXA5+oWohl3fxT4OEFC0MPAD9z9y/VKNR0phS7GzBYDnwfe7+4/rFueZtz9uLufT1D/4kIz6ypznJm9CXjC3e+sW5YMrHL3VwO/ClwZmjm7iXnAq4Ft7v4q4EeENda7jdC0dRnwP+uWpRkzO4Wg/PBZwOnAIjN7R71STUdKoUsJ7fSfBybc/Qt1y9OK0IzwNeAN9Uoyg1XAZaG9/gbgdWa2s16R4nH3x8LXJ4C/pftqlB8CDkVWg39DoCS6kV8F7nL3x+sWJIaLgYfc/Yi7vwh8AfjXNcs0DSmFLiR04l4L3O/uf1q3PHGY2VIzOzl8v5DgP/t3ahWqCXff5O7L3X2EwJzwFXfvqqcyADNbFAYUEJpkXg90VXScu/8/4BEzOy/sWk1Q/6QbeTtdaDoKeRj4BTMbDP/OVxP4DLuGOacUwuI/twPnmdmhsOBPt7EKeCfBk20jvG5N3UI1sQz4qpndC/wLgU+ha0M+u5zTgK+b2T0EFQf/zt1vrVmmOH4LmAj/zc8H/rBecWZiZoPAJQRP4F1HuNL6G+Au4NsEc3BX7W6ecyGpQgghkplzKwUhhBDJSCkIIYSYREpBCCHEJFIKQgghJpFSEEIIMYmUgpgzmNnxpiyahXfkmtk/lSlb07XHzOzPq7q+EK1QSKqYM5jZM+6+uG45hOhmtFIQc56wlsHHzOyusKbBT4X9S83strD/L83soJktCY89E75eZGZfi9QZmAh3qmJmF5jZP4RJ7r4UpkRvvvdbw7z695jZP0aueXP4/pbIyuYHZrYuTET4x2b2L2Z2r5ld0anfSvQ+UgpiLrGwyXz0byPHjoYJ6bYBHwz7PkKQGuPVBPmIViRc91XA+4FRgmyiq8LcVf8N+HV3vwC4DtgSM/b3gEvd/WcJkrhNw93XhEkH3wscBP5X+P4H7v5zwM8Bv2FmZ2X8DYRoyby6BRCigzwXTrBxNNIi3An8Wvj+F4G3ALj7rWb2vYSxd7j7IYAwlfgI8H3gFcBt4cKhnyBVcjPfAK4Pi63EpmYIVyefBd7m7j8ws9cDrzSzXw9PeRlwDvBQgnxCZEZKQYiA58PX40z9XVjOsdHxBux195YlK939fWb28wSFgO42s/Ojx8MKYjcAv+/ujSR5BvyWu38po3xCZEbmIyGS+TrwNoDw6fyUHGMfAJZaWMfYzAbMbGXzSWZ2trt/091/DzgKnNl0ytXAve5+Q6TvS8CG0ESFmZ3b5QVvxCxCKwUxl1gYmnca3OrurcJSPwZ8LvQ9/AOB+efpLDdy9xdC886fm9nLCP7WPgHsbTr1j83sHIKn/93APcCvRI5/ENgbkfv3CEqLjgB3hU7tI8Cbs8glRBoKSRUiATNbABx392PhE/+2Fj4JIXoCrRSESGYFcKOZ9QEvAL9RszxCVI5WCkIIISaRo1kIIcQkUgpCCCEmkVIQQggxiZSCEEKISaQUhBBCTCKlIIQQYpL/D/ZoRF15citXAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.scatter(cdf.ENGINESIZE, cdf.CO2EMISSIONS,  color='blue')\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "#### Creating train and test dataset\n",
    "\n",
    "Train/Test Split involves splitting the dataset into training and testing sets respectively, which are mutually exclusive. After which, you train with the training set and test with the testing set.\n",
    "This will provide a more accurate evaluation on out-of-sample accuracy because the testing dataset is not part of the dataset that have been used to train the model. Therefore, it gives us a better understanding of how well our model generalizes on new data.\n",
    "\n",
    "We know the outcome of each data point in the testing dataset, making it great to test with! Since this data has not been used to train the model, the model has no knowledge of the outcome of these data points. So, in essence, it is truly an out-of-sample testing.\n",
    "\n",
    "Let's split our dataset into train and test sets. Around 80% of the entire dataset will be used for training and 20% for testing. We create a mask to select random rows using the  **np.random.rand()** function:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [],
   "source": [
    "msk = np.random.rand(len(df)) < 0.8\n",
    "train = cdf[msk]\n",
    "test = cdf[~msk]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "#### Train data distribution\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEHCAYAAABBW1qbAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/MnkTPAAAACXBIWXMAAAsTAAALEwEAmpwYAAAu4UlEQVR4nO3dfbRddX3n8ff3PgRyE2rCJTLhITeMRTvBOii3qENXSxsQG12ibXXiXG20rgYTbLEdlzXNTNWZocP00XZWA6SKhMkdGaa2I0MpiBHb0Vox0YAkyBBLAgEGIoKCKJLkO3/sfe7d99z9fPY+Z99zPq+19jrn/M7e+/zugezv2b+H78/cHREREYChXldARESaQ0FBRERmKCiIiMgMBQUREZmhoCAiIjMUFEREZMZInSc3s4PAM8Ax4Ki7T5rZycD/AFYDB4G3uftT4f5bgPeE+/+Gu9+edv5TTjnFV69eXVf1RUT60p49e77t7ivi3qs1KIR+zt2/HXn9IWCXu19lZh8KX/+2ma0B1gPnAKcBnzOzl7r7saQTr169mt27d9dZdxGRvmNmh5Le60Xz0aXAjvD5DuDNkfIb3f15d38QOACc3/3qiYgMrrqDggOfNbM9ZrYxLDvV3R8DCB9fHJafDjwcOfZwWCYiIl1Sd/PRBe7+qJm9GLjDzL6Zsq/FlM3LwREGl40Aq1atqqaWIiIC1Hyn4O6Pho9PAH9N0Bz0uJmtBAgfnwh3PwycGTn8DODRmHNud/dJd59csSK2n0REREqqLSiY2RIzO6n1HHgdcC9wM7Ah3G0D8Jnw+c3AejM7wczOAs4G7qqrfiIiMl+ddwqnAl80s7sJLu5/4+63AVcBF5vZA8DF4WvcfR9wE7AfuA24PG3kkYgMlulpWL0ahoaCx+npXteoP9lCTp09OTnpGpIq0v+mp2HjRnjuudmysTHYvh2mpnpXr4XKzPa4+2Tce5rRLCKNt3Xr3IAAweutW3tTn36moCAijffQQ8XKpTwFBRFpvKTR5xqVXj0FBRFpvCuvDPoQosbGgnKploKCiDTe1FTQqTwxAWbBozqZ69GNhHgiIh2bmlIQ6AbdKYiIyAwFBRERmaGgICIiMxQURERkhoKCiIjMUFAQEZEZCgoiIjJDQUFERGYoKIiIyAwFBRERmaGgICIiM2oPCmY2bGZfN7NbwtcfMbNHzGxvuK2L7LvFzA6Y2f1mdknddRMRkbm6kRDvCuA+4MciZX/i7n8Y3cnM1gDrgXOA04DPmdlLtU6ziEj31HqnYGZnAG8APp5j90uBG939eXd/EDgAnF9n/UREZK66m48+BnwQON5W/j4zu8fMrjOz5WHZ6cDDkX0Oh2UiItIltQUFM3sj8IS772l762rgJcC5wGPAH7UOiTmNx5x3o5ntNrPdR44cqbDGIiJS553CBcCbzOwgcCPw82a2090fd/dj7n4c+Atmm4gOA2dGjj8DeLT9pO6+3d0n3X1yxYoVNVZfRGTw1BYU3H2Lu5/h7qsJOpA/7+7vMLOVkd3eAtwbPr8ZWG9mJ5jZWcDZwF111U9ERObrxXKcv29m5xI0DR0ELgNw931mdhOwHzgKXK6RRyIi3dWVyWvu/gV3f2P4/J3u/pPu/gp3f5O7PxbZ70p3f4m7v8zd/7YbdRORhWF6GlavhqGh4HF6utc16k+a0SwimXp9QZ6eho0b4dAhcA8eN25UYKiDgoKIpJqehne9a+4F+V3v6u4FeetWeO65uWXPPReUS7XMfd6ozwVjcnLSd+/e3etqiPS1k06CZ5+dX750KTzzTHfqMDQUBKR2ZnC8fRaUZDKzPe4+Gfee7hREJFVcQEgrr8OqVcXKpTwFBRFpvCuvhLGxuWVjY0G5VEtBQURSWVyugZTyOkxNwfbtMDERfO7ERPB6aqp7dRgUCgoikuq97y1WXpepKTh4MOhDOHhQAaEuCgoifaDOIaPbtsGmTTA8HLweHg5eb9vW2Xl7PcxV4ikoiNRs82YYGQmaPUZGgtdVihvD/+53wymnVHfB3bYNjh4Nzn/0aDUBQfMOmklDUkVqtHkzXH31/PIqfmm3rF4dXFTTjI01qw0+qc4TE0HTkNQrbUiqgoJIjUZG4FhMBq/h4eAXdxWSxvC3a9IFV/MOekvzFER6JC4gpJWXkXes/kMPlf+MrCawov0DmnfQXAoKIjVqdc7mLS8jbgx/nLIX3FYTWCuQHTsWvG4FhjL9A5p30FwKCiI12rixWHmcrF/p7WP4x8dh0aK5+3Rywb3mmvTyMnmJNO+gwdx9wW7nnXeei3Ri0yb34WF3CB43bWrWZ2zaFBzXvmWdo8q/K+7zW5u7u1n8e2blP1PqBez2hOuqOpplYHVjZFCnynRUt5pzor/eOxl9lDZz2V0jiRYidTSLxNi+vVh5L5TpqO52mmn1D/SX2oOCmQ2b2dfN7Jbw9clmdoeZPRA+Lo/su8XMDpjZ/WZ2Sd11k8HWjZFBnSrTUZ00yqjs6KNNm9LLp6Zgw4a5M543bFD/wELVjTuFK4D7Iq8/BOxy97OBXeFrzGwNsB44B3g9sM3MKhyjITJXN0YGdapMR3XVwz2z0lxMT8OOHXNHJ+3YodnJC1WtQcHMzgDeAHw8UnwpsCN8vgN4c6T8Rnd/3t0fBA4A59dZPxlsVYwMqtsFFwT9ClEjI0F5krjmnNHRYP2Dsmkv0tJcaFW0/lL3ncLHgA8C0TmKp7r7YwDh44vD8tOBhyP7HQ7LRGpRV6K3Km3dOr9D+ejRYsM9x8eDxyefrCfPUNXNVdJbtQUFM3sj8IS778l7SEzZvKFRZrbRzHab2e4jR450VEeRqhO9Va3sBTeaZnrpUvjRj+a+X+Uvec1O7i913ilcALzJzA4CNwI/b2Y7gcfNbCVA+PhEuP9h4MzI8WcAj7af1N23u/uku0+uWLGixuqL9F4VF9y6f8nXNfrooouCO5zWdtFFnZ1P8qktKLj7Fnc/w91XE3Qgf97d3wHcDGwId9sAfCZ8fjOw3sxOMLOzgLOBu+qqn8hCUMUFt+5f8nXMTr7oIti1a27Zrl0KDN3Qi3kKVwEXm9kDwMXha9x9H3ATsB+4Dbjc3Rs0OFCk+6q44HZjHkHVq6K1B4Ss8kFS9/ocPU9V0cmmNBfSBDt3uk9MBGkdJiaC102zEOoYlZVaY1CVTXvSjpQ0F5rRLNKBhbKCWPsvedBSmAtRN2bhKyiIdKApY/SLrGdQRyA755y5ncLnnFP+XABr1xYrHxTdmIWvoCDSgV6M0V++fO4FeGys2EW+TCBLa8c+5xzYv3/u/vv3dxYYPve5+QFg7dqgfJB1Yxa+goJIB7o9Rn/5cnj66bllP/hBsYt80nrOSeVZi+y0B4SWpPK8Pve5uS3ngx4QoDuz8BUURDrQ7Qyh7QEhTdLdStFfmwshm+yg6MYsfAUFkQ40eQWxpLuVou3SCyGb7CCpexa+goJIH0q7W5mYKFa+ELLJSnUUFEQ60O0hqcuWxZcvXpz/bmXdumLlCyGbrFRHQUEkRdZQz24PSX3qqfmBYdmy4DPzzii+9dZi5Vnt2LqT6C8KCiIJ8twF9GJI6lNPzR2V89RTxVIflKlzWjt2VXcStadvkHySpjovhE1pLqROExPxKQUmJmb3GR+P32d8vL56taesWLu2WOqDPH9XUe11WLu22PFVpW+QfFCaC5Himrh4TNzdS1KSuKuvjm/2qnoY7fQ0fPnLc8u+/OX5TW1pTXEa9togSdFiIWy6U5A65flFbRa/j1l19YjeGQwPx39e1jY2NjcJXpUJ8pK+p/Hx2c8YH3dftCi5TkqA113oTkGkuDy/qJPmAgwNVZNsrv3OoOzcgOeegw0bZusE6R3TRRa4SbpzevLJ2Xo/+WT66m/qrG4OBQWRBHkmpsUFDggu3q3mnU6GqMaNbiorb52KLnDTSUqPVkDRsNfmsOBOYmGanJz03bt397oaMuCmp4OL90MPBb/E437NT0zMpqwuYmgouJDXIalOFrdaeiiuLq27mTLBK1qHzZuDoHvsWHCHsHFj89bM7hdmtsfdJ+Pe052CSIeiaxUcPx6/T1rndNpQzLoS60Fwx1BFE9fUVNA0FZ3HsGRJ9nHtTXF1p2+QfGoLCmZ2opndZWZ3m9k+M/toWP4RM3vEzPaG27rIMVvM7ICZ3W9ml9RVN5G6JF0Mk8qzMpD++I9XX8eoKpq4pqfh4x+f+zf88IcwOjp3v9FRGB9vXo4oaZPUA93pBhiwNHw+CnwFeA3wEeADMfuvAe4GTgDOAr4FDKd9hkYfSRNER/IUHUWTNJpoeDj9/eh22mnBSJ4yo5LiRlUlzXtImnuQNFdjyZKFtQToIKEXo4/Cz342fDkabmmto5cCN7r78+7+IHAAOL+u+olUoX10UFFZGUjTRhu1Lr+PPDK3QzxtJE9af0GriavoAjdPPhlf/v3v50+9Ic1Ra5+CmQ2b2V7gCeAOd/9K+Nb7zOweM7vOzJaHZacDD0cOPxyWiXRN0VQLnY4OyhqKWWao5rJlsGjR3LKxMdixI7hAJ2VDjfZfaIGbwVVrUHD3Y+5+LnAGcL6ZvRy4GngJcC7wGPBH4e5xv2Hm/fYys41mttvMdh85cqSWestgymrfj5O0Wlm7pUvjyy+8ML08aUjmsWOzcwiWL597t/Lkk8FjtP1+w4YggA0NwbPPxgeNsjOak/62pHJptq6MPnL3p4EvAK9398fDYHEc+Atmm4gOA2dGDjsDeDTmXNvdfdLdJ1esWFFvxWWglEm1kGdy1cgIXHNN/Ht796aXt2cojfP00/PvVl54IbgoHz8eXOx37EgPGp10+p5wQrFyabY6Rx+tMLNl4fPFwEXAN81sZWS3twD3hs9vBtab2QlmdhZwNnBXXfUTaVdmhbG091oX3OuvT77gJrXHR8ujQzWLaPURxDVxvfDCbHA4fBi+9KVi5476zneKlUuz1XmnsBK408zuAb5K0KdwC/D7ZvaNsPzngN8EcPd9wE3AfuA24HJ314J/0jVpv8aT0j0UXa2sm1p9BFkJ/PI0k6UpOgxXmk0zmmWgRWcjj40FI2ayREfi5JnNOzaW3DxTdPZw2v5Jn7l6db6+j+Hh4I6kqKJ/g/SeZjRLLbJWJWt6HdqHk37/+7OJ7NJE8wK150eKu0OociW2006LL1+2LDlHU1J+pnZlk+1Jn0mawLAQNk1e652dO+dPmGpPz9z0OmSlxi6TzrloKu2in1F2MZo8E+xaE+aKUtrrhYeUyWtqPpJSkpokyiZ+60UdkpLNmQWjdso0ixStU9HPGBmJ/0VfpOmnNfS2XXTd5SJOOikY5tpu6VJ45pni55P6ddx8FI4k+h0z2x5OOLvOzK6rtpqykDRhVbJO65CUbK5V3j6rt6W9PNqE9eyz83P+dDIHoF2ZEVLtLrhgfhPZ0FBQXsY118SfL2kYrjRb3j6FzwAvAj4H/E1kkwGVdUFdCHXIWkQnT7qH9n6J1jDP1h3A8HAwcSxpSGrSnUJSeRWL0WzdOj+b6/HjnfV7tH9+E0ZfSUlJ7UrRDdibZ79ub+pT6J1+6FNonaOTpG1J/RJ569StPoWoqpcQzbNsqTQLKX0KeYPCfwLW5dm3m5uCQm9t2jSbxXN4uNiFqSpVrjVcRlZm1KwLZJkLaqffe9UX8W6sUy3VSgsKeZuPrgBuMbMfmtkz4fa9Wm5dZEGYng5SJ0TzBO3Y0ZthqWnqHjabt6kqqZ8jzzrQ7TpdjGbdumLlWZKGu+YZBisNlBQtFsKmO4XeaUKTQVbz0c6d89cjGB6u9m5i5073RYuy7xSGh5PvZrp9x1X1f7u8TWC9vquTWXTafBScgzcBfxhub8x7XJ2bgkLv1NFkUPSikXVxW7Ik/v0lS/LXqX3BmfaFZnbudB8dzQ4KaYGraL9I++eNjub/e9yr/2+XJyjs3Dn/c80UGHql46AAXAXsAn413O4ArspzbJ2bgkLvVP1rs8zFMevilvcXbJI8K5AlfQ+tO4OkldNa31PR7zEpABUJDL24U0i6m1q0qNxnSmeqCAr3AEOR18PAPXmOrXNTUOidqkcfZV1c4+4c6piRHJXn+E4DU9E6dvo3ucc3eS1aVP6/XZ47jyrqLdVJCwpFch8tizx/UelODOkL7Tl/Os3Jn9QRe+xYcOmIW1y+TCdt1bLmSlQxr6AOwW+75NdFvPe9xcql4ZKiRXQD3g4cAq4HdgAPAuvzHFvnpjuF/pFnvH9cE0daP0Q37hSy7ph6daeQ1nldxyCBrM5y3Sk0CxV1NK8k6Gy+FPhneY+rc1NQ6B87d7oPDeULDHlH6oyPxx8/Pj73c5OCSp4+haxzVN3EladPIWuCWy/mFeT9LqU7SgcF4CfCx1fFbWnHdmNTUOgfSReyPFtSYMgKCnna1rNGH2Xp9E4iTtboo6TgOjSU73upS6ffpVSnk6CwPXy8M2b7fNqx3dgUFHqrynHnSaN08t45xMm64NZ1cWz/XjZtqq+JK07Zv9tMcwgGRSXNR0U34ESCNZbvBvYBHw3LTyYY0vpA+Lg8cswW4ABwP3BJ1mcoKPRO1aOPygaEtAtoUqBpBZE6LshFv5deBIU8qTm6ncdKuistKORaT8HM3grc5u7PmNm/C5uP/qO7fz3lGAOWuPuzZjYKfJEgXcYvAt9x96vM7ENhUPhtM1sDfAo4HziNICPrSz1lnWatp9A7Va+nkLROQB5JawlkrVVQxzKSda+nkMfSpfHLii5ZEqT2zrs8ZzfXxpDuqmI5zn8fBoSfBi4hGIGUmi09DEitpTdGw80JOqp3hOU7gDeHzy8FbnT35939QYI7hvNz1k+6LOmikudiE2fjxvJ1STp2fDy9POv9MpKG1h46VF3+pc2bgyBqFjxu3jz3/WuvjV/f4Nprg+d5cxx1c20MaY68QaH1G+4NwNXu/hlgUdZBZjZsZnuBJ4A73P0rwKnu/hhA+PjicPfTgYcjhx8Oy6SBqh5/H7fwS5ylS2c/Y3i4/GphAH/6p/MXxBkdDcqLiCbdS/sb3IPg8O53zwaGousptFZNiyYivPrquYFhagpuuGHuHJIbbpidQ3Lrrfn+rm6ujSENktSuFN2AW4BrgW8RTGI7Abg7z7Hh8csIOqdfDjzd9t5T4eOfA++IlH8C+KWYc20EdgO7V61aVV0jmxSSpy28SEd03nkKkP+cVdcxTlwfQp4tOgIq7v2kemT1k6TVM2uN5k76FJTsbmGhgjQXYwR9AWeHr1cCr8tzbOQcHwY+QNCJvDJynvvD51uALZH9bwdem3ZOdTT3Tp7hnlV1uJa9eFXRibt48dzjFi+e+35Weo6sOuzc6T4yMrd8ZKTavylv4Co7+iguKeDoqAJDk6UFhbwdzS8BDrv782Z2IfAK4AZ3fzrlmBXAC+7+tJktBj4L/BfgZ4Enfbaj+WR3/6CZnQP8d2Y7mneFQUgdzQ2UtYB8lR2uWarsxN28OUjXkdbpvXgxPPdc8HxoKP5cZsESl1l1OOWUYAnPduPj8O1vx5837Xxx8nYsDw2V6+wv+jdI71XR0fxp4JiZ/ThBs85ZBBfwNCuBO83sHuCrBH0KtxBkXL3YzB4ALg5f4+77gJuA/cBtwOVpAaHfVb04TFbnZFFZC8gndVLW0XlZtnO7XXt7fZIf/GD2eafrRMddTNPKy8j7nbev25xXN/4G6aKkW4joBnwtfPwg8Ovh86/nObbOrV+bj6qeA1DFur7tspoxiubXKdt81Gr2KFPHdkUm0LVk/bfKamYrWscyzUd5+2uy+iWSlKmT9BYV9Cl8hSAp3r3AWWHZvXmOrXPr16BQdcKysp2TabIuBEUDW57Vy+q+gJb9vLRO1qz29m4Ehbx9CmV/JPQqbYaUlxYU8jYfvRt4LXCluz9oZmcBO6u7X5Goqptespp6yli8OL28aGrt97ynfF2qkmdILCT/7XGmpuCTn5z7PXzyk7PfQ9JnJpVv2lSsvFWHDRvmDuVds6baob2L2gaoL1pUfGivNERStFgIW7/eKVT9yysrQVoZVTcZFBmSmvczi36PSct3tv/Kj+q0qa9M017RNZ2rbo5M+gwNSV046CAh3k3h4zcIVl9rbd9AK6/VpuqgUMVaxe2qDgp5x88X+cyiQyXL5AQqs2Jcex3bm/eGh6u9qNaxfoIsbJ0EhdZ8gom4Le3Ybmz9GhSqzndfR/78qoNCUiDsJCi41zOBLnox7TS5XJkLdtFf5b1YP0GaLS0opLai+mw6ikPufgh4CngmskkNOh3mWPf5FpKpqWAOw/HjwWPacqFxy3vGifbt5PkOn3sOtm7NPlee8unpINfToUPBpT1umdJ23fjvX/UQaumhpGgR3YDLgMeBgwRLcT4I/FOeY+vc+vVOoeqF1fO0KRf99dm05qPWtmZNuc9viX4PSaO2or/ii6S5iFP0TqHsnUWdfQrd6LOQalHBkNQHgFPy7NvNrZ+DQtVpA7KGTRb9R111U06nzUdVBYZoJ+7Q0PxO+rjvJU9eoaThv0W/+7JNQXV2BKvPYuGpIijcBozl2bebW78GhW7/IyvzeUWDQtbFr9N5CnkDU5qkkUBLltR7B1VFv0cvL8Dqs1h40oJC3txHrwQ+STCJ7flI09NvVNaOVUK/5j7KyqfThM/Lk4NnejpoS3/ooeS8Oq28RZ3kPkqrQxHDw/F/b5GcQFkL3HSqlYqjXSfzDDpV9YJLUr8qch9dC3we+EdgT2STGiR1dubpBC2jjo7I9g7RpItqVXmLqpAUAIsE4laivLzlRSWthZB3jYQ6xHXQj40F5bLw5A0KR939t9z9k+6+o7XVWrMBFk24lqe8U3X8o966Nd+FsOyiPGnWrKn+nHkl3aGk3bkUGbnTzUSDeRWdvS7NNpJzvzvNbCPwv5nbfPSdWmo14Kr4xVpE6x9vq6ln1aogIHTyjzrvRaqTVBtx1qyBffvKHbtkSXLTT12mp4OV2F54IXjdWpkN4r//Vavi7656Pbx4akpBoF/kvVP4NwSL4PwDs01H/deY38eyfo0WGc+fR96L1MREZ5/T0urebA8IRX6FX3vt/DuX4eHZtY3zaM8BlFV+xRWzAaHlhReC8jhqqpHaJfVAL4StX0cfVT2qZufO+UMrh4Y6G5aYVcekkTzRLTr3oo7RRmWG2nY6dLNoipK6Ryt1SxPrJMnoIM3FByPP39r23u+lHduNTUEh2dq12RfSOnMf5UkZkTeFdJ4t7mLUi+GbRYdnVv0DoBc0eW3hSQsKWc1H6yPPt7S99/qKblakzfh4sfJ2F10Eu3Zl7xfXfl6VPH0KL7wQpHTOm7I6jXvQ1v4rvzLbRNSLTtmiI7k6/W/dBHGDCtJSe0izZf1ztITnca/nvml2ppndaWb3mdk+M7siLP+ImT1iZnvDbV3kmC1mdsDM7jezSwr9JX2k0/z0eQJC3U4+Od9+x44FF/SqHD8Ol10WPO9Fzqeibf79sBZBE0dESQeSbiGCO4xgGc7253GvY45dCbwqfH4S8H+BNcBHgA/E7L8GuBs4gWAN6G8Bw2mf0a/NR+6dtdHmbXKJrqdQde6jKtNWlNlaf1MvmjWKfpcLvT2+ibOsJR0d9CkcA75HkBH1aPi89fqFtGNjzvUZ4OKUoLAF2BJ5fTvw2rRz9nNQ6ETeC2drcZY6ch9VleCuk6DQ+tsW8gV3IVCfwsKTFhSyUmcPu/uPuftJ7j4SPm+9Hs17N2Jmq4FXEqTJAHifmd1jZteZ2fKw7HTg4chhh8OygbR5M4yMBJOBRkaC11VpX36xjjbhpOajoaHgb6pj0lqcqofaLhTdTGWtyWt9JilaVLUBSwnmNfxi+PpUYJigP+NK4Lqw/M+Bd0SO+wTwSzHn20gwR2L3qlWr6giiPVdmicaoPL+go8okNCvbfNQamrlmTXfuFAaRfrlLFjpNiFeWmY0CtwC3u/sfx7y/GrjF3V9uZlvCIPWfw/duBz7i7l9OOn+/JsQbGYmf6Ts8DEePZh+fJ1ldVJmEZlmfkZVkr+oEeHF1GFRKUCdZqkiIV+ZDjeDX/n3RgGBmKyO7vQW4N3x+M7DezE4ws7OAs4G76qpfkyWlfqg6JURLHbNkk5qP8o5KkvI0Gkg6kTf3URkXAO8EvmFme8Oy3wHebmbnAk6wkttlAO6+z8xuAvYTdGpf7u41XQYlqo7cR9I7Tc2PJAtDrc1HdevX5qOizT9VH5/H4sXwwx/OLz/xxCCbay+bjwa9maSVtjw6eGBsTJ2/MqsnzUfSO0mpo9NSShcd7dTK5JlUnjVxrK7RR0oOp9FA0hkFhRp0czhgnPvuiy/fvz/+ot9azavVZ3HsWPA6LTDcdFN6+bp18e+3yqvsH1m6VBe/doM6FFc6p+ajilVx657WtGKW3eaft2mmNVehzGinrCaqrBEwJ51UzfKUkH9UlogE0pqPFBQqVsVwwDwX9bRAkzcotC6mZfogOh2SmvR+WQv4f2ORrlOfQhd1azhgFVko6xriCtl9ClVexLs1O1pkECgoVKybmTmbPO48a+5DlRfyjRurO5fIoFNQqFhWB2uVmjzuPGsEzIUXlj93K6C053ASkc7VOXltIN16a7HysqocemmW3P7fibTF3A8cKHfOJUuq66AWkfl0p1CxuE7mtPKi6hh6+d73FiuvQtmmr9e8ptp6iMhculOo2PBw8vDOKhw/Xs15olrNL9u3B3UfHg7a6etslklKxZDlC1+ovCoiEqE7hYrlSWZX51oJZW3bFgxPdQ8e626nj+uIzqPOEVMioqBQuaRF6FvlZWYPN9HSpcXK27V3ROel4aci9VJQqFhS806rfPv2+PeTyrulaGqOV7+6WHmcaCqG007Ld4yGn4rUS30KXdbttRLyaE/NcejQ7MU3qTM7qW2/bJv/aMbirt3o5xARpbmoXFb6hzx5hupMnR13vjpWXiuqG+m+RSSgNBcNkjRpq5PJXGUtWxY8lknNkdS2X7bNv+rziUg5CgpdtndvsfI6Pf108FgmNUdS237ZNv8mNquJDKI612g+08zuNLP7zGyfmV0Rlp9sZneY2QPh4/LIMVvM7ICZ3W9ml9RVt1568sli5d1QZo3mbduCFBNVpZyYmChWLiL1qPNO4Sjwb939XwCvAS43szXAh4Bd7n42sCt8TfjeeuAc4PXANjNT40EJrWahvMqu1FXl3IZu5owSkWS1jT5y98eAx8Lnz5jZfcDpwKXAheFuO4AvAL8dlt/o7s8DD5rZAeB84Mt11bFftZqFikjLU9QN3coZJSLputKnYGargVcCXwFODQNGK3C8ONztdODhyGGHw7LGi47xl3K6tQ6FiKSr/TJmZkuBTwPvd/fvpe0aUzZvMKKZbTSz3Wa2+8iRI1VVs7TWGP9Dh7ozdLJX6z7XrZvrUIhIslqDgpmNEgSEaXf/q7D4cTNbGb6/EngiLD8MnBk5/Azg0fZzuvt2d59098kVK1bUV/kU0dxF73jH3PWY6+Y+O7msnwJDmc5uEalenaOPDPgEcJ+7/3HkrZuBDeHzDcBnIuXrzewEMzsLOBu4q676ldWeu6hXqliOs0nKdnaLSLXqTHNxAfBO4Btmtjcs+x3gKuAmM3sP8BDwVgB332dmNwH7CUYuXe7ujRulfs01nR1fZWrtpPb2JUvg+9/PPr7TRXREpP/UOfroi8T3EwCsTTjmSqDRDQad9htUOUkrqb39Na+BXbuyjz/55OKfWZcy+ZdEpHoaL7NApbW3f/7z+c7Rywlz7bZund83029NZCILgYLCApOnvT3v3UyThtBqSKpIMyh19gJT5XKcdSztWVbS8pwakirSXQ36rShVybv6WZNoSKpIMygo9KFrrgnmUWQZH6+/LnlpSKpIMygo9KGpKbj++tkL7JIl8fu97W1drVamL30JDh8O+kQOHw5ei0h3KSj0qej6x0luuKFr1cnUPinw2LHg9ebNva2XyKBRUBgASRPZ8kxw65bt24uVi0g9FBQa6MQTi5X3A628JtIMCgoFddo5m9S+Hy1/97vj90kqz5KUzqJJaS60RrNIMygoFFR2FvBppwWPee4Cql5wJmmSWpMmr1W95rOIlKPJawWZlct/NDoaPOZZozluEldaeZaF0DTTWspz+/agXsPDQUDoZIlPESnOvBsrw9RkcnLSd+/e3dXPLNvkYhaMBBoejh8RNDQ0e5FO+4wy/7mqPp+ILGxmtsfdJ+Pea1ADQnNEl9esapWzVkbSpCGidaacWAjNRyLSDLostGlfXrMfVjm77LJi5SIyuBQU2mSlcC47+ug73+msXp3Ytg02bZodyTM8HLxWe72ItFNQaJOVwrlsaoheZ/vctg2OHg3ufo4eVUAQkXh1rtF8nZk9YWb3Rso+YmaPmNnecFsXeW+LmR0ws/vN7JK66gXpfQZJF+9WeZlhoaOjs9k+87Tv55nLICJShzrvFK4HXh9T/ifufm643QpgZmuA9cA54THbzKyWaUtZfQZZKZzLLPoSHf2Tp6P52mvnB4+hoaBcRKROtQUFd/97IG9L+qXAje7+vLs/CBwAzq+jXll9BlkpnJPuJIaHg/3jZuD+6Eez55+YiD8+Wj41FSSri9bhhhuURlpE6teLPoX3mdk9YfPS8rDsdODhyD6Hw7LKdbrsY9KdxI4dwa/9pDuB1vnzLiYTzXJ68KACgoh0R7eDwtXAS4BzgceAPwrL46ZXxU6rMrONZrbbzHYfOXKkcAVa8wWSyrOal+LuJDZsCO4EhoaS+wxadxh5F5OpY66EiEgmd69tA1YD92a9B2wBtkTeux14bdb5zzvvPC9qfNw9uNzP3cbHg/cnJuLfHx52Nwve37lz9nw7d7qPjcUf09rGxuYekyXunGXOMTERX2cRGWzAbk+6bie9UcXWHhSAlZHnv0nQjwBBB/PdwAnAWcA/AcNZ5y8TFMziL9xm6e8nXaCLBpE8ks45MZHv+CqCioj0r7SgUFvuIzP7FHAhcArwOPDh8PW5BE1DB4HL3P2xcP+twK8CR4H3u/vfZn1GmdxHq1fHJ5abmAja7pPeT9p/aCg+f1Ar11EZnZ4z629QsjmRwdaT3Efu/nZ3X+nuo+5+hrt/wt3f6e4/6e6vcPc3tQJCuP+V7v4Sd39ZnoBQVlZH77p184+J0+o4zprXUEZWv0eWrE5zLXUpIkkGbkZzVkdv3slprYt+UhDJG1zqkDcgaalLEWk3cEEB0od75hmaGr2zqHpBHEjOk5Q3f1Lc3VCcJq2nICLNMJBBIU3W5LT2O4tO5z0UqUPeO4D2u6EkWupSRNopKLTJmpzWfmdR5gKeNQch7wS3NNG7obVr4/e58ML85xORwaCg0Cbv5LKWohfwPOs1FK1DlgMHipWLyOBSUIhRJMVE0Qt4Vu6lOtTRxCUi/UlBoYT25h/IH0TyXKCrXv2tjmGzItKfFBQK6vSCnecCXfXdRBV9FCIyGBQUCur0gp3nAl11c0/VfRQi0r8UFArq9IKd5wJdR3OPUnGLSB4KCgVVccHOukCruUdEekVBoaBuXLDV3CMivTLS6wosNK0L89atQZPRqlVBQKj6gj01pSAgIt2noFCCLtgi0q/UfFQBLZ0pIv1Cdwodas1baA1Tbc1bAN1NiMjCozuFDvUibYWISF1qCwpmdp2ZPWFm90bKTjazO8zsgfBxeeS9LWZ2wMzuN7NL6qpX1ZRXSET6SZ13CtcDr28r+xCwy93PBnaFrzGzNcB64JzwmG1mtiCy/SuvkIj0kzrXaP57oH2tsEuBHeHzHcCbI+U3uvvz7v4gcAA4v666VUkTzUSkn3S7T+FUd38MIHx8cVh+OvBwZL/DYVnjaaKZiPSTpow+ils00mN3NNsIbARY1ZA2Gs1bEJF+0e07hcfNbCVA+PhEWH4YODOy3xnAo3EncPft7j7p7pMrVqyotbIiIoOm20HhZmBD+HwD8JlI+XozO8HMzgLOBu7qct1ERAZebc1HZvYp4ELgFDM7DHwYuAq4yczeAzwEvBXA3feZ2U3AfuAocLm7H6urbiIiEq+2oODub094a23C/lcCGrMjItJDmtEsIiIzzD12kM+CYGZHgEMdnOIU4NsVVacuqmM1VMdqqI7V6HUdJ9w9dqTOgg4KnTKz3e4+2et6pFEdq6E6VkN1rEaT66jmIxERmaGgICIiMwY9KGzvdQVyUB2roTpWQ3WsRmPrONB9CiIiMteg3ymIiEjEwAWFuMV/msbMzjSzO83sPjPbZ2ZX9LpO7czsRDO7y8zuDuv40V7XKYmZDZvZ183sll7XJYmZHTSzb5jZXjPb3ev6xDGzZWb2l2b2zfD/zdf2uk5RZvay8Ptrbd8zs/f3ul7tzOw3w38z95rZp8zsxF7XKWrgmo/M7GeAZ4Eb3P3lva5PnDBZ4Ep3/5qZnQTsAd7s7vt7XLUZZmbAEnd/1sxGgS8CV7j7P/a4avOY2W8Bk8CPufsbe12fOGZ2EJh098aOrzezHcD/cfePm9kiYMzdn+5xtWKFi3Q9Arza3TuZy1QpMzud4N/KGnf/QZje51Z3v763NZs1cHcKCYv/NIq7P+buXwufPwPcR8PWl/DAs+HL0XBr3C8MMzsDeAPw8V7XZSEzsx8Dfgb4BIC7/6ipASG0FvhWkwJCxAiw2MxGgDESMkL3ysAFhYXGzFYDrwS+0uOqzBM2y+wlSIF+h7s3ro7Ax4APAsd7XI8sDnzWzPaEa4Y0zT8HjgCfDJviPm5mS3pdqRTrgU/1uhLt3P0R4A8JEoI+BnzX3T/b21rNpaDQYGa2FPg08H53/16v69PO3Y+5+7kE61+cb2aNao4zszcCT7j7nl7XJYcL3P1VwC8Al4fNnE0yArwKuNrdXwl8n3CN9aYJm7beBPzPXtelnZktJ1h++CzgNGCJmb2jt7WaS0GhocJ2+k8D0+7+V72uT5qwGeELwOt7W5N5LgDeFLbX3wj8vJnt7G2V4rn7o+HjE8Bf07w1yg8DhyN3g39JECSa6BeAr7n7472uSIyLgAfd/Yi7vwD8FfCvelynORQUGijsxP0EcJ+7/3Gv6xPHzFaY2bLw+WKC/9m/2dNKtXH3Le5+hruvJmhO+Ly7N+pXGYCZLQkHFBA2ybwOaNToOHf/f8DDZvaysGgtwfonTfR2Gth0FHoIeI2ZjYX/ztcS9Bk2xsAFhXDxny8DLzOzw+GCP01zAfBOgl+2reF163pdqTYrgTvN7B7gqwR9Co0d8tlwpwJfNLO7CVYc/Bt3v63HdYrz68B0+N/8XOD3elud+cxsDLiY4Bd444R3Wn8JfA34BsE1uFGzmwduSKqIiCQbuDsFERFJpqAgIiIzFBRERGSGgoKIiMxQUBARkRkKCjIwzOxYWxbN0jNyzewfqqxb27knzezP6jq/SBoNSZWBYWbPuvvSXtdDpMl0pyADL1zL4KNm9rVwTYOfCMtXmNkdYfm1ZnbIzE4J33s2fLzQzL4QWWdgOpypipmdZ2Z/Fya5uz1Mid7+2W8N8+rfbWZ/HznnLeHzWyN3Nt81sw1hIsI/MLOvmtk9ZnZZt74r6X8KCjJIFrc1H/3ryHvfDhPSXQ18ICz7MEFqjFcR5CNalXDeVwLvB9YQZBO9IMxd9V+BX3b384DrgCtjjv1d4BJ3/5cESdzmcPd1YdLB9wCHgP8VPv+uu/8U8FPAr5nZWTm/A5FUI72ugEgX/SC8wMZppUXYA/xi+PyngbcAuPttZvZUwrF3ufthgDCV+GrgaeDlwB3hjcMwQarkdl8Crg8XW4lNzRDenfw34G3u/l0zex3wCjP75XCXFwFnAw8m1E8kNwUFkcDz4eMxZv9dWMFjo8cbsM/dU5esdPf3mtmrCRYC2mtm50bfD1cQuxH4D+7eSpJnwK+7++056yeSm5qPRJJ9EXgbQPjrfHmBY+8HVli4jrGZjZrZOe07mdlL3P0r7v67wLeBM9t2uQq4x91vjJTdDmwKm6gws5c2fMEbWUB0pyCDZHHYvNNym7unDUv9KPCpsO/h7wiaf57J80Hu/qOweefPzOxFBP/WPgbsa9v1D8zsbIJf/7uAu4Gfjbz/AWBfpN6/S7C06Grga2Gn9hHgzXnqJZJFQ1JFEpjZCcAxdz8a/uK/OqVPQqQv6E5BJNkq4CYzGwJ+BPxaj+sjUjvdKYiIyAx1NIuIyAwFBRERmaGgICIiMxQURERkhoKCiIjMUFAQEZEZ/x9dlq2jHZSa3gAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.scatter(train.ENGINESIZE, train.CO2EMISSIONS,  color='blue')\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"multiple_regression_model\">Multiple Regression Model</h2>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In reality, there are multiple variables that impact the co2emission. When more than one independent variable is present, the process is called multiple linear regression. An example of multiple linear regression is predicting co2emission using the features FUELCONSUMPTION_COMB, EngineSize and Cylinders of cars. The good thing here is that multiple linear regression model is the extension of the simple linear regression model.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Coefficients:  [[10.84686321  7.9458323   9.30255208]]\n"
     ]
    }
   ],
   "source": [
    "from sklearn import linear_model\n",
    "regr = linear_model.LinearRegression()\n",
    "x = np.asanyarray(train[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB']])\n",
    "y = np.asanyarray(train[['CO2EMISSIONS']])\n",
    "regr.fit (x, y)\n",
    "# The coefficients\n",
    "print ('Coefficients: ', regr.coef_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As mentioned before, **Coefficient** and **Intercept**  are the parameters of the fitted line.\n",
    "Given that it is a multiple linear regression model with 3 parameters and that the parameters are the intercept and coefficients of the hyperplane, sklearn can estimate them from our data. Scikit-learn uses plain Ordinary Least Squares method to solve this problem.\n",
    "\n",
    "#### Ordinary Least Squares (OLS)\n",
    "\n",
    "OLS is a method for estimating the unknown parameters in a linear regression model. OLS chooses the parameters of a linear function of a set of explanatory variables by minimizing the sum of the squares of the differences between the target dependent variable and those predicted by the linear function. In other words, it tries to minimizes the sum of squared errors (SSE) or mean squared error (MSE) between the target variable (y) and our predicted output ($\\hat{y}$) over all samples in the dataset.\n",
    "\n",
    "OLS can find the best parameters using of the following methods:\n",
    "\n",
    "*   Solving the model parameters analytically using closed-form equations\n",
    "*   Using an optimization algorithm (Gradient Descent, Stochastic Gradient Descent, Newton’s Method, etc.)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h2 id=\"prediction\">Prediction</h2>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Residual sum of squares: 555.50\n",
      "Variance score: 0.86\n"
     ]
    }
   ],
   "source": [
    "y_hat= regr.predict(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB']])\n",
    "x = np.asanyarray(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB']])\n",
    "y = np.asanyarray(test[['CO2EMISSIONS']])\n",
    "print(\"Residual sum of squares: %.2f\"\n",
    "      % np.mean((y_hat - y) ** 2))\n",
    "\n",
    "# Explained variance score: 1 is perfect prediction\n",
    "print('Variance score: %.2f' % regr.score(x, y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Explained variance regression score:**\\\n",
    "Let $\\hat{y}$ be the estimated target output, y the corresponding (correct) target output, and Var be the Variance (the square of the standard deviation). Then the explained variance is estimated as follows:\n",
    "\n",
    "$\\texttt{explainedVariance}(y, \\hat{y}) = 1 - \\frac{Var{ y - \\hat{y}}}{Var{y}}$\\\n",
    "The best possible score is 1.0, the lower values are worse.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h2 id=\"practice\">Practice</h2>\n",
    "Try to use a multiple linear regression with the same dataset, but this time use FUELCONSUMPTION_CITY and FUELCONSUMPTION_HWY instead of FUELCONSUMPTION_COMB. Does it result in better accuracy?\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Coefficients:  [[10.85558031  7.92117516  5.16356889  4.12549379]]\n",
      "Residual sum of squares: 555.84\n",
      "Variance score: 0.86\n"
     ]
    }
   ],
   "source": [
    "# write your code here\n",
    "\n",
    "from sklearn import linear_model\n",
    "regr = linear_model.LinearRegression()\n",
    "x = np.asanyarray(train[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y = np.asanyarray(train[['CO2EMISSIONS']])\n",
    "regr.fit (x, y)\n",
    "# The coefficients\n",
    "print ('Coefficients: ', regr.coef_)\n",
    "\n",
    "y_= regr.predict(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "x = np.asanyarray(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y = np.asanyarray(test[['CO2EMISSIONS']])\n",
    "print(\"Residual sum of squares: %.2f\"% np.mean((y_ - y) ** 2))\n",
    "print('Variance score: %.2f' % regr.score(x, y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<details><summary>Click here for the solution</summary>\n",
    "\n",
    "```python\n",
    "regr = linear_model.LinearRegression()\n",
    "x = np.asanyarray(train[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y = np.asanyarray(train[['CO2EMISSIONS']])\n",
    "regr.fit (x, y)\n",
    "print ('Coefficients: ', regr.coef_)\n",
    "y_= regr.predict(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "x = np.asanyarray(test[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_CITY','FUELCONSUMPTION_HWY']])\n",
    "y = np.asanyarray(test[['CO2EMISSIONS']])\n",
    "print(\"Residual sum of squares: %.2f\"% np.mean((y_ - y) ** 2))\n",
    "print('Variance score: %.2f' % regr.score(x, y))\n",
    "\n",
    "```\n",
    "\n",
    "</details>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2>Want to learn more?</h2>\n",
    "\n",
    "IBM SPSS Modeler is a comprehensive analytics platform that has many machine learning algorithms. It has been designed to bring predictive intelligence to decisions made by individuals, by groups, by systems – by your enterprise as a whole. A free trial is available through this course, available here: <a href=\"https://www.ibm.com/analytics/spss-statistics-software?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01\">SPSS Modeler</a>\n",
    "\n",
    "Also, you can use Watson Studio to run these notebooks faster with bigger datasets. Watson Studio is IBM's leading cloud solution for data scientists, built by data scientists. With Jupyter notebooks, RStudio, Apache Spark and popular libraries pre-packaged in the cloud, Watson Studio enables data scientists to collaborate on their projects without having to install anything. Join the fast-growing community of Watson Studio users today with a free account at <a href=\"https://www.ibm.com/cloud/watson-studio?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01\">Watson Studio</a>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Thank you for completing this lab!\n",
    "\n",
    "## Author\n",
    "\n",
    "Saeed Aghabozorgi\n",
    "\n",
    "### Other Contributors\n",
    "\n",
    "<a href=\"https://www.linkedin.com/in/joseph-s-50398b136/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDeveloperSkillsNetworkML0101ENSkillsNetwork20718538-2021-01-01\" target=\"_blank\">Joseph Santarcangelo</a>\n",
    "\n",
    "## Change Log\n",
    "\n",
    "| Date (YYYY-MM-DD) | Version | Changed By | Change Description                 |\n",
    "| ----------------- | ------- | ---------- | ---------------------------------- |\n",
    "| 2020-11-03        | 2.1     | Lakshmi    | Made changes in URL                |\n",
    "| 2020-08-27        | 2.0     | Lavanya    | Moved lab to course repo in GitLab |\n",
    "|                   |         |            |                                    |\n",
    "|                   |         |            |                                    |\n",
    "\n",
    "## <h3 align=\"center\"> © IBM Corporation 2020. All rights reserved. <h3/>\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.7"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}