02-Discrete-Bayes.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[Table of Contents](http://nbviewer.ipython.org/github/rlabbe/Kalman-and-Bayesian-Filters-in-Python/blob/master/table_of_contents.ipynb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Discrete Bayes Filter"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>\n",
       "@import url('http://fonts.googleapis.com/css?family=Source+Code+Pro');\n",
       "@import url('http://fonts.googleapis.com/css?family=Lora');\n",
       "\n",
       ".CodeMirror pre {\n",
       "    font-family: 'Source Code Pro', Consolas, monocco, monospace;\n",
       "}\n",
       "    div.cell{\n",
       "        //width: 950px;\n",
       "        margin-left: 0% !important;\n",
       "        margin-right: auto;\n",
       "    }\n",
       "    div.text_cell_render{\n",
       "        font-family: 'Lora';\n",
       "        line-height: 125%;\n",
       "        font-size: 100%;\n",
       "        text-align: justify;\n",
       "        text-justify:inter-word;\n",
       "    }\n",
       "    div.text_cell code {\n",
       "        background: transparent;\n",
       "        color: #000000;\n",
       "        font-weight: 400;\n",
       "        font-size: 11pt;\n",
       "        font-family:  'Source Code Pro', Consolas, monocco, monospace;\n",
       "   }\n",
       "    h1 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "\t}\n",
       "\n",
       "    div.input_area {\n",
       "        background: #F6F6F9;\n",
       "        border: 1px solid #586e75;\n",
       "    }\n",
       "\n",
       "    .text_cell_render h1 {\n",
       "        font-weight: 200;\n",
       "        font-size: 30pt;\n",
       "        line-height: 100%;\n",
       "        color:#c76c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 1em;\n",
       "        display: block;\n",
       "        white-space: wrap;\n",
       "        text-align: left;\n",
       "    }\n",
       "    h2 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "        text-align: left;\n",
       "    }\n",
       "    .text_cell_render h2 {\n",
       "        font-weight: 200;\n",
       "        font-size: 16pt;\n",
       "        font-style: italic;\n",
       "        line-height: 100%;\n",
       "        color:#c76c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 1.5em;\n",
       "        display: block;\n",
       "        white-space: wrap;\n",
       "        text-align: left;\n",
       "    }\n",
       "    h3 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "    .text_cell_render h3 {\n",
       "        font-weight: 200;\n",
       "        font-size: 14pt;\n",
       "        line-height: 100%;\n",
       "        color:#d77c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 2em;\n",
       "        display: block;\n",
       "        white-space: wrap;\n",
       "        text-align: left;\n",
       "    }\n",
       "    h4 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "    .text_cell_render h4 {\n",
       "        font-weight: 100;\n",
       "        font-size: 14pt;\n",
       "        color:#d77c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 0.5em;\n",
       "        display: block;\n",
       "        white-space: nowrap;\n",
       "    }\n",
       "    h5 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "\n",
       "    .text_cell_render h5 {\n",
       "        font-weight: 200;\n",
       "        font-style: normal;\n",
       "        color: #1d3b84;\n",
       "        font-size: 16pt;\n",
       "        margin-bottom: 0em;\n",
       "        margin-top: 0.5em;\n",
       "        display: block;\n",
       "        white-space: nowrap;\n",
       "    }\n",
       "    div.output_subarea.output_text.output_pyout {\n",
       "        overflow-x: auto;\n",
       "        overflow-y: visible;\n",
       "        max-height: 5000000px;\n",
       "    }\n",
       "    div.output_subarea.output_stream.output_stdout.output_text {\n",
       "        overflow-x: auto;\n",
       "        overflow-y: visible;\n",
       "        max-height: 5000000px;\n",
       "    }\n",
       "    div.output_wrapper{\n",
       "        margin-top:0.2em;\n",
       "        margin-bottom:0.2em;\n",
       "}\n",
       "\n",
       "    code{\n",
       "        font-size: 6pt;\n",
       "\n",
       "    }\n",
       "    .rendered_html code{\n",
       "    background-color: transparent;\n",
       "    }\n",
       "    ul{\n",
       "        margin: 2em;\n",
       "    }\n",
       "    ul li{\n",
       "        padding-left: 0.5em;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 0.5em;\n",
       "    }\n",
       "    ul li li{\n",
       "        padding-left: 0.2em;\n",
       "        margin-bottom: 0.2em;\n",
       "        margin-top: 0.2em;\n",
       "    }\n",
       "    ol{\n",
       "        margin: 2em;\n",
       "    }\n",
       "    ol li{\n",
       "        padding-left: 0.5em;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 0.5em;\n",
       "    }\n",
       "    ul li{\n",
       "        padding-left: 0.5em;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 0.2em;\n",
       "    }\n",
       "    a:link{\n",
       "       color:#447adb;\n",
       "    }\n",
       "    a:visited{\n",
       "       color: #1d3b84;\n",
       "    }\n",
       "    a:hover{\n",
       "       color: #1d3b84;\n",
       "    }\n",
       "    a:focus{\n",
       "       color:#447adb;\n",
       "    }\n",
       "    a:active{\n",
       "       font-weight: bold;\n",
       "       color:#447adb;\n",
       "    }\n",
       "    .rendered_html :link {\n",
       "       text-decoration: underline;\n",
       "    }\n",
       "    .rendered_html :hover {\n",
       "       text-decoration: none;\n",
       "    }\n",
       "    .rendered_html :visited {\n",
       "      text-decoration: none;\n",
       "    }\n",
       "    .rendered_html :focus {\n",
       "      text-decoration: none;\n",
       "    }\n",
       "    .rendered_html :active {\n",
       "      text-decoration: none;\n",
       "    }\n",
       "    .warning{\n",
       "        color: rgb( 240, 20, 20 )\n",
       "    }\n",
       "    hr {\n",
       "      color: #f3f3f3;\n",
       "      background-color: #f3f3f3;\n",
       "      height: 1px;\n",
       "    }\n",
       "    blockquote{\n",
       "      display:block;\n",
       "      background: #fcfcfc;\n",
       "      border-left: 5px solid #c76c0c;\n",
       "      font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "      width:680px;\n",
       "      padding: 10px 10px 10px 10px;\n",
       "      text-align:justify;\n",
       "      text-justify:inter-word;\n",
       "      }\n",
       "      blockquote p {\n",
       "        margin-bottom: 0;\n",
       "        line-height: 125%;\n",
       "        font-size: 100%;\n",
       "      }\n",
       "</style>\n",
       "<script>\n",
       "    MathJax.Hub.Config({\n",
       "                        TeX: {\n",
       "                           extensions: [\"AMSmath.js\"],\n",
       "                           equationNumbers: { autoNumber: \"AMS\", useLabelIds: true}\n",
       "                           },\n",
       "                tex2jax: {\n",
       "                    inlineMath: [ ['$','$'], [\"\\\\(\",\"\\\\)\"] ],\n",
       "                    displayMath: [ ['$$','$$'], [\"\\\\[\",\"\\\\]\"] ]\n",
       "                },\n",
       "                displayAlign: 'center', // Change this to 'center' to center equations.\n",
       "                \"HTML-CSS\": {\n",
       "                    scale: 95,\n",
       "                        availableFonts: [],\n",
       "                        preferredFont:null,\n",
       "                        webFont: \"TeX\",\n",
       "                    styles: {'.MathJax_Display': {\"margin\": 4}}\n",
       "                },\n",
       "                 \"fast-preview\": {\n",
       "                    \"disabled\": false\n",
       "                }\n",
       "        });\n",
       "</script>\n"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#format the book\n",
    "%matplotlib inline\n",
    "from __future__ import division, print_function\n",
    "from book_format import load_style\n",
    "load_style()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The Kalman filter belongs to a family of filters called *Bayesian filters*. Most textbook treatments of the Kalman filter present the Bayesian formula, perhaps shows how it factors into the Kalman filter equations, but mostly keeps the discussion at a very abstract level. \n",
    "\n",
    "That approach requires a fairly sophisticated understanding of several fields of mathematics, and it still leaves much of the work of understanding and forming an intuitive grasp of the situation in the hands of the reader.\n",
    "\n",
    "I will use a different way to develop the topic, to which I owe the work of Dieter Fox and Sebastian Thrun a great debt. It depends on building an intuition on how Bayesian statistics work by tracking an object through a hallway - they use a robot, I use a dog. I like dogs, and they are less predictable than robots which imposes interesting difficulties for filtering. The first published example of this that I can find seems to be Fox 1999 [1], with a fuller example in Fox 2003 [2]. Sebastian Thrun also uses this formulation in his excellent Udacity course Artificial Intelligence for Robotics [3]. In fact, if you like watching videos, I highly recommend pausing reading this book in favor of first few lessons of that course, and then come back to this book for a deeper dive into the topic.\n",
    "\n",
    "Let's now use a simple thought experiment, much like we did with the g-h filter, to see how we might reason about the use of probabilities for filtering and tracking."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Tracking a Dog\n",
    "\n",
    "Let's begin with a simple problem. We have a dog friendly workspace, and so people bring their dogs to work. Occasionally the dogs wander out of offices and down the halls. We want to be able to track them. So during a hackathon somebody invented a sonar sensor to attach to the dog's collar. It emits a signal, listens for the echo, and based on how quickly an echo comes back we can tell whether the dog is in front of an open doorway or not. It also senses when the dog walks, and reports in which direction the dog has moved. It connects to the network via wifi and sends an update once a second.\n",
    "\n",
    "I want to track my dog Simon, so I attach the device to his collar and then fire up Python, ready to write code to track him through the building. At first blush this may appear impossible. If I start listening to the sensor of Simon's collar I might read **door**, **hall**, **hall**, and so on. How can I use that information to determine where Simon is?\n",
    "\n",
    "To keep the problem small enough to plot easily we will assume that there are only 10 positions in the hallway, which we will number 0 to 9, where 1 is to the right of 0. For reasons that will be clear later, we will also assume that the hallway is circular or rectangular. If you move right from position 9, you will be at position 0.  \n",
    "\n",
    "When I begin listening to the sensor I have no reason to believe that Simon is at any particular position in the hallway. From my perspective he is equally likely to be in any position. There are 10 positions, so the probability that he is in any given position is 1/10. \n",
    "\n",
    "Let's represent our belief of his position in a NumPy array. I could use a Python list, but NumPy arrays offer functionality that we will be using soon."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1]\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "belief = np.array([1./10]*10)\n",
    "print(belief)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In [Bayesian statistics](https://en.wikipedia.org/wiki/Bayesian_probability) this is called a [*prior*](https://en.wikipedia.org/wiki/Prior_probability). It is the probability prior to incorporating measurements or other information. More completely, this is called the *prior probability distribution*. A [*probability distribution*](https://en.wikipedia.org/wiki/Probability_distribution) is a collection of all possible probabilities for an event. Probability distributions always sum to 1 because something had to happen; the distribution lists all possible events and the probability of each.\n",
    "\n",
    "I'm sure you've used probabilities before - as in \"the probability of rain today is 30%\". The last paragraph sounds like more of that. But Bayesian statistics was a revolution in probability because it treats probability as a belief about a single event. Let's take an example. I know that if I flip a fair coin infinitely many times I will get 50% heads and 50% tails. This is called [*frequentist statistics*](https://en.wikipedia.org/wiki/Frequentist_inference) to distinguish it from Bayesian statistics. Computations are based on the frequency in which events occur.\n",
    "\n",
    "I flip the coin one more time and let it land. Which way do I believe it landed? Frequentist probability has nothing to say about that; it will merely state that 50% of coin flips land as heads. In some ways it is meaningless to assign a probability to the current state of the coin. It is either heads or tails, we just don't know which. Bayes treats this as a belief about a single event - the strength of my belief or knowledge that this specific coin flip is heads is 50%. Some object to the term \"belief\"; belief can imply holding something to be true without evidence. In this book it always is a measure of the strength of our knowledge. We'll learn more about this as we go.\n",
    "\n",
    "Bayesian statistics takes past information (the prior) into account. We observe that it rains 4 times every 100 days. From this I could state that the chance of rain tomorrow is 1/25. This is not how weather prediction is done. If I know it is raining today and the storm front is stalled, it is likely to rain tomorrow. Weather prediction is Bayesian.\n",
    "\n",
    "In practice statisticians use a mix of frequentist and Bayesian techniques. Sometimes finding the prior is difficult or impossible, and frequentist techniques rule. In this book we can find the prior. When I talk about the probability of something I am referring to the probability that some specific thing is true given past events. When I do that I'm taking the Bayesian approach.\n",
    "\n",
    "Now let's create a map of the hallway. We'll place the first two doors close together, and then another door further away. We will use 1 for doors, and 0 for walls:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "hallway = np.array([1, 1, 0, 0, 0, 0, 0, 0, 1, 0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I start listening to Simon's transmissions on the network, and the first data I get from the sensor is **door**. For the moment assume the sensor always returns the correct answer. From this I conclude that he is in front of a door, but which one? I have no reason to believe he is in front of the first, second, or third door. What I can do is assign a probability to each door. All doors are equally likely, and there are three of them, so I assign a probability of 1/3 to each door. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZkAAAD5CAYAAAD1JkggAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAD11JREFUeJzt3X+MZWddx/H3h10qtMBgWjC1u9gaR8KmMbaZtJQmpdoiWyRbNY3pJjRC+GEMi2BF06optTEhqAgxVkRbfgqtS/mRDdmwoBTBhNYdWn50u5RZC9Jhi4tQLiLGsvL1j3vYXO7OztzOzjNnZ/b9SiZzzz3PnPPZ2Zn9zHmec2dTVUiS1MLj+g4gSVq/LBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1s2TJJHlbkkNJ7jvG/iT5yyQHknw+yfkrH1OStBZNciXzDmDrIvuvAKa7t1cAbzn+WJKk9WDJkqmqTwLfWmTIlcC7augu4KlJzlypgJKktWvjChzjLOChke357rmHRwcNBgN/tYAkrWNTU1MZf24lFv6POihgoUiSVqRk5oHNI9ubgIMrcFxJ0hq3EtNlu4AdSW4HLgQGVfXwYh8wNTW1Aqed3OzsLAAzMzOret4TNQeY5VjMsjCzLOxEydJnjsFgsOj+JUsmyW3ApcAZSeaB1wGPB6iqvwF2Ay8ADgDfA15yXIklSevGkiVTVduX2F/AK1cskSRp3fAV/5KkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqZmJSibJ1iQPJDmQ5LoF9j8jyZ1J7k3y+SQvWPmokqS1ZsmSSbIBuBm4AtgCbE+yZWzYHwE7q+o84Grgr1c6qCRp7UlVLT4guQi4saqe321fD1BVrx8Z81bgwap6Qzf+jVX1nNHjDAaDIyeam5tbuT+BJKk309PTRx5PTU1lfP/GCY5xFvDQyPY8cOHYmBuBjyZ5FXAacPljDSpJWn8mKZmjmgkYv/zZDryjqt7YXcm8O8m5VfWDhQ44MzPzGGMen9nZ2V7Oe6LmALMci1kWZpaFnShZ+swxGAwW3T/Jwv88sHlkexNwcGzMS4GdAFX1aeAJwBkTp5QkrUuTlMxeYDrJOUlOYbiwv2tszFeBywCSPIthyXxjJYNKktaeJUumqg4DO4A9wH6Gd5HtS3JTkm3dsN8FXp7kc8BtwItrqTsKJEnr3iRrMlTVbmD32HM3jDy+H7h4ZaNJktY6X/EvSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNTNRySTZmuSBJAeSXHeMMb+e5P4k+5K8d2VjSpLWoo1LDUiyAbgZeB4wD+xNsquq7h8ZMw1cD1xcVY8keXqrwJKktWOSK5kLgANV9WBVPQrcDlw5NublwM1V9QhAVR1a2ZiSpLUoVbX4gOQqYGtVvazbvga4sKp2jIz5EPAl4GJgA3BjVX1k9DiDweDIiebm5lbsDyBJ6s/09PSRx1NTUxnfv+R0GXDUBwHjzbQRmAYuBTYBn0pyblV9e+KkkqR1Z5KSmQc2j2xvAg4uMOauqvo+8OUkDzAsnb0LHXBmZmYZUZdvdna2l/OeqDnALMdiloWZZWEnSpY+cwwGg0X3T7ImsxeYTnJOklOAq4FdY2M+BPwCQJIzgJ8FHnzMaSVJ68qSJVNVh4EdwB5gP7CzqvYluSnJtm7YHuCbSe4H7gR+r6q+2Sq0JGltmGS6jKraDewee+6GkccFXNu9SZIE+Ip/SVJDlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUjCUjSWrGkpEkNWPJSJKasWQkSc1YMpKkZiwZSVIzlowkqRlLRpLUzEQlk2RrkgeSHEhy3SLjrkpSSWZWLqIkaa1asmSSbABuBq4AtgDbk2xZYNyTgd8G7l7pkJKktSlVtfiA5CLgxqp6frd9PUBVvX5s3JuBfwReC7y2qmZH9w8GgyMnmpubW5HwkqR+TU9PH3k8NTWV8f2TTJedBTw0sj3fPXdEkvOAzVX14eXFlCStRxsnGHNUMwFHrkqSPA54E/DiSU86M7O6Szazs7O9nPdEzQFmORazLMwsCztRsvSZYzAYLLp/kiuZeWDzyPYm4ODI9pOBc4FPJPkK8Gxgl4v/kqRJSmYvMJ3knCSnAFcDu364s6oGVXVGVZ1dVWcDdwHbxtdkJEknnyVLpqoOAzuAPcB+YGdV7UtyU5JtrQNKktauSdZkqKrdwO6x5244xthLjz+WJGk98BX/kqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmJnrF/4nkvHcv5/+imRq+2//YP/bea6aPue+xZ2mTQ9LxW81/W06m72evZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqZqGSSbE3yQJIDSa5bYP+1Se5P8vkk/5Tkp1Y+qiRprVmyZJJsAG4GrgC2ANuTbBkbdi8wU1U/B9wB/OlKB5UkrT2TXMlcAByoqger6lHgduDK0QFVdWdVfa/bvAvYtLIxJUlrUapq8QHJVcDWqnpZt30NcGFV7TjG+L8Cvl5VfzL6/GAwOHKiubm5ZQd++f6pZX/scvzdswbH3LeaWRbLIen4+f28PNPT00ceT01NZXz/xgmOcdQHAQs2U5IXATPAcyfMJ0laxyYpmXlg88j2JuDg+KAklwN/CDy3qv53sQPOzMw8low/av/yr4KWY9Gsq5jluD5nC5idnW1y3OUwy8LMsrBmWfx+XpbBYPGrsknWZPYC00nOSXIKcDWwa3RAkvOAtwLbqurQMrNKktaZJUumqg4DO4A9wH5gZ1XtS3JTkm3dsD8DngS8L8lnk+w6xuEkSSeRSabLqKrdwO6x524YeXz5CueSJK0DvuJfktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktSMJSNJasaSkSQ1M1HJJNma5IEkB5Jct8D+H0vyD93+u5OcvdJBJUlrz5Ilk2QDcDNwBbAF2J5ky9iwlwKPVNXPAG8C3rDSQSVJa0+qavEByUXAjVX1/G77eoCqev3ImD3dmE8n2Qh8HXhajRx8MBgsfiJJ0po2NTWV8ecmmS47C3hoZHu+e27BMVV1GBgApy8vpiRpvZikZI5qJmD8qmSSMZKkk8zGCcbMA5tHtjcBB48xZr6bLpsCvjU6YKHLKEnS+jbJlcxeYDrJOUlOAa4Gdo2N2QX8Rvf4KuDjtdRijyRp3VuyZLo1lh3AHmA/sLOq9iW5Kcm2btitwOlJDgDXAkfd5tyXpW6/XsUcb0tyKMl9fWUYybI5yZ1J9ifZl+TVPWZ5QpJ/TfK5Lssf95Wly7Mhyb1JPtxnji7LV5J8Iclnk8z2mOOpSe5I8sXua+ainnI8s/tc/PDtO0le00eWLs/vdF+z9yW5LckTeszy6i7Hvj4/JwtZ8u6ytay7/fpLwPMYTuntBbZX1f09ZLkE+C7wrqo6d7XPP5blTODMqronyZOBzwC/0tPnJcBpVfXdJI8H/gV4dVXdtdpZujzXAjPAU6rqhX1kGMnyFWCmqv6z5xzvBD5VVbd0sxmnVtW3e860AfgacGFV/XsP5z+L4dfqlqr6nyQ7gd1V9Y4espwL3A5cADwKfAT4raqaW+0sC1nvr/i/ADhQVQ9W1aMM/yKu7CNIVX2SsXWqvlTVw1V1T/f4vxheoY7fMbhaWaqqvtttPr576+UnnySbgF8Gbunj/CeiJE8BLmE4W0FVPdp3wXQuA/6tj4IZsRF4YrcOfSpHr1WvlmcBd1XV97qZp38GfrWnLEdZ7yUzye3XJ7XutzOcB9zdY4YNST4LHAI+VlV9ZXkz8PvAD3o6/7gCPprkM0le0VOGnwa+Aby9m0a8JclpPWUZdTVwW18nr6qvAX8OfBV4GBhU1Ud7inMfcEmS05OcCryAH71Zq1frvWS8tXoRSZ4EvB94TVV9p68cVfV/VfXzDO9cvKC7/F9VSV4IHKqqz6z2uRdxcVWdz/C3bbyym3JdbRuB84G3VNV5wH/T85prN2W3DXhfjxl+nOGsyDnATwKnJXlRH1mqaj/D37LyMYZTZZ8DDveRZSHrvWQmuf36pNStf7wfeE9VfaDvPADdNMwngK09nP5iYFu3DnI78ItJ/r6HHEdU1cHu/SHggwynf1fbPDA/cnV5B8PS6dMVwD1V9R89Zrgc+HJVfaOqvg98AHhOX2Gq6taqOr+qLmE4LX9CrMfA+i+ZSW6/Pul0i+23Avur6i96zvK0JE/tHj+R4TfvF1c7R1VdX1Wbqupshl8nH6+qXn4yBUhyWndTBt301C8xnBZZVVX1deChJM/snroMWPUbRMZsp8epss5XgWcnObX7frqM4dpmL5I8vXv/DODX6P/zc8QkL8Zcs6rqcJIf3n69AXhbVe3rI0uS24BLgTOSzAOvq6pb+8jC8Kf2a4AvdGshAH9QVbt7yHIm8M7ubqHHMbxFvvfbh08APwF8cPjvFxuB91bVR3rK8irgPd0Pag8CL+kpB92aw/OA3+wrA0BV3Z3kDuAehlNT9wJ/22Ok9yc5Hfg+8MqqeqTHLD9iXd/CLEnq13qfLpMk9ciSkSQ1Y8lIkpqxZCRJzVgykqRmLBlJUjOWjCSpGUtGktTM/wMvxD5HCOkIyQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db568f9048>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from kf_book.book_plots import figsize, set_figsize\n",
    "import kf_book.book_plots as book_plots\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "belief = np.array([1./3, 1./3, 0, 0, 0, 0, 0, 0, 1/3, 0])\n",
    "plt.figure()\n",
    "set_figsize(y=2)\n",
    "book_plots.bar_plot(belief)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This distribution is called a [*categorical distribution*](https://en.wikipedia.org/wiki/Categorical_distribution), which is a discrete distribution describing the probability of observing $n$ outcomes. It is a [*multimodal distribution*](https://en.wikipedia.org/wiki/Multimodal_distribution) because we have multiple beliefs about the position of our dog. Of course we are not saying that we think he is simultaneously in three different locations, merely that we have narrowed down our knowledge to one of these three locations. My (Bayesian) belief is that there is a 33.3% chance of being at door 0, 33.3% at door 1, and a 33.3% chance of being at door 8.\n",
    "\n",
    "This is an improvement in two ways. I've rejected a number of hallway positions as impossible, and the strength of my belief in the remaining positions has increased from 10% to 33%. This will always happen. As our knowledge improves the probabilities will get closer to 100%.\n",
    "\n",
    "A few words about the [*mode*](https://en.wikipedia.org/wiki/Mode_(statistics&#41;)\n",
    "of a distribution. Given a set of numbers, such as {1, 2, 2, 2, 3, 3, 4}, the *mode* is the number that occurs most often. For this set the mode is 2. A set can contain more than one mode. The set {1, 2, 2, 2, 3, 3, 4, 4, 4} contains the modes 2 and 4, because both occur three times. We say the former set is [*unimodal*](https://en.wikipedia.org/wiki/Unimodality), and the latter is *multimodal*.\n",
    "\n",
    "Another term used for this distribution is a [*histogram*](https://en.wikipedia.org/wiki/Histogram). Histograms graphically depict the distribution of a set of numbers. The bar chart above is a histogram.\n",
    "\n",
    "I hand coded the `belief` array in the code above. How would we implement this in code? We represent doors with 1, and walls as 0, so we will multiply the hallway variable by the percentage, like so;"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0.333 0.333 0.    0.    0.    0.    0.    0.    0.333 0.   ]\n"
     ]
    }
   ],
   "source": [
    "belief = hallway * (1./3)\n",
    "print(belief)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Extracting Information from Sensor Readings\n",
    "\n",
    "Let's put Python aside and think about the problem a bit. Suppose we were to read the following from Simon's sensor:\n",
    "\n",
    "  * door\n",
    "  * move right\n",
    "  * door\n",
    "  \n",
    "\n",
    "Can we deduce Simon's location? Of course! Given the hallway's layout there is only one place from which you can get this sequence, and that is at the left end. Therefore we can confidently state that Simon is in front of the second doorway. If this is not clear, suppose Simon had started at the second or third door. After moving to the right, his sensor would have returned 'wall'. That doesn't match the sensor readings, so we know he didn't start there. We can continue with that logic for all the remaining starting positions. The only possibility is that he is now in front of the second door. Our belief is:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "belief = np.array([0., 1., 0., 0., 0., 0., 0., 0., 0., 0.])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I designed the hallway layout and sensor readings to give us an exact answer quickly. Real problems are not so clear cut. But this should trigger your intuition - the first sensor reading only gave us low probabilities (0.333) for Simon's location, but after a position update and another sensor reading we know more about where he is. You might suspect, correctly, that if you had a very long hallway with a large number of doors that after several sensor readings and positions updates we would either be able to know where Simon was, or have the possibilities narrowed down to a small number of possibilities. This is possible when a set of sensor readings only matches one to a few starting locations.\n",
    "\n",
    "We could implement this solution now, but instead let's consider a real world complication to the problem."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Noisy Sensors\n",
    "\n",
    "Perfect sensors are rare. Perhaps the sensor would not detect a door if Simon sat in front of it while scratching himself, or misread if he is not facing down the hallway. Thus when I get **door** I cannot use 1/3 as the probability. I have to assign less than 1/3 to each door, and assign a small probability to each blank wall position. Something like\n",
    "\n",
    "```Python\n",
    "[.31, .31, .01, .01, .01, .01, .01, .01, .31, .01]\n",
    "```\n",
    "\n",
    "At first this may seem insurmountable. If the sensor is noisy it casts doubt on every piece of data. How can we conclude anything if we are always unsure?\n",
    "\n",
    "The answer, as for the problem above, is with probabilities. We are already comfortable assigning a probabilistic belief to the location of the dog; now we have to incorporate the additional uncertainty caused by the sensor noise. \n",
    "\n",
    "Say we get a reading of **door**, and suppose that testing shows that the sensor is 3 times more likely to be right than wrong. We should scale the probability distribution by 3 where there is a door. If we do that the result will no longer be a probability distribution, but we will learn how to fix that in a moment.\n",
    "\n",
    "Let's look at that in Python code. Here I use the variable `z` to denote the measurement. `z` or `y` are customary choices in the literature for the measurement. As a programmer I prefer meaningful variable names, but I want you to be able to read the literature and/or other filtering code, so I will start introducing these abbreviated names now."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "belief: [0.3 0.3 0.1 0.1 0.1 0.1 0.1 0.1 0.3 0.1]\n",
      "sum = 1.6000000000000003\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACMCAYAAAAgJeDfAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAADjpJREFUeJzt3X2MZXddx/H3hy4VWmAwLWjtLrbGgbBpjNtMWkuTUm2RLZKtD43pJjRCeDCGRbA+pFVSajUhoIgxVkRb5EFoXQroxmxYiBRBQ+sOLQ/dLmXXgnTYYpGHi4haKl//uKfrdZjZObP9tfee7fuVTPaec35z7mfu7t797Dm/c26qCkmSpBYeM+0AkiTp2GGxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNrFkskrwlyX1J7lhle5L8UZKDST6V5Mz2MSVJ0hD0OWLxVmDrEbZfBMx3Xy8D3vTQY0mSpCFas1hU1UeArx5hyMXA22vsFuDJSU5pFVCSJA3Hhgb7OBW4Z2J5qVt37+Sg0WjkLT4lSTrGzM3NZXK5xeTNrLDOEiFJ0qNQi2KxBGyaWN4IHGqwX0mSNDAtToXsAnYkuRE4GxhV1b1H+oa5ubkGT9ve4uIiAAsLC1NOsj5DzQ3DzT7U3DDc7EPNDcPNPtTcMNzsQ8k9Go1W3bZmsUhyA3A+cHKSJeA1wGMBqupPgd3A84CDwLeAFz3kxJIkaZDWLBZVtX2N7QW8vFkiSZI0WN55U5IkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNWCwkSVIzFgtJktSMxUKSJDVjsZAkSc1YLCRJUjMWC0mS1IzFQpIkNdOrWCTZmuSuJAeTXLHC9qcluTnJ7Uk+leR57aNKkqRZt2axSHIccC1wEbAZ2J5k87JhrwZ2VtUW4FLgT1oHlSRJsy9VdeQByTnA1VX13G75SoCqeu3EmDcDd1fV67rxb6iqZ03uZzQaHX6iAwcOtPsJJEnSI2p+fv7w47m5uUxu29Dj+08F7plYXgLOXjbmauADSV4BnAhceDRBJUnSsPUpFllh3fLDHNuBt1bVG7ojFu9IckZVfWelHS4sLKwz5iNjcXERmN18qxlqbhhu9qHmhuFmH2puGG72oeaG4WYfSu7RaLTqtj6TN5eATRPLG4FDy8a8GNgJUFUfAx4HnLyulJIkafD6FIu9wHyS05Mcz3hy5q5lY74AXACQ5JmMi8WXWwaVJEmzb81iUVUPADuAPcB+xld/7EtyTZJt3bBfBV6a5JPADcALa61ZoZIk6ZjTZ44FVbUb2L1s3VUTj+8Ezm0bTZIkDY133pQkSc1YLCRJUjMWC0mS1IzFQpIkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNWCwkSVIzFgtJktSMxUKSJDVjsZAkSc30KhZJtia5K8nBJFesMubnk9yZZF+Sd7WNKUmShmDNj01PchxwLfAcYAnYm2RX91HpD46ZB64Ezq2qryV56sMVWJIkza5U1ZEHJOcAV1fVc7vlKwGq6rUTY14PfLaqrlttP6PR6PATHThw4CHGliRJ0zI/P3/48dzcXCa39TkVcipwz8TyUrdu0tOBpyf5xyS3JNl6lFklSdKArXkqBMgK65Yf5tgAzAPnAxuBjyY5o6q+vtIOFxYW1pPxEbO4uAjMbr7VDDU3DDf7UHPDcLMPNTcMN/tQc8Nwsw8l92g0WnVbnyMWS8CmieWNwKEVxvxNVX27qj4H3MW4aEiSpEeRPsViLzCf5PQkxwOXAruWjflr4McBkpzM+NTI3S2DSpKk2bdmsaiqB4AdwB5gP7CzqvYluSbJtm7YHuArSe4EbgZ+vaq+8nCFliRJs6nPHAuqajewe9m6qyYeF3B59yVJkh6lvPOmJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpmV7FIsnWJHclOZjkiiOMuyRJJVloF1GSJA3FmsUiyXHAtcBFwGZge5LNK4x7IvDLwK2tQ0qSpGHoc8TiLOBgVd1dVfcDNwIXrzDud4DXA//VMJ8kSRqQVNWRBySXAFur6iXd8mXA2VW1Y2LMFuDVVfVzST4M/FpVLU7uZzQaHX6iAwcOtPsJJEnSI2p+fv7w47m5uUxu29Dj+7PCusMlIcljgDcCLzy6eJIk6VjRp1gsAZsmljcChyaWnwicAXw4CcD3A7uSbFt+1OJBCwuzObdzcXEcd1bzrWaouWG42YeaG4abfai5YbjZh5obhpt9KLlHo9Gq2/rMsdgLzCc5PcnxwKXArgc3VtWoqk6uqtOq6jTgFmDVUiFJko5daxaLqnoA2AHsAfYDO6tqX5Jrkmx7uANKkqTh6HMqhKraDexetu6qVcae/9BjSZKkIfLOm5IkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqptflprNuyztaffbI3PiX/W32d/tl82uOaZP9kc8tSQ+HWXw/9z1xfTxiIUmSmrFYSJKkZiwWkiSpGYuFJElqxmIhSZKasVhIkqRmehWLJFuT3JXkYJIrVth+eZI7k3wqyd8l+cH2USVJ0qxbs1gkOQ64FrgI2AxsT7J52bDbgYWq+hHgJuD1rYNKkqTZ1+eIxVnAwaq6u6ruB24ELp4cUFU3V9W3usVbgI1tY0qSpCFIVR15QHIJsLWqXtItXwacXVU7Vhn/x8CXqup3J9ePRqPDT3TgQKs7q429dP9c0/218ufPHK05Zhaz98ktSQ8H3xOHYX7+/+5GOjc3l8ltfW7pnRXWrdhGkrwAWACevY58kiTpGNGnWCwBmyaWNwKHlg9KciHwW8Czq+q/j7TDhYWF9WRcW6PPyGit1885g9mb//4cweLi4iP+nC0MNTcMN/tQc8Nws08lt++Jj/hzHo3RaPWjOH3mWOwF5pOcnuR44FJg1+SAJFuANwPbquq+h5BVkiQN2JrFoqoeAHYAe4D9wM6q2pfkmiTbumG/BzwBeHeSTyTZtcruJEnSMazXx6ZX1W5g97J1V008vrBxLkmSNEDeeVOSJDVjsZAkSc1YLCRJUjMWC0mS1IzFQpIkNdPrqhBpuS3vaHUTm+72vY1uinP7ZfNrjmmTfai5oWX2PrnB19zXfKxv9qHyNR/ziIUkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZnoViyRbk9yV5GCSK1bY/j1J/qrbfmuS01oHlSRJs2/NYpHkOOBa4CJgM7A9yeZlw14MfK2qfhh4I/C61kElSdLsS1UdeUByDnB1VT23W74SoKpeOzFmTzfmY0k2AF8CnlITOx+NRkd+IkmSNDhzc3OZXO5zKuRU4J6J5aVu3YpjquoBYAScdPQxJUnSEPUpFllh3fKjD33GSJKkY1yfDyFbAjZNLG8EDq0yZqk7FTIHfHVywPJDJZIk6djT54jFXmA+yelJjgcuBXYtG7ML+IXu8SXAh2qtyRuSJOmYs2ax6OZM7AD2APuBnVW1L8k1SbZ1w64HTkpyELgc+K5LUmfdWpfUzqokb0lyX5I7pp1lPZJsSnJzkv1J9iV55bQz9ZXkcUn+Kcknu+y/Pe1M65HkuCS3J/nbaWdZjySfT/LpJJ9IsjjtPH0leXKSm5J8pvvzfs60M/WR5Bnda/3g1zeSvGraufpI8ivd3807ktyQ5HHTztRXkld2ufcN5fVebs2rQh4NuktqPws8h/Fpnb3A9qq6c6rBekhyHvBN4O1Vdca08/SV5BTglKq6LckTgY8DPz2Q1zzAiVX1zSSPBf4BeGVV3TLlaL0kuRxYAJ5UVc+fdp6+knweWKiqf5t2lvVI8jbgo1V1XXfU94Sq+vq0c61H9x75ReDsqvqXaec5kiSnMv47ubmq/jPJTmB3Vb11usnWluQM4EbgLOB+4P3AL1XVgakGWyfvvDl2FnCwqu6uqvsZ/8ZePOVMvVTVR1g2n2UIqureqrqte/zvjI+GLb/aaCbV2De7xcd2X4No6Ek2Aj8FXDftLI8GSZ4EnMf4qC5Vdf/QSkXnAuCfZ71UTNgAPL6b83cC3z0vcFY9E7ilqr7VnS34e+Bnppxp3SwWY30uqdXDpLtT6xbg1ukm6a87nfAJ4D7gg1U1lOx/CPwG8J1pBzkKBXwgyceTvGzaYXr6IeDLwF90p5+uS3LitEMdhUuBG6Ydoo+q+iLw+8AXgHuBUVV9YLqpersDOC/JSUlOAJ7H/794YhAsFmNeLjslSZ4AvAd4VVV9Y9p5+qqq/6mqH2V8ldRZ3SHMmZbk+cB9VfXxaWc5SudW1ZmM7wL88u404KzbAJwJvKmqtgD/wcDmoHWnb7YB7552lj6SfC/jI86nAz8AnJjkBdNN1U9V7Wd85+oPMj4N8knggamGOgoWi7E+l9SqsW5+wnuAd1bVe6ed52h0h7U/DGydcpQ+zgW2dXMVbgR+IslfTjdSf1V1qPv1PuB9jE9hzrolYGniiNZNjIvGkFwE3FZV/zrtID1dCHyuqr5cVd8G3gs8a8qZequq66vqzKo6j/Fp7kHNrwCLxYP6XFKrhroJkNcD+6vqD6adZz2SPCXJk7vHj2f8RvaZ6aZaW1VdWVUbq+o0xn/GP1RVg/ifXJITu0m+dKcSfpLxYeOZVlVfAu5J8oxu1QXAzE9QXmY7AzkN0vkC8GNJTujeZy5gPIdrEJI8tfv1acDPMqzXHuh3g6xjXlU9kOTBS2qPA95SVfumHKuXJDcA5wMnJ1kCXlNV1083VS/nApcBn+7mKgD8ZlXtnmKmvk4B3tbNlH8M40uwB3Xp5gB9H/C+8b8TbADeVVXvn26k3l4BvLP7T8vdwIumnKe37jz/c4BfnHaWvqrq1iQ3AbcxPo1wO/Bn0021Lu9JchLwbeDlVfW1aQdaLy83lSRJzXgqRJIkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNWCwkSVIzFgtJktTM/wK9oV0Rin2vzgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db568ddc50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def update_belief(hall, belief, z, correct_scale):\n",
    "    for i, val in enumerate(hall):\n",
    "        if val == z:\n",
    "            belief[i] *= correct_scale\n",
    "\n",
    "belief = np.array([0.1] * 10)\n",
    "reading = 1 # 1 is 'door'\n",
    "update_belief(hallway, belief, z=reading, correct_scale=3.)\n",
    "print('belief:', belief)\n",
    "print('sum =', sum(belief))\n",
    "plt.figure()\n",
    "book_plots.bar_plot(belief)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is not a probability distribution because it does not sum to 1.0. But the code is doing mostly the right thing - the doors are assigned a number (0.3) that is 3 times higher than the walls (0.1). All we need to do is normalize the result so that the probabilities correctly sum to 1.0. Normalization is done by dividing each element by the sum of all elements in the list. That is easy with NumPy:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0.188, 0.188, 0.062, 0.062, 0.062, 0.062, 0.062, 0.062, 0.188,\n",
       "       0.062])"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "belief / sum(belief)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "FilterPy implements this with the `normalize` function:\n",
    "\n",
    "```Python\n",
    "from filterpy.discrete_bayes import normalize\n",
    "normalize(belief)\n",
    "```\n",
    "\n",
    "It is a bit odd to say \"3 times as likely to be right as wrong\". We are working in probabilities, so let's specify the probability of the sensor being correct, and compute the scale factor from that. The equation for that is\n",
    "\n",
    "$$scale =  \\frac{prob_{correct}}{prob_{incorrect}} = \\frac{prob_{correct}} {1-prob_{correct}}$$\n",
    "\n",
    "\n",
    "\n",
    "Also, the `for` loop is cumbersome. As a general rule you will want to avoid using `for` loops in NumPy code. NumPy is implemented in C and Fortran, so if you avoid for loops the result often runs 100x faster than the equivalent loop.\n",
    "\n",
    "How do we get rid of this `for` loop? NumPy lets you index arrays with boolean arrays. You create a boolean array with logical operators. We can find all the doors in the hallway with:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ True,  True, False, False, False, False, False, False,  True,\n",
       "       False])"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hallway == 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When you use the boolean array as an index to another array it returns only the elements where the index is `True`. Thus we can replace the `for` loop with\n",
    "\n",
    "```python\n",
    "belief[hall==z] *= scale\n",
    "```\n",
    "and only the elements which equal `z` will be multiplied by `scale`.\n",
    "\n",
    "Teaching you NumPy is beyond the scope of this book. I will use idiomatic NumPy constructs and explain them the first time I present them. If you are new to NumPy there are many blog posts and videos on how to use NumPy efficiently and idiomatically.\n",
    "\n",
    "Here is our improved version:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "sum = 1.0\n",
      "probability of door = 0.1875\n",
      "probability of wall = 0.06249999999999999\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACMCAYAAAAgJeDfAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAC+NJREFUeJzt3X+sX/Vdx/Hna+1wg8mdwWmQosN5s6xZjJAriCTMDHBlW8pmMKFmZBp/Sw2TPxTU4CQmiz+i/iExU8DNuYEMtqRZmrHFzR9LBHv5MaF0rBUnXBgyI34RZ4Tq2z++B/Ld5bb33PZTzveU5yNp7vec8+n3++q37bevfj7nnJuqQpIkqYVXDB1AkiQdPywWkiSpGYuFJElqxmIhSZKasVhIkqRmLBaSJKmZXsUiybYkDyU5kOTqNY7/XJL7k9yX5AtJtraPKkmS5l3Wu49Fkk3Al4GLgBVgD7Cjqh6cGXNyVT3dPd4O/EJVbTtmqSVJ0lzqM2NxNnCgqh6uqmeBW4BLZgc8Xyo6JwHedUuSpJehzT3GnAY8OrO9ApyzelCSK4CrgBOAt64+PplMLBuSJB1nFhYWMrvdZ8Yia+x7UUmoquur6g3ArwC/fmTxJEnSmPUpFivA6TPbW4DHDzP+FuBdRxNKkiSNU5+lkD3AYpIzgMeAy4Afmx2QZLGq9neb7wD2cxgLCwtHEPXYW15eBmBpaWngJBsz1tww3uxjzQ3jzT7W3DDe7GPNDePNPpbck8nkkMfWLRZVdTDJTuAOYBNwU1XtTXIdsFxVu4CdSS4EngOeAt7bJLkkSRqVPjMWVNVuYPeqfdfOPL6ycS5JkjRC3nlTkiQ1Y7GQJEnNWCwkSVIzFgtJktSMxUKSJDVjsZAkSc1YLCRJUjMWC0mS1IzFQpIkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNWCwkSVIzFgtJktSMxUKSJDVjsZAkSc1YLCRJUjMWC0mS1IzFQpIkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNWCwkSVIzvYpFkm1JHkpyIMnVaxy/KsmDSf4xyV8l+a72USVJ0rxbt1gk2QRcD1wMbAV2JNm6ati9wFJVfS9wG/A7rYNKkqT512fG4mzgQFU9XFXPArcAl8wOqKrPV9XXu807gS1tY0qSpDFIVR1+QHIpsK2qfqrbvhw4p6p2HmL8HwFPVNVvze6fTCYvvND+/fuPNrckSRrI4uLiC48XFhYye2xzj5+fNfat2UaSvAdYAt6ygXySJOk40adYrACnz2xvAR5fPSjJhcCvAW+pqv853BMuLS1tJONLZnl5GZjffIcy1tww3uxjzQ3jzT7W3DDe7GPNDePNPpbck8nkkMf6nGOxB1hMckaSE4DLgF2zA5KcCXwQ2F5VTx5FVkmSNGLrFouqOgjsBO4A9gG3VtXeJNcl2d4N+13gNcDHk9yXZNchnk6SJB3H+iyFUFW7gd2r9l078/jCxrk25MyPtDoZdGH6ZV+b57v38sV1x7TJ/tLnlqRjYR4/z/1M3BjvvClJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJaqZXsUiyLclDSQ4kuXqN4+cnuSfJwSSXto8pSZLGYN1ikWQTcD1wMbAV2JFk66phjwA/DnysdUBJkjQeqarDD0jOBd5fVW/rtq8BqKoPrDH2Q8Cnquq21ccmk8kLL7R///6jS73KT+9baPp8rfzpmybrjpnH7H1yS9Kx4GfiOCwuLr7weGFhIbPH+iyFnAY8OrO90u2TJEn6Bpt7jMka+w4/zbGOpaWlo/npL7av7QxIK71+nXOYvfnvz2EsLy+/5K/Zwlhzw3izjzU3jDf7ILn9THzJX/NITCaHnsXpM2OxApw+s70FePwoM0mSpONQn2KxB1hMckaSE4DLgF3HNpYkSRqjdYtFVR0EdgJ3APuAW6tqb5LrkmwHSPL9SVaAHwU+mGTvsQwtSZLmU59zLKiq3cDuVfuunXm8h+kSiSRJehnzzpuSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZnrdIEta7cyPtPpGQd23SG70jYfuvXxx3TFtso81N7TM3ic3+J77nk/1zT5WvudTzlhIkqRmLBaSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqZlexSLJtiQPJTmQ5Oo1jn9Tkr/sjt+V5PWtg0qSpPm3brFIsgm4HrgY2ArsSLJ11bCfBJ6qqu8B/gD47dZBJUnS/EtVHX5Aci7w/qp6W7d9DUBVfWBmzB3dmL9Pshl4AnhdzTz5ZDI5/AtJkqTRWVhYyOx2n6WQ04BHZ7ZXun1rjqmqg8AEOOXIY0qSpDHqUyyyxr7Vsw99xkiSpOPc5h5jVoDTZ7a3AI8fYsxKtxSyAPz77IDVUyWSJOn402fGYg+wmOSMJCcAlwG7Vo3ZBby3e3wp8Lla7+QNSZJ03Fm3WHTnTOwE7gD2AbdW1d4k1yXZ3g27ETglyQHgKuBFl6TOu/UuqZ1XSW5K8mSSB4bOshFJTk/y+ST7kuxNcuXQmfpK8qok/5Dki1323xw600Yk2ZTk3iSfGjrLRiT5SpL7k9yXZHnoPH0leW2S25J8qfvzfu7QmfpI8sbuvX7+x9NJ3jd0rj6S/FL3d/OBJDcnedXQmfpKcmWXe+9Y3u/V1r0q5OWgu6T2y8BFTJd19gA7qurBQYP1kOR84Bngz6vqzUPn6SvJqcCpVXVPkm8G7gbeNZL3PMBJVfVMklcCXwCurKo7B47WS5KrgCXg5Kp659B5+kryFWCpqv5t6CwbkeTDwN9V1Q3drO+JVfUfQ+faiO4z8jHgnKr6l6HzHE6S05j+ndxaVf+d5FZgd1V9aNhk60vyZuAW4GzgWeDTwM9X1f5Bg22Qd96cOhs4UFUPV9WzTH9jLxk4Uy9V9besOp9lDKrqq1V1T/f4P5nOhq2+2mgu1dQz3eYrux+jaOhJtgDvAG4YOsvLQZKTgfOZzupSVc+OrVR0LgD+ad5LxYzNwKu7c/5O5MXnBc6rNwF3VtXXu9WCvwHePXCmDbNYTPW5pFbHSHen1jOBu4ZN0l+3nHAf8CTw2aoaS/Y/BH4Z+L+hgxyBAj6T5O4kPzN0mJ6+G/ga8Gfd8tMNSU4aOtQRuAy4eegQfVTVY8DvAY8AXwUmVfWZYVP19gBwfpJTkpwIvJ1vvHhiFCwWU14uO5AkrwFuB95XVU8Pnaevqvrfqvo+pldJnd1NYc61JO8Enqyqu4fOcoTOq6qzmN4F+IpuGXDebQbOAv64qs4E/ouRnYPWLd9sBz4+dJY+knwL0xnnM4DvAE5K8p5hU/VTVfuY3rn6s0yXQb4IHBw01BGwWEz1uaRWjXXnJ9wOfLSqPjF0niPRTWv/NbBt4Ch9nAds785VuAV4a5K/GDZSf1X1ePf1SeCTTJcw590KsDIzo3Ub06IxJhcD91TVvw4dpKcLgX+uqq9V1XPAJ4AfHDhTb1V1Y1WdVVXnM13mHtX5FWCxeF6fS2rVUHcC5I3Avqr6/aHzbESS1yV5bff41Uw/yL40bKr1VdU1VbWlql7P9M/456pqFP+TS3JSd5Iv3VLCDzOdNp5rVfUE8GiSN3a7LgDm/gTlVXYwkmWQziPADyQ5sfucuYDpOVyjkOTbuq/fCfwI43rvgX43yDruVdXBJM9fUrsJuKmq9g4cq5ckNwM/BHxrkhXgN6rqxmFT9XIecDlwf3euAsCvVtXuATP1dSrw4e5M+VcwvQR7VJdujtC3A5+c/jvBZuBjVfXpYSP19ovAR7v/tDwM/MTAeXrr1vkvAn526Cx9VdVdSW4D7mG6jHAv8CfDptqQ25OcAjwHXFFVTw0daKO83FSSJDXjUogkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpmf8H81Jdnl4AUpEAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db56cdec50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from filterpy.discrete_bayes import normalize\n",
    "\n",
    "def scaled_update(hall, belief, z, z_prob): \n",
    "    scale = z_prob / (1. - z_prob)\n",
    "    belief[hall==z] *= scale\n",
    "    normalize(belief)\n",
    "\n",
    "belief = np.array([0.1] * 10)\n",
    "scaled_update(hallway, belief, z=1, z_prob=.75)\n",
    "\n",
    "print('sum =', sum(belief))\n",
    "print('probability of door =', belief[0])\n",
    "print('probability of wall =', belief[2])\n",
    "book_plots.bar_plot(belief, ylim=(0, .3))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    " We can see from the output that the sum is now 1.0, and that the probability of a door vs wall is still three times larger. The result also fits our intuition that the probability of a door must be less than 0.333, and that the probability of a wall must be greater than 0.0. Finally, it should fit our intuition that we have not yet been given any information that would allow us to distinguish between any given door or wall position, so all door positions should have the same value, and the same should be true for wall positions.\n",
    " \n",
    "This result is called the [*posterior*](https://en.wikipedia.org/wiki/Posterior_probability), which is short for *posterior probability distribution*. All this means is a probability distribution *after* incorporating the measurement information (posterior means 'after' in this context). To review, the *prior* is the probability distribution before including the measurement's information. \n",
    "\n",
    "Another term is the [*likelihood*](https://en.wikipedia.org/wiki/Likelihood_function). When we computed `belief[hall==z] *= scale` we were computing how *likely* each position was given the measurement. The likelihood is not a probability distribution because it does not sum to one.\n",
    "\n",
    "The combination of these gives the equation\n",
    "\n",
    "$$\\mathtt{posterior} = \\frac{\\mathtt{likelihood} \\times \\mathtt{prior}}{\\mathtt{normalization}}$$ \n",
    "\n",
    "When we talk about the filter's output we typically call the state after performing the prediction the *prior* or *prediction*, and we call the state after the update either the *posterior* or the *estimated state*. \n",
    "\n",
    "It is very important to learn and internalize these terms as most of the literature uses them extensively.\n",
    "\n",
    "Does `scaled_update()` perform this computation? It does. Let me recast it into this form:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "def scaled_update(hall, belief, z, z_prob): \n",
    "    scale = z_prob / (1. - z_prob)\n",
    "    likelihood = np.ones(len(hall))\n",
    "    likelihood[hall==z] *= scale\n",
    "    return normalize(likelihood * belief)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This function is not fully general. It contains knowledge about the hallway, and how we match measurements to it. We always strive to write general functions. Here we will remove the computation of the likelihood from the function, and require the caller to compute the likelihood themselves.\n",
    "\n",
    "Here is a full implementation of the algorithm:\n",
    "\n",
    "```python\n",
    "def update(likelihood, prior):\n",
    "    return normalize(likelihood * prior)\n",
    "```\n",
    "\n",
    "Computation of the likelihood varies per problem. For example, the sensor might not return  just 1 or 0, but a `float` between 0 and 1 indicating the probability of being in front of a door. It might use computer vision and report a blob shape that you then probabilistically match to a door. It might use sonar and return a distance reading. In each case the computation of the likelihood will be different. We will see many examples of this throughout the book, and learn how to perform these calculations.\n",
    "\n",
    "FilterPy implements `update`. Here is the previous example in a fully general form:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0.188, 0.188, 0.062, 0.062, 0.062, 0.062, 0.062, 0.062, 0.188,\n",
       "       0.062])"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from filterpy.discrete_bayes import update\n",
    "\n",
    "def lh_hallway(hall, z, z_prob):\n",
    "    \"\"\" compute likelihood that a measurement matches\n",
    "    positions in the hallway.\"\"\"\n",
    "    \n",
    "    try:\n",
    "        scale = z_prob / (1. - z_prob)\n",
    "    except ZeroDivisionError:\n",
    "        scale = 1e8\n",
    "\n",
    "    likelihood = np.ones(len(hall))\n",
    "    likelihood[hall==z] *= scale\n",
    "    return likelihood\n",
    "\n",
    "belief = np.array([0.1] * 10)\n",
    "likelihood = lh_hallway(hallway, z=1, z_prob=.75)\n",
    "update(likelihood, belief)  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Incorporating Movement\n",
    "\n",
    "Recall how quickly we were able to find an exact solution when we incorporated a series of measurements and movement updates. However, that occurred in a fictional world of perfect sensors. Might we be able to find an exact solution with noisy sensors?\n",
    "\n",
    "Unfortunately, the answer is no. Even if the sensor readings perfectly match an extremely complicated hallway map, we cannot be 100% certain that the dog is in a specific position - there is, after all, a tiny possibility that every sensor reading was wrong! Naturally, in a more typical situation most sensor readings will be correct, and we might be close to 100% sure of our answer, but never 100% sure. This may seem complicated, but let's go ahead and program the math.\n",
    "\n",
    "First let's deal with the simple case - assume the movement sensor is perfect, and it reports that the dog has moved one space to the right. How would we alter our `belief` array?\n",
    "\n",
    "I hope that after a moment's thought it is clear that we should shift all the values one space to the right. If we previously thought there was a 50% chance of Simon being at position 3, then after he moved one position to the right we should believe that there is a 50% chance he is at position 4. The hallway is circular, so we will use modulo arithmetic to perform the shift."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAFb1JREFUeJzt3XmUXGWZx/HvjywQFptNOJKFteUQUQEjiAjmCEpwCY4HhDgCmRHUGaIowyA4How4HkbHAc9RVAZQEAUMEZ2AUZDBuI1AwiaEJiRASJoQFoEC3CDwzB/37XCpVFdVp95equv3OadO7u371nPfqu775LnvfeuWIgIzMzOzHDYZ7g6YmZnZ6OHCwszMzLJxYWFmZmbZuLAwMzOzbFxYmJmZWTYuLMzMzCwbFxZtQtI/SXpU0nOSthvu/rRC0nRJvaX1pZKmb0ScgyUty9o5s1FE0gRJ10iqSLpquPuzMSTtIikkjU3rP5N0wkbEmZLy55j8vbQyFxZDRNJKSX9Jf9hPSfqppMlNPncccC7wrojYMiL+OLi9HVoR8bqIWNSoXUoue5Se95uI2HNQO2fWBiQtSnll06pNRwE7AttFxNGSZkv67TB0MZuIOCIiLm3ULuXcw0rPW5Xy54uD20NzYTG03hcRWwKvAR4Fvt7k83YENgOWDnSHKgza77nvLMLMhoekXYCDgQBmVm3eGbgvItZl2ldLx/tg5yMbGfwLHgYR8VdgPjC172eSNpX0VUmr0iWPb6dhzNcCfcP9T0u6MbV/q6TFaYhzsaS3lmItkvQlSb8D/gzsJqlL0sWSHpH0sKR/729IUNJcSfMl/VDSs5Juk/TG0vaVkj4j6Q/AnySNlbSTpB9JelzSg5I+WWo/QdIl6YzqHuDNVftbf2YhaYykz0q6P+37VkmTJf06Nb8zjfocU+OSyl7ptT+dLq/MLG27RNL5aaToWUk3S9p9QL84s5HpeOAm4BJg/SUCSV8AzgKOScfMycC3gQPT+tOpXc3ck7ZNl9Sbjve1wHerd55GQX4n6espH90r6dDS9gHlo5QDvirpCUkPAO+p2t8iSSeW1k+S1JOO63sk7SfpMmAKcE16radrw0sqO0laIOlJSSsknVSKOVfSPEnfS3GXSprWyi+po0SEH0PwAFYCh6XlzYFLge+Vtn8NWABsC2wFXAOck7btQnE2Mjatbws8BRwHjAVmpfXt0vZFwCrgdWn7OOAnwAXAFsAOwC3Ax/rp61zgBYph1HHAacCDwLjSa7kDmAxMoChQb6VIYuOB3YAHgMNT+/8AfpP6PRm4G+jt5735V+AuYE9AwBtLryuAPUrPm94XJ/VzBfDZ1Id3AM8Ce6btlwBPAvun9+QHwJXD/Xfhhx+tPtLf/T8Db0rH7Y6lbXOB75fWZwO/rXp+vdwzHVgHfBnYFJhQY/+zU5tPp+PwGKACbJu2DygfAR8H7k25Ylvgl7wy/y0CTkzLRwMPU5ysCNgD2DltW59X0vouVXF+BXyTYjR4H+Bx4NDS+/ZX4N3AGOAc4Kbh/l23y2PYO9Apj/RH/hzwdDoI1wCvT9sE/AnYvdT+QODBtFx9QBwH3FIV//fA7LS8CDi7tG1H4G/lpEBRjPyyn77OLR9EFIXDI8DBpdfyj6XtBwCrqmKcCXw3LT8AzCht+yj9FxbLgCP76Ve9wuJgYC2wSWn7FcDctHwJcFFp27uBe4f778IPP1p5AG+jKCa2T+v3Ap8ubZ9LncKiidwzHXge2KxOH2anfKbSz24BjkvLA8pHwI3Ax0vb3kX/hcV1wCn99Gt9Xknru/TFoShaXgS2Km0/B7ik9L7dUNo2FfjLcP++2+Xh6+ND6/0RcUMa8jsS+JWkqcBLFKMYt0rqayuKSrmWnYCHqn72EDCxtL66tLwzxVnCI6X4m1S1qbZ+W0S8lC457FQn/k59Q6vJGIpRir7+lttX971sMnB/ne392QlYHREvVe2n/J6sLS3/GdhyI/ZjNpKcAFwfEU+k9cvTz85r8vmvpnHueTyKy7f1PBzpf+DkIerni3r5aKjyxZMR8WzVfsqXO6rzxWaSxkam+SqjmQuLYRDFrOSrJV1AccZxNfAX4HUR8XATIdZQHJxlU4Cfl3dTWl5NcYaw/QAOivWfWFEx2WpS2m9/8R+MiO5+Yj2S4vVNPp1SZ7+rgd0pLpcMxBpgsqRNSsXFFOC+AcYxawtpHsQHgTFp/gMUlyu2lvTGiLizxtOqv876CRrnnma+AnuiJJWKiykUl1dqxWiUj/ryRZ9m8kUt9fq9BthW0lal4mIKxWUVa5Enbw4DFY4EtgF60n+EFwLnSdohtZko6fB+QiwEXivpQ2ni5DEUQ3XX1mocEY8A1wP/JelVkjaRtLukt9fp5pskfSBNdPoURSK4qZ+2twDPpAleE9Lkq70l9U3SnAecKWkbSZOAT9TZ70XAFyV1p/fpDXr5vh2PUszfqOVmiiHd0yWNU3FfjPcBV9bZl1k7ez/FcP5UijkC+wB7UYwUHt/Pcx4FJkkaD8VoJAPLPf3ZAfhkOvaOTv1YWKthE/loXoo1SdI2wBl19nsRcJqkN6V8sYekvpOufvNFRKwG/g84R9Jmkt4AfIRi7pW1yIXF0LpG0nPAM8CXgBMiou8s/jMUk7BukvQMcAPFBMYNRHEfi/cC/wL8ETgdeG9pOLSW4ykmNd5DMdFzPsXHXvvzPxSTsPomiX4gIl7opz8vUvwnvg/FJM8nKA74rtTkCxTDjA9SJJTL6uz3XIrEcj3F+3QxxQRRKK57XqriUx8frOrD8xQftTsi7f+bwPERcW+dfZm1sxMo5jGtioi1fQ/gG8Dfq/ZHQ2+kGDlcK6kvXzSde+q4GeimOPa+BBwV9e+3Uy8fXUgxd+JO4DaKEd2aIuKqtL/LKSZr/4RiwicUcyY+l/LFaTWePoti3sUa4MfA5yPiF41eqDWmV14WMys+akUxSfLDw90XMxvZJM2mmEz5tuHui40MHrEwMzOzbJoqLCTNkLQs3USk3+tdko5KNyDxjUTMbD3nELPO0fBSSPpo5H3AO4FeYDEwKyLuqWq3FfBTiutmcyJiyaD02MzainOIWWdpZsRif2BFRDyQJshdSXEPhmpfBL5CcbcyM7M+ziFmHaSZ+1hM5JU3K+mluNPiepL2BSZHxLX9zL6lUql4lqjZCNPV1aXGrVrmHGI2ilXnkWYKi1qJZ/0Bnm6edB7FbV3NzKo5h5h1kGYuhfTyyrugVd+BcStgb2CRpJXAW4AFnnxlZolziFkHaWbEYjHQLWlXitudHgt8qG9jRFSA7fvWJS0CTqs38aqrq6u/TQ0tWVKEnTYtb84ZjLiO6Zg55YpbqVRydGcgRlQOgfb5vTvmyI85WHFHesx6eaThiEW6l/scijuh9QDzImKppLMlzWy5d2Y2qjmHmHWWpr6ELCIWUnXf94g4q5+201vvlpmNJs4hZp3Dd940MzOzbFxYmJmZWTYuLMzMzCwbFxZmZmaWjQsLMzMzy8aFhZmZmWXjwsLMzMyycWFhZmZm2TR1g6yhtu9ly+tsTbfy7anXBm4/rjtfh8ys49XPS9BMbnJesk7gEQszMzPLxoWFmZmZZePCwszMzLJxYWFmZmbZuLAwMzOzbFxYmJmZWTYuLMzMzCwbFxZmZmaWjQsLMzMzy6apwkLSDEnLJK2QdEaN7R+XdJekOyT9VtLU/F01s3blHGLWORoWFpLGAOcDRwBTgVk1DvrLI+L1EbEP8BXg3Ow9NbO25Bxi1lmaGbHYH1gREQ9ExPPAlcCR5QYR8UxpdQsg8nXRzNqcc4hZB1FE/eNX0lHAjIg4Ma0fBxwQEXOq2p0MnAqMB94REa/4Jp5KpbJ+R8uX1/8yn5N6ugbwEmq7cK9KyzHMRqPu7pe/CKurq0uDvb/hyCGDwXnJ7GX18kgz325aK/FsUI1ExPnA+ZI+BHwOOGFg3TRw8rJRyTlkFHBusmY1U1j0ApNL65OANXXaXwl8q17AadOm1d9jg69Eb0bDfVRZsmTJRj0ve8xOfu2OOSRxK5UhT+5Dn0Ma8LG5ETGH+PWPqNc+DHFHesx6eaSZORaLgW5Ju0oaDxwLLCg3kNRdWn0PMPTjlGY2UjmHmHWQhiMWEbFO0hzgOmAM8J2IWCrpbGBJRCwA5kg6DHgBeAoPYZpZ4hxi1lmauRRCRCwEFlb97KzS8imZ+2Vmo4hziFnn8J03zczMLBsXFmZmZpaNCwszMzPLxoWFmZmZZePCwszMzLJxYWFmZmbZuLAwMzOzbFxYmJmZWTYuLMzMzCwbFxZmZmaWjQsLMzMzy8aFhZmZmWXjwsLMzMyycWFhZmZm2biwMDMzs2xcWJiZmVk2LizMzMwsGxcWZmZmlo0LCzMzM8umqcJC0gxJyyStkHRGje2nSrpH0h8k/a+knfN31czalXOIWedoWFhIGgOcDxwBTAVmSZpa1ex2YFpEvAGYD3wld0fNrD05h5h1FkVE/QbSgcDciDg8rZ8JEBHn9NN+X+AbEXFQ+eeVSmX9jpYvX153nyf1dDXT97ou3KvScozh0Mmv3YZGd3f3+uWuri4N9v6GI4cMhk4/Njv99dsr1csjY5t4/kRgdWm9FzigTvuPAD8bQP/alg80s6Y4hwwx5yYbTs0UFrXOaGoOc0j6MDANeHu9gNOmTau/x57Wz0Ya7qPKkiVLBv68wehnu7x2xxzSmDnjVipD/h/G0OeQBkbM8d7ARv/OR0Fu6sRjs51i1ssjzRQWvcDk0vokYE11I0mHAf8GvD0i/jbAPprZ6OUcYtZBmvlUyGKgW9KuksYDxwILyg3SNdELgJkR8Vj+bppZG3MOMesgDQuLiFgHzAGuA3qAeRGxVNLZkmamZv8JbAlcJekOSQv6CWdmHcY5xKyzNHMphIhYCCys+tlZpeXDMvfLzEYR5xCzzuE7b5qZmVk2LizMzMwsGxcWZmZmlo0LCzMzM8vGhYWZmZll48LCzMzMsnFhYWZmZtm4sDAzM7NsXFiYmZlZNi4szMzMLBsXFmZmZpaNCwszMzPLxoWFmZmZZePCwszMzLJxYWFmZmbZuLAwMzOzbFxYmJmZWTYuLMzMzCybpgoLSTMkLZO0QtIZNbYfIuk2SeskHZW/m2bWzpxDzDpHw8JC0hjgfOAIYCowS9LUqmargNnA5bk7aGbtzTnErLMoIuo3kA4E5kbE4Wn9TICIOKdG20uAayNifvW2SqWyfkfLly+vu8+Terqa6Hp9F+5VaTlGI4PRz3Z57da+uru71y93dXVpsPc3HDlkMLTTsencZIOtXh4Z28TzJwKrS+u9wAFZejaEfFCYDZtRkUMGS6u5yXnJRppmCotaZzT1hzkamDZtWv0GPa2fjWywj06O2cCSJUs26nmOOXQxc8atVIb8P6KhzyENbNR7OVjHZotxByNmzbhDnJs68dhsp5j18kgzkzd7gcml9UnAmhb7ZGadwznErIM0U1gsBrol7SppPHAssGBwu2Vmo4hziFkHaVhYRMQ6YA5wHdADzIuIpZLOljQTQNKbJfUCRwMXSFo6mJ02s/bhHGLWWZqZY0FELAQWVv3srNLyYorhTTOzDTiHmHUO33nTzMzMsnFhYWZmZtm4sDAzM7NsXFiYmZlZNi4szMzMLBsXFmZmZpaNCwszMzPLxoWFmZmZZdPUDbLMbPDte1mjL3lK34JZ58ugbj+uu99tncTvpdnw8YiFmZmZZePCwszMzLJxYWFmZmbZuLAwMzOzbFxYmJmZWTYuLMzMzCwbFxZmZmaWjQsLMzMzy8aFhZmZmWXTVGEhaYakZZJWSDqjxvZNJf0wbb9Z0i65O2pm7cs5xKxzNCwsJI0BzgeOAKYCsyRNrWr2EeCpiNgDOA/4cu6Omll7cg4x6yyKiPoNpAOBuRFxeFo/EyAizim1uS61+b2kscBa4NVRCl6pVOrvyMyGXFdXlwZ7H84hZqNbdR5p5lLIRGB1ab03/axmm4hYB1SA7Ta+m2Y2ijiHmHWQZgqLWmc01WcOzbQxs87kHGLWQZr52vReYHJpfRKwpp82vWkYswt4stxgKIZczWxEcg4x6yDNjFgsBrol7SppPHAssKCqzQLghLR8FHBjNJq8YWadwjnErIM0LCzS9c45wHVADzAvIpZKOlvSzNTsYmA7SSuAU4ENPk6WS6OPrW1EvO9IekzS3Tn6l2JOlvRLST2Slko6JUPMzSTdIunOFPMLOfqaYo+RdLukazPGXCnpLkl3SFqSKebWkuZLuje9twe2GG/P1L++xzOSPpWhn59Ov6O7JV0habMMMU9J8Zbm6ONQGu05JMV0HsmcR5xD2jiHRETbPIAxwP3AbsB44E5gaosxDwH2A+7O2M/XAPul5a2A+zL0U8CWaXkccDPwlkz9PRW4HLg243uwEtg+8+//UuDEtDwe2Drz39ZaYOcW40wEHgQmpPV5wOwWY+4N3A1sTnH58gagO+d72ymPwcghKa7zSOY84hzSvjmk3e68uT+wIiIeiIjngSuBI1sJGBG/pupabqsi4pGIuC0tP0txllY9C36gMSMinkur49Kj5aFiSZOA9wAXtRprMEl6FUXyvhggIp6PiKcz7uJQ4P6IeChDrLHAhDRXYHM2nE8wUHsBN0XEn6M4+/8V8HctxuxU2XMIOI+0Qx5xDhm6HNJuhUUzH1sbUdIdBPelODNoNdYYSXcAjwG/iIiWYwJfA04HXsoQqyyA6yXdKumjGeLtBjwOfDcNt14kaYsMcfscC1zRapCIeBj4KrAKeASoRMT1LYa9GzhE0naSNgfezSsnQ1rz2i6HQMfmEeeQNs0h7VZYtNVH0iRtCfwI+FREPNNqvIh4MSL2oZhVv7+kvVvs33uBxyLi1lb7VsNBEbEfxd0WT5Z0SIvxxlIMNX8rIvYF/kSm6/BpQuFM4KoMsbahOAPeFdgJ2ELSh1uJGRE9FHei/AXwc4rh+3UtdrVTtVUOgY7OI84hbZpD2q2waOZjayOCpHEUyeAHEXF1zthp+G4RMKPFUAcBMyWtpBgSfoek77cYE4CIWJP+fQz4McUQdCt6gd7S2dV8iiSRwxHAbRHxaIZYhwEPRsTjEfECcDXw1laDRsTFEbFfRBxCMeS+vNWYHaptcgh0dh5xDmnfHNJuhUUzH1sbdpJEcR2vJyLOzRTz1ZK2TssTKP747m0lZkScGRGTImIXivfyxohoqTJO/dtC0lZ9y8C7KIbiWunrWmC1pD3Tjw4F7mmpoy+bRYYhzGQV8BZJm6e/g0Mpro23RNIO6d8pwAfI199O0xY5BDo7jziHtHcOaeYGWSNGRKyT1PextTHAdyJiaSsxJV0BTAe2l9QLfD4iLm6xqwcBxwF3pWuZAJ+NiIUtxHwNcKmKL3TahOIje9k+HprZjsCPi2OCscDlEfHzDHE/Afwg/YfwAPAPrQZM1xvfCXys1VgAEXGzpPnAbRRDjbcD/50h9I8kbQe8AJwcEU9liNlxBiOHgPPIIHAOaeMc0vBLyMzMzMya1W6XQszMzGwEc2FhZmZm2biwMDMzs2xcWJiZmVk2LizMzMwsGxcWZmZmlo0LCzMzM8vGhYWZmZll8/+qrdmaoWbUiwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db5493f9b0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def perfect_predict(belief, move):\n",
    "    \"\"\" move the position by `move` spaces, where positive is \n",
    "    to the right, and negative is to the left\n",
    "    \"\"\"\n",
    "    n = len(belief)\n",
    "    result = np.zeros(n)\n",
    "    for i in range(n):\n",
    "        result[i] = belief[(i-move) % n]\n",
    "    return result\n",
    "        \n",
    "belief = np.array([.35, .1, .2, .3, 0, 0, 0, 0, 0, .05])\n",
    "plt.subplot(121)\n",
    "book_plots.bar_plot(belief, title='Before prediction', ylim=(0, .4))\n",
    "\n",
    "belief = perfect_predict(belief, 1)\n",
    "plt.subplot(122)\n",
    "book_plots.bar_plot(belief, title='After prediction', ylim=(0, .4))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see that we correctly shifted all values one position to the right, wrapping from the end of the array back to the beginning. \n",
    "\n",
    "If you execute the next cell by pressing CTRL-Enter in it you can see this in action. This simulates Simon walking around and around the hallway. It does not (yet) incorporate new measurements so the probability distribution does not change."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            if (mpl.ratio != 1) {\n",
       "                fig.send_message(\"set_dpi_ratio\", {'dpi_ratio': mpl.ratio});\n",
       "            }\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        fig.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var backingStore = this.context.backingStorePixelRatio ||\n",
       "\tthis.context.webkitBackingStorePixelRatio ||\n",
       "\tthis.context.mozBackingStorePixelRatio ||\n",
       "\tthis.context.msBackingStorePixelRatio ||\n",
       "\tthis.context.oBackingStorePixelRatio ||\n",
       "\tthis.context.backingStorePixelRatio || 1;\n",
       "\n",
       "    mpl.ratio = (window.devicePixelRatio || 1) / backingStore;\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width * mpl.ratio);\n",
       "        canvas.attr('height', height * mpl.ratio);\n",
       "        canvas.attr('style', 'width: ' + width + 'px; height: ' + height + 'px;');\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'] / mpl.ratio;\n",
       "    var y0 = (fig.canvas.height - msg['y0']) / mpl.ratio;\n",
       "    var x1 = msg['x1'] / mpl.ratio;\n",
       "    var y1 = (fig.canvas.height - msg['y1']) / mpl.ratio;\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x * mpl.ratio;\n",
       "    var y = canvas_pos.y * mpl.ratio;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    var width = fig.canvas.width/mpl.ratio\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\" width=\"' + width + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var width = this.canvas.width/mpl.ratio\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\" width=\"' + width + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        event.shiftKey = false;\n",
       "        // Send a \"J\" for go to next cell\n",
       "        event.which = 74;\n",
       "        event.keyCode = 74;\n",
       "        manager.command_mode();\n",
       "        manager.handle_keydown(event);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA+gAAAD6CAYAAAAyVW3pAAAgAElEQVR4Xu2dDbRl5Vnf/3Mvs9LCHAgYJiXGUQZpgxMZ4wISQ2vTrNQA2tbGBPlcEIWSVtu62lQ+TK22IOhytUaNbZmSspLw1djarAawpJpEK5gmlSSFQvkYYaoooDbhlNg4c2e6ntx9J4fj3Hufc/bZ73728/7OWq64hnefu5/f/j/7vL/z7r3PFvGCAAQgAAEIQAACEIAABCAAAQhAoHcCW3rfA3YAAhCAAAQgAAEIQAACEIAABCAAASHohAACEIAABCAAAQhAAAIQgAAEIBCAAIIe4CCwCxCAAAQgAAEIQAACEIAABCAAAQSdDEAAAhCAAAQgAAEIQAACEIAABAIQQNADHAR2AQIQgAAEIAABCEAAAhCAAAQggKCTAQhAAAIQgAAEIAABCEAAAhCAQAACCHqAg8AuQAACEIAABCAAAQhAAAIQgAAEEHQyAAEIQAACEIAABCAAAQhAAAIQCEAAQQ9wENgFCEAAAhCAAAQgAAEIQAACEIAAgk4GIAABCEAAAhCAAAQgAAEIQAACAQgg6AEOArsAAQhAAAIQgAAEIAABCEAAAhBA0MkABCAAAQhAAAIQgAAEIAABCEAgAAEEPcBBYBcgAAEIQAACEIAABCAAAQhAAAIIOhmAAAQgAAEIQAACEIAABCAAAQgEIICgBzgI7AIEIAABCEAAAhCAAAQgAAEIQABBJwMQgAAEIAABCEAAAhCAAAQgAIEABBD0AAeBXYAABCAAAQhAAAIQgAAEIAABCEQT9G2Srpd0vqQTJD0q6SZJd854qOw9fkTSw5JeO+O2DIcABCAAAQhAAAIQgAAEIAABCBQnEE3Q75N0pqRrJD0m6SJJV0i6WNLtTjrfIuk3JX1B0h8g6E5qDIMABCAAAQhAAAIQgAAEIACBXglEEvTzJN3dSPkdE1RM2ndJ2iFpZRNaR0n6tKRfk7Rb0isQ9F7zxR+HAAQgAAEIQAACEIAABCAAASeBSIK+R9IFko6XdGBi/y9sVs/PlnT/JnW9R9KVjdB/dD1BP3To0PJ4PD518r22bNnyR5IOObkxDAIQgAAEIAABCEAAApEIbDl06JDdInr4NRqNHt+yZctmC1yRamBfIFA9gUiC/oCkZUlnTR0VWz1/SNJVkm7e4Ih9k6TfkvQ2SfdI+sR6gv7CCy+85uDBg49Uf/QBAAEIQAACEIAABCCQlsDS0tJpxx57rD3TiRcEIDAQApEE3e453yvpnCl2J0l6RtJ1km5ch+tSs7pu29t96/ZC0AcSQnYTAhCAAAQgAAEIQGDxBBD0xTPlHSHQNYFogv6kpHPXEfRrmye6H4nJuyXZfz9N0nMIetex4f0hAAEIQAACEIAABKITQNCjHyH2DwJ/mkAkQZ/3End7eJxdumNPfv/ARIl2D7rdh/NGSV+W9Mdr/41L3GkFCEAAAhCAAAQgAIHsBBD07EeY+jISiCTodn+5PRBu+iFx9uA4e6r7eg+Je5Okj29ycN4r6YfWxozH4+0rKyvPTm5zzDHHaGnJrpTP9Xr44Yd14MABHXXUUdq1y27nr+8FA6l2BrXXb11fO4Pa6ycD9AAZWJ3/ZD4XHDx4UC+++OJLJnrLy8uvHI1Ga1eX1jcJpGIIDJBAJEG3S9vt4W4m5HdNsLxX0ukb/MzayyXZb59Pv35G0nGS3inpdyQ9MSHoJ66srLzkZDUajVIK+uc+9znt379fW7du1e7d9stz9b1gINXOoPb6retrZ1B7/WSAHiADq/OfzOcCE/TxeDwt6NtHo9Hz9c3+qBgCwyUQSdCNov3m+RmSrm6E2lbU7WfTLpF0W4P5FkmXSTpF0tMboF/3IXHj8RhBH25mZ97zzB/GXhi1M6i9/uyTUk8fkIHcYkIGPATIQPZzIYLu6wNGQSA6gWiCvk3SDZLOb+4ft3vL7cntd06AvLUR9JMlPYWgbxwxJqVMSLJPSDwnWfqAPiADZIAMkIHsn4cIumdGwBgIxCcQTdCLEGMFvQjmMH+ESRmTMjJABsgAGSADZABBDzM1Y0cgAIENCCDoDRzuQc/bJ0zKmJSRATJABsgAGSADCHreuR6VQSATAQQdQc+U5yPWwqSMSRkZIANkgAyQATKAoKef8lEgBFIQQNAR9BRB3qgIJmVMysgAGSADZIAMkAEEPf2UjwIhkIIAgo6gpwgygr7xYax9Ylp7/dknpZ6TGBlAzsgAGch+LuQhcZ5PA8ZAID4BBB1Bj5/SlnvIpIxJGRkgA2SADJABMoCgt5xQsTkEIFCEAIKOoBcJWp9/hEkZkzIyQAbIABkgA2QAQe9zNsbfhgAEvAQQdATdm5XBjmNSxqSMDJABMkAGyAAZQNAHO5VjxyFQFQEEHUFPH3gmZUzKyAAZIANkgAyQAQQ9/ZSPAiGQggCCjqCnCPJGRTApY1JGBsgAGSADZIAMIOjpp3wUCIEUBBB0BD1FkBH0jQ9j7RPT2uvPPin1nMTIAHJGBshA9nMhT3H3fBowBgLxCSDoCHr8lLbcQyZlTMrIABkgA2SADJABBL3lhIrNIQCBIgQQdAS9SND6/CNMypiUkQEyQAbIABkgAwh6n7Mx/jYEIOAlgKAj6N6sDHYckzImZWSADJABMkAGyACCPtipHDsOgaoIIOgIeq+Bf90HH+/17y/6jz946amLfsuFvF/tE9Pa688+KfU0CRlAzsgAGch+LuQedM+nAWMgEJ8Ago6g95pSBL0M/tonprXXn31S6ukiMoCckQEykP1ciKB7Pg0YA4H4BBB0BL3XlCLoZfDXPjGtvf7sk1JPF5EB5IwMkIHs50IE3fNpwBgIxCeAoCPovaYUQS+Dv/aJae31Z5+UerqIDCBnZIAMZD8XIuieTwPGQCA+AQQdQe81pQh6Gfy1T0xrrz/7pNTTRWQAOSMDZCD7uRBB93waMAYC8Qkg6Ah6rylF0Mvgr31iWnv92Selni4iA8gZGSAD2c+FCLrn04AxEIhPAEFH0HtNKYJeBn/tE9Pa688+KfV0ERlAzsgAGch+LkTQPZ8GjIFAfAIIOoLea0oR9DL4a5+Y1l5/9kmpp4vIAHJGBshA9nMhgu75NGAMBOITQNAR9F5TiqCXwV/7xLT2+rNPSj1dRAaQMzJABrKfCxF0z6cBYyAQnwCCjqD3mlIEvQz+2iemtdeffVLq6SIygJyRATKQ/VyIoHs+DRgDgfgEEHQEvdeUIuhl8Nc+Ma29/uyTUk8XkQHkjAyQgeznQgTd82nAGAjEJ4CgI+i9phRBL4O/9olp7fVnn5R6uogMIGdkgAxkPxci6J5PA8ZAID4BBB1B7zWlCHoZ/LVPTGuvP/uk1NNFZAA5IwNkIPu5EEH3fBowBgLxCSDoCHqvKUXQy+CvfWJae/3ZJ6WeLiIDyBkZIAPZz4UIuufTgDEQiE8gmqBvk3S9pPMlnSDpUUk3SbpzE5RvkXS1pF2SvkbSFyU9JOmnJd0zve14PD5xZWXlucl/H41GWlpain/EZtzD6BMSBH3GAzrn8Og5mLMs92a11599UuoJAhlAzsgAGch+LkTQPZ8GjIFAfALRBP0+SWdKukbSY5IuknSFpIsl3b4Bzu+V9G2SHpD0+43cv0vSd0i6VNKHJrdF0OMEE0Evcyxqn5jWXn/2Samni8gAckYGyED2cyGC7vk0YAwE4hOIJOjnSbq7kfI7JtCZtNvK+A5JKzMg3SrptyXtlfTtCPpW7d69ewZ8ZYYi6GU41z4xrb3+7JNSTxeRAeSMDJCB7OdCBN3zacAYCMQnEEnQ90i6QNLxkg5MoLuwWT0/W9L9MyK1y9ztUvY3I+gI+ozZmWv4g5eeOtd2XW9U+8S09vqzT0o9/UMGkDMyQAaynwsRdM+nAWMgEJ9AJEG3y9OXJZ01hc1Wz020r5J08yZI7SZy+7/tzfhrJf3NZmX+8KZc4h4nmKyglzkWtU9Ma68/+6TU00VkADkjA2Qg+7kQQfd8GjAGAvEJRBJ0u+fcLkc/ZwrbSZKekXSdpBs3QfrLkt7ajHlB0uWSfml6myMJ+r59+2Qntmyv/fv3Hy5p61a76j/W6/LPHx1rh1ruza2nf6nlO3SzefQcdFP1V9+19vqNRO0Maq+fDNADZGD1MyHzucAedrxjh90R+tXX8vLy9tFo9HzXn7O8PwQgsDgC0QT9SUnnriPothpuT3Tf6GXXF79ckkn9JZK+W9JlkibvadeRBH3v3r1aWZnlFvfFHYSa3+nKR45LVf6e0+wHBHhBAAIQgAAEIACBsgSWl5e1c+dOBL0sdv4aBBZOIJKgL+IS92lA90p6vaRXSDq8PM4K+sJzNPcbsoI+N7qZNsy8YuABEb1++sBzFNuNiZ6BdtX5tq6dQe31W0pgkJsBK+i+cyGjIBCdQCRBt/vL7YFw0w+JswfH2Qr4PA+J+3FJPyrpz0l6du1gcA96nFhyD3qZY1H7vZfR66cPuu+D6BnongD3H5MBMmB9ljkH3INe4kzK34BA9wQiCbpd2n5P8yT3uyZKt1Xw0+f4mTWr7eOS7LfFTpx8MjyC3n2wvH8BMfGSajcu84TEQyZ6/fSB5yi2GxM9A+2q821dO4Pa688up74uQNC9nBgHAQj0RyCSoBsF+83zMyRdLemJZkX9yuZ+8tsaTLc095WfIunp5t8+Yl+KSvqspD+U9KrmAXHfIekHJP3CJGIEvb/ATf9lxKTMsah9Yhq9fvqg+z6InoHuCeQWEw8/MkAGsn9JwQq650zAGAjEJxBN0LdJukHS+ZJOkPRo8+T2OydQ3toI+smSnmr+/YclvV3SN0o6VtIXJH1G0s9N/8SajUfQ4wQTMSlzLGqfmEavnz7ovg+iZ6B7AsgZGSADCHqJMw1/AwIQaEsgmqC3rce1PYLuwlRkEGJSBHPqe+48BKNPzOkDz1FsNyZ6BtpV59u6dga1159dTn1dkPtLClbQvSlgHARiE0DQm+MzGo1kT7/M9oo+IUFMyiQueg66phC9fvqg6wTknpR76UXvA28d846rvX4EfTU5mXOAoM97dmA7CMQigKAj6L0mEjEpgz/zhMRDMHr99IHnKLYbEz0D7arzbV07g9rrzy6nvi5A0L2cGAcBCPRHAEFH0PtLnyTEpAz+2iem0eunD7rvg+gZ6J5AbjHx8CMDZCD7lxSsoHvOBIyBQHwCCDqC3mtKEZMy+GufmEavnz7ovg+iZ6B7AsgZGSADCHqJMw1/AwIQaEsAQUfQ22ao1faISSt87o1rn5hGr58+cEd57oHRMzB3YTNsWDuD2uvPLqfeVsicA1bQvSlgHARiE0DQEfReE4qYlMGfeULiIRi9fvrAcxTbjYmegXbV+baunUHt9SPoq32SOQcIuu9cyCgIRCeAoCPovWYUMSmDP/OExEMwev30gecothsTPQPtqvNtXTuD2uvPLqe+LkDQvZwYBwEI9EcAQUfQ+0sfD4krxr72iWn0+hH07lshega6J5BbTDz8yAAZyP4lBSvonjMBYyAQnwCCjqD3mlLEpAz+2iem0eunD7rvg+gZ6J4AckYGyACCXuJMw9+AAATaEkDQEfS2GWq1PWLSCp9749onptHrpw/cUZ57YPQMzF3YDBvWzqD2+rPLqbcVMueAFXRvChgHgdgEEHQEvdeEIiZl8GeekHgIRq+fPvAcxXZjomegXXW+rWtnUHv9CPpqn2TOAYLuOxcyCgLRCSDoCHqvGUVMyuDPPCHxEIxeP33gOYrtxkTPQLvqfFvXzqD2+rPLqa8LEHQvJ8ZBAAL9EUDQEfT+0sdD4oqxr31iGr1+BL37Voiege4J5BYTDz8yQAayf0nBCrrnTMAYCMQngKAj6L2mFDEpg7/2iWn0+umD7vsgega6J4CckQEygKCXONPwNyAAgbYEEHQEvW2GWm2PmLTC59649olp9PrpA3eU5x4YPQNzFzbDhrUzqL3+7HLqbYXMOWAF3ZsCxkEgNgEEHUHvNaGISRn8mSckHoLR66cPPEex3ZjoGWhXnW/r2hnUXj+CvtonmXOAoPvOhYyCQHQCCDqC3mtGEZMy+DNPSDwEo9dPH3iOYrsx0TPQrjrf1rUzqL3+7HLq6wIE3cuJcRCAQH8EEHQEvb/08ZC4Yuxrn5hGrx9B774VomegewK5xcTDjwyQgexfUrCC7jkTMAYC8Qkg6Ah6rylFTMrgr31iGr1++qD7Poiege4JIGdkgAwg6CXONPwNCECgLQEEHUFvm6FW2yMmrfC5N659Yhq9fvrAHeW5B0bPwNyFzbBh7Qxqrz+7nHpbIXMOWEH3poBxEIhNAEFH0HtNKGJSBn/mCYmHYPT66QPPUWw3JnoG2lXn27p2BrXXj6Cv9knmHCDovnMhoyAQnQCCjqD3mlHEpAz+zBMSD8Ho9dMHnqPYbkz0DLSrzrd17Qxqrz+7nPq6AEH3cmIcBCDQHwEEHUHvL308JK4Y+9onptHrR9C7b4XoGeieQG4x8fAjA2Qg+5cUrKB7zgSMgUB8Agg6gt5rShGTMvhrn5hGr58+6L4PomegewLIGRkgAwh6iTMNfwMCEGhLAEFH0NtmqNX2iEkrfO6Na5+YRq+fPnBHee6B0TMwd2EzbFg7g9rrzy6n3lbInANW0L0pYBwEYhNA0BH0XhOKmJTBn3lC4iEYvX76wHMU242JnoF21fm2rp1B7fUj6Kt9kjkHCLrvXMgoCEQngKAj6L1mFDEpgz/zhMRDMHr99IHnKLYbEz0D7arzbV07g9rrzy6nvi5A0L2cGAcBCPRHAEFH0PtLHw+JK8a+9olp9PoR9O5bIXoGuieQW0w8/MgAGcj+JQUr6J4zAWMgEJ9ANEHfJul6SedLOkHSo5JuknTnJijfJukdks6U9LWSnpX0G5J+TNLj09uOx+MTV1ZWnpv899FopKWlpfhHbMY9jD4hQUxmPKBzDo+egznLcm8WvX76wH0o5x4YPQNzFzbDhrUzqL3+7HLqbYXMOUDQvSlgHARiE4gm6Pc1kn2NpMckXSTpCkkXS7p9A5SfkvT7kv6jpL2Svk7Sdc3/vkHSw5PbIuhxQomYlDkWmSckHoLR66cPPEex3ZjoGWhXnW/r2hnUXj+CvtonmXOAoPvOhYyCQHQCkQT9PEl3N1J+xwQ4k/ZdknZIWlkH6HZJL1kRl/QqSU9J+kAj+Yc3RdDjxBIxKXMsMk9IPASj108feI5iuzHRM9CuOt/WtTOovf7scurrAgTdy4lxEIBAfwQiCfoeSRdIOl7SgQkkFzar52dLun9GVLaabpe4v3VyOwR9RoodDkdMOoQ78da1T0yj108fdN8H0TPQPYHcYuLhRwbIQPYvKVhB95wJGAOB+AQiCfoDkpYlnTWFzVbPH5J0laSbZ0C6s5Hz90r6Bwj6Vu3evXsGfGWGIiZlONc+MY1eP33QfR9Ez0D3BJAzMkAGEPQSZxr+BgQg0JZAJEG3e85txfucqaJOkvRMc0/5jc6Cj5L0MUnfKum1kv73ZoK+b98+2TeP2V779+8/XNLWrVvDlXf5548Ot09tdujW07/UZvPOto2eg84Kb944ev30QdcJkKJnoHsCMCADZMD6LHMO7GHHO3bYHaFffS0vL28fjUbPlzjH8DcgAIHFEIgm6E9KOncdQb+2eaL7ZpVbTbc2D5b7Hkkfmd7gSJe47927Vysr693ivtmf5L/PS+DKR46bd9OQ2+057Ysh9yvyTpEBCQaRE8q+QQACEBgGgeXlZe3caReQIujDOGLsJQSOTCCSoC/iEner599IulzSZZI+dKSyjyTorKD30yKsHJbhHnnFgAxIMOi+DyL3QPfVr/6F2hnUXj8ZyN8HrKCXOpvydyDQLYFIgm73l9sD4aYfEmcPjrOnum/2kLg1OX+npO+X9G/XQ8dD4roN1Szvzr23s9Caf2zkey/JgASD+bPt3TJyD3hraDuudga112/5gUFuBjwkru1Zku0hEINAJEG3S9vvaZ7kftcEnnslnb7Jz6xZHfYU+O9rHiZn//+6LwQ9RvhsLxCTMsci8qSMDNAHJbogcg+UqB85yy1m3gzRB7lzgKB7O4FxEIhNIJKgGyn7zfMzJF0t6YlmRf1KSZdIuq1BeUtz+fopkp5u/u3nJP2gpPc3oj5J/cuSHpz8BwQ9TiiRszLHIvKkjAwg6CW6IHIPlKgfQc8tZt4M0Qe5c4CgezuBcRCITSCaoG+TdIOk8yWdIOlRSfbk9jsnMNoD4Oz+8pMlPdX8u/3v16+D2iT+GxB0fmatRCs+eOmpJf7MzH8j8qQMQUfQZw70HBtE7oE5yplrk9oZ1F4/X9Kstk3mHCDoc50a2QgC4QhEE/QigFhBL4LZ9UeQMxem1oMiT0jIAILeOuCON4jcA47dX8iQ2hnUXn92OfU2SeYcIOjeFDAOArEJIOjN8RmNRrKnX2Z7Rf8gQs7KJC5yDsgAgl6iCyL3QIn6kbPcK6feDNEHuXOAoHs7gXEQiE0AQUfQe00oclYGf+RJGRlA0Et0QeQeKFE/gp5bzLwZog9y5wBB93YC4yAQmwCCjqD3mlDkrAz+yJMyMoCgl+iCyD1Qon4EPbeYeTNEH+TOAYLu7QTGQSA2AQQdQe81ochZGfyRJ2VkAEEv0QWRe6BE/Qh6bjHzZog+yJ0DBN3bCYyDQGwCCDqC3mtCkbMy+CNPysgAgl6iCyL3QIn6EfTcYubNEH2QOwcIurcTGAeB2AQQdAS914QiZ2XwR56UkQEEvUQXRO6BEvUj6LnFzJsh+iB3DhB0bycwDgKxCSDoCHqvCUXOyuCPPCkjAwh6iS6I3AMl6kfQc4uZN0P0Qe4cIOjeTmAcBGITQNAR9F4TipyVwR95UkYGEPQSXRC5B0rUj6DnFjNvhuiD3DlA0L2dwDgIxCaAoCPovSYUOSuDP/KkjAwg6CW6IHIPlKgfQc8tZt4M0Qe5c4CgezuBcRCITQBBR9B7TShyVgZ/5EkZGUDQS3RB5B4oUT+CnlvMvBmiD3LnAEH3dgLjIBCbAIKOoPeaUOSsDP7IkzIygKCX6ILIPVCifgQ9t5h5M0Qf5M4Bgu7tBMZBIDYBBB1B7zWhyFkZ/JEnZWQAQS/RBZF7oET9CHpuMfNmiD7InQME3dsJjINAbAIIOoLea0KRszL4I0/KyACCXqILIvdAifoR9Nxi5s0QfZA7Bwi6txMYB4HYBBB0BL3XhCJnZfBHnpSRAQS9RBdE7oES9SPoucXMmyH6IHcOEHRvJzAOArEJIOgIeq8JRc7K4I88KSMDCHqJLojcAyXqR9Bzi5k3Q/RB7hwg6N5OYBwEYhNA0BH0XhOKnJXBH3lSRgYQ9BJdELkHStSPoOcWM2+G6IPcOUDQvZ3AOAjEJoCgI+i9JhQ5K4M/8qSMDCDoJbogcg+UqB9Bzy1m3gzRB7lzgKB7O4FxEIhNAEFH0HtNKHJWBn/kSRkZQNBLdEHkHihRP4KeW8y8GaIPcucAQfd2AuMgEJsAgo6g95pQ5KwM/siTMjKAoJfogsg9UKJ+BD23mHkzRB/kzgGC7u0ExkEgNgEEHUHvNaHIWRn8kSdlZABBL9EFkXugRP0Iem4x82aIPsidAwTd2wmMg0BsAgg6gt5rQpGzMvgjT8rIAIJeogsi90CJ+hH03GLmzRB9kDsHCLq3ExgHgdgEEHQEvdeEImdl8EeelJEBBL1EF0TugRL1I+i5xcybIfogdw4QdG8nMA4CsQkg6Ah6rwlFzsrgjzwpIwMIeokuiNwDJepH0HOLmTdD9EHuHCDo3k5gHARiE0DQEfReE4qclcEfeVJGBhD0El0QuQdK1I+g5xYzb4bog9w5QNC9ncA4CMQmgKAj6L0mFDkrgz/ypIwMIOgluiByD5SoH0HPLWbeDNEHuXOAoHs7gXEQiE0AQUfQe00oclYGf+RJGRlA0Et0QeQeKFE/gp5bzLwZog9y5wBB93YC4yAQmwCCjqD3mlDkrAz+yJMyMoCgl+iCyD1Qon4EPbeYeTNEH+TOAYLu7QTGQSA2AQQdQe81ochZGfyRJ2VkAEEv0QWRe6BE/Qh6bjHzZog+yJ0DBN3bCYyDQGwC0QR9m6TrJZ0v6QRJj0q6SdKdm2B8taR3S3qdpN2SjpP0Tkm3Hmm78Xh84srKynOT/200GmlpaSn20Zpj76J/GCNncxzUOTaJnAMygKDPEemZN4ncAzMXM+cGtTOovX6+pFltnMw5QNDnPDmyGQSCEYgm6PdJOlPSNZIek3SRpCskXSzp9g3YvUnShyV9VtLzki5E0IfxQYSclTkjRJ6QkAEEvUQXRO6BEvVnFxMPQzKQW049GcjeBwi6NwWMg0BsApEE/TxJdzdSfscENpP2XZJ2SFpZB6ctfR9s/tsZkj6NoCPofbTeg5ee2sef3fRvRp6YIugI+qYBXsCAyD2wgPJcb1E7g9rrzy6nriZgBd2LiXEQgECPBCIJ+h5JF0g6XtKBCSa2Gm6r52dLut/BCkGfgBR9QoKcORK9gCGRc0AGEPQFRHzTt4jcA5vu/IIG1M6g9voR9GEsXLRpd1bQ29BjWwjEIRBJ0B+QtCzprCk8tnr+kKSrJN3sQIegI+iOmHQzhBX02bki6Aj67KmZfQvkjMubyQAZyP4lBYI++2cDW0AgIoFIgm73nO+VdM4UqJMkPSPpOkk3OiDOJej79u2Tndiyvfbv33+4pK1bt4Yr7/LPHx1un9rs0K2nf6nN5p1tGzkHZECCQWfRP/zGkXug++pX/0LtDGqvnwzk7wN72PGOHXZH6Fdfy8vL20ejkT2fiRcEIDAQAtEE/UlJ564j6Nc2T3TfDO1cgr53716trKx3i/tmf5L/Pi+BKx+xB+7nee057YszF5OJQe3128GHwXwMZm4cNoAABCAAgWkZ186dOxF0cgGBgROIJOi9XuLOCno/SWblMNfq6TxXEJCBXBmwM8k8Oej6DMTqKSvoZIAM2Hkmcw5YQe/6k4T3h0AZAmbksWsAABUDSURBVJEE3e4vtwfCTT8kzh4cZ0915yFxc2Qi+j133H+c6/7jee7BJwO5MmCnqXlyMMfpbaZNop8LZypmzsG1M6i9fosNDHIz4B70OU+ObAaBYAQiCbpd2n5P8yT3uyY43Svp9E1+Zm0S61yXuI9GI9k3j9le0T+MkbNccjaPmJGBXBlA0ON+ikT/POiaXO31I+irCcucAwS967MI7w+BMgQiCbpVbL95boJ9taQnmhX1KyVdIum2Bsktki6TdIqkpycwvb35/+3mm5+U9D5Jn2j+7RcncY7H4xNXVlaem/w3BL1M4Kb/CnKWS84Q9PlWj+mD7s8/mSflXnq1M6i9/uxySh/oKw87Ho/HL0HBQ+K8yWAcBOIQiCbo2yTdIOl8SSdIerR5cvudE8hubQT9ZElPTfz7oQ2wvqROBD1OABETBJ0M5MqAnV3m+aKm67MScpZ75dCTHzJABrJ/SYGge84EjIFAfALRBL0IMQS9CGbXH0HOcsnZPGJGBnJlAEF3nfp6GVS7oNZef3Y59TZV5hwg6N4UMA4CsQkg6M3x4RL3foKKnOWSMwR9vtVj+qD780/mSbmXXu0Maq8fQV/tlMw5QNC9Z0PGQSA2AQQdQe81oYgJgk4GcmWAFfReT6kb/vHMYuKhXnv92eXUk4HsDBB0bwoYB4HYBBB0BL3XhCJnueSMFXRW0BH0Xk+pCPoGBBD03KvH3s7LnAME3ZsCxkEgNgEEHUHvNaEIOoJOBnJlAEHv9ZSKoCPoZGCTFkTQ456j2DMIQGCVAIKOoPfaC8hZLjljBZ0VdAS911MqcoagkwEE/SUE+Jm1uOdk9gwC6xFA0BH0XrsDQUfQyUCuDCDovZ5SkTMEnQwg6Ah63NMwewYBFwEEHUF3BaWrQchZLjljBZ0VdAS9q7Nl+/fNfGmvh07t9RsjGORmwD3onjMBYyAQnwCCjqD3mlIEHUEnA7kygKD3ekpl9ZQVdDLACjor6HFPw+wZBFwEEHQE3RWUrgYhZ7nkjBV0VtAR9K7Olu3ft/bV09rrZwV9tYcy54AV9PbnSd4BAhEIIOgIeq85RNARdDKQKwMIeq+nVFZPWUEnA6ygs4Ie9zTMnkHARQBBR9BdQelqEHKWS85YQWcFHUHv6mzZ/n0zrxx66NRef/bVY08GsjNgBd2bAsZBIDYBBB1B7zWhCDqCTgZyZQBB7/WUyuopK+hkgBV0VtDjnobZMwi4CCDoCLorKF0NQs5yyRkr6KygI+hdnS3bv2/tK8i115999djbIZlzwAq6NwWMg0BsAgh6z4KeSVCRM+SMDJABBD3uh35mMfFQr71+BH01JZlzgKB7zgSMgUB8Agg6gr6wlCJnyBkZIAMI+sJOqQt/o8xi4oFVe/3Z5dSTgewMEHRvChgHgdgEEHQEfWEJRc6QMzJABhD0hZ1SF/5GtQtq7fVnl1Nvw2TOAYLuTQHjIBCbAIKOoC8socgZckYGyACCvrBT6sLfKLOYeGDVXj+CvpqSzDlA0D1nAsZAID4BBB1BX1hKkTPkjAyQAQR9YafUhb9RZjHxwKq9/uxy6slAdgYIujcFjINAbAIIOoK+sIQiZ8gZGSADCPrCTqkLf6PaBbX2+rPLqbdhMucAQfemgHEQiE0AQUfQF5ZQ5Aw5IwNkAEFf2Cl14W+UWUw8sGqvH0FfTUnmHCDonjMBYyAQnwCCjqAvLKXIGXJGBsgAgr6wU+rC3yizmHhg1V5/djn1ZCA7AwTdmwLGQSA2AQQdQV9YQpEz5IwMkAEEfWGn1IW/Ue2CWnv92eXU2zCZc4Cge1PAOAjEJoCgI+gLSyhyhpyRATKAoC/slLrwN8osJh5YtdePoK+mJHMOEHTPmYAxEIhPAEFH0BeWUuQMOSMDZABBX9gpdeFvlFlMPLBqrz+7nHoykJ0Bgu5NAeMgEJsAgo6gLyyhyBlyRgbIAIK+sFPqwt+odkGtvf7scuptmMw5QNC9KWAcBGITQNAR9IUlFDlDzsgAGUDQF3ZKXfgbZRYTD6za60fQV1OSOQcIuudMwBgIxCeAoCPoC0spcoackQEygKAv7JS68DfKLCYeWLXXn11OPRnIzgBB96aAcRCITSCaoG+TdL2k8yWdIOlRSTdJutOBcbukn5L0XZKOti9JJb1H0q9Mbzsej09cWVl5bvLfR6ORlpaWHH9msUNe98HHF/uGPb4bcoackQEygKD3eBLe5E/XLqi1159dTr2dlzkHCLo3BYyDQGwC0QT9PklnSrpG0mOSLpJ0haSLJd2+AcqXSfqMpJc325p8/4Ck75T0FkmfnNwWQe8mlMgZckYGyACC3s35dRHvmllMPHxqrx9BX01J5hwg6J4zAWMgEJ9AJEE/T9LdjZTfMYHOpH2XpB2SVtZB+nckvU/SGyU90Iw5qllF/7+SXo+gdx9G5Aw5IwNkAEHv/lw771/ILCYeJrXXn11OPRnIzgBB96aAcRCITSCSoO+RdIGk4yUdmMB2YbN6frak+9fB+TFJXyfpNVP//VpJPyHp1ZJ+d+2/jcfj7SsrK89Ojj3mmGN6ucT9zR/eGzshM+zdr75j5wyjV4dmqt/qqZ1B7fWTgdW+nicHM588Ztzg4Ycf1oEDB3TUUUdp1y77zre+V+0Maq/fEg+D3AxM0F988cWXnNyWl5dfORqNXnJbZ31nPyqGwLAIRBJ0W/lelnTWFEKbST0k6SpJN6+D9/ck/Xpz7/rkELvE/aOS3irJVuK/8nrhhRdec/DgwUeGdajYWwhAAAIQgAAEIAABCPgJLC0tnXbsscfaM514QQACAyEQSdDtnnNbTj5nit1Jkp6RdJ2kG9fh+ieS3i/pXVP//duaVXe7l/3wZfMI+kDSyW5CAAIQgAAEIAABCMxNAEGfGx0bQqA3AtEE/UlJ564j6Ha5uj3R/UgvE/RbJP3tdQTdLpM//CR4BL23vPGHIQABCEAAAhCAAAQKEUDQC4Hmz0BggQQiCTqXuC/wwPJWEIAABCAAAQhAAAJ1E0DQ6z7+VD9MApEE3e4vt5Xu6YfE2YPj7PL0jR4SZ/eX20PiTps6DPZzbXZZ/Nc2l8l/5T8fOnRoeTwenzo5dsuWLX9k/2mYh5G9hgAEIAABCEAAAhConMCWQ4cOnTDJYDQaPb5ly5b1fgWpclyUD4GYBCIJul3afk/zJPe7JnDdK+n0TX5mzS5t/wVJb5D0qWZb+5m1z0qyn1mzf+cFAQhAAAIQgAAEIAABCEAAAhAISyCSoBskWwk/Q9LVkp5oVtSvlHSJpNsainav+WWSTpH0dPNvL5P03yUdK8lWze3nJOy30f+apLdI+mTYI8COQQACEIAABCAAAQhAAAIQgAAEJEUT9G2Sbmh+Ls0u0bGfhbBL1A8/4E3SrY2gnyzpqYmj+EpJPyXpuyQd3aye/2NJ/6XSI20sr59iaQ/Zm2SZHc1IkmXgWyS9TtIrJP24pB/LXnhT35ubL7fe2NwC8gVJn5H0T5svtLJjsONu55NvlnSipD+W9L8kvU/Sh7IXv059V0jaI8l+KNfOEdlfb5L08XWKtF/5+M3sACbq+4vNr6FY3X9G0u9I+oCkf5acwdqcYb0ya8mBfQb+k+anbF8uaZ+k2yX9tKQvJc+AlWc/4WtZt89Dm/t+WtJ7JP1GBbVTIgQgMDAC0QR9YPhC765djXBmc0WB/YSd/dScTc4vbj6UQ+/8gnbuG5ovaj4nyRhY/TUJ+oclfY0k+9//2UjqP2yuUnmrpF9dEOeob2NyZs+w+K+SflfSMU3+7d/sixv7Aqumlz2L4+FGzo+rTNDtZzqnRf2h5haoGjJg5/8PSvp3zfnfbv2yq9Be1Xxhl5mB1Wlf0E2//pOkL0v6eknZ78/9puZLWfuC8ick/YGkb28E9W5JfyNzAJq50K9L+m+S/nkj6D/cfHH/VyTZQ4p5QQACEAhDAEEPcygWuiPnSbIP3Zf8/ntzC8GuTe7nX+iO9Pxma/m2h//Z6vnzlQn69uZ2j8nDYKumdvuIyYnd/lHjy1ZNTUx2VFa8CYn1gj0Q8+2VCfo7JP1iZcd7rVz7YsbEzFbL7dYvXtJflvSJ5ks6+7Iu+8u+jPwRSd8oyX7Odu31ryX9LUl2xeL/SQzhl5sr6XZOXC1gV9jtbb68t4cQ84IABCAQhgCCHuZQLHRH7BJWWyWcfiK+PSXfLmnb6In4C92RQG9Wo6Cvh99Wzm3S/hcCHZ+Su/JRSbaiZJO1Wl72HA97kKbVbZN1BL2WI796WbPd1mNXFK09t6We6o9cqX1ZYT1hq+u/XQGMtQzYlQS2er72+klJ726e32O3vWR9jZtFC5sXTb7+vaS3NV/Y/l7W4qkLAhAYHgEEfXjHzLPHbX5T3vP+QxyDoK8eNbu02SbpJuk2ManhtSTJ/s++sLKV1PdK+kFJtnpUw8uupLBbHH60kXS7J7c2QbcHh9rtHnavrZ0f7V5Uu/WhhtevNKuHdkWVCdlrm6so/oMku8z3hRogTNRo50CTMbv3+K9WUrt9OfNg80weewivXU1mVxHYszjsy4q/l5yD3cpgz9+xBwxPvmzBwhYu7JYvuy2QFwQgAIEQBBD0EIdh4Tth91vbpVvnTL3zSc3vwdv9mPbwvZpeCPrq0bYJ2fc2Pz1ov3xQw+tfSbqqKfRPJP2QpH9ZQ+FNjXZpt/W+PSTMLnGvSdDtwVg2KbfLmf+wucT3H0n685K+U9J/riAH9rBVu896f3Pety8o7Pkk9jyO35L0l5pcVIDiKyW+q+l/E7OaHpr6Gkm/JMn+d+31s8350M4LmV/25YQ9PPg0SQebQu2neO3WD7uSavp2wMwsqA0CEBgAAQR9AAdpjl00Qbf7zOy35Sdfa4J+rSR7ontNLwR9ddXQnlr7dyX9fEUH3+41t1Vk+z/76UW759JWkezpxdlf39Pc1mKiaqvo9qpJ0I90fO0J1v+jWUXenT0AzT22p0qaPu//fUk/06wi1/RrJ/b0bvsVGLvNx1ZWa3jZCvrHJD0r6V80K+ivbz4P7Au8708O4fsk2U/02hez9ssedkWVXfZ/uaTl5pbAu5IzoDwIQGBABBD0AR2sGXaVS9z/NKzaBX3tHkR7UJA9xbfml03S7In+9qA4u9Qz62vtgYB21cTkE+vtXvS/LunVzapq5ntP1zu2lgFbSbVVNfv5vcwv+zx4g6RvbS5zXqvVriKwFUT7ssp+orSG1+mS7Fc97DYXu5KmlpddKWBPK7fV4sl+f6ek90uyX7z4ZHIYlnP7gnrt5yWtL36tyb9dRVLLLS/JDzPlQSAHAQQ9x3GcruLm5r6q6YfE2QNS7uAhcdX8DvpaLtbk3B4UZZe11v5am5SatHwqMQxbNdvsAVgfkfTdiRmsV9rabQ9/VtL/S17/2pO6pwXdHhJpl7/bJf81XE1ih9nE3O63/ubmlyySH/rD5dlxtvvuTdInX/Y8AruaxJ7J8b4KYLxMkl1NYg+Ns2exWG/YT8/aw/Oyf1FXweGlRAjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHAIKe51hSCQQgAAEIQAACEIAABCAAAQgMmACCPuCDx65DAAIQgAAEIAABCEAAAhCAQB4CCHqeY0klEIAABCAAAQhAAAIQgAAEIDBgAgj6gA8euw4BCEAAAhCAAAQgAAEIQAACeQgg6HmOJZVAAAIQgAAEIAABCEAAAhCAwIAJIOgDPnjsOgQgAAEIQAACEIAABCAAAQjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHAIKe51hSCQQgAAEIQAACEIAABCAAAQgMmACCPuCDx65DAAIQgAAEIAABCEAAAhCAQB4CCHqeY0klEIAABCAAAQhAAAIQgAAEIDBgAgj6gA8euw4BCEAAAhCAAAQgAAEIQAACeQgg6HmOJZVAAAIQgAAEIAABCEAAAhCAwIAJIOgDPnjsOgQgAAEIQAACEIAABCAAAQjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHAIKe51hSCQQgAAEIQAACEIAABCAAAQgMmACCPuCDx65DAAIQgAAEIAABCEAAAhCAQB4CCHqeY0klEIAABCAAAQhAAAIQgAAEIDBgAgj6gA8euw4BCEAAAhCAAAQgAAEIQAACeQgg6HmOJZVAAAIQgAAEIAABCEAAAhCAwIAJIOgDPnjsOgQgAAEIQAACEIAABCAAAQjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHAIKe51hSCQQgAAEIQAACEIAABCAAAQgMmACCPuCDx65DAAIQgAAEIAABCEAAAhCAQB4CCHqeY0klEIAABCAAAQhAAAIQgAAEIDBgAgj6gA8euw4BCEAAAhCAAAQgAAEIQAACeQgg6HmOJZVAAAIQgAAEIAABCEAAAhCAwIAJIOgDPnjsOgQgAAEIQAACEIAABCAAAQjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHAIKe51hSCQQgAAEIQAACEIAABCAAAQgMmACCPuCDx65DAAIQgAAEIAABCEAAAhCAQB4CCHqeY0klEIAABCAAAQhAAAIQgAAEIDBgAgj6gA8euw4BCEAAAhCAAAQgAAEIQAACeQgg6HmOJZVAAAIQgAAEIAABCEAAAhCAwIAJIOgDPnjsOgQgAAEIQAACEIAABCAAAQjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHAIKe51hSCQQgAAEIQAACEIAABCAAAQgMmACCPuCDx65DAAIQgAAEIAABCEAAAhCAQB4CCHqeY0klEIAABCAAAQhAAAIQgAAEIDBgAgj6gA8euw4BCEAAAhCAAAQgAAEIQAACeQgg6HmOJZVAAAIQgAAEIAABCEAAAhCAwIAJIOgDPnjsOgQgAAEIQAACEIAABCAAAQjkIYCg5zmWVAIBCEAAAhCAAAQgAAEIQAACAyaAoA/44LHrEIAABCAAAQhAAAIQgAAEIJCHwP8HfPgIgK/R8ykAAAAASUVORK5CYII=\" width=\"800\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import time\n",
    "\n",
    "%matplotlib notebook\n",
    "set_figsize(y=2)\n",
    "fig = plt.figure()\n",
    "for _ in range(50):\n",
    "    # Simon takes one step to the right\n",
    "    belief = perfect_predict(belief, 1)\n",
    "    plt.cla()\n",
    "    book_plots.bar_plot(belief, ylim=(0, .4))\n",
    "    fig.canvas.draw()\n",
    "    time.sleep(0.05)\n",
    "    \n",
    "# reset to noninteractive plot settings\n",
    "%matplotlib inline\n",
    "set_figsize(y=2);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Terminology\n",
    "\n",
    "Let's pause a moment to review terminology. I introduced this terminology in the last chapter, but let's take a second to help solidify your knowledge. \n",
    "\n",
    "The *system* is what we are trying to model or filter. Here the system is our dog. The *state* is its current configuration or value. In this chapter the state is our dog's position. We rarely know the actual state, so we say our filters produce the *estimated state* of the system. In practice this often gets called the state, so be careful to understand the context.\n",
    " \n",
    "One cycle of prediction and updating with a measurement is called the state or system *evolution*, which is short for *time evolution* [7]. Another term is *system propagation*. It refers to how the state of the system changes over time. For filters, time is usually a discrete step, such as 1 second. For our dog tracker the system state is the position of the dog, and the state evolution is the position after a discrete amount of time has passed.\n",
    "\n",
    "We model the system behavior with the *process model*. Here, our process model is that the dog moves one or more positions at each time step. This is not a particularly accurate model of how dogs behave. The error in the model is called the *system error* or *process error*. \n",
    "\n",
    "The prediction is our new *prior*. Time has moved forward and we made a prediction without benefit of knowing the measurements. \n",
    "\n",
    "Let's work an example. The current position of the dog is 17 m. Our epoch is 2 seconds long, and the dog is traveling at 15 m/s. Where do we predict he will be in two seconds? \n",
    "\n",
    "Clearly,\n",
    "\n",
    "$$ \\begin{aligned}\n",
    "\\bar x &= 17 + (15*2) \\\\\n",
    "&= 47\n",
    "\\end{aligned}$$\n",
    "\n",
    "I use bars over variables to indicate that they are priors (predictions). We can write the equation for the process model like this:\n",
    "\n",
    "$$ \\bar x_{k+1} = f_x(\\bullet) + x_k$$\n",
    "\n",
    "$x_k$ is the current position or state. If the dog is at 17 m then $x_k = 17$.\n",
    "\n",
    "$f_x(\\bullet)$ is the state propagation function for x. It describes how much the $x_k$ changes over one time step. For our example it performs the computation $15 \\cdot 2$ so we would define it as \n",
    "\n",
    "$$f_x(v_x, t) = v_k t$$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Adding Uncertainty to the Prediction\n",
    "\n",
    "`perfect_predict()` assumes perfect measurements, but all sensors have noise. What if the sensor reported that our dog moved one space, but he actually moved two spaces, or zero? This may sound like an insurmountable problem, but let's model it and see what happens.\n",
    "\n",
    "Assume that the sensor's movement measurement is 80% likely to be correct, 10% likely to overshoot one position to the right, and 10% likely to undershoot to the left. That is, if the movement measurement is 4 (meaning 4 spaces to the right), the dog is 80% likely to have moved 4 spaces to the right, 10% to have moved 3 spaces, and 10% to have moved 5 spaces.\n",
    "\n",
    "Each result in the array now needs to incorporate probabilities for 3 different situations. For example, consider the reported movement of 2. If we are 100% certain the dog started from position 3, then there is an 80% chance he is at 5, and a 10% chance for either 4 or 6. Let's try coding that:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEfJJREFUeJzt3X+U5XVdx/Hny13wB9BYoKXsClijhz0cT3AmwSijpFisllNZB0qSTmKdI/bDfoF5lEizLKvTkczwB+YPiDRzsz2hpWa/ICZRY1lxNyR3QoISbqUlEu/+uN9dL+PszJ29nxnm3vt8nDOH7/fez33fz3dn5sX7++N+J1WFJElSC494uCcgSZImh42FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCymUJI7kpw9yuuSvCTJG4Z83Vcn+XCS/0rymtW+r6TJkOSbk9z2cM9Da2vzwz0Bjaeq+pVVDH8B8O/AV5Q3TpGmVlX9NfDUh3seWlsesdB6OAG41aZCml5JRtqRTbKp1Vy0tmwsptc3JLk1yb1J3pzkUQBJvivJR5Pcl+TvkjxtqRcnuTzJ2wbWz+jG35fkY0nO6h6/Gnge8PNJ/vtwTsFI2ri6U6SXLc6TJGclWUjyC0nuAt584LGB156c5ENdbuxOsmPguauTvC7JriSfA7714dg+rZ6NxfT6IeAc4GuBpwAvTXIa8Cbgx4BjgdcDO5M8crlCSY4H/gx4BfBVwM8C70ryuKq6CHg78OqqOrqq/mKNtkfSw+fL8qR7/GvoZ8IJ9E+JHpTkCOBPgfcBjwdeBLw9yeCpkh8EXgkcA/zNGs5fDdlYTK/XVtX+qvos/V/cC4CLgddX1Y1V9X9V9RbgC8AZK9R6LrCrqnZV1YNV9X5gHnj2Wm6ApA1jqTwBeBB4eVV9oar+Z9FrzgCOBn61qu6vqg8A7x14LcB7qupvu1z537XeCLVhYzG99g8s/wvwRPp7FT/THZa8L8l9wNbuueWcAHz/otd9E/CEtZi4pA1nqTwBuGeZhuCJwP6qenDRa48/RF2NCT8VMr22Diw/CbiT/i/xK6vqlaustR94a1Vd3GpyksbKUnkCsNwF23cCW5M8YqC5eBLwyYExXvA9hjxiMb1emGRLkq8CXgL8IXAV8ONJTk/fUUm+M8kxK9R6G/DdSc5Jsmngwq0ta70RkjaEpfJkJTcCn6N/YfcR3QXf3w1cu3bT1HqwsZhe76B/0dTt3dcrqmqe/nUWrwXuBfYBF61UqKr2A+fRD5R76B/B+Dn8+ZKmxZflyUovqKr7gR3AufTvc/O7wA9X1SfWcJ5aB/HWApKkw5XkDuD5fuJLB7hHKUmSmlmxsUjypiR3J7nlEM8nye8k2Zfk4929ECTpIHNEmh7DHLG4Gti+zPPnArPd1wuA140+LUkT5mrMkYlUVSd6GkSDVmwsqurDwGeXGXIe8AfVdwPw2CTev0DSQeaIND1a3MfieB56E5OF7rHPDA7q9XpeJSptMDMzM3m459BZMUfMEGljWpwjLS7eXCqYDABJq2GOSBOiRWOxwEPvuraFL911TZKGYY5IE6LFqZCdwCVJrgVOB3pV9ZnlXjAzM3PYbzY/Pw/A3NzcYddYr7qHU/PUt+4d+X1vvnB2VeM3yrZbc33q9nq9FtNpbVU5MkqGwPh836258WuuVd2NXnO5HFmxsUhyDXAWcFySBeDlwBEAVfV7wC76f8VyH/B54EdGnrGkiWKOSNNjxcaiqi5Y4fkCXthsRpImjjkiTQ/vvClJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpmaEaiyTbk9yWZF+SS5d4/klJPpjk5iQfT/Ls9lOVNK7MEGl6rNhYJNkEXAmcC2wDLkiybdGwlwLXVdWpwPnA77aeqKTxZIZI0yVVtfyA5BnA5VV1Trd+GUBVvWpgzOuB26vq17rxr6mqbxys0+v1Dr7R3r17223BhLl4z8zINa46uddgJppUs7OzB5dnZmay1u9nhkiTZ7kc2TzE648H9g+sLwCnLxpzOfC+JC8CjgLOPpyJSppIZoiW5I7UZBqmsVhqj2bxYY4LgKur6jXd3sZbk5xSVQ8uVXBubm6V0/yS+fn5kWusV93Dqrln9D2x1W7Dhtl2a65L3V5v3YN4Q2UIjM/3feJrrnPebfTfzXGquVyODHPx5gKwdWB9C3DnojE/ClwHUFV/DzwKOG5Vs5Q0qcwQaYoM01jcBMwmOSnJkfQvrNq5aMyngWcBJDmZfijc03KiksaWGSJNkRUbi6p6ALgEuB7YQ//K7d1Jrkiyoxv2M8DFST4GXANcVCtdFSppKpgh0nQZ5hoLqmoXsGvRYy8bWL4VOLPt1CRNCjNEmh7eeVOSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSM0M1Fkm2J7ktyb4klx5izA8kuTXJ7iTvaDtNSePMDJGmx4p/Nj3JJuBK4NuBBeCmJDu7P3N8YMwscBlwZlXdm+TxazVhSePFDJGmS6pq+QHJM4DLq+qcbv0ygKp61cCYVwOfrKo3HKpOr9c7+EZ79+4dcdqT6+I9MyPXuOrkXoOZaFLNzs4eXJ6Zmclav58ZokMx78bXcjkyzKmQ44H9A+sL3WODngI8JcnfJrkhyfbDnKukyWOGSFNkxVMhwFJ7NIsPc2wGZoGzgC3AXyc5paruW6rg3Nzcaub4EPPz8yPXWK+6h1Vzz+h7Yqvdhg2z7dZcl7q93rrv4W2oDIHx+b5PfM11zruN/rs5TjWXy5FhjlgsAFsH1rcAdy4x5j1V9cWq+hRwG/2QkCQzRJoiwzQWNwGzSU5KciRwPrBz0Zg/Ab4VIMlx9A9r3t5yopLGlhkiTZEVG4uqegC4BLge2ANcV1W7k1yRZEc37HrgP5LcCnwQ+Lmq+o+1mrSk8WGGSNNlmGssqKpdwK5Fj71sYLmAF3dfkvQQZog0PbzzpiRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnNDNVYJNme5LYk+5Jcusy45ySpJHPtpihp3Jkh0vRYsbFIsgm4EjgX2AZckGTbEuOOAX4CuLH1JCWNLzNEmi7DHLF4OrCvqm6vqvuBa4Hzlhj3y8Crgf9tOD9J488MkaZIqmr5AclzgO1V9fxu/ULg9Kq6ZGDMqcBLq+r7knwI+Nmqmh+s0+v1Dr7R3r17223BhLl4z8zINa46uddgJppUs7OzB5dnZmay1u9nhuhQzLvxtVyObB7i9UsFz8Ff8CSPAH4LuOjwpidpwpkh0hQZprFYALYOrG8B7hxYPwY4BfhQEoCvAXYm2bF4j+OAubnDvy5rfn5+5BrrVfewau4ZfU9stduwYbbdmutSt9db9z28DZUhMD7f94mvuc55t9F/N8ep5nI5Msw1FjcBs0lOSnIkcD6w88CTVdWrquOq6sSqOhG4AThkIEiaOmaINEVWbCyq6gHgEuB6YA9wXVXtTnJFkh1rPUFJ480MkabLMKdCqKpdwK5Fj73sEGPPGn1akiaJGSJND++8KUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKmZoRqLJNuT3JZkX5JLl3j+xUluTfLxJH+Z5IT2U5U0rswQaXqs2Fgk2QRcCZwLbAMuSLJt0bCbgbmqehrwTuDVrScqaTyZIdJ0GeaIxdOBfVV1e1XdD1wLnDc4oKo+WFWf71ZvALa0naakMWaGSFMkVbX8gOQ5wPaqen63fiFwelVdcojxrwXuqqpXDD7e6/UOvtHevXtHnffEunjPzMg1rjq512AmmlSzs7MHl2dmZrLW72eG6FDMu/G1XI5sHuL1SwXPkt1IkucCc8C3rGJ+kiabGSJNkWEaiwVg68D6FuDOxYOSnA38IvAtVfWF5QrOzc2tZo4PMT8/P3KN9ap7WDX3jL4nttpt2DDbbs11qdvrrfse3obKEBif7/vE11znvNvov5vjVHO5HBnmGoubgNkkJyU5Ejgf2Dk4IMmpwOuBHVV19whzlTR5zBBpiqzYWFTVA8AlwPXAHuC6qtqd5IokO7phvw4cDfxRko8m2XmIcpKmjBkiTZdhToVQVbuAXYsee9nA8tmN5yVpgpgh0vTwzpuSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpoZ6lMhkqTpdupbl7uZVXdr7hVueHXzhbPLPt/CuMxzknnEQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUzFCNRZLtSW5Lsi/JpUs8/8gkf9g9f2OSE1tPVNL4MkOk6bFiY5FkE3AlcC6wDbggybZFw34UuLeqvg74LeDXWk9U0ngyQ6TpkqpafkDyDODyqjqnW78MoKpeNTDm+m7M3yfZDNwFPK4Givd6veXfSNK6m5mZyVq/hxkiTbbFOTLMqZDjgf0D6wvdY0uOqaoHgB5w7OFPU9IEMUOkKTJMY7HUHs3iPYdhxkiaTmaINEWG+SNkC8DWgfUtwJ2HGLPQHcacAT47OGA9DrlK2pDMEGmKDHPE4iZgNslJSY4Ezgd2LhqzE3het/wc4AO10sUbkqaFGSJNkRUbi+585yXA9cAe4Lqq2p3kiiQ7umFvBI5Nsg94MfBlHydrZaWPrR1GvTcluTvJLS3m19XcmuSDSfYk2Z3kJxvUfFSSf0jysa7mL7WYa1d7U5Kbk7y3Yc07kvxTko8mmW9U87FJ3pnkE92/7TNGrPfUbn4Hvv4zyU81mOdPd9+jW5Jck+RRDWr+ZFdvd4s5rqdJz5CupjnSOEfMkDHOkKoamy9gE/DPwJOBI4GPAdtGrPlM4DTglobzfAJwWrd8DPDJBvMMcHS3fARwI3BGo/m+GHgH8N6G/wZ3AMc1/v6/BXh+t3wk8NjGP1t3ASeMWOd44FPAo7v164CLRqx5CnAL8Bj6py//Apht+W87LV9rkSFdXXOkcY6YIeObIeN2582nA/uq6vaquh+4FjhvlIJV9WEWncsdVVV9pqo+0i3/F/29tMVXwa+2ZlXVf3erR3RfIx8qTrIF+E7gDaPWWktJvoJ+eL8RoKrur6r7Gr7Fs4B/rqp/aVBrM/Do7lqBx/Dl1xOs1snADVX1+erv/f8V8D0j1pxWzTMEzJFxyBEzZP0yZNwai2E+trahdHcQPJX+nsGotTYl+ShwN/D+qhq5JvDbwM8DDzaoNaiA9yX5xyQvaFDvycA9wJu7w61vSHJUg7oHnA9cM2qRqvpX4DeATwOfAXpV9b4Ry94CPDPJsUkeAzybh14MqeGNXYbA1OaIGTKmGTJujcVYfSQtydHAu4Cfqqr/HLVeVf1fVX09/avqn57klBHn913A3VX1j6PObQlnVtVp9O+2+MIkzxyx3mb6h5pfV1WnAp+j0Xn47oLCHcAfNaj1lfT3gE8CnggcleS5o9Ssqj3070T5fuDP6R++f2DEqU6rscoQmOocMUPGNEPGrbEY5mNrG0KSI+iHwdur6o9b1u4O330I2D5iqTOBHUnuoH9I+NuSvG3EmgBU1Z3df+8G3k3/EPQoFoCFgb2rd9IPiRbOBT5SVf/WoNbZwKeq6p6q+iLwx8A3jlq0qt5YVadV1TPpH3LfO2rNKTU2GQLTnSNmyPhmyLg1FsN8bO1hlyT0z+PtqarfbFTzcUke2y0/mv4P3ydGqVlVl1XVlqo6kf6/5QeqaqTOuJvfUUmOObAMfAf9Q3GjzPUuYH+Sp3YPPQu4daSJfskFNDiE2fk0cEaSx3Q/B8+if258JEke3/33ScD30m6+02YsMgSmO0fMkPHOkGFukLVhVNUDSQ58bG0T8Kaq2j1KzSTXAGcBxyVZAF5eVW8ccapnAhcC/9SdywR4SVXtGqHmE4C3pP8HnR5B/yN7zT4e2thXA+/u/06wGXhHVf15g7ovAt7e/Q/hduBHRi3YnW/8duDHRq0FUFU3Jnkn8BH6hxpvBn6/Qel3JTkW+CLwwqq6t0HNqbMWGQLmyBowQ8Y4Q1b8I2SSJEnDGrdTIZIkaQOzsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNfP/Jbsb6AbUS8QAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db576f4780>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def predict_move(belief, move, p_under, p_correct, p_over):\n",
    "    n = len(belief)\n",
    "    prior = np.zeros(n)\n",
    "    for i in range(n):\n",
    "        prior[i] = (\n",
    "            belief[(i-move) % n]   * p_correct +\n",
    "            belief[(i-move-1) % n] * p_over +\n",
    "            belief[(i-move+1) % n] * p_under)      \n",
    "    return prior\n",
    "\n",
    "belief = [0., 0., 0., 1., 0., 0., 0., 0., 0., 0.]\n",
    "prior = predict_move(belief, 2, .1, .8, .1)\n",
    "book_plots.plot_belief_vs_prior(belief, prior)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "It appears to work correctly. Now what happens when our belief is not 100% certain?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0.  , 0.  , 0.  , 0.04, 0.38, 0.52, 0.06, 0.  , 0.  , 0.  ])"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEeFJREFUeJzt3X20ZXVdx/H3xwF8ALoWaCozItbVxSxWK1g3wSijpBhMh1VZC0qKVmKtJWZpD2AuJdIsy2q1JDOfMB9A0h4mmyVaavYkcRM1hhFnQnRuSFDCqbRE4tsfZ894uNy598yc35255+73a62zZu9zfue7v+fee77z3b+9zz6pKiRJklp4yOFOQJIkrR82FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGx6KEktyU5e5LnJXlJkjeO+byvT/KRJP+V5DUHul1J60OSb09yy+HOQ6vriMOdgKZTVf3qAQx/HvDvwNeUF06Requq/gZ48uHOQ6vLGQsdCicCN9tUSP2VZKId2SQbWuWi1WVj0V/fkuTmJHcneUuShwEkeWaSjye5J8nfJ/mmpZ6c5PIkbx9ZP6Mbf0+STyQ5q7v/KuDHgF9I8t8HcwhG0trVHSK9bHE9SXJWkoUkv5jkDuAte+8bee7JST7c1Y0dSbaOPHZVktcl2Z7ki8B3Ho7XpwNnY9FfPwKcA3wD8CTgpUlOA94M/CRwHPB6YFuShy4XKMkJwF8ArwC+Dvg54D1JHlVVFwHvAF5dVcdU1V+u0uuRdPg8qJ509z+GYU04keEh0X2SHAn8OfB+4NHAC4B3JBk9VPLDwCuBY4G/XcX81ZCNRX+9tqr2VNUXGL5xLwAuBl5fVddX1f9V1VuBLwNnrBDrOcD2qtpeVfdX1QeAeeAZq/kCJK0ZS9UTgPuBl1fVl6vqfxY95wzgGODXqureqvog8N6R5wL8WVX9XVdX/ne1X4TasLHorz0jy58FHsdwr+LF3bTkPUnuATZ1jy3nROAHFz3v24DHrkbiktacpeoJwF3LNASPA/ZU1f2LnnvCfuJqSvipkP7aNLL8eOB2hm/iV1bVKw8w1h7gbVV1cavkJE2VpeoJwHInbN8ObErykJHm4vHAp0fGeML3FHLGor+en2Rjkq8DXgK8C3gD8FNJTs/Q0Um+N8mxK8R6O/CsJOck2TBy4tbG1X4RktaEperJSq4HvsjwxO4juxO+nwVcs3pp6lCwseivdzI8aerW7vaKqppneJ7Fa4G7gd3ARSsFqqo9wHkMC8pdDGcwfh7/vqS+eFA9WekJVXUvsBU4l+F1bn4P+NGq+tQq5qlDIF5aQJJ0sJLcBjzXT3xpL/coJUlSMys2FknenOTOJDft5/Ek+d0ku5N8srsWgiTtYx2R+mOcGYurgC3LPH4uMNvdnge8bvK0JK0zV2EdWZeq6gkeBtGoFRuLqvoI8IVlhpwH/GENfRR4ZBKvXyBpH+uI1B8trmNxAg+8iMlCd9/nRwcNBgPPEpXWmJmZmRzuHDor1hFriLQ2La4jLU7eXKowWQAkHQjriLROtGgsFnjgVdc28tWrrknSOKwj0jrR4lDINuCSJNcApwODqvr8ck+YmZk56I3Nz88DMDc3d9AxDlVcYxqzpVZxB4NBi3RaO6A6MkkNgen5vRtz7cdcrbhrPeZydWTFxiLJ1cBZwPFJFoCXA0cCVNXvA9sZfovlbuBLwI9PnLGkdcU6IvXHio1FVV2wwuMFPL9ZRpLWHeuI1B9eeVOSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSM2M1Fkm2JLklye4kly7x+OOTfCjJjUk+meQZ7VOVNK2sIVJ/rNhYJNkAXAmcC2wGLkiyedGwlwLXVtWpwPnA77VOVNJ0soZI/ZKqWn5A8lTg8qo6p1u/DKCqXjUy5vXArVX1693411TVt47GGQwG+za0a9eudq9A0gGZnZ3dtzwzM5PV3p41RFp/lqsjR4zx/BOAPSPrC8Dpi8ZcDrw/yQuAo4GzDyZRSeuSNUTqkXEai6X2aBZPc1wAXFVVr+n2Nt6W5JSqun+pgHNzcweY5lfNz89PHONQxTWmMVtqFXcwGLRI50CsqRoC0/N7N+baj7lacdd6zOXqyDgnby4Am0bWNwK3LxrzE8C1AFX1D8DDgOMPKEtJ65U1ROqRcRqLG4DZJCclOYrhiVXbFo35HPB0gCQnMywKd7VMVNLUsoZIPbJiY1FV9wGXANcBOxmeub0jyRVJtnbDXgxcnOQTwNXARbXSWaGSesEaIvXLOOdYUFXbge2L7nvZyPLNwJltU5O0XlhDpP7wypuSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmhmrsUiyJcktSXYnuXQ/Y34oyc1JdiR5Z9s0JU0za4jUHyt+bXqSDcCVwHcDC8ANSbZ1X3O8d8wscBlwZlXdneTRq5WwpOliDZH6JVW1/IDkqcDlVXVOt34ZQFW9amTMq4FPV9Ub9xdnMBjs29CuXbsmTFvSwZqdnd23PDMzk9XenjVEWn+WqyMrzlgAJwB7RtYXgNMXjXkSQJK/AzYwLCLvO5hk++7inTMTx3jDyYMGmUjNWEOkHhmnsVhqj2bxNMcRwCxwFrAR+Jskp1TVPUsFnJubO5AcH2B+fn7iGIcq7kHF3Dn5ntiBvoY189qNeUjiDgaHvPFcUzUEpuf3bsy1H3O14q71mMvVkXFO3lwANo2sbwRuX2LMn1XVV6rqM8AtDIuEJFlDpB4Zp7G4AZhNclKSo4DzgW2Lxvwp8J0ASY5nOK15a8tEJU0ta4jUIys2FlV1H3AJcB2wE7i2qnYkuSLJ1m7YdcB/JLkZ+BDw81X1H6uVtKTpYQ2R+mWccyyoqu3A9kX3vWxkuYAXdTdJegBriNQfXnlTkiQ1Y2MhSZKasbGQJEnNjHWOhSRJrZ36tuWu29NdLHCFa/vceKGfSl5rnLGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpoZq7FIsiXJLUl2J7l0mXHPTlJJ5tqlKGnaWUOk/lixsUiyAbgSOBfYDFyQZPMS444Ffhq4vnWSkqaXNUTql3FmLJ4C7K6qW6vqXuAa4Lwlxv0K8GrgfxvmJ2n6WUOkHklVLT8geTawpaqe261fCJxeVZeMjDkVeGlV/UCSDwM/V1Xzo3EGg8G+De3atfy13/vs4p0zE8d4w8mDBplovZqd/ep3K8zMzGS1t2cN0f5Y76bXcnVknC8hW6rw7HuDJ3kI8NvARQeX3vTyTSGNxRoi9cg4jcUCsGlkfSNw+8j6scApwIeTADwG2JZk6+I9jr3m5g7+vKz5+fmJYzSLu8K37o3jQdtbjZgrWI2fqTHXyN/oEgaDQ97MrqkaAtPze1/3MQ9xvVvr781pirlcHRmnsbgBmE1yEvCvwPnAD+99sKoGwPF71/c3jSmpt6wh64Bfca5xrXjyZlXdB1wCXAfsBK6tqh1JrkiydbUTlDTdrCFSv4wzY0FVbQe2L7rvZfsZe9bkaUlaT6whUn945U1JktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzYzVWCTZkuSWJLuTXLrE4y9KcnOSTyb5qyQntk9V0rSyhkj9sWJjkWQDcCVwLrAZuCDJ5kXDbgTmquqbgHcDr26dqKTpZA2R+mWcGYunALur6taquhe4BjhvdEBVfaiqvtStfhTY2DZNSVPMGiL1SKpq+QHJs4EtVfXcbv1C4PSqumQ/418L3FFVrxi9fzAY7NvQrl27Js17Tbh458zEMd5w8mDVY0qjZmdn9y3PzMxktbdnDVkfrHcatVwdOWKM5y9VeJbsRpI8B5gDvuMA8pO0vllDpB4Zp7FYADaNrG8Ebl88KMnZwC8B31FVX14u4Nzc3IHk+ADz8/MTx2gWd+fke00P2t5qxFzBavxMjblG/kaXMBgc8j28NVVDYHp+72sq5jqod2v9vTlNMZerI+OcY3EDMJvkpCRHAecD20YHJDkVeD2wtarunCBXSeuPNUTqkRUbi6q6D7gEuA7YCVxbVTuSXJFkazfsN4BjgD9K8vEk2/YTTlLPWEOkfhnnUAhVtR3Yvui+l40sn904L0nriDVE6g+vvClJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzYx1SW9JkqbBqW9b7htTZ4b/rPCtqjdeONsuoR5yxkKSJDXjjIUkrTPutetwGmvGIsmWJLck2Z3k0iUef2iSd3WPX5/kCa0TlTS9rCFSf6zYWCTZAFwJnAtsBi5IsnnRsJ8A7q6qbwR+G/j11olKmk7WEKlfUlXLD0ieClxeVed065cBVNWrRsZc1435hyRHAHcAj6qR4IPBYPkNSTrkZmZmstrbsIZI69viOjLOoZATgD0j6wvdfUuOqar7gAFw3MGnKWkdsYZIPTJOY7HUHs3iPYdxxkjqJ2uI1CPjfCpkAdg0sr4RuH0/Yxa6acwZ4AujAw7FlKukNckaIvXIODMWNwCzSU5KchRwPrBt0ZhtwI91y88GPlgrnbwhqS+sIVKPrNhYdMc7LwGuA3YC11bVjiRXJNnaDXsTcFyS3cCLgAd9nKyVlT62dhDx3pzkziQ3tcivi7kpyYeS7EyyI8kLG8R8WJJ/TPKJLuYvt8i1i70hyY1J3tsw5m1J/jnJx5PMN4r5yCTvTvKp7mf71AnjPbnLb+/tP5P8TIM8f7b7Hd2U5OokD2sQ84VdvB0tcjyU1nsN6WJaRxrXEWvIFNeQqpqaG7AB+BfgicBRwCeAzRPGfBpwGnBTwzwfC5zWLR8LfLpBngGO6ZaPBK4HzmiU74uAdwLvbfgzuA04vvHv/63Ac7vlo4BHNv7bugM4ccI4JwCfAR7erV8LXDRhzFOAm4BHMDx8+ZfAbMufbV9uq1FDurjWkcZ1xBoyvTVk2i7p/RRgd1XdWlX3AtcA500SsKo+wqJjuZOqqs9X1ce65f9iuJe2+Cz4A41ZVfXf3eqR3W3iqeIkG4HvBd44aazVlORrGBbvNwFU1b1VdU/DTTwd+Jeq+myDWEcAD+/OFXgEDz6f4ECdDHy0qr5Uw73/vwa+b8KYfdW8hoB1ZBrqiDXk0NWQaWssxvnY2prSXUHwVIZ7BpPG2pDk48CdwAeqauKYwO8AvwDc3yDWqALen+SfkjyvQbwnAncBb+mmW9+Y5OgGcfc6H7h60iBV9a/AbwKfAz4PDKrq/ROGvQl4WpLjkjwCeAYPPBlS45u6GgK9rSPWkCmtIdPWWEzVR9KSHAO8B/iZqvrPSeNV1f9V1TczPKv+KUlOmTC/ZwJ3VtU/TZrbEs6sqtMYXm3x+UmeNmG8IxhONb+uqk4Fvkij4/DdCYVbgT9qEOtrGe4BnwQ8Djg6yXMmiVlVOxleifIDwPsYTt/fN2GqfTVVNQR6XUesIVNaQ6atsRjnY2trQpIjGRaDd1TVH7eM3U3ffRjYMmGoM4GtSW5jOCX8XUnePmFMAKrq9u7fO4E/YTgFPYkFYGFk7+rdDItEC+cCH6uqf2sQ62zgM1V1V1V9Bfhj4FsnDVpVb6qq06rqaQyn3Jf/Bintz9TUEOh3HbGGTG8NmbbGYpyPrR12ScLwON7OqvqtRjEfleSR3fLDGf7xfWqSmFV1WVVtrKonMPxZfrCqJuqMu/yOTnLs3mXgexhOxU2S6x3AniRP7u56OnDzRIl+1QU0mMLsfA44I8kjur+DpzM8Nj6RJI/u/n088P20y7dvpqKGQL/riDVkumvIVH1telXdl2Tvx9Y2AG+uqh2TxExyNXAWcHySBeDlVfWmCVM9E7gQ+OfuWCbAS6pq+wQxHwu8NcMvdHoIw4/sNft4aGNfD/zJ8D3BEcA7q+p9DeK+AHhH9x/CrcCPTxqwO9743cBPThoLoKquT/Ju4GMMpxpvBP6gQej3JDkO+Arw/Kq6u0HM3lmNGgLWkVVgDZniGrLil5BJkiSNa9oOhUiSpDXMxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1Mz/A1lCGn7MCJLWAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db576ea128>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "belief = [0, 0, .4, .6, 0, 0, 0, 0, 0, 0]\n",
    "prior = predict_move(belief, 2, .1, .8, .1)\n",
    "book_plots.plot_belief_vs_prior(belief, prior)\n",
    "prior"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here the results are more complicated, but you should still be able to work it out in your head. The 0.04 is due to the possibility that the 0.4 belief undershot by 1. The 0.38 is due to the following: the 80% chance that we moved 2 positions (0.4 $\\times$ 0.8) and the 10% chance that we undershot (0.6 $\\times$ 0.1). Overshooting plays no role here because if we overshot both 0.4 and 0.6 would be past this position. **I strongly suggest working some examples until all of this is very clear, as so much of what follows depends on understanding this step.**\n",
    "\n",
    "If you look at the probabilities after performing the update you might be dismayed. In the example above we started with probabilities of 0.4 and 0.6 in two positions; after performing the update the probabilities are not only lowered, but they are strewn out across the map.\n",
    "\n",
    "This is not a coincidence, or the result of a carefully chosen example - it is always true of the prediction. If the sensor is noisy we lose some information on every prediction. Suppose we were to perform the prediction an infinite number of times - what would the result be? If we lose information on every step, we must eventually end up with no information at all, and our probabilities will be equally distributed across the `belief` array. Let's try this with 100 iterations. The plot is animated; recall that you put the cursor in the cell and press Ctrl-Enter to execute the code and see the animation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            if (mpl.ratio != 1) {\n",
       "                fig.send_message(\"set_dpi_ratio\", {'dpi_ratio': mpl.ratio});\n",
       "            }\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        fig.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var backingStore = this.context.backingStorePixelRatio ||\n",
       "\tthis.context.webkitBackingStorePixelRatio ||\n",
       "\tthis.context.mozBackingStorePixelRatio ||\n",
       "\tthis.context.msBackingStorePixelRatio ||\n",
       "\tthis.context.oBackingStorePixelRatio ||\n",
       "\tthis.context.backingStorePixelRatio || 1;\n",
       "\n",
       "    mpl.ratio = (window.devicePixelRatio || 1) / backingStore;\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width * mpl.ratio);\n",
       "        canvas.attr('height', height * mpl.ratio);\n",
       "        canvas.attr('style', 'width: ' + width + 'px; height: ' + height + 'px;');\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'] / mpl.ratio;\n",
       "    var y0 = (fig.canvas.height - msg['y0']) / mpl.ratio;\n",
       "    var x1 = msg['x1'] / mpl.ratio;\n",
       "    var y1 = (fig.canvas.height - msg['y1']) / mpl.ratio;\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x * mpl.ratio;\n",
       "    var y = canvas_pos.y * mpl.ratio;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    var width = fig.canvas.width/mpl.ratio\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\" width=\"' + width + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var width = this.canvas.width/mpl.ratio\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\" width=\"' + width + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        event.shiftKey = false;\n",
       "        // Send a \"J\" for go to next cell\n",
       "        event.which = 74;\n",
       "        event.keyCode = 74;\n",
       "        manager.command_mode();\n",
       "        manager.handle_keydown(event);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA+gAAAD6CAYAAAAyVW3pAAAgAElEQVR4Xu2dCbglVXmu3z6HjijsvsIVEIdWWlEQpdWL4hiHqCCO0Ygy5OKASswcrwgOiVEU5DE3GuOEolyVSU2MURwQjTgATle5oiJoB9oRjBMHNNic7vv86bVxsz1nnzp7rPrrrefhad2nhrXe9VXV/9Va619rcJOABCQgAQlIQAISkIAEJCABCUhg5gTWzLwEFkACEpCABCQgAQlIQAISkIAEJCABNOiKQAISkECzCcwDzwSOBO4BdICfAT8CvgD8a/mvW8unA+8AngGcVsOqPxI4GLgncC9gF+BzwINWKOvdgJcBDwXWAVcCZwEnAb9a5tgHAC8B7gfsCHwbeDvwemCxhmwskgQkIAEJSEACyQlo0JM3sNWTgARSEwhz/qFiaH8OnAN8D9gVuDPwQOCLfea27gb9X4AnAP9ZDPPdKxj0A4FPAmuB9wHfBR4OHFCO/T3g+j4lxDX+qVznbOCnwOOAu5ZzPCW1cqycBCQgAQlIQAK1JKBBr2WzWCgJSEAClQhEr/m7gIuBhwC/6Dsqep//B3Bez+91N+j3B64BLgVuD/z7CgY9PlJ8Ddi3GPsYMRDbHPAe4MnA8aUnvYsheti/U3ra4yPGl8ofohc9jH6U4bDSA1+pIdxJAhKQgAQkIAEJjIOABn0cFD2HBCQggdkQeBNwDPCXwGsrFOFTxcgvtetewBXlDzsAzwH+JxBDx+P/fws4FXgjsLXnBHcsJvr/FBMcQ8p/F7gZ8BXg5cC5Fcq21C7dcw8a4h694/EB4vwyvL33PBuKEd8MxLm2lT8+C3gbEGWODxa9W/S8fwL4TKnHkEX3MAlIQAISkIAEJLB6Ahr01TPzCAlIQAJ1IRDm96VAGPXnVShUmNEnlp7mDwBf7TkmDH4Mk49h4h8EDiq92GF8Y7j5w4D9gdPLfPfuoV0T/eny90uAzwJ7Ak8Ffgc4HIhh5Kvdqhj0E4AXL9FL3r1WfFi4SxnyH73msb0bOGKZXvL4GBEjEaLcOy8xNH61dXB/CUhAAhKQgAQkUJmABr0yKneUgAQkUDsCG8sc8zCVZwBhumO4dgwLX25baYh7JFr7G+B1wPN7kqXFUPJTSkK63wdirnhsXRMd//s1wAt6LhxzwC8ErgXuUIaurwZiFYP+XuAPyn8xp7x/izn6jwEOAT5S/hjz8qNs8d+XlzgmPjLsV0YPfHM1BXZfCUhAAhKQgAQkMAoBDfoo9DxWAhKQwOwJhDn9h9Jj3S3NT8qQ7xiS/uG+Ig4y6DFv+2rg12X+d38m81uWZGphhLtJ1LomOnqdY874Qt/1IlP8UWUoeQwpX81WxaDH8PnI/B7/9c61714nevyjBz/+O7P8eBmwd/kvMrf3bzGkPjK8x3/xgcFNAhKQgAQkIAEJTIWABn0qmL2IBCQggYkSiGHpMQQ9liKLpcni3zDTscWyYUf3zL8eZND3AaLH+PLSI79UoaOHfFNZ0i3+3jXR/1Yyp/cf071e9Mj/xSopjMOgx8iCSPjWm/RtJYN+QUkUF8niLlplmd1dAhKQgAQkIAEJDE1Agz40Og+UgAQkUFsCMRw9speHOd+pzDuP4e+xDTLokdE85o+vtEUyuUgq12vQY83xMMH9W6xpHkPLoyc91l5fzVbFoDvEfTVE3VcCEpCABCQggVoT0KDXunksnAQkIIGRCLwCeAnweuDPypkGGfRYczyWLHs/8KSKV551D3o3SdyLgBOXKPOgJHG9w967h5okrmLDu5sEJCABCUhAAuMnoEEfP1PPKAEJSKAuBI4FXg38I/CnpVB/CLyzDHuPOeq9W5jTHwO/KkndtlSoyKznoHeXRYss8rEWfO/WXWbtytLj311m7ZllybjgEPPje7dB56uAw10kIAEJSEACEpDA8AQ06MOz80gJSEACsyYQQ8r/o6zb3bs2eZTr1mUt7zsDhwIxFDy2yGZ+DvC3QGRs79+6S7e9GfirYtZ794nl03YBvlF+rJLF/Tpg/YSyuMdw/uj137csH/evpVyR8C6WdoskeseXNdq79VhX1kePf2NYf2S+j21H4JNl/nnvnPVZt7PXl4AEJCABCUigJQQ06C1paKspAQmkJBBrl/858KMyd7y7vFrMD4+lxW5ell6LZdG6vcdhrr8HRO/4u4CrCpkYBh+Z2CPh3PuAxwPfL4Y1/t29ZD0PQxvrjp/UZ9C766CHWY4s6MOugx4J7iKpXWyxDnnMpY/M8t0l0uL3GKbfux1Yytkt+2bg98oyalGW+N/X9x0T68FHPWON95g//9NS57uW3+OjRpdZSvFYKQlIQAISkIAE6kdAg16/NrFEEpCABKoSiGXNwkg/oqzZHaY4eoFjmbWvlEzskcW8v3c9ErfFWuf3KEnk4nph6iP5W2zxbjiyGOHICh9GOYa+xweAWLYtjP13+wx6LKEWpj2G1P8ucLNShuiR/1jVCvUksRt0yFLvrruVUQGRzb4DxLD2WFYtyhRD9pfauh8bIlt7cIsl1yKxXixb17/E3Cqq4K4SkIAEJCABCUhgOAIa9OG4eZQEJCABCWwn0B3iHga9v2dbRhKQgAQkIAEJSEACqyCgQV8FLHeVgAQkIIHfIqBBVxQSkIAEJCABCUhgTASmYdBjqOFLgXsCMVTyVgOSEy1VrZj3eDLwWOAWwMVl2aBPLLFzDPOMZYU2Ar8EPgREFuOYv+gmAQlIQALjJ6BBHz9TzygBCUhAAhKQQEsJTMOgR/D21WKsLyvJf5bLHtzfDDGHMbLr3hI4rhjtPy7Jj8KMn99zQCyvc17JTvyGktAo5kL+rCQK6k8Q1NImt9oSkIAExkpAgz5WnJ5MAhKQgAQkIIE2E5iGQe9eI7LhRu95JBqqatCfB4TZfgBwYWmoWKc3etGvBSJzb3f7Qkl2FL3nN5Qf47jI4BvneVObG9q6S0ACEpCABCQgAQlIQAISkEC9CUzDoPcSWK1B/zgQWYr36cMYa9q+CrhdWQbotmXZoP61buOwb5Vsvo/qnmPbtm3zCwsLe/eec82aNbHEjkvq1Fuvlk4CEpCABCQgAQlIYGkCa7Zt27Zr7586nc7la9ascVUKFSOBBhGou0H/IfAZINaj7d1ifd+YX34QcG7596Nl6HssAdS7vReIpXRu0/3xmmuu2Wfr1q3fbFA7WVQJSEACEpCABCQgAQmsisDc3Ny+69atu3RVB7mzBCQwUwJ1N+i/LmvSHtNHKdasvQA4vKxzG/+eDsTvF/Xt+5ay9E/MZ/+vTYM+U815cQlIQAISkIAEJCCBKRDQoE8BspeQwJgJNMGgnwr80TIG/TDgrGLUw6DfD/j8Egb9KGBHDfqY1ePpJCABCUhAAhKQgARqS0CDXtumsWASWJZA3Q26Q9wVrwQkIAEJSEACEpCABIYgoEEfApqHSGDGBOpu0GN+eSSJ27ePUyy5diIQyeF+UP79XlmKLZZW691i3s1m4MYkcQsLC7svLi5e1bvTTjvtxNzc3IybY/yX//rXv84NN9zADjvswH777Tf+CzTgjDKAtjNoe/3jNm07g7bXXw14D6iB7QFL5mfB1q1bue66624Smc3Pz+/R6XSubkC4ZhElIIFCoO4GPYa2v7Fv6HossxbrqscyazGkvbvF0PZbAPcEutkq4++xPFuc583dHRcWFnZbXFy8ycOq0+mkNOgXX3wxW7ZsYe3atWzcGCvQtW+TAbSdQdvrH3d92xm0vf5qwHtADWyPfzI/C8KgLyws9Bv03TudTixx7CYBCTSEwLQM+qPLGuWdkvQtMqu/pzCKrOu/BGKuecwVv1NZFi3+HIndvgysK73jYapjTfPHAY8Azu/h/FAglmX7YDH1uwMnAb8ADgCu16Br0P1I0c4PNZkDsqrvmrYzaHv9sxuTKveBGshtTqtoIPt9oEGvqgL3k0C9CUzLoF8B3GEZFHsB8ffTikHv/v/u7nsAJwOPLT3k0Xv+UuC8Jc73SODlpRc9TH8sxfYC4Ca95fag11uU4y6dQZlBmRpQA2pADagBNaBBH3eE5fkkIIFJEJiWQZ9E2Yc+pwZ9aHSNPNCgzKBMDagBNaAG1IAa0KA3Moyz0BJoHQENemly56Dn1b5BmUGZGlADakANqAE1oEHPG+tZMwlkIqBB16Bn0vOSdTEoMyhTA2pADagBNaAGNOjpQz4rKIEUBDToGvQUQh5UCYMygzI1oAbUgBpQA2pAg54+5LOCEkhBQIOuQU8hZA364GZse2Da9vpnD0qrPMTUgOZMDaiB7M9Cs7hXeRu4jwTqT0CDrkGvv0pHLKFBmUGZGlADakANqAE1oEEfMaDycAlIYCoENOga9KkIbZYXMSgzKFMDakANqAE1oAY06LOMxry2BCRQlYAGXYNeVSuN3c+gzKBMDagBNaAG1IAa0KA3NpSz4BJoFQENugY9veANygzK1IAaUANqQA2oAQ16+pDPCkogBQENugY9hZAHVcKgzKBMDagBNaAG1IAa0KCnD/msoARSENCga9BTCFmDPrgZ2x6Ytr3+2YPSKg8xNaA5UwNqIPuz0CzuVd4G7iOB+hPQoGvQ66/SEUtoUGZQpgbUgBpQA2pADWjQRwyoPFwCEpgKAQ26Bn0qQpvlRQzKDMrUgBpQA2pADagBDfosozGvLQEJVCWgQdegV9VKY/czKDMoUwNqQA2oATWgBjTojQ3lLLgEWkVAg65BTy94gzKDMjWgBtSAGlADakCDnj7ks4ISSEFAg65BTyHkQZUwKDMoUwNqQA2oATWgBjTo6UM+KyiBFAQ06Br0FELWoA9uxrYHpm2vf/agtMpDTA1oztSAGsj+LDSLe5W3gftIoP4ENOga9PqrdMQSGpQZlKkBNaAG1IAaUAMa9BEDKg+XgASmQkCDrkGfitBmeRGDMoMyNaAG1IAaUANqQIM+y2jMa0tAAlUJaNA16FW10tj9DMoMytSAGlADakANqAENemNDOQsugVYR0KBr0NML3qDMoEwNqAE1oAbUgBrQoKcP+aygBFIQ0KBr0FMIeVAlDMoMytSAGlADakANqAENevqQzwpKIAUBDboGPYWQNeiDm7HtgWnb6589KK3yEFMDmjM1oAayPwvN4l7lbeA+Eqg/AQ26Br3+Kh2xhAZlBmVqQA2oATWgBtSABn3EgMrDJSCBqRDQoGvQpyK0WV7EoMygTA2oATWgBtSAGtCgzzIa89oSkEBVAhp0DXpVrTR2P4MygzI1oAbUgBpQA2pAg97YUM6CS6BVBDToGvT0gjcoMyhTA2pADagBNaAGNOjpQz4rKIEUBDToGvQUQh5UCYMygzI1oAbUgBpQA2pAg54+5LOCEkhBYBoGfWfgBOBQYFfgUuAk4KwVCH4KeMiAffYEflT+vty+HwMO7j/HwsLCbouLi1f3/t7pdJibm0vRqL2VMCAxIMkekFS5ab0PvA/UgBpQA2og+/vQLO5VIgL3kUD9CUzDoJ8L3Ac4DrgMOBw4GjgCOGMAorsB6/r+fgvgo8CXgfv3/C0M+u3LOXsP+Xn5IHCT02jQ6y/McZbQoMygTA2oATWgBtSAGtCgjzO68lwSkMCkCEzaoB8CnFNM+Zk9lQjTvh+wHlhcReWOAk4rBv/UPoN+K+DuVc6lQa9CKc8+BmUGZWpADagBNaAG1IAGPU9sZ00kkJnApA36W4GnAbsAN/SAPKz0nj8QuGAVgD8N3AuI4e3XatBXJmdAYkCSPSBZ+S5QA2pADagBNaAGtr8tMsdFDnGvEhG4jwTqT2DSBv1CYB64bx+K6D2/BHgucEpFTHuXIfJvA57dd0wMcT8Q+FUZFn9lmeMec9/jt5ts9qBXJJ5kt8wv46pN1HYGba9/9qC0yn2gBnIbEzVQhYAayP4s1KBXuw/cSwJ1JzBpgx5zzjctkagtesB/ALwIOLEipEgs98Iy9/yivmPCiH+/zDe/OfBo4JjSO/8wYGvv/hr0isST7GZgblCmBtSAGlADakANaNCTBHZWQwLJCUzDoH+nGOZelF2DfnzJ6L4S5h2A7wI/qTrPHHg+8BrgScD7VzLomzdvJr48Ztu2bNlyY5XWrl2brXqV6iMDaDuDttc/bpS2M2h7/dWA94Aa2B4yZH4WxGpE69dHeqffbPPz87t3Op0fVwqY3EkCEqgFgUkb9HENcX888AHgL4HXViS3R1mG7eTS837jYUv1oG/atInFxdXkq6tYCneTgAQkIAEJSEACEpDAhAnMz8+zYcMGDfqEOXt6CUyawKQNeswvj4Rw/UniInFcZHWvmiQuzHmsZ36b0otehUvXoMfQ+OipH2jQ7UGvgrSZ+2T+Wl61RdrOoO31D520nUHb668GvAfUwPY3ZuZngT3oVaMi95NAvQlM2qDHXPAPl0zuZ/eg+Aiwf8Vl1m5dhrf/M/DUVeA8Fng18MTS+z7QoHc6HeLBlm1zzp1z7kLTbddB2+uvBrwH1IAaUAPbI7zM7wOTxGWL4q1PWwlM2qAH11jz/IAyzPzbpUc9srAfCZxewMea5rHG+Z2AyMDeu0ViuOgFfxTw8SUa6sHAi8s880hIt2OZ8/4c4HzgkSaJ20LMP9+4cWMrdZ75ZVy1QdvOoO31zx6UVrkP1EBuY6IGqhBQA9mfhRr0aveBe0mg7gSmYdB3Bl4JHArsWjKtR+b2s3rgnFYM+l7AFX3QvgX8DhCTarYtAfTOwOuAcJ+3KvtcXs7/d8D1/ceYxb3ushxv+QzMDcrUgBpQA2pADagBDfp44yvPJgEJTIbANAz6ZEo+wlk16CPAa+ChBmUGZWpADagBNaAG1IAGvYFBnEWWQAsJaNBLozsHPa/6DcoMytSAGlADakANqAENet5Yz5pJIBMBDboGPZOel6yLQZlBmRpQA2pADagBNaBBTx/yWUEJpCCgQdegpxDyoEoYlBmUqQE1oAbUgBpQAxr09CGfFZRACgIadA16CiFr0Ac3Y9sD07bXP3tQWuUhpgY0Z2pADWR/FprFvcrbwH0kUH8CGnQNev1VOmIJDcoMytSAGlADakANqAEN+ogBlYdLQAJTIaBB16BPRWizvIhBmUGZGlADakANqAE1oEGfZTTmtSUggaoENOga9Kpaaex+BmUGZWpADagBNaAG1IAGvbGhnAWXQKsIaNA16OkFb1BmUKYG1IAaUANqQA1o0NOHfFZQAikIaNA16CmEPKgSBmUGZWpADagBNaAG1IAGPX3IZwUlkIKABl2DnkLIGvTBzdj2wLTt9c8elFZ5iKkBzZkaUAPZn4Vmca/yNnAfCdSfgAZdg15/lY5YQoMygzI1oAbUgBpQA2pAgz5iQOXhEpDAVAho0DXoUxHaLC9iUGZQpgbUgBpQA2pADWjQZxmNeW0JSKAqAQ26Br2qVhq7n0GZQZkaUANqQA2oATWgQW9sKGfBJdAqAhp0DXp6wRuUGZSpATWgBtSAGlADGvT0IZ8VlEAKAhp0DXoKIQ+qhEGZQZkaUANqQA2oATWgQU8f8llBCaQgoEHXoKcQsgZ9cDO2PTBte/2zB6VVHmJqQHOmBtRA9mehWdyrvA3cRwL1J6BB16DXX6UjltCgzKBMDagBNaAG1IAa0KCPGFB5uAQkMBUCGnQN+lSENsuLGJQZlKkBNaAG1IAaUAMa9FlGY15bAhKoSkCDrkGvqpXG7mdQZlCmBtSAGlADakANaNAbG8pZcAm0ioAGXYOeXvAGZQZlakANqAE1oAbUgAY9fchnBSWQgoAGXYOeQsiDKmFQZlCmBtSAGlADakANaNDTh3xWUAIpCGjQNegphKxBH9yMbQ9M217/7EFplYeYGtCcqQE1kP1ZaBb3Km8D95FA/Qlo0DXo9VfpiCU0KDMoUwNqQA2oATWgBjToIwZUHi4BCUyFgAZdgz4Voc3yIgZlBmVqQA2oATWgBtSABn2W0ZjXloAEqhLQoGvQq2qlsfsZlBmUqQE1oAbUgBpQAxr0xoZyFlwCrSKgQdegpxe8QZlBmRpQA2pADagBNaBBTx/yWUEJpCCgQdegpxDyoEoYlBmUqQE1oAbUgBpQAxr09CGfFZRACgIadA16CiFr0Ac3Y9sD07bXP3tQWuUhpgY0Z2pADWR/FprFvcrbwH0kUH8C0zDoOwMnAIcCuwKXAicBZ62A5+nAO5bZZ0/gR31/expwHLAP8FPgPcBLgGv7z7GwsLDb4uLi1b2/dzod5ubm6t9iqyyhAYkBSfaApMot4X3gfaAG1IAaUAPZ34ca9CoRgftIoP4EpmHQzwXuU8zzZcDhwNHAEcAZAxB1Dfoziqnv3fXLwJaeH+Jc7wbeVs55F+DVwBeAR2nQt7B27Vo2btxYf0VOoIQGZQZlakANqAE1oAbUgAZ9AkGWp5SABMZOYNIG/RDgnGLKz+wpfZj2/YD1wOIyteoa9DD3XxpQ83ngu8DXgIN69osPAacDUYaP9B5vD/rYdVTrExqUGZSpATWgBtSAGlADGvRah2sWTgISKAQmbdDfCsTQ812AG3qoH1Z6uh8IXDCiQY9zfBaIc/YOm19bhrrHh4HnaNDtQXcUQXtHUhiYG5irATWgBtSABl3/IwEJNIHApA36hUD0cN+3D0b0nl8CPBc4ZQWDfhWwG/AL4FPAX5dju4fFOd5ceuS/0XeuL5ah8A/QoGvQNegadDWgBtSAGlAD7dWABr0J1sQySkACkzboMed8E3BwH+pI8vYD4EXAics0QxzzIOAi4BrgHmUee/TGR6/5xeW4OMcrgaUSx30MuCNw15UM+ubNm4nkGtm2LVt+M1U/gpI2bjKAtjNoe/3jvm87g7bXXw14D6iB7RFQ5mdBJDtevz5mj/5mm5+f373T6fy4jfGfdZZAUwlMw6B/B3j0Mgb9+JLRvSq/MNsx1/yTwBP6DPqtgeht793CoN+hZHa/8fel5qBv2rSJxcXlpsNXLZ77SUACEpCABCQgAQlIYPoE5ufn2bBhgwZ9+ui9ogTGSmDSBn2UIe7LVTQSvt0b2KPsMJYh7vagj1VXtTpZ5q/lVUG3nUHb6x86aTuDttdfDXgPqIHtb8zMzwJ70KtGRe4ngXoTmLRBj/nlkbytP0lcJI6L5G2DksQtR+6jQKwXFkPaY4v55Z8ryejO7jloB+Bn5TomiXOZNZea29LeeYcmhzI5lBpQA2pADUSMmFkHroNeb9Nl6SRQlcCkDXoMbf/wEuY5esH3X2GZtaXqsBfw/4DzgN8vO3SXWYs56b1D6bsfAeK3MPU3bi6zVlUeOfbL/DKu2kJtZ9D2+mcPSqvcB2ogtzFRA1UIqIHsz0INerX7wL0kUHcCkzboUf9Y8/wA4IXAt0uP+rOBI8s65bHPqcBRwJ2AKwu0MOGfLoa8myTuWKBTes0jC3x3i3O9q2SEj575vYGTgcji/qj+RtCg112W4y2fgblBmRpQA2pADagBNaBBH2985dkkIIHJEJiGQd+5ZFk/FNgVuLRkbu9ds/y0YtCjh/yKUtW/L+b69sDNgatLcrhXAJEdvn+LofTHlYRwPwXeA7wYuFaD3t6hzdlfxlUfC20PTNtef+8DjYkaUANqYPsbM/P7wB70qlGR+0mg3gSmYdBrR8Ae9No1yUQLlPllXBVc2xm0vf7Zg9Iq94EayG1M1EAVAmog+7NQg17tPnAvCdSdgAa9tFCn0yGyX2bbDEoNSLIHJFXuWe8D7wM1oAbUgBrI/j7UoFeJCNxHAvUnoEHXoNdfpSOW0KDMoEwNqAE1oAbUgBrQoI8YUHm4BCQwFQIadA36VIQ2y4sYlBmUqQE1oAbUgBpQAxr0WUZjXlsCEqhKQIOuQa+qlcbuZ1BmUKYG1IAaUANqQA1o0BsbyllwCbSKgAZdg55e8AZlBmVqQA2oATWgBtSABj19yGcFJZCCgAZdg55CyIMqYVBmUKYG1IAaUANqQA1o0NOHfFZQAikIaNA16CmErEEf3IxtD0zbXv/sQWmVh5ga0JypATWQ/VloFvcqbwP3kUD9CWjQNej1V+mIJTQoMyhTA2pADagBNaAGNOgjBlQeLgEJTIWABl2DPhWhzfIiBmUGZWpADagBNaAG1IAGfZbRmNeWgASqEtCga9CraqWx+xmUGZSpATWgBtSAGlADGvTGhnIWXAKtIqBB16CnF7xBmUGZGlADakANqAE1oEFPH/JZQQmkIKBB16CnEPKgShiUGZSpATWgBtSAGlADGvT0IZ8VlEAKAhp0DXoKIWvQBzdj2wPTttc/e1Ba5SGmBjRnakANZH8WmsW9ytvAfSRQfwIadA16/VU6YgkNygzK1IAaUANqQA2oAQ36iAGVh0tAAlMhoEHXoE9FaLO8iEGZQZkaUANqQA2oATWgQZ9lNOa1JSCBqgQ06Br0qlpp7H4GZQZlakANqAE1oAbUgAa9saGcBZdAqwho0DXo6QVvUGZQpgbUgBpQA2pADWjQ04d8VlACKQho0DXoKYQ8qBIGZQZlakANqAE1oAbUgAY9fchnBSWQgoAGXYOeQsga9MHN2PbAtO31zx6UVnmIqQHNmRpQA9mfhWZxr/I2cB8J1J+ABl2DXn+VjlhCgzKDMjWgBtSAGlADakCDPmJA5eESkMBUCGjQNehTEdosL2JQZlCmBtSAGlADakANaNBnGY15bQlIoCoBDboGvapWGrufQZlBmRpQA2pADagBNaBBb2woZ8El0CoCGnQNenrBG5QZlKkBNaAG1IAaUAMa9PQhnxWUQAoCGnQNegohD6qEQZlBmRpQA2pADagBNaBBTx/yWUEJpCCgQdegpxCyBn1wM7Y9MG17/bMHpVUeYmpAc6YG1ED2Z6FZ3Ku8DdxHAvUnoEHXoNdfpSOW0KDMoEwNqAE1oAbUgBrQoI8YUHm4BCQwFQIadA36VIQ2y4sYlBmUqQE1oAbUgBpQAxr0WUZjXlsCEqhKQIOuQa+qlcbuZ1BmUKYG1IAaUANqQA1o0BsbyllwCbSKwDQM+s7ACcChwK7ApcBJwO4RHUgAABeMSURBVFkrkH4S8BTgPsBtgauAzwEvAy7vO/ZTwEOWON/HgIP7f19YWNhtcXHx6t7fO50Oc3Nz6RrfgMSAJHtAUuWm9T7wPlADakANqIHs70PnoFeJCNxHAvUnMA2Dfm4x2ccBlwGHA0cDRwBnDED0eeBHwL8Am4DbAy8q/94P+HrPsWHQ4+9xzt7t5+WDwE1+1KDXX5jjLKFBmUGZGlADakANqAE1oEEfZ3TluSQggUkRmLRBPwQ4p5jyM3sqEaZ9P2A9sLhM5XYHbtLLDdwGuAJ4ZzH53UPDoN8KuHsVUBr0KpTy7GNQZlCmBtSAGlADakANaNDzxHbWRAKZCUzaoL8VeBqwC3BDD8jDSu/5A4ELVgk4etNjiPtBfT3oGvQlQBqQGJBkD0iqPD+8D7wP1IAaUANqIPv70CHuVSIC95FA/QlM2qBfCMwD9+1DEb3nlwDPBU5ZBaYNxZy/DvirPoN+IPArYB1wZZnjHnPf47ebbPagr4J4gl0NygzK1IAaUANqQA2oAQ16gqDOKkigBQQmbdBjznn0ePcnatsT+EGZU35iRc47AB8H7l2Gsn+357gw4t8v881vDjwaOKb0zj8M2Np7jaUM+ubNm4kvj9m2LVu23FiltWvXZqtepfrIANrOoO31jxul7QzaXn814D2gBraHDJmfBZHseP36mD36m21+fn73Tqfz40oBkztJQAK1IDANg/6dYph7K9w16MeXjO4rwYhynlaSwD0Z+MBKBwDPB14DRDb4969k0Ddt2sTi4nLT4StczV0kIAEJSEACEpCABCQwIwLz8/Ns2BCDTTXoM2oCLyuBsRCYtEEfxxD3KOPbgKcDRwHvrljzPUoW+JOBF65k0O1Br0i1gbtl/lpetTnazqDt9Q+dtJ1B2+uvBrwH1MD2N2bmZ4E96FWjIveTQL0JTNqgx/zySAjXnyQuEsdFVveVksR1zfkzgGcB71gFzq5BjzXXo6f+xs056KugmGBX5x0671ANqAE1oAbUgBqIkCazDkwSlyBotQoSACZt0GMu+IdLJveze4h/BNh/hWXWomyRBf6ZJZlc/O/VbMcCrwae2D8kXoO+GozN3zfzy7hq67SdQdvrnz0orXIfqIHcxkQNVCGgBrI/CzXo1e4D95JA3QlM2qBH/WPN8wPKMPNvlx71ZwNHAqcXQKeW4et3KhnY4+fXA38CvL0Y9V6W1wNfKT88GHhxmWceCel2LHPenwOcDzyySpK4TqdDDA3KthmUGpBkD0iq3LPeB94HakANqAE1kP19qEGvEhG4jwTqT2AaBn1n4JXAocCuJdN6ZG4/qwdPJICL+eV7AVeU3+PfOyyDMJZRu2P5252BWHZtIxBroW8rS7HF+f8OCDN/k80e9PoLc5wlNCgzKFMDakANqAE1oAY06OOMrjyXBCQwKQLTMOiTKvvQ59WgD42ukQcalBmUqQE1oAbUgBpQAxr0RoZxFloCrSOgQS9N7hD3vNo3KDMoUwNqQA2oATWgBjToeWM9ayaBTAQ06Br0THpesi4GZQZlakANqAE1oAbUgAY9fchnBSWQgoAGXYOeQsiDKmFQZlCmBtSAGlADakANaNDTh3xWUAIpCGjQNegphKxBH9yMbQ9M217/7EFplYeYGtCcqQE1kP1ZaBb3Km8D95FA/Qlo0DXo9VfpiCU0KDMoUwNqQA2oATWgBjToIwZUHi4BCUyFgAZdgz4Voc3yIgZlBmVqQA2oATWgBtSABn2W0ZjXloAEqhLQoGvQq2qlsfsZlBmUqQE1oAbUgBpQAxr0xoZyFlwCrSKgQdegpxe8QZlBmRpQA2pADagBNaBBTx/yWUEJpCCgQdegpxDyoEoYlBmUqQE1oAbUgBpQAxr09CGfFZRACgIadA16CiFr0Ac3Y9sD07bXP3tQWuUhpgY0Z2pADWR/FprFvcrbwH0kUH8CGnQNev1VOmIJDcoMytSAGlADakANqAEN+ogBlYdLQAJTIaBB16BPRWizvIhBmUGZGlADakANqAE1oEGfZTTmtSUggaoENOga9Kpaaex+BmUGZWpADagBNaAG1IAGvbGhnAWXQKsIaNA16OkFb1BmUKYG1IAaUANqQA1o0NOHfFZQAikIaNA16CmEPKgSBmUGZWpADagBNaAG1IAGPX3IZwUlkIKABl2DnkLIGvTBzdj2wLTt9c8elFZ5iKkBzZkaUAPZn4Vmca/yNnAfCdSfgAZ9xgb9Xu+6vP4qqVjCr/zh3hX3/M1umeoftRqGwaqhDXFA2wPTttc/e1Ba5ZZQA5ozNVB/DWSKCWYRD2jQq7wN3EcC9SegQdegj02lw7yMMr2MhzXomRiogeE+0mTSwDD3QdvrH8xkkIuBz0KfhcNoYNSATIM+KkGPl0A9CGjQNehjU+IwLyODUoNSNZBLAxp0jckwGsj2kcL3offBMBoYNSDToI9K0OMlUA8CGnQN+tiUOMzLSHOWy5ypAYPSYcyZz4Fcz4FhNKBBVwNqYPRwTIM+OkPPIIE6ENCga9DHpkPNmeZMDaiBYcyZBl1zpjlTA2pg9HBMgz46Q88ggToQ0KBr0MemQ82Z5kwNqAENuhoYRgOaMw26Ghg9HNOgj87QM0igDgQ06Br0selQc2ZgrgbUwDDmzB50zZnmTA2ogdHDMQ366Aw9gwTqQECDrkEfmw41Z5ozNaAGNOhqYBgNaM406Gpg9HBMgz46Q88ggToQ0KBr0MemQ82ZgbkaUAPDmDN70DVnmjM1oAZGD8c06KMz9AwSqAMBDboGfWw61JxpztSAGtCgq4FhNKA506CrgdHDMQ366Aw9gwTqQECDrkEfmw41ZwbmakANDGPO7EHXnGnO1IAaGD0c06CPztAzSKAOBKZh0HcGTgAOBXYFLgVOAs6qAGB34GTgscAtgIuBlwCfWOLYRwCvADYCvwQ+BBwLXN2/78LCwm6Li4s3+b3T6TA3N1ehSOPdJVNgqjnTnKkBNaBBVwPDaEBzpkFXA6PHlxr00Rl6BgnUgcA0DPq5wH2A44DLgMOBo4EjgDMGQLgZ8CXgluXYMNR/DDwGCDN+fs+xDwHOA84B3gCEsX818DPgAOD63uto0CcjPc2ZgbkaUAPDmLNMHyqHqX82YyIDnwNqYDgNjBqdadBHJejxEqgHgUkb9EOKaQ5TfmZPlcO07wesBxaXQfG8YrYfAFxY9tmh9KJfCxzYc9wXgJ1K7/kN5fc47nNAnOdNGvTJC05zNtwLOZM5UQNqYJjAPNM9MEz9Nejb30+ZdOCz0GfhMBoYNVLToI9K0OMlUA8CkzbobwWeBuwCdI1z1Pyw0nv+QOCCZVB8HLg9sE/f348HXgXcDvg+cFvge0D8HkPne7dvAVcCj+oz6LsvLi5e1fvbTjvtNJMh7g9/76Z6KGEMpfjkUzas+iyZ6h+VbzuDttdfDWx/BKxWBz4HQAa5GKz2Hoj7Rg3kYjCMBlYdRPUdEAb9uuuuu8mv8/Pze3Q6nd+a7jnqtTxeAhKYHIFJG/To+Z4H7ttXheg9vwR4LnDKMtX7IfCZMne9d5cY4h7zyw8Coic+/v1oGfr+4b5zvReIjwC36f39mmuu2Wfr1q3fnBxWzywBCUhAAhKQgAQkIIHZEpibm9t33bp1kf/JTQISaAiBSRv0mHMeXcQH9/HYE/gB8CLgxGVY/Rp4O3BM39/vX3rdu8Pm49/Tgfj9or593wI8HYj57DduGvSGqNNiSkACEpCABCQgAQkMTUCDPjQ6D5TAzAhMw6B/B3j0MgZ9qWHp3V3DoJ8K/NEyBj2GyUcm+K5Bvx/w+SUM+lHAjhr0mWnMC0tAAhKQgAQkIAEJzICABn0G0L2kBEYkMGmD7hD3ERvIwyUgAQlIQAISkIAEJDAMAQ36MNQ8RgKzJTBpgx7zy6Onuz9JXCSOi6zug5LExfzySBK3bx+iWK4thsVHcrgYJt9NEhe/x9JqvVvMudncnyRu27Zt8wsLC3v37rhmzZqfAttm2xxeXQISkIAEJCABCUhAAkMRWLNt27Zde4/sdDqXr1mzZrkVk4a6iAdJQAKTJTBpgx5D2yNxWxjys3uq8hFg/xWWWYuh7W8EeoeuxzJrXwVimbX4vbvF0PZbAPfsWbYt/h49+HGeN08Wo2eXgAQkIAEJSEACEpCABCQgAQmMRmDSBj1KFz3hBwAvBL5detSfDRxZkrvFPjHXPOaK36ksixa/RWK3LwPrgOgdjyUiYk3zxwGPAM7vqfpDgViW7YPF1O9ellz7Rbn29aNh8mgJSEACEpCABCQgAQlIQAISkMBkCUzDoO8MvLIslxbDbmLYeQxRjwRv3e20YtD3Aq7o+X0P4GTgsaWHPHrPXwqctwSWRwIvL73ovyxLsb2gGPvJUqzn2YP7CX3cY534Xu71LPn4StUpeomRFfcCbgX8LfCy8V2i1md6ePkQ9oAyXeTnwJfKfRIfv7Jv0e7x7LkHsBvwK+BbwBuAd2ev/DL1Oxp4KxAL5cYzIvsWH2//bZlKLrXyR2YeDyorp0S9I3Hq94B3Aq/IXGmgG18sV8226CDegX9Tlr29ZZn+dwbwGiBipuxbLPcbWo/3YcS+XwReAnwue8WtnwQk0DwC0zDozaOSo8QxcuE+ZfRBLHcX2e4jOD8CiJdyG7Y7likRFwPBIOrfJoP+XuC/A/HvN4pJfX4ZVXIQ8MnkIghzFtNrPgt8H9ip6D9+iw998QGrTVvk6/h6Mef/rWUGPZb07Dfql5TpUm3QQDz/3wW8pzz/Y5pYjFi7Tflgl5lB1DM+0PVvMeIuRtfdoWdqXFYOdysjEuMD5auA/wB+txjUc4AnZK14qVfEQp8BvgD872LQjy0f7h9WpkMmR2D1JCCBJhHQoDeptaqX9RAgXrrdteK7R4Zp32+Fuf/Vr1L/Pbv6juR/0Xv+45YZ9JjqEVNDerfoNY2pJmFOYqpIG7eLijFZ37LKhyGJeyESYv5Bywz6U4D3tay9u9WNDzNhzKK3PKaJucFDgE+Vj3TxsS77Fh8jXwzcGYilb7vbW4DnADG68WeJIXy0jK7c0DNaIEbYbSof7yNhsZsEJCCB2hDQoNemKcZakBjCGr2E/dnzI6N+9J4Pyp4/1oLU6GRtNOjL4Y+e8wja71qj9plmUT4ERI9SBGtt2SLnRyTdjHpHsK5Bb0vLbx/WHNN6YkTRle2p9sCaxseKuCeid/3fW8Ckq4EYSRC9590tVr75XyXXT0x7ybotlE6LiIt6t38CnlQ+2P4wa+WtlwQk0DwCGvTmtVmVEo+y/nyV8zdxHw369laLoc0RpIdJj8CkDdscEP/FB6voSX0d8CdA9B61YYuRFDHF4a+LSY85uW0z6DGSJKZ7xFzbeD7GXNSY+tCG7ROl9zBGVIUhu3sZRfHPQAzzvaYNEHrqGM/AMGMx9zhy17Rhi48zXyn5eyJhb4wmi1EEkYsjPlb8WXIIMZUh8u9EMuLeLTosouMipnzFCEM3CUhAArUgoEGvRTOMvRAx3zqGbh3cd+Y9y9rxMR8zEvW1adOgb2/tCMieWpYpbEOiuKhzLLP43CL2XwN/AbypReKPod1x70eSsBji3iaDHomxIiiP4cw/KUN8I3noXYDHAB9rgQ4iMWvMs95SnvvxgSLm5EY+jv8LPLjoogUo/quKx5T7P4xZm5Km7gO8H4h/u9s/lOdhPBcyb/FxIpbi3RfYWioay/bG1I8YSdU/HTAzC+smAQk0gIAGvQGNNEQRw6DHPLNYh7536xr048sydEOcurGHaNC39xpG1to/Bf6xsS25+oLHXPPoRY7/YpnGmHMZvUiRvTj79uQyrSWMavSix9Ymg75U+0YG66+VXuSN2QVQ5tjuDfQ/9/8ceG3pRV5qZZSsaCJ7d6wYE9N82rIEa/Sgx1K0VwF/X3rQDyzvg/iA96ysjV3q9cyynG98mI2VPWJEVQz7fzowX6YEnp2cgdWTgAQaRECD3qDGWkVRHeL+27DabtC7cxAjUVBk8W3zFkFaZPSPDNYx1DPr1k0IGKMmejPWx1z0xwO3K72qmeeeLte2oYHoSY1etVh+L/MW74P7Afcuw5y7dY1RBNGDGB+rYjnTNmz7A7GqR0xziZE0bdlipEBkK4/e4t77/RnA24FY8eL85DBC5/GBuru8ZNwXny76j1EkbZnykryZrZ4EchDQoOdox/5anFLmVfUniYsEKWeaJK4166B3ddE155EoKoa1tn3rBqVhWj6fGEb0mq2UAOsDwBMTM1iuat1pDzcH/jN5/buZuvsNeiSJjOHvMeS/DaNJopnDmMd863uUlSySN/2N1Yt2jnn3YdJ7t8hHEKNJIifHG1oA42ZAjCaJpHGRiyXujVh6NpLnZf9Q14LmtYoSyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggDwENep62tCYSkIAEJCABCUhAAhKQgAQk0GACGvQGN55Fl4AEJCABCUhAAhKQgAQkIIE8BDToedrSmkhAAhKQgAQkIAEJSEACEpBAgwlo0BvceBZdAhKQgAQkIAEJSEACEpCABPIQ0KDnaUtrIgEJSEACEpCABCQgAQlIQAINJqBBb3DjWXQJSEACEpCABCQgAQlIQAISyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggDwENep62tCYSkIAEJCABCUhAAhKQgAQk0GACGvQGN55Fl4AEJCABCUhAAhKQgAQkIIE8BDToedrSmkhAAhKQgAQkIAEJSEACEpBAgwlo0BvceBZdAhKQgAQkIAEJSEACEpCABPIQ0KDnaUtrIgEJSEACEpCABCQgAQlIQAINJqBBb3DjWXQJSEACEpCABCQgAQlIQAISyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggDwENep62tCYSkIAEJCABCUhAAhKQgAQk0GACGvQGN55Fl4AEJCABCUhAAhKQgAQkIIE8BDToedrSmkhAAhKQgAQkIAEJSEACEpBAgwlo0BvceBZdAhKQgAQkIAEJSEACEpCABPIQ0KDnaUtrIgEJSEACEpCABCQgAQlIQAINJqBBb3DjWXQJSEACEpCABCQgAQlIQAISyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggDwENep62tCYSkIAEJCABCUhAAhKQgAQk0GACGvQGN55Fl4AEJCABCUhAAhKQgAQkIIE8BDToedrSmkhAAhKQgAQkIAEJSEACEpBAgwlo0BvceBZdAhKQgAQkIAEJSEACEpCABPIQ0KDnaUtrIgEJSEACEpCABCQgAQlIQAINJqBBb3DjWXQJSEACEpCABCQgAQlIQAISyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggDwENep62tCYSkIAEJCABCUhAAhKQgAQk0GACGvQGN55Fl4AEJCABCUhAAhKQgAQkIIE8BDToedrSmkhAAhKQgAQkIAEJSEACEpBAgwlo0BvceBZdAhKQgAQkIAEJSEACEpCABPIQ0KDnaUtrIgEJSEACEpCABCQgAQlIQAINJqBBb3DjWXQJSEACEpCABCQgAQlIQAISyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggDwENep62tCYSkIAEJCABCUhAAhKQgAQk0GACGvQGN55Fl4AEJCABCUhAAhKQgAQkIIE8BDToedrSmkhAAhKQgAQkIAEJSEACEpBAgwlo0BvceBZdAhKQgAQkIAEJSEACEpCABPIQ0KDnaUtrIgEJSEACEpCABCQgAQlIQAINJqBBb3DjWXQJSEACEpCABCQgAQlIQAISyENAg56nLa2JBCQgAQlIQAISkIAEJCABCTSYgAa9wY1n0SUgAQlIQAISkIAEJCABCUggD4H/D3gUu7wBTH5IAAAAAElFTkSuQmCC\" width=\"800\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Final Belief: [0.104 0.103 0.101 0.099 0.097 0.096 0.097 0.099 0.101 0.103]\n"
     ]
    }
   ],
   "source": [
    "%matplotlib notebook\n",
    "set_figsize(y=2)\n",
    "\n",
    "belief = np.array([1.0, 0, 0, 0, 0, 0, 0, 0, 0, 0])\n",
    "plt.figure()\n",
    "    \n",
    "for i in range(100):\n",
    "    plt.cla()\n",
    "    belief = predict_move(belief, 1, .1, .8, .1)\n",
    "    book_plots.bar_plot(belief)\n",
    "    plt.title('Step {}'.format(i+1))\n",
    "    plt.gcf().canvas.draw()\n",
    "print('Final Belief:', belief)\n",
    "\n",
    "# reset to noninteractive plot settings\n",
    "%matplotlib inline\n",
    "set_figsize(y=2);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "After 100 iterations we have lost almost all information, even though we were 100% sure that we started in position 0. Feel free to play with the numbers to see the effect of differing number of updates. For example, after 100 updates a small amount of information is left, after 50 a lot is left, but by 200 iterations essentially all information is lost."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And, if you are viewing this online here is an animation of that output.\n",
    "<img src=\"animations/02_no_info.gif\">\n",
    "\n",
    "I will not generate these standalone animations through the rest of the book. Please see the preface for instructions to run this book on the web, for free, or install IPython on your computer. This will allow you to run all of the cells and see the animations. It's very important that you practice with this code, not just read passively."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Generalizing with Convolution\n",
    "\n",
    "We made the assumption that the movement error is at most one position. But it is possible for the error to be two, three, or more positions. As programmers we always want to generalize our code so that it works for all cases. \n",
    "\n",
    "This is easily solved with [*convolution*](https://en.wikipedia.org/wiki/Convolution). Convolution modifies one function with another function. In our case we are modifying a probability distribution with the error function of the sensor. The implementation of `predict_move()` is a convolution, though we did not call it that. Formally, convolution is defined as\n",
    "\n",
    "$$ (f \\ast g) (t) = \\int_0^t \\!f(\\tau) \\, g(t-\\tau) \\, \\mathrm{d}\\tau$$\n",
    "\n",
    "where $f\\ast g$ is the notation for convolving f by g. It does not mean multiply.\n",
    "\n",
    "Integrals are for continuous functions, but we are using discrete functions. We replace the integral with a summation, and the parenthesis with array brackets.\n",
    "\n",
    "$$ (f \\ast g) [t] = \\sum\\limits_{\\tau=0}^t \\!f[\\tau] \\, g[t-\\tau]$$\n",
    "\n",
    "Comparison shows that `predict_move()` is computing this equation - it computes the sum of a series of multiplications.\n",
    "\n",
    "[Khan Academy](https://www.khanacademy.org/math/differential-equations/laplace-transform/convolution-integral/v/introduction-to-the-convolution) [4] has a good introduction to convolution, and Wikipedia has some excellent animations of convolutions [5]. But the general idea is already clear. You slide an array called the *kernel* across another array, multiplying the neighbors of the current cell with the values of the second array. In our example above we used 0.8 for the probability of moving to the correct location, 0.1 for undershooting, and 0.1 for overshooting. We make a kernel of this with the array `[0.1, 0.8, 0.1]`. All we need to do is write a loop that goes over each element of our array, multiplying by the kernel, and summing the results. To emphasize that the belief is a probability distribution I have named it `pdf`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "def predict_move_convolution(pdf, offset, kernel):\n",
    "    N = len(pdf)\n",
    "    kN = len(kernel)\n",
    "    width = int((kN - 1) / 2)\n",
    "\n",
    "    prior = np.zeros(N)\n",
    "    for i in range(N):\n",
    "        for k in range (kN):\n",
    "            index = (i + (width-k) - offset) % N\n",
    "            prior[i] += pdf[index] * kernel[k]\n",
    "    return prior"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This illustrates the algorithm, but it runs very slow. SciPy provides a convolution routine `convolve()` in the `ndimage.filters` module. We  need to shift the pdf by `offset` before convolution; `np.roll()` does that. The move and predict algorithm can be implemented with one line:\n",
    "\n",
    "```python\n",
    "convolve(np.roll(pdf, offset), kernel, mode='wrap')\n",
    "```\n",
    "\n",
    "FilterPy implements this with `discrete_bayes`' `predict()` function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAD6NJREFUeJzt3XuQ3XV5x/H3hwRULl0reCURsI0OGcYpTIpYWqSKBbzEaWs70Eqlo2hnxGqpWrCOUqq1tRf7h9SxipdBEBG1pjYVtUq1tlKiYCVETEQ0ESlUYb20isjTP84veFg2uyc5393s2d/7NbOTc/me53zPnj1PPr/rSVUhSZLUwj57ewKSJGn5MFhIkqRmDBaSJKkZg4UkSWrGYCFJkpoxWEiSpGYMFj2U5OYkJ43zuCSvTPK2ER/38CSfSvLdJH+9u88raXlI8ktJbtzb89DCWrm3J6DJVFV/thvDXwD8D/BT5YlTpN6qqk8Dj9vb89DCco2FFsNhwA2GCqm/koy1IJtkRau5aGEZLPrr55PckOSOJO9I8kCAJM9Icl2SO5P8e5LHz/bgJOcneffQ9eO68Xcm+UKSE7vb3wk8F3hFku/tySYYSUtXt4n0vJn9JMmJSXYk+aMktwLv2Hnb0GOPTHJV1zc2J1k/dN87k7w5ycYk3wd+eW+8Pu0+g0V//TZwMvAzwGOBVyU5Bng78ELgYOAtwIYkD5irUJJDgX8CXgs8BHgZ8P4kD62qM4FLgDdU1YFV9fEFej2S9p779ZPu9kcw6AmHMdgkeq8k+wL/CHwUeBjwYuCSJMObSn4LeB1wEPBvCzh/NWSw6K83VdX2qvo2gw/u6cBZwFuq6uqq+nFVvQv4IXDcPLWeA2ysqo1VdU9VfQzYBDxtIV+ApCVjtn4CcA/wmqr6YVX934zHHAccCPx5Vd1VVZ8APjz0WIAPVdVnur7yg4V+EWrDYNFf24cufw14FIOlij/sVkvemeROYHV331wOA35jxuN+EXjkQkxc0pIzWz8BuH2OQPAoYHtV3TPjsYfuoq4mhEeF9NfqocuPBm5h8CF+XVW9bjdrbQcurqqzWk1O0kSZrZ8AzLXD9i3A6iT7DIWLRwNfHhrjDt8TyDUW/fWiJKuSPAR4JfBe4K3A7yV5QgYOSPL0JAfNU+vdwDOTnJxkxdCOW6sW+kVIWhJm6yfzuRr4PoMdu/ftdvh+JnDZwk1Ti8Fg0V+XMthp6qbu57VVtYnBfhZvAu4AtgFnzleoqrYDz2LQUG5nsAbj5fj3JfXF/frJfA+oqruA9cCpDM5z83fA71TVlxZwnloE8dQCkqQ9leRm4Pke8aWdXKKUJEnNjBQskpyS5MYk25Kcu4sxv9mdIGVzkkvbTlPSJLOHSP0x76aQ7jSqXwaeCuwArgFOr6obhsasAS4HnlxVdyR5WFXdtnDTljQp7CFSv4yyxuJYYFtV3dTtbHMZgx31hp0FXFhVdwDYECQNsYdIPTLKeSwO5b4nKdkBPGHGmMcCJPkMsAI4v6o+MjxgenravUSlJWZqaiqL8DT2EGkZm9lHRgkWszWemR/wlcAa4ERgFfDpJEdV1Z17MklJy4o9ROqRUTaF7OC+Z1VbxU/OqjY85kNV9aOq+ipwI4MmIUn2EKlHRlljcQ2wJskRwDeA0xh849ywf2DwxTHvTHIIg9WaN+2q4NTU1J7NFti0aRMA69at2+Mai1XXmtZsqVXd6enpFtPZHUuqh8DkvO/WXPo1F6ruUq85Vx+Zd41FVd0NnA1cCWwBLq+qzUkuSLK+G3Yl8K0kNwCfBF5eVd8ae+aSJp49ROqXkb6ErKo2Ahtn3PbqocsFnNP9SNJ92EOk/vDMm5IkqRmDhSRJasZgIUmSmjFYSJKkZkbaeVOT7eiLt84zojt0b8uux117hqcUkCTNzzUWkiSpGYOFJElqxmAhSZKaMVhIkqRmDBaSJKkZg4UkSWrGYCFJkpoxWEiSpGYMFpIkqRmDhSRJasZgIUmSmjFYSJKkZgwWkiSpGYOFJElqxmAhSZKaMVhIkqRmDBaSJKmZlXt7ApKkfjr64q1z3Ds1+GfLXGPg2jPWtJuQmnCNhSRJasZgIUmSmjFYSJKkZgwWkiSpmZGCRZJTktyYZFuSc+cY9+wklWRduylKmnT2EKk/5g0WSVYAFwKnAmuB05OsnWXcQcDvA1e3nqSkyWUPkfpllDUWxwLbquqmqroLuAx41izj/hR4A/CDhvOTNPnsIVKPpKrmHpA8Gzilqp7fXT8DeEJVnT005mjgVVX160muAl5WVZuG60xPT9/7RFu3zn1csto6a8vU2DXeeuR0g5loKViz5ifH/U9NTWWhn88eol2xN02uufrIKCfImq3x3PsBT7IP8EbgzD2bnqRlzh4i9cgowWIHsHro+irglqHrBwFHAVclAXgEsCHJ+plLHDutW7fn+2Vt2rRp7BqLVXfJ1JznzHWj2N3XsGRe+zKp2bLu9PSiL+EtqR4Ck/O+L/uai9yblvpnc5JqztVHRtnH4hpgTZIjkuwHnAZs2HlnVU1X1SFVdXhVHQ58FthlQ5DUO/YQqUfmDRZVdTdwNnAlsAW4vKo2J7kgyfqFnqCkyWYPkfplpC8hq6qNwMYZt716F2NPHH9akpYTe4jUH555U5IkNWOwkCRJzRgsJElSMwYLSZLUjMFCkiQ1Y7CQJEnNGCwkSVIzBgtJktSMwUKSJDVjsJAkSc0YLCRJUjMGC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUjMFCkiQ1Y7CQJEnNGCwkSVIzBgtJktSMwUKSJDVjsJAkSc0YLCRJUjMGC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUzEjBIskpSW5Msi3JubPcf06SG5L8V5J/SXJY+6lKmlT2EKk/5g0WSVYAFwKnAmuB05OsnTHsWmBdVT0euAJ4Q+uJSppM9hCpX1JVcw9IngicX1Und9fPA6iq1+9i/NHAm6rq+OHbp6en732irVu3jjlt7Y6ztkyNXeOtR043mImWgjVr1tx7eWpqKgv9fPYQ7Yq9aXLN1UdG2RRyKLB96PqO7rZdeR7wz7sxP0nLmz1E6pGVI4yZbYlm1tUcSZ4DrAOeNFfBdevWjfC0s9u0adPYNRar7pKpuWX8pbvdfQ1L5rUvk5ot605PL/oS3pLqITA57/uyr7nIvWmpfzYnqeZcfWSUYLEDWD10fRVwy8xBSU4C/hh4UlX9cDfnKGn5sodIPTLKppBrgDVJjkiyH3AasGF4QLdN9C3A+qq6rf00JU0we4jUI/MGi6q6GzgbuBLYAlxeVZuTXJBkfTfsL4EDgfcluS7Jhl2Uk9Qz9hCpX0bZFEJVbQQ2zrjt1UOXT2o8L0nLiD1E6g/PvClJkpoxWEiSpGYMFpIkqRmDhSRJasZgIUmSmjFYSJKkZgwWkiSpGYOFJElqxmAhSZKaMVhIkqRmDBaSJKkZg4UkSWpmpC8hkyT129EXb53j3qnBP1vmGgPXnrGm3YR2YVLmuZy5xkKSJDVjsJAkSc0YLCRJUjMGC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUzJI8QdZCnOBk7pqj1Z3Umgtl3Pdptnku/ns/KTVHq+uJfQYm6bM5KZ+jPpuUv6el0kNcYyFJkpoxWEiSpGYMFpIkqRmDhSRJasZgIUmSmhkpWCQ5JcmNSbYlOXeW+x+Q5L3d/VcnObz1RCVNLnuI1B/zBoskK4ALgVOBtcDpSdbOGPY84I6q+lngjcBftJ6opMlkD5H6JVU194DkicD5VXVyd/08gKp6/dCYK7sx/5FkJXAr8NAaKj49PT33E0ladFNTU1no57CHSMvbzD4yyqaQQ4HtQ9d3dLfNOqaq7gamgYP3fJqSlhF7iNQjowSL2ZZoZi45jDJGUj/ZQ6QeGeWU3juA1UPXVwG37GLMjm415hTw7eEBi7HKVdKSZA+RemSUNRbXAGuSHJFkP+A0YMOMMRuA53aXnw18oubbeUNSX9hDpB6ZN1h02zvPBq4EtgCXV9XmJBckWd8Nuwg4OMk24BzgfoeTtTLfYWt7UO/tSW5Lcn2L+XU1Vyf5ZJItSTYneUmDmg9M8p9JvtDV/JMWc+1qr0hybZIPN6x5c5IvJrkuyaZGNR+c5IokX+p+t08cs97juvnt/PlOkpc2mOcfdO/R9Unek+SBDWq+pKu3ucUcF9Ny7yFdTftI4z5iD5ngHlJVE/MDrAC+AjwG2A/4ArB2zJonAMcA1zec5yOBY7rLBwFfbjDPAAd2l/cFrgaOazTfc4BLgQ83/B3cDBzS+P1/F/D87vJ+wIMb/23dChw2Zp1Dga8CD+quXw6cOWbNo4Drgf0ZbL78OLCm5e+2Lz8L0UO6uvaRxn3EHjK5PWTSzrx5LLCtqm6qqruAy4BnjVOwqj7FjG2546qqb1bV57vL32WwlDZzL/jdrVlV9b3u6r7dz9iripOsAp4OvG3cWgspyU8xaN4XAVTVXVV1Z8OneArwlar6WoNaK4EHdfsK7M/99yfYXUcCn62q/63B0v+/Ar86Zs2+at5DwD4yCX3EHrJ4PWTSgsUoh60tKd0ZBI9msGQwbq0VSa4DbgM+VlVj1wT+FngFcE+DWsMK+GiSzyV5QYN6jwFuB97RrW59W5IDGtTd6TTgPeMWqapvAH8FfB34JjBdVR8ds+z1wAlJDk6yP/A07rszpEY3cT0EettH7CET2kMmLVhM1CFpSQ4E3g+8tKq+M269qvpxVf0cg73qj01y1JjzewZwW1V9bty5zeL4qjqGwdkWX5TkhDHrrWSwqvnNVXU08H0abYfvdihcD7yvQa2fZrAEfATwKOCAJM8Zp2ZVbWFwJsqPAR9hsPr+7jGn2lcT1UOg133EHjKhPWTSgsUoh60tCUn2ZdAMLqmqD7Ss3a2+uwo4ZcxSxwPrk9zMYJXwk5O8e8yaAFTVLd2/twEfZLAKehw7gB1DS1dXMGgSLZwKfL6q/rtBrZOAr1bV7VX1I+ADwC+MW7SqLqqqY6rqBAar3LeOW7OnJqaHQL/7iD1kcnvIpAWLUQ5b2+uShMF2vC1V9TeNaj40yYO7yw9i8Mf3pXFqVtV5VbWqqg5n8Lv8RFWNlYy7+R2Q5KCdl4FfYbAqbpy53gpsT/K47qanADeMNdGfOJ0GqzA7XweOS7J/93fwFAbbxseS5GHdv48Gfo128+2biegh0O8+Yg+Z7B4yygmyloyqujvJzsPWVgBvr6rN49RM8h7gROCQJDuA11TVRWNO9XjgDOCL3bZMgFdW1cYxaj4SeFcGX+i0D4ND9podHtrYw4EPDj4TrAQuraqPNKj7YuCS7j+Em4DfHbdgt73xqcALx60FUFVXJ7kC+DyDVY3XAn/foPT7kxwM/Ah4UVXd0aBm7yxEDwH7yAKwh0xwD5n3S8gkSZJGNWmbQiRJ0hJmsJAkSc0YLCRJUjMGC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUzP8D6CmopLsJyiUAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db57707c50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from filterpy.discrete_bayes import predict\n",
    "\n",
    "belief = [.05, .05, .05, .05, .55, .05, .05, .05, .05, .05]\n",
    "prior = predict(belief, offset=1, kernel=[.1, .8, .1])\n",
    "book_plots.plot_belief_vs_prior(belief, prior, ylim=(0,0.6))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "All of the elements are unchanged except the middle ones. The values in position 4 and 6 should be \n",
    "$$(0.1 \\times 0.05)+ (0.8 \\times 0.05) + (0.1 \\times 0.55) = 0.1$$\n",
    "\n",
    "Position 5 should be $$(0.1 \\times 0.05) + (0.8 \\times 0.55)+ (0.1 \\times 0.05) = 0.45$$\n",
    "\n",
    "Let's ensure that it shifts the positions correctly for movements greater than one and for asymmetric kernels."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAD59JREFUeJzt3XuQnXV9x/H3hwRULl0reCURsF0dMozTMCliaZEqFvASp63tQCuVjqKdEaulasE6SqnW1l7sH1LHKl4GQUTUSm0qapVqbaVEwUqImIhoIlKownppFZFv/zhP8LBsdk9yfpvs2ef9mtnJufzO9/zO7p5vPs/vec6zqSokSZJa2GdvT0CSJC0fBgtJktSMwUKSJDVjsJAkSc0YLCRJUjMGC0mS1IzBooeS3JzkxHEel+SVSd424uMenuRTSb6b5K939XklLQ9JfinJjXt7HlpcK/f2BDSZqurPdmH4C4D/AX6qPHGK1FtV9WngcXt7HlpcrlhoTzgMuMFQIfVXkrE2ZJOsaDUXLS6DRX/9fJIbktyR5B1JHgiQ5BlJrktyZ5J/T/L4uR6c5Lwk7x66fmw3/s4kX0hyQnf7O4HnAq9I8r3d2QUjaenqdpGeO7ufJDkhyfYkf5TkVuAdO24beuyRSa7q+samJOuH7ntnkjcn2ZDk+8Av743Xp11nsOiv3wZOAn4GeCzwqiRHA28HXggcDLwFuCLJA+YrlORQ4J+A1wIPAV4GvD/JQ6vqDOBi4A1VdWBVfXyRXo+kved+/aS7/REMesJhDHaJ3ivJvsA/Ah8FHga8GLg4yfCukt8CXgccBPzbIs5fDRks+utNVbWtqr7N4I17GnAm8JaqurqqflxV7wJ+CBy7QK3nABuqakNV3VNVHwM2Ak9bzBcgacmYq58A3AO8pqp+WFX/N+sxxwIHAn9eVXdV1SeADw89FuBDVfWZrq/8YLFfhNowWPTXtqHLXwMexWCr4g+7Zck7k9wJrO7um89hwG/MetwvAo9cjIlLWnLm6icAt88TCB4FbKuqe2Y99tCd1NWE8FMh/bV66PKjgVsYvIlfV1Wv28Va24CLqurMVpOTNFHm6icA8x2wfQuwOsk+Q+Hi0cCXh8Z4wPcEcsWiv16UZFWShwCvBN4LvBX4vSRPyMABSZ6e5KAFar0beGaSk5KsGDpwa9VivwhJS8Jc/WQhVwPfZ3Bg977dAd/PBC5dvGlqTzBY9NclDA6auqn7em1VbWRwnMWbgDuArcAZCxWqqm3Asxg0lNsZrGC8HH+/pL64Xz9Z6AFVdRewHjiFwXlu/g74nar60iLOU3tAPLWAJGl3JbkZeL6f+NIOblFKkqRmRgoWSU5OcmOSrUnO2cmY3+xOkLIpySVtpylpktlDpP5YcFdIdxrVLwNPBbYD1wCnVdUNQ2OmgcuAJ1fVHUkeVlW3Ld60JU0Ke4jUL6OsWBwDbK2qm7qDbS5lcKDesDOBC6rqDgAbgqQh9hCpR0Y5j8Wh3PckJduBJ8wa81iAJJ8BVgDnVdVHhgfMzMx4lKi0xExNTWUPPI09RFrGZveRUYLFXI1n9ht8JTANnACsAj6d5KiqunN3JilpWbGHSD0yyq6Q7dz3rGqr+MlZ1YbHfKiqflRVXwVuZNAkJMkeIvXIKCsW1wDTSY4AvgGcyuAvzg37BwZ/OOadSQ5hsKx5084KTk1N7d5sgY0bNwKwbt263a6xp+pa05ottao7MzPTYjq7Ykn1EJicn7s1l37Nxaq71GvO10cWXLGoqruBs4Argc3AZVW1Kcn5SdZ3w64EvpXkBuCTwMur6ltjz1zSxLOHSP0y0h8hq6oNwIZZt7166HIBZ3dfknQf9hCpPzzzpiRJasZgIUmSmjFYSJKkZgwWkiSpmZEO3tRkW3vRlgVGdB/d27zzcdee7ikFJEkLc8VCkiQ1Y7CQJEnNGCwkSVIzBgtJktSMwUKSJDVjsJAkSc0YLCRJUjMGC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUjMFCkiQ1Y7CQJEnNGCwkSVIzBgtJktSMwUKSJDVjsJAkSc0YLCRJUjMGC0mS1IzBQpIkNWOwkCRJzYwULJKcnOTGJFuTnDPPuGcnqSTr2k1R0qSzh0j9sWCwSLICuAA4BVgDnJZkzRzjDgJ+H7i69SQlTS57iNQvo6xYHANsraqbquou4FLgWXOM+1PgDcAPGs5P0uSzh0g9kqqaf0DybODkqnp+d/104AlVddbQmLXAq6rq15NcBbysqjYO15mZmbn3ibZs2dLuFWhBZ26eGrvGW4+caTATLQXT09P3Xp6amspiP589RFp+5usjK0d4/FyN5943eJJ9gDcCZ+ze9CQtc/YQqUdGCRbbgdVD11cBtwxdPwg4CrgqCcAjgCuSrJ+9xbHDunW7f1zWxo0bx66xp+oumZqbx9+629XXsGRe+zKp2bLuzMweX31aUj0EJufnbs2lX3Ox6i71mvP1kVGOsbgGmE5yRJL9gFOBK3bcWVUzVXVIVR1eVYcDnwV22hAk9Y49ROqRBYNFVd0NnAVcCWwGLquqTUnOT7J+sScoabLZQ6R+GWVXCFW1Adgw67ZX72TsCeNPS9JyYg+R+sMzb0qSpGYMFpIkqRmDhSRJasZgIUmSmhnp4E1Jkvpq7UULnQuoO7vxPOcMuvb06Z3et9y4YiFJkpoxWEiSpGYMFpIkqRmDhSRJasZgIUmSmjFYSJKkZgwWkiSpGYOFJElqxmAhSZKaMVhIkqRmDBaSJKkZg4UkSWrGYCFJkpoxWEiSpGYMFpIkqRmDhSRJasZgIUmSmjFYSJKkZgwWkiSpGYOFJElqxmAhSZKaMVhIkqRmDBaSJKmZkYJFkpOT3Jhka5Jz5rj/7CQ3JPmvJP+S5LD2U5U0qewhUn8sGCySrAAuAE4B1gCnJVkza9i1wLqqejxwOfCG1hOVNJnsIVK/pKrmH5A8ETivqk7qrp8LUFWv38n4tcCbquq44dtnZmbufaItW7aMOW3tijM3T41d461HzjSYiZaC6enpey9PTU1lsZ/PHqJJZw+9v/n6yCi7Qg4Ftg1d397dtjPPA/55F+YnaXmzh0g9snKEMXNt0cy5zJHkOcA64EnzFVy3bt0ITzu3jRs3jl1jT9VdMjU3j791t6uvYcm89mVSs2XdmZk9vuW0pHoITM7P3ZpLpKY99H7m6yOjBIvtwOqh66uAW2YPSnIi8MfAk6rqh7s4R0nLlz1E6pFRdoVcA0wnOSLJfsCpwBXDA7p9om8B1lfVbe2nKWmC2UOkHlkwWFTV3cBZwJXAZuCyqtqU5Pwk67thfwkcCLwvyXVJrthJOUk9Yw+R+mWUXSFU1QZgw6zbXj10+cTG85K0jNhDpP7wzJuSJKkZg4UkSWrGYCFJkpoZ6RgLSZLUztqLFjo3Rne2z3nOoXHt6dM7vW9vcsVCkiQ1Y7CQJEnNGCwkSVIzBgtJktSMwUKSJDVjsJAkSc0YLCRJUjMGC0mS1IwnyJIkaRlYKifdcsVCkiQ1Y7CQJEnNGCwkSVIzBgtJktSMB29KkvaK+Q82XPhAQ7j/wYaLUVO7xhULSZLUjMFCkiQ1Y7CQJEnNLMljLPb8frfR6k5qzcUy7s9prnlOyj7XSfkd7atJem/2+X2k5ckVC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUzEjBIsnJSW5MsjXJOXPc/4Ak7+3uvzrJ4a0nKmly2UOk/lgwWCRZAVwAnAKsAU5LsmbWsOcBd1TVzwJvBP6i9UQlTSZ7iNQvqar5ByRPBM6rqpO66+cCVNXrh8Zc2Y35jyQrgVuBh9ZQ8ZmZmfmfSNIeNzU1lcV+DnuItLzN7iOj7Ao5FNg2dH17d9ucY6rqbmAGOHj3pylpGbGHSD0ySrCYa4tm9pbDKGMk9ZM9ROqRUU7pvR1YPXR9FXDLTsZs75Yxp4BvDw/YE0uukpYke4jUI6OsWFwDTCc5Isl+wKnAFbPGXAE8t7v8bOATtdDBG5L6wh4i9ciCwaLb33kWcCWwGbisqjYlOT/J+m7YhcDBSbYCZwP3+zhZKwt9bG036r09yW1Jrm8xv67m6iSfTLI5yaYkL2lQ84FJ/jPJF7qaf9Jirl3tFUmuTfLhhjVvTvLFJNcl2dio5oOTXJ7kS9339olj1ntcN78dX99J8tIG8/yD7md0fZL3JHlgg5ov6eptajHHPWm595Cupn2kcR+xh0xwD6mqifkCVgBfAR4D7Ad8AVgzZs3jgaOB6xvO85HA0d3lg4AvN5hngAO7y/sCVwPHNprv2cAlwIcbfg9uBg5p/PN/F/D87vJ+wIMb/27dChw2Zp1Dga8CD+quXwacMWbNo4Drgf0Z7L78ODDd8nvbl6/F6CFdXftI4z5iD5ncHjJpZ948BthaVTdV1V3ApcCzxilYVZ9i1r7ccVXVN6vq893l7zLYSpt9FPyu1qyq+l53dd/ua+yl4iSrgKcDbxu31mJK8lMMmveFAFV1V1Xd2fApngJ8paq+1qDWSuBB3bEC+3P/4wl21ZHAZ6vqf2uw9f+vwK+OWbOvmvcQsI9MQh+xh+y5HjJpwWKUj60tKd0ZBNcy2DIYt9aKJNcBtwEfq6qxawJ/C7wCuKdBrWEFfDTJ55K8oEG9xwC3A+/ollvfluSABnV3OBV4z7hFquobwF8BXwe+CcxU1UfHLHs9cHySg5PsDzyN+x4MqdFNXA+B3vYRe8iE9pBJCxYT9ZG0JAcC7wdeWlXfGbdeVf24qn6OwVH1xyQ5asz5PQO4rao+N+7c5nBcVR3N4GyLL0py/Jj1VjJYan5zVa0Fvk+j/fDdAYXrgfc1qPXTDLaAjwAeBRyQ5Dnj1KyqzQzORPkx4CMMlu/vHnOqfTVRPQR63UfsIRPaQyYtWIzysbUlIcm+DJrBxVX1gZa1u+W7q4CTxyx1HLA+yc0MloSfnOTdY9YEoKpu6f69DfgggyXocWwHtg9tXV3OoEm0cArw+ar67wa1TgS+WlW3V9WPgA8AvzBu0aq6sKqOrqrjGSy5bxm3Zk9NTA+BfvcRe8jk9pBJCxajfGxtr0sSBvvxNlfV3zSq+dAkD+4uP4jBL9+XxqlZVedW1aqqOpzB9/ITVTVWMu7md0CSg3ZcBn6FwVLcOHO9FdiW5HHdTU8Bbhhroj9xGg2WMDtfB45Nsn/3e/AUBvvGx5LkYd2/jwZ+jXbz7ZuJ6CHQ7z5iD5nsHjLKCbKWjKq6O8mOj62tAN5eVZvGqZnkPcAJwCFJtgOvqaoLx5zqccDpwBe7fZkAr6yqDWPUfCTwrgz+oNM+DD6y1+zjoY09HPjg4D3BSuCSqvpIg7ovBi7u/kO4CfjdcQt2+xufCrxw3FoAVXV1ksuBzzNYarwW+PsGpd+f5GDgR8CLquqOBjV7ZzF6CNhHFoE9ZIJ7yIJ/hEySJGlUk7YrRJIkLWEGC0mS1IzBQpIkNWOwkCRJzRgsJElSMwYLSZLUjMFCkiQ1Y7CQJEnN/D+6xaZaXbeK+wAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db576ea3c8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "prior = predict(belief, offset=3, kernel=[.05, .05, .6, .2, .1])\n",
    "book_plots.plot_belief_vs_prior(belief, prior, ylim=(0,0.6))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The position was correctly shifted by 3 positions and we give more weight to the likelihood of an overshoot vs an undershoot, so this looks correct.\n",
    "\n",
    "Make sure you understand what we are doing. We are making a prediction of where the dog is moving, and convolving the probabilities to get the prior.\n",
    "\n",
    "If we weren't using probabilities we would use this equation that I gave earlier:\n",
    "\n",
    "$$ \\bar x_{k+1} = x_k + f_{\\mathbf x}(\\bullet)$$\n",
    "\n",
    "The prior, our prediction of where the dog will be, is the amount the dog moved plus his current position. The dog was at 10, he moved 5 meters, so he is now at 15 m. It couldn't be simpler. But we are using probabilities to model this, so our equation is:\n",
    "\n",
    "$$ \\bar{ \\mathbf x}_{k+1} = \\mathbf x_k \\ast f_{\\mathbf x}(\\bullet)$$\n",
    "\n",
    "We are *convolving* the current probabilistic position estimate with a probabilistic estimate of how much we think the dog moved. It's the same concept, but the math is slightly different. $\\mathbf x$ is bold to denote that it is an array of numbers. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Integrating Measurements and Movement Updates\n",
    "\n",
    "The problem of losing information during a prediction may make it seem as if our system would quickly devolve into having no knowledge. However, each prediction is followed by an update where we incorporate the measurement into the estimate. The update improves our knowledge. The output of the update step is fed into the next prediction. The prediction degrades our certainty. That is passed into another update, where certainty is again increased.\n",
    "\n",
    "Let's think about this intuitively. Consider a simple case - you are tracking a dog while he sits still. During each prediction you predict he doesn't move. Your filter quickly *converges* on an accurate estimate of his position. Then the microwave in the kitchen turns on, and he goes streaking off. You don't know this, so at the next prediction you predict he is in the same spot. But the measurements tell a different story. As you incorporate the measurements your belief will be smeared along the hallway, leading towards the kitchen. On every epoch (cycle) your belief that he is sitting still will get smaller, and your belief that he is inbound towards the kitchen at a startling rate of speed increases.\n",
    "\n",
    "That is what intuition tells us. What does the math tell us?\n",
    "\n",
    "We have already programmed the update and predict steps. All we need to do is feed the result of one into the other, and we will have implemented a dog tracker!!! Let's see how it performs. We will input measurements as if the dog started at position 0 and moved right one position each epoch. As in a real world application, we will start with no knowledge of his position by assigning equal probability to all positions. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEpBJREFUeJzt3X2QXXddx/H3h6SRQstWCiptIi26IhEdiktLZaxI0aYiwQfURqjWsaIzREB8alErdlQUGWGQ6oi0wEhLqcWHUDMWENHxgdq15aFpqIltoWsoRWgvUpU29Osf9yTcbja7N7m/Tfbufb9mdnLOub/7Pd/sbr75nt95uKkqJEmSWnjE0U5AkiStHjYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbHQUJJ8e5LbjnYekiZLklclecvRzkPDi8+xkCQthyRvA+aq6lePdi46cpyx0JKSrB3x/Wta5SJpcoxSe0atWzp8NhYTLMmdSS5OcmuSe5O8Nckjkzw7yVySX05yN/DWfdsG3vuUJB9Mcl+SHUk2D7z2tiR/lGR7kvuB7zwafz9Jh+ZgNaF77aeS7E7yuSTbkpzUbU+S1ye5J0kvyUeTPDXJS4AXAb+U5AtJ3tONPynJu5N8JskdSV42sP9XJ7k2yTuSfB64oNv2joExm7uac19Xg54yL/9fTvJR4H6bi6PDxkIvAs4Bvg74BmDflOXXAI8Fngi8ZPANSY4B3gO8F/gq4GeBK5M8eWDYjwK/BRwP/OMy5i+prQNqQpLnAK8Bfhh4AvAJ4Opu/HcDZ3VjTwB+BPhsVb0ZuBJ4bVUdV1XPT/II+rXjI8DJwNnAK5KcM7D/FwDXdrGuHEwsyTcA7wReATwe2A68J8m6gWFbgOcBJ1TV3tG/HTpUNhZ6U1XdVVWfo98IbOm2PwT8elV9sar+d957ngkcB/xOVT1QVR8Arht4L8BfVdU/VdVDVfV/y/2XkNTMQjXhRcAVVXVTVX0RuBg4M8kpwIP0DyC+kf51ezur6lMHif0M4PFVdWlXO24H/gQ4b2DMv1TVX3a1Y37t+RHgr6vqfVX1IPA64Fjg2wbGvLHLf/57dYTYWOiugeVPACd1y59ZpCE4Cbirqh6a996TDxJX0vhYqCac1C0DUFVfAD4LnNwdWLwJuAz4dJI3J3nMQWI/ETipO41xX5L7gFcBX32Q/c83P4+HuvHWnhXExkIbBpa/FtjTLS92u9AeYEM3rTn43v8cWPd2I2k8LVQT9tBvCgBI8mjgRLp/81X1xqr6VuCb6J8S+cVu6Pw6cBdwR1WdMPB1fFV9z8CYpWrPYB7p8rX2rCA2FnppkvVJHkv/yOFdQ7znBuB++hdlHZPk2cDz+fI5V0nja6GacBXwE0meluQrgN8GbqiqO5M8I8kZ3bVX9wP/B3ypi/Vp4EkDsf8V+Hx3geWxSdZ0F3o+Y8jcrgGel+Tsbn8/D3wR+OdR/9Jqx8ZCV9G/CPP27us3l3pDVT0AbAbOBf4L+EPgx6rq48uYp6Qj44CaUFV/C/wa8G7gU/Qv7Nx3XcRj6F8ncS/90xSfpX/tA8DlwMbutMdfVtWX6B+EPA24g379eAswNUxiVXUb8GLgD7r3Ph94fleTtEL4gKwJluRO4MKqev/RzkXS0WdNUAvOWEiSpGaGaiySbEpyW/dwlIsWeP2C7mEnH+6+LmyfqqRxZQ2RJseSp0K6xzH/O/BdwBxwI7Clqm4dGHMBMFNVW5cvVUnjyBoiTZZhZixOB3ZX1e3dBTJX038ymiQNwxoiTZBhnqN+Mg9/4MgccMYC434wyVn0j0x+rqoe9pCSXq/nVaLSCjM1NZUjsBtriLSKza8jw8xYLFR45v8Dfw9wSlV9C/B+4O2Hl56kVcgaIk2QYRqLOR7+JLb1fPnpjABU1We758dD/37mb22TnqRVwBoiTZBhToXcCEwnOZX+Y1PPo//JlfslecLAh85sBnYuFnBqaqhnoSxodnYWgJmZmcOOcaTiGtOYLbWK2+v1WqRzKFZUDYHx+bkbc+XHXK64Kz3mYnVkycaiqvYm2QpcD6yh/wl3O5JcCsxW1TbgZUk2A3uBzwEXjJy1pFXBGiJNlmFmLKiq7fQ/935w2yUDyxfT/xhdSTqANUSaHD55U5IkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzQzUWSTYluS3J7iQXLTLuhUkqSdsPu5c01qwh0uRYsrFIsga4DDgX2AhsSbJxgXHHAy8DbmidpKTxZQ2RJkuqavEByZnAq6vqnG79YoCqes28cW8A3g/8AvALVTU7+Hqv19u/o127djVJXtKhm56e3r88NTWV5d6fNURafRarI8OcCjkZuGtgfa7btl+S04ANVXXd4acpaZWyhkgTZO0QYxY6otl/5JDkEcDrgQuG3enMzOGfPp2dnR05xpGKa0xjttQqbq/Xa5HOoVhRNQTG5+duzJUfc7nirvSYi9WRYWYs5oANA+vrgT0D68cDTwU+mORO4JnANi++ktSxhkgTZJjG4kZgOsmpSdYB5wHb9r1YVb2qelxVnVJVpwAfAjbPPz8qaWJZQ6QJsmRjUVV7ga3A9cBO4Jqq2pHk0iSblztBSePNGiJNlmGusaCqtgPb52275CBjnz16WpJWE2uINDl88qYkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZoZqLJJsSnJbkt1JLlrg9Z9J8rEkH07yj0k2tk9V0riyhkiTY8nGIska4DLgXGAjsGWBf/RXVdU3V9XTgNcCv988U0ljyRoiTZZU1eIDkjOBV1fVOd36xQBV9ZqDjN8C/FhVnTu4vdfr7d/Rrl27Rkxb0uGanp7evzw1NZXl3p81RFp9Fqsja4d4/8nAXQPrc8AZ8wcleSnwSmAd8JzDSVTSqmQNkSbIMI3FQkc0B0xzVNVlwGVJfhT4VeDHDxZwZmZm6ATnm52dHTnGkYprTGO21Cpur9drkc6hWFE1BMbn527MlR9zueKu9JiL1ZFhLt6cAzYMrK8H9iwy/mrg+4bKTNIksIZIE2SYxuJGYDrJqUnWAecB2wYHJJkeWH0e4AlQSftYQ6QJsuSpkKram2QrcD2wBriiqnYkuRSYraptwNYkzwUeBO5lkSlMSZPFGiJNlmGusaCqtgPb5227ZGD55Y3zkrSKWEOkyeGTNyVJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqZqjGIsmmJLcl2Z3kogVef2WSW5N8NMnfJnli+1QljStriDQ5lmwskqwBLgPOBTYCW5JsnDfsZmCmqr4FuBZ4betEJY0na4g0WYaZsTgd2F1Vt1fVA8DVwAsGB1TV31XV/3SrHwLWt01T0hizhkgTJFW1+IDkhcCmqrqwWz8fOKOqth5k/JuAu6vqNwe393q9/TvatWvXqHlLOkzT09P7l6emprLc+7OGSKvPYnVk7RDvX6jwLNiNJHkxMAN8xyHkJ2l1s4ZIE2SYxmIO2DCwvh7YM39QkucCvwJ8R1V9cbGAMzMzh5Ljw8zOzo4c40jFNaYxW2oVt9frtUjnUKyoGgLj83M35sqPuVxxV3rMxerIMNdY3AhMJzk1yTrgPGDb4IAkpwF/DGyuqntGyFXS6mMNkSbIkjMWVbU3yVbgemANcEVV7UhyKTBbVduA3wOOA/4sCcAnq2rzMuYtaUwcjRpy2p8udQ3GVP+PnQcfd/P50w9bX46Ymlyr+fdpmFMhVNV2YPu8bZcMLD+3cV6SVhFriDQ5fPKmJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGaGaiySbEpyW5LdSS5a4PWzktyUZG+SF7ZPU9I4s4ZIk2PJxiLJGuAy4FxgI7AlycZ5wz4JXABc1TpBSePNGiJNlrVDjDkd2F1VtwMkuRp4AXDrvgFVdWf32kPLkKOk8WYNkSZIqmrxAf1pyU1VdWG3fj5wRlVtXWDs24Drqura+a/1er39O9q1a9eIaUs6XNPT0/uXp6amstz7Oxo15Kd2To2YNfzJU3rLHlOTa9x/nxarI8PMWCxUeBbvRkY0LkVhkmO2iLscMReKO8kxV4gjXkMkHT3DNBZzwIaB9fXAnlF2OjMzs/iAnaPPaBywD2O2jdkg7nLEXDDuJMdcQK93xJsPa8jBYi5hdnb2sN5nzCMX87Djjvnv02J1ZJi7Qm4EppOcmmQdcB6wbeSsJE0Ka4g0QZZsLKpqL7AVuB7YCVxTVTuSXJpkM0CSZySZA34I+OMkO5YzaUnjwxoiTZZhToVQVduB7fO2XTKwfCP96U1JOoA1RJocPnlTkiQ1Y2MhSZKasbGQJEnNDHWNhSRpeZz2p4vddtg922SRWxNvPn/6gG2jxlworjEXc3g/p9ZWSp7OWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZoZqLJJsSnJbkt1JLlrg9a9I8q7u9RuSnNI6UUnjyxoiTY4lG4ska4DLgHOBjcCWJBvnDftJ4N6q+nrg9cDvtk5U0niyhkiTJVW1+IDkTODVVXVOt34xQFW9ZmDM9d2Yf0myFrgbeHwNBO/1eovvSNIRNzU1leXehzVEWt3m15FhToWcDNw1sD7XbVtwTFXtBXrAiYefpqRVxBoiTZBhGouFjmjmHzkMM0bSZLKGSBNkmI9NnwM2DKyvB/YcZMxcN405BXxucMCRmHKVtCJZQ6QJMsyMxY3AdJJTk6wDzgO2zRuzDfjxbvmFwAdqqYs3JE0Ka4g0QZZsLLrznVuB64GdwDVVtSPJpUk2d8MuB05Msht4JXDA7WStLHXb2mHEuyLJPUluaZFfF3NDkr9LsjPJjiQvbxDzkUn+NclHupi/0SLXLvaaJDcnua5hzDuTfCzJh5PMNop5QpJrk3y8+96eOWK8J3f57fv6fJJXNMjz57qf0S1J3pnkkQ1ivryLt6NFjkfSaq8hXUzrSOM6Yg0Z4xpSVWPzBawB/gN4ErAO+AiwccSYZwFPB25pmOcTgKd3y8cD/94gzwDHdcvHADcAz2yU7yuBq4DrGn4P7gQe1/jn/3bgwm55HXBC49+tu4EnjhjnZOAO4Nhu/RrgghFjPhW4BXgU/dOX7wemW35vJ+VrOWpIF9c60riOWEPGt4aM25M3Twd2V9XtVfUAcDXwglECVtU/MO9c7qiq6lNVdVO3/N/0j9LmXwV/qDGrqr7QrR7TfY08VZxkPfA84C2jxlpOSR5Dv3hfDlBVD1TVfQ13cTbwH1X1iQax1gLHdtcKPIoDryc4VE8BPlRV/1P9o/+/B75/xJiTqnkNAevIONQRa8iRqyHj1lgMc9vaitI9QfA0+kcGo8Zak+TDwD3A+6pq5JjAG4BfAh5qEGtQAe9N8m9JXtIg3pOAzwBv7aZb35Lk0Q3i7nMe8M5Rg1TVfwKvAz4JfAroVdV7Rwx7C3BWkhOTPAr4Hh5+MaSGN3Y1BCa2jlhDxrSGjFtjMVa3pCU5Dng38Iqq+vyo8arqS1X1NPpX1Z+e5Kkj5ve9wD1V9W+j5raAZ1XV0+k/bfGlSc4aMd5a+lPNf1RVpwH30+g8fHdB4WbgzxrE+kr6R8CnAicBj07y4lFiVtVO+k+ifB/wN/Sn7/eOmOqkGqsaAhNdR6whY1pDxq2xGOa2tRUhyTH0i8GVVfXnLWN303cfBDaNGOpZwOYkd9KfEn5OkneMGBOAqtrT/XkP8Bf0p6BHMQfMDRxdXUu/SLRwLnBTVX26QaznAndU1Weq6kHgz4FvGzVoVV1eVU+vqrPoT7nvGjXmhBqbGgKTXUesIeNbQ8atsRjmtrWjLknon8fbWVW/3yjm45Oc0C0fS/+X7+OjxKyqi6tqfVWdQv97+YGqGqkz7vJ7dJLj9y0D301/Km6UXO8G7kry5G7T2cCtIyX6ZVtoMIXZ+STwzCSP6n4PzqZ/bnwkSb6q+/NrgR+gXb6TZixqCEx2HbGGjHcNGeYBWStGVe1Nsu+2tTXAFVW1Y5SYSd4JPBt4XJI54Ner6vIRU30WcD7wse5cJsCrqmr7CDGfALw9/Q90egT9W/aa3R7a2FcDf9H/N8Fa4Kqq+psGcX8WuLL7D+F24CdGDdidb/wu4KdHjQVQVTckuRa4if5U483AmxuEfneSE4EHgZdW1b0NYk6c5aghYB1ZBtaQMa4hS34ImSRJ0rDG7VSIJElawWwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN/D9LkLFUPUkyIQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db56d24e10>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from filterpy.discrete_bayes import update\n",
    "\n",
    "hallway = np.array([1, 1, 0, 0, 0, 0, 0, 0, 1, 0])\n",
    "prior = np.array([.1] * 10)\n",
    "likelihood = lh_hallway(hallway, z=1, z_prob=.75)\n",
    "posterior = update(likelihood, prior)\n",
    "book_plots.plot_prior_vs_posterior(prior, posterior, ylim=(0,.5))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "After the first update we have assigned a high probability to each door position, and a low probability to each wall position. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEr1JREFUeJzt3X+QZHdZ7/H3h00igYSJBlSyuyZBR2RFi+CQECkjEjSJyOIP1CyCxhK5t4oVEL2YIEZuyntRpMRSoiWSICUJMQZ/LLhlABEtfxAzJvzIZom7JoEdQggXkkZQSZY8948+u3QmszO929/emZ5+v6q6ts/p73nOMzPdzz79PadPp6qQJElq4RGrnYAkSVo/bCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjY6GxSvLqJG9Z7Twkrb4k35XkttXOQ+MVr2OhQ0nyR8BCVb1mtXORJE0GZyw0NkmOWY1tJa09o76mk2xolYvGy8ZiHUlyZ5JLktya5N4kb03yyO6xn02yN8nnkuxIckq3PknemOSeJL0kH0ny5CQvAX4CeFWSLyR5Vzf+lCTvTPKZJHckednA/l+b5Lokb0/yeeCibt3bB8ZsTbIryX1JPpDkSYvy/6UkHwG+aHMhrX2HqjtJnplkoXtN3w289cC6gW2f1NWB+7q6sHXgsT9K8vtJdib5IvA9q/Hz6fDZWKw/PwGcB3wj8M3Aa5I8C3gd8GPA44GPA9d0478POKcbexLw48Bnq+rNwFXA66vqhKp6bpJHAO8CPgxsBM4FXpHkvIH9Pw+4rot11WBiSb4ZeAfwCuBxwE7gXUmOGxi2DXgOcFJV7R/91yHpKHhY3enWfz3wNcCpwEsGN0hyLP168h7ga4GfA65K8sSBYS8A/g9wIvAPY8xfDdlYrD9vqqp9VfU5+i/IbfRf9FdW1U1V9SXgEuDsJKcBD9B/0X4L/XNudlfVpw4R+2nA46rqsqq6v6puB/4QuHBgzD9X1V9U1YNV9V+Ltv9x4K+q6r1V9QDwBuB44DsHxvxOl//ibSWtXUvVHYAHgV+tqi8t8Zp+OnAC8OtdPXk/8O6BbQH+sqr+sasn/z3uH0Jt2FisP/sG7n8cOKW7ffzAyqr6AvBZYGP3Yn4TcDnw6SRvTvKYQ8Q+FTilm7a8L8l9wKuBrzvE/hdbnMeD3fiNQ24vaW1aqu4AfGaZhuAUYF9XBwa3tR5MOBuL9WfzwP1vAO7qbqceWJnk0cDJwCcBqup3quo7gG+lP435v7qhiz8ytA+4o6pOGridWFXfPzBmuY8ZLc4jXb6fHHJ7SWvTUnUHVq4Hm7tDrIPbWg8mnI3F+vPSJJuSfA392YQ/Aa4GfjrJU5J8FfB/gRuq6s4kT0tyVne884vAfwNf7mJ9GnjCQOx/AT7fnYx1fJIN3YmeTxsyt2uB5yQ5t9vfLwBfAv5p1B9a0qpaqu6s5Ab6NedVSY5N8kzguXzl/C9NKBuL9edq+idD3d7dfq2q/gb4FeCdwKfon2B14LyIx9A/T+Je+tOQn6V/7gPAFcCW7rDHX1TVl+m/8J8C3AH8P+AtwMwwiVXVbcALgd/ttn0u8Nyqun+UH1jSqntY3Vlpg+51vxW4gH49+D3gJ6vqY2PMU0eBF8haR5LcCby4qt632rlImg7WHS3mjIUkSWpmqMYiyflJbususHTxEo9f1F0w6UPd7cXtU5U0qawh0vRY8VBIdxnVfwO+F1gAbgS2VdWtA2MuAuaqavv4UpU0iawh0nQZZsbiTGBvVd3enWxzDf2rK0rSMKwh0hQZ5rsYNvLQi5QsAGctMe5HkpxD/53Jz1fVQy5s0uv1PEtUWmNmZmZyFHZjDZHWscV1ZJgZi6UKz+IX+LuA06rq24H3AW87svQkrUPWEGmKDNNYLPDQq6pt4itXVQOgqj7bfQcF9K+J8B1t0pO0DlhDpCkyzKGQG4HZJKfTv9TqhfS/ce6gJI8f+OKqrcDu5QLOzAx1PaUlzc/PAzA3N3fEMY5WXGMas6VWcXu9Xot0DseaqiEwOX93Y679mOOKu9ZjLldHVmwsqmp/ku3A9cAG+t+SuSvJZcB8Ve0AXpZkK7Af+Bxw0chZS1oXrCHSdBlmxoKq2gnsXLTu0oH7l9D/Km5JehhriDQ9vPKmJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGaGaiySnJ/ktiR7k1y8zLjnJ6kkbb/sXtJEs4ZI02PFxiLJBuBy4AJgC7AtyZYlxp0IvAy4oXWSkiaXNUSaLqmq5QckZwOvrarzuuVLAKrqdYvG/TbwPuAXgV+sqvnBx3u93sEd7dmzp0nykg7f7OzswfszMzMZ9/6sIdL6s1wdGeZQyEZg38DyQrfuoCRnAJur6t1HnqakdcoaIk2RY4YYs9Q7moPvHJI8AngjcNGwO52bO/LDp/Pz8yPHOFpxjWnMllrF7fV6LdI5HGuqhsDk/N2NufZjjivuWo+5XB0ZZsZiAdg8sLwJuGtg+UTgycAHktwJPB3Y4clXkjrWEGmKDNNY3AjMJjk9yXHAhcCOAw9WVa+qHltVp1XVacAHga2Lj49KmlrWEGmKrNhYVNV+YDtwPbAbuLaqdiW5LMnWcScoabJZQ6TpMsw5FlTVTmDnonWXHmLsM0dPS9J6Yg2RpodX3pQkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUzFCNRZLzk9yWZG+Si5d4/H8m+WiSDyX5hyRb2qcqaVJZQ6TpsWJjkWQDcDlwAbAF2LbEi/7qqvq2qnoK8Hrgt5pnKmkiWUOk6ZKqWn5Acjbw2qo6r1u+BKCqXneI8duAn6yqCwbX93q9gzvas2fPiGlLOlKzs7MH78/MzGTc+7OGSOvPcnXkmCG23wjsG1heAM5aPCjJS4FXAscBzzqSRCWtS9YQaYoM01gs9Y7mYdMcVXU5cHmSFwCvAX7qUAHn5uaGTnCx+fn5kWMcrbjGNGZLreL2er0W6RyONVVDYHL+7sZc+zHHFXetx1yujgxz8uYCsHlgeRNw1zLjrwF+cKjMJE0Da4g0RYZpLG4EZpOcnuQ44EJgx+CAJLMDi88BPAAq6QBriDRFVjwUUlX7k2wHrgc2AFdW1a4klwHzVbUD2J7k2cADwL0sM4UpabpYQ6TpMsw5FlTVTmDnonWXDtx/eeO8JK0j1hBpenjlTUmS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKaGaqxSHJ+ktuS7E1y8RKPvzLJrUk+kuRvkpzaPlVJk8oaIk2PFRuLJBuAy4ELgC3AtiRbFg27GZirqm8HrgNe3zpRSZPJGiJNl2FmLM4E9lbV7VV1P3AN8LzBAVX1t1X1n93iB4FNbdOUNMGsIdIUSVUtPyB5PnB+Vb24W34RcFZVbT/E+DcBd1fVrw2u7/V6B3e0Z8+eUfOWdIRmZ2cP3p+Zmcm492cNkdaf5erIMUNsv1ThWbIbSfJCYA747sPIT9L6Zg2RpsgwjcUCsHlgeRNw1+JBSZ4N/DLw3VX1peUCzs3NHU6ODzE/Pz9yjKMV15jGbKlV3F6v1yKdw7GmaghMzt/dmGs/5rjirvWYy9WRYc6xuBGYTXJ6kuOAC4EdgwOSnAH8AbC1qu4ZIVdJ6481RJoiK85YVNX+JNuB64ENwJVVtSvJZcB8Ve0AfhM4AfjTJACfqKqtR5rUGX+83PHTmf4/u5c/xnrzi2Yfsrx8zOHiLo6p6TWO5+h6tRo1RNLqGeZQCFW1E9i5aN2lA/ef3TgvSeuINUSaHkM1FpI07cY16znq7Ne0zHxpcnhJb0mS1IyNhSRJasZDIZIkrQNr5UMKzlhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGaGaiySnJ/ktiR7k1y8xOPnJLkpyf4kz2+fpqRJZg2RpseKjUWSDcDlwAXAFmBbki2Lhn0CuAi4unWCkiabNUSaLsN8V8iZwN6quh0gyTXA84BbDwyoqju7xx4cQ46SJps1RJoiwzQWG4F9A8sLwFmj7HR+fn6FETOjhD/EPsYRc7zbGXMtx5zc59Ps7OhfMnSYVqGGjCPOuP7mo8W1Lq2NmOOKuzaeow+3XB0Z5hyLLLGuhtqzJFlDpKkyzIzFArB5YHkTcNcoO52bm1t+wDJf6XrE+xhHzBUc6PwOdztjTkDMCX4+9Xq9kbY/Ake/hqzgiH6X4/qbjxjXurS6MccVd009R5ewXB0ZprG4EZhNcjrwSeBC4AVD7VmSVqGGnPHHKxXYbsp4mUJ884uO+iEjaV1Y8VBIVe0HtgPXA7uBa6tqV5LLkmwFSPK0JAvAjwJ/kGTXOJOWNDmsIdJ0GWbGgqraCexctO7Sgfs30p/elKSHsYZI02OoxkKSNDmWPxS08mEg8FDQuK3nw3Ve0luSJDVjYyFJkprxUMgIxjGVNSkxV467OjGXijsp08LreWpUk29SXptHP+ZwcafptemMhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqZqjGIsn5SW5LsjfJxUs8/lVJ/qR7/IYkp7VOVNLksoZI02PFxiLJBuBy4AJgC7AtyZZFw34GuLeqvgl4I/AbrROVNJmsIdJ0SVUtPyA5G3htVZ3XLV8CUFWvGxhzfTfmn5McA9wNPK4Ggvd6veV3JOmom5mZybj3YQ2R1rfFdWSYQyEbgX0DywvduiXHVNV+oAecfORpSlpHrCHSFBmmsVjqHc3idw7DjJE0nawh0hQZ5mvTF4DNA8ubgLsOMWahm8acAT43OOBoTLlKWpOsIdIUGWbG4kZgNsnpSY4DLgR2LBqzA/ip7v7zgffXSidvSJoW1hBpiqzYWHTHO7cD1wO7gWuraleSy5Js7YZdAZycZC/wSuBhHydrZaWPrR1BvCuT3JPklhb5dTE3J/nbJLuT7Ery8gYxH5nkX5J8uIv5v1vk2sXekOTmJO9uGPPOJB9N8qEk841inpTkuiQf6363Z48Y74ldfgdun0/yigZ5/nz3N7olyTuSPLJBzJd38Xa1yPFoWu81pItpHWlcR6whE1xDqmpibsAG4N+BJwDHAR8GtowY8xzgqcAtDfN8PPDU7v6JwL81yDPACd39Y4EbgKc3yveVwNXAuxv+Du4EHtv47/824MXd/eOAkxo/t+4GTh0xzkbgDuD4bvla4KIRYz4ZuAV4FP3Dl+8DZlv+bqflNo4a0sW1jjSuI9aQya0hk3blzTOBvVV1e1XdD1wDPG+UgFX19yw6ljuqqvpUVd3U3f8P+u/SFp8Ff7gxq6q+0C0e291GnipOsgl4DvCWUWONU5LH0C/eVwBU1f1VdV/DXZwL/HtVfbxBrGOA47tzBR7Fw88nOFxPAj5YVf9Z/Xf/fwf80Igxp1XzGgLWkUmoI9aQo1dDJq2xGOZja2tKdwXBM+i/Mxg11oYkHwLuAd5bVSPHBH4beBXwYINYgwp4T5J/TfKSBvGeAHwGeGs33fqWJI9uEPeAC4F3jBqkqj4JvAH4BPApoFdV7xkx7C3AOUlOTvIo4Pt56MmQGt7E1RCY2jpiDZnQGjJpjcVEfSQtyQnAO4FXVNXnR41XVV+uqqfQP6v+zCRPHjG/HwDuqap/HTW3JTyjqp5K/2qLL01yzojxjqE/1fz7VXUG8EUaHYfvTijcCvxpg1hfTf8d8OnAKcCjk7xwlJhVtZv+lSjfC/w1/en7/SOmOq0mqobAVNcRa8iE1pBJayyG+djampDkWPrF4Kqq+rOWsbvpuw8A548Y6hnA1iR30p8SflaSt48YE4Cquqv79x7gz+lPQY9iAVgYeHd1Hf0i0cIFwE1V9ekGsZ4N3FFVn6mqB4A/A75z1KBVdUVVPbWqzqE/5b5n1JhTamJqCEx3HbGGTG4NmbTGYpiPra26JKF/HG93Vf1Wo5iPS3JSd/94+k++j40Ss6ouqapNVXUa/d/l+6tqpM64y+/RSU48cB/4PvpTcaPkejewL8kTu1XnAreOlOhXbKPBFGbnE8DTkzyqex6cS//Y+EiSfG337zcAP0y7fKfNRNQQmO46Yg2Z7BoyzAWy1oyq2p/kwMfWNgBXVtWuUWImeQfwTOCxSRaAX62qK0ZM9RnAi4CPdscyAV5dVTtHiPl44G3pf6HTI+h/ZK/Zx0Mb+zrgz/uvCY4Brq6qv24Q9+eAq7r/EG4HfnrUgN3xxu8F/seosQCq6oYk1wE30Z9qvBl4c4PQ70xyMvAA8NKqurdBzKkzjhoC1pExsIZMcA1Z8UvIJEmShjVph0IkSdIaZmMhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrm/wMlUs7SLk/I0wAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db58889390>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "kernel = (.1, .8, .1)\n",
    "prior = predict(posterior, 1, kernel)\n",
    "book_plots.plot_prior_vs_posterior(prior, posterior, True, ylim=(0,.5))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The predict step shifted these probabilities to the right, smearing them about a bit. Now let's look at what happens at the next sense."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEvFJREFUeJzt3X+U5XVdx/HnywUSBYdCK9ndBGsyNuuIjSB5IhMLyFz7YcX6o+ik1jlsavYLrMg4lWWd7IfUSUHzJEiE/VhtT6iZdfohMYEay0q7AbrjipjCNamElXd/3O/iZZiduTv3M7Nz5z4f58zZ7/fez31/3zNz573v7/fz/X5vqgpJkqQWHnGkE5AkSeuHjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLDSUJN+S5NYjnYekyZLk1UkuP9J5aHjxPhaSpJWQ5I+Buar6hSOdi1aPRyy0pCRHjfj6Da1ykTQ5Rqk9o9YtLZ+NxQRLckeSi5PckuTuJG9J8sgkz0wyl+TnktwJvOXgYwOvPTXJ+5Pck2RXkq0Dz/1xkj9MsjPJvcC3HYnvT9LhOVRN6J57aZK9ST6TZEeSk7rHk+T1Se5K0kvy4SRPTvIy4IXAzyb5XJJ3duNPSvKOJJ9KcnuSlw9s/zVJrk3ytiSfBS7oHnvbwJitXc25p6tBp87L/+eSfBi41+biyLCx0AuBc4CvBr4WOHjI8iuBLwOeALxs8AVJjgbeCbwb+HLgJ4ArkzxpYNgLgF8Fjgf+cQXzl9TWw2pCkmcBrwV+AHg88FHg6m78dwBndWNPAH4Q+HRVvRG4EnhdVR1XVc9N8gj6teNDwEbgbOCVSc4Z2P7zgGu7WFcOJpbka4G3A68EHgfsBN6Z5JiBYduA5wAnVNWB0X8cOlw2FnpDVe2rqs/QbwS2dY8/APxSVX2+qv533mueDhwH/HpV3VdV7wPeNfBagL+qqn+qqgeq6v9W+puQ1MxCNeGFwJur6saq+jxwMXBmkpOB++nvQHwd/fP2dlfVJw4R+2nA46rq0q523Aa8CTh/YMy/VNVfdrVjfu35QeCvq+o9VXU/8FvAscA3D4z5vS7/+a/VKrGx0L6B5Y8CJ3XLn1qkITgJ2FdVD8x77cZDxJU0PhaqCSd1ywBU1eeATwMbux2LNwCXAZ9M8sYkjzlE7CcAJ3XTGPckuQd4NfAVh9j+fPPzeKAbb+1ZQ2wstHlg+auA/d3yYpcL7Qc2d4c1B1/78YF1LzeSxtNCNWE//aYAgCSPBk6k+5uvqt+rqm8Cvp7+lMjPdEPn14F9wO1VdcLA1/FV9Z0DY5aqPYN5pMvX2rOG2FjowiSbknwZ/T2HPx3iNdcD99I/KevoJM8EnssX51wlja+FasJVwI8keUqSLwF+Dbi+qu5I8rQkZ3TnXt0L/B/whS7WJ4EnDsT+V+Cz3QmWxybZ0J3o+bQhc7sGeE6Ss7vt/RTweeCfR/2m1Y6Nha6ifxLmbd3Xryz1gqq6D9gKnAf8F/AHwA9V1UdWME9Jq+NhNaGq/hb4ReAdwCfon9h58LyIx9A/T+Ju+tMUn6Z/7gPAFcCWbtrjL6vqC/R3Qp4C3E6/flwOTA2TWFXdCrwI+P3utc8FntvVJK0R3iBrgiW5A3hJVb33SOci6cizJqgFj1hIkqRmhmoskpyb5Nbu5igXLfD8Bd3NTj7Yfb2kfaqSxpU1RJocS06FdLdj/g/g24E54AZgW1XdMjDmAmCmqravXKqSxpE1RJoswxyxOB3YW1W3dSfIXE3/zmiSNAxriDRBhrmP+kYeesOROeCMBcZ9X5Kz6O+Z/GRVPeQmJb1ez7NEpTVmamoqq7AZa4i0js2vI8McsVio8Mz/A38ncHJVfSPwXuCty0tP0jpkDZEmyDCNxRwPvRPbJr54d0YAqurT3f3joX898ze1SU/SOmANkSbIMFMhNwDTSU6hf9vU8+l/cuWDkjx+4ENntgK7Fws4NTXUvVAWNDs7C8DMzMyyY6xWXGMas6VWcXu9Xot0DseaqiEwPr93Y679mCsVd63HXKyOLNlYVNWBJNuB64AN9D/hbleSS4HZqtoBvDzJVuAA8BnggpGzlrQuWEOkyTLMEQuqaif9z70ffOySgeWL6X+MriQ9jDVEmhzeeVOSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSM0M1FknOTXJrkr1JLlpk3POTVJK2H3YvaaxZQ6TJsWRjkWQDcBlwHrAF2JZkywLjjgdeDlzfOklJ48saIk2WVNXiA5IzgddU1Tnd+sUAVfXaeeN+B3gv8NPAT1fV7ODzvV7vwQ3t2bOnSfKSDt/09PSDy1NTU1np7VlDpPVnsToyzFTIRmDfwPpc99iDkpwGbK6qdy0/TUnrlDVEmiBHDTFmoT2aB/cckjwCeD1wwbAbnZlZ/vTp7OzsyDFWK64xjdlSq7i9Xq9FOodjTdUQGJ/fuzHXfsyVirvWYy5WR4Y5YjEHbB5Y3wTsH1g/Hngy8P4kdwBPB3Z48pWkjjVEmiDDNBY3ANNJTklyDHA+sOPgk1XVq6rHVtXJVXUy8AFg6/z5UUkTyxoiTZAlG4uqOgBsB64DdgPXVNWuJJcm2brSCUoab9YQabIMc44FVbUT2DnvsUsOMfaZo6claT2xhkiTwztvSpKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWpmqE83TXIu8LvABuDyqvr1ec//OHAh8AXgc8DLquqWxrlKGlProYac9id7lhgx1f9n96HH3fTi6XYJSWvUkkcskmwALgPOA7YA25JsmTfsqqr6hqp6CvA64LebZyppLFlDpMmSqlp8QHIm8JqqOqdbvxigql57iPHbgB+qqvMGH+/1eg9uaM+epTp/SStlevqLe81TU1NZ6e2tlxry0t1TI8d406m9BplIR95idWSYqZCNwL6B9TngjPmDklwIvAo4BnjWchKVtC5ZQ6QJMkxjsdAezcMOc1TVZcBlSV4A/ALww4cKODMzM3SC883Ozo4cY7XiGtOYLbWK2+ut+l7zmqohsMyf5SLnTgzrcPMel/fnJMdcqbhrPeZidWSYq0LmgM0D65uA/YuMvxr47qEykzQJrCHSBBmmsbgBmE5ySpJjgPOBHYMDkgye6vwcwJMoJB1kDZEmyJJTIVV1IMl24Dr6l4q9uap2JbkUmK2qHcD2JM8G7gfuZpFDmJImizVEmixD3ceiqnYCO+c9dsnA8isa5yVpHbGGSJPDO29KkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1MxQjUWSc5PcmmRvkosWeP5VSW5J8uEkf5vkCe1TlTSurCHS5FiysUiyAbgMOA/YAmxLsmXesJuAmar6RuBa4HWtE5U0nqwh0mQZ5ojF6cDeqrqtqu4DrgaeNzigqv6uqv6nW/0AsKltmpLGmDVEmiCpqsUHJM8Hzq2ql3TrLwbOqKrthxj/BuDOqvqVwcd7vd6DG9qzZ8+oeUtapunp6QeXp6amstLbWy815KW7p0aO8aZTew0ykY68xerIUUO8fqHCs2A3kuRFwAzwrYeRn6T1zRoiTZBhGos5YPPA+iZg//xBSZ4N/DzwrVX1+cUCzszMHE6ODzE7OztyjNWKa0xjttQqbq+36nvNa6qGwDJ/lrtHP0pyuHmPy/tzkmOuVNy1HnOxOjLMORY3ANNJTklyDHA+sGNwQJLTgD8CtlbVXSPkKmn9sYZIE2TJxqKqDgDbgeuA3cA1VbUryaVJtnbDfhM4DvizJB9MsuMQ4SRNGGuINFmGmQqhqnYCO+c9dsnA8rMb5yVpHbGGSJNjqMZiPTjtT5aaH+3O+F5kHvWmF08/ZH0lYkqSNM68pbckSWrGxkKSJDUzMVMh0lrn1Jqk9cDGQtK6Y5MmHTlOhUiSpGZsLCRJUjM2FpIkqRkbC0mS1Iwnb0qStMrW8wnGHrGQJEnN2FhIkqRmbCwkSVIzQzUWSc5NcmuSvUkuWuD5s5LcmORAkue3T1PSOLOGSJNjycYiyQbgMuA8YAuwLcmWecM+BlwAXNU6QUnjzRoiTZZhrgo5HdhbVbcBJLkaeB5wy8EBVXVH99wDK5CjpPFmDZEmyDCNxUZg38D6HHDGKBudnZ0d5eXLjDG1AttciZgr+zpjruWYq/N+mp5e9UvUjkANGZ+/95fuXizu0pccvunUXrNcRjXJMQ8/7nj//7FYHRmmscgCj9Wys5E0aawh0ipYvEkdznIb1UHDNBZzwOaB9U3A/lE2OjMzs+zXHuy0DjvGIh3/sB62zZWIuYRlf//GXPsxV+n91OuNXjgO0+rXkHH6ex8xrjXkyMZcdtxxeo8uYLE6MkxjcQMwneQU4OPA+cALhtryMi1+R7KlDw3C2r0jmTSBVr2GSDpylrwqpKoOANuB64DdwDVVtSvJpUm2AiR5WpI54PuBP0qyayWTljQ+rCHSZBnqs0Kqaiewc95jlwws30D/8KYkPYw1RJocfgjZGrOeP5hmPXG6TpIW5i29JUlSMzYWkiSpGadCJsBKTa+MOh2wEjEXiuu0hSStHo9YSJKkZmwsJElSMzYWkiSpGc+xkKR1xvOKdCTZWEiSljQuJ1avfszh4k5So+ZUiCRJasbGQpIkNWNjIUmSmrGxkCRJzQzVWCQ5N8mtSfYmuWiB578kyZ92z1+f5OTWiUoaX9YQaXIs2Vgk2QBcBpwHbAG2Jdkyb9iPAndX1dcArwd+o3WiksaTNUSaLKmqxQckZwKvqapzuvWLAarqtQNjruvG/EuSo4A7gcfVQPBer7f4hiStuqmpqaz0Nqwh0vo2v44MMxWyEdg3sD7XPbbgmKo6APSAE5efpqR1xBoiTZBhGouF9mjm7zkMM0bSZLKGSBNkmDtvzgGbB9Y3AfsPMWauO4w5BXxmcMBqHHKVtCZZQ6QJMswRixuA6SSnJDkGOB/YMW/MDuCHu+XnA++rpU7ekDQprCHSBFmysejmO7cD1wG7gWuqaleSS5Ns7YZdAZyYZC/wKuBhl5O1stRla8uI9+YkdyW5uUV+XczNSf4uye4ku5K8okHMRyb51yQf6mL+cotcu9gbktyU5F0NY96R5N+TfDDJbKOYJyS5NslHup/tmSPGe1KX38GvzyZ5ZYM8f7L7Hd2c5O1JHtkg5iu6eLta5Lia1nsN6WJaRxrXEWvIGNeQqhqbL2AD8J/AE4FjgA8BW0aMeRbwVODmhnk+Hnhqt3w88B8N8gxwXLd8NHA98PRG+b4KuAp4V8OfwR3AYxv//t8KvKRbPgY4ofF7607gCSPG2QjcDhzbrV8DXDBizCcDNwOPoj99+V5guuXPdlK+VqKGdHGtI43riDVkfGvIuN1583Rgb1XdVlX3AVcDzxslYFX9A/PmckdVVZ+oqhu75f+mv5c2/yz4w41ZVfW5bvXo7mvkQ8VJNgHPAS4fNdZKSvIY+sX7CoCquq+q7mm4ibOB/6yqjzaIdRRwbHeuwKN4+PkEh+tU4ANV9T/V3/v/e+B7Row5qZrXELCOjEMdsYasXg0Zt8ZimMvW1pTuDoKn0d8zGDXWhiQfBO4C3lNVI8cEfgf4WeCBBrEGFfDuJP+W5GUN4j0R+BTwlu5w6+VJHt0g7kHnA28fNUhVfRz4LeBjwCeAXlW9e8SwNwNnJTkxyaOA7+ShJ0NqeGNXQ2Bi64g1ZExryLg1FmN1SVqS44B3AK+sqs+OGq+qvlBVT6F/Vv3pSZ48Yn7fBdxVVf82am4LeEZVPZX+3RYvTHLWiPGOon+o+Q+r6jTgXhrNw3cnFG4F/qxBrC+lvwd8CnAS8OgkLxolZlXtpn8nyvcAf0P/8P2BEVOdVGNVQ2Ci64g1ZExryLg1FsNctrYmJDmafjG4sqr+vGXs7vDd+4FzRwz1DGBrkjvoHxJ+VpK3jRgTgKra3/17F/AX9A9Bj2IOmBvYu7qWfpFo4Tzgxqr6ZINYzwZur6pPVdX9wJ8D3zxq0Kq6oqqeWlVn0T/kvmfUmBNqbGoITHYdsYaMbw0Zt8ZimMvWjrgkoT+Pt7uqfrtRzMclOaFbPpb+m+8jo8SsqouralNVnUz/Z/m+qhqpM+7ye3SS4w8uA99B/1DcKLneCexL8qTuobOBW0ZK9Iu20eAQZudjwNOTPKp7H5xNf258JEm+vPv3q4DvpV2+k2YsaghMdh2xhox3DRnmBllrRlUdSHLwsrUNwJuratcoMZO8HXgm8Ngkc8AvVdUVI6b6DODFwL93c5kAr66qnSPEfDzw1vQ/0OkR9C/Za3Z5aGNfAfxF/2+Co4CrqupvGsT9CeDK7j+E24AfGTVgN9/47cCPjRoLoKquT3ItcCP9Q403AW9sEPodSU4E7gcurKq7G8ScOCtRQ8A6sgKsIWNcQ5b8EDJJkqRhjdtUiCRJWsNsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzfw/N23O80hD6CAAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db58b2b6d8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "likelihood = lh_hallway(hallway, z=1, z_prob=.75)\n",
    "posterior = update(likelihood, prior)\n",
    "book_plots.plot_prior_vs_posterior(prior, posterior, ylim=(0,.5))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notice the tall bar at position 1. This corresponds with the (correct) case of starting at position 0, sensing a door, shifting 1 to the right, and sensing another door. No other positions make this set of observations as likely. Now we will add an update and then sense the wall."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEwhJREFUeJzt3X+U5XVdx/Hny4VNFBwKrWR3E6zJ2KwjNoLkiUwsIHPthyWrknRS6xw3NfsFVmScyjJPdkrqpKJ5FCTCH622J9TUOv0QmQCVZSU2QHdaEVO4JpWw8u6P+128DLMzd/d+Znbu3OfjnDn7/d77ue/ve+bOvPf9/X6+3+9NVSFJktTCQw53ApIkae2wsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhYaS5PuS3HS485A0WZK8MsmbDnceGl68j4UkaTkk+Utgrqp+43DnopXjEQstKckRI75+XatcJE2OUWrPqHVLh87GYoIluS3JBUluTHJnkrckeWiSpyaZS/JrSW4H3rL/sYHXnpTkI0nuSrIzyZaB5/4yyZ8n2ZHkbuAHDsf3J+ngHKgmdM+9KMnuJF9Msj3J8d3jSfK6JHck6SX5RJLHJ3kx8DzgV5N8Ocl7u/HHJ3lnks8nuTXJSwe2/6okVyZ5e5IvAed1j719YMyWrubc1dWgk+bl/2tJPgHcbXNxeNhY6HnAmcC3At8O7D9k+c3ANwCPAV48+IIkRwLvBd4PfCPwC8ClSR43MOy5wO8CxwD/tIz5S2rrQTUhydOAVwM/BTwa+DRweTf+h4DTu7HHAs8BvlBVbwAuBV5TVUdX1TOTPIR+7fg4sAE4A3h5kjMHtv8s4Mou1qWDiSX5duAdwMuBRwE7gPcmWT8wbCvwDODYqto3+o9DB8vGQq+vqj1V9UX6jcDW7vH7gN+qqq9U1f/Oe82TgaOB36+qe6rqQ8D7Bl4L8DdV9c9VdV9V/d9yfxOSmlmoJjwPeHNVXVtVXwEuAE5LcgJwL/0diO+gf97erqr67AFiPwl4VFVd1NWOW4A3AucMjPnXqnpPVzvm157nAH9bVR+oqnuB1wJHAd87MOZPuvznv1YrxMZCewaWPw0c3y1/fpGG4HhgT1XdN++1Gw4QV9L4WKgmHN8tA1BVXwa+AGzodixeD1wMfC7JG5I84gCxHwMc301j3JXkLuCVwDcdYPvzzc/jvm68tWcVsbHQpoHlbwH2dsuLXS60F9jUHdYcfO1/Dqx7uZE0nhaqCXvpNwUAJHk4cBzd33xV/UlVfQ/wnfSnRH6lGzq/DuwBbq2qYwe+jqmqHx4Ys1TtGcwjXb7WnlXExkIvSbIxyTfQ33P4qyFeczVwN/2Tso5M8lTgmXxtzlXS+FqoJlwG/EySJyT5OuD3gKur6rYkT0pyanfu1d3A/wFf7WJ9DnjsQOyPAV/qTrA8Ksm67kTPJw2Z2xXAM5Kc0W3vl4CvAP8y6jetdmwsdBn9kzBv6b5+Z6kXVNU9wBbgbOC/gD8DfrqqPrWMeUpaGQ+qCVX198BvAu8EPkv/xM7950U8gv55EnfSn6b4Av1zHwAuATZ30x7vqaqv0t8JeQJwK/368SZgapjEquom4PnAn3avfSbwzK4maZXwBlkTLMltwAur6oOHOxdJh581QS14xEKSJDUzVGOR5KwkN3U3Rzl/gefP6252cn339cL2qUoaV9YQaXIsORXS3Y7534EfBOaAa4CtVXXjwJjzgJmq2rZ8qUoaR9YQabIMc8TiFGB3Vd3SnSBzOf07o0nSMKwh0gQZ5j7qG3jgDUfmgFMXGPcTSU6nv2fyi1X1gJuU9Ho9zxKVVpmpqamswGasIdIaNr+ODHPEYqHCM/8P/L3ACVX13cAHgbceWnqS1iBriDRBhmks5njgndg28rW7MwJQVV/o7h8P/euZv6dNepLWAGuINEGGmQq5BphOciL926aeQ/+TK++X5NEDHzqzBdi1WMCpqaHuhbKg2dlZAGZmZg45xkrFNaYxW2oVt9frtUjnYKyqGgLj874bc/XHXK64qz3mYnVkycaiqvYl2QZcBayj/wl3O5NcBMxW1XbgpUm2APuALwLnjZy1pDXBGiJNlmGOWFBVO+h/7v3gYxcOLF9A/2N0JelBrCHS5PDOm5IkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKaGaqxSHJWkpuS7E5y/iLjnp2kkrT9sHtJY80aIk2OJRuLJOuAi4Gzgc3A1iSbFxh3DPBS4OrWSUoaX9YQabKkqhYfkJwGvKqqzuzWLwCoqlfPG/fHwAeBXwZ+uapmB5/v9Xr3b+jmm29ukrykgzc9PX3/8tTUVJZ7e9YQae1ZrI4MMxWyAdgzsD7XPXa/JCcDm6rqfYeepqQ1yhoiTZAjhhiz0B7N/XsOSR4CvA44b9iNzswc+vTp7OzsyDFWKq4xjdlSq7i9Xq9FOgdjVdUQGJ/33ZirP+ZyxV3tMRerI8McsZgDNg2sbwT2DqwfAzwe+EiS24AnA9s9+UpSxxoiTZBhGotrgOkkJyZZD5wDbN//ZFX1quqRVXVCVZ0AfBTYMn9+VNLEsoZIE2TJxqKq9gHbgKuAXcAVVbUzyUVJtix3gpLGmzVEmizDnGNBVe0Adsx77MIDjH3q6GlJWkusIdLk8M6bkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKaGeqqEEnS8jj5bYt97slU/59dBx5z3bnTB3xOOhw8YiFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJamaoxiLJWUluSrI7yfkLPP/zST6Z5Pok/5Rkc/tUJY0ra4g0OZZsLJKsAy4GzgY2A1sX+KO/rKq+q6qeALwG+KPmmUoaS9YQabKkqhYfkJwGvKqqzuzWLwCoqlcfYPxW4Ker6uzBx3u93v0buvnmxe40J2k5TU9/7U6NU1NTWe7tWUMW96JdUyO9/o0n9RplIg1vsToyzC29NwB7BtbngFPnD0ryEuAVwHrgaYeSqKQ1yRoiTZBhGouF9mgedJijqi4GLk7yXOA3gBccKODMzMzQCc43Ozs7coyVimtMY7bUKm6vt+J7uKuqhsAqe98X+RyQYRzs9lbV974GYi5X3NUec7E6MszJm3PApoH1jcDeRcZfDvzoUJlJmgTWEGmCDNNYXANMJzkxyXrgHGD74IAkgx+v9wxg7UyAShqVNUSaIEtOhVTVviTbgKuAdcCbq2pnkouA2araDmxL8nTgXuBOFjmEKWmyWEOkyTLMORZU1Q5gx7zHLhxYflnjvMbCyW9baqeqO9t7kTnU686dPuBz0lphDZEmh3felCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKmZoRqLJGcluSnJ7iTnL/D8K5LcmOQTSf4+yWPapyppXFlDpMmxZGORZB1wMXA2sBnYmmTzvGHXATNV9d3AlcBrWicqaTxZQ6TJMswRi1OA3VV1S1XdA1wOPGtwQFV9uKr+p1v9KLCxbZqSxpg1RJogqarFByTPBs6qqhd26+cCp1bVtgOMfz1we1X9zuDjvV7v/g3dfPPNo+a9Krxo19TIMd54Uq9BJtLwpqen71+emprKcm/PGrK4UeuINUSHw2J15IghXr9Q4VmwG0nyfGAG+P6DyE/S2mYNkSbIMI3FHLBpYH0jsHf+oCRPB34d+P6q+spiAWdmZg4mxweYnZ0dOUazuLtG32s62O9jOb5/Y67+mC3j9norvoe7qmoIrLL3fcQ6Yg05vDGXK+5qj7lYHRnmHItrgOkkJyZZD5wDbB8ckORk4C+ALVV1xwi5Slp7rCHSBFmysaiqfcA24CpgF3BFVe1MclGSLd2wPwSOBv46yfVJth8gnKQJYw2RJsswUyFU1Q5gx7zHLhxYfnrjvCStIdYQaXJ4501JktSMjYUkSWpmqKmQteDkty115nV3LfkiZ2hfd+70AZ+TJEkesZAkSQ3ZWEiSpGYmZipEkibF4lO/S0/7glO/42i1TPl7xEKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkvN11lVsvlQlp5vveS1oKhjlgkOSvJTUl2Jzl/gedPT3Jtkn1Jnt0+TUnjzBoiTY4lG4sk64CLgbOBzcDWJJvnDfsMcB5wWesEJY03a4g0WYaZCjkF2F1VtwAkuRx4FnDj/gFVdVv33H0tkvKucdKasuI1RNLhM0xjsQHYM7A+B5w6ykZnZ2eXGDE1SvgDbGOSYy7v64zZKubKvPfT0yvedB+GGrKycUaLOdr7vvD2Dk8dWR0/z8MTc7niHlzMlXvfF6sjw5xjkQUeq6G2LEnWEGmiDHPEYg7YNLC+Edg7ykZnZmYWH7DENMchbWOSYy5hf4d6sK8zZuOYK/Te93q9kbdzkFa+hixhLb3vC25vhevIqvp5rnDM5Yp7SDFX8H1frI4Mc8TiGmA6yYlJ1gPnANuH2rIkWUOkibJkY1FV+4BtwFXALuCKqtqZ5KIkWwCSPCnJHPCTwF8k2bmcSUsaH9YQabIMdYOsqtoB7Jj32IUDy9fQP7wpSQ9iDZEmh7f0liRJzXhLb0kagrdcl4ZjYyFJWpI3LtSwnAqRJEnN2FhIkqRmnAqZAM4NS5JWio2FdAicb17dbKbHw3L8Ha18zOHiTtLvk1MhkiSpGY9Y6JCNumewUAc/LnswkqSFecRCkiQ1Y2MhSZKasbGQJEnNeI6FJEkrbC1faTLUEYskZyW5KcnuJOcv8PzXJfmr7vmrk5zQOlFJ48saIk2OJRuLJOuAi4Gzgc3A1iSb5w37WeDOqvo24HXAH7ROVNJ4soZIkyVVtfiA5DTgVVV1Zrd+AUBVvXpgzFXdmH9NcgRwO/CoGgje6/UW35CkFTc1NZXl3oY1RFrb5teRYaZCNgB7BtbnuscWHFNV+4AecNyhpylpDbGGSBNkmMZioT2a+XsOw4yRNJmsIdIEGeaqkDlg08D6RmDvAcbMdYcxp4AvDg5YiUOuklYla4g0QYY5YnENMJ3kxCTrgXOA7fPGbAde0C0/G/hQLXXyhqRJYQ2RJsiSjUU337kNuArYBVxRVTuTXJRkSzfsEuC4JLuBVwAPupyslaUuWzuEeG9OckeSG1rk18XclOTDSXYl2ZnkZQ1iPjTJx5J8vIv52y1y7WKvS3Jdkvc1jHlbkk8muT7JbKOYxya5Msmnup/taSPGe1yX3/6vLyV5eYM8f7F7j25I8o4kD20Q82VdvJ0tclxJa72GdDGtI43riDVkjGtIVY3NF7AO+A/gscB64OPA5hFjng48EbihYZ6PBp7YLR8D/HuDPAMc3S0fCVwNPLlRvq8ALgPe1/BncBvwyMbv/1uBF3bL64FjG/9u3Q48ZsQ4G4BbgaO69SuA80aM+XjgBuBh9KcvPwhMt/zZTsrXctSQLq51pHEdsYaMbw0Zt1t6nwLsrqpbquoe4HLgWaMErKp/ZN5c7qiq6rNVdW23/N/099LmnwV/sDGrqr7crR7ZfY18qDjJRuAZwJtGjbWckjyCfvG+BKCq7qmquxpu4gzgP6rq0w1iHQEc1Z0r8DAefD7BwToJ+GhV/U/19/7/AfixEWNOquY1BKwj41BHrCErV0PGrbEY5rK1VaW7g+DJ9PcMRo21Lsn1wB3AB6pq5JjAHwO/CtzXINagAt6f5N+SvLhBvMcCnwfe0h1ufVOShzeIu985wDtGDVJV/wm8FvgM8FmgV1XvHzHsDcDpSY5L8jDgh3ngyZAa3tjVEJjYOmINGdMaMm6NxVhdkpbkaOCdwMur6kujxquqr1bVE+ifVX9KksePmN+PAHdU1b+NmtsCnlJVT6R/t8WXJDl9xHhH0D/U/OdVdTJwN43m4bsTCrcAf90g1tfT3wM+ETgeeHiS548Ss6p20b8T5QeAv6N/+H7fiKlOqrGqITDRdcQaMqY1ZNwai2EuW1sVkhxJvxhcWlXvahm7O3z3EeCsEUM9BdiS5Db6h4SfluTtI8YEoKr2dv/eAbyb/iHoUcwBcwN7V1fSLxItnA1cW1WfaxDr6cCtVfX5qroXeBfwvaMGrapLquqJVXU6/UPuS32CkRY2NjUEJruOWEPGt4aMW2MxzGVrh12S0J/H21VVf9Qo5qOSHNstH0X/l+9To8SsqguqamNVnUD/Z/mhqhqpM+7ye3iSY/YvAz9E/1DcKLneDuxJ8rjuoTOAG0dK9Gu20uAQZuczwJOTPKz7PTiD/tz4SJJ8Y/fvtwA/Trt8J81Y1BCY7DpiDRnvGjJWH5teVfuS7L9sbR3w5qraOUrMJO8Ango8Mskc8FtVdcmIqT4FOBf4ZDeXCfDKqtoxQsxHA29N/wOdHkL/kr1ml4c29k3Au/t/ExwBXFZVf9cg7i8Al3b/IdwC/MyoAbv5xh8Efm7UWABVdXWSK4Fr6R9qvA54Q4PQ70xyHHAv8JKqurNBzImzHDUErCPLwBoyxjVkyQ8hkyRJGta4TYVIkqRVzMZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktTM/wMYlMeMp+w8SQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db58ad2240>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "prior = predict(posterior, 1, kernel)\n",
    "likelihood = lh_hallway(hallway, z=0, z_prob=.75)\n",
    "posterior = update(likelihood, prior)\n",
    "book_plots.plot_prior_vs_posterior(prior, posterior, ylim=(0,.5))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is exciting! We have a very prominent bar at position 2 with a value of around 35%. It is over twice the value of any other bar in the plot, and is about 4% larger than our last plot, where the tallest bar was around 31%. Let's see one more cycle."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACYCAYAAAC4YqBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAEyVJREFUeJzt3X+w5XV93/Hny4WNKHhJ0KSyuxFsbywbmxFzBYlTYkUDxLL2h9OwURMyVdsZN2qsTcCmxDBpbW0mZlJJJioYJ4KEYExXuxPUGNtJG8neACrLStgAujcrYhWOlTTCyrt/nO+uh8vde8/u+dy759zzfMzc2e/3nM95f9/n/njv+/v5/jipKiRJklp40vFOQJIkrR82FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGx0FCS/MMkdx3vPCRNlyRvS/K+452HhhfvYyFJWg1JfgdYqKpfPN65aO04Y6EVJTlhxNdvaJWLpOkxSu0ZtW7p2NlYTLEk9yW5IsmdSR5M8v4kT07y4iQLSX4hyf3A+w89NvDas5J8OslDSfYk2Tbw3O8k+a0ku5I8DPyj4/H+JB2dI9WE7rnXJdmX5OtJdiY5vXs8Sd6V5IEkvSSfS/LcJK8HXgX8fJJvJvloN/70JB9O8tUk9yZ548D2357kpiQfTPIN4LLusQ8OjNnW1ZyHuhp01qL8fyHJ54CHbS6ODxsLvQq4EPi7wA8Ah6Ys/w7wPcCzgNcPviDJicBHgY8D3wv8LHBdkucMDPtJ4D8ApwB/uor5S2rrCTUhyUuAdwD/Angm8EXghm78jwHnd2NPBX4C+FpVvQe4DnhnVZ1cVZckeRL92vFZYBNwAfDmJBcObP8VwE1drOsGE0vyA8CHgDcDzwB2AR9NsnFg2Hbg5cCpVXVw9G+HjpaNhd5dVfur6uv0G4Ht3eOPAb9UVd+qqv+36DUvBE4G/lNVPVJVnwI+NvBagP9WVf+rqh6rqr9d7TchqZmlasKrgGur6taq+hZwBXBekjOAR+nvQPx9+uft7a2qLx8h9guAZ1TVVV3tuAd4L3DpwJg/q6o/7GrH4trzE8B/r6pPVNWjwK8CJwE/MjDmN7r8F79Wa8TGQvsHlr8InN4tf3WZhuB0YH9VPbbotZuOEFfS5FiqJpzeLQNQVd8EvgZs6nYs3g1cDXwlyXuSPO0IsZ8FnN4dxngoyUPA24DvO8L2F1ucx2PdeGvPGLGx0JaB5e8HDnTLy10udADY0k1rDr72rwfWvdxImkxL1YQD9JsCAJI8FTiN7m++qn6jqn4Y+EH6h0T+bTd0cR3YD9xbVacOfJ1SVT8+MGal2jOYR7p8rT1jxMZCb0iyOcn30N9z+L0hXnML8DD9k7JOTPJi4BK+c8xV0uRaqiZcD/xMkucl+S7gPwK3VNV9SV6Q5Nzu3KuHgb8Fvt3F+grw7IHYfw58ozvB8qQkG7oTPV8wZG43Ai9PckG3vX8DfAv436O+abVjY6Hr6Z+EeU/39SsrvaCqHgG2ARcD/wf4TeCnquoLq5inpLXxhJpQVX8M/Hvgw8CX6Z/Yeei8iKfRP0/iQfqHKb5G/9wHgGuArd1hjz+sqm/T3wl5HnAv/frxPmBmmMSq6i7g1cB/7V57CXBJV5M0JrxB1hRLch/w2qr65PHORdLxZ01QC85YSJKkZoZqLJJclOSu7uYoly/x/GXdzU5u775e2z5VSZPKGiJNjxUPhXS3Y/5L4GXAArAb2F5Vdw6MuQyYq6odq5eqpElkDZGmyzAzFucA+6rqnu4EmRvo3xlNkoZhDZGmyDD3Ud/E4284sgCcu8S4f57kfPp7Jj9XVY+7SUmv1/MsUWnMzMzMZA02Yw2R1rHFdWSYGYulCs/iP/CPAmdU1Q8BnwQ+cGzpSVqHrCHSFBmmsVjg8Xdi28x37s4IQFV9rbt/PPSvZ/7hNulJWgesIdIUGeZQyG5gNsmZ9G+bein9T648LMkzBz50Zhuwd7mAMzND3QtlSfPz8wDMzc0dc4y1imtMY7bUKm6v12uRztEYqxoCk/NzN+b4x1ytuOMec7k6smJjUVUHk+wAbgY20P+Euz1JrgLmq2on8MYk24CDwNeBy0bOWtK6YA2RpsswMxZU1S76n3s/+NiVA8tX0P8YXUl6AmuIND2886YkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZoZqLJJclOSuJPuSXL7MuFcmqSRtP+xe0kSzhkjTY8XGIskG4GrgYmArsD3J1iXGnQK8EbildZKSJpc1RJouqarlByTnAW+vqgu79SsAquodi8b9OvBJ4K3AW6tqfvD5Xq93eEN33313k+QlHb3Z2dnDyzMzM1nt7VlDpPVnuToyzKGQTcD+gfWF7rHDkpwNbKmqjx17mpLWKWuINEVOGGLMUns0h/cckjwJeBdw2bAbnZs79sOn8/PzI8dYq7jGNGZLreL2er0W6RyNsaohMDk/d2OOf8zVijvuMZerI8PMWCwAWwbWNwMHBtZPAZ4LfDrJfcALgZ2efCWpYw2RpsgwjcVuYDbJmUk2ApcCOw89WVW9qnp6VZ1RVWcAnwG2LT4+KmlqWUOkKbJiY1FVB4EdwM3AXuDGqtqT5Kok21Y7QUmTzRoiTZdhzrGgqnYBuxY9duURxr549LQkrSfWEGl6eOdNSZLUjI2FJElqxsZCkiQ1M9Q5FpKkyXH27y53Z9KZ/j97l7976W2vmV32eelInLGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc0M1VgkuSjJXUn2Jbl8ief/dZLPJ7k9yZ8m2do+VUmTyhoiTY8VG4skG4CrgYuBrcD2Jf7or6+qf1BVzwPeCfxa80wlTSRriDRdUlXLD0jOA95eVRd261cAVNU7jjB+O/BTVXXx4OO9Xu/whu6+e/l71E+z1+2dGTnGe8/qNchE69Xs7Hc+A2JmZiarvT1ryNqzjmi1LVdHhvkQsk3A/oH1BeDcxYOSvAF4C7AReMmxJCppXbKGSFNkmMZiqT2aJ0xzVNXVwNVJfhL4ReCnjxRwbm5u6AQXm5+fHznGWsU9ppgrfOLgMI72PYzNezfmmsTt9dZ8T3SsaghMzs/9mGOucR0Zq/e+xjFXK+64x1yujgxz8uYCsGVgfTNwYJnxNwD/ZKjMJE0Da4g0RYZpLHYDs0nOTLIRuBTYOTggyezA6ssBD4BKOsQaIk2RFQ+FVNXBJDuAm4ENwLVVtSfJVcB8Ve0EdiR5KfAo8CDLTGFKmi7WEGm6DHOOBVW1C9i16LErB5bf1DgvSeuINUSaHt55U5IkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmhmosklyU5K4k+5JcvsTzb0lyZ5LPJfnjJM9qn6qkSWUNkabHio1Fkg3A1cDFwFZge5Kti4bdBsxV1Q8BNwHvbJ2opMlkDZGmyzAzFucA+6rqnqp6BLgBeMXggKr6k6r6m271M8DmtmlKmmDWEGmKpKqWH5C8Erioql7brb8GOLeqdhxh/LuB+6vqVwYf7/V6hzd09913j5r3uvW6vTMjx3jvWb0GmWi9mp2dPbw8MzOT1d6eNWTtWUe02parIycM8fqlCs+S3UiSVwNzwI8eRX6S1jdriDRFhmksFoAtA+ubgQOLByV5KfDvgB+tqm8tF3Bubu5ocnyc+fn5kWOsVdxjirl39D2xo30PY/PejbkmcXu9Nd8THasaApPzcz/mmKtQR87+3dFj3vaa2ZUHdcbq+3kc4o57zOXqyDDnWOwGZpOcmWQjcCmwc3BAkrOB3wa2VdUDI+Qqaf2xhkhTZMXGoqoOAjuAm4G9wI1VtSfJVUm2dcP+C3Ay8PtJbk+y8wjhJE0Za4g0XYY5FEJV7QJ2LXrsyoHllzbOS9I6Yg2Rpod33pQkSc3YWEiSpGZsLCRJUjNDnWOhybbyZWLdzXSWuUTtaC4TkyRNL2csJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKaGcvLTZe/PHLlSyPByyMlSToenLGQJEnN2FhIkqRmhmosklyU5K4k+5JcvsTz5ye5NcnBJK9sn6akSWYNkabHiudYJNkAXA28DFgAdifZWVV3Dgz7EnAZ8NbVSFLS5LKGLG/Uc8o8n0zjZpiTN88B9lXVPQBJbgBeARwuClV1X/fcY6uQo6TJZg2RpsgwjcUmYP/A+gJw7igbnZ+fX2HEzCjhh9xG29e1i7ka732av5/rK2aLuLOza76HexxqyNrGGS3maH+fS29v/dSR8fgZHb+44xpzuToyTGORJR6rY85mHXnd3tH/0N57Vq9BJtJYs4ZIU2SYxmIB2DKwvhk4MMpG5+bmlh+wwj0qmmxjkUMd3FG9bjXynJSYKzim76cx1yRur7fmzeza15AVjNXPfcS/zyW3tw7qyFj9jI5D3HGPuVwdGeaqkN3AbJIzk2wELgV2jpyVpGlhDZGmyIozFlV1MMkO4GZgA3BtVe1JchUwX1U7k7wA+Ajw3cAlSX65qn5wVTOXNBGsIToS77K8Pg11S++q2gXsWvTYlQPLu+lPb0rSE1hDpOnhnTclSVIzY/khZJoM3thHkrSYMxaSJKkZZywkSeuGJ4Qef1PTWCz/ywZO3UuSluL/H0dnahoLTQb3NtSC/xFIx4+NhdY9mxVJWjs2FtIxsFmRNG7GZabOxkIaE+NSFCRpFF5uKkmSmrGxkCRJzXgoRJKG4KEqaTg2FpIkrbH13KgOdSgkyUVJ7kqyL8nlSzz/XUl+r3v+liRntE5U0uSyhkjTY8XGIskG4GrgYmArsD3J1kXD/iXwYFX9PeBdwH9unaikyWQNkaZLqmr5Acl5wNur6sJu/QqAqnrHwJibuzF/luQE4H7gGTUQvNfrLb8hSWtuZmYmq70Na4i0vi2uI8McCtkE7B9YX+geW3JMVR0EesBpx56mpHXEGiJNkWEai6X2aBbvOQwzRtJ0soZIU2SYq0IWgC0D65uBA0cYs9BNY84AXx8csBZTrpLGkjVEmiLDzFjsBmaTnJlkI3ApsHPRmJ3AT3fLrwQ+VSudvCFpWlhDpCmyYmPRHe/cAdwM7AVurKo9Sa5Ksq0bdg1wWpJ9wFuAJ1xO1spKl60dQ7xrkzyQ5I4W+XUxtyT5kyR7k+xJ8qYGMZ+c5M+TfLaL+cstcu1ib0hyW5KPNYx5X5LPJ7k9yXyjmKcmuSnJF7rv7XkjxntOl9+hr28keXODPH+u+xndkeRDSZ7cIOabunh7WuS4ltZ7DeliWkca1xFryATXkKqamC9gA/BXwLOBjcBnga0jxjwfeD5wR8M8nwk8v1s+BfjLBnkGOLlbPhG4BXhho3zfAlwPfKzh9+A+4OmNf/4fAF7bLW8ETm38u3U/8KwR42wC7gVO6tZvBC4bMeZzgTuAp9A/fPlJYLbl93ZavlajhnRxrSON64g1ZHJryKR9Vsg5wL6quqeqHgFuAF4xSsCq+p8sOpY7qqr6clXd2i3/X/p7aYvPgj/amFVV3+xWT+y+Rp4qTrIZeDnwvlFjraYkT6NfvK8BqKpHquqhhpu4APirqvpig1gnACd15wo8hSeeT3C0zgI+U1V/U/29//8B/NMRY06r5jUErCOTUEesIWtXQyatsRjmsrWx0t1B8Gz6ewajxtqQ5HbgAeATVTVyTODXgZ8HHmsQa1ABH0/yF0le3yDes4GvAu/vplvfl+SpDeIecinwoVGDVNVfA78KfAn4MtCrqo+PGPYO4PwkpyV5CvDjPP5kSA1v4moITG0dsYZMaA2ZtMZioi5JS3Iy8GHgzVX1jVHjVdW3q+p59M+qPyfJc0fM7x8DD1TVX4ya2xJeVFXPp3+3xTckOX/EeCfQn2r+rao6G3iYRsfhuxMKtwG/3yDWd9PfAz4TOB14apJXjxKzqvbSvxPlJ4A/oj99f3DEVKfVRNUQmOo6Yg2Z0BoyaY3FMJetjYUkJ9IvBtdV1R+0jN1N330auGjEUC8CtiW5j/6U8EuSfHDEmABU1YHu3weAj9Cfgh7FArAwsHd1E/0i0cLFwK1V9ZUGsV4K3FtVX62qR4E/AH5k1KBVdU1VPb+qzqc/5b7SJxhpaRNTQ2C664g1ZHJryKQ1FsNctnbcJQn943h7q+rXGsV8RpJTu+WT6P/yfWGUmFV1RVVtrqoz6H8vP1VVI3XGXX5PTXLKoWXgx+hPxY2S6/3A/iTP6R66ALhzpES/YzsNpjA7XwJemOQp3e/BBfSPjY8kyfd2/34/8M9ol++0mYgaAtNdR6whk11DJupj06vqYJJDl61tAK6tqj2jxEzyIeDFwNOTLAC/VFXXjJjqi4DXAJ/vjmUCvK2qdo0Q85nAB9L/QKcn0b9kr9nloY19H/CR/t8EJwDXV9UfNYj7s8B13X8I9wA/M2rA7njjy4B/NWosgKq6JclNwK30pxpvA97TIPSHk5wGPAq8oaoebBBz6qxGDQHryCqwhkxwDVnxQ8gkSZKGNWmHQiRJ0hizsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNfP/AfL11In8OOB6AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db57752b00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "prior = predict(posterior, 1, kernel)\n",
    "likelihood = lh_hallway(hallway, z=0, z_prob=.75)\n",
    "posterior = update(likelihood, prior)\n",
    "book_plots.plot_prior_vs_posterior(prior, posterior, ylim=(0,.5))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I ignored an important issue. Earlier I assumed that we had a motion sensor for the predict step; then, when talking about the dog and the microwave I assumed that you had no knowledge that he suddenly began running. I mentioned that your belief that the dog is running would increase over time, but I did not provide any code for this. In short, how do we detect and/or estimate changes in the process model if aren't directly measuring it?\n",
    "\n",
    "For now I want to ignore this problem. In later chapters we will learn the mathematics behind this estimation; for now it is a large enough task just to learn this algorithm. It is profoundly important to solve this problem, but we haven't yet built enough of the mathematical apparatus that is required, and so for the remainder of the chapter we will ignore the problem by assuming we have a sensor that senses movement."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Discrete Bayes Algorithm\n",
    "\n",
    "This chart illustrates the algorithm:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZsAAAEvCAYAAACTw2ybAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3XlUU2f+P/B3EpKwQyDsIKsbiruC1boruNtTrb9pOxWr047aVme0tevUjt86Z3o6fmut3/k6Y9txKm1tO1O3Km51YVxwREURFNkXWQMBQtiSPL8/+HJHIIGAJDfL53VOjubem5tPkg/55D73eZ4rYIwxEEIIISYk5DsAQgghto+KDSGEEJOjYkMIIcTkqNgQQggxOSo2hBBCTM4kxSYxMRGLFi3qcZuCggIIBAJcv37d6P1u27YNI0eOfNzwCCGEmJmDMRslJiaiuroax44dM2qnu3btwqM9qmfMmIGRI0fis88+45aFhISgrKwMcrm8jyETQgixNkYVm77y8PDodRuRSAR/f39TPD0hhBAL0+dmtI4msl27diEoKAgymQyrV6+GWq3utk3H/y9cuIA9e/ZAIBBAIBCgoKCgWzOaVqvFmjVrEB4eDicnJwwePBgfffQRdDrdAL1UQgghfOnXkU1KSgoCAgJw5swZFBcX45lnnsGQIUPw1ltvddt2165dyM7OxrBhw7Bjxw4AgI+PD4qLizttp9PpEBQUhO+++w4+Pj64du0aXnrpJXh7e2PNmjX9CZMQQoiF6FexcXd3x5///Gc4ODhg+PDhWLFiBc6ePau32Hh4eEAikcDZ2bnHZjOxWIzf//733P2wsDDcuHED33zzDRUbQgixcv0qNtHR0XBw+M9DAwMDkZqa+tjB/O///i/27duHwsJCNDU1oa2tDaGhoY+9X0IIIfzqV9dnsVjc6b5AIHjscysHDx7Epk2bkJiYiJMnT+LWrVtYv349WltbH2u/hBBC+GeS3mhdSSQSaLXaHrf517/+hdjYWLzyyivcstzcXFOHRgghxAzMMoNAWFgYrl27hoKCAlRXV+s9ChoyZAhu3LiBEydO4MGDB9i+fTsuXLhgjvAIIYSYmFmKzZYtWyCRSBAdHQ0fHx8UFRV12+bll1/GM888g2effRYTJ05EQUEBNm/ebI7wCCGEmJiALp5GCCHE1GgiTkIIISZHxYYQQojJUbEhhBBiclRsCCGEmBwVG0IIISZHxYYQQojJWUWxWbRoERITE7n7xlwJ1JhtzKG2thZ+fn4DOhvC8uXLsXPnzgHbHyGEmJrR42wqKiqwY8cOHDt2DCUlJZDL5Rg1ahReffVVLFiwwKRBLlq0CHK5HH/7298AAHV1dWCMwdPTU+9VQLtuw6fXX38d1dXV+PLLLwdsn3fu3MH06dORn59v1IXqCCGEb0bNjVZQUIApU6bAzc0Nf/jDHzB69GjodDqcPXsWv/71r/XOCGBKxnzBWsKXsFqtxr59+3D06NEB3W9MTAwiIiJw4MABbNiwYUD3TQghpmBUM9r69evBGMP169fxzDPPYOjQoRg+fDheeeUVpKenAwBaWlqwadMm+Pn5wdHREXFxcfjXv/7VaT8zZszA+vXr8fbbb0Mul8PX1xdbtmzpNFeaWq1GYmIiXF1d4efnx11w7VEdTWSGrgL66DYdeovPmNguXryIuLg4uLq6wsPDA7GxscjIyDD4vh0/fhxCoRBTpkzhlh05coSL9cyZMwCACxcuQCgUQiAQ4IcffjDmI8GSJUvwzTffGLUtIYTwrddiU1NTg+TkZLzyyitwdXXttl4mkwEA3njjDRw8eBBffPEFbt68iZiYGCQkJKCsrKzT9klJSXBwcMDly5fx2Wef4ZNPPsHBgwe59Vu2bMHp06fxj3/8A2fPnsXNmzdx8eJFvbHt2rULkydPxurVq1FWVoaysjKEhITo3daY+HqKTaPRYOnSpZg6dSrS09ORmpqKjRs3QiQSGXzvUlJSMH78eAgEAm7ZkiVL8PLLLwMAfvWrX6G8vBwvvvgiGGNITEzE8uXLDe7vUZMmTcK1a9fQ1NRk1PaEEMIr1ovU1FQGgP3zn/80uI1KpWJisZjt37+fW6bRaFhERAR75513uGXTp09ncXFxnR47Z84ctmbNGsYYYw0NDUwikbADBw5w6xsaGpiHhwdbtWoVt2zVqlVs4cKF3D43bNjQLaZHtzEmvt5iUygUDAA7f/68wfehq6VLl7IXXnih2/LGxkY2dOhQBoD5+fkxACwyMpI1NDRw26SkpLARI0YwiUTCYmNjWWZmZqd9pKenMwAsJyfH6HgIIYQvvR7ZMCP6D+Tm5qKtra1Tc5FIJMLkyZORmZnZadtRo0Z1uh8YGIjKykpuP62trZg8eTK33tXVFTExMb3GMBDx9RSbl5cXEhMTER8fj4ULF2Lnzp0oLi7u8Xmbmprg6OjYbbmzszOSkpIgEolQUVEBoVCIpKQk7sixubkZy5cvh0ajwX//938jPz8fv/jFLzrtw8nJiXsOQgixdL0Wm8GDB0MgECArK8vgNh0F6dHmog5dl/V0lU9jClt/GBtfb1cg/fLLL5Gamopp06bhyJEjGDJkCE6ePGnweeVyOWpra/WuKykp4S4op9PpkJeXx607ceIEKioq8Nprr2H9+vVYtWoV0tPTcevWLW6bmpoaAICPj4/B5yeEEEvRa7Hx8vJCfHw8PvvsM6hUqm7rlUoloqKiIJFIOp1w12q1uHLlCqKjo40OJioqCmKxGFevXuWWNTY29ngS3pirgA5UfAAwevRobN26FefPn8eMGTOwf/9+g9uOHTu225EdAJSXl2Pt2rXcNkB7J4yOI6X8/HwAQHBwcKd/O5YDQEZGBgIDA+Hn59en+AkhhA9G9Ub7n//5HzDGMGHCBHz//fe4f/8+7t27hz//+c8YNWoUXFxcsG7dOrz55ps4fvw4srKysG7dOlRUVGD9+vVGB+Pq6oo1a9Zg69atOH36NO7evYsXX3yxx2JizFVAByK+/Px8vPnmm7h8+TIKCwtx7tw53L59u8diFR8fj6ysLCgUCm4ZYwyrV69GdXU1Jk6ciCtXriAuLg5KpRIvvPCC3vj1HfGlpKQgISHBqNgJIYRvRo2zCQ8Px40bN7Bjxw5s3boVpaWl8Pb2xujRo7F3714AwB//+EcAwOrVq6FUKjF27FgkJycjICCgTwF9/PHHaGxsxFNPPQVnZ2e8+uqraGxsNLj9li1bsGrVKkRHR6OpqQn5+fkICwvrtt3jxufs7Izs7GysWLEC1dXV8PPzw3PPPYetW7cafExMTAwmTZqEb7/9lhsPs3v3biQnJ0MqlWL//v3cv2PHjsX58+fxpz/9CVFRUQDam9oAoLS0FED75wC0n9P58ccfe2zCI4QQS0JX6jSx5ORkbNy4EZmZmT12k35Uc3MzQkNDIZPJ8Nprr+GDDz6Av78/N6Zpz549OHz4ME6dOmXK0AkhZMBYxdxo1iwhIQEbNmzgjlKM4ejoiO+++w4ikQibNm1CWFgYvv76a269WCzG7t27TREuIYSYBB3ZEEIIMTk6siGEEGJyVGwIIYSYHBUbQgghJkfFhhBCiMlRsemnsrKyTiP6CSGEGGbUoE7SWV5eHs6dOwcAWLBgQZ8HrhJCiL2hI5t+KCgogFarhVarxalTpwxOtkkIIaQdFZt+mD59OgIDAwG0XwH0xIkTPU6pQwgh9o6KTT+IRCLMnTuXu0qpSqVCcnIyWltbeY6MEEIsExWbfpJKpZg/fz5cXFwAAAqFAqdPn+71cgeEEGKPqNg8BldXV8yfPx8SiQRA++zMFy9eNNlF4AghxFpRsXlMXl5emDdvHoTC9rfywYMH+Pe//81zVIQQYlmo2AyAwMBAzJgxg7t/69YtvVfoJIQQe0XFZoBERUUhLi6Ou3/p0iUUFBTwFxAhhFgQKjYDKCYmBiNHjgTQfinns2fPoqKigueoCCGEf1RsBpBAIEBcXBx3+WatVovk5GQolUqeIyOEEH5RsRlgQqEQM2fOhL+/P4D/DPpUq9U8R0YIIfyhYmMCDg4OmDdvHjw9PQEADQ0NSE5ORltbG8+REUIIP6jYmIijoyPmz58PZ2dnAEB1dTXOnDkDnU7Hc2SEEGJ+VGxMyM3NDQkJCRCLxQCA4uJipKSk0KBPQojdoWJjYnK5HHPnzoVAIAAA3L9/H2lpaTxHRQgh5kXFxgyCg4Mxffp07v6NGzdw7949HiMihBDzomJjJkOGDMHEiRO5+ykpKSgqKuIxIkIIMR8qNmY0ZswYREdHA2gf9HnmzBlUVlbyHBUhhJgeFRszEggEeOKJJxAaGgoA0Gg0SE5ORn19Pc+REUKIaVGxMTOhUIjZs2fD19cXANDc3Izjx4+jqamJ58gIIbautrYWfn5+yM3NHZD9LV++HDt37jRqWyo2PHBwcEBCQgI8PDwAAPX19Th58iQ0Gg3PkREycBITEyEQCLB27dpu69544w0IBAIsWrSIh8hsy4wZM/DKK68Yte2OHTuwYMECREZGDshzv//++/iv//ov1NXV9botFRuedAz6dHJyAgBUVlbSoE9ic0JCQnDw4EE0NjZyyzQaDb766isMGjSIx8iMY0uXeler1di3bx/WrFkzYPuMiYlBREQEDhw40Ou2VGx45O7ujoSEBDg4OAAAioqKcOnSJRr0SWzGqFGjMHjwYHz33Xfcsp9++gmOjo6drgEFtHea+eijjxAZGQknJyfExMR0+hJLTk7Gk08+CZlMBi8vL8THxyMrK6vTPi5evIi4uDi4urrCw8MDsbGxyMjIAKD/CCAxMbHT0dWMGTOwbt06bNmyBT4+PpgyZYpRsXU8bvPmzfDy8oKPjw927dqFlpYWbNiwAZ6enhg0aBC++uqrPr3mjn2vX78eb7/9NuRyOXx9fbFlyxbodDokJibiwoUL2LNnDwQCAQQCgcFLmxw/fhxCoZB7TQBQUFDAPa7rbdu2bXr309WSJUvwzTff9LodFRue+fj4YM6cOdygz6ysLNy8eZPnqAgZOGvWrMEXX3zB3f/iiy+wevVqLuc7vPvuu/j888+xZ88eZGZm4q233sLLL7+Mn376CQDQ2NiITZs24dq1azh//jw8PDywePFi7uhDo9Fg6dKlmDp1KtLT05GamoqNGzdCJBL1Kd4DBw6AMYaUlBT8/e9/Nyo2AEhKSoKbmxtSU1Px5ptvYtOmTVi2bBmGDBmC69evY9WqVVi7di0ePnxo9Gt+dN8ODg64fPkyPvvsM3zyySc4ePAgdu3ahcmTJ2P16tUoKytDWVkZQkJC9L6ulJQUjB8/vtP7LpVKERsby906ZqwHwLW69GbSpEm4du1a7+edGbEI9+7dY3v37uVu9+/f5zskQh7LqlWr2MKFC1lNTQ1zdHRk2dnZrKysjEkkElZYWMitZ4wxlUrFHB0d2cWLFzvtY+PGjWz+/Pl6969SqZhQKGQpKSmMMcYUCgUDwM6fP693++nTp7MNGzbojfHRbWJiYro9T2+xTZ8+ncXFxXHrdDodk8vlbPHixdyy1tZWJhaL2ffff9+n19x134wxNmfOHLZmzRqDr0ufpUuXshdeeMHg+vLychYZGckAsLi4OKZWq1l+fj4DwFauXGnwcenp6QwAy8nJ6fH5HYwqXcTkhg4dCpVKxU1lc+HCBTg7OyM4OJjnyAh5PDKZDE899RS++OILeHp6YsaMGd3O12RmZqK5uRkJCQmdfnm3tbUhLCwMAJCbm4v33nsPqampqKqqgk6ng06n4wZHe3l5ITExEfHx8Zg9ezZmz56NFStWGPylb8j48eP7HBvQ3mTYQSAQwNfXFzExMdwysVgMmUzGja0zdr9d9w20X4q+r2P0mpqa4Ofnp3ddQ0MD5s+fj9zcXAwZMgTHjh0z+simY7vejmyo2FiQcePGobGxEffu3QNjDKdPn8bixYshl8v5Do2Qx/Liiy9i1apVcHV1xe9///tu6zs6xhw9erRbIeqYyHbx4sUICgrC3r17ERQUBAcHB0RHR3c6if/ll19i06ZNSE5OxpEjR/DOO+/g0KFDiI+Ph1Ao7HY+VN9lP1xcXPocW9f/A+0FR9+yjv0Zu19D++5rZyK5XI7a2tpuy1taWrB06VLcvHkT/v7+OHnyJLy9vbttp1arMWvWLGRlZeHs2bOYMGECAKCmpgZA+ymBnlCxsSACgQBTp06FWq1GUVER2tracOLECSxbtgxubm58h0dIv82ePRsSiQTV1dVYtmxZt/XR0dGQSqUoLCzErFmzuq1XKBTIysrCnj17MHPmTADtcwzqGy4wevRojB49Glu3bsX8+fOxf/9+xMfHw8fHB2VlZZ22TU9P73YU0dfY+mug9iuRSKDVanvdbuzYsfjb3/7WaZlOp8Pzzz+Pc+fOwc3NDcePH9f7fmi1WqxcuRJ37tzByZMnuUIDABkZGQgMDDR41NSBio2F6Rj0eezYMVRVVaGpqQnHjx/H0qVL4ejoyHd4hPSLQCDA7du3wRiDVCrttt7NzQ1btmzBli1bwBjDtGnToFKpcPXqVQiFQqxduxZyuRx//etfERISgtLSUrz++utcT04AyM/Px969e7FkyRIEBQUhLy8Pt2/fxrp16wAAs2bNwqZNm3DkyBEMHToUe/fuRXFxca/FprfYXnrppX69JwO137CwMFy7dg0FBQVwdXWFl5cXhMLufb/i4+OxdetWKBQK7sjl+++/xw8//ACgvTms470CgLVr12LOnDkAgEOHDkGj0eDYsWOYOnVqp/2mpKQgISGh1zipN5oFEovFSEhIgLu7OwCgrq6OBn0Sq+fm5sbltD7bt2/Htm3b8PHHH2PEiBGYO3cu/vGPfyA8PBxCoRAHDx7E7du3MXLkSGzYsAHbt2/vVLicnZ2RnZ2NFStWYMiQIVi1ahWee+45bN26FUB7U17HbcqUKXB1dcVTTz1lVOw9xfY4BmK/W7ZsgUQiQXR0NHx8fAxO8BsTE4NJkybh22+/5ZY9ep6lsrISqamp3K2kpIRb19FE9vXXX3dqimxubsaPP/6IX/3qV73GKWBdGzGJxairq8Phw4fR3NwMoP0XzJw5c/T+aiEDR6fToaWlpdMNaD/q7LiJRCLuX2dnZ0gkEp6jJqR3ycnJ2LhxIzIzM43qEl5QUIDw8HCsXLkSQ4YMwfbt2/H222/jww8/BADs2bMHhw8fxqlTp3rdFzWjWTAPDw8kJCTg6NGj0Gq1KCgowJUrV/DEE090G6NAjMcYQ2NjI2pra1FbWwulUona2lqo1Wq0tLT0a9S4WCyGq6srXF1d4eLiwv1fLpfD09OTfiAQi5CQkIANGzagpKSEmxDYWB988AHu3buHHTt2IDw8HGvXroVYLMbu3buNejwd2ViBwsJCnDp1ijt8jY2NxejRo3mOyno0NTXh4cOHePjwIaqrq6FUKvX2QjIVsVgMuVwOuVwOHx8f+Pj4wN3dnX4wELtCxcZKZGVlISUlhbs/a9YsREVF8RiR5WpubkZZWRlXYPR19+Sbk5MTQkJCMGjQIAQHB1MzHLF5VGysyL///W9uKhuhUIj58+cjKCiI56gsQ3NzM/Ly8pCbm9ute2t/icViSKVS7iR0xyDCR28ajeaxj5KEQiECAgIQGhqKQYMG9XgSnRBrRcXGijDGcOHCBWRnZwNo/zJcsmSJ3gFY9qC1tRUFBQXIzc1FSUlJnycwdXd3h6enJ2QyGWQyGdzc3ODo6MgVGGPn1GptbYVKpUJjYyMaGxuhUqmgUqmgVCqhUCiMGgPxKG9vbwwdOhSDBw/W202YEGtExcbK6HQ6JCcnc90SXVxcsHTpUri6uvIcmXkwxvDw4UNkZmaiqKjI6C9yNzc3BAYGIiAgAF5eXvD09Ow0RsNUtFotamtrUVVVxd1qamqMKowikQjh4eEYNmwYAgIC6BwPsWpUbKxQa2srjh07hurqagDtc08tWbLEpn8FazQa5OTkICMjg5seoyfOzs4IDAzkbpbUNNXW1obS0lIUFRWhqKgIarW618e4u7tj6NChGDp0KJydnc0Qpf0qKipCUFBQn2eLJj2jYmOl1Go1Dh8+jIaGBgBAQEAAFixYYHN/IGq1GpmZmdykhT1xcXFBZGQkoqKi4O3tbRVHAowxKBQKFBYWoqioCFVVVT1uLxKJMGzYMIwePdpujmbNhTGGtLQ03LhxA1FRUZg5c6ZV5JC1oGJjxZRKJQ4fPswNOoyIiMDs2bNt4g+kvr4eN27cQE5OTo8TDjo6OiIiIgKRkZHw9/e3+tdeX1+P+/fvIzs7u9PVLbsSCoUYPHgwxowZw11enPSfVqvFhQsXkJOTwy2bN29er1PZEONRsbFy5eXl+Omnn7hzFzExMZg8eTLPUfWfWq3GjRs3kJWV1eN5jZCQEIwYMQLBwcE2OWBSp9OhpKQE9+7dQ2FhocH3QiAQIDIyEmPGjIGXl5eZo7QNzc3NOHXqFMrLy7llEydOxJgxY6z+x4sloWJjA/Lz83H69Gnu/uTJkztdR8MatLS0ID09HXfu3DF40l8kEmHIkCGIiYmBp6enmSPkj1qtRnZ2NjIyMno8vxMVFYXY2NhuU+QTw+rq6pCcnIy6ujoA7Tk2Y8YMREZG8hyZ7aFiYyPu3r2LS5cucffnzJmDiIgIHiMyjkajwd27d3Hr1i2uObArFxcXjBgxAsOGDbPrma81Gg2ys7ORnp7OnavrysHBgZti3xy97axZeXk5Tp48yeWdVCpFfHw8/P39eY7MNlGxsSGpqalIT08H0N6mv3DhQgQEBPAclWEFBQW4dOmSwXMTrq6uGD9+PAYPHmyTTWX9pdPpkJOTg1u3bkGpVOrdxsXFBbGxsYiMjKSmID1ycnJw/vx57nxgxzyEdP7LdKjY2BDGGM6dO8ed5JRIJFiyZAnXlq/T6SziS1ulUuHSpUsoLCzUu97R0RFjx47F8OHD6dd5DxhjyM/Px40bNwx2B/fz88PkyZPh6+vbablOpwNjzOZ6L/aGMYZbt27h3//+N7csICAAc+fOteujZnOgYmNjtFotkpOTUVpaCuA/gz4zMjIgk8kwdOhQ3mLT6XTIyMjA9evX9V6bRywWIyYmBqNGjaK5wvpAp9Ph3r17uH79usHu4dHR0Zg0aRL3vt64cQMSiQQjR440Z6i80ul0SElJwf3797llUVFRmD59ut0VXT5QsbFBra2tOHLkCPdrVywWo62tDZGRkZg9ezYvMVVWViIlJQUKhaLbOoFAgOjoaIwbNw5OTk48RGcbWlpacOPGDWRkZOjtvebi4oKpU6fCzc0N//znPyEWi/H//t//s+nBwB1aWlpw5swZ7kcYAIwfPx7jxo2jZkYzoWJjoxobG3Ho0KFO50McHR3xy1/+0qx/XBqNBteuXUNGRobe9d7e3pg+fTrkcrnZYrJ1SqUSV69eNXjFRqlUyp0UHzVqFOLi4swZntk1NDTgxIkT3PktoVCIadOmYciQITxHZl+oQdxGMcYgkUg6FZvm5mbU1NSYbeLOmpoanD17Vu8U/yKRCOPGjcPo0aMt4jySLfH09ERCQgJKSkrwr3/9C/X19Z3WP9rrLyMjAyNGjICbm5u5wzSLyspKnDx5krv8sVQqxdy5cxEYGMhzZPaHjmxsEGMMly5d0jsw0hwXXmOM4e7du0hNTdU7Zsbf3x/Tpk2zq7EyfNFoNEhLS8Pt27cNDgzls3nVlPLz8/Hzzz9zOejm5ob58+dT3vGEio0NU6lUuH//Pu7du8cd4QQHB2PBggUme86mpiacP38excXF3daJxWJMmjQJ0dHR1E5uZpWVlTh8+LDBgvP000/bzKUqGGO4c+cOrl69yi3z8/PDvHnz6Jwgj6gZzYZ1jFMZO3YsiouLkZWVhbKyMmg0GpN0KS4qKsKFCxe4JotHhYSE4Mknn6TJI3lSWlra4/Q/aWlpmDdvnhkjMg2dTscd1XeIiIjAjBkzqBs9z+jdtwNCoRChoaEIDQ2FSqWCVqsd0D88nU6Ha9eu4fbt293WSaVSTJkyhQYX8qimpgZpaWk9blNQUICqqir4+PiYKaqB19rairNnz3Y6qh4zZgwmTpxIuWcBqBnNhjHGoNVqO/2iFQgEEAqFA3ZSXq1W4+zZs3ovxRwUFISZM2fS9Vd41traCqVSiYaGBjQ0NEClUqGhoQG1tbVQqVTcdiEhIZg/f36f92+OPDP0vKmpqZg0aRLUajWSk5O57v4CgQBPPvkkhg0bZrLnJ31DRzZWrq2tDWq1Gmq1Gi0tLWhra+Nu+gZOdhAKhRCLxdxNIpHAyckJzs7OcHR0NOqXYEVFBU6fPq13cshx48Zh3Lhx1NPMAkgkEvj6+nabRQBo75lWU1MDhUIBhUIBlUqlt6mTzzwzpLy8HLdv34ZKpUJ5eTmXh2KxGHPnzkVwcHC/900GHhUbK6NWq1FfXw+VSgW1Wo22trZ+7Uen06GlpUXv5JdCoRBOTk5wcXGBm5sb3N3d9RaNysrKboXG0dERs2bNoj90KyGVShEQENBtDr2mpibU1dWhsbERjY2NJs0zZ2dnuLu7G8wzQ+7evQsAyMvL45a5uroiISGBLrdggagZzcIxxtDQ0AClUom6ujq0traaPQaBQAB3d3d4enrCw8MDYrGYi+3ChQvIzs4G0N7jZ/bs2dQJwAp15FldXR2USiWveebh4QFPT08uz/RRq9VISkrq1HTn6emJRYsWUbOthaIjGwvV0tKCqqoqVFdXG7y+i7kwxlBXV8dd88Pd3R0+Pj7w8PDA1KlTUVtbC39/f8TGxlKzmZWx1DwrKirqlGddm9v0jSHrOB9FxcYy0ZGNBen4Y6uqquo26tsSSSQSyOVyyGQymjHXilhrnsnlcojFYuh0Onz99dedmnBFIhH8/f0RERGB4cOH8xgtMYSKjQVgjEGpVKK0tNTgBcQsmUAggI+PDwICAmgsg4Wrra21+jxrampCSkoKfH19ERgYiMDAQPj6+tLMzRaOig3P6uvrUVpa2uPlfq2FUCiEv78//eFbIFvKs7a2NgQFBSEwMJDyzIpQseFJc3MzioqKDF7e15o5ODggMDAQcrmcBtPxjPKMWAoqNmbGGENhxRv+AAAgAElEQVRFRQUePnzY4/QhtsDNzQ2hoaF2cb0US0N5RiwNFRszam5uRkFBQadp/22dUChEcHCwVU+DYm3sOc/oKMdyUbExk8rKSpSUlNj8r0xD3NzcEB4e3uPYCfL4KM8ozywVFRsT0+l0KCoq0ns5ZHsjkUgQGRlJ4yBMgPLsPyjPLBMVGxNqa2tDbm6uXTVn9EYoFCIsLAwymYzvUGwG5Vl3lGeWh4qNiajVauTk5PR7TilbFxAQQJfmHQCUZz3rmPeNzuPwj4qNCTQ0NCAnJwc6nY7vUCyaXC7HoEGD6Iugn1QqFR48eEB51gvKM8tAxWaA1dfXIzc3l74AjOTt7Y3Q0FD6Iugj+kHTN15eXggLC6M84xHNmjiAGhoaqND0kUKhQFFRkd32nuoPlUpFhaaPampqUFhYSHnGIyo2A6SxsZG+APqpuroaJSUlfIdhFdRqNTWd9ZNCoeh0yWhiXlRsBkBraysd0TymyspKVFVV8R2GRWtra6MfNI+pqqoKlZWVfIdhl6jYPCadTofc3FzqDTQAiouLbXIOr4FAeTZwiouLreLSCraGis1jKiwstImZdC0BYwx5eXlWOf29qRUWFtI4mgFEeWZ+VGweQ0VFBWpqavgOw6ZoNBpqkuyC8mzgabVa5OTk8H51UntCxaaf1Go1SktL+Q7DJjU1NVGHgf/T1NREeWYizc3N9N6aERWbfmCMoaCggLpRmlBVVZXdn7+hPDM9yjPzoWLTD2VlZWhqauI7DJtXWFho181p5eXldD7QDAoKCqg5zQyo2PSRWq1GeXk532HYhZaWFrttTmtqakJZWRnfYdiF1tZWak4zAyo2fUSj3c2rqqrKLn/dU56ZV1VVFfX2MzEqNn2gVCopIXlgb786lUolVCoV32HYHXvLM3OjYmMkxhglI0/q6+vt5iQu5Rl/GhoaaLCnCVGxMZJCoUBzczPfYdgtezl3U1NTQ3nGo9LSUmq+NBEqNkbQ6XR0spZnarUatbW1fIdhUowxPHz4kO8w7JparYZSqeQ7DJtExcYItbW1aG1t5TsMu1dRUcF3CCZFeWYZbD3P+ELFxgg0G7FlaGxstOmeaZRnlsHW84wvVGx6oVarqQeaBbHVL+SmpibqgWZBbDXP+ETFpheUdJalpqbGJkd7U55ZFlvNMz5RsemBVqul2XYtjE6ng0Kh4DuMAaXVam3uNVk7W8wzvlGx6UF9fb1dz81lqWyttxDlmWWy9d6P5kbFpge29qVmKxoaGqDRaPgOY8DU1dXxHQLRQ6VS2VSe8Y2KjQGMMfoSsGC2MtKb8syy0WczcKjYGKBSqegEoQWzlaPOxsZG+vVswajYDBwqNgbYcpI9fPgQEyZM4L7kXnvtNRw7doznqPqmvr7eJqYVsbU8O3r0KNasWcN3GAOmrq7OJvLMElCxMcASxtYsXrwYU6ZMwZNPPol58+bhgw8+MMlgs08//RSLFi0yKp7U1NQBf/7+0Gq1NjGHGN9jayZMmIDi4uJOy/bu3Yv33nvP5M9trud5HDqdji6UOECo2OjBGLOYEcQ7d+5ESkoKDhw4gLt37+Lzzz/vtJ4xZrc9mSzlM+ovS8ozYhh9RgPDge8ALFFzc7PFfYH7+vpiypQpyM3NxUsvvYTRo0cjLS0N9+/fx7fffguZTIadO3fi0qVLEAqFWLx4MV5++WWIRCJotVrs3r0bR48ehaurK5577rlO+37ppZewYMECLFu2DADw448/IikpCZWVlfDz88P27duRlJSE8vJy/Pa3v4VQKMTatWuxatUqPt4KTmNjI7y9vXmN4XG0tLRYXJ51df36dfzud7/D8uXLkZSUBGdnZ6xfvx7z588H0H7u7IMPPsCNGzcQGhqKyZMnd3r8xx9/jHPnzkGlUiEkJASbN2/G2LFjcfnyZXz55ZdgjOH8+fMIDg7GN998A5VKZTCP+ULFZmBQsdHDEpOrvLwcly5dwsyZM3Hz5k0cP34cn376KUJDQwEAW7duhZeXFw4dOoSmpiZs2rQJfn5+ePrpp/Hjjz8iJSUFSUlJcHJywhtvvGHwec6cOYO//OUv+PjjjxEdHY2SkhI4ODhg+/btuHXrFt59913Exsaa62X3yBI/p76wlvgVCgWUSiVOnDiBO3fuYOPGjRg+fDjCwsLwxz/+EVKpFMnJySgtLcWrr76KwMBA7rHR0dFYu3YtXF1d8e233+LNN9/EkSNH8MQTT2D16tUoKSnB9u3bue3ff/99g3nMF0toUrcF1IymhyV9CWzZsgUzZszA2rVrMW7cOKxevRpA+/mTyMhIODg4oK6uDpcvX8bmzZvh5OQELy8vPPvsszh16hSA9gLyi1/8Av7+/vDw8OD2oc+hQ4fwwgsvYMSIERAIBAgJCUFAQIBZXmtfqdVqqz55a0l51pt169ZBIpFg/PjxmDp1Ks6cOQOtVouff/4Zv/71r+Hk5ISoqKhu5/4WLFgAT09PODg44Pnnn0draysKCwv1PodCoegxj/nS1NRk1XlmKejIRo+Wlha+Q+B8/PHHeo8k/Pz8uP+XlZVBo9EgISGBW8YY47apqqqCv78/t+7R/3dVUVGB4ODggQjd5BhjaGtrg0Qi4TuUfrGEPBOJRN26Xms0Gjg4/Oerwc3NDU5OTtz9gIAAVFVVoba2FlqttlMuds2tAwcO4NChQ6iqqoJAIEBjY6PBbuu95TFfrD3PLAUVGz3a2tr4DqFXAoGA+7+/vz8kEgnOnDnT6Uuig1wuR3l5OXf/0f935efnZ/CqmI8+p6Ww5i8BS8gzf39/PHz4EOHh4dyyhw8fYtCgQdz9hoYGNDU1cQWnvLwckZGRkMlkEIlEqKioQFhYGLeuw82bN7F//378+c9/RkREBIRCIWbOnMkdJXTNp97ymE/WnGeWgprR9LCEL4G+kMvliI2NxSeffAKVSgWdToeSkhKkpaUBAObOnYuDBw+ioqIC9fX12L9/v8F9LVu2DAcOHEBWVhYYYyguLuauUurl5YXS0lKzvCZjWdtn9ShLuFDa3Llz8fnnn6OiogI6nQ6pqalISUnB7NmzO223d+9etLW14ebNm0hJScGcOXMgEokwa9Ys7N27F83NzcjLy8NPP/3EPaaxsREikQienp7QarX461//2un8h5eXFx4+fMh1kugtj/lkCZ+VtaNi00XHIbO1+f3vf4+2tjY888wzmDlzJt544w1UV1cDaC8gcXFxePbZZ/H8889j5syZBvczZ84crF69Gu+88w6mTZuGzZs3cwMPExMT8fnnn2PGjBn46quvzPK6emONnxXQnmeWMHPA2rVrMXr0aKxduxYzZ87Ep59+iu3btyMqKorbxtvbG25ubkhISMC7776Lt956izuSeeONN9DU1IT4+Hhs27YNixcv5h43efJkPPHEE3j66aexaNEiSCSSTk1ic+bMAQDMnj2b6yHZUx7zyVrzzJIIGJ356qStrQ23b9/mOwxipICAgE69n6yFRqNBeno632H0qqPr8/Hjx/kOhVf+/v4ICgriOwyrRkc2XdB8aNbFEo4O+sNa47ZX9L3w+KjYdEEHesQcKM+sC31ej4+KTReUVNaFPi/TmjBhgt03oQGUZwOBig0hhBCTo2LThSWOJSGGWevnZa1x2yv6vB6fZY2csgDWlFS3bt3Cp59+itzcXIhEIoSFhWHz5s3Iy8vDoUOHus0QbYus6fN6lDXFTXkGCIX0u/xxUbHpQiwW8x2CUVQqFTZt2oQ333wTc+fORVtbG27dumV3o5yt5fPqylripjxrZ2kzGlgjKtddiEQiq/gVU1RUBABISEiASCSCo6Mj4uLi4ODggD/84Q+4c+cOnnzyScyYMQNA+wjoTz75BAsXLsS8efOwY8cO7uJj169fx4IFC/DFF19g9uzZWLx4MU6cOMHXS+sTa/nS7kooFFKeUZ7ZFcvPdh5YQ2INGjQIIpEI77//Pi5duoT6+noAQHh4ON566y3ExMQgJSUF58+fBwDs3r0bhYWF+Prrr/Hjjz+iqqoK+/bt4/b36DTy27Ztw4cffoiCggIeXlnfWMNnZYg1xE551s4aPitLR8VGD2tILFdXV+zbtw8CgQAffvgh5s6di9/85jdQKBTdtmWM4ccff8TmzZvh4eEBFxcXrF69utvU7fqmkbd01vBZGWINTVGUZ+2s4bOydNQQqYe1fIGFh4dj27ZtAICCggK89957+NOf/tTtaom1tbVobm7G888/zy3rejlpQ9PIWzpr+az0sZbYKc+s57OyZFRs9HByckJtbS3fYfRJWFgYFi1ahH/+85944oknOq3z9PSEVCrFd999B19fX72PNzSNvCUTi8VWfeL20S9da2GPeebg4GDVeWYpqBlND2dnZ75D6FVBQQEOHDiAiooKAO1/tCdPnkRMTAy8vLxQWVnJzVQrFArx1FNPYefOnaipqQEAVFZW4sqVK532qW8aeUtmDZ9TT6whfsozwMXFhe8QbAKVaz2sIbmcnZ2RkZGBpKQkNDQ0wM3NDVOnTsXGjRshlUoRERGB+Ph4CAQCnD17Fq+++ir27duH1atXQ6lUwsfHB8uXL+eaQh6dRt7R0bHTNPKWyhq+rHtiDfFTnlnH52QN6BIDBty5c8duLphkrdPIR0VFwcPDg+8wHgvlmeWLjIyEp6cn32FYPWpGM4B+zVg+W/iMbOE12Dr6jAYGFRsD3Nzc+A6B9MDR0dEmegi5u7vzHQLpgVQqpW7PA4Sa0QxobW3FnTt3+A6DGODn54fg4GC+w3hslGeWzVbyzBLQkY0BEonEKrum2gtbaUOnPLNs1n5O0JJQsekBJZplcnBwsIoeg8aylcJpaxwcHODq6sp3GDaDik0P6EvAMnl4eFjVFP29oTyzTO7u7jaVZ3yjYtMDFxcXODo68h0G6cLLy4vvEAaUs7Mz5ZkF8vb25jsEm0LFphc+Pj58h0Ae4ejoaJM9uCjPLItUKqUeqQOMik0vvL29reK6I/bCVr+UKc8si4+PDzWhDTDK7l6IRCKba7axVkKh0GabNijPLIct5xmfqNgYwVZ/TVsbLy8viEQivsMwGUMzJRPzkslkNMuzCVCxMYKzszN1g+aZQCCAv78/32GYlJOTE/VM45lAIEBAQADfYdgkKjZGCgoK4jsEuyaXyyGVSvkOw+QCAwP5DsGu2Uue8YGKjZGcnJyoHZcnQqHQbn5tUp7xx57yjA9UbPogICCAeqjwwM/PzyYm3TRWYGAg5RkPfH197SrPzI2KTR9IpVI6iWtmYrEYfn5+fIdhVhKJhPLMzBwcHGz+nCDfqNj0UWBgILXpmtGgQYNsugeaIZRn5hUaGmqXeWZOVGz6SCgUWvxlbG2Fl5eX3fbOojwzH5lMZrd5Zk5UbPrB1dWVmjlMTCwWIyQkhO8weOXq6mp3TYjm5uDggEGDBvEdhl2gYtNPQUFB1MxhQoMGDaKBdaDmNFMLDQ2lPDMTKjb9JBQKERkZSfNZmYCfnx81a/wfyjPT8fX1pTwzI8rgx+Dk5ETt6gPM3d2dBtB24eTkhPDwcL7DsCnu7u50uWczo2LzmGQyGQ0EGyCOjo6IiIigMSZ6eHp60uwCA0QqlSI8PJzyzMyo2AyAgIAAOhx/TCKRCJGRkdT9tAcBAQGQyWR8h2HVRCIRoqKi6DwND6jYDACBQIDw8HC62FI/CYVCREVF0dUqjRAWFkZ51k8d578oz/hBxWaAdCSyq6sr36FYFYFAQO9bH3QUZnq/+qYjz6hQ84eKzQDqOESnLwLjdHxx2uJlnk2JCk7fUJ5ZBgFjjPEdhK3R6XTIzc1FfX0936FYLKFQiMGDB9MX5mOgPOtdR6GhIxr+UbExEcYYiouLUVVVxXcoFkcqldI5mgFCeWaYVCpFZGQknJyc+A6FgIqNyVVVVaG4uBj0Nrdzc3NDREQE9QYaYJRnnVGeWR4qNmbQ0NCAvLw8aDQavkPhla+vL4KDg2l8g4moVCrk5ubafZ75+PggJCSE8szCULExk9bWVhQWFtpl+3rHZIc0RsT07D3PQkJC4OXlxXcoRA8qNmZWXV2N4uJi6HQ6vkMxC09PTwwaNIiugGhm1dXVKCkpgVar5TsUs6A8s3xUbHhgD78+6WiGf/aSZ3Q0Yx2o2PCotrYWpaWlaGlp4TuUASMQCODr6wt/f386OWshbDXPfHx8EBAQQHlmJajY8IwxhurqapSVlaGtrY3vcB6Lt7c3AgMDIZFI+A6FdMEYg0KhwMOHDynPCC+o2FgInU6HyspKVFZWWtWXgUAggKenJwICAmg8gxWgPCN8oWJjYRhjqKurQ2VlJRoaGvgOxyCxWAwfHx/I5XI6KWuFOvKsqqrKos/pUJ7ZDio2Fqy5uRnV1dVQKpUW0d4uFArh7u4Ob29veHh4QCAQgDFG4xmsnCXmmZubG7y9veHp6Un5ZSOo2FiJpqYm1NXVQalUorGx0WzPKxaL4eHhAU9PT7i5uXW7PHFxcTGuX7/O/fr08fGBTCajyxhbmeLiYmi1Wvj5+VlknhHrR8XGCmk0GjQ2NkKtVkOtVqOxsXFA2t+FQiGcnJzg4uICZ2dnODs7w9HRscdflowx/OMf/0BNTQ23TCQSQSaTwcPDo9PNy8uLeg5ZGJ1Oh+vXr+PWrVsQi8V46qmnuAsBds0ztVqN1tbWx37O/uQZsX5UbGyERqNBS0sL2traOt20Wi0YY9ycWQKBAEKhEGKxuNtNKpX26w8+NzcXZ8+e7XEbDw8PPP3001RsLEhjYyN+/vlnlJWVcctkMhmWLVtm8PwIn3lGrBv95dsIBwcH3r7Iw8PD4enpCaVSqXe9QCDAzJkzqdBYCMYYcnJycOnSpW5HKkqlEqWlpQgLC9P7WD7zjFg3yho7oFQqUVdXB5FIhODg4AHfv1AoxJgxY3D+/Hm96z09Pem6NRaiubkZKSkpyM/P77bO2dkZs2bNQmBgIA+REVtHzWh2IC0tDWlpaXBycsIvf/lLkzyHTqfD999/j7q6Or3rHR0dMXXqVERERJjk+UnvCgsLcfHiRTQ1NXVbFxQUhFmzZtEYFmIy1OWDDAihUIiJEycaXN/c3IwzZ87gzJkzUKvVZoyMtLa24vz58zh58mS3QiMSiRAXF4cFCxZQoSEmRc1oZMCEh4fD29sbCoUCQPsFrLoOTM3Ly0NJSQkmTpyI4cOHUxdXE2KMobCwEJcvX4ZKpeq2Xi6XY+bMmTRZKjEL+ksnA0YgEGDSpEkAgNDQUKxcuRITJ07sVlBaW1tx6dIlHDp0CJWVlXyEavOUSiVOnDiBU6dOdSs0AoEA48aNw7Jly6jQELOhIxsyoIKDgxEREYEpU6ZAKBRi7NixCA0Nxblz57gjng7V1dU4dOgQhg0bhkmTJsHR0ZGnqG1Ha2srbty4gYyMDL3XTPL09MTMmTPh4+PDQ3TEnlEHATtgjg4Cj9I3hY1Op0NGRgbS0tL0DkB1dHTExIkTMXToUGpa64eO7sypqal6z4kJBAKMHDkSEydOpK7LhBeUdWTA6RuwJxQKMWrUKERGRuLKlSvIy8vrtL6jS256ejrGjx+PyMhIKjpGYIyhtLQU169fN9gk6e/vjylTpsDb29vM0RHyH1RsiFm5uLhgzpw5KCkpwaVLl7p1la6vr8e5c+dw69YtjB8/HuHh4TTaXI+OIpOWloaKigq92zg7OyMuLg6RkZH0HhLeUbEhvAgODsby5cuRnp6OmzdvQqvVdlpfW1uLM2fOwNvbGxMmTMCgQYPoCxPGFRmhUIiYmBiMHTuWLjBGLAYVG8IbkUiEcePGYfDgwbhx4ways7PR9RSiQqHAyZMnIZPJMGLECAwePNgur2ui0+lQUFCAO3fuGCwyABASEoLJkydzk2kSYimog4AdMHcHgf6qq6tDWloacnJyDG4jkUgwZMgQjBgxAh4eHmaMjh8qlQpZWVm4d++e3pH/HYKCgjB+/Hj4+/ubMTpCjEdHNsRieHh4YNasWRgzZgzS0tL0zt/V2tqKjIwMZGRkICQkBNHR0QgJCbGpzgQ6nQ4lJSXIzMxEcXFxt6O9R1GRIdaCig2xOF5eXpg7dy6qq6uRlpaGwsJCvdsVFxejuLgYUqkUoaGhiIiIQFBQEEQikZkjfnw6nQ4VFRUoKChAfn6+3hH/j6IiQ6wNFRtiseRyOeLj41FfX4/MzEzcu3dP78W7WlpakJ2djezsbEgkkk6Fx5LHlGg0Gjx8+BD5+fkoLCxEc3Nzj9uLRCJEREQgOjoafn5+ZoqSkIFhuX+JhPwfd3d3xMXFYcKECXjw4AHu3r3b6cqgj2ptbcWDBw/w4MEDiEQi+Pr6wt/fH/7+/vDz8+O1d1ZbWxuqqqpQUVGBiooKlJWVGXWFVXd3d0RHR2PIkCE0ywKxWlRsiNVwcHDA8OHDMWzYMJSXlyMzMxOFhYXQaDR6t9dqtSgrK+OuRCkQCODl5YWAgAB4eXlxl6t2cnIa8G7VLS0tqK+vh1KpREVFBSorK6FQKHo8//IogUCAsLAwREdHIzAwkLp9E6tHxYZYHYFAgICAAAQEBECj0aC4uJhriurpSIExBoVC0W2ONrFYDHd3d3h4eMDd3R0SiQRisbjbvwKBABqNRu9NpVKhoaEB9fX1aGho0Nvc1xuhUIjg4GCEhYUhNDSUpvwnNoWKDbFqDg4OCA8PR3h4ODQaDUpKSpCXl4eioiKjv/Db2tr0FiFzEIvFGDRoEMLDwxEcHEyDMInNomJDbIaDgwPCwsIQFhYGnU6HmpoalJeXo7y8HGVlZT2OUzEXqVQKX19f+Pn5wc/PD/7+/lbZe46QvqJiQ2ySUCiEXC6HXC7HyJEjwRhDfX09ysvLUVlZifr6etTV1fXaxfhxSKVSuLm5QS6Xc8XFw8ODzr8Qu0TFhtgFgUDAdQgYOnQot1yj0XCFp6P4tLW1cbfW1la0traira0NjDE4ODh0u4lEIjg7O8Pd3R1ubm5wc3Pjzv0QQtpRsSF2zcHBAV5eXvDy8uI7FEJsmu3M8UEIIcRiUbEhhBBiclRsCCGEmBwVG0IIISZHxYYQQojJUbEhhBBicnSlThumVqtx8uRJNDY2Qq1WQyAQwNvbG8OGDUN0dDTf4RFC7Agd2diwjoGGarUaQPtElLW1tQgLC+M3MEKI3aFiY+PGjRvX6f7w4cPh7OzMUzSEEHtFxcbGyWQyREZGAmi/0uOYMWN4jogQYo+o2NiBjqMbOqohhPCFio0dkMlkGDp0KB3VEEJ4Q73R7IRWq6XrphBCeEPFhlidn3/+GRcvXsSsWbMwbdo0vsMhhBiBig2xKiUlJRg1ahSGDRuGnJwc3LlzB35+fnyHRQjpBZ2zsXGJiYlYtGgR32H0SW1tLfz8/JCbm9tpOWMMiYmJeO6553D58mUsXboUL774olH7XL58OXbu3GmKcAkhxmB2oLKykq1bt46FhoYyiUTCfH192axZs9ipU6cYY4xNnz6dbdiwoc/77e/j9Fm1ahUD0O0WGxv7WLEolUpWW1s7IDH25/n7Y8uWLSwxMXFA9tXh9u3bTCaTMaVSOaD7JYQYxy6u1Pn0009DrVbj888/R1RUFCorK3HhwgUoFAq+Q+tkzpw5+Oqrrzote9xLC3t4eDzW481NrVZj3759OHr06IDuNyYmBhEREThw4AA2bNgwoPsmhBiB72pnarW1tQwAO336tN71+o4o8vPzGWOMnThxgk2dOpV5enoymUzG5s2bxzIzM3t9nE6nY3/84x9ZREQEc3R0ZCNHjmRfffVVj3GuWrWKLVy4sMdtLly4wGJjY5mLiwtzd3dnkyZNYnfu3Okxlq77nT59Ovv1r3/Nfvvb3zKZTMbkcjn75JNPWHNzM1u/fj3z8PBgISEh7O9//zv3mJ7eh57ei/68D99//z3z8vJiOp2OW3b48GFuvx2f4/nz55lAIGAA2Pfff9/jPjt88MEHbMqUKUZtSwgZWDZfbNra2pirqyt79dVXWVNTU7f1SqWSTZ48ma1evZqVlZWxsrIyptFoGGOM/fDDD+yHH35g2dnZLD09na1YsYJFRkaylpaWHh/39ttvsyFDhrATJ06wvLw8lpSUxJydndmxY8cMxtlbsWlra2Oenp5s8+bNLCcnh2VlZbGkpCSWmZnZYyz6io2bmxt7//33WXZ2Nvv4448ZAJaQkMA++eQT9uDBA/buu+8yiUTCSktLe30fenoP+/M+vPbaa2zu3Lndlr/88ssMAAsLC2NlZWUsIiKCAehTc9uJEyeYWCxmarXa6McQQgaGzRcbxtq/LGUyGZNKpSwuLo5t3ryZXb16lVtv7PkGlUrFhEIhS0lJMfg4lUrFHB0d2cWLFzst37hxI5s/f77Bfa9atYqJRCLm4uLS6fbGG28wxhhTKBQMADt//rzexxt6DfqKTVxcHHdfp9MxuVzOFi9ezC1rbW1lYrHY4BFD1/dB3/P3931YunQpe+GFF7otb2xsZEOHDmUAmJ+fHwPAIiMjWUNDA2OMsfz8fAaArVy50uC+09PTGQCWk5NjcBtCiGnYzTmbhQsXIiUlBVeuXEFycjL+9Kc/4cMPP8Tbb79t8HG5ubl47733kJqaiqqqKuh0Ouh0OhQVFRl8TGZmJpqbm5GQkACBQMAtb2tr63W25WnTpuEvf/lLp2Wenp4AAC8vLyQmJiI+Ph6zZ8/G7NmzsWLFCoSEhBjxDnQ2atQo7v8CgQC+vr6IiYnhlonFYshkMlRWVgIw7/vQ1NSktyuzs7MzkpKSEBsbi4qKCgiFQiQlJcHV1dXo1+3k5MQ9ByHEvOyi2ACAo6Mj5s6di7lz5+J3v/sd1q5di23btmHLli0GH7N48WIEBQVh7969CAoKgoODA6Kjo9Ha2mrwMTqdDgBw9OhRDBo0qNM6sVjcY4zOzs6IiooyuP7LL7/Epk2bkJycjCNHjuCdd97BoUOHEB8f3+N+u+NEr2AAAAR6SURBVOoah0Ag0Lus47WY832Qy+Wora3Vu66kpARarZbbf15eHmJjY7ttp1arMWvWLGRlZeHs2bOYMGECAKCmpgYA4OPjY/D5CSGmYTfFpqvo6GhoNBo0NzdDIpFwX2IdFAoFsrKysGfPHsycORMAcOPGDWg0Gm4bfY+Ljo6GVCpFYWEhZs2aNeBxjx49GqNHj8bWrVsxf/587N+/H/Hx8XpjGQjGvA9A9/eiv+/D2LFj8be//a3b8vLycqxdu5bb5ubNm1i/fj2mTp3a6ehOq9Vi5cqVuHPnDk6ePMkVGgDIyMhAYGAgDQIlhAc2X2wUCgVWrFiBF198EaNGjYKbmxuuX7+Ojz76CLNnz4a7uzvCwsJw7do1FBQUwNXVFV5eXpDJZJDL5fjrX/+KkJAQlJaW4vXXX4eDw3/eMn2Pc3Nzw5YtW7BlyxYwxjBt2jSoVCpcvXoVQqEQL730ksFYW1paUF5e3mmZSCSCj48P8vPzsXfvXixZsgRBQUHIy8vD7du3sW7dOoOxCIWPP2bXmPfB0PP3532Ij4/H1q1boVAo4O3tDaB9MOfq1atRXV2NiRMnIiUlBTNmzMDVq1fxwgsv4OzZs9zjDx06BI1Gg2PHjmHq1Kmd9p2SkoKEhITHfk8IIf3A8zkjk2tubmZvvfUWmzBhAvP09GROTk4sKiqK/eY3v2EKhYIxxtj9+/dZXFwcc3Jy6tRt+OzZs2zEiBFMKpWyESNGsOTkZObi4sK+/PLLHh+n0+nYp59+yoYPH84kEgmTy+Vszpw53CBSfQwN6gwKCmKMMVZeXs6eeuopFhgYyCQSCQsJCWGvv/46a21t7TEWfR0EunYkGDFiBHv//fc7LfPz82O7d+826n0w9Pz9eR8YYywuLo599tln3P1du3YxAEwqlXJdru/fv8+cnZ0ZAPbRRx9xHQQCAgIYAPbss8926j7d1NTE3N3d2ZUrV3p8bkKIadDcaMTiJCcnY+PGjcjMzDR6puqCggKEh4dj5cqVGDJkCLZv3463334bH374IQBgz549OHz4ME6dOmXK0AkhBtDcaMTiJCQkYMOGDSgpKenX4z/44AOsWLECO3bswL59+wC0d0rYvXv3QIZJCOkDOrIhhBBicnRkQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk6NiQwghxOSo2BBCCDE5KjaEEEJMjooNIYQQk/v/Wc+us7MggMIAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db58b25eb8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "book_plots.predict_update_chart()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This filter is a form of the g-h filter. Here we are using the percentages for the errors to implicitly compute the $g$ and $h$ parameters. We could express the discrete Bayes algorithm as a g-h filter, but that would obscure the logic of this filter.\n",
    "\n",
    "The filter equations are:\n",
    "\n",
    "$$\\begin{aligned} \\bar {\\mathbf x} &= \\mathbf x \\ast f_{\\mathbf x}(\\bullet)\\, \\, &\\text{Predict Step} \\\\\n",
    "\\mathbf x &= \\|\\mathcal L \\cdot \\bar{\\mathbf x}\\|\\, \\, &\\text{Update Step}\\end{aligned}$$\n",
    "\n",
    "$\\mathcal L$ is the usual way to write the likelihood function, so I use that. The $\\|\\|$ notation denotes taking the norm. We need to normalize the product of the likelihood with the prior to ensure $x$ is a probability distribution that sums to one.\n",
    "\n",
    "We can express this in pseudocode.\n",
    "\n",
    "**Initialization**\n",
    "\n",
    "    1. Initialize our belief in the state\n",
    "    \n",
    "**Predict**\n",
    "\n",
    "    1. Based on the system behavior, predict state for the next time step\n",
    "    2. Adjust belief to account for the uncertainty in prediction\n",
    "    \n",
    "**Update**\n",
    "\n",
    "    1. Get a measurement and associated belief about its accuracy\n",
    "    2. Compute how likely it is the measurement matches each state\n",
    "    3. Update state belief with this likelihood\n",
    "\n",
    "When we cover the Kalman filter we will use this exact same algorithm; only the details of the computation will differ.\n",
    "\n",
    "Algorithms in this form are sometimes called *predictor correctors*. We make a prediction, then correct them.\n",
    "\n",
    "Let's animate this. I've plotted the position of the doorways in black. Prior are drawn in orange, and the posterior in blue. You can see how the prior shifts the position and reduces certainty, and the posterior stays in the same position and increases certainty as it incorporates the information from the measurement. I've made the measurement perfect with the line `z_prob = 1.0`; we will explore the effect of imperfect measurements in the next section. finally, I draw a thick vertical line to indicate where Simon really is. This is not an output of the filter - we know where Simon really is only because we are simulating his movement."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            if (mpl.ratio != 1) {\n",
       "                fig.send_message(\"set_dpi_ratio\", {'dpi_ratio': mpl.ratio});\n",
       "            }\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        fig.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var backingStore = this.context.backingStorePixelRatio ||\n",
       "\tthis.context.webkitBackingStorePixelRatio ||\n",
       "\tthis.context.mozBackingStorePixelRatio ||\n",
       "\tthis.context.msBackingStorePixelRatio ||\n",
       "\tthis.context.oBackingStorePixelRatio ||\n",
       "\tthis.context.backingStorePixelRatio || 1;\n",
       "\n",
       "    mpl.ratio = (window.devicePixelRatio || 1) / backingStore;\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width * mpl.ratio);\n",
       "        canvas.attr('height', height * mpl.ratio);\n",
       "        canvas.attr('style', 'width: ' + width + 'px; height: ' + height + 'px;');\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'] / mpl.ratio;\n",
       "    var y0 = (fig.canvas.height - msg['y0']) / mpl.ratio;\n",
       "    var x1 = msg['x1'] / mpl.ratio;\n",
       "    var y1 = (fig.canvas.height - msg['y1']) / mpl.ratio;\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x * mpl.ratio;\n",
       "    var y = canvas_pos.y * mpl.ratio;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    var width = fig.canvas.width/mpl.ratio\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\" width=\"' + width + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var width = this.canvas.width/mpl.ratio\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\" width=\"' + width + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        event.shiftKey = false;\n",
       "        // Send a \"J\" for go to next cell\n",
       "        event.which = 74;\n",
       "        event.keyCode = 74;\n",
       "        manager.command_mode();\n",
       "        manager.handle_keydown(event);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA+gAAAD6CAYAAAAyVW3pAAAgAElEQVR4Xu2dCbQtVXnn//deXqLAwUDLI06oKMpgAF3gGNuYOGuG1hbHLEkiaoYe7TibNnFmJZ2ku42JqGHFqKAd01lxnlqSOKItJOKEvlacsSPKdWh93Pd6fbx94Lzz7r21aw91v9r1O2uxnt6z9676fvurqv07u2rXivhAAAIQgAAEIAABCEAAAhCAAAQgsOMEVnZ8D9gBCEAAAhCAAAQgAAEIQAACEIAABISgkwQQgAAEIAABCEAAAhCAAAQgAAEHBBB0B53ALkAAAhCAAAQgAAEIQAACEIAABBB0cgACEIAABCAAAQhAAAIQgAAEIOCAAILuoBPYBQhAAAIQgAAEIAABCEAAAhCAAIJODkAAAhCAAAQgAAEIQAACEIAABBwQQNAddAK7AAEIQAACEIAABCAAAQhAAAIQQNDJAQhAAAIQgAAEIAABCEAAAhCAgAMCCLqDTmAXIAABCEAAAhCAAAQgAAEIQAACCDo5AAEIQAACEIAABCAAAQhAAAIQcEAAQXfQCewCBCAAAQhAAAIQgAAEIAABCEAAQScHIAABCEAAAhCAAAQgAAEIQAACDggg6A46gV2AAAQgAAEIQAACEIAABCAAAQgg6OQABCAAAQhAAAIQgAAEIAABCEDAAQEE3UEnsAsQgAAEIAABCEAAAhCAAAQgAAEEnRyAAAQgAAEIQAACEIAABCAAAQg4IICgO+gEdgECEIAABCAAAQhAAAIQgAAEIDCEoM8kPVfSGZLuLOmmkn5X0vMi8e+WdJ6kh0k6XNJlkp4j6T2b1L+fpOdLOl3S9yW9WdLTJF0VuS2KQQACEIAABCAAAQhAAAIQgAAEdoTAEIJ+G0mXBrH+rKQn9hD0H5f0UUk/IekZQbR/U9JDJZmMX7xA7T6S3i3pLZJeJsnE/qWSrpZ0pqQf7ghhNgoBCEAAAhCAAAQgAAEIQAACEIggMISgz7exP8yef7OHoP9GkO17SvpgiOewIPvflXS3hRg/IumIMHt+bfi71Xu/JGvn5RE8KAIBCEAAAhCAAAQgAAEIQAACENgRAkMI+mJgdnt7H0F/l6RbSTppic4zJb1I0i0lfUXSLSR9WZL9/SVLZT8j6YuSHjD/+/79+9fW19dPXCy3srLyLUn2IwIfCEAAAhCAAAQgAAEIjI3Ayv79+49Z3OnZbHbFysrKxtgCYX8hMGUC3gX9a5L+XtLZS51kt7jb8+UPlPTO8O/bw63vb10q+0ZJ95J08/nfr7nmmpP27dv3qSl3PLFDAAIQgAAEIAABCLRNYHV19eSjjjrq021HSXQQaIuAd0H/kaRXS3rKEvZ7SPqApMdKen3497WS7O8fWir7Z5LOkWTPs1/3QdDbSmKigQAEIAABCEAAAhA4lACCTlZAYHwExiDor5L061sI+mMkXbgg6HeX9OFNBP0Jkm6EoI8vQdljCEAAAhCAAAQgAIE0Agh6GjdqQWAnCXgXdG5x38nsYNsQgAAEIAABCEAAAqMlgKCPtuvY8QkT8C7o9ny5LRJ38lIf2SvXXhwWh/vqwiJx9nd7tdrix567uXJxkbj19fXdGxsb31gsdMQRR2h1dXXwVNi9294G18bnqqv6v26+pfitF1MYDNH7l19+ua699loddthhOvXUU4fYpKttTDn+u7/oPdq7se+Q/ti1tqoPPevnXPVTzZ2Zcg7MuU6dgff4uR7WPAPc0Lb3PMihsG/fPn3ve987qIm1tbXjZrNZ/wFazo5QFwIQyCLgXdDt1vY/kbR467q9Zs3eq26vWbO/zz92a/vhks6QNF+t0r6317NZO386L7i+vn7sxsbGQSer2Wy2I4K+sjJ0F2Tly7aV9+/vvwh+S/EbnBQG9XrkhpYvu+wy7d27V7t27dLpp58+xCZdbWPK8d/h2W/TjzYR9B9bW9VnX/hgV/1Uc2emnANzrlNn4D1+roc1zwDTuB6aoK+vry8L+u7ZbGZvUOIDAQiMhMBQdmijQHtH+Sws+mYrq78hMLJV178vyZ41t2fFbxdei2Zf28JuH5N0lCSbHTeptnea/7yk+0m6eIHzz0iy17L9bZB6m5q2V659R9KZkn6IoNfNyhQ5ZUBSt08YmB8g4H1gXjMLEHRygPPAOHKA62HNMyGCPgxdtgIBCJQgMJSgf0HSrbfY4dtKsu8vCII+///z4sdJOk/Sw8IMuc2eP1fSuzdp7/6Sfi/Mopv026vYfjuI/fXFmUEvkTqHtoGgM4NeJ7PyW0XQD73FnRn0/LwaWwtTPg7G8EMdgj7MEdXyccAM+jA5xFYgUJvAUIJeO45e7SPovXBFF0bQEfToZBm4YMsDsi6UzKCPY/a0qx9LfD/l4wBBL5FB/dpIGRP020Ja6ZaPAwQ9LSeoBQFvBBD00CM8g56fmikXY2YM8rnHtNDygIT4tyeAoCPo8wzhPOB7LQ6uhzFn8/wyLR8HCHp+ftACBDwQQNAR9GJ5iKAzg14smQo31PKArAsVgo6gI+jjyAEEvetsVub7lq8HCHqZHKEVCOw0AQQdQS+Wgwg6gl4smQo31PKArAsVgj4OOevqxxLfT/k4MH7e40fQS2R5dxve86A7gq1LIOg59KgLAT8EEHQEvVg2IugIerFkKtxQywOyLlQIOoLODPo4cgBB7zqblfm+5esBgl4mR2gFAjtNAEFH0IvlIIKOoBdLpsINtTwg60KFoI9Dzrr6scT3Uz4OmEEvkUH92kgZE/TbQlrplo8DBD0tJ6gFAW8EEHQEvVhOplyMmTEohn/bhloekMQQnHL8CDqCzgz6OHKA62HM2Ty/TMvXAwQ9Pz9oAQIeCCDoCHqxPETQmUEvlkyFG2p5QNaFCkEfh5x19WOJ76d8HDCDXiKD+rWRMibot4W00i0fBwh6Wk5QCwLeCCDoCHqxnEy5GDNjUAw/M+jbEGh5QNaVQQg6gs4M+jhygOth19mszPctXw8Q9DI5QisQ2GkCCDqCXiwHEXRm0IslU+GGWh6QdaFC0MchZ139WOL7KR8HzKCXyKB+baSMCfptIa10y8cBgp6WE9SCgDcCCDqCXiwnUy7GzBgUw88MOjPomxJA0BF0ZtDHkQNcD7ke5hJA0HMJUh8CPggg6Ah6sUxE0JlBL5ZMhRtqecakCxWCPg456+rHEt9P+ThgBr1EBvVrI2VM0G8LaaVbPg4Q9LScoBYEvBFA0BH0YjmZcjFmxqAYfmbQmUFnBp0c4Dww4hzgesj1MJcAgp5LkPoQ8EEAQUfQi2Uigs4MerFkKtxQyzMmXaiYQWcGfZ4jUz4OmEHvOlOU/z5lTFB+Lw5tseXjAEEfIoPYBgTqE0DQEfRiWZZyMWbGoBh+Zs5GPHNWMwsQdAQdQR9HDnA9rHkmvKFtBH0YzmwFAhBIJ4CgI+jp2bNUE0FnBr1YMhVuqOUBWRcqBH0cctbVjyW+n/JxYPy8x4+gl8jy7ja850F3BFuXYAY9hx51IeCHAIKOoBfLRgQdQS+WTIUbanlA1oUKQUfQ5zky5eMAQe86U5T/PmVMUH4vDm2x5eMAQR8ig9gGBOoTQNAR9GJZlnIxZsagGP5tG2p5QBJDcMrxI+gIOoI+jhzgehhzNs8v0/L1AEHPzw9agIAHAgg6gl4sDxF0ZtCLJVPhhloekHWhQtDHIWdd/Vji+ykfB8ygl8igfm2kjAn6bSGtdMvHAYKelhPUgoA3Agg6gl4sJ1MuxswYFMPPDPo2BFoekHVlEIKOoDODPo4c4HrYdTYr833L1wMEvUyO0AoEdpoAgo6gF8tBBJ0Z9GLJVLihlgdkXagQ9HHIWVc/lvh+yscBM+glMqhfGyljgn5bSCvd8nGAoKflBLUg4I0Ago6gF8vJlIsxMwbF8DODzgz6pgQQdASdGfRx5ADXQ66HuQQQ9FyC1IeADwIIOoJeLBMRdGbQiyVT4YZanjHpQoWgj0POuvqxxPdTPg6YQS+RQf3aSBkT9NtCWumWjwMEPS0nqAUBbwQQdAS9WE6mXIyZMSiGnxl0ZtCZQScHOA+MOAe4HnI9zCWAoOcSpD4EfBBA0BH0YpmIoDODXiyZCjfU8oxJFypm0JlBn+fIlI8DZtC7zhTlv08ZE5Tfi0NbbPk4QNCHyCC2AYH6BBB0BL1YlqVcjJkxKIafmbMRz5zVzAIEHUFH0MeRA1wPa54Jb2gbQR+GM1uBAATSCSDoCHp69izVRNCZQS+WTIUbanlA1oUKQR+HnHX1Y4nvp3wcGD/v8SPoJbK8uw3vedAdwdYlmEHPoUddCPghgKAj6MWyEUFH0IslU+GGWh6QdaFC0BH0eY5M+ThA0LvOFOW/TxkTlN+LQ1ts+ThA0IfIILYBgfoEhhD0IyW9QNLZko6R9GlJL5F0YUd475N0n23K3EzS18P3W5V9h6QHLbexvr5+7MbGxlWLf5/NZlpdXa1PfGkLLf1innIxbil+69oUBkMkXcsDkhh+U44fQUfQEfRx5ADXw5izeX6Zlq8HCHp+ftACBDwQGELQ3ynpLEnPkPRZSY+V9ERJj5P0um0gnCLpqKXvD5f0dkkfk3SPhe9M0G8V2lys8u3wg8BBzSDodVIvRU4ZkNTpi+VWWx6QxBCccvwI+jjkLCaPc8tM+Tgwdt7j53qYm+Fx9b3nQVwUm5dC0HPoURcCfgjUFvSHSHpLkPLXL4Rt0n6qpOMlbfTA8QRJFwTBf9WSoN9U0p1i2kLQYyj1L4OgM4PeP2uGqdHygKyLIIKOoM9zZMrHAYLedaYo/33KmKD8XhzaYsvHAYI+RAaxDQjUJ1Bb0M+X9GhJR0u6diGcx4TZ83tJ+kCPMP9O0p0l2e3t30XQe5AboGjKxZgZgwE6ZgQzR7UptDwg62KHoCPoCPo4coDrYdfZrMz3LV8PEPQyOUIrENhpArUF/YOS1iTddSlQmz3/hKQnS3pFJIQTwy3yr5R07lIdu8X9bpJ+EG6L/2J4xt2efbe/HfRhBj2SeM9iCDoz6D1TZrDiLQ/IuiAi6OOQs65+LPH9lI8D4+c9fgS9RJZ3t+E9D7oj2LoEgp5Dj7oQ8EOgtqDbM+d7NlmozWbAvyrpWZJeHInDFpZ7enj2/ENLdUzEvxKeN7+xpAdLekqYnb+vpH2L5RH0SOI9iyHoCHrPlBmseMsDsi6ICDqCPs+RKR8HCHrXmaL89yljgvJ7cWiLLR8HCPoQGcQ2IFCfwBCC/vkgzIvRzAX9mWFF965ID5P0JUn/HPucuaSnSvp9SQ+X9Nddgn7llVfKTmxDf84444yhN1lte5deemnvtluK34JPYdAbWkKFvXv3Xl9r165dCS2Mu8qU43/ERV/WtZuc2g5blf7qUbccd8f22Psp58Ac09QZeI+f62GPAzqjqPc8yAjturcRHX+8Le90w2dtbW33bDb7Zk671IUABIYlUFvQS93i/guS/kbSf5D0R5GIjguvYTsvzLxfX22zGfQ9e/ZoY6PPenWRe9FR7KyzbIH7Nj6XXHJJ70Bait+CT2HQGxoVINCDwKPf9I0tBf3Ch9tpkg8EIOCBANdDD70w7n1YW1vTCSecgKCPuxvZewiotqDb8+W2INzyInG2cJyt6h67SJzJub3P/OZhFj2m6+aCbrfG20z9toLODHoM0u3LpMweM2OQzz2mhZZnDIh/ewLMoB/gM/VjAAb+c4DrYczZPL9My+cCZtDz84MWIOCBQG1Bt2fB3xpWcr9oIeC3STot8jVrPxlub3+TpEf1gPY0SS+V9Eth9n1bQZ/NZtfdGjT0p6VFYVKeN2spfsudFAZD5FzLz9zF8Jty/DyDfiBDppwD82Nk6gy8x8/1MOZsnl/Gex7kRMgz6Dn0qAsBPwRqC7pFau88PzPcZv65MKNuq7A/XtJrAwp7p7m94/x2kmwF9sWPLQxns+APkPSuTdDdW9Kzw3PmtiDdjcIz70+SdLGk+7NI3DAJlyKnDEiG6ZuWByQxBKccP4KOoCPo48gBrocxZ/P8Mi1fDxD0/PygBQh4IDCEoB8p6YWSzpZ0TFhp3VZuv3ABwAVB0G8r6QtLYD4j6cck2UM1+zeBdntJfyzpdEk3DWWuCO3/gaQfLtdhFfc6qYegM4NeJ7PyW215QNZFB0Efh5x19WOJ76d8HBg/7/Ej6CWyvLsN73nQHcHWJRD0HHrUhYAfAkMIup9ow54g6HW6BEFH0OtkVn6rLQ/Iuugg6Aj6PEemfBwg6F1nivLfp4wJyu/FoS22fBwg6ENkENuAQH0CCHpgzDPo+cmWcjFmxiCfe0wLLQ9IiH97Agg6go6gjyMHuB7GnM3zy7R8PUTQ8/ODFiDggQCCjqAXy0MEnRn0YslUuKGWB2RdqBD0cchZVz+W+H7KxwEz6CUyqF8bKWOCfltIK93ycYCgp+UEtSDgjQCCjqAXy8mUizEzBsXwb9tQywOSGIJTjh9BR9CZQR9HDnA9jDmb55dp+XqAoOfnBy1AwAMBBB1BL5aHCDoz6MWSqXBDLQ/IulAh6OOQs65+LPH9lI8DZtBLZFC/NlLGBP22kFa65eMAQU/LCWpBwBsBBB1BL5aTKRdjZgyK4WcGfRsCLQ/IujIIQUfQmUEfRw5wPew6m5X5vuXrAYJeJkdoBQI7TQBBR9CL5SCCzgx6sWQq3FDLA7IuVAj6OOSsqx9LfD/l44AZ9BIZ1K+NlDFBvy2klW75OEDQ03KCWhDwRgBBR9CL5WTKxZgZg2L4mUFnBn1TAgg6gs4M+jhygOsh18NcAgh6LkHqQ8AHAQQdQS+WiQg6M+jFkqlwQy3PmHShQtDHIWdd/Vji+ykfB8ygl8igfm2kjAn6bSGtdMvHAYKelhPUgoA3Agg6gl4sJ1MuxswYFMPPDDoz6MygkwOcB0acA1wPuR7mEkDQcwlSHwI+CCDoCHqxTETQmUEvlkyFG2p5xqQLFTPozKDPc2TKxwEz6F1nivLfp4wJyu/FoS22fBwg6ENkENuAQH0CCDqCXizLUi7GzBgUw8/M2YhnzmpmAYKOoCPo48gBroc1z4Q3tI2gD8OZrUAAAukEEHQEPT17lmoi6MygF0umwg21PCDrQoWgj0POuvqxxPdTPg6Mn/f4EfQSWd7dhvc86I5g6xLMoOfQoy4E/BBA0BH0YtmIoCPoxZKpcEMtD8i6UCHoCPo8R6Z8HCDoXWeK8t+njAnK78WhLbZ8HCDoQ2QQ24BAfQIIOoJeLMtSLsbMGBTDv21DLQ9IYghOOX4EHUFH0MeRA1wPY87m+WVavh4g6Pn5QQsQ8EAAQUfQi+Uhgs4MerFkKtxQywOyLlQI+jjkrKsfS3w/5eOAGfQSGdSvjZQxQb8tpJVu+ThA0NNygloQ8EYAQUfQi+VkysWYGYNi+JlB34ZAywOyrgxC0BF0ZtDHkQNcD7vOZmW+b/l6gKCXyRFagcBOE0DQEfRiOYigM4NeLJkKN9TygKwLFYI+Djnr6scS30/5OGAGvUQG9WsjZUzQbwtppVs+DhD0tJygFgS8EUDQEfRiOZlyMWbGoBh+ZtBHPIN+59dcUS0Rrv7kFfbL0aHtr6zo6FNOrLLdj/9ynXZzdrblQXksl6kz8B4/18PYTM4r5z0PcqJD0HPoURcCfggg6Ah6sWxE0JlBL5ZMhRvyPiBD0At3+CbNec+B+gT8v2asNgPvOYCg186AA+17z4McCgh6Dj3qQsAPAQQdQS+WjQg6gl4smQo35H1AhqAX7nAEfVOg3o+D2lngPX4EvXYGIOjDEGYrEIBALgEEHUHPzaHr6yPoCHqxZCrckPeBOYJeuMMRdAR9hDmAoNc/DzCDPgxjtgIBCOQRQNAR9LwMWqiNoCPoxZKpcEMIOs+ge8+BwimPoCPoQ6TUtttIGRMMsdMtnwu4xX2IDGIbEKhPAEFH0ItlWcrFmBmDYvi3bajlAUkMQe/xM4Me04t5ZbznQF50cbWnzsB7/FwP4/I4t5T3PMiJD0HPoUddCPghgKAj6MWyEUFnBr1YMhVuyPuADEEv3OEjnD2tT6DtxbFi+Hk/DyDoMb2YX8Z7HuREiKDn0KMuBPwQQNAR9GLZiKAj6MWSqXBD3gdkCHrhDkfQNwXq/TionQXe40fQa2fAgfa950EOBQQ9hx51IeCHAIKOoBfLRgQdQS+WTIUb8j4gQ9ALdziCjqCPMAcQ9PrnAQR9GMZsBQIQyCOAoCPoeRm0UBtBR9CLJVPhhhB0FonzngOFUx5BR9CHSKltt5EyJhhip1s+FzCDPkQGsQ0I1CeAoCPoxbIs5WLMjEEx/Ns21PKAJIag9/iZQY/pxbwy3nMgL7q42lNn4D1+rodxeZxbynse5MSHoOfQoy4E/BAYQtCPlPQCSWdLOkbSpyW9RNKFHRjOkfTnW5S5maSvL333aEnPkHSSpG9JeoOk50j67nIb6+vrx25sbFy1+PfZbKbV1dXBe6alCzKCzgz64AdQ5Aa9D8gQ9MiOzCjmPQcyQouuOnUG3uNvaTxgSZkyJohO5oyC3vMgIzQh6Dn0qAsBPwSGEPR3SjoryPNnJT1W0hMlPU7S67ZBMRf0XwlSv1j0Y5L2LvzB2vpLSa8Mbd5B0kslfUTSAxD0YRIu5WLMgGSYvml5QBJD0Hv8CHpML+aV8Z4DedHF1Z46A+/xcz2My+PcUt7zICc+BD2HHnUh4IdAbUF/iKS3BCl//ULYJu2nSjpe0sYWOOaCbnL/0W2QrUn6kqR/kvTAhXL2Q8BrJdk+vG2xPjPodRIQQWfGoE5m5bfqfUCGoOf3cVcL3nOga/9LfD91Bt7jR9BLZHl3G97zoDuCrUsg6Dn0qAsBPwRqC/r5kuzW86MlXbsQ9mPCTPe9JH0gU9CtjX+QZG0u3ja/K9zqbj8MPAlBr590CDqCXj/L0rbgfUCGoKf1a59a3nOgTyypZafOwHv8CHpqZver5z0P+kVzcGkEPYcedSHgh0BtQf+gJJvhvutSyDZ7/glJT5b0ig5B/4akYyV9R9L7JP1OqDuvZm38aZiR/+RSW5eEW+HviaDXTzoEHUGvn2VpW/A+IEPQ0/q1Ty3vOdAnltSyU2fgPX4EPTWz+9Xzngf9okHQc3hRFwJeCdQWdHvmfI+kBy0BsEXevirpWZJevAUcq/PTkj4k6RpJPxWeY7fZeJs1vyzUszZeKGmzhePeIek2ku7YJehXXnnldYtrDP0544wzht5kte1deumlvdtuKX4LPoVBb2gJFfbuvWHJhl277OaSaX28x3/OPx5erUOu/uQV9svRoe2vrOjoU06sst0LTvt+lXZzGvWeAzmxxdadOgPv8XM9jM3kvHLe8yAnOlvs+Pjj7enRGz5ra2u7Z7PZN3PapS4EIDAsgSEE/fOSHrwU1lzQnxlWdI+N2mTbnjV/r6RfDJXmgv6Tkmy2ffFjgn7rsLL79X/f7Bn0PXv2aGNjq8fhY3evf7mzzrJH7Nv4XHKJ3bDQ79NS/BZ5CoN+xCjdIoFzP3WTamHthKCff7Ld8MQHAhDoQ4DrYR9alN2MwNramk444YSDvkLQyRUIjI9AbUHPucV9K5q24NtdJB0XChS5xZ0Z9PzkTZk9ZsYgn3tMCy3PGLQQPzPoMb2YV2bqx4DRmzoD7/FzPcw7xmNre8+D2Dg2K8cMeg496kLAD4Hagm7Pl9vibcuLxNnCcbZ423aLxG1F6e2STg+3tFsZe778/WExuosWKh0m6eqwHRaJGyDneAadZ9AHSLOkTXh/5pBn0JO6tVcl7znQK5jEwlNn4D1+nkFPTOye1bznQc9wDirOInE59KgLAT8Eagu63dr+1k3k2WbBT+t4zdpmlG4r6R8lvVvSvwoF5q9Zs2fSF2+ln/8IYH8zqb/+w2vW6iQggo6g18ms/Fa9D8gQ9Pw+7mrBew507X+J76fOwHv8CHqJLO9uw3sedEewdQkEPYcedSHgh0BtQbdI7Z3nZ0p6uqTPhRn1cyU9Pryn3Mq8StITJN1O0hcDHpPwvwtCPl8k7mmSZmHW3FaBn3+srdeEFeFtZt5WPjrPHgmW9IBl3Ah6nQRE0BH0OpmV36r3ARmCnt/HXS14z4Gu/S/x/dQZeI8fQS+R5d1teM+D7ggQ9BxG1IXAGAgMIehHhlXWz5Z0jKRPh5XbF99ZfkEQdJsh/0IA94dBrm8l6caSrgqLwz1fkq0Ov/yxW+mfERaE+5akN0h6tqTvIujDpCKCjqAPk2n9t+J9QIag9+/TvjW850DfeFLKT52B9/gR9JSs7l/Hex70j+iGGsyg59CjLgT8EBhC0P1EG/aEGfQ6XYKgI+h1Miu/Ve8DMgQ9v4+7WvCeA137X+L7qTPwHj+CXiLLu9vwngfdEWxdAkHPoUddCPghgKCHvpjNZrLVL4f+tHRBRtAR9KGPn9jteR+QIeixPZleznsOpEcWX3PqDLzH39J4wLIyZUwQn83pJb3nQXpkEoKeQ4+6EPBDAEFH0ItlY8rFmAFJMfzbNtTygCSGoPf4EfSYXswr4z0H8qKLqz11Bt7j53oYl8e5pbznQU58CHoOPepCwA8BBB1BL5aNCDozBsWSqXBD3gdkCHrhDt+kOe85UJ+ANHUG3uNH0Ic4Cto+DhD0YXKIrUCgNgEEHUEvlmMIOoJeLJkKN+R9YI6gF+5wBH1ToN6Pg9pZ4D1+BL12Bhxo33se5FBA0HPoURcCfggg6Ah6sWxE0BH0YslUuCHvAzIEvXCHI+gI+ghzAEGvfx5A0IdhzFYgAIE8Agg6gp6XQQu1EXQEvVgyFW4IQd9/KNGVFR19yomFSR9o7uO/XKfdnJ31ngM5scXWnToD7/Ej6LGZnFfOex7kRMcMeg496kLADwEEHUEvlo0IOoJeLJkKN+R9QMYMeuEO36Q57zlQn0Dbt/bG8POeAwh6TC/ml/GeBzkRIug59KgLAT8EEHQEvVg2IugIerFkKtyQ9wEZgl64wxH0TYF6Pw5qZ4H3+BH02hlwoH3veZBDAUHPoUddCAmLUUQAACAASURBVPghgKAj6MWyEUFH0IslU+GGvA/IEPTCHY6gI+gjzAEEvf55AEEfhjFbgQAE8ggg6Ah6XgYt1EbQEfRiyVS4IQSdZ9C950DhlEfQEfQhUmrbbaSMCYbY6ZbPBcygD5FBbAMC9Qkg6Ah6sSxLuRgzY1AM/7YNtTwgiSHoPX5m0GN6Ma+M9xzIiy6u9tQZeI+f62FcHueW8p4HOfEh6Dn0qAsBPwQQdAS9WDYi6MygF0umwg15H5Ah6IU7fISzp/UJtP3sbQw/7+cBBD2mF/PLeM+DnAgR9Bx61IWAHwIIOoJeLBsRdAS9WDIVbsj7gAxBL9zhCPqmQL0fB7WzwHv8CHrtDDjQvvc8yKGAoOfQoy4E/BBA0BH0YtmIoCPoxZKpcEPeB2QIeuEOR9AR9BHmAIJe/zyAoA/DmK1AAAJ5BBB0BD0vgxZqI+gIerFkKtwQgs4icd5zoHDKI+gI+hApte02UsYEQ+x0y+cCZtCHyCC2AYH6BBB0BL1YlqVcjJkxKIZ/24ZaHpDEEPQePzPoMb2YV8Z7DuRFF1d76gy8x8/1MC6Pc0t5z4Oc+BD0HHrUhYAfAgg6gl4sGxF0ZtCLJVPhhrwPyBD0wh0+wtnT+gTafvY2hp/38wCCHtOL+WW850FOhAh6Dj3qQsAPAQQdQS+WjQg6gl4smQo35H1AhqAX7nAEfVOg3o+D2lngPX4EvXYGHGjfex7kUEDQc+hRFwJ+CCDoCHqxbETQEfRiyVS4Ie8DMgS9cIcj6Aj6CHMAQa9/HkDQh2HMViAAgTwCCDqCnpdBC7URdAS9WDIVbghBZ5E47zlQOOURdAR9iJTadhspY4IhdrrlcwEz6ENkENuAQH0CCDqCXizLUi7GzBgUw79tQy0PSGIIeo+fGfSYXswr4z0H8qKLqz11Bt7j53oYl8e5pbznQU58CHoOPepCwA8BBB1BL5aNCDoz6MWSqXBD3gdkCHrhDh/h7Gl9Am0/exvDz/t5AEGP6cX8Mt7zICdCBD2HHnUh4IcAgo6gF8tGBB1BL5ZMhRvyPiBD0At3OIK+KVDvx0HtLPAeP4JeOwMOtO89D3IoIOg59KgLAT8EEHQEvVg2IugIerFkKtyQ9wEZgl64wxF0BH2EOYCg1z8PIOjDMGYrEIBAHgEEHUHPy6CF2gg6gl4smQo3hKCzSJz3HCic8gg6gj5ESm27jZQxwRA73fK5gBn0ITKIbUCgPgEEHUEvlmUpF2NmDIrh37ahlgckMQS9x88Mekwv5pXxngN50cXVnjoD7/FzPYzL49xS3vMgJz4EPYcedSHghwCCjqAXy0YEnRn0YslUuCHvAzIEvXCHj3D2tD6Btp+9jeHn/TyAoMf0Yn4Z73mQEyGCnkOPuhDwQwBBR9CLZSOCjqAXS6bCDXkfkCHohTscQd8UqPfjoHYWeI8fQa+dAQfa954HORQQ9Bx61IWAHwJDCPqRkl4g6WxJx0j6tKSXSLqwA8PDJT1S0lmSbiHpG5LeL+l5kq5Yqvs+SffZpL13SHrQ8t/X19eP3djYuGrx77PZTKurq4P3TEsXZAQdQR/8AIrcoPcBGYIe2ZEZxbznQEZo0VWnzsB7/C2NBywpU8YE0cmcUdB7HmSEJgQ9hx51IeCHwBCC/s4g2c+Q9FlJj5X0REmPk/S6bVB8WNLXJf1PSXsk3UrSs8K/d5d0+UJdE3T73tpc/Hw7/CBw0B8R9DoJmHIxZkBSpy+WW215QBJD0Hv8CHpML+aV8Z4DedHF1Z46A+/xcz2My+PcUt7zICc+BD2HHnUh4IdAbUF/iKS3BCl//ULYJu2nSjpe0sYWOHZLOmiWW9LNJX1B0l8EyZ9XNUG/qaQ7xaBF0GMo9S+DoDNj0D9rhqnhfUCGoNfPA+85UJ9A27f2xvDzngMIekwv5pfxngc5ESLoOfSoCwE/BGoL+vmSHi3paEnXLoT9mDB7fi9JH+iJw2bT7Rb3By7UQ9B7QqxRHEFH0GvkVYk2vQ/IEPQSvbx9G95zoD4BBN17DiDoQxwFbR8HCPowOcRWIFCbQG1B/6CkNUl3XQrEZs8/IenJkl7RI8gTgpz/saT/uCTod5P0A0lHSfpieMbdnn23vx30YQa9B/EeRRF0BL1Hugxa1PvAHEGvnw7ec6A+gbbFJIaf9xxA0GN6Mb+M9zzIiRBBz6FHXQj4IVBb0O2Zc5vxXl6o7WaSvhqeKX9xJI7DJL1L0l3CrexfWqhnIv6V8Lz5jSU9WNJTwuz8fSXtW9zGZoJ+5ZVXXre4xtCfM844Y+hNVtvepZde2rvtluK34FMY9IaWUGHv3r3X19q1a1dCC+Ou4j3+c/7x8GqAr/7kFfbL0aHtr6zo6FNOrLLdC077fpV2cxr1ngM5scXWnToD7/FzPYzN5Lxy3vMgJzpb7Pj44+3p0Rs+a2tru2ez2Tdz2qUuBCAwLIEhBP3zQZgXI5sL+jPDiu5dUdt+XhAWgXuEpL/pqiDpqZJ+X5KtBv/Xi+U3E/Q9e/ZoY2Orx+EjtpZY5KyzbJH6Nj6XXHJJ70Bait+CT2HQGxoVmiNw7qduUi2mnRD080/+TrV4aBgCrRLgethqzw4X19ramk44wW42RdCHo86WIFCeQG1BL3GLu+3jKyWdI+kJkv4yEsNxYRX48yQ9vUvQmUGPpLpNsZTZY2YM8rnHtNDyjEEL8TODHtOLeWWmfgwYvakz8B4/18O8Yzy2tvc8iI1js3LMoOfQoy4E/BCoLej2fLktCLe8SJwtHGerunctEjeX81+R9GuS/rwHurmg2zvXbab++g/PoPeg2KMoz6DzDHqPdBm0qPdnDnkGvX46eM+B+gR4Bt17DvAM+hBHQdvHAc+gD5NDbAUCtQnUFnR7FvytYSX3ixaCeZuk0zpes2b7ZqvA/2pYTM7+d5/P0yS9VNIvLd8Sj6D3wRhfFkFH0OOzZdiS3gfmCHr9fPCeA/UJtC0mMfy85wCCHtOL+WW850FOhAh6Dj3qQsAPgdqCbpHaO8/PDLeZfy7MqJ8r6fGSXhtQvCrcvn67sAK7/fm/SfotSa8Oor5I7YeSPh7+cG9Jzw7PmduCdDcKz7w/SdLFku4fs0jcbDaT3Ro09KelCzKCjqAPffzEbs/7gAxBj+3J9HLecyA9sviaU2fgPf6WxgOWlSljgvhsTi/pPQ/SI9N1ix2vr68f1ASLxOUQpS4EdobAEIJ+pKQXSjpb0jFhpXVbuf3ChZBtATh7vvy2kr4Q/m7/3noLLPYatduE724vyV67drqkm9o1IbyKzdr/A0km8wd9mEGvk2wpF2MGJHX6YrnVlgckMQS9xz91Qa8Zf0x+lC7z8V+uszp+7n56Pw5y4+uq7z1+roddPVjme+95kBMlgp5Dj7oQ8ENgCEH3E23YEwS9Tpcg6MwY1Mms/Fa9D8hqCupOrOLeV1Brxp+fPf1b6Bt//y2k1fB+HKRFFV/Le/wIenxf5pT0ngc5sSHoOfSoCwE/BBD00Bfc4p6flAg6gp6fRXVa8D4gqymoCHqdnNquVQR9eOYxW/R+HkDQY3oxv4z3PMiJEEHPoUddCPghgKAj6MWyEUFH0IslU+GGvA/IEPQrCvf4zjaHoO8s/6227v08gKAPkzfe8yCHAoKeQ4+6EPBDAEFH0ItlI4KOoBdLpsINeR+QIegIeuGU37Q578dBbQbe40fQa2fAgfa950EOBQQ9hx51IeCHAIKOoBfLRgQdQS+WTIUb8j4gQ9AR9MIpj6BvQsD7eQBBH+IoQNCHocxWIACBHAIIOoKekz8H1UXQEfRiyVS4Ie8DcwQdQS+c8gg6gj5ESm27jZQxwRA77f16kMOAGfQcetSFgB8CCDqCXiwbUy7GzBgUw79tQy0PSGIIeo8fQUfQY/I4t4z34yA3vq763uPnetjVg2W+954HOVEi6Dn0qAsBPwQQdAS9WDYi6MygF0umwg15H5Ah6Ah64ZRnBp0Z9CFSihn0Had88A4g6M46hN2BQCIBBB1BT0ydQ6sh6Ah6sWQq3BCCvv9QoisrOvqUEwuTPtBc31XMa/5AUSXAjkb7xj/UPno/Dmpz8B4/M+i1M+BA+97zIIcCgp5Dj7oQ8EMAQUfQi2Ujgo6gF0umwg15H5DVFFTeg144mSKaQ9AjIO1AEe/nAQR9mKTwngc5FBD0HHrUhYAfAgg6gl4sGxF0BL1YMhVuyPuADEHnFvfCKb9pc96Pg9oMvMePoNfOAGbQhyHMViAAgVwCCDqCnptD19dH0BH0lGSqKacp+5NbJ2X2tCYDZtBze7R//ZQc6L+V/jW8C2r/iPrV8B4/gt6vP1NLe8+D1LisHjPoOfSoCwE/BBB0BL1YNiLoCHpKMtWU05T9ya2TImc1GSDouT3av35KDvTfSv8aLYtJDA3v8SPoMb2YX8Z7HuREiKDn0KMuBPwQQNAR9GLZiKAj6CnJVFNOU/Ynt06KnNVkgKDn9mj/+ik50H8r/Wu0LCYxNLzHj6DH9GJ+Ge95kBMhgp5Dj7oQ8EMAQUfQi2Ujgo6gpyRTTTlN2Z/cOilyVpMBgp7bo/3rp+RA/630r9GymMTQ8B4/gh7Ti/llvOdBToQIeg496kLADwEEHUEvlo0IOoKekkw15TRlf3LrpMhZTQYIem6P9q+fkgP9t9K/RstiEkPDe/wIekwv5pfxngc5ESLoOfSoCwE/BBB0BL1YNiLoCHpKMtWU05T9ya2TImc1GSDouT3av35KDvTfSv8aLYtJDA3v8SPoMb2YX8Z7HuREiKDn0KMuBPwQQNAR9GLZiKAj6CnJVFNOU/Ynt06KnNVkgKDn9mj/+ik50H8r/Wu0LCYxNLzHj6DH9GJ+Ge95kBMhgp5Dj7oQ8EMAQUfQi2Ujgo6gpyRTTTlN2Z/cOilyVpMBgp7bo/3rp+RA/630r9GymMTQ8B4/gh7Ti/llvOdBToQIeg496kLADwEEHUEvlo0IOoKekkw15TRlf3LrpMhZTQYIem6P9q+fkgP9t9K/RstiEkPDe/wIekwv5pfxngc5ESLoOfSoCwE/BBB0BL1YNiLoCHpKMtWU05T9ya2TImc1GSDouT3av35KDvTfSv8aLYtJDA3v8SPoMb2YX8Z7HuREiKDn0KMuBPwQQNAR9GLZiKAj6CnJVFNOU/Ynt06KnNVkgKDn9mj/+ik50H8r/Wu0LCYxNLzHj6DH9GJ+Ge95kBMhgp5Dj7oQ8EMAQUfQi2Ujgo6gpyRTTTlN2Z/cOilyVpMBgp7bo/3rp+RA/630r9GymMTQ8B4/gh7Ti/llvOdBToQIeg496kLADwEEHUEvlo0IOoKekkw15TRlf3LrpMhZTQYIem6P9q+fkgP9t9K/RstiEkPDe/wIekwv5pfxngc5ESLoOfSoCwE/BBB0BL1YNiLoCHpKMtWU05T9ya2TImc1GSDouT3av35KDvTfSv8aLYtJDA3v8SPoMb2YX8Z7HuREiKDn0KMuBPwQQNAR9GLZiKAj6CnJVFNOU/Ynt06KnNVkgKDn9mj/+ik50H8r/Wu0LCYxNLzHj6DH9GJ+Ge95kBMhgp5Dj7oQ8EMAQUfQi2Ujgo6gpyRTTTlN2Z/cOilyVpMBgp7bo/3rp+RA/630r9GymMTQ8B4/gh7Ti/llvOdBToQIeg496kLADwEEHUEvlo0IOoKekkw15TRlf3LrpMhZTQYIem6P9q+fkgP9t9K/RstiEkPDe/wIekwv5pfxngc5ESLoOfSoCwE/BIYQ9CMlvUDS2ZKOkfRpSS+RdGEEht2SzpP0MEmHS7pM0nMkvWeTuveT9HxJp0v6vqQ3S3qapKuWy66vrx+7sbFx0N9ns5lWV1cjdqlskZYuyAg6gp5ydNSU05T9ya2TImc1GSDouT3av35KDvTfSv8aLYtJDA3v8bc0HrD+SBkTxPRjbhnveZATH4KeQ4+6EPBDYAhBf6eksyQ9Q9JnJT1W0hMlPU7S67ZB8eOSPirpJ0JdE+rflPRQSSbjFy/UvY+kd0t6i6SXSTKxf6mkqyWdKemHi9tB0OskYMrFmAFJnb5YbtXzgKSmnA5D9+CtpMhZTQYI+vBZkJIDQ+yl5/MA8UtcD4fIAqnl4wBBHyaH2AoEahOoLegPCdJsUv76hWBM2k+VdLykjS2C/I0g2/eU9MFQ5rAwi/5dSXdbqPcRSUeE2fNrw9+t3vslWTsvR9Brp1Lar+UMSOr3i23B84CkppwOQxdBX+bcV1DJAQkG9Y9Wz+dBi57rYf0c8H49zCWAoOcSpD4EfBCoLejnS3q0pKMlzcXZIn9MmD2/l6QPbIHiXZJuJemkpe+fKelFkm4p6SuSbiHpy5Ls73br/OLnM5K+KOkBS4K+e2Nj4xuLfzviiCN25Bb33bttsr+Nz1VXHfI0QWdgLcVvwaYw6IRUoMDll1+ua6+9VocddphOPdV+G/Pz+dk37vGzMwX25L2PPKF3KzUZfOcze+zXs0P3aWVFN7lj/32NCa4vg5rxx+xv6TJ947ftw6B0LxzanufzoO0t18P6OWBb8J4HORRM0L/3ve8d1MTa2tpxs9ms/wAtZ0eoCwEIZBGoLeg2870m6a5Le2mG8AlJT5b0ii0i+Jqkvw/Pri8WsVvc7fnyB0qymXj79+3h1ve3LrX1Rkn2I8DNF/9+zTXXnLRv375PZZGjMgQgAAEIQAACEIAABBwTWF1dPfmoo46y9Z/4QAACIyFQW9DtmXObHnvQEo+bSfqqpGdJevEWrH4k6dWSnrL0/T3CrPv8tnn797WS7O8fWir7Z5LOkWTPs1//QdBHkp3sJgQgAAEIQAACEIBAMgEEPRkdFSGwYwSGEPTPS3rwFoK+2W3p86Im6K+S9OtbCLrdJm8rwc8F/e6SPryJoD9B0o0Q9B3LMTYMAQhAAAIQgAAEILADBBD0HYDOJiGQSaC2oHOLe2YHUR0CEIAABCAAAQhAAAIpBBD0FGrUgcDOEqgt6PZ8uc10Ly8SZwvH2aru2y0SZ8+X2yJxJy8hste12W3xtjic3SY/XyTO/m6vVlv82DM3Vy4vErd///619fX1ExcLrqysfMte27mz3cHWIQABCEAAAhCAAAQgkERgZf/+/ccs1pzNZlesrKxs9cakpI1QCQIQqEugtqDbre22cJsJ+UULobxN0mkdr1mzW9v/RNLirev2mrVLJdlr1uzv84/d2n64pDMWXttm39sMvrXzp3Ux0joEIAABCEAAAhCAAAQgAAEIQCCPQG1Bt72zmfAzJT1d0ufCjPq5kh4fFnezMvasuT0rfrvwWjT7my3s9jFJR0my2XF7RYS90/znJd1P0sULof+MJHst298Gqbd3l9kr174Ttv3DPEzUhgAEIAABCEAAAhCAAAQgAAEI1CUwhKAfKemF4XVpdtuN3XZut6jbAm/zzwVB0G8r6QsLfz9O0nmSHhZmyG32/LmS3r0JlvtL+r0wi/798Cq23w5iX5eiz9aN+wuWuNuPFovcfe55ub2ahXyxOyvuLOmmkn5X0vPKbcJ1Sz8bfgi7Z3hc5NuSPhqOE/vxq/WP9bude35K0rGSfiDpM5JeJukvWw9+i/ieKOl8SfaiXDtHtP6xH2//1xZBbvbmj5Z5/HR4c4rFbQunflnSX0h6fstBS5qPL7YKcyp5YNfA/xxee/sT4fG/10n6fUk2Zmr9Y6/7tVy366GNfS+R9BxJ7289cOKDAATGR2AIQR8flTb22O5cOCvcfWCvu7PV7m1w/jhJdlGewuc24ZGIyyQZA4t/SoL+Rkn/QpL9+8kgqU8Nd5U8UNJ7G08CkzN7vOYfJH1F0hEh/+1v9kOf/YA1pY+t13F5kPObTEzQ7ZWey6L+ifC41BRywM7/r5H0hnD+t8fE7I61m4cf7FpmYHHaD3TLH7vjzu6uu/XCo3Gtcjgl3JFoP1C+SNL/lfQvg6C+RdIvthp4iMvGQn8v6SOS/ksQ9KeFH+7vGx6HbBwB4UEAAmMigKCPqbfi9/UhkuyiO39X/LymSfupHc/+x2/Ff8l5ftvifzZ7/s2JCbo96mGPhix+bNbUHjUxObFHRab4+VAQk+MnFrwJiR0LtiDmv56YoD9S0v+YWH/Pw7UfZkzMbLbcHhPjI91H0vvCj3T2Y13rH/sx8tmSbi/JXn07//yZpCdJsrsbr24YwtvD3ZUnLNwtYHfY7Qk/3tuCxXwgAAEIuCGAoLvpiqI7Yrew2izh8ur5tqK+zZ5vt3p+0R1x1NgUBX0r/DZzboP2OzrqnyF35c2SbEbJBmtT+diaH7bopsVtg3UEfSo9f+C2Znusx+4o+uJ0wt42Uvuxwo4Jm13/PxNgMs8Bu5PAZs/nH3vzzX8Ka/3YYy+tftbDpIWNixY/fyXp4eEH26+1GjxxQQAC4yOAoI+vz2L2OOf98zHtj7EMgn6g1+zWZhukm6TbwGQKn1VJ9p/9YGUzqX8s6bck2ezRFD52J4U94vA7QdLtmdypCbrdSWKPe9iztnZ+tGdR7dGHKXzeE2YP7Y4qE7I7hbso3iTJbvO9ZgoQFmK0c6DJmD17bGvXTOFjP858PKzfYwv22t1kdheBrcVhP1b828Yh2KMMtv6OLUa8+LEJC5u4sEe+7A5DPhCAAARcEEDQXXRD8Z2w563t1q0HLbV8s/DueHse0xbqm9IHQT/Q2zYge1R4TeEUFoqzmO01i08Oyf4jSf9e0ssnlPx2a7cd+7ZImN3iPiVBt4WxbFButzP/c7jF1xYPvYOkh0p6xwTywBZmtees94bzvv1AYc/k2noc/1vSvUNeTADFdSE+JRz/JmZTWjT1JEl/Lcn+nX/+azgf2nmh5Y/9OGGv4j1Z0r4QqL221x79sDuplh8HbJkFsUEAAiMggKCPoJMSdtEE3Z4zs/fQL37mgv7M8Bq6hKZHWwVBPzBraKvW/htJ/320Pdl/x+1Zc5tFtv/sNY32zKXNItnqxa1/HhEeazFRtVl0+0xJ0DfrX1vB+p/CLPLprSdAeMb2REnL5/1/J+mPwizyZm9GaRWNrd5tb4yxx3ym8gpWm0G3V9F+Q9Ifhhn0u4Xrgf2A92utdnaI61fD63zth1l7s4fdUWW3/Z8jaS08EnhR4wwIDwIQGBEBBH1EndVjV7nF/VBYUxf0+TOItlCQreI75Y8N0mxFf1vB2m71bPUzXxDQ7ppYXLHenkX/BUm3DLOqLT97ulXfWg7YTKrNqtnr91r+2PXg7pLuEm5znsdqdxHYDKL9WGWvM53C5zRJ9lYPe8zF7qSZysfuFLDVym22ePF4/xVJr5Zkb7y4uHEYluf2A/X89ZJ2XPxdyH+7i2Qqj7w03s2EB4E2CCDobfTjchSvCM9VLS8SZwukvJ5F4ibzHvR5Xszl3BaKsttap/6ZD0pNWj7cMAybNetaAOtvJP1Swwy2Cm3+2MONJf2/xuOfr9S9LOi2SKTd/m63/E/hbhLrZhNze976p8KbLBrv+uvDs3625+5N0hc/th6B3U1ia3K8bAIwflyS3U1ii8bZWix2bNirZ23xvNZ/qJtA9xIiBNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIcAgt5OXxIJBCAAAQhAAAIQgAAEIAABCIyYAII+4s5j1yEAAQhAAAIQgAAEIAABCECgHQIIejt9SSQQgAAEIAABCEAAAhCAAAQgMGICCPqIO49dhwAEIAABCEAAAhCAAAQgAIF2CCDo7fQlkUAAAhCAAAQgAAEIQAACEIDAiAkg6CPuPHYdAhCAAAQgAAEIQAACEIAABNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIcAgt5OXxIJBCAAAQhAAAIQgAAEIAABCIyYAII+4s5j1yEAAQhAAAIQgAAEIAABCECgHQIIejt9SSQQgAAEIAABCEAAAhCAAAQgMGICCPqIO49dhwAEIAABCEAAAhCAAAQgAIF2CCDo7fQlkUAAAhCAAAQgAAEIQAACEIDAiAkg6CPuPHYdAhCAAAQgAAEIQAACEIAABNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIcAgt5OXxIJBCAAAQhAAAIQgAAEIAABCIyYAII+4s5j1yEAAQhAAAIQgAAEIAABCECgHQIIejt9SSQQgAAEIAABCEAAAhCAAAQgMGICCPqIO49dhwAEIAABCEAAAhCAAAQgAIF2CCDo7fQlkUAAAhCAAAQgAAEIQAACEIDAiAkg6CPuPHYdAhCAAAQgAAEIQAACEIAABNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIcAgt5OXxIJBCAAAQhAAAIQgAAEIAABCIyYAII+4s5j1yEAAQhAAAIQgAAEIAABCECgHQIIejt9SSQQgAAEIAABCEAAAhCAAAQgMGICCPqIO49dhwAEIAABCEAAAhCAAAQgAIF2CCDo7fQlkUAAAhCAAAQgAAEIQAACEIDAiAkg6CPuPHYdAhCAAAQgAAEIQAACEIAABNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIcAgt5OXxIJBCAAAQhAAAIQgAAEIAABCIyYAII+4s5j1yEAAQhAAAIQgAAEIAABCECgHQIIejt9SSQQgAAEIAABCEAAAhCAAAQgMGICCPqIO49dhwAEIAABCEAAAhCAAAQgAIF2CCDo7fQlkUAAAhCAAAQgAAEIQAACEIDAiAkg6CPuPHYdAhCAAAQgAAEIQAACEIAABNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIcAgt5OXxIJBCAAAQhAh6EVOwAAAMNJREFUAAIQgAAEIAABCIyYAII+4s5j1yEAAQhAAAIQgAAEIAABCECgHQIIejt9SSQQgAAEIAABCEAAAhCAAAQgMGICCPqIO49dhwAEIAABCEAAAhCAAAQgAIF2CCDo7fQlkUAAAhCAAAQgAAEIQAACEIDAiAkg6CPuPHYdAhCAAAQgAAEIQAACEIAABNohgKC305dEAgEIQAACEIAABCAAAQhAAAIjJoCgj7jz2HUIQAACEIAABCAAAQhAAAIQaIfA/weMNiyAI7XTjAAAAABJRU5ErkJggg==\" width=\"800\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Final posterior: [0.    0.    0.009 0.144 0.605 0.215 0.026 0.001 0.    0.   ]\n"
     ]
    }
   ],
   "source": [
    "def discrete_bayes_sim(pos, kernel, zs, z_prob_correct, sleep=0.25):\n",
    "    %matplotlib notebook\n",
    "    N = len(hallway)\n",
    "    fig = plt.figure()\n",
    "    for i, z in enumerate(zs):\n",
    "        plt.cla()\n",
    "        prior = predict(pos, 1, kernel)\n",
    "        book_plots.bar_plot(hallway, c='k')\n",
    "        book_plots.bar_plot(prior, ylim=(0,1.0), c='#ff8015')\n",
    "        plt.axvline(i % N, lw=5)\n",
    "        fig.canvas.draw()\n",
    "        time.sleep(sleep)\n",
    "\n",
    "        plt.cla()\n",
    "        likelihood = lh_hallway(hallway, z=z, z_prob=z_prob_correct)\n",
    "        pos = update(likelihood, prior)\n",
    "        book_plots.bar_plot(hallway, c='k')\n",
    "        book_plots.bar_plot(pos, ylim=(0,1.0))\n",
    "        plt.axvline(i % 10, lw=5)\n",
    "        fig.canvas.draw()\n",
    "        time.sleep(sleep)\n",
    "    plt.show()\n",
    "    %matplotlib inline\n",
    "    set_figsize(y=2)\n",
    "    print('Final posterior:', pos)\n",
    "     \n",
    "# change these numbers to alter the simulation\n",
    "kernel = (.1, .8, .1)\n",
    "z_prob = 1.0\n",
    "\n",
    "# list of perfect measurements\n",
    "hallway = np.array([1, 1, 0, 0, 0, 0, 0, 0, 1, 0])\n",
    "measurements = [hallway[i % len(hallway)] for i in range(25)]\n",
    "pos = np.array([.1]*10)\n",
    "\n",
    "discrete_bayes_sim(pos, kernel, measurements, z_prob);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Effect of Bad Sensor Data\n",
    "\n",
    "You may be suspicious of the results above because I always passed correct sensor data into the functions. However, we are claiming that this code implements a *filter* - it should filter out bad sensor measurements. Does it do that?\n",
    "\n",
    "To make this easy to program and visualize I will change the layout of the hallway to mostly alternating doors and hallways, and run the algorithm on 15 correct measurements:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            if (mpl.ratio != 1) {\n",
       "                fig.send_message(\"set_dpi_ratio\", {'dpi_ratio': mpl.ratio});\n",
       "            }\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        fig.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var backingStore = this.context.backingStorePixelRatio ||\n",
       "\tthis.context.webkitBackingStorePixelRatio ||\n",
       "\tthis.context.mozBackingStorePixelRatio ||\n",
       "\tthis.context.msBackingStorePixelRatio ||\n",
       "\tthis.context.oBackingStorePixelRatio ||\n",
       "\tthis.context.backingStorePixelRatio || 1;\n",
       "\n",
       "    mpl.ratio = (window.devicePixelRatio || 1) / backingStore;\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width * mpl.ratio);\n",
       "        canvas.attr('height', height * mpl.ratio);\n",
       "        canvas.attr('style', 'width: ' + width + 'px; height: ' + height + 'px;');\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'] / mpl.ratio;\n",
       "    var y0 = (fig.canvas.height - msg['y0']) / mpl.ratio;\n",
       "    var x1 = msg['x1'] / mpl.ratio;\n",
       "    var y1 = (fig.canvas.height - msg['y1']) / mpl.ratio;\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x * mpl.ratio;\n",
       "    var y = canvas_pos.y * mpl.ratio;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    var width = fig.canvas.width/mpl.ratio\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\" width=\"' + width + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var width = this.canvas.width/mpl.ratio\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\" width=\"' + width + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        event.shiftKey = false;\n",
       "        // Send a \"J\" for go to next cell\n",
       "        event.which = 74;\n",
       "        event.keyCode = 74;\n",
       "        manager.command_mode();\n",
       "        manager.handle_keydown(event);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA+gAAAD6CAYAAAAyVW3pAAAgAElEQVR4Xu2dCbRlZXXn/+89KipwUWko4lRqKQqiULoox9jGtLMmMdoiDr3EBIcMPdpBcEibiBPLdGJ3jANqWHEAtNV2RZy1RaOiaFskDghaDeUIdBx4oo3Fe9Vrx+8W913eq3v3ft+559yzf2ctVum9e597vt/53/32/37nfGdBbBCAAAQgAAEIQAACEIAABCAAAQi0TmCh9SPgACAAAQhAAAIQgAAEIAABCEAAAhAQBh0RQAACEIAABCAAAQhAAAIQgAAEOkAAg96Bk8AhQAACEIAABCAAAQhAAAIQgAAEMOhoAAIQgAAEIAABCEAAAhCAAAQg0AECGPQOnAQOAQIQgAAEIAABCEAAAhCAAAQggEFHAxCAAAQgAAEIQAACEIAABCAAgQ4QwKB34CRwCBCAAAQgAAEIQAACEIAABCAAAQw6GoAABCAAAQhAAAIQgAAEIAABCHSAAAa9AyeBQ4AABCAAAQhAAAIQgAAEIAABCGDQ0QAEIAABCEAAAhCAAAQgAAEIQKADBDDoHTgJHAIEIAABCEAAAhCAAAQgAAEIQACDjgYgAAEIQAACEIAABCAAAQhAAAIdIIBB78BJ4BAgAAEIQAACEIAABCAAAQhAAAIYdDQAAQhAAAIQgAAEIAABCEAAAhDoAAEMegdOAocAAQhAAAIQgAAEIAABCEAAAhDAoKMBCEAAAhCAAAQgAAEIQAACEIBABwhg0DtwEjgECEAAAhCAAAQgAAEIQAACEIDALAz6QNKLJe2QdG9JR0j6U0kvmRL/VklnSXqcpIMlXSLpRZI+vk7+wyS9VNIJkn4m6f2STpN09ZSfRRgEIAABCEAAAhCAAAQgAAEIQKAVArMw6HeStKsY68skneow6DeT9EVJt5J0ejHafyjpsZLMjF84Qu0hkj4m6QJJr5Vkxv5Vkn4k6URJ17dCmA+FAAQgAAEIQAACEIAABCAAAQhMQWAWBn34GfvK7Pk1DoP+B8VsP1DS58p4Dipm/6eS7jcyxi9IOqTMnt9QXre8z0iy/bxuCh6EQAACEIAABCAAAQhAAAIQgAAEWiEwC4M+OjC7vN1j0D8q6Q6Sjhmjc4akl0u6vaTvSrqdpO9IstdfORb7DUlXSnrE8PV9+/YtLS8vHz0at7Cw8ENJ9iMCGwQgAAEIQAACEIAABOaNwMK+ffsOHz3owWBw+cLCwsq8DYTjhUBmAl036N+X9GlJJ42dJLvE3e4vf6Skj5R/P1Quff/AWOy7JD1I0m2Hr1977bXHrK6ufj3ziWfsEIAABCAAAQhAAAL9JrC4uHjsYYcddmm/R8noINAvAl036L+Q9BZJzx3D/gBJn5X0VEnnln/fLslev2gs9g2STpFk97P/84ZB75eIGQ0EIAABCEAAAhCAwE0JYNBRBQTmj8A8GPQ3S/r9DQz6UySdN2LQ7y/p8+sY9GdIujkGff4EyhFDAAIQgAAEIAABCMQIYNBj3MiCQJsEum7QucS9TXXw2RCAAAQgAAEIQAACc0sAgz63p44DT0yg6wbd7i+3ReKOHTtH9si1V5TF4b43skicvW6PVhvd7L6bPaOLxC0vL29dWVm5ajTokEMO0eLi4sylsHWrPQ2uH9vVV3fzcfNf/epXdcMNN+iggw7Scccd1znYaKD5U9J1DTRJ4P4v/7j2rqze5CO2LC3qohf8qyY/eup99+k7YIOmFk596tcE9kkHaCCmgVlk9fnvwerqqq677ro1GJeWlo4aDAbdbNBmccL5DAjMIYGuG3S7tP2vJY1eum6PWbPnqttj1uz14WaXth8saYek4WqV9r49ns328/ph4PLy8pErKytritVgMGjFoC8szPoUNKfSffu6uQj+JZdcor1792rLli064YQTmgMQ3DMaCIJzpHVdA46huEPv9sIP6hfrGPRfWVrUZS97tHt/TST06TtgfKiFMZX0SQdoIKaBWWT1+e+BGfTl5eVxg751MBjYE5TYIACBOSEwK3doXaA9o3xQFn2zldXfWRjZqus/k2T3mtu94ncpj0Wzt21hty9JOkySzY6bqbZnmv+mpIdJunCE869Lssey/V0x9TY1bY9c+4mkEyVdj0FvVpU0JDG+NKUxbp6sPjdkkzhg0CcRqv8+tTDGlFoY4+bJylwLh5z6zACD7vk2EAuB7hKYlUG/QtIdN8BwZ0n2/jnFoA///zD8KElnSXpcmSG32fMXS/rYOvt7uKQ/K7PoZvrtUWx/XIz9/nBm0JsRJE1pjCtNaYybJ6vPDdkkDhj0SYTqv08tjDGlFsa4ebIy10IMukcpxEIAAm0SmJVBb3OMN/lsDHozp4OmNMaVpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FGHSPUoiFAATaJIBBL/S5B33zMqQpjTGkKY1x82Rlbkox6B6l1ImlFsY4Ugtj3DxZmWshBt2jFGIhAIE2CWDQMejV9EdTGkNJUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCDLpHKcRCAAJtEsCgY9Cr6Y+mNIaSpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FGHSPUoiFAATaJIBBx6BX0x9NaQwlTWmMmycrc1OKQfcopU4stTDGkVoY4+bJylwLMegepRALAQi0SQCDjkGvpj+a0hhKmtIYN09W5qYUg+5RSp1YamGMI7Uwxs2TlbkWYtA9SiEWAhBokwAGHYNeTX80pTGUNKUxbp6szE0pBt2jlDqx1MIYR2phjJsnK3MtxKB7lEIsBCDQJgEMOga9mv5oSmMoaUpj3DxZmZtSDLpHKXViqYUxjtTCGDdPVuZaiEH3KIVYCECgTQIYdAx6Nf3RlMZQ0pTGuHmyMjelGHSPUurEUgtjHKmFMW6erMy1EIPuUQqxEIBAmwQw6Bj0avqjKY2hpCmNcfNkZW5KMegepdSJpRbGOFILY9w8WZlrIQbdoxRiIQCBNglg0DHo1fRHUxpDSVMa4+bJytyUYtA9SqkTSy2McaQWxrh5sjLXQgy6RynEQgACbRLAoGPQq+mPpjSGkqY0xs2TlbkpxaB7lFInlloY40gtjHHzZGWuhRh0j1KIhQAE2iSAQcegV9MfTWkMJU1pjJsnK3NTikH3KKVOLLUwxpFaGOPmycpcCzHoHqUQCwEItEkAg45Br6Y/mtIYSprSGDdPVuamFIPuUUqdWGphjCO1MMbNk5W5FmLQPUohFgIQaJMABh2DXk1/NKUxlDSlMW6erMxNKQbdo5Q6sdTCGEdqYYybJytzLcSge5RCLAQg0CYBDDoGvZr+aEpjKGlKY9w8WZmbUgy6Ryl1YqmFMY7Uwhg3T1bmWohB9yiFWAhAoE0CGHQMejX90ZTGUNKUxrh5sjI3pRh0j1LqxFILYxyphTFunqzMtRCD7lEKsRCAQJsEMOgY9Gr6oymNoaQpjXHzZGVuSjHoHqXUiaUWxjhSC2PcPFmZayEG3aMUYiEAgTYJYNAx6NX0R1MaQ0lTGuPmycrclGLQPUqpE0stjHGkFsa4ebIy10IMukcpxEIAAm0SwKBj0Kvpj6Y0hpKmNMbNk5W5KcWge5RSJ5ZaGONILYxx82RlroUYdI9SiIUABNokgEHHoFfTH01pDCVNaYybJytzU4pB9yilTiy1MMaRWhjj5snKXAsx6B6lEAsBCLRJAIOOQa+mP5rSGEqa0hg3T1bmphSD7lFKnVhqYYwjtTDGzZOVuRZi0D1KIRYCEGiTAAYdg15NfzSlMZQ0pTFunqzMTSkG3aOUOrHUwhhHamGMmycrcy3EoHuUQiwEINAmAQw6Br2a/mhKYyhpSmPcPFmZm1IMukcpdWKphTGO1MIYN09W5lqIQfcohVgIQKBNAhh0DHo1/dGUxlDSlMa4ebIyN6UYdI9S6sRSC2McqYUxbp6szLUQg+5RCrEQgECbBDDoGPRq+qMpjaGkKY1x82Rlbkox6B6l1ImlFsY4Ugtj3DxZmWshBt2jFGIhAIE2CWDQMejV9EdTGkNJUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCDLpHKcRCAAJtEsCgY9Cr6Y+mNIaSpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FGHSPUoiFAATaJDALg36opDMlnSTpcEmXSnqlpPMmDPyTkh5ygJjbSPpBeX+j2A9LetT4PpaXl49cWVm5evT1wWCgxcXFmZ8LGpLmkXe9IUEDaKBJAhj0Jumuv28Meow5tTDGzZPV9b+HnrFEY/vMYHV1VcvLy2vQLC0tbR0MBtdEeZEHAQjMnsAsDPpHJO2UdLqkyyQ9VdKpkp4m6R0HGPI9JB029v7Bkj4k6UuSHjDynhn0O5R9jqb8uPwgsGY3GPRmhEZTGuNKUxrj5snqc0M2iQMGfRKh+u9TC2NMqYUxbp6szLVwyKnPDDDonm8DsRDoLoGmDfpjJF1QTPm5IxjMtB8naZukFQeeZ0g6pxj8N48Z9CMk3XOafWHQp6Hkj6Ep9TOzDJrSGDdPVp8bskkcMOiTCNV/n1oYY0otjHHzZGWuhRh0j1KIhQAE2iTQtEE/W9LJkm4t6YaRgT6lzJ4/SNJnHQA+Jenekuzy9p9i0B3kZhBKUxqDTFMa4+bJytyUYtA9SqkTSy2McaQWxrh5sjLXQgy6RynEQgACbRJo2qB/TtKSpPuODdJmz78i6TmS3jglgKPLJfJvkvSssRy7xP1+kn5eLou/stzjbve+22trNmbQpyTuDKMpdQIr4TSlMW6erMxNKQbdo5Q6sdTCGEdqYYybJytzLcSge5RCLAQg0CaBpg263XO+e52F2mwG/HuSXiDpFVMCsIXlnl/uPb9oLMeM+HfL/ea3kPRoSc8ts/MPlbQ6Go9Bn5K4M4ym1AkMgx4DFsjK3JRi0AOC2WQKtTAGEIMe4+bJylwLMegepRALAQi0SWAWBv1bxTCPjnNo0M8oK7pPYnCQpG9L+qdp7zOX9DxJr5b0BEnvnWTQ9+zZI1tcY9bbjh07Zv2RjX3erl27Gtv3Zna8d+/e/elbtmzZzK4ayUUDjWBds9Oua6BJAk88/zu6YZ3SdtCi9O4n377Jj5563336DtigqYVTn/o1gX3SARqIaWAWWX3+e2BPI9q2zZZ3unFjFfdZqIrPgEBdAk0b9FqXuP+WpPdJ+o+S/nJKBEeVx7CdVWbe96etN4O+e/durax41qub8igmhO3caQvc92O7+OKL+zGQGY8CDcwYeLKPO/k9V21o0M97gpXJ9rc+fQeMJrUwpqk+6QANxDRA1uYILC0tafv27Rj0zWEkGwKtE2jaoNv95bYg3PgicbZwnK3qPu0icWbO7Xnmty2z6NOAGxp0uzTeZuoPaNCZQZ8G6YFjmDGIMWTWKMbNk9XnGZNJHJhBn0So/vvUwhhTamGMmycrcy0ccuozA2bQPd8GYiHQXQJNG3S7F/wDZSX380cwfFDS8VM+Zu1Xy+Xt75H0ZAfK0yS9StLjy+z7AQ36YDCQFbZZb9xz1zzxrt9zhwbQQJMEuAe9Sbrr75t70GPMqYUxbp6srv899IwlGttnBjwHPaoK8iDQLQJNG3QbrT3z/MRymfk3y4y6rcL+dElvLzjsmeb2jPO7SLIV2Ec3WxjOZsEfIemj6+B7sKQXlvvMbUG6m5d73p8t6UJJD2eRuNmIjqY0xpmmNMbNk9XnhmwSBwz6JEL136cWxphSC2PcPFmZa+GQU58ZYNA93wZiIdBdArMw6IdKepmkkyQdXlZat5XbzxvBck4x6HeWdMUYrm9I+hVJdlPNvnVQ3lXSaySdIOmIEnN52f+fS7p+PIdV3JsRJE1pjCtNaYybJ6vPDdkkDhj0SYTqv08tjDGlFsa4ebIy10IMukcpxEIAAm0SmIVBb3N86342Br2ZU0JTGuNKUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCDLpHKcRCAAJtEsCgF/rcg755GdKUxhjSlMa4ebIyN6UYdI9S6sRSC2McqYUxbp6szLUQg+5RCrEQgECbBDDoGPRq+qMpjaGkKY1x82Rlbkox6B6l1ImlFsY4Ugtj3DxZmWshBt2jFGIhAIE2CWDQMejV9EdTGkNJUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCDLpHKcRCAAJtEsCgY9Cr6Y+mNIaSpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FGHSPUoiFAATaJIBBx6BX0x9NaQwlTWmMmycrc1OKQfcopU4stTDGkVoY4+bJylwLMegepRALAQi0SQCDjkGvpj+a0hhKmtIYN09W5qYUg+5RSp1YamGMI7Uwxs2TlbkWYtA9SiEWAhBokwAGHYNeTX80pTGUNKUxbp6szE0pBt2jlDqx1MIYR2phjJsnK3MtxKB7lEIsBCDQJgEMOga9mv5oSmMoaUpj3DxZmZtSDLpHKXViqYUxjtTCGDdPVuZaiEH3KIVYCECgTQIYdAx6Nf3RlMZQ0pTGuHmyMjelGHSPUurEUgtjHKmFMW6erMy1EIPuUQqxEIBAmwQw6Bj0avqjKY2hpCmNcfNkZW5KMegepdSJpRbGOFILY9w8WZlrIQbdoxRiIQCBNglg0DHo1fRHUxpDSVMa4+bJytyUYtA9SqkTSy2McaQWxrh5sjLXQgy6RynEQgACbRLAoGPQq+mPpjSGkqY0xs2TlbkpxaB7lFInlloY40gtjHHzZGWuhRh0j1KIhQAE2iSAQcegV9MfTWkMJU1pjJsnK3NTikH3KKVOLLUwxpFaGOPmycpcCzHoHqUQCwEItEkAg45Br6Y/mtIYSprSGDdPVuamFIPuUUqdWGphjCO1MMbNk5W5FmLQPUohFgIQaJMABh2DXk1/NKUxlDSlMW6erMxNKQbdo5Q6sdTCGEdqYYybJytzLcSge5RCLAQg0CYBDDoGvZr+aEpjKGlKY9w8WZmbUgy6Ryl1YqmFMY7Uwhg3T1bmWohB9yiFWAhAoE0CGHQMejX90ZTGUNKUxrh5sjI3pRh0j1LqxFILYxyphTFunqzMtRCD7lEKsRCAQJsEMOgY9Gr6oymNoaQpjXHzZGVuSjHoHqXUiaUWxjhSC2PcPFmZayEG3aMUYiEAgTYJYNAx6NX0R1MaQ0lTGuPmycrclGLQPUqpE0stjHGkFsa4ebIy10IMukcpxEIAAm0SwKBj0Kvpj6Y0hpKmNMbNk5W5KcWge5RSJ5ZaGONILYxx82RlroUYdI9SiIUABNokgEHHoFfTH01pDCVNaYybJytzU4pB9yilTiy1MMaRWhjj5snKXAsx6B6lEAsBCLRJAIOOQa+mP5rSGEqa0hg3T1bmphSD7lFKnVhqYYwjtTDGzZOVuRZi0D1KIRYCEGiTAAYdg15NfzSlMZQ0pTFunqzMTSkG3aOUOrHUwhhHamGMmycrcy3EoHuUQiwEINAmAQw6Br2a/mhKYyhpSmPcPFmZm1IMukcpdWKphTGO1MIYN09W5lqIQfcohVgIQKBNAhh0DHo1/dGUxlDSlMa4ebIyN6UYdI9S6sRSC2McqYUxbp6szLUQg+5RCrEQgECbBDDoGPRq+qMpjaGkKY1x82Rlbkox6B6l1ImlFsY4Ugtj3DxZmWshBt2jFGIhAIE2CWDQMejV9EdTGkNJUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCDLpHKcRCAAJtEsCgY9Cr6Y+mNIaSpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FGHSPUoiFAATaJDALg36opDMlnSTpcEmXSnqlpPMmDPwUSX+zQcxtJP1g7L2TJZ0u6RhJP5T0TkkvkvTT8X0sLy8fubKycvXo64PBQIuLizM/FzQkzSPvekOCBtBAkwQw6E3SXX/fGPQYc2phjJsnq+t/Dz1jicb2mcHq6qqWl5fXoFlaWto6GAyuifIiDwIQmD2BWRj0j0jaWczzZZKeKulUSU+T9I4DDHlo0J9ZTP1o6Jck7R15wfb1NklvKvu8m6RXSfqCpEdg0GcjLJrSGGea0hg3T1afG7JJHDDokwjVf59aGGNKLYxx82RlroVDTn1mgEH3fBuIhUB3CTRt0B8j6YJiys8dwWCm/ThJ2yStbIBnaNDN3H/xAAiXJH1b0j9KeuRInP0Q8HZJdgwfHM1nBr0ZQdKUxrjSlMa4ebL63JBN4oBBn0So/vvUwhhTamGMmycrcy3EoHuUQiwEINAmgaYN+tmS7NLzW0u6YWSgTykz3Q+S9NlNGnTbx99Lsn2OXja/pVzqbj8MPBuD3rzMaEpjjGlKY9w8WZmbUgy6Ryl1YqmFMY7Uwhg3T1bmWohB9yiFWAhAoE0CTRv0z0myGe77jg3SZs+/Iuk5kt44waBfJelIST+R9ElJf1Jyh2m2j9eXGfmvje3r4nIp/AMx6M3LjKY0xpimNMbNk5W5KcWge5RSJ5ZaGONILYxx82RlroUYdI9SiIUABNok0LRBt3vOd0t61NggbZG370l6gaRXbADAcn5N0kWSrpV0r3Ifu83G26z5JSXP9vEySestHPdhSXeSdPdJBn3Pnj2ye3dmve3YsWPWH9nY5+3atauxfW9mx3v33rhcwZYtdmFFtzY00Pz56LoGmiTwxPO/oxvWKW0HLUrvfvLtm/zoqffdp++ADZpaOPWpXxPYJx2ggZgGZpHV578Httjxtm129+iNG4vEzUJVfAYE6hKYhUH/lqRHb2DQzygruk87KjPbdq/5JyT99phB/1VJNts+uplBv2NZ2X3/6+vdg757926trGx0O/y0h+eP27nTbrHvx3bxxXbBApuXABrwEiPeQ+Dk91y1oUE/7wlHeXbVWGyfvgMGiVoYk0qfdIAGYhoga3MElpaWtH379jU7waBvjinZEGiDQNMGfTOXuG/EwxZ8u4+kYWdZ5RJ3ZtA3Lz9mDGIMmTWKcfNk9XnGZBIHZtAnEar/PrUwxpRaGOPmycpcC4ec+syAGXTPt4FYCHSXQNMG3e4vt8XbxheJs4XjbPG2Ay0StxG1D0k6oVzSbjF2f/lnymJ0548kHSTpR+VzWCRuBhrkvssYZO67jHHzZGW+75J70D1KqRNLLYxxpBbGuHmyMtfCIac+M+Axa55vA7EQ6C6Bpg26Xdr+gXXMs82CHz/hMWvrUbuzpH+Q9DFJv1MCho9Zs3vSRy+lH/4IYK+Zqd+/8Zi1ZgRJUxrjSlMa4+bJ6nNDNokDBn0SofrvUwtjTKmFMW6erMy1EIPuUQqxEIBAmwSaNug2Nnvm+YmSni/pm2VG/VmSnl6eU24xb5b0DEl3kXRlAWIm/FPFkA8XiTtN0qDMmtsq8MPN9vXWsiK8zcwfLeksuxVQ0iPGAWPQm5EcTWmMK01pjJsnK3NTikH3KKVOLLUwxpFaGOPmycpcCzHoHqUQCwEItElgFgb90LLK+kmSDpd0aVm5ffSZ5ecUg24z5FcUIH9RzPUdJN1C0tVlcbiXSrLV4cc3u5T+9LIg3A8lvVPSCyX9FIM+G4nRlMY405TGuHmyMjelGHSPUurEUgtjHKmFMW6erMy1EIPuUQqxEIBAmwRmYdDbHN+6n80MejOnhKY0xpWmNMbNk5W5KcWge5RSJ5ZaGONILYxx82RlroUYdI9SiIUABNokgEEv9AeDgWz1y1lvNCTNE+96Q4IG0ECTBDDoTdJdf98Y9BhzamGMmyer638PPWOJxvaZAYvERVVBHgS6RQCDjkGvpkia0hhKmtIYN09WnxuySRww6JMI1X+fWhhjSi2McfNkZa6FQ059ZoBB93wbiIVAdwlg0DHo1dRJUxpDSVMa4+bJ6nNDNokDBn0SofrvUwtjTKmFMW6erMy1EIPuUQqxEIBAmwQw6Bj0avqjKY2hpCmNcfNkZW5KMegepdSJpRbGOFILY9w8WZlrIQbdoxRiIQCBNglg0DHo1fRHUxpDSVMa4+bJytyUYtA9SqkTSy2McaQWxrh5sjLXQgy6RynEQgACbRLAoGPQq+mPpjSGkqY0xs2TlbkpxaB7lFInlloY40gtjHHzZGWuhRh0j1KIhQAE2iSAQcegV9MfTWkMJU1pjJsnK3NTikH3KKVOLLUwxpFaGOPmycpcCzHoHqUQCwEItEkAg45Br6Y/mtIYSprSGDdPVuamFIPuUUqdWGphjCO1MMbNk5W5FmLQPUohFgIQaJMABh2DXk1/NKUxlDSlMW6erMxNKQbdo5Q6sdTCGEdqYYybJytzLcSge5RCLAQg0CYBDDoGvZr+aEpjKGlKY9w8WZmbUgy6Ryl1YqmFMY7Uwhg3T1bmWohB9yiFWAhAoE0CGHQMejX90ZTGUNKUxrh5sjI3pRh0j1LqxFILYxyphTFunqzMtRCD7lEKsRCAQJsEMOgY9Gr6oymNoaQpjXHzZGVuSjHoHqXUiaUWxjhSC2PcPFmZayEG3aMUYiEAgTYJYNAx6NX0R1MaQ0lTGuPmycrclGLQPUqpE0stjHGkFsa4ebIy10IMukcpxEIAAm0SwKBj0Kvpj6Y0hpKmNMbNk5W5KcWge5RSJ5ZaGONILYxx82RlroUYdI9SiIUABNokgEHHoFfTH01pDCVNaYybJytzU4pB9yilTiy1MMaRWhjj5snKXAsx6B6lEAsBCLRJAIOOQa+mP5rSGEqa0hg3T1bmphSD7lFKnVhqYYwjtTDGzZOVuRZi0D1KIRYCEGiTAAYdg15NfzSlMZQ0pTFunqzMTSkG3aOUOrHUwhhHamGMmycrcy3EoHuUQiwEINAmAQw6Br2a/mhKYyhpSmPcPFmZm1IMukcpdWKphTGO1MIYN09W5lqIQfcohVgIQKBNAhh0DHo1/dGUxlDSlMa4ebIyN6UYdI9S6sRSC2McqYUxbp6szLUQg+5RCrEQgECbBDDoGPRq+qMpjaGkKY1x82Rlbkox6B6l1ImlFsY4Ugtj3DxZmWshBt2jFGIhAIE2CXJPVYcAABzWSURBVGDQMejV9EdTGkNJUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCDLpHKcRCAAJtEsCgY9Cr6Y+mNIaSpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FGHSPUoiFAATaJIBBx6BX0x9NaQwlTWmMmycrc1OKQfcopU4stTDGkVoY4+bJylwLMegepRALAQi0SQCDjkGvpj+a0hhKmtIYN09W5qYUg+5RSp1YamGMI7Uwxs2TlbkWYtA9SiEWAhBokwAGHYNeTX80pTGUNKUxbp6szE0pBt2jlDqx1MIYR2phjJsnK3MtxKB7lEIsBCDQJgEMOga9mv5oSmMoaUpj3DxZmZtSDLpHKXViqYUxjtTCGDdPVuZaiEH3KIVYCECgTQIYdAx6Nf3RlMZQ0pTGuHmyMjelGHSPUurEUgtjHKmFMW6erMy1EIPuUQqxEIBAmwQw6Bj0avqjKY2hpCmNcfNkZW5KMegepdSJpRbGOFILY9w8WZlrIQbdoxRiIQCBNgnMwqAfKulMSSdJOlzSpZJeKem8CQN/gqQnSdop6XaSrpL0GUkvkXT5WO4nJT1knf19WNKjxl9fXl4+cmVl5erR1weDgRYXF2d+LmhImkfe9YYEDaCBJglg0Juku/6+Megx5tTCGDdPVtf/HnrGEo3tM4PV1VUtLy+vQbO0tLR1MBhcE+VFHgQgMHsCszDoHykm+3RJl0l6qqRTJT1N0jsOMOTPS/qBpP8pabekO0h6Qfn3/pK+OpJrBt3et32Obj8uPwiseRGD3ozQaEpjXGlKY9w8WX1uyCZxwKBPIlT/fWphjCm1MMbNk5W5Fg459ZkBBt3zbSAWAt0l0LRBf4ykC4opP3cEg5n24yRtk7SyAZ6tktbMcku6raQrJP1tMfnDVDPoR0i65zSoMejTUPLH0JT6mVkGTWmMmyerzw3ZJA4Y9EmE6r9PLYwxpRbGuHmyMtdCDLpHKcRCAAJtEmjaoJ8t6WRJt5Z0w8hAn1Jmzx8k6bNOADabbpe4P3IkD4PuhNhEOE1pjCpNaYybJ6vrTem93zp+145ndAeO/dHXLpf27btp0MKCbn2Po+t90MievvxvfPvt03fAMFALY7Lqkw7QQEwDTdbC2BHFs7x1MP5JN2Yyg16DIvuAQPsEmjbon5O0JOm+Y0O12fOvSHqOpDc6MGwv5vw1kv7TmEG/n6SfSzpM0pXlHne7991eW7Mxg+4g7gilIXHAGgmlKY1x82Rh0DHoHr1sNpZaGCNILYxx82RlroUeTjViMeg1KLIPCOQk0LRBt3vObcZ7fKG220j6Xrmn/BVToj9I0kcl3adcyv7tkTwz4t8t95vfQtKjJT23zM4/VNLq6GesZ9D37Nkj++Vx1tuOHTtm/ZGNfd6uXbsa2/dmdrx379796Vu2bNnMrhrJRQONYF2z065r4JR/OLgxCG3MoJ9z/M9c4+nTd8AGTi10nf79wX3SARqIaaDJWhg7oniWtw7GP+nGTFvseNs2u3v0xo1F4mqQZR8QmC2BWRj0bxXDPDqyoUE/o6zoPmnUdpznlEXgnijpfZMSJD1P0qsl2Wrw7x2NX8+g7969WysrG90OP8WnBUN27rRF6vuxXXzxxf0YyIxHgQZmDLyDH/esr9+ysaNqw6CffexPXOPp03fABk4tdJ3+/cF90gEaiGmgyVoYO6J4lrcOxj9pjRnX9u12sSkGvQZP9gGBtgg0bdBrXOJux/gmSadIeoakt00J66iyCvxZkp4/yaAzgz4l1QOEMWMQY8isUYybJ4sZ9Nle4u6dOerTd8B0SS30fDtvjO2TDtBATAPMoMe4DbOYQd8cP7Ih0BUCTRt0u7/cFoQbXyTOFo6zVd0nLRI3NOfPlPR7kv7GAW5o0O2Z6zZTv3/jHnQHRUco9106YI2Ect9ljJsnK/N9l23MoHvvvezTd8B0SS30fDtvjO2TDtBATAMsEhfjNsxikbjN8SMbAl0h0LRBt3vBP1BWcj9/ZNAflHT8hMes2bHZKvC/WxaTs//t2U6T9CpJjx+/JB6D7sE4fSwNyfSsRiNpSmPcPFkY9NnOoGPQ1+HtEWxDsV3/HlALGzrxI7vtugYw6JvTAAZ9c/zIhkBXCDRt0G2c9szzE8tl5t8sM+rPkvR0SW8vIN5cLl+/S1mB3V7+75L+SNJbilEfZXa9pC+XFx4s6YXlPnNbkO7m5Z73Z0u6UNLDp1kkbjAYyC4NmvVGQ9I88a43JGgADTTZlDKD3ry+xj+BHytjzKmFMW6erK7/PWyyFno41Yj1/lBZ4zMx6DUosg8ItE9gFgb9UEkvk3SSpMPLSuu2cvt5I8O3BeDs/vI7S7qivG7/3nEDRPYYtTuV9+4qyR67doKkI+zqwvIoNtv/n0syM79mYwa9GeHRlMa40pTGuHmyMjelGHSPUurEUgtjHKmFMW6erMy10MOpRiwGvQZF9gGBnARmYdA7RxaD3swpoSmNcaUpjXHzZGVuSjHoHqXUiaUWxjhSC2PcPFmZa6GHU41YDHoNiuwDAjkJYNDLeecS981/AWhKYwxpSmPcPFmZm1IMukcpdWKphTGO1MIYN09W5lro4VQjFoNegyL7gEBOAhh0DHo15dOUxlDSlMa4ebIyN6UYdI9S6sRSC2McqYUxbp6szLXQw6lGLAa9BkX2AYGcBDDoGPRqyqcpjaGkKY1x82Rlbkox6B6l1ImlFsY4Ugtj3DxZmWuhh1ONWAx6DYrsAwI5CWDQMejVlE9TGkNJUxrj5snK3JRi0D1KqRNLLYxxpBbGuHmyMtdCD6casRj0GhTZBwRyEsCgY9CrKZ+mNIaSpjTGzZOVuSnFoHuUUieWWhjjSC2McfNkZa6FHk41YjHoNSiyDwjkJIBBx6BXUz5NaQwlTWmMmycrc1OKQfcopU4stTDGkVoY4+bJylwLPZxqxGLQa1BkHxDISQCDjkGvpnya0hhKmtIYN09W5qYUg+5RSp1YamGMI7Uwxs2TlbkWejjViMWg16DIPiCQkwAGHYNeTfk0pTGUNKUxbp6szE0pBt2jlDqx1MIYR2phjJsnK3Mt9HCqEYtBr0GRfUAgJwEMOga9mvJpSmMoaUpj3DxZmZtSDLpHKXViqYUxjtTCGDdPVuZa6OFUIxaDXoMi+4BATgIYdAx6NeXTlMZQ0pTGuHmyMjelGHSPUurEUgtjHKmFMW6erMy10MOpRiwGvQZF9gGBnAQw6Bj0asqnKY2hpCmNcfNkZW5KMegepdSJpRbGOFILY9w8WZlroYdTjVgMeg2K7AMCOQlg0DHo1ZRPUxpDSVMa4+bJytyUYtA9SqkTSy2McaQWxrh5sjLXQg+nGrEY9BoU2QcEchLAoGPQqymfpjSGkqY0xs2TlbkpxaB7lFInlloY40gtjHHzZGWuhR5ONWIx6DUosg8I5CSAQcegV1M+TWkMJU1pjJsnK3NTikH3KKVOLLUwxpFaGOPmycpcCz2casRi0GtQZB8QyEkAg45Br6Z8mtIYSprSGDdPVuamFIPuUUqdWGphjCO1MMbNk5W5Fno41YjFoNegyD4gkJMABh2DXk35NKUxlDSlMW6erMxNKQbdo5Q6sdTCGEdqYYybJytzLfRwqhGLQa9BkX1AICcBDDoGvZryaUpjKGlKY9w8WZmbUgy6Ryl1YqmFMY7Uwhg3T1bmWujhVCMWg16DIvuAQE4CGHQMejXl05TGUNKUxrh5sjI3pRh0j1LqxFILYxyphTFunqzMtdDDqUYsBr0GRfYBgZwEMOgY9GrKpymNoaQpjXHzZGVuSjHoHqXUiaUWxjhSC2PcPFmZa6GHU41YDHoNiuwDAjkJYNAx6NWUT1MaQ0lTGuPmycrclGLQPUqpE0stjHGkFsa4ebIy10IPpxqxGPQaFNkHBHISwKBj0Kspn6Y0hpKmNMbNk5W5KcWge5RSJ5ZaGONILYxx82RlroUeTjViMeg1KLIPCOQkgEHHoFdTPk1pDGX2pvTeb708Bq6jWZGmrEkGGPTZC4VaGGNOLaQWNlkLY6qMZ0X+FsQ/7ZeZq6urWl5eXrObpaWlrYPB4JrN7pt8CEBgdgQw6Bj0amqLNKV9+mNsICN/kGlKaUqb/B5g0KuVuKl3RC2kFqKBmAaarIVTf4ErBUb6gc1+NAZ9swTJh0A3CGDQMejVlEhDEmtIMOgY9CabUgx6tRI39Y6ohdRCNBDTQJO1cOovcKVADHolkOwGAgkJYNAx6NVkT0NCQxJpSPrUkEWvomiSAQa9WombekfUQmohtRANRDQwdZHZIJAZ9M0SJB8C3SCAQcegV1MiTSkNSaQhadKcVhO3Y0ddY4BBd5y8SqHUQmph1+pAJWm7dpOdQWT8LsDrBGPQN0uQfAh0gwAGHYNeTYk0pTSlkYYEgy41yQCDXq3ETb0jaiG1kFqIBiIamLrIMIO+WVTkQ6DTBGZh0A+VdKakkyQdLulSSa+UdN4UZLZKOkvS4yQdLOkSSS+S9PF1ch8m6aWSTpD0M0nvl3SapKvHY5eXl49cWVlZ8/pgMNDi4uIUh1Q3pMnGvO6RTt5b5I9Rn8ZvhLIzyD7+LmpgHgw6daDZH2kmV+/6EdlrQfbxd7EW1lf5gfcY0cBmj5EZ9M0SJB8C3SAwC4P+EUk7JZ0u6TJJT5V0qqSnSXrHATDcTNIXJd2q5Jqh/kNJj5VkZvzCkdyHSPqYpAskvVaSGftXSfqRpBMlXT/6ORj0ZsQX+WNEY96vxhwNdO9HGgx6M/XuQHvle9C978GsVYAG0EBEA5vVKQZ9swTJh0A3CDRt0B9TTLOZ8nNHhmym/ThJ2yStbIDiD4rZfqCkz5WYg8os+k8l3W8k7wuSDimz5zeU1y3vM5JsP6/DoDcvuMgfIww6Bh0NNKsBDHrztW/8E6iFmDM0gAYiGthstcKgb5Yg+RDoBoGmDfrZkk6WdGtJQ+NsI39KmT1/kKTPboDio5LuIOmYsffPkPRySbeX9F1Jt5P0HUn2ul06P7p9Q9KVkh4xZtC3rqysXDX62iGHHNLKJe6/8a7d3VBChaP4xJO2u/fSp/Hb4LMzyD7+LmrgJ9/YLe3bd9Pv5sKCbnl3/3d2mi+5VwfUAQkG/WLg/Q7Y9woN9ItBRAPT1NcDxZhBv+6669aELC0tHTUYDG5yu+dmP4t8CECgOQJNG3Sb+V6SdN+xIdjs+VckPUfSGzcY3vclfbrcuz4aYpe42/3lj5RkM/H274fKpe8fGNvXuyTZjwC3HX392muvPWZ1dfXrzWFlzxCAAAQgAAEIQAACEGiXwOLi4rGHHXaYrf/EBgEIzAmBpg263XNuU8SPGuNxG0nfk/QCSa/YgNUvJL1F0nPH3n9AmXUfXjZv/75dkr1+0VjsGySdIsnuZ9+/YdDnRJ0cJgQgAAEIQAACEIBAmAAGPYyORAi0RmAWBv1bkh69gUFf77L0YagZ9DdL+v0NDLpdJm8rwQ8N+v0lfX4dg/4MSTfHoLemMT4YAhCAAAQgAAEIQKAFAhj0FqDzkRDYJIGmDTqXuG/yBJEOAQhAAAIQgAAEIACBCAEMeoQaORBol0DTBt3uL7eZ7vFF4mzhOFvV/UCLxNn95bZI3LFjiOxxbXZZvC0OZ5fJDxeJs9ft0Wqjm91zs2d8kbh9+/YtLS8vHz0auLCw8ENJ66yk1O4J4tMhAAEIQAACEIAABCAwBYGFffv2HT4aNxgMLl9YWNjoiUlT7JIQCEBg1gSaNuh2abst3GaG/PyRwX1Q0vETHrNml7b/taTRS9ftMWu7JNlj1uz14WaXth8sacfIY9vsfZvBt/28ftZg+TwIQAACEIAABCAAAQhAAAIQgICHQNMG3Y7FZsJPlPR8Sd8sM+rPkvT0sribxdi95nav+F3KY9HsNVvY7UuSDpNks+P2iAh7pvlvSnqYpAtHBvrrkuyxbH9XTP3W8si1n5TPvt4DhVgIQAACEIAABCAAAQhAAAIQgMCsCczCoB8q6WXlcWl22Y1ddm6XqNsCb8PtnGLQ7yzpipHXj5J0lqTHlRlymz1/saSPrQPq4ZL+rMyi/6w8iu2Pi7GfNdcufJ5xP3OMuz0nfpR7F46zyWMYFL3YlRX3lnSEpD+V9JImP7RD+/6N8kPYA8vtIj+W9MXyPbEfv/q+2Xm32nMvSUdK+rmkb0h6raS39X3wG4zvVElnS7IH5VqN6PtmP97+rw0Gud6TP/rM49fKk1Ns3LZw6nck/a2kl/Z50JKG/cVGw8yiA/sb+F/KY29vVW7/e4ekV0uynqnvmz3u17Rufw+t971Y0oskfabvA2d8EIDA/BGYhUGfPyr9OGK7cmFnufrAHndnq91bc/40SfZHOcN2p3JLxCWSjIGNP5NBf5ekfyHJ/v1aManPK1eVPFLSJ3ouAjNndnvN30v6rqRDiv7tNfuhz37AyrTZeh1fLeb8lskMuj3Sc9yof6XcLpVBA1b/3yrpnaX+221idsXabcsPdn1mYOO0H+jGN7vizq6uu+PIrXF95XCPckWi/UD5ckn/V9K/LAb1Akm/3deBl3FZL/RpSV+Q9F+LQT+t/HD/0HI7ZM8RMDwIQGCeCGDQ5+lsTX+sj5Fkf3SHz4ofZpppP27Cvf/Tf0r3I4f6tsX/bPb8mmQG3W71sFtDRjebNbVbTcyc2K0iGbeLijHZlmzwZkjsu2ALYv7rZAb9SZL+R7LzPRyu/TBjxsxmy+02MTbpIZI+WX6ksx/r+r7Zj5EvlHRXSfbo2+H2BknPlmRXN/6oxxA+VK6u3D5ytYBdYbe7/HhvCxazQQACEOgMAQx6Z05F1QOxS1htlnB89XxbUd9mzw+0en7VA+nQzjIa9I3w28y5Ne1379D5meWhvF+SzShZs5ZlszU/bNFNG7c16xj0LGf+l5c12209dkXRlXmGfcCR2o8V9p2w2fX/k4DJUAN2JYHNng83e/LNfy5r/dhtL33dlsukhfVFo9u7JT2h/GD7/b4OnnFBAALzRwCDPn/nbJoj3szz56fZ/zzGYNB/edbs0mZr0s2kW2OSYVuUZP/ZD1Y2k/oaSX8kyWaPMmx2JYXd4vAnxaTbPbnZDLpdSWK3e9i9tlYf7V5Uu/Uhw/bxMntoV1SZIbtnuYriPZLsMt9rM0AYGaPVQDNjdu+xrV2TYbMfZ75c1u+xBXvtajK7isDW4rAfK/5dzyHYrQy2/o4tRjy62YSFTVzYLV92hSEbBCAAgU4QwKB34jRUPwi739ou3XrU2J5vU54db/dj2kJ9mTYM+i/PtjVkTy6PKcywUJyN2R6z+Jwi9l9I+g+SXpdI/HZpt333bZEwu8Q9k0G3hbGsKbfLmf+pXOJri4feTdJjJX04gQ5sYVa7z3pvqfv2A4Xdk2vrcfxvSQ8uukiA4p+H+Nzy/TdjlmnR1GMkvVeS/Tvc/luph1YX+rzZjxP2KN5jJa2Wgdpje+3WD7uSavx2wD6zYGwQgMAcEMCgz8FJChyiGXS7z8yeQz+6DQ36GeUxdIFdz20KBv2Xs4a2au2/lfRXc3sm/Qdu95rbLLL9Z49ptHsubRbJVi/u+/bEcluLGVWbRbctk0Ff7/zaCtb/WGaRT+i7AMo9tkdLGq/7/17SX5ZZ5PWejNJXNLZ6tz0xxm7zyfIIVptBt0fRXiXpL8oM+v3K3wP7Ae/3+nqyy7h+tzzO136YtSd72BVVdtn/KZKWyi2B5/ecAcODAATmiAAGfY5OluNQucT9prCyG/ThPYi2UJCt4pt5sybNVvS3FaztUs++bsMFAe2qidEV6+1e9N+SdPsyq9rne083OremAZtJtVk1e/xenzf7e3B/SfcplzkPx2pXEdgMov1YZY8zzbAdL8me6mG3udiVNFk2u1LAViu32eLR7/szJb1Fkj3x4sKewzCd2w/Uw8dL2vfiU0X/dhVJllteen6aGR4E+kEAg96P8zg+ijeW+6rGF4mzBVLOZZG4NM9BH+piaM5toSi7rDX7NmxKzbR8vscwbNZs0gJY75P0+B4z2Ghow9sebiHp//V8/MOVuscNui0SaZe/2yX/Ga4msdNsxtzut75XeZJFz0/9/uHZebb77s2kj262HoFdTWJrcrw2AYybSbKrSWzROFuLxb4b9uhZWzyv7z/UJTi9DBEC/SGAQe/PuWQkEIAABCAAAQhAAAIQgAAEIDDHBDDoc3zyOHQIQAACEIAABCAAAQhAAAIQ6A8BDHp/ziUjgQAEIAABCEAAAhCAAAQgAIE5JoBBn+OTx6FDAAIQgAAEIAABCEAAAhCAQH8IYND7cy4ZCQQgAAEIQAACEIAABCAAAQjMMQEM+hyfPA4dAhCAAAQgAAEIQAACEIAABPpDAIPen3PJSCAAAQhAAAIQgAAEIAABCEBgjglg0Of45HHoEIAABCAAAQhAAAIQgAAEINAfAhj0/pxLRgIBCEAAAhCAAAQgAAEIQAACc0wAgz7HJ49DhwAEIAABCEAAAhCAAAQgAIH+EMCg9+dcMhIIQAACEIAABCAAAQhAAAIQmGMCGPQ5PnkcOgQgAAEIQAACEIAABCAAAQj0hwAGvT/nkpFAAAIQgAAEIAABCEAAAhCAwBwTwKDP8cnj0CEAAQhAAAIQgAAEIAABCECgPwQw6P05l4wEAhCAAAQgAAEIQAACEIAABOaYAAZ9jk8ehw4BCEAAAhCAAAQgAAEIQAAC/SGAQe/PuWQkEIAABCAAAQhAAAIQgAAEIDDHBDDoc3zyOHQIQAACEIAABCAAAQhAAAIQ6A8BDHp/ziUjgQAEIAABCEAAAhCAAAQgAIE5JoBBn+OTx6FDAAIQgAAEIAABCEAAAhCAQH8IYND7cy4ZCQQgAAEIQAACEIAABCAAAQjMMQEM+hyfPA4dAhCAAAQgAAEIQAACEIAABPpDAIPen3PJSCAAAQhAAAIQgAAEIAABCEBgjglg0Of45HHoEIAABCAAAQhAAAIQgAAEINAfAhj0/pxLRgIBCEAAAhCAAAQgAAEIQAACc0wAgz7HJ49DhwAEIAABCEAAAhCAAAQgAIH+EMCg9+dcMhIIQAACEIAABCAAAQhAAAIQmGMCGPQ5PnkcOgQgAAEIQAACEIAABCAAAQj0hwAGvT/nkpFAAAIQgAAEIAABCEAAAhCAwBwTwKDP8cnj0CEAAQhAAAIQgAAEIAABCECgPwQw6P05l4wEAhCAAAQgAAEIQAACEIAABOaYAAZ9jk8ehw4BCEAAAhCAAAQgAAEIQAAC/SGAQe/PuWQkEIAABCAAAQhAAAIQgAAEIDDHBDDoc3zyOHQIQAACEIAABCAAAQhAAAIQ6A8BDHp/ziUjgQAEIAABCEAAAhCAAAQgAIE5JoBBn+OTx6FDAAIQgAAEIAABCEAAAhCAQH8IYND7cy4ZCQQgAAEIQAACEIAABCAAAQjMMQEM+hyfPA4dAhCAAAQgAAEIQAACEIAABPpDAIPen3PJSCAAAQhAAAIQgAAEIAABCEBgjglg0Of45HHoEIAABCAAAQhAAAIQgAAEINAfAhj0/pxLRgIBCEAAAhCAAAQgAAEIQAACc0wAgz7HJ49DhwAEIAABCEAAAhCAAAQgAIH+EMCg9+dcMhIIQAACEIAABCAAAQhAAAIQmGMCGPQ5PnkcOgQgAAEIQAACEIAABCAAAQj0hwAGvT/nkpFAAAIQgAAEIAABCEAAAhCAwBwTwKDP8cnj0CEAAQhAAAIQgAAEIAABCECgPwQw6P05l4wEAhCAAAQgAAEIQAACEIAABOaYAAZ9jk8ehw4BCEAAAhCAAAQgAAEIQAAC/SGAQe/PuWQkEIAABCAAAQhAAAIQgAAEIDDHBDDoc3zyOHQIQAACEIAABCAAAQhAAAIQ6A+B/w8AEcxTTFBcigAAAABJRU5ErkJggg==\" width=\"800\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Final posterior: [0.037 0.065 0.055 0.076 0.267 0.037 0.065 0.055 0.076 0.267]\n"
     ]
    }
   ],
   "source": [
    "hallway = np.array([1, 0, 1, 0, 0]*2)\n",
    "kernel = (.1, .8, .1)\n",
    "prior = np.array([.1] * 10)\n",
    "measurements = [1, 0, 1, 0, 0]\n",
    "z_prob = 0.75\n",
    "discrete_bayes_sim(prior, kernel, measurements, z_prob);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have identified the likely cases of having started at position 0 or 5, because we saw this sequence of doors and walls: 1,0,1,0,0. Now I inject a bad measurement. The next measurement should be 1, but instead we get a 0:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            if (mpl.ratio != 1) {\n",
       "                fig.send_message(\"set_dpi_ratio\", {'dpi_ratio': mpl.ratio});\n",
       "            }\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        fig.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var backingStore = this.context.backingStorePixelRatio ||\n",
       "\tthis.context.webkitBackingStorePixelRatio ||\n",
       "\tthis.context.mozBackingStorePixelRatio ||\n",
       "\tthis.context.msBackingStorePixelRatio ||\n",
       "\tthis.context.oBackingStorePixelRatio ||\n",
       "\tthis.context.backingStorePixelRatio || 1;\n",
       "\n",
       "    mpl.ratio = (window.devicePixelRatio || 1) / backingStore;\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width * mpl.ratio);\n",
       "        canvas.attr('height', height * mpl.ratio);\n",
       "        canvas.attr('style', 'width: ' + width + 'px; height: ' + height + 'px;');\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'] / mpl.ratio;\n",
       "    var y0 = (fig.canvas.height - msg['y0']) / mpl.ratio;\n",
       "    var x1 = msg['x1'] / mpl.ratio;\n",
       "    var y1 = (fig.canvas.height - msg['y1']) / mpl.ratio;\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x * mpl.ratio;\n",
       "    var y = canvas_pos.y * mpl.ratio;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    var width = fig.canvas.width/mpl.ratio\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\" width=\"' + width + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var width = this.canvas.width/mpl.ratio\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\" width=\"' + width + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        event.shiftKey = false;\n",
       "        // Send a \"J\" for go to next cell\n",
       "        event.which = 74;\n",
       "        event.keyCode = 74;\n",
       "        manager.command_mode();\n",
       "        manager.handle_keydown(event);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA+gAAAD6CAYAAAAyVW3pAAAgAElEQVR4Xu2dC7RtZ1Xf//eepALJjpKSRBACBFEwSoIjAQQt6uAtvmvk1QEqLx99UnlrVUAgQ6u2xQcIUhUI0EodyhstUXkGalJBgcAtREAJFSQHsHhz7u2Y3HWSfTfn3Lv2/1tzr7nX/u0xGNFz11zf9/3WnN/+fnu9DogPBCAAAQhAAAIQgAAEIAABCEAAAqMTODB6D+gABCAAAQhAAAIQgAAEIAABCEAAAkLQSQIIQAACEIAABCAAAQhAAAIQgEABAgh6gYNAFyAAAQhAAAIQgAAEIAABCEAAAgg6OQABCEAAAhCAAAQgAAEIQAACEChAAEEvcBDoAgQgAAEIQAACEIAABCAAAQhAAEEnByAAAQhAAAIQgAAEIAABCEAAAgUIIOgFDgJdgAAEIAABCEAAAhCAAAQgAAEIIOjkAAQgAAEIQAACEIAABCAAAQhAoAABBL3AQaALEIAABCAAAQhAAAIQgAAEIAABBJ0cgAAEIAABCEAAAhCAAAQgAAEIFCCAoBc4CHQBAhCAAAQgAAEIQAACEIAABCCAoJMDEIAABCAAAQhAAAIQgAAEIACBAgQQ9AIHgS5AAAIQgAAEIAABCEAAAhCAAAQQdHIAAhCAAAQgAAEIQAACEIAABCBQgACCXuAg0AUIQAACEIAABCAAAQhAAAIQgACCTg5AAAIQgAAEIAABCEAAAhCAAAQKEEDQCxwEugABCEAAAhCAAAQgAAEIQAACEFiFoM8k/ZSkCyXdVdItJP2spJ/pif9sSZdKerCkm0m6StLTJf3RHvH3kfQMSRdI+rykP5T0REnX9myLzSAAAQhAAAIQgAAEIAABCEAAAqMQWIWg307SlZ1Yf0DSo5cQ9C+T9C5JXyHpyZ1o/7ik75AUMn75HLV7S3qTpFdLep6kEPvnSvq0pIskfWEUwjQKAQhAAAIQgAAEIAABCEAAAhDoQWAVgr7bxtHu7PknlxD0H+tk+56S3taN55RO9j8r6e5zY3ynpNO6s+fXd3+PuLdIiv38Wg8ebAIBCEAAAhCAAAQgAAEIQAACEBiFwCoEfX5gcXn7MoL+Rkm3kXSnBTpPkfTzkm4t6WOSvkrSRyXF35+zsO37JX1E0v12/3706NGt7e3tO85vd+DAgU9Jih8R+EAAAhCAAAQgAAEIQGDdCBw4evTomfOdns1mVx84cGBn3QZCfyGwyQSqC/rfSPpTSZcsHKS4xD3uL7+/pDd0/31dd+n7axa2faWke0m61e7fr7vuujsdOXLkrzb5wDN2CEAAAhCAAAQgAIFpEzh48OCdzzjjjPdNe5SMDgLTIlBd0P9R0oskPX4B+zdJequkh0l6Wfffl0iKv799YdvfkPQoSXE/+xc/CPq0kpjRQAACEIAABCAAAQh8KQEEnayAwPoRWAdBf6GkH91H0B8q6bI5Qb+HpHfsIeiPlHQTBH39EpQeQwACEIAABCAAAQh4BBB0jxtREBiTQHVB5xL3MbODtiEAAQhAAAIQgAAE1pYAgr62h46ObzCB6oIe95fHQ+LuvHCM4pVrz+4eDvfxuYfExd/j1Wrzn7jv5pr5h8Rtb2+fvbOz84n5jU477TQdPHhw5alw9tnxNrhpfK69tubr5t/73vfq+uuv1ymnnKLzzz+/HGxyIP+QVM+BfAJSZQaZNXDrH/uvOrAVL/84/nN053p99Ffj4qrhP8yFHtPMPPB65EeRAz677MjKc2Hr2I8cOaLPfe5zx+1ma2vrnNlsVnOB1jpg4iEwUQLVBT0ubf9VSfOXrsdKK96rHq9Zi7/vfuLS9ptJulDS7tMq49/j9Wyxn1/f3XB7e/usnZ2d4yar2Ww2iqAfOLDqQ5CXyUeP1nwI/lVXXaXDhw/r1FNP1QUXXJAHwNwzOWCCWyKseg4sMRR708oMMmvg3Ce8SgdOOfVLBf36w7rmF7/X5nmiQOZCD2tmHng98qPIAZ9ddmTlubB17CHo29vbi4J+9mw2izco8YEABNaEwKrs8IHdO8pn3UPf4snqr+gYxVPXPy8p7jWP0xl36F6LFv8cD3Z7t6QzJMXZ8ZDqeKf5d0q6j6TL5zh/q6R4LdsfdFIfp6bjlWufkXSRpC8g6LlZyYLE48ui1OO2TNSUF2R9OVRmkFkDCPqNGVI5B6KXmXnQt06G2o7vw6FIDr+f6nXQMmIEvYUesRCoQ2BVgv5hSbfdZ9i3lxT//uJO0Hf//93Nz5F0qaQHd2fI4+z5T0l60x77u6+kn+vOoof0x6vYfrIT+xs25wx6TgKyIPG4sij1uC0TNeUFWV8OlRlk1gCCjqD3rZEht+P7cEiaw+6r8lzYOlIEvZUg8RCoQWBVgl5jtF0vEPScw8GCxOOaKSdej/wocsBnlx1ZeVGaWQMIOoKeXVt77Z+5cAzq/dqsPBf2G8H+WyHorQSJh0ANAgh6dxy4B709IVmQeAwz5cTrkR9FDvjssiMrL0ozawBBR9CzawtBH4Ow32bludAf1bFIBL2VIPEQqEEAQUfQB8tE5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBFYh6KdLeqakSySdKel9kp4j6bKTgHizpHufYJtbSvrb7t/32/b1kh6wuI/t7e2zdnZ2rp3/+2w208GDB1d+bDIXpqseDHLmEScHPG7LRE15QdaXQ2UGmTWAoCPofWtkyO34PhyS5rD7qjwXto70yJEj2t7ePm43W1tbZ89ms0+27pt4CEBgdQRWIehvkHSxpCdL+oCkh0l6tKSHS3rpCYb6dZLOWPj3m0l6naR3S/qmuX8LQb9Nt8/5kL/vfhA4bjcIek6CsSDxuGbKidcjP4oc8NllR1ZelGbWAIKOoGfX1l77Zy4cg3q/NivPhf1GsP9WCHorQeIhUINAtqA/SNKrOyl/2dyQQ9rPl3SupJ0lUDxS0os7wX/hgqDfQtLX99kXgt6H0vLbsCBZnllEZMqJ1yM/ihzw2WVHVl6UZtYAgo6gZ9cWgj4GYb/NynOhP6pjkQh6K0HiIVCDQLagv0DSQyTdXNL1c0N+aHf2/F6S3roEij+RdFdJcXn7ZxH0JcitYFPkzIOcKSdej/wocsBnlx1ZeVGaWQMIOoKeXVsI+hiE/TYrz4X+qBD0VnbEQ6ASgWxBf5ukLUl3Wxh0nD1/j6THSXp+TyB37C6R/01Jj1mIiUvc7y7pH7rL4j/S3eMe977H3477cAa9J/ElN0POlgTWbZ4pJ16P/ChywGeXHVl5UZpZAwg6gp5dWwj6GIT9NivPhf6oEPRWdsRDoBKBbEGPe84P7fGgtjgD/nFJT5X07J5A4sFyT+ruPX/7QkyI+Me6+81vKumBkh7fnZ3/trjqZ357BL0n8SU3Q86WBIage8CMqCkvyPriqMwAQe97FNu2q5wDMbLMPGgjt3w034fLM1tVRPU6aOHAJe4t9IiFQB0CqxD0D3XCPD/qXUF/SvdE95MROUXSX0v6u773mUt6gqRfkPR9kl51MkG/5pprvnjvzqo/F1544aqbTGvvyiuvTNt3y44PHz58Q/ipp57asquUWHIgBetxO62eA/kEpMoMMmtgjDPozIVeRmfmgdcjP4oc8NllR1aeC1vHHm8jOvfceLzTjR+e4t5KlXgIrJ5AtqAPdYn7d0n6fUn/VtIv98R0Tvcatku7M+83hO11Bv3QoUPa2VnmeXU9e3GSzS6+OB5wP43PFVdcMY2BrHgU5MCKgdNcOQKZNTCGoDMXeimWmQdej/wocsBnR6RPYGtrS+eddx6C7iMkEgIlCGQLetxfHg+EW3xIXDw4Lp7q3vchcSHn8T7zW3Vn0fvA2xX0uDQ+ztSfUNA5g94H6Ym34YyBx5CzRh63ZaKmfMakL4fKDDJrYAxBZy7sm5XHb5eZB16P/ChywGeXHVl5LmwdO2fQWwkSD4EaBLIFPe4Ff033JPeXzw35tZLu0vM1a1/ZXd7+e5J+cAlsT5T0XEnf0519P6Ggz2YzxcS26g/33OUTr36/GTlADuQTkCrXQWYNjCHo3H/sZXRmHng98qPIAZ9ddmTlubB17NyD3kqQeAjUIJAt6DHKeOf5Rd1l5h/szqjHU9gfIeklHYZ4p3m84/wOkuIJ7POfeDBcnAW/n6Q37oHtWyQ9rbvPPB5Id5PunvfHSrpc0n15SNxqko0FiceZRanHbZmoKS/I+nKozCCzBhD0GzOkcg5ELzPzoG+dDLUd34dDkRx+P9XroGXECHoLPWIhUIfAKgT9dEnPknSJpDO7J63Hk9svm8Pw4k7Qby/pwwt43i/pn0iKm2qO7oHuqyX9iqQLJN2i2+bqbv+/KOkLizE8xT0nAVmQeFxZlHrcloma8oKsL4fKDDJrAEFH0PvWyJDb8X04JM1h91V5LmwdKYLeSpB4CNQgsApBrzHSuV4g6DmHhAWJxzVTTrwe+VHkgM8uO7LyojSzBhB0BD27tvbaP3PhGNT7tVl5Luw3gv23QtBbCRIPgRoEEPTuOHAPentCsiDxGGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT+qY5EIeitB4iFQgwCCjqAPlonImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKwCkE/XdIzJV0i6UxJ75P0HEmXnQTEoyT91j7b3FLS3y7820MkPVnSnSR9StIrJD1d0mcX97G9vX3Wzs7OtfN/n81mOnjw4MqPTebCdNWDQc484uSAx22ZqCkvyPpyqMwgswYQdAS9b40MuR3fh0PSHHZflefC1pEeOXJE29vbx+1ma2vr7Nls9snWfRMPAQisjsAqBP0Nki7u5PkDkh4m6dGSHi7ppScY6q6g/1An9fObvlvS4bk/xL5+V9Jvdvv8GknPlfROSfdD0FeTUCxIPM6ZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtbXX/pkLx6Der83Kc2G/Eey/FYLeSpB4CNQgkC3oD5L06k7KXzY35JD28yWdK2lnHxS7gh5y/64T4NqS9NeS/kLS/ee2ix8CXiIp+vDa+XjOoOckHwsSj2umnHg98qPIAZ9ddmTlRWlmDSDoCHp2bSHoYxD226w8F/qjOhaJoLcSJB4CNQhkC/oLJMWl5zeXdP3ckB/anem+l6S3Ngp67OPPJMU+5y+bP7W71D1+GHgsgp6fcMiZxzhTTrwe+VHkgM8uO7LyojSzBhB0BD27thD0MQj7bVaeC/1RIeit7IiHQCUC2YL+NklxhvtuC4OOs+fvkfQ4Sc8/iaB/QtJZkj4j6c2SfrqL3Q2Lffx6d0b+Lxf2dUV3Kfw9EfT8tEPOPMaZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRyBb0uOf8kKQHLAw6HvL2cUlPlfTsfYBEzDdLeruk6yR9Q3cfe5yNj7PmV3VxsY9nSdrrwXGvl3Q7SV97MkG/5pprvnhp0Ko/F1544aqbTGvvyiuvTNt3y44PH77xcQWnnhoXVtT6kAP5x6N6DuQTkCozyKyBMQSdudDL6Mw88HrkR5EDPrvsyMpzYevY42HH554bd4/e+OEhca1UiYfA6gmsQtA/JOmB+wj6U7onuvcdech23Gv+x5K+e0HQv1JSnG2f/4Sg37Z7svsNf9/rHvRDhw5pZ2e/2+H7dm/57S6+OG6xn8bniiviggU+yxIgB5YlxvZTI5BZA2MIOnOhl6GZeeD1yI8iB3x2RPoEtra2dN555x23AwTd50kkBMYikC3oLZe478ckHvj2jZLO6TYY5BJ3zqC3pyBnDDyGnDXyuC0TNeUzJn05VGaQWQNjCDpzYd+sPH67zDzweuRHkQM+u+zIynNh69g5g95KkHgI1CCQLehxf3k8vG3xIXHx4Lh4eNuJHhK3H6HXSbqgu6Q9ton7y9/SPYzu5XNBp0j6dNcOD4lbQb5x/7EHOfP+W69HfhQ54LPLjqx832VmDYwh6NSBl82ZeeD1yI8iB3x22ZGV58LWsfMU91aCxEOgBoFsQY9L21+zhzzHWfC7nOQ1a3sRur2k/y3pTZK+t9tg9zVrcU/6/KX0uz8CxN9C6m/48Jq1nORjQeJxZVHqcVsmasoLsr4cKjPIrAEE/cYMqZwD0cvMPOhbJ0Ntx/fhUCSH30/1OmgZMYLeQo9YCNQhkC3oMdJ45/lFkp4k6YPdGfXHSHpE957y2OaFkh4p6Q6SPtLhCQn/k07Idx8S90RJs+6seTwFfvcT+/qd7onwcWb+jpIulRQ3Rd9vETeCnpOALEg8rixKPW7LRE15QdaXQ2UGmTWAoCPofWtkyO34PhyS5rD7qjwXto4UQW8lSDwEahBYhaCf3j1l/RJJZ0p6X/fk9vl3lr+4E/Q4Q/7hDs0vdXJ9G0k3lXRt93C4Z0iKp8MvfuJS+id3D4T7lKRXSHqapM8i6KtJNhYkHudMOfF65EeRAz677MjKi9LMGkDQEfTs2tpr/8yFY1Dv12blubDfCPbfCkFvJUg8BGoQWIWg1xjpXC84g55zSFiQeFwz5cTrkR9FDvjssiMrL0ozawBBR9CzawtBH4Ow32bludAf1bFIBL2VIPEQqEEAQe+Ow2w2Uzz9ctWfzIXpqseCnHnEyQGP2zJRU16Q9eVQmUFmDSDoCHrfGhlyO74Ph6Q57L4qz4WtI0XQWwkSD4EaBBB0BH2wTGRB4qHMlBOvR34UOeCzy46svCjNrAEEHUHPrq299s9cOAb1fm1Wngv7jWD/rRD0VoLEQ6AGAQQdQR8sE1mQeCgz5cTrkR9FDvjssiMrL0ozawBBR9CzawtBH4Ow32bludAf1bFIBL2VIPEQqEEAQUfQB8tE5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB855Y+kAACAASURBVHx22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEgEEHUEfLB+RMw9lppx4PfKjyAGfXXZk5UVpZg0g6Ah6dm0h6GMQ9tusPBf6o0LQW9kRD4FKBBB0BH2wfETOPJSZcuL1yI8iB3x22ZGVF6WZNYCgI+jZtYWgj0HYb7PyXOiPCkFvZUc8BCoRQNAR9MHyETnzUGbKidcjP4oc8NllR1ZelGbWAIKOoGfXFoI+BmG/zcpzoT8qBL2VHfEQqEQAQUfQB8tH5MxDmSknXo/8KHLAZ5cdWXlRmlkDCDqCnl1bCPoYhP02K8+F/qgQ9FZ2xEOgEoFVCPrpkp4p6RJJZ0p6n6TnSLrsJCC+T9IPSLpY0ldJ+oSkt0j6GUlXL8S+WdK999jf6yU9YPHv29vbZ+3s7Fw7//fZbKaDBw+u/NhkLkxXPRjkzCNODnjcloma8oKsL4fKDDJrAEFH0PvWyJDb8X04JM1h91V5Lmwd6ZEjR7S9vX3cbra2ts6ezWafbN038RCAwOoIrELQ39BJ9pMlfUDSwyQ9WtLDJb30BEN9h6S/lfQ/JB2SdBtJT+3+ew9J752LDUGPf499zn/+vvtB4Lg/Iug5CcaCxOOaKSdej/wocsBnlx1ZeVGaWQMIOoKeXVt77Z+5cAzq/dqsPBf2G8H+WyHorQSJh0ANAtmC/iBJr+6k/GVzQw5pP1/SuZJ29kFxtqTjznJLupWkD0v67U7yd0ND0G8h6ev7YEXQ+1BafhsWJMszi4hMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHdSwSQW8lSDwEahDIFvQXSHqIpJtLun5uyA/tzp7fS9Jbl0QRZ9PjEvf7z8Uh6EtCzNgcOfOoZsqJ1yM/ihzw2WVHVl6UZtYAgo6gZ9cWgj4GYb/NynOhPyoEvZUd8RCoRCBb0N8maUvS3RYGHWfP3yPpcZKevwSQ8zo5/xVJ/25B0O8u6R8knSHpI9097nHve/ztuA9n0JcgvsSmyNkSsOY2zZQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiUC2oMc953HGe/FBbbeU9PHunvJn9wRyiqQ3SvrG7lL2v56LCxH/WHe/+U0lPVDS47uz898WV/3Mt7GXoF9zzTVfvDRo1Z8LL7xw1U2mtXfllVem7btlx4cPH74h/NRTT23ZVUosOZCC9bidVs+BfAJSZQaZNTCGoDMXehmdmQdej/wocsBnlx1ZeS5sHXs87Pjcc+Pu0Rs/PCSulSrxEFg9gVUI+oc6YZ4f3a6gP6V7ovvJRh79fHH3ELjvl/T7JwuQ9ARJvyApngb/qpMJ+qFDh7Szs9/t8D1aMze5+OJ4SP00PldcccU0BrLiUZADKwZOc+UIZNbAGILOXOilWGYeeD3yo8gBnx2RPoGtrS2dd15cbIqg+xSJhMD4BLIFfYhL3KOPvynpUZIeKel3e2I7p3sK/KWSnnQyQecMek+qJ9iMMwYeQ84aedyWiZryGZO+HCozyKyBMQSdubBvVh6/XWYeeD3yo8gBn112ZOW5sHXsnEFvJUg8BGoQyBb0uL88Hgi3+JC4eHBcPNX9ZA+J25XzH5L0I5J+awlsu4Ie71yPM/U3fLgHfQmKS2zK/cdLwJrbNPP+W69HfhQ54LPLjqx832VmDYwh6NSBl82ZeeD1yI8iB3x22ZGV58LWsfMU91aCxEOgBoFsQY97wV/TPcn95XNDfq2ku5zkNWvRt3gK/A93D5OL/3uZzxMlPVfS9yxeEo+gL4Ox/7YsSPqzmt+SRanHbZmoKS/I+nKozCCzBhD0GzOkcg5ELzPzoG+dDLUd34dDkRx+P9XroGXECHoLPWIhUIdAtqDHSOOd5xd1l5l/sDuj/hhJj5D0kg7FC7vL1+/QPYE9/vyfJf2EpBd1oj5P7QuS/rz7w7dIelp3n3k8kO4m3T3vj5V0uaT79nlI3Gw2U1watOoPC5J84tW/jMkBciCfgFS5DjJrAEFH0FdRX4ttIOhjUO/XZuW5sN8I9t8KQW8lSDwEahBYhaCfLulZki6RdGb3pPV4cvtlcwjiAXBxf/ntJX24+3v897b7YIrXqN2u+7evlhSvXbtA0i0kHe1exRb7/0VJIfPHfTiDnpN8LEg8rply4vXIjyIHfHbZkZUXpZk1gKAj6Nm1tdf+mQvHoN6vzcpzYb8RIOitnIiHQHUCqxD0cgwQ9JxDwoLE45opJ16P/ChywGeXHVl5UZpZAwg6gp5dWwj6GIT9NivPhf6ojkVyBr2VIPEQqEEAQe+OA5e4tyckcuYxzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDPLjuy8qI0swYQdAQ9u7YQ9DEI+21Wngv9USHoreyIh0AlAgg6gj5YPiJnHspMOfF65EeRAz677MjKi9LMGkDQEfTs2kLQxyDst1l5LvRHhaC3siMeApUIIOgI+mD5iJx5KDPlxOuRH0UO+OyyIysvSjNrAEFH0LNrC0Efg7DfZuW50B8Vgt7KjngIVCKAoCPog+UjcuahzJQTr0d+FDngs8uOrLwozawBBB1Bz64tBH0Mwn6bledCf1QIeis74iFQiQCCjqAPlo/ImYcyU068HvlR5IDH7q6/c7UXWDTqz//FHZfqWWYNIOgI+lLJONDGzIUeyCnNhcvOgx6x46OOHDmi7e3t4/64tbV19mw2++QQ+2cfEIDAaggg6Aj6YJnGgsRDmSknXo/8KHLAYzelRWkQWHZhmlkDCDqC7lVlWxRzocdvSnPhsvOgRwxBH4Ib+4BANQIIOoI+WE6yIPFQZsqJ1yM/ihzw2E1pUYqgS9SBVwfMhR63ZaKqX949pbkQQV8mM9kWAhCYJ4CgI+iDVQSLUg8li1KP2zJRLEqXodW+7bIL08wa4Aw6Z9DbM3r5PfB9uDyziEDQPW67UVzi3saPaAhUIYCgjyzofBnll0J1OcuUk3y6x7fAotQjPqV5wDmDnjn+T//l1XFK+0sPzIEDuvnXLXevfN+ju+wPFH3327odc2Erwf7xzIX9Wc1vmTkXeD3yo8aYBxB0/3gRCYFKBBB0BH2wfBzjy6hP51mU9qE0zDYsSj2OU1qUIujL34PvZc3yUcyFyzNzI5gLPXJTmgvHWBMh6F7eEQWBagQQdAR9sJwc48uoT+dZlPahNMw2LEo9jlNalCLoCLpXBRJXE7nk+sdV/z6c0lw4xpoIQe9fC2wJgcoEEHQEfbD8HOPLqE/nqy9IWJT2OYpt21TPgSktShF0BN2tVuZCl1z/OObC/qxatxxjTYSgtx414iFQgwCCjqAPlonOl9Gmi0nAZ1E6WAruuyMWpfmM51tYdi7InAfW5R70TAarPfrHWls2B5gLV3OUmAtXw9mtgdbeIeitBImHQA0CCDqCPlgmOgsyFqUIOjkwrScXOwvTzBxA0Aeb4pfakfN9sOk/VmbWwVIHb6CNnRyYEgNn/K3oEfRWgsRDoAYBBB1BHywTnS+jKX0ZO2LCWSPkNHJg0+sgc/wI+mBT/FI7cr4PEPSrl2JcfWMnBzLnglXzcsbf2kcEvZUg8RCoQQBBR9AHy0Tny2hKX8YIerzNao/XWZ0kw8gBBD0zBxD0wab4pXbkfB8g6Ah65lywVAIPsLFTA63NIuitBImHQA0CCDqCPlgmOl9GU/oyRtARdDcHNr0OMsePoA82xS+1I+f7AEFH0DPngqUSeICNnRpobRZBbyVIPARqEEDQEfTBMtH5MprSl7ErZyxKWZRueh1kjh9BH2yKX2pHzvcBcyFzYeZcsFQCD7CxUwOtzSLorQSJh0ANAgg6gj5YJjpfRlP6MkbQOYPu5sCm10Hm+BH0wab4pXbkfB8g6Ah65lywVAIPsLFTA63NIuitBImHQA0CCDqCPlgmOl9GU/oyduWMRSmL0k2vg8zxI+iDTfFL7cj5PmAuZC7MnAuWSuABNnZqoLVZBL2VIPEQqEEAQUfQB8tE58toSl/GCDpn0N0c2PQ6yBw/gj7YFL/UjpzvAwQdQc+cC5ZK4AE2dmqgtVkEvZUg8RCoQQBBR9AHy0Tny2hKX8aunLEoZVG66XWQOX4EfbApfqkdOd8HzIXMhZlzwVIJPMDGTg20NougtxIkHgI1CKxC0E+X9ExJl0g6U9L7JD1H0mU9EJwt6VJJD5Z0M0lXSXq6pD/aI/Y+kp4h6QJJn5f0h5KeKOnaxW23t7fP2tnZOe7vs9lMBw8e7NGlYTfZ9C+jKY0fQecMupsDm14HmeNH0If9zuq7N0dOEHQEPXMu6Ju7Q23n1EBr2wh6K0HiIVCDwCoE/Q2SLpb0ZEkfkPQwSY+W9HBJLz0Bhi+T9C5JX9HFhlD/uKTvkBQyfvlc7L0lvUnSqyU9T1KI/XMlfVrSRZK+MN8Ogp6TfM6X0ZS+jJEziRyAgVMHmfMAgp4z359sr5s+F2z6+J15IGIy54KT5ezQ/+7kQGsfEPRWgsRDoAaBbEF/UCfNIeUvmxtySPv5ks6VtLMPih/rZPuekt7WbXNKdxb9s5LuPhf3TkmndWfPr+/+HnFvkRT7+TUEPT/hnC+jKX0ZsyBBTsmBY/PMsnNB5jyAoOfP/Xu1sGwOIGfTklNnHiAH2msVQW9nyB4gUIFAtqC/QNJDJN1c0q44x7gf2p09v5ekt+4D4o2SbiPpTgv//hRJPy/p1pI+JumrJH1UUvw9Lp2f/7xf0kck3W9B0M/e2dn5xPzfTjvttFEucf/2Vx6qkAeD9OGPf+C8pfczpfHH4DedwaaPnxw4NgUsmweZ88Bn3n8o7r340rnpwAF9+dcuP2f1meSWHX/sM5NBnz4Pvc2mM9j08TvzwNTqwMmB1joMQf/c5z533G62trbOmc1mX3K7Z2tbxEMAAnkEsgU9znxvSbrbwhDi7Pl7JD1O0vP3Gd7fSPrT7t71+U3iEve4v/z+kuJMfPz3dd2l769Z2NcrJcWPALea//t11113pyNHjvxVHlb2DAEIQAACEIAABCAAgXEJHDx48M5nnHFGPP+JDwQgsCYEsgU97jmPU8QPWOBxS0kfl/RUSc/eh9U/SnqRpMcv/Ps3dWfddy+bj/++RFL8/e0L2/6GpEdJivvZb/gg6GuSnXQTAhCAAAQgAAEIQMAmgKDb6AiEwGgEViHoH5L0wH0Efa/L0nc3DUF/oaQf3UfQ4zL5eBL8rqDfQ9I79hD0R0q6CYI+Wo7RMAQgAAEIQAACEIDACAQQ9BGg0yQEGglkCzqXuDceIMIhAAEIQAACEIAABCDgEEDQHWrEQGBcAtmCHveXx5nuxYfExYPj4qnuJ3pIXNxfHg+Ju/MConhdW1wWHw+Hi8vkdx8SF3+PV6vNf+Kem2sWHxJ39OjRre3t7TvOb3jgwIFPSdrjSULjHiBahwAEIAABCEAAAhCAQA8CB44ePXrm/Haz2ezqAwcO7PfGpB67ZBMIQGDVBLIFPS5tjwe3hZC/fG5wr5V0l5O8Zi0ubf9VSfOXrsdr1q6UFK9Zi7/vfuLS9ptJunDutW3x73EGP/bz66sGS3sQgAAEIAABCEAAAhCAAAQgAIFlCGQLevQlzoRfJOlJkj7YnVF/jKRHdA93i23iXvO4V/wO3WvR4m/xYLd3SzpDUpwdj1dExDvNv1PSfSRdPjfQb5UUr2X7g07qz+5eufaZru0vLAOFbSEAAQhAAAIQgAAEIAABCEAAAqsmsApBP13Ss7rXpcVlN3HZeVyiHg942/28uBP020v68Nzfz5F0qaQHd2fI4+z5T0l60x6g7ivp57qz6J/vXsX2k53Yr5prhfaC+zMXuMd74ue5V+hnZh9mXb7ElRV3lXQLST8r6WcyGy2072/vfgi7Z3e7yN9LeldXJ/Hj19Q/cdxj7vkGSWdJ+gdJ75f0PEm/O/XB7zO+R0t6gaR4UW7MEVP/xI+3/3OfQe715o8p8/jm7s0pMe54cOpHJf22pGdMedCSdtcX+w1zU/IgvgP/Q/fa26/obv97qaRfkBRrpql/4nW/kevxfRhr3yskPV3SW6Y+cMYHAQisH4FVCPr6UZlGj+PKhYu7qw/idXfxtPtYnD9cUnwpb8Lndt0tEVdJCgYx/k0S9FdK+qeS4r9/2UnqE7qrSu4v6Y8nngQhZ3F7zZ9J+pik07r8j7/FD33xA9YmfeJ5He/t5PzLN0zQ45Wei6L+nu52qU3IgZj/f0fSK7r5P24TiyvWbtX9YDdlBjHO+IFu8RNX3MXVdbeduzVuqhy+rrsiMX6g/HlJ/1fSP+sE9dWSvnuqA+/GFWuhP5X0Tkn/sRP0J3Y/3H9bdzvkxBEwPAhAYJ0IIOjrdLT69/VBkuJLd/dd8buRIe3nn+Te//6t1N9yN7/j4X9x9vyTGybocatH3Boy/4mzpnGrSchJ3CqyiZ+3d2Jy7oYNPoQkaiEeiPnPN0zQf0DSf9uw47073PhhJsQszpbHbWJ8pHtLenP3I138WDf1T/wY+TRJXy0pXn27+/kNSY+VFFc3fnrCEF7XXV153tzVAnGF3aHux/t4YDEfCEAAAmUIIOhlDsWgHYlLWOMs4eLT8+OJ+nH2/ERPzx+0I4V2tomCvh/+OHMei/avLXR8VtmVP5QUZ5RisbYpn3jmRzx0M8Ydi3UEfVOO/LHLmuO2nrii6CObM+wTjjR+rIiaiLPr/2cDmOzmQFxJEGfPdz/x5pt/3z3rJ257mepnuztpEeui+c9/l/R93Q+2fzPVwTMuCEBg/Qgg6Ot3zPr0uOX98332v47bIOjHjlpc2hyL9JD0WJhswuegpPhf/GAVZ1J/RdJPSIqzR5vwiSsp4haHn+4kPe7J3TRBjytJ4naPuNc25se4FzVufdiEzx91Zw/jiqoQsq/vrqL4PUlxme91mwBhbowxB4aMxb3H8eyaTfjEjzN/3j2/Jx7YG1eTxVUE8SyO+LHiX00cQtzKEM/fiYcRz3/ihEWcuIhbvuIKQz4QgAAEShBA0EschsE7Efdbx6VbD1jY8y27d8fH/ZjxoL5N+iDox452LMh+sHtN4SY8KC7GHK9ZfFyX7P8o6d9I+rUNSv64tDtqPx4SFpe4b5Kgx4OxYlEelzP/XXeJbzw89GskfYek129AHsSDWeM+68PdvB8/UMQ9ufE8jv8l6Vu6vNgAFF8c4uO7+g8x26SHpt5J0qskxX93P/+pmw9jXpjyJ36ciFfx3lnSkW6g8dreuPUjrqRavB1wyiwYGwQgsAYEEPQ1OEhGF0PQ4z6zeA/9/GdX0J/SvYbO2PXahiDox84axlNr/6Wk/7K2R3L5jse95nEWOf4Xr2mMey7jLFI8vXjqn+/vbmsJUY2z6PHZJEHf6/jGE6z/ojuLfMHUE6C7x/aOkhbn/X8t6Ze7s8h7vRllqmji6d3xxpi4zWdTXsEaZ9DjVbSfkPRL3Rn0u3ffB/ED3o9M9WB34/rh7nW+8cNsvNkjrqiKy/4fJWmruyXw5RNnwPAgAIE1IoCgr9HBWqKrXOL+pbA2XdB370GMBwXFU3w3+ROLtHiifzzBOi71nOpn94GAcdXE/BPr417075J06+6s6pTvPd3v2EYOxJnUOKsWr9+b8ie+D+4h6Ru7y5x3xxpXEcQZxPixKl5nugmfu0iKt3rEbS5xJc2mfOJKgXhaeZwtnq/3H5L0IknxxovLJw4j8jx+oN59vWTUxZ90+R9XkWzKLS8TP8wMDwLTIICgT+M4Lo7i+d19VYsPiYsHpLyMh8RtzHvQd/NiV87jQVFxWeumf3YXpSEt75gwjDhrdrIHYP2+pO+ZMIP9hrZ728NNJf2/iY9/90ndi4IeD4mMy9/jkv9NuJokDnOIedxv/Q3dmywmfuhvGF4c57jvPiR9/hPPI4irSeKZHM/bABhfJimuJomHxsWzWKI24tWz8fC8qf9QtwGHlyFCYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoEEPTpHEtGAgEIQAACEIAABCAAAQhAAAJrleoPKAAAACFJREFUTABBX+ODR9chAAEIQAACEIAABCAAAQhAYDoE/j/aObmA3VowYQAAAABJRU5ErkJggg==\" width=\"800\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Final posterior: [0.121 0.102 0.033 0.094 0.151 0.121 0.102 0.033 0.094 0.151]\n"
     ]
    }
   ],
   "source": [
    "measurements = [1, 0, 1, 0, 0, 0]\n",
    "discrete_bayes_sim(prior, kernel, measurements, z_prob);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "That one bad measurement has significantly eroded our knowledge. Now let's continue with a series of correct measurements."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAjgAAAGECAYAAAA7lVplAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3X2wZHV97/v3xxkGRXCbI2oUUDDuazkxOcIZn0KClmAYYg4mOaQy5PhAjubhXifReFMJGAsJMSGaRE0lnFyNmMNRERH13rlmIpp4TSqpyJkRNAojMiDC5kHU4I6aqIx+7x+9BpvNfuiZ+fXu3Wu/X1Vdu1f3r7/r1716vvNdv99aq1NVSJIk9cmDJt0BSZKk1ixwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHB2wJBckeecY429PsjvJt5L8j3GtR9LaNs5ck+TwJJck+UKSryW5NskZ41iXJmPjpDsgLeIO4HXA6cBDJtwXSf20EbgNeDZwK/ATwBVJfqiqbplkx9SGIzhaUpLfSnJ7t3dzQ5JTk2wFXg38XJKvJ/lU13am2xu6s3vN65Js6J47J8k/JvnTJPNJPpvk1KXWW1Xvr6r/G/jKqrxRSRM1iVxTVd+oqguq6paq+m5VfRD4PPCfVut9a7wcwdGikjwJ2A48raruSHI8sKGqbkry+8ATq+qFQy+5FPgi8ETgocAHGewdvaV7/hnAlcDRwM8A709yQlX9y2q8H0lr01rJNUkeDfxvwHWt3psmyxEcLeU7wOHA5iSHdXs5Ny3WsEsMZwCv7PaK7gbeBGwbanY38Oaqureq3gPcADx/vG9B0hSYeK5JchjwLuDSqvrsob8lrQWO4GhRVbU3ySuBC4AfTHIV8KqqumOR5o8HDgPuTLL/sQcx2Kva7/a6/y+7fgF4bPOOS5oqk841SR4EvAP4NoORJPWEIzhaUlVdVlU/yiCpFPD6/U8taHob8C3g6Kp6eHd7WFX94FCbYzKUkYDHMTiYWNI6N6lc07W7BHg08F+q6t4Gb0drhAWOFpXkSUmem+Rw4JvAvzMYSobB/Pfx3Z4PVXUn8GHgj5M8LMmDkvxAkmcPhXwU8GtJDkvys8CTgZ1LrHtjkgcDG4ANSR6cxNFGqYcmmWuAP++e/89V9e/t350myQJHSzkc+APgy8BdDJLGq7vn3tv9/UqSa7r7LwY2AdcD9zA4yO8xQ/GuBma7eL8HnFVVS50l9RoGSe5c4IXd/dcc+luStAZNJNckeTzwy8BTgbu6M7W+nuS/NnxvmqDcf6pSai/JOcDLuiFoSRoLc42GOYIjSZJ6Z6QCJ8nW7uJLe5Ocu0y7s5JUki3tuihpvTDXSGplxSmq7gqRnwOeB8wBu4Czq+r6Be2OAv6Kwdzo9qraPZYeS+olc42klkY5M+XpwN6quhkgyeXACxgc4DXsd4E3AL+xWJD5+XkP9pHWoZmZmazcCmiQa8wz0vq1MNeMMkV1DPe/iNJc99h9kpwIHNf9lockHQxzjaRmRhnBWWzv6769pO76BG8CzmnUJ0nrk7lGUjOjFDhzwHFDy8dy/6tCHgU8BfhYd/HI7wd2JDlzqbnxmZmZg+vtkN27B6G3bBnPMYbjjG/fVz/2uOPb9/ubn58/mJc1zTUt8gxM32e/WvHt+2TiT2vsccVfLteMMkW1C5hNckKSTQx+1GzH/ierar6qjq6q46vqeODjwJLFjSQtwVwjqZkVC5yq2sfgB8iuAvYAV1TVdUkuTHLmuDsoaX0w10hqaaTf96mqnSz4LY+qOn+Jts859G5JWo/MNZJa8UrGkiSpdyxwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb1jgSNJknpnpAInydYkNyTZm+TcRZ7/lSSfTvLJJP+QZHP7rkrqO3ONpFZWLHCSbAAuBs4ANgNnL5JULquqH6qqpwJvAN7YvKeSes1cI6mlVNXyDZJnARdU1end8nkAVXXREu3PBl5cVWcMPz4/P3/fim688cZD7LaktWx2dva++zMzMxnlNS1yjXlGWl+WyzUbR3j9McBtQ8tzwDMWNkrycuBVwCbguQfTUUnrmrlGUjOjFDiL7X09YNinqi4GLk7y88BrgJcsFXDLli0jd3Apu3fvbhZrtePb99WPPe749v3+5ufnD+ZlTXNNq/czbZ/9asW375OJP62xxxV/uVwzykHGc8BxQ8vHAncs0/5y4KdG6pkkfY+5RlIzoxQ4u4DZJCck2QRsA3YMN0gyO7T4fMDJb0kHylwjqZkVp6iqal+S7cBVwAbg7VV1XZILgd1VtQPYnuQ04F7gHpaZnpKkxZhrJLU0yjE4VNVOYOeCx84fuv+Kxv2StA6ZayS14pWMJUlS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb1jgSNJknrHAkeSJPXOSAVOkq1JbkiyN8m5izz/qiTXJ/nnJH+b5PHtuyqpz8wzklpascBJsgG4GDgD2AycnWTzgmbXAluq6oeBK4E3tO6opP4yz0hqLVW1fIPkWcAFVXV6t3weQFVdtET7E4E/q6qThx+fn5+/b0U33njjIXZb0lo2Ozt73/2ZmZms1N48I+lgLJdrRpmiOga4bWh5rntsKS8F/voA+idJ5hlJTW0coc1ie1+LDvskeSGwBXj2cgG3bNkywmqXt3v37maxVju+fV/92OOOb9/vb35+/kBfsibzDEzfZ79a8e37ZOJPa+xxxV8u14xS4MwBxw0tHwvcsbBRktOA3waeXVXfOsA+SlrfJpZnTnzHSlNZM4M/e5Zvd+2LZpd9XqvHbSoYbYpqFzCb5IQkm4BtwI7hBt18+FuAM6vq7vbdlNRz5hlJTa1Y4FTVPmA7cBWwB7iiqq5LcmGSM7tmfwgcCbw3ySeT7FginCQ9gHlGUmujTFFRVTuBnQseO3/o/mmN+yVpnTHPHJiVp2HAqZjp4/RaO17JWJIk9Y4FjiRJ6h0LHEmS1DsWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb1jgSNJknpnpAv99c00XyBr3H2f5otMTWvfp2WbLhVfktYiR3AkSVLvWOBIkqTescCRJEm9Y4EjSZJ6Z6QCJ8nWJDck2Zvk3EWePyXJNUn2JTmrfTcl9Z15RlJLKxY4STYAFwNnAJuBs5NsXtDsVuAc4LLWHZTUf+YZSa2Ncpr404G9VXUzQJLLgRcA1+9vUFW3dM99d5SV7t69+4A72jbWzITXfyivHXff28Rf/c8Fprfv07FNl47/QLOzB3w6+QTzjN+byfx7HWf8yW/Tg3/95Pu+Nrfp4pbLNaNMUR0D3Da0PNc9JkmtmGckNTXKCE4WeawOZaVbtmw5lJcD36sADyrWCBc0G9XBrH9N971R/FX/XGB6+z4l23TJ+IuYn58/0NCTyzN+bybz73Wc8Se4TWF6+76mt+kSlss1o4zgzAHHDS0fC9xxiH2SpGHmGUlNjVLg7AJmk5yQZBOwDdgx3m5JWmfMM5KaWrHAqap9wHbgKmAPcEVVXZfkwiRnAiR5WpI54GeBtyS5bpydltQv5hlJrY30Y5tVtRPYueCx84fu72IwpCxJB8U8I6klr2QsSZJ6xwJHkiT1zkhTVJIktXLiO0Y5Fbq74N0Kp01f+6IDvqikxmAtblNHcCRJUu9Y4EiSpN6xwJEkSb2zZo/BWXk+b7S5PFj9Odpp7vs4TfPnMs19l6T1yBEcSZLUOxY4kiSpd9bsFJUkTbtpntqc5r6P01o8HXpU622bOoIjSZJ6xwJHkiT1jgWOJEnqnZEKnCRbk9yQZG+Scxd5/vAk7+mevzrJ8a07Kqn/zDWSWlmxwEmyAbgYOAPYDJydZPOCZi8F7qmqJwJvAl7fuqOS+s1cI6mlUUZwng7sraqbq+rbwOXACxa0eQFwaXf/SuDUJGnXTUnrgLlGUjOpquUbJGcBW6vqZd3yi4BnVNX2oTaf6drMdcs3dW2+vL/N/Pz88iuS1EszMzMjFSAtco15Rlq/FuaaUUZwFktOC5PIKG0kaTnmGknNjFLgzAHHDS0fC9yxVJskGxlcLehfWnRQ0rphrpHUzChXMt4FzCY5Abgd2Ab8/II2O4CXAP8EnAV8tBbMfY06TC1p3TrkXGOekbTfigVOVe1Lsh24CtgAvL2qrktyIbC7qnYAlwDvSLKXwd7UtnF2WlL/mGsktbTiQcZrVZKtwJ8wSIRvq6o/aBj77cBPAndX1VNaxe1iHwf8T+D7ge8Cb62qP2kU+8HA3wOHMyher6yq17aIPbSODcBu4Paq+snGsW8BvgZ8B9hXVVsaxn448DbgKQyO2fhvVfVPjWI/CXjP0ENPAM6vqjc3iv/rwMsY9PvTwC9U1TdbxO7ivwL4RQbHt/xFq373xbhyzbTmmS6+uWbp2OaaxWOvfp6pqqm7MUg0NzHYuJuATwGbG8Y/BTgJ+MwY+v4Y4KTu/lHA51r1vfviHNndPwy4Gnhm4/6/CrgM+OAYPptbgKPH9J25FHhZd38T8PAxrWcDcBfw+EbxjgE+DzykW74COKdhf58CfAY4gsF/VH8DzI7js5nG2zhzzbTmmS6muWbp2OaaB8aeSJ6Z1p9qGOV6GQetqv6eMR24WFV3VtU13f2vAXsYfLFaxK6q+nq3eFh3azZEl+RY4PkM9k6mRpKHMfjP5BKAqvp2VX11TKs7Fbipqr7QMOZG4CHdQbVH8MADbw/Fk4GPV9W/VdU+4O+An24Yf9qNLddMa57pYpprFmGuWdJE8sy0FjjHALcNLc/R8B/vaukuM38ig72fVjE3JPkkcDfwkapqFht4M/CbDIa8x6GADyf5RJJfahj3CcCXgL9Mcm2StyV5aMP4w7YB724VrKpuB/4IuBW4E5ivqg+3is9gr+qUJI9IcgTwE9z/TKb1bupzzTjyTBfXXPNA5prFTSTPTGuBM/XXwkhyJPA+4JVV9a+t4lbVd6rqqQxOsX16kiZz+0n2HyvwiRbxlnByVZ3E4FL9L09ySqO4GxlMBfx5VZ0IfAN4wO8cHaokm4Azgfc2jPl9DEYMTgAeCzw0yQtbxa+qPQx+7uAjwIcYTMHsaxW/B6Y614wrz4C5ZgnmmkVMKs9Ma4EzyvUy1qwkhzFIOu+qqvePYx3dsOjHgK2NQp4MnNkdnHc58Nwk72wUG4CquqP7ezfwAQbTAy3MAXNDe5hXMkhCrZ0BXFNVX2wY8zTg81X1paq6F3g/8CMN41NVl1TVSVV1CoMpkxtbxp9yU5trViPPgLlmAXPNEiaRZ6a1wLnvehldJbuNwfUx1rzud3MuAfZU1Rsbx35kdwQ/SR7C4Av72Raxq+q8qjq2qo5n8Hl/tKqajSQkeWiSo/bfB36cwbDmIauqu4DbujMQYDB3fX2L2AucTcMh486twDOTHNF9d05lcDxFM0ke1f19HPAztH8P02wqc80480wX31yzCHPN0iaRZ0a50N+aU0tcL6NV/CTvBp4DHJ1kDnhtVV3SKPzJwIuAT3fz1wCvrqqdDWI/Bri0O73yQcAVVfXBBnFXw6OBD3S/m7gRuKyqPtQw/q8C7+r+k7oZ+IWGsenmlZ8H/HLLuFV1dZIrgWsYDOleC7y15TqA9yV5BHAv8PKquqdx/Kk1zlwzxXkGzDXLMdcsbtXzzNReB0eSJGkp0zpFJUmStCQLHEmS1DsWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb1jgSNJknrHAkeSJPWOBY4kSeodCxxJktQ7FjiSJKl3LHAkSVLvWOBIkqTescDRAUtyQZJ3jjH+O5PcmeRfk3wuycvGtS5Ja9e4c83QemaTfHM11qXVY4Gjtegi4PiqehhwJvC6JP9pwn2S1F8XA7sm3Qm1ZYGjJSX5rSS3J/lakhuSnJpkK/Bq4OeSfD3Jp7q2M0ku6UZebk/yuiQbuufOSfKPSf40yXySzyY5dan1VtV1VfWt/Yvd7QfG/HYlTcikck33mm3AV4G/Hff71OqywNGikjwJ2A48raqOAk4HbqmqDwG/D7ynqo6sqv/YveRSYB/wROBE4MeB4amlZwA3A0cDrwXen+Q/LLP+/57k34DPAncCO1u+P0lrwyRzTZKHARcC/2fzN6aJs8DRUr4DHA5sTnJYVd1SVTct1jDJo4EzgFdW1Teq6m7gTcC2oWZ3A2+uqnur6j3ADcDzl1p5Vf0fwFHAjwHvB761VFtJU22SueZ3gUuq6rZWb0ZrhwWOFlVVe4FXAhcAdye5PMljl2j+eOAw4M4kX03yVeAtwKOG2txeVTW0/AVgqXj7+/CdqvoH4Fjgfz+4dyJpLZtUrknyVOA0BgWSesgCR0uqqsuq6kcZJJUCXr//qQVNb2MwwnJ0VT28uz2sqn5wqM0xSTK0/DjgjhG7shGPwZF6a0K55jnA8cCtSe4CfgP4L0muOeQ3pDXBAkeLSvKkJM9NcjjwTeDfGQwlA3wROD7JgwCq6k7gw8AfJ3lYkgcl+YEkzx4K+Sjg15IcluRngSezyHE1SR6VZFuSI5NsSHI6cDbw0bG9WUkTM6lcA7yVwY7TU7vb/wX8FYNjgNQDFjhayuHAHwBfBu5ikDRe3T333u7vV4b2dl4MbAKuB+4BrgQeMxTvamC2i/d7wFlV9ZVF1lsMpqPmujh/xGC+/f9p87YkrTETyTVV9W9Vddf+G/B14JtV9aWWb06Tk/tPVUrtJTkHeFk3BC1JY2Gu0TBHcCRJUu+MVOAk2dpdfGlvknOXaXdWkkqypV0XJa0X5hpJraw4RdVdIfJzwPMYHBexCzi7qq5f0O4oBgdobQK2V9XusfRYUi+ZayS1tHGENk8H9lbVzQBJLgdewOAAr2G/C7yBwal2DzA/P+/BPtI6NDMzk5VbAQ1yjXlGWr8W5ppRpqiOYXDtgf3musfuk+RE4Liq+uAh91DSemWukdTMKCM4i+193beX1F2f4E3AOY36JGl9MtdIamaUAmcOOG5o+Vjuf1XIo4CnAB/rLh75/cCOJGcuNTc+MzNzcL0dsnv3IPSWLeM5xnCc8e376sced3z7fn/z8/MH87KmuaZFnoHp++xXK759n0z8aY09rvjL5ZpRpqh2AbNJTkiyicGPmu3Y/2RVzVfV0VV1fFUdD3wcWLK4kaQlmGskNbNigVNV+xj8lP1VwB7giqq6LsmFSc4cdwclrQ/mGkktjTJFRVXtZMFveVTV+Uu0fc6hd0vSemSukdSKVzKWJEm9Y4EjSZJ6xwJHkiT1jgWOJEnqHQscSZLUOxY4kiSpdyxwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsjFThJtia5IcneJOcu8vyvJPl0kk8m+Yckm9t3VVLfmWsktbJigZNkA3AxcAawGTh7kaRyWVX9UFU9FXgD8MbmPZXUa+YaSS2lqpZvkDwLuKCqTu+WzwOoqouWaH828OKqOmP48fn5+ftWdOONNx5ityWtZbOzs/fdn5mZySivaZFrzDPS+rJcrtk4wuuPAW4bWp4DnrGwUZKXA68CNgHPPZiOSlrXzDWSmhmlwFls7+sBwz5VdTFwcZKfB14DvGSpgFu2bBm5g0vZvXt3s1irHd++r37scce37/c3Pz9/MC9rmmtavZ9p++xXK759n0z8aY09rvjL5ZpRDjKeA44bWj4WuGOZ9pcDPzVSzyTpe8w1kpoZpcDZBcwmOSHJJmAbsGO4QZLZocXnA05+SzpQ5hpJzaw4RVVV+5JsB64CNgBvr6rrklwI7K6qHcD2JKcB9wL3sMz0lCQtxlwjqaVRjsGhqnYCOxc8dv7Q/Vc07pekdchcI6kVr2QsSZJ6xwJHkiT1jgWOJEnqHQscSZLUOyMdZCxJWltOfMcoZ8jPDP7sWb7ttS+aXfZ5rZ6Vt6vbdFSO4EiSpN6xwJEkSb1jgSNJknrHAkeSJPWOBY4kSeodCxxJktQ7FjiSJKl3LHAkSVLvjFTgJNma5IYke5Ocu8jzr0pyfZJ/TvK3SR7fvquS+sw8I6mlFQucJBuAi4EzgM3A2Uk2L2h2LbClqn4YuBJ4Q+uOSuov84yk1lJVyzdIngVcUFWnd8vnAVTVRUu0PxH4s6o6efjx+fn5+1Z0442jXGJc0rSanf3eZeJnZmayUnvzzIH7xT0zzWL9xZPnm8XSoWm1XdfLNl0u14zyW1THALcNLc8Bz1im/UuBvz6A/q06E0M/mRimWu/yjKTJGqXAWWzva9FhnyQvBLYAz14u4JYtW0ZY7fJ279598LFW+JGyA3Ew6z+kvk84/pqO3Wi7uk0P3fz8AReJazLPwBr+7M1jazL2Icc3jx2Q5XLNKAXOHHDc0PKxwB0LGyU5Dfht4NlV9a0D7KOk9c08I6mpUc6i2gXMJjkhySZgG7BjuEE3H/4W4Myqurt9NyX1nHlGUlMrjuBU1b4k24GrgA3A26vquiQXAruragfwh8CRwHuTANxaVWeOsd/r1onvGGX4sjsWZYWhzmtfNLvs81odblPzjKT2Rpmioqp2AjsXPHb+0P3TGvdL0jpjnpHUklcyliRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb1jgSNJknrHAkeSJPWOBY4kSeodCxxJktQ7IxU4SbYmuSHJ3iTnLvL8KUmuSbIvyVntuymp78wzklrauFKDJBuAi4HnAXPAriQ7qur6oWa3AucAvzGOTkrqt0nmmRPfceMKLWYGf/Ys3+7aF8226ZAOmdtUMEKBAzwd2FtVNwMkuRx4AXBf4qmqW7rnvjvKSnfv3n3AHW0ba2bC6z+U105z38cdu81n4zY9dLOzB/wfwwTzjN+btfK9aRd/8tv04F8/+b6vzW26uOVyzShTVMcAtw0tz3WPSVIr5hlJTY0ygpNFHqtDWemWLVsO5eXA9yrAg4q1wrDkgTiY9a/bvo87dqPPxm166Obn5w/0JZPLM35v1sz3pln8CW5TmN6+r+ltuoTlcs0oIzhzwHFDy8cCdxxinyRpmHlGUlOjFDi7gNkkJyTZBGwDdoy3W5LWGfOMpKZWnKKqqn1JtgNXARuAt1fVdUkuBHZX1Y4kTwM+AHwf8J+T/E5V/eBYey6pN8wz68vKZzmBZzpNl7W4TUc5Boeq2gnsXPDY+UP3dzEYUpakg2KekdSSVzKWJEm9Y4EjSZJ6Z6QpKq0fXgG0f1ptU3C7SpoejuBIkqTescCRJEm9Y4EjSZJ6xwJHkiT1jgWOJEnqHQscSZLUO2v2NHFPbe0ft6k0Pfz32j/rbZuu2QJnmq23L9F64DbVwfB70z9r8TeXtDinqCRJUu9Y4EiSpN4ZqcBJsjXJDUn2Jjl3kecPT/Ke7vmrkxzfuqOS+s9cI6mVFQucJBuAi4EzgM3A2Uk2L2j2UuCeqnoi8Cbg9a07KqnfzDWSWkpVLd8geRZwQVWd3i2fB1BVFw21uapr809JNgJ3AY+soeDz8/PLr0hSL83MzGSUdi1yjXlGWr8W5ppRpqiOAW4bWp7rHlu0TVXtA+aBRxx8NyWtQ+YaSc2MUuAstve1cC9plDaStBxzjaRmRrkOzhxw3NDyscAdS7SZ64aNZ4B/GW4w6jC1pHXrkHONeUbSfqOM4OwCZpOckGQTsA3YsaDNDuAl3f2zgI/WSgf3SNL9mWskNbNigdPNc28HrgL2AFdU1XVJLkxyZtfsEuARSfYCrwIecHpnayudTnqIsd+e5O4kn2kZt4t9XJL/L8meJNcleUXD2A9O8r+SfKqL/TutYg+tY0OSa5N8cAyxb0ny6SSfTLK7ceyHJ7kyyWe7z/5ZDWM/qevz/tu/Jnllw/i/3m3PzyR5d5IHt4rdxX9FF/u6lv0+UOst10xrnunim2uWjm2uWTz26ueZqpq6G7ABuAl4ArAJ+BSwuWH8U4CTgM+Moe+PAU7q7h8FfK5V3xkcn3Bkd/8w4GrgmY37/yrgMuCDY/hsbgGOHtN35lLgZd39TcDDx7SeDQzO7Hl8o3jHAJ8HHtItXwGc07C/TwE+AxzBYMr6b4DZcXw203gbZ66Z1jzTxTTXLB3bXPPA2BPJM9N6JeOnA3ur6uaq+jZwOfCCVsGr6u9ZcAxRw9h3VtU13f2vMdhTXXimyMHGrqr6erd4WHdrNnyf5Fjg+cDbWsVcDUkexuA/k0sAqurbVfXVMa3uVOCmqvpCw5gbgYd0x5wcwQOPSzkUTwY+XlX/VoMRlL8Dfrph/Gk3tlwzrXmmi2muWYS5ZkkTyTPTWuCMcjrpmtddhfVEBns/rWJuSPJJ4G7gI1XVLDbwZuA3ge82jDmsgA8n+USSX2oY9wnAl4C/7Ia835bkoQ3jD9sGvLtVsKq6Hfgj4FbgTmC+qj7cKj6DvapTkjwiyRHAT3D/A33Xu6nPNePIM11cc80DmWsWN5E8M60FztSfKprkSOB9wCur6l9bxa2q71TVUxmcgfL0JE9pETfJTwJ3V9UnWsRbwslVdRKDK9m+PMkpjeJuZDAV8OdVdSLwDcZw7EZ3YOyZwHsbxvw+BiMGJwCPBR6a5IWt4lfVHgZXA/4I8CEGUzD7WsXvganONePKM2CuWYK5ZhGTyjPTWuCMcjrpmpXkMAZJ511V9f5xrKMbFv0YsLVRyJOBM5PcwmCY/rlJ3tkoNgBVdUf3927gAwymB1qYA+aG9jCvZJCEWjsDuKaqvtgw5mnA56vqS1V1L/B+4EcaxqeqLqmqk6rqFAZTJje2jD/lpjbXrEaeAXPNAuaaJUwiz0xrgTPK6aRrUpIwmJ/dU1VvbBz7kUke3t1/CIMv7GdbxK6q86rq2Ko6nsHn/dGqajaSkOShSY7afx/4cQbDmoesqu4CbkvypO6hU4HrW8Re4GwaDhl3bgWemeSI7rtzKoPjKZpJ8qju7+OAn6H9e5hmU5lrxplnuvjmmkWYa5Y2iTwzyoX+1pyq2pdk/+mkG4C3V9V1reIneTfwHODoJHPAa6vqkkbhTwZ6vIB2AAAQ3klEQVReBHy6m78GeHVV7WwQ+zHApRn8aOGDGJxm2/wUyzF5NPCBwb8rNgKXVdWHGsb/VeBd3X9SNwO/0DA23bzy84Bfbhm3qq5OciVwDYMh3WuBt7ZcB/C+JI8A7gVeXlX3NI4/tcaZa6Y4z4C5ZjnmmsWtep5Z8cc2JUmSps20TlFJkiQtyQJHkiT1jgWOJEnqHQscSZLUOxY4kiSpdyxwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsWOJIkqXcscHTAklyQ5J1jjP+xJN9M8vXudsO41iVp7Rp3runWsS3JniTfSHJTkh8b5/q0ejZOugPSErZX1dsm3QlJ/ZXkecDrgZ8D/hfwmMn2SC05gqMlJfmtJLcn+VqSG5KcmmQr8Grg57rRlU91bWeSXJLkzu41r0uyoXvunCT/mORPk8wn+WySUyf53iStHRPMNb8DXFhVH6+q71bV7VV1+/jfsVaDBY4WleRJwHbgaVV1FHA6cEtVfQj4feA9VXVkVf3H7iWXAvuAJwInAj8OvGwo5DOAm4GjgdcC70/yH5bpwkVJvtwlq+c0fGuS1pBJ5ZquKNoCPDLJ3iRzSf4syUPG8ka16ixwtJTvAIcDm5McVlW3VNVNizVM8mjgDOCVVfWNqrobeBOwbajZ3cCbq+reqnoPcAPw/CXW/VvAE4BjgLcC/2+SH2jyriStNZPKNY8GDgPOAn4MeCqDguk1jd6XJswCR4uqqr3AK4ELgLuTXJ7ksUs0fzyDRHFnkq8m+SrwFuBRQ21ur6oaWv4CsGi8qrq6qr5WVd+qqkuBfwR+4tDekaS1aIK55t+7v39aVXdW1ZeBN2Ku6Q0LHC2pqi6rqh9lkFSKwcF4dPeH3QZ8Czi6qh7e3R5WVT841OaYJBlafhxwx6hdAbJiK0lTaRK5pqruAeYWWYd6wgJHi0rypCTPTXI48E0Gezvf6Z7+InB8kgcBVNWdwIeBP07ysCQPSvIDSZ49FPJRwK8lOSzJzwJPBnYust6HJzk9yYOTbEzyX4FTgKvG9mYlTcykck3nL4FfTfKoJN/HYCTpg83fpCbCAkdLORz4A+DLwF0Mksaru+fe2/39SpJruvsvBjYB1wP3AFdy/1MurwZmu3i/B5xVVV9ZZL2HAa8DvtS1/VXgp6rKa+FI/TSpXAPwu8Au4HPAHuDa7jXqgdx/qlJqL8k5wMu6IWhJGgtzjYY5giNJknpnpAInydbu4kt7k5y7TLuzklSSLe26KGm9MNdIamXFKaruYkifA57H4IjzXcDZVXX9gnZHAX/FYG50e1XtHkuPJfWSuUZSS6P8FtXTgb1VdTNAksuBFzA4wGvY7wJvAH5jsSDz8/Me7COtQzMzM6Oe4n/IucY8I61fC3PNKFNUxzC49sB+c91j90lyInBcVXl6naSDZa6R1MwoIziL7X3dt5fUXZ/gTcA5jfokaX0y10hqZpQCZw44bmj5WO5/VcijgKcAH+suHvn9wI4kZy41Nz4zM3NwvR2ye/cg9JYt4znGcJzx7fvqxx53fPt+f/Pz8wfzsqa5pkWegen77Fcrvn2fTPxpjT2u+MvlmlGmqHYBs0lOSLKJwY+a7dj/ZFXNV9XRVXV8VR0PfBxYsriRpCWYayQ1s2KBU1X7GPyU/VUMrvR4RVVdl+TCJGeOu4OS1gdzjaSWRpmioqp2suC3PKrq/CXaPufQuyVpPTLXSGrFKxlLkqTescCRJEm9Y4EjSZJ6xwJHkiT1jgWOJEnqHQscSZLUOxY4kiSpdyxwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6p2RCpwkW5PckGRvknMXef5Xknw6ySeT/EOSze27KqnvzDWSWlmxwEmyAbgYOAPYDJy9SFK5rKp+qKqeCrwBeGPznkrqNXONpJZSVcs3SJ4FXFBVp3fL5wFU1UVLtD8beHFVnTH8+Pz8/H0ruvHGGw+x25LWstnZ2fvuz8zMZJTXtMg15hlpfVku12wc4fXHALcNLc8Bz1jYKMnLgVcBm4DnHkxHJa1r5hpJzYxS4Cy29/WAYZ+quhi4OMnPA68BXrJUwC1btozcwaXs3r27WazVjm/fVz/2uOPb9/ubn58/mJc1zTWt3s+0ffarFd++Tyb+tMYeV/zlcs0oBxnPAccNLR8L3LFM+8uBnxqpZ5L0PeYaSc2MUuDsAmaTnJBkE7AN2DHcIMns0OLzASe/JR0oc42kZlacoqqqfUm2A1cBG4C3V9V1SS4EdlfVDmB7ktOAe4F7WGZ6SpIWY65ZP058xyh16czgz57l2177otlln9fqWIvbdJRjcKiqncDOBY+dP3T/FU16I2ldM9dIasUrGUuSpN6xwJEkSb1jgSNJknrHAkeSJPXOSAcZa+1Yi0eq69C4TSWpPUdwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsWOJIkqXdGKnCSbE1yQ5K9Sc5d5PlXJbk+yT8n+dskj2/fVUl9Zp6R1NKKBU6SDcDFwBnAZuDsJJsXNLsW2FJVPwxcCbyhdUcl9Zd5RlJrqarlGyTPAi6oqtO75fMAquqiJdqfCPxZVZ08/Pj8/Px9K7rxxlEuTa/F/OKemWax/uLJ881i6eD1cZvOzn7vJyNmZmayUnvzzPrSx+/8ejepbbpcrhlliuoY4Lah5bnusaW8FPjrkXsnSeYZSY2N8mObi+19LTrsk+SFwBbg2csF3LJlywirXd7u3bubxVrt+IcUe4UfWzwQB7P+Nfu5TDi+2/T+5ucPeK96TeYZWMPfmwnH9zs/mfhrNvaEtulyuWaUAmcOOG5o+VjgjoWNkpwG/Dbw7Kr61si9kyTzjKTGRpmi2gXMJjkhySZgG7BjuEE3H/4W4Myqurt9NyX1nHlGUlMrFjhVtQ/YDlwF7AGuqKrrklyY5Myu2R8CRwLvTfLJJDuWCCdJD2CekdTaKFNUVNVOYOeCx84fun9a435JWmfMM5Ja8krGkiSpdyxwJElS71jgSJKk3rHAkSRJvWOBI0mSescCR5Ik9Y4FjiRJ6h0LHEmS1DsWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb0z0o9t9s2J77hxhFYzgz97lm977YtmD71DamLl7eo2laT1YqQRnCRbk9yQZG+Scxd5/pQk1yTZl+Ss9t2U1HfmGUktrVjgJNkAXAycAWwGzk6yeUGzW4FzgMtad1BS/5lnJLWWqlq+QfIs4IKqOr1bPg+gqi5apO3/AD5YVVcufG5+fv6+Fd144yhTROPzi3tmmsX6iyfPN4s1imnu+7i1+mzcpodudvZ703wzMzNZqX0f84yW1sfv/Ho3qW26XK4ZZYrqGOC2oeW57jFJasU8I6mpUQ4yXmzva/lhnxVs2bLlUF4OwO7duw8+1goHmR6Ig1n/uu37uGM3+mzcpodufv6A96rXZJ6BNf6dn2B8v/OTib9mY09omy6Xa0YZwZkDjhtaPha4Y+S1S9LKzDOSmhqlwNkFzCY5IckmYBuwY7zdkrTOmGckNbVigVNV+4DtwFXAHuCKqrouyYVJzgRI8rQkc8DPAm9Jct04Oy2pX8wzklob6UJ/VbUT2LngsfOH7u9iMKQsSQfFPCOppXV5JWNJ0vJaXRkcvDr4WrHetqkFju7Hnzvon/WW1CQJ/LFNSZLUQ47gSNKYOHrWP/5Y8/RwBEeSJPWOBY4kSeodCxxJktQ7HoMjSVPIY0H6yTNZ27HAkbSu+R9K/7hNBWu4wPHsg/5xm0qSVovH4EiSpN5ZsyM408yRiv5xm0rSdHEER5Ik9c5IBU6SrUluSLI3ybmLPH94kvd0z1+d5PjWHZXUf+YaSa2sWOAk2QBcDJwBbAbOTrJ5QbOXAvdU1ROBNwGvb91RSf1mrpHUUqpq+QbJs4ALqur0bvk8gKq6aKjNVV2bf0qyEbgLeGQNBZ+fn19+RZJ6aWZmJqO0a5FrzDPS+rUw14wyRXUMcNvQ8lz32KJtqmofMA884uC7KWkdMtdIamaUAmexva+Fe0mjtJGk5ZhrJDUzymnic8BxQ8vHAncs0WauGzaeAf5luMGow9SS1q1DzjXmGUn7jTKCswuYTXJCkk3ANmDHgjY7gJd0988CPlorHdwjSfdnrpHUzIojOFW1L8l24CpgA/D2qrouyYXA7qraAVwCvCPJXgZ7U9vG2WlJ/WOukdTSimdRrVVJtgJ/wiARvq2q/qBh7LcDPwncXVVPaRW3i30c8D+B7we+C7y1qv6kUewHA38PHM6geL2yql7bIvbQOjYAu4Hbq+onG8e+Bfga8B1gX1VtaRj74cDbgKcwOGbjv1XVPzWK/STgPUMPPQE4v6re3Cj+rwMvY9DvTwO/UFXfbBG7i/8K4BcZHN/yF6363RfjyjXTmme6+OaapWObaxaPvfp5pqqm7sYg0dzEYONuAj4FbG4Y/xTgJOAzY+j7Y4CTuvtHAZ9r1ffui3Nkd/8w4GrgmY37/yrgMuCDY/hsbgGOHtN35lLgZd39TcDDx7SeDQxOXX58o3jHAJ8HHtItXwGc07C/TwE+AxzB4D+qvwFmx/HZTONtnLlmWvNMF9Ncs3Rsc80DY08kz0zrTzU8HdhbVTdX1beBy4EXtApeVX/PgoOkG8a+s6qu6e5/DdjDA0+FPdjYVVVf7xYP627NhuiSHAs8n8HeydRI8jAG/5lcAlBV366qr45pdacCN1XVFxrG3Ag8pDuo9ggeeODtoXgy8PGq+rcanHb9d8BPN4w/7caWa6Y1z3QxzTWLMNcsaSJ5ZloLnFGul7HmdZeZP5HB3k+rmBuSfBK4G/hIVTWLDbwZ+E0GQ97jUMCHk3wiyS81jPsE4EvAXya5Nsnbkjy0Yfxh24B3twpWVbcDfwTcCtwJzFfVh1vFZ7BXdUqSRyQ5AvgJ7n8m03o39blmHHmmi2uueSBzzeImkmemtcCZ+mthJDkSeB/wyqr611Zxq+o7VfVUBqfYPj1Jk7n9JPuPFfhEi3hLOLmqTmJwqf6XJzmlUdyNDKYC/ryqTgS+ATzgd44OVXfmz5nAexvG/D4GIwYnAI8FHprkha3iV9UeBj938BHgQwymYPa1it8DU51rxpVnwFyzBHPNIiaVZ6a1wBnlehlrVpLDGCSdd1XV+8exjm5Y9GPA1kYhTwbO7A7Ouxx4bpJ3NooNQFXd0f29G/gAg+mBFuaAuaE9zCsZJKHWzgCuqaovNox5GvD5qvpSVd0LvB/4kYbxqapLquqkqjqFwZTJjS3jT7mpzTWrkWfAXLOAuWYJk8gz01rgjHK9jDUpSRjMz+6pqjc2jv3I7gh+kjyEwRf2sy1iV9V5VXVsVR3P4PP+aFU1G0lI8tAkR+2/D/w4g2HNQ1ZVdwG3dWcgwGDu+voWsRc4m4ZDxp1bgWcmOaL77pzK4HiKZpI8qvv7OOBnaP8eptlU5ppx5pkuvrlmEeaapU0iz4xyJeM1p5a4Xkar+EneDTwHODrJHPDaqrqkUfiTgRcBn+7mrwFeXVU7G8R+DHBpd3rlg4ArquqDDeKuhkcDHxj8u2IjcFlVfahh/F8F3tX9J3Uz8AsNY9PNKz8P+OWWcavq6iRXAtcwGNK9Fnhry3UA70vyCOBe4OVVdU/j+FNrnLlmivMMmGuWY65Z3Krnmam9Do4kSdJSpnWKSpIkaUkWOJIkqXcscCRJUu9Y4EiSpN6xwJEkSb1jgSNJknrHAkeSJPXO/w9T7cLZc7LNDQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db588608d0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "with figsize(y=5.5):\n",
    "    measurements = [0, 1, 0, 1, 0, 0]\n",
    "    for i, m in enumerate(measurements):\n",
    "        likelihood = lh_hallway(hallway, z=m, z_prob=.75)\n",
    "        posterior = update(likelihood, prior)\n",
    "        prior = predict(posterior, 1, kernel)\n",
    "        plt.subplot(3, 2, i+1)\n",
    "        book_plots.bar_plot(posterior, ylim=(0, .4), title='step {}'.format(i+1))\n",
    "    plt.tight_layout()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We quickly filtered out the bad sensor reading and converged on the most likely positions for our dog."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Drawbacks and Limitations\n",
    "\n",
    "Do not be mislead by the simplicity of the examples I chose. This is a robust and complete filter, and you may use the code in real world solutions. If you need a multimodal, discrete filter, this filter works.\n",
    "\n",
    "With that said, this filter it is not used often because it has several limitations. Getting around those limitations is the motivation behind the chapters in the rest of this book.\n",
    "\n",
    "The first problem is scaling. Our dog tracking problem used only one variable, $pos$, to denote the dog's position. Most interesting problems will want to track several things in a large space. Realistically, at a minimum we would want to track our dog's $(x,y)$ coordinate, and probably his velocity $(\\dot{x},\\dot{y})$ as well. We have not covered the multidimensional case, but instead of an array we use a multidimensional grid to store the probabilities at each discrete location. Each `update()` and `predict()` step requires updating all values in the grid, so a simple four variable problem would require $O(n^4)$ running time *per time step*. Realistic filters can have 10 or more variables to track, leading to exorbitant computation requirements.\n",
    "\n",
    "The second problem is that the filter is discrete, but we live in a continuous world. The histogram requires that you model the output of your filter as a set of discrete points. A 100 meter hallway requires 10,000 positions to model the hallway to 1cm accuracy. So each update and predict operation would entail performing calculations for 10,000 different probabilities. It gets exponentially worse as we add dimensions. A 100x100 m$^2$ courtyard requires 100,000,000 bins to get 1cm accuracy.\n",
    "\n",
    "A third problem is that the filter is multimodal. In the last example we ended up with strong beliefs that the dog was in position 4 or 9. This is not always a problem. Particle filters, which we will study later, are multimodal and are often used because of this property. But imagine if the GPS in your car reported to you that it is 40% sure that you are on D street, and 30% sure you are on Willow Avenue. \n",
    "\n",
    "A forth problem is that it requires a measurement of the change in state. We need a motion sensor to detect how much the dog moves. There are ways to work around this problem, but it would complicate the exposition of this chapter, so, given the aforementioned problems, I will not discuss it further.\n",
    "\n",
    "With that said, if I had a small problem that this technique could handle I would choose to use it; it is trivial to implement, debug, and understand, all virtues."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Tracking and Control\n",
    "\n",
    "We have been passively tracking an autonomously moving object. But consider this very similar problem. I am automating a warehouse and want to use robots to collect all of the items for a customer's order. Perhaps the easiest way to do this is to have the robots travel on a train track. I want to be able to send the robot a destination and have it go there. But train tracks and robot motors are imperfect. Wheel slippage and imperfect motors means that the robot is unlikely to travel to exactly the position you command. There is more than one robot, and we need to know where they all are so we do not cause them to crash.\n",
    "\n",
    "So we add sensors. Perhaps we mount magnets on the track every few feet, and use a Hall sensor to count how many magnets are passed. If we count 10 magnets then the robot should be at the 10th magnet. Of course it is possible to either miss a magnet or to count it twice, so we have to accommodate some degree of error. We can use the code from the previous section to track our robot since magnet counting is very similar to doorway sensing.\n",
    "\n",
    "But we are not done. We've learned to never throw information away. If you have information you should use it to improve your estimate. What information are we leaving out? We know what control inputs we are feeding to the wheels of the robot at each moment in time. For example, let's say that once a second we send a movement command to the robot - move left 1 unit, move right 1 unit, or stand still.  If I send the command 'move left 1 unit' I expect that in one second from now the robot will be 1 unit to the left of where it is now. This is a simplification because I am not taking acceleration into account, but I am not trying to teach control theory. Wheels and motors are imperfect. The robot might end up 0.9 units away, or maybe 1.2 units. \n",
    "\n",
    "Now the entire solution is clear. We assumed that the dog kept moving in whatever direction he was previously moving. That is a dubious assumption for my dog! Robots are far more predictable. Instead of making a dubious prediction based on assumption of behavior we will feed in the command that we sent to the robot! In other words, when we call `predict()` we will pass in the commanded movement that we gave the robot along with a kernel that describes the likelihood  of that movement."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Simulating the Train Behavior\n",
    "\n",
    "We need to simulate an imperfect train. When we command it to move it will sometimes make a small mistake, and its sensor will sometimes return the incorrect value."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "class Train(object):\n",
    "\n",
    "    def __init__(self, track_len, kernel=[1.], sensor_accuracy=.9):\n",
    "        self.track_len = track_len\n",
    "        self.pos = 0\n",
    "        self.kernel = kernel\n",
    "        self.sensor_accuracy = sensor_accuracy\n",
    "\n",
    "    def move(self, distance=1):\n",
    "        \"\"\" move in the specified direction\n",
    "        with some small chance of error\"\"\"\n",
    "\n",
    "        self.pos += distance\n",
    "        # insert random movement error according to kernel\n",
    "        r = random.random()\n",
    "        s = 0\n",
    "        offset = -(len(self.kernel) - 1) / 2\n",
    "        for k in self.kernel:\n",
    "            s += k\n",
    "            if r <= s:\n",
    "                break\n",
    "            offset += 1\n",
    "        self.pos = int((self.pos + offset) % self.track_len)\n",
    "        return self.pos\n",
    "\n",
    "    def sense(self):\n",
    "        pos = self.pos\n",
    "         # insert random sensor error\n",
    "        if random.random() > self.sensor_accuracy:\n",
    "            if random.random() > 0.5:\n",
    "                pos += 1\n",
    "            else:\n",
    "                pos -= 1\n",
    "        return pos"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "With that we are ready to write the filter. We will put it in a function so that we can run it with different assumptions. I will assume that the robot always starts at the beginning of the track. The track is implemented as being 10 units long, but think of it as a track of length, say 10,000, with the magnet pattern repeated every 10 units. A length of 10 makes it easier to plot and inspect."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "def train_filter(iterations, kernel, sensor_accuracy, \n",
    "             move_distance, do_print=True):\n",
    "    track = np.array([0, 1, 2, 3, 4, 5, 6, 7, 8, 9])\n",
    "    prior = np.array([.9] + [0.01]*9)\n",
    "    posterior = prior[:]\n",
    "    normalize(prior)\n",
    "    \n",
    "    robot = Train(len(track), kernel, sensor_accuracy)\n",
    "    for i in range(iterations):\n",
    "        # move the robot and\n",
    "        robot.move(distance=move_distance)\n",
    "\n",
    "        # peform prediction\n",
    "        prior = predict(posterior, move_distance, kernel)       \n",
    "\n",
    "        #  and update the filter\n",
    "        m = robot.sense()\n",
    "        likelihood = lh_hallway(track, m, sensor_accuracy)\n",
    "        posterior = update(likelihood, prior)\n",
    "        index = np.argmax(posterior)\n",
    "\n",
    "        if do_print:\n",
    "            print('''time {}: pos {}, sensed {}, '''\n",
    "                  '''at position {}'''.format(\n",
    "                    i, robot.pos, m, track[robot.pos]))\n",
    "\n",
    "            print('''        estimated position is {}'''\n",
    "                  ''' with confidence {:.4f}%:'''.format(\n",
    "                  index, posterior[index]*100))            \n",
    "\n",
    "    book_plots.bar_plot(posterior)\n",
    "    if do_print:\n",
    "        print()\n",
    "        print('final position is', robot.pos)\n",
    "        index = np.argmax(posterior)\n",
    "        print('''Estimated position is {} with '''\n",
    "              '''confidence {:.4f}%:'''.format(\n",
    "                index, posterior[index]*100))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Read the code and make sure you understand it. Now let's do a run with no sensor or movement error. If the code is correct it should be able to locate the robot with no error. The output is a bit tedious to read, but if you are at all unsure of how the update/predict cycle works make sure you read through it carefully to solidify your understanding."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "time 0: pos 4, sensed 4, at position 4\n",
      "        estimated position is 4 with confidence 99.9900%:\n",
      "time 1: pos 8, sensed 8, at position 8\n",
      "        estimated position is 8 with confidence 100.0000%:\n",
      "time 2: pos 2, sensed 2, at position 2\n",
      "        estimated position is 2 with confidence 100.0000%:\n",
      "time 3: pos 6, sensed 6, at position 6\n",
      "        estimated position is 6 with confidence 100.0000%:\n",
      "\n",
      "final position is 6\n",
      "Estimated position is 6 with confidence 100.0000%:\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACMCAYAAAAgJeDfAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAADiZJREFUeJzt3X2MZXV9x/H3x12pgjo2oC1lsdB0NGxIU8gEiiRIC9bFmqUPpGETSTWKTeNaLX0ItAYpbWK0tTZNqbWA9aEKXVHbTbNxNRWrbYTuCD6wjDhbtDIuFuvDtda2uPXbP+5hczvM7JxZzu65Z3m/ksnec85v7v3c4e7y2d/5nbOpKiRJkrrwhL4DSJKkY4fFQpIkdcZiIUmSOmOxkCRJnbFYSJKkzlgsJElSZ9YsFkneluShJPescjxJ/iTJviSfSXJ29zElSdIQtJmxeDuw5RDHLwFmm69XAG957LEkSdIQrVksqupjwNcPMeRS4J01dgfw9CQndxVQkiQNx8YOnuMU4IGJ7aVm34OTg0ajkbf4lCTpGDMzM5PJ7S4Wb2aFfZYISZIeh7ooFkvAqRPbm4D9HTyvJEkamC5OhewEtie5FTgXGFXVg4f6hpmZmQ5etnvz8/MAzM3N9ZxkfYaaG4abfai5YbjZ+8h91rsWj9prtXX3FbNH7bWG+lmB4WYfSu7RaLTqsTWLRZJbgAuBk5IsAa8DnghQVX8O7AJeCOwDvgO89DEnliRJg7RmsaiqbWscL+CVnSWSJEmD5Z03JUlSZywWkiSpMxYLSZLUGYuFJEnqjMVCkiR1xmIhSZI6Y7GQJEmdsVhIkqTOWCwkSVJnLBaSJKkzFgtJktQZi4UkSeqMxUKSJHWmVbFIsiXJfUn2Jbl6hePPSnJ7kruTfCbJC7uPKkmSpt2axSLJBuAG4BJgM7AtyeZlw14L7Kiqs4DLgT/rOqgkSZp+qapDD0jOA66rqhc029cAVNXrJ8a8Fbi/qt7QjH9TVT138nlGo9HBF1pcXOzuHUjSEXLlwkzfER7lxjNGfUeQmJ2dPfh4ZmYmk8c2tvj+U4AHJraXgHOXjbkO+FCSVwEnABcfTlBJkjRsbYpFVti3fJpjG/D2qnpTM2PxriRnVtX3VnrCubm5dcY8Oubn54HpzbeaoeaG4WYfam4YbvZeci9M3+zq0Xz/Q/2swHCzDyX3aLT6zFmbxZtLwKkT25uA/cvGvAzYAVBVnwCeBJy0rpSSJGnw2hSLPcBsktOTHMd4cebOZWO+BFwEkOQMxsXiq10GlSRJ02/NYlFVB4DtwG5ggfHVH3uTXJ9kazPs14Erk3wauAV4Sa21KlSSJB1z2qyxoKp2AbuW7bt24vG9wPndRpMkSUPjnTclSVJnLBaSJKkzFgtJktQZi4UkSeqMxUKSJHXGYiFJkjpjsZAkSZ2xWEiSpM5YLCRJUmcsFpIkqTMWC0mS1BmLhSRJ6ozFQpIkdaZVsUiyJcl9SfYluXqVMb+Y5N4ke5O8p9uYkiRpCNb8Z9OTbABuAJ4PLAF7kuxs/qn0R8bMAtcA51fVN5I880gFliRJ0ytVdegByXnAdVX1gmb7GoCqev3EmDcCn6+qm1Z7ntFodPCFFhcXH2NsSTryrlyY6TvCo9x4xqjvCBKzs7MHH8/MzGTyWJtTIacAD0xsLzX7Jj0beHaSf0pyR5Ith5lVkiQN2JqnQoCssG/5NMdGYBa4ENgEfDzJmVX1zZWecG5ubj0Zj5r5+XlgevOtZqi5YbjZh5obhpu9l9wL0ze7ejTf/1A/KzDc7EPJPRqtPnPWZsZiCTh1YnsTsH+FMX9bVd+tqi8A9zEuGpIk6XGkTbHYA8wmOT3JccDlwM5lY/4G+EmAJCcxPjVyf5dBJUnS9FuzWFTVAWA7sBtYAHZU1d4k1yfZ2gzbDXwtyb3A7cBvVtXXjlRoSZI0ndqssaCqdgG7lu27duJxAVc1X5Ik6XHKO29KkqTOWCwkSVJnLBaSJKkzFgtJktQZi4UkSeqMxUKSJHXGYiFJkjpjsZAkSZ2xWEiSpM5YLCRJUmcsFpIkqTMWC0mS1JlWxSLJliT3JdmX5OpDjLssSSWZ6y6iJEkaijWLRZINwA3AJcBmYFuSzSuMeyrwq8CdXYeUJEnD0GbG4hxgX1XdX1UPA7cCl64w7veANwL/3WE+SZI0IKmqQw9ILgO2VNXLm+0rgHOravvEmLOA11bVLyT5KPAbVTU/+Tyj0ejgCy0uLnb3DiTpCLlyYabvCI9y4xmjviNIzM7OHnw8MzOTyWMbW3x/Vth3sCQkeQLwZuAlhxdPkiQdK9oUiyXg1IntTcD+ie2nAmcCH00C8IPAziRbl89aPGJubjrXds7Pj+NOa77VDDU3DDf7UHPDcLP3knth+mZXj+b7H+pnBYabfSi5R6PVZ87arLHYA8wmOT3JccDlwM5HDlbVqKpOqqrTquo04A5g1VIhSZKOXWsWi6o6AGwHdgMLwI6q2pvk+iRbj3RASZI0HG1OhVBVu4Bdy/Zdu8rYCx97LEmSNETeeVOSJHXGYiFJkjpjsZAkSZ2xWEiSpM5YLCRJUmcsFpIkqTMWC0mS1BmLhSRJ6ozFQpIkdcZiIUmSOmOxkCRJnbFYSJKkzlgsJElSZ1oViyRbktyXZF+Sq1c4flWSe5N8JsnfJ/nh7qNKkqRpt2axSLIBuAG4BNgMbEuyedmwu4G5qvox4DbgjV0HlSRJ06/NjMU5wL6qur+qHgZuBS6dHFBVt1fVd5rNO4BN3caUJElDkKo69IDkMmBLVb282b4COLeqtq8y/k+Br1TV70/uH41GB19ocXHxseaWpCPuyoWZviM8yo1njPqOIDE7O3vw8czMTCaPbWzx/Vlh34ptJMmLgTngeevIJ0mSjhFtisUScOrE9iZg//JBSS4Gfgd4XlX9z6GecG5ubj0Zj5r5+XlgevOtZqi5YbjZh5obhpu9l9wL0ze7ejTf/1A/KzDc7EPJPRqtPnPWZo3FHmA2yelJjgMuB3ZODkhyFvBWYGtVPfQYskqSpAFbs1hU1QFgO7AbWAB2VNXeJNcn2doM+wPgKcB7k3wqyc5Vnk6SJB3D2pwKoap2AbuW7bt24vHFHeeSJEkD5J03JUlSZywWkiSpMxYLSZLUGYuFJEnqjMVCkiR1xmIhSZI6Y7GQJEmdsVhIkqTOWCwkSVJnLBaSJKkzFgtJktQZi4UkSeqMxUKSJHWmVbFIsiXJfUn2Jbl6hePfl+Svm+N3Jjmt66CSJGn6rVkskmwAbgAuATYD25JsXjbsZcA3qupHgTcDb+g6qCRJmn6pqkMPSM4DrquqFzTb1wBU1esnxuxuxnwiyUbgK8AzauLJR6PRoV9IkiQNzszMTCa325wKOQV4YGJ7qdm34piqOgCMgBMPP6YkSRqiNsUiK+xbPvvQZowkSTrGbWwxZgk4dWJ7E7B/lTFLzamQGeDrkwOWT5VIkqRjT5sZiz3AbJLTkxwHXA7sXDZmJ/BLzePLgI/UWos3JEnSMWfNYtGsmdgO7AYWgB1VtTfJ9Um2NsNuBk5Msg+4CnjUJanTbq1LaqdVkrcleSjJPX1nWY8kpya5PclCkr1JXt13praSPCnJPyf5dJP9d/vOtB5JNiS5O8nf9Z1lPZJ8Mclnk3wqyXzfedpK8vQktyX5XPN5P6/vTG0keU7zs37k61tJXtN3rjaS/Frze/OeJLckeVLfmdpK8uom996h/LyXW/OqkMeD5pLazwPPZ3xaZw+wraru7TVYC0kuAL4NvLOqzuw7T1tJTgZOrqq7kjwV+CTwswP5mQc4oaq+neSJwD8Cr66qO3qO1kqSq4A54GlV9aK+87SV5IvAXFX9e99Z1iPJO4CPV9VNzazv8VX1zb5zrUfzZ+SXgXOr6l/7znMoSU5h/Htyc1X9V5IdwK6qenu/ydaW5EzgVuAc4GHgg8CvVNVir8HWyTtvjp0D7Kuq+6vqYcb/YS/tOVMrVfUxlq1nGYKqerCq7moe/wfj2bDlVxtNpRr7drP5xOZrEA09ySbgZ4Cb+s7yeJDkacAFjGd1qaqHh1YqGhcB/zLtpWLCRuDJzZq/43n0usBpdQZwR1V9pzlb8A/Az/Wcad0sFmNtLqnVEdLcqfUs4M5+k7TXnE74FPAQ8OGqGkr2PwZ+C/he30EOQwEfSvLJJK/oO0xLPwJ8FfjL5vTTTUlO6DvUYbgcuKXvEG1U1ZeBPwS+BDwIjKrqQ/2mau0e4IIkJyY5Hngh///iiUGwWIx5uWxPkjwFeB/wmqr6Vt952qqq/62qH2d8ldQ5zRTmVEvyIuChqvpk31kO0/lVdTbjuwC/sjkNOO02AmcDb6mqs4D/ZGBr0JrTN1uB9/adpY0k3894xvl04IeAE5K8uN9U7VTVAuM7V3+Y8WmQTwMHeg11GCwWY20uqVXHmvUJ7wPeXVXv7zvP4WimtT8KbOk5ShvnA1ubtQq3Aj+V5K/6jdReVe1vfn0I+ADjU5jTbglYmpjRuo1x0RiSS4C7qurf+g7S0sXAF6rqq1X1XeD9wHN7ztRaVd1cVWdX1QWMT3MPan0FWCwe0eaSWnWoWQB5M7BQVX/Ud571SPKMJE9vHj+Z8R9kn+s31dqq6pqq2lRVpzH+jH+kqgbxN7kkJzSLfGlOJfw042njqVZVXwEeSPKcZtdFwNQvUF5mGwM5DdL4EvATSY5v/py5iPEarkFI8szm12cBP8+wfvZAuxtkHfOq6kCSRy6p3QC8rar29hyrlSS3ABcCJyVZAl5XVTf3m6qV84ErgM82axUAfruqdvWYqa2TgXc0K+WfwPgS7EFdujlAPwB8YPz/CTYC76mqD/YbqbVXAe9u/tJyP/DSnvO01pznfz7wy31naauq7kxyG3AX49MIdwN/0W+qdXlfkhOB7wKvrKpv9B1ovbzcVJIkdcZTIZIkqTMWC0mS1BmLhSRJ6ozFQpIkdcZiIUmSOmOxkCRJnbFYSJKkzlgsJElSZ/4PLUUv0TsVRkoAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db5768b400>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import random\n",
    "\n",
    "random.seed(3)\n",
    "np.set_printoptions(precision=2, suppress=True, linewidth=60)\n",
    "train_filter(4, kernel=[1.], sensor_accuracy=.999,\n",
    "             move_distance=4, do_print=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see that the code was able to perfectly track the robot so we should feel reasonably confident that the code is working. Now let's see how it fairs with some errors. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "time 0: pos 4, sensed 4, at position 4\n",
      "        estimated position is 4 with confidence 96.0390%:\n",
      "time 1: pos 8, sensed 9, at position 8\n",
      "        estimated position is 9 with confidence 52.1180%:\n",
      "time 2: pos 3, sensed 3, at position 3\n",
      "        estimated position is 3 with confidence 88.3993%:\n",
      "time 3: pos 7, sensed 8, at position 7\n",
      "        estimated position is 8 with confidence 49.3174%:\n",
      "\n",
      "final position is 7\n",
      "Estimated position is 8 with confidence 49.3174%:\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAACMCAYAAAAgJeDfAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAADitJREFUeJzt3X2MZXddx/H3hy4VWnAwLWjtLrbGgXTTGLeZtJYmpdoiWyRbHxrTTWiE8GAMi2B9SKuk1GpCQBFjrIi0yIPQuhTQjdmwECmChtYdWh66XcquBemwxSIPFxG1rHz9456u1+nMzpndX3vn7L5fyWTuOec3935mdnb2s7/zO2dSVUiSJLXwuGkHkCRJxw6LhSRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqZsVikeStSR5Mcvcyx5Pkj5PsT/LpJOe0jylJkoagz4zF24DNhzl+KTDbvb0MeNPRx5IkSUO0YrGoqo8CXzvMkMuAd9TY7cBTkpzWKqAkSRqOdQ2e43Tg/onthW7fA5ODRqORt/iUJOkYMzMzk8ntFos3s8Q+S4QkScehFsViAdgwsb0eONDgeSVJ0sC0OBWyA9iW5BbgPGBUVQ8c7gNmZmYavGx78/PzAMzNzU05yeoMNTcMN/tQc8Nwsw81Nww3+1Bzw3CzDyX3aDRa9tiKxSLJzcBFwKlJFoDXAI8HqKo/A3YCzwP2A98GXnTUiSVJ0iCtWCyqausKxwt4ebNEkiRpsLzzpiRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJaqZXsUiyOcm9SfYnuXqJ409PcluSu5J8Osnz2keVJElr3YrFIskJwA3ApcBGYGuSjYuGvRrYXlWbgCuAP20dVJIkrX2pqsMPSM4Hrquq53bb1wBU1WsnxrwZuK+qXteNf0NVPWvyeUaj0aEX2rdvX7vPQJIkPaZmZ2cPPZ6ZmcnksXU9Pv504P6J7QXgvEVjrgM+mOQVwMnAJUcSVJIkDVufYpEl9i2e5tgKvK2q3tDNWLwzydlV9d2lnnBubm6VMR8b8/PzwNrNt5yh5obhZh9qbhhu9qHmhuFmH2puGG72oeQejUbLHuuzeHMB2DCxvR44sGjMi4HtAFX1ceAJwKmrSilJkgavT7HYDcwmOTPJiYwXZ+5YNOaLwMUASc5iXCy+0jKoJEla+1YsFlV1ENgG7AL2Mr76Y0+S65Ns6Yb9GvDSJJ8CbgZeWCutCpUkScecPmssqKqdwM5F+66deHwPcEHbaJIkaWi886YkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmrFYSJKkZiwWkiSpGYuFJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWqmV7FIsjnJvUn2J7l6mTG/kOSeJHuSvLttTEmSNAQr/tr0JCcANwDPARaA3Ul2dL8q/eExs8A1wAVV9fUkT3u0AkuSpLUrVXX4Acn5wHVV9dxu+xqAqnrtxJjXA5+rqhuXe57RaHTohfbt23eUsSVJ0rTMzs4eejwzM5PJY31OhZwO3D+xvdDtm/QM4BlJ/jHJ7Uk2H2FWSZI0YCueCgGyxL7F0xzrgFngImA98LEkZ1fVN5Z6wrm5udVkfMzMz88DazffcoaaG4abfai5YbjZh5obhpt9qLlhuNmHkns0Gi17rM+MxQKwYWJ7PXBgiTF/U1XfqarPA/cyLhqSJOk40qdY7AZmk5yZ5ETgCmDHojF/DfwEQJJTGZ8aua9lUEmStPatWCyq6iCwDdgF7AW2V9WeJNcn2dIN2wV8Nck9wG3Ab1TVVx+t0JIkaW3qs8aCqtoJ7Fy079qJxwVc1b1JkqTjlHfelCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnNWCwkSVIzvS43lSTpsbDpna1+SeXM+N3eo3++u670RtKr4YyFJElqxmIhSZKasVhIkqRmLBaSJKkZi4UkSWqmV7FIsjnJvUn2J7n6MOMuT1JJ5tpFlCRJQ7FisUhyAnADcCmwEdiaZOMS454M/ApwR+uQkiRpGPrMWJwL7K+q+6rqIeAW4LIlxv0u8HrgvxrmkyRJA5KqOvyA5HJgc1W9pNu+EjivqrZNjNkEvLqqfj7JR4Bfr6r5yecZjUaHXmjfvlY3QJEkHUteundm2hEe4S1njaYdYc2Znf2/m4bNzMxk8lifO29miX2HSkKSxwFvBF54ZPEkSa35D7SmpU+xWAA2TGyvBw5MbD8ZOBv4SBKAHwB2JNmyeNbiYXNza3Nt5/z8OO5azbecoeaG4WYfam4Ybvah5oYpZW9wK+vWen3+Q83dyFC+z0ej5UtinzUWu4HZJGcmORG4Atjx8MGqGlXVqVV1RlWdAdwOLFsqJEnSsWvFYlFVB4FtwC5gL7C9qvYkuT7Jlkc7oCRJGo5ev920qnYCOxftu3aZsRcdfSxJkjRE3nlTkiQ1Y7GQJEnNWCwkSVIzFgtJktSMxUKSJDVjsZAkSc1YLCRJUjMWC0mS1IzFQpIkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ106tYJNmc5N4k+5NcvcTxq5Lck+TTSf4uyQ+1jypJkta6FYtFkhOAG4BLgY3A1iQbFw27C5irqh8FbgVe3zqoJEla+/rMWJwL7K+q+6rqIeAW4LLJAVV1W1V9u9u8HVjfNqYkSRqCVNXhBySXA5ur6iXd9pXAeVW1bZnxfwJ8uap+b3L/aDQ69EL79u072tySpMN46d6ZaUd4hLecNVpxzFBzH29mZ2cPPZ6ZmcnksXU9Pj5L7FuyjSR5ATAHPHsV+SRJ0jGiT7FYADZMbK8HDiwelOQS4LeBZ1fVfx/uCefm5laT8TEzPz8PrN18yxlqbhhu9qHmhuFmH2pumFL2vWtvZrjX5z/U3I0M5ft8NFp+FqfPGovdwGySM5OcCFwB7JgckGQT8GZgS1U9eBRZJUnSgK1YLKrqILAN2AXsBbZX1Z4k1yfZ0g37feBJwHuSfDLJjmWeTpIkHcP6nAqhqnYCOxftu3bi8SWNc0mSpAHyzpuSJKkZi4UkSWrGYiFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmul1HwtJOh5temer20t3v1irwe2q77pyduVB0hQ5YyFJkpqxWEiSpGYsFpIkqRmLhSRJasZiIUmSmulVLJJsTnJvkv1Jrl7i+Pck+avu+B1JzmgdVJIkrX0rFoskJwA3AJcCG4GtSTYuGvZi4OtV9SPAG4HXtQ4qSZLWvlTV4Qck5wPXVdVzu+1rAKrqtRNjdnVjPp5kHfBl4Kk18eSj0ejwLyRJkgZnZmYmk9t9ToWcDtw/sb3Q7VtyTFUdBEbAKUceU5IkDVGfYpEl9i2efegzRpIkHeP63NJ7Adgwsb0eOLDMmIXuVMgM8LXJAYunSiRJ0rGnz4zFbmA2yZlJTgSuAHYsGrMD+MXu8eXAh2ulxRuSJOmYs2Kx6NZMbAN2AXuB7VW1J8n1SbZ0w24CTkmyH7gKeMQlqWvdSpfUrlVJ3prkwSR3TzvLaiTZkOS2JHuT7Enyymln6ivJE5L8U5JPddl/Z9qZViPJCUnuSvK3086yGkm+kOQzST6ZZH7aefpK8pQktyb5bPf9fv60M/WR5Jnd1/rht28medW0c/WR5Fe7v5t3J7k5yROmnamvJK/scu8Zytd7sRWvCjkedJfUfg54DuPTOruBrVV1z1SD9ZDkQuBbwDuq6uxp5+kryWnAaVV1Z5InA58AfmYgX/MAJ1fVt5I8HvgH4JVVdfuUo/WS5CpgDvjeqnr+tPP0leQLwFxV/du0s6xGkrcDH6uqG7tZ35Oq6hvTzrUa3c/ILwHnVdW/TDvP4SQ5nfHfyY1V9Z9JtgM7q+pt0022siRnA7cA5wIPAR8AfrmqWv2a3ceEd94cOxfYX1X3VdVDjP9gL5typl6q6qMsWs8yBFX1QFXd2T3+d8azYYuvNlqTauxb3ebju7dBNPQk64GfBm6cdpbjQZLvBS5kPKtLVT00tFLRuRj457VeKiasA57Yrfk7iUeuC1yrzgJur6pvd2cL/h742SlnWjWLxVifS2r1KOnu1LoJuGO6SfrrTid8EngQ+FBVDSX7HwG/CXx32kGOQAEfTPKJJC+bdpiefhj4CvAX3emnG5OcPO1QR+AK4OZph+ijqr4E/AHwReABYFRVH5xuqt7uBi5MckqSk4Dn8f8vnhgEi8WYl8tOSZInAe8FXlVV35x2nr6q6n+q6scYXyV1bjeFuaYleT7wYFV9YtpZjtAFVXUO47sAv7w7DbjWrQPOAd5UVZuA/2Bga9C60zdbgPdMO0sfSb6P8YzzmcAPAicnecF0U/VTVXsZ37n6Q4xPg3wKODjVUEfAYjHW55JaNdatT3gv8K6qet+08xyJblr7I8DmKUfp4wJgS7dW4RbgJ5P85XQj9VdVB7r3DwLvZ3wKc61bABYmZrRuZVw0huRS4M6q+tdpB+npEuDzVfWVqvoO8D7gWVPO1FtV3VRV51TVhYxPcw9qfQVYLB7W55JaNdQtgLwJ2FtVfzjtPKuR5KlJntI9fiLjH2SfnW6qlVXVNVW1vqrOYPw9/uGqGsT/5JKc3C3ypTuV8FOMp43XtKr6MnB/kmd2uy4G1vwC5UW2MpDTIJ0vAj+e5KTu58zFjNdwDUKSp3Xvnw78HMP62gP9bpB1zKuqg0kevqT2BOCtVbVnyrF6SXIzcBFwapIF4DVVddN0U/VyAXAl8JlurQLAb1XVzilm6us04O3dSvnHMb4Ee1CXbg7Q9wPvH/87wTrg3VX1gelG6u0VwLu6/7TcB7xoynl6687zPwf4pWln6auq7khyK3An49MIdwF/Pt1Uq/LeJKcA3wFeXlVfn3ag1fJyU0mS1IynQiRJUjMWC0mS1IzFQpIkNWOxkCRJzVgsJElSMxYLSZLUjMVCkiQ1Y7GQJEnN/C/3wjlXlj2KGgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db58b4f9b0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "random.seed(5)\n",
    "train_filter(4, kernel=[.1, .8, .1], sensor_accuracy=.9,\n",
    "         move_distance=4, do_print=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "There was a sensing error at time 1, but we are still quite confident in our position. \n",
    "\n",
    "Now let's run a very long simulation and see how the filter responds to errors."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAhYAAAFWCAYAAAA199QiAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3X+UZHV95//nixlYBKFJJHqUAcHY5gtyVNg5KiGrbEAZzGbc5OvZwB5JzFHM7koSY9SFxK9O2GxYzRrdRJJ1EaOiYpComTUT0awaN1k1TESUYcSZIEILiEEsf8RVx7y/f9SdoWj7R3XXp3u6up6Pc+pM3apPve+7em6/+30/996qVBWSJEktHHKwE5AkSeuHjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLNawJLuSnHUQ139Ckm8m2XCwcpC0fNYQHQw2FmtYVT2+qj4KkGRbkrev5PqS3J7knIH131FVD62q76/Auv5Tks8m2Zdk2wLj/jhJJXnswGMnJtmR5P4k9yR5Q5KNrXOUxp01ZN4acnKSDyfpJdmb5Gda5zfJbCwmxBr8w7sXeDnw5/MNSPITwI/O8dQfAvcCjwSeBDwd+A8rkKOkznqpId37+DPg/cAPAy8E3p7kcSuX6mSxsVjD9nf/SbYAvwH8XDeteFP3/FSSq5LcneRLSX57/5Rjkucl+Zskr0vyVWBbkh/tuvT7kvxDknckOaYbfzVwAvA/u3W8vJsZqP0FJcmjkmxP8tWuy79oINdtSa5N8rYk3+imYDfP996q6q1V9RfAN+Z57xuBPwAunuPpk4Brq+r/VtU9wAeAxy/15yutd9aQOWvI/wM8CnhdVX2/qj4M/A1w4TJ+xJqDjcUYqKoPAL8D/Ek3rfjE7qm3AvuAxwKnAc8EXjDw0qcAtwEPB/4zEOBy+r9UJwPHA9u6dVwI3AH8dLeO18yRyjXATPf65wC/k+Tsgee3Au8CjgG2A28Y4W3/GvCxqvrMHM/9N+D8JEckOQ44j35zIWkO1pAHyRxjA5w6wro0wMZiTCV5BP0/qC+uqm9V1b3A64DzB4bdVVV/UFX7qurbVbW3qj5UVd+pqq8Av0f/MMIw6zse+AngP3YzBZ8G3sSDu/y/rqod3fHUq4EnzhFq2HX9EvDKeYb8Ff0Ziq/TL1I7gfctZ13SpJrgGvI5+odSX5bk0CTP7N7DEctZl36QjcX4ejRwKHB3kq8l+RrwRvp7FvvdOfiCJA9P8q5uyvPrwNuBY4dc36OAr1bV4LTjF4HjBpbvGbj/j8Dhyzwu+3rgsqrqzX4iySHA9cB7gCPp5/9DwKuXsR5pkk1kDamq7wH/Gvipbn2/DlxLfydFDdhYjI/ZX0N7J/Ad4NiqOqa7HV1Vj1/gNZd3jz2hqo4GnsuDpwUX+qrbu4AfTnLUwGMnAF9aypsY0tnA76Z/xcf+QvPxJP+W/slWxwNv6Paa7gP+GHjWCuQhrSfWkH4Noao+U1VPr6qHVdW5wGOAv12BPCaSjcX4+DJwYrfHTlXdDXwQeG2So5Mc0p1YtdC05FHAN4GvdecmvGyOdTxmrhdW1Z3A/wEuT3J4kicAzwfesZw3001BHk5/G9zYxdx/rfvj6E+BPqm7Afw08N6q+gfgC8C/T7KxO3HsF4CblpOHNEGsIfDe7rVP6MYfkeSl9K8we8ty8tAPsrEYH+/u/r0vyae6+z8PHAbcAtwPXEf/F2Q+vwWcDvToX6L1nlnPXw68opsWfekcr78AOJH+nsd7gVdV1YeW/lYAuBL4dhfzN7v7FwJU1b1Vdc/+Wzf+H6rq2939nwW2AF+hf8nZPvonakmanzXkgRpyIXA3/XMtzgaeUVXfWWYemiVVC81cSZIkDc8ZC0mS1MyijUWSNye5N8nN8zyfJL/ffdjJZ5Kc3j5NSePMOiJNjmFmLN5C/3j2fM4DprvbC4E/Gj0tSevMW7COSBNh0euDq+pjSU5cYMizgbdV/2SNTyQ5JskjuzOOD+j1ep7MIa0xU1NTc30KYXMt6og1RFqbZteRFudYHMeDP0Rlhgd/4IkkLcY6Iq0TLRqLufZ43LOQtBTWEWmdaPE1uDP0Pwlxv030r1Ge19TU1LJXtnPnTgA2b573S+/WTFxjGrOlVnF7vR/4lOO1YEl1ZJQaAuPz/27MtR9zpeKu9ZgL1ZEWMxbbgZ/vzup+KtCbfX6FJC3COiKtE4vOWCS5BjgLODbJDPAq+l9cQ1X9d2AH/e9p2Ev/S2N+caWSlTSerCPS5BjmqpALFnm+gBc1y0jSumMdkSaHn7wpSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZafG26JGmZTrt6zwLPdl8Pv3v+MTdeON02IWlEzlhIkqRmbCwkSVIzNhaSJKmZoRqLJFuS3Jpkb5JL5nj+hCQfSXJjks8keVb7VCWNK2uINDkWbSySbACuAM4DTgEuSHLKrGGvAK6tqtOA84E/bJ2opPFkDZEmS6pq4QHJGcC2qjq3W74UoKouHxjzRuC2qnp1N/61VfXjg3F6vd6BFe3Zs9BZ0JJW0vT0A1cRTE1NZaXXZw1Z2EW7p0Z6/ZUn9xplIg1voToyzOWmxwF3DizPAE+ZNWYb8MEkvwwcCZyznEQlrUvWEGmCDNNYzLVHM3ua4wLgLVX12m5v4+okp1bVP80VcPPmzUtM8wE7d+4cOcZqxTWmMVtqFbfXW/U93DVVQ2CN/b8v8BkVw1jq+tbUe18HMVcq7lqPuVAdGebkzRng+IHlTcBds8Y8H7gWoKo+DhwOHLukLCWtV9YQaYIM01jcAEwnOSnJYfRPrNo+a8wdwNkASU6mXxS+0jJRSWPLGiJNkEUbi6raB1wMXA/spn/m9q4klyXZ2g37deCiJDcB1wDPq8XOCpU0Eawh0mQZ6rtCqmoHsGPWY68cuH8LcGbb1CStF9YQaXL4yZuSJKkZGwtJktSMX5suLcOoX3UNft21pPXJGQtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmhmqsUiyJcmtSfYmuWSeMf8myS1JdiV5Z9s0JY0za4g0ORb9dtMkG4ArgGcAM8ANSbZX1S0DY6aBS4Ezq+r+JA9fqYQljRdriDRZUlULD0jOALZV1bnd8qUAVXX5wJjXAJ+vqjfNF6fX6x1Y0Z49C3+dtLTWXbR7auQYV57ca5DJ0k1PP/B17VNTU1np9VlDFjbqtnSwtiNNtoXqyDCHQo4D7hxYnukeG/Q44HFJ/ibJJ5JsWWauktYfa4g0QRY9FALMtUcze5pjIzANnAVsAv53klOr6mtzBdy8efNScnyQnTt3jhxjteIacx3H3D36HvNS19nq/fd6q76Hu6ZqCKyvbelgbUfGXNm4az3mQnVkmBmLGeD4geVNwF1zjPmzqvpeVX0BuJV+kZAka4g0QYZpLG4AppOclOQw4Hxg+6wx7wP+JUCSY+lPa97WMlFJY8saIk2QRRuLqtoHXAxcD+wGrq2qXUkuS7K1G3Y9cF+SW4CPAC+rqvtWKmlJ48MaIk2WYc6xoKp2ADtmPfbKgfsFvKS7SdKDWEOkyeEnb0qSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKaGaqxSLIlya1J9ia5ZIFxz0lSSTa3S1HSuLOGSJNj0cYiyQbgCuA84BTggiSnzDHuKOBXgE+2TlLS+LKGSJMlVbXwgOQMYFtVndstXwpQVZfPGvd64C+BlwIvraqdg8/3er0DK9qzZ0+T5KWD5aLdUyPHuPLkXoNMlm56evrA/ampqaz0+qwhCxt1WzpY25Em20J1ZJhDIccBdw4sz3SPHZDkNOD4qnr/8tOUtE5ZQ6QJsnGIMXPt0RzYc0hyCPA64HnDrnTz5uUfPt25c+fIMVYrrjHXcczdo+8xL3Wdrd5/r7fqe7hrqobA+tqWDtZ2ZMyVjbvWYy5UR4aZsZgBjh9Y3gTcNbB8FHAq8NEktwNPBbZ78pWkjjVEmiDDNBY3ANNJTkpyGHA+sH3/k1XVq6pjq+rEqjoR+ASwdfbxUUkTyxoiTZBFG4uq2gdcDFwP7AaurapdSS5LsnWlE5Q03qwh0mQZ5hwLqmoHsGPWY6+cZ+xZo6claT2xhkiTw0/elCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDUzVGORZEuSW5PsTXLJHM+/JMktST6T5H8leXT7VCWNK2uINDkWbSySbACuAM4DTgEuSHLKrGE3Apur6gnAdcBrWicqaTxZQ6TJkqpaeEByBrCtqs7tli8FqKrL5xl/GvCGqjpz8PFer3dgRXv27Bkxbengumj31Mgxrjy51yCTpZuenj5wf2pqKiu9PmvIwkbdlg7WdqTJtlAdGeZQyHHAnQPLM91j83k+8BdLyE/S+mYNkSbIxiHGzLVHM+c0R5LnApuBpy8UcPPmzUOsdm47d+4cOcZqxTXmOo65e/Q95qWus9X77/VWfQ93TdUQWF/b0sHajoy5snHXesyF6sgwjcUMcPzA8ibgrtmDkpwD/Cbw9Kr6zhJzlLR+WUOkCTLMoZAbgOkkJyU5DDgf2D44oDsm+kZga1Xd2z5NSWPMGiJNkEUbi6raB1wMXA/sBq6tql1JLkuytRv2u8BDgXcn+XSS7fOEkzRhrCHSZBnmUAhVtQPYMeuxVw7cP6dxXpLWEWuINDn85E1JktSMjYUkSWrGxkKSJDUz1DkW0jg77eqFPieg+9TDRT5L4MYLpxd8XpLU54yFJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzXm4qrRELXxYLw1wa62WxK8f/H2k4zlhIkqRmbCwkSVIzHgqRpHXGT5vVweSMhSRJamaoGYskW4D/BmwA3lRV/2XW8/8MeBvwz4H7gJ+rqtuXm5TdtrS+rHYNkXTwLNpYJNkAXAE8A5gBbkiyvapuGRj2fOD+qnpskvOBVwM/txIJL9dKnNHtWeLt2VSuP+ulhkgaTqpq4QHJGcC2qjq3W74UoKouHxhzfTfm40k2AvcAP1IDwXu93sIrkrTqpqamstLrsIZI69vsOjLMORbHAXcOLM90j805pqr2AT3gYctPU9I6Yg2RJsgwjcVcezSz9xyGGSNpMllDpAkyzMmbM8DxA8ubgLvmGTPTTWNOAV8dHLAaU66S1iRriDRBhpmxuAGYTnJSksOA84Hts8ZsB36hu/8c4MO12MkbkiaFNUSaIIs2Ft3xzouB64HdwLVVtSvJZUm2dsOuAh6WZC/wEuCSlUo4yZYktybZm2Tk9SR5c5J7k9zcIr8u5vFJPpJkd5JdSX61QczDk/xtkpu6mL/VItcu9oYkNyZ5f8OYtyf5bJJPJ9nZKOYxSa5L8rnuZ3vGiPF+rMtv/+3rSV7cIM9f6/6Pbk5yTZLDG8T81S7erhY5rqb1XkO6mNaRxnXEGjLGNaSqxuZG/xr4vwceAxwG3AScMmLMpwGnAzc3zPORwOnd/aOAzzfIM8BDu/uHAp8Entoo35cA7wTe3/BncDtwbOP//7cCL+juHwYc03jbugd49IhxjgO+ADykW74WeN6IMU8FbgaOoH/48i+B6ZY/20m5rUQN6eJaRxrXEWvI+NaQcfvkzScDe6vqtqr6LvAu4NmjBKyqjzHrWO6oquruqvpUd/8b9PfSZp8Fv9SYVVXf7BYP7W4jTxUn2QT8FPCmUWOtpCRH0y/eVwFU1Xer6msNV3E28PdV9cUGsTYCD+nOFTiCHzyfYKlOBj5RVf9Y/b3/vwJ+ZsSYk6p5DQHryDjUEWvI6tWQcWsshrlsbU1JciJwGv09g1FjbUjyaeBe4ENVNXJM4PXAy4F/ahBrUAEfTPJ3SV7YIN5jgK8Af9xNt74pyZEN4u53PnDNqEGq6kvAfwXuAO4GelX1wRHD3gw8LcnDkhwBPIsHnwyp4Y1dDYGJrSPWkDGtIePWWIzVJWlJHgr8KfDiqvr6qPGq6vtV9ST6Z9U/OcmpI+b3r4B7q+rvRs1tDmdW1enAecCLkjxtxHgb6U81/1FVnQZ8i0bH4bsTCrcC724Q64fo7wGfBDwKODLJc0eJWVW76X8S5YeAD9Cfvt83YqqTaqxqCEx0HbGGjGkNGbfGYpjL1taEJIfSLwbvqKr3tIzdTd99FNgyYqgzga1Jbqc/JfyTSd4+YkwAququ7t97gffSn4IexQwwM7B3dR39ItHCecCnqurLDWKdA3yhqr5SVd8D3gP8+KhBq+qqqjq9qp5Gf8p9sc+T19zGpobAZNcRa8j41pBxayyGuWztoEsS+sfxdlfV7zWK+SNJjunuP4T+xve5UWJW1aVVtamqTqT/s/xwVY3UGXf5HZnkqP33gWfSn4obJdd7gDuT/Fj30NnALQu8ZCkuoMEUZucO4KlJjui2g7PpHxsfSZKHd/+eAPws7fKdNGNRQ2Cy64g1ZLxryFDfbrpWVNW+JPsvW9sAvLmqdo0SM8k1wFnAsUlmgFdV1VUjpnomcCHw2e5YJsBvVNWOEWI+Enhr+l/odAj9S/aaXR7a2COA9/Z/J9gIvLOqPtAg7i8D7+j+INwG/OKoAbvjjc8AfmnUWABV9ckk1wGfoj/VeCPwPxqE/tMkDwO+B7yoqu5vEHPirEQNAevICrCGjHENWfRLyCRJkoY1bodCJEnSGmZjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZiDUuyK8lZB3H9JyT5ZpINBysHSctnDdHBYGOxhlXV46vqowBJtiV5+0quL8ntSc4ZWP8dVfXQqvr+CqzrPyX5bJJ9SbbNeu6sJP/UFaT9t18YeP6Hk7w3ybeSfDHJv22dn7QeWEPmrSEXJ9mZ5DtJ3tI6t0m38WAnoNWRZGNV7TvYeQzYC7wc+HfzPH9XVW2a57krgO8CjwCeBPx5kpuqalf7NCXBuqshdwG/DZwLPGQFcptozlisYfu7/yRbgN8Afq7rvG/qnp9KclWSu5N8Kclv759yTPK8JH+T5HVJvgpsS/KjST6c5L4k/5DkHUmO6cZfDZwA/M9uHS9PcmKSSrKxG/OoJNuTfDXJ3iQXDeS6Lcm1Sd6W5BvdFOzm+d5bVb21qv4C+MYSfyZHAv8v8P9V1Ter6q+B7cCFS4kjTQJryLyvfU9VvQ+4b6mv1eJsLMZAVX0A+B3gT7ppxSd2T70V2Ac8FjgNeCbwgoGXPgW4DXg48J+BAJcDjwJOBo4HtnXruBC4A/jpbh2vmSOVa4CZ7vXPAX4nydkDz28F3gUcQ/+P/RtGeNsPT/LlJF/oCtuR3eOPA75fVZ8fGHsT8PgR1iWta9aQB9UQrTAbizGV5BHAecCLq+pbVXUv8Drg/IFhd1XVH1TVvqr6dlXtraoPVdV3quorwO8BTx9yfccDPwH8x6r6v1X1aeBNPHim4K+rakd3PPVq4IlzhBrG5+gf4ngk8JPAP+9yBXgo0Js1vgcctcx1SRNpgmuIVpjnWIyvRwOHAncn2f/YIcCdA2MG75Pk4cDvA/+C/h/iQ4D7h1zfo4CvVtXgtOMXgcGpynsG7v8jcPhyjstW1T0Dsb6Q5OXAnwO/BHwTOHrWS45mGdOh0oSb1BqiFeaMxfioWct3At8Bjq2qY7rb0VX1+AVec3n32BOq6mjgufSnNucbP+gu4IeTDM4MnAB8aSlvYpmKB/L8PLAxyfTA808EPHFTWpg1RKvCxmJ8fBk4MckhAFV1N/BB4LVJjk5ySHdi1ULTkkfR3+P/WpLjgJfNsY7HzPXCqroT+D/A5UkOT/IE4PnAO5bzZpIcmuRw+tvgxi7m/pPGzkr/+vd006f/BfizLo9vAe8BLktyZJIzgWfTnzaVND9ryAOv3di9dgOwoXutM/iN2FiMj3d3/96X5FPd/Z8HDgNuoT8deR39Y4rz+S3gdPrnJPw5/T/Qgy4HXpHka0leOsfrLwBOpL/n8V7gVVX1oaW/FQCuBL7dxfzN7v7+Y62nAx8HvkW/EN0M/MrAa/8D/UvE7qV/Mti/91JTaVHWkAe8oht/Cf1Zl293j6mBVC00cyVJkjQ8ZywkSVIzizYWSd6c5N4kN8/zfJL8fvdhJ59Jcnr7NCWNM+uINDmGmbF4C7BlgefPA6a72wuBPxo9LUnrzFuwjkgTYdGzYKvqY0lOXGDIs4G3Vf9kjU8kOSbJI7szjg/o9XqezCGtMVNTU6tyCV6LOmINkdam2XWkxTkWx/HgD1GZ6R6TpGFZR6R1okVjMdcej3sWkpbCOiKtEy0+EGSG/hfR7LeJ/jXK85qamlr2ynbu3AnA5s3zfundmolrTGO21Cpurzf7q1bWhCXVkVFqCIzP/7sx137MlYq71mMuVEdazFhsB36+O6v7qUBv9vkVkrQI64i0Tiw6Y5HkGuAs4NgkM8Cr6H9xDVX134EdwLOAvfS/NOYXVypZSePJOiJNjmGuCrlgkecLeFGzjCStO9YRaXL4yZuSJKkZGwtJktSMjYUkSWrGxkKSJDXT4nMsJGlNOe3qPYuM6D4HY/f84268cLpdQtIEsbHQmrLwH4TF/xiAfxAk6WDyUIgkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJamaoxiLJliS3Jtmb5JI5nj8hyUeS3JjkM0me1T5VSePKGiJNjkUbiyQbgCuA84BTgAuSnDJr2CuAa6vqNOB84A9bJyppPFlDpMmSqlp4QHIGsK2qzu2WLwWoqssHxrwRuK2qXt2Nf21V/fhgnF6vd2BFe/Ys9gVBmlQX7Z4aOcaVJ/caZLJ+TU8/8F0qU1NTWen1HYwa4nYkrayF6sgwX0J2HHDnwPIM8JRZY7YBH0zyy8CRwDnLSVTSumQNkSbIMI3FXHs0s6c5LgDeUlWv7fY2rk5yalX901wBN2/evMQ0H7Bz586RY6xWXGMuI+Yi31w6jKWsc02991WK2+ut+p746teQVd6OYHy2JWOu3d/NcYq5UB0Z5uTNGeD4geVNwF2zxjwfuBagqj4OHA4cu6QsJa1X1hBpggzTWNwATCc5Kclh9E+s2j5rzB3A2QBJTqZfFL7SMlFJY8saIk2QRRuLqtoHXAxcD+ymf+b2riSXJdnaDft14KIkNwHXAM+rxc4KlTQRrCHSZBnmHAuqagewY9Zjrxy4fwtwZtvUJK0X1hBpcvjJm5IkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnNDNVYJNmS5NYke5NcMs+Yf5PkliS7kryzbZqSxpk1RJocGxcbkGQDcAXwDGAGuCHJ9qq6ZWDMNHApcGZV3Z/k4SuVsKTxYg2RJsswMxZPBvZW1W1V9V3gXcCzZ425CLiiqu4HqKp726YpaYxZQ6QJkqpaeEDyHGBLVb2gW74QeEpVXTww5n3A54EzgQ3Atqr6wGCcXq93YEV79uxp9ga0vly0e2rkGFee3GuQyfo1PT194P7U1FRWen0Ho4a4HUkra6E6suihEGCuwjO7G9kITANnAZuA/53k1Kr62pIylbQeWUOkCTJMYzEDHD+wvAm4a44xn6iq7wFfSHIr/SJxw1wBN2/evIxU+3bu3DlyjNWKa8xlxNw9+mzWUta5pt77KsXt9VZ9T3z1a8gqb0cwPtuSMdfu7+Y4xVyojgxzjsUNwHSSk5IcBpwPbJ815n3AvwRIcizwOOC2ZWUrab2xhkgTZNHGoqr2ARcD1wO7gWuraleSy5Js7YZdD9yX5BbgI8DLquq+lUpa0viwhkiTZZhDIVTVDmDHrMdeOXC/gJd0N0l6EGuINDn85E1JktSMjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjM2FpIkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSM0M1Fkm2JLk1yd4klyww7jlJKsnmdilKGnfWEGlyLNpYJNkAXAGcB5wCXJDklDnGHQX8CvDJ1klKGl/WEGmypKoWHpCcAWyrqnO75UsBquryWeNeD/wl8FLgpVW1c/D5Xq93YEV79uxpkrzWn4t2T40c48qTew0yWb+mp6cP3J+amspKr+9g1BC3I2llLVRHhjkUchxw58DyTPfYAUlOA46vqvcvP01J65Q1RJogG4cYM9cezYE9hySHAK8DnjfsSjdvXv7h0507d44cY7XiGnMZMXePPpu1lHWuqfe+SnF7vVXfE1/9GrLK2xGMz7ZkzLX7uzlOMReqI8PMWMwAxw8sbwLuGlg+CjgV+GiS24GnAts9+UpSxxoiTZBhGosbgOkkJyU5DDgf2L7/yarqVdWxVXViVZ0IfALYOvv4qKSJZQ2RJsiijUVV7QMuBq4HdgPXVtWuJJcl2brSCUoab9YQabIMc44FVbUD2DHrsVfOM/as0dOStJ5YQ6TJ4SdvSpKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKasbGQJEnN2FhIkqRmbCwkSVIzNhaSJKkZGwtJktSMjYUkSWrGxkKSJDVjYyFJkpoZqrFIsiXJrUn2JrlkjudfkuSWJJ9J8r+SPLp9qpJ7sjztAAAHNUlEQVTGlTVEmhyLNhZJNgBXAOcBpwAXJDll1rAbgc1V9QTgOuA1rROVNJ6sIdJkSVUtPCA5A9hWVed2y5cCVNXl84w/DXhDVZ05+Hiv1zuwoj179oyYttari3ZPjRzjypN7DTJZv6anpw/cn5qaykqv72DUELcjaWUtVEeGORRyHHDnwPJM99h8ng/8xRLyk7S+WUOkCbJxiDFz7dHMOc2R5LnAZuDpCwXcvHnzEKud286dO0eOsVpxjbmMmLtHn81ayjrX1Htfpbi93qrvia9+DVnl7QjGZ1sy5tr93RynmAvVkWEaixng+IHlTcBdswclOQf4TeDpVfWdJeYoaf2yhkgTZJhDITcA00lOSnIYcD6wfXBAd0z0jcDWqrq3fZqSxpg1RJogizYWVbUPuBi4HtgNXFtVu5JclmRrN+x3gYcC707y6STb5wknacJYQ6TJMsyhEKpqB7Bj1mOvHLh/TuO8JK0j1hBpcvjJm5IkqRkbC0mS1IyNhSRJasbGQpIkNWNjIUmSmrGxkCRJzdhYSJKkZmwsJElSMzYWkiSpGRsLSZLUjI2FJElqxsZCkiQ1Y2MhSZKaGerbTaW5nHb1ngWener/s3v+MTdeON02IUnSQWdjoXVv1AYIbIK02HYENtM62NbKNjrUoZAkW5LcmmRvkkvmeP6fJfmT7vlPJjlx5MwkrRvWEGlyLNpYJNkAXAGcB5wCXJDklFnDng/cX1WPBV4HvLp1opLGkzVEmiypqoUHJGcA26rq3G75UoCqunxgzPXdmI8n2QjcA/xIDQTv9XoLr0jSqpuamspKr8MaIq1vs+vIMIdCjgPuHFie6R6bc0xV7QN6wMOWn6akdcQaIk2QYRqLufZoZu85DDNG0mSyhkgTZJirQmaA4weWNwF3zTNmppvGnAK+OjhgNaZcJa1J1hBpggwzY3EDMJ3kpCSHAecD22eN2Q78Qnf/OcCHa7GTNyRNCmuINEEWnbGoqn1JLgauBzYAb66qXUkuA3ZW1XbgKuDqJHvp72Wcv5JJSxof1hBpwlTVWN2ALcCtwF7gkgbx3gzcC9zcMMfjgY8Au4FdwK82iHk48LfATV3M32qY7wbgRuD9DWPeDnwW+DT9Px4tYh4DXAd8rvvZnjFivB/r8tt/+zrw4gZ5/lr3f3QzcA1weIOYv9rF29Uix0m+ta4hXUzrSOM6Yg0Z3xqyYoFXJNn+hvv3wGOAw7pfjlNGjPk04PTGBeGRwOnd/aOAzzfIM8BDu/uHAp8Entoo35cA71yBxuLYxv//bwVe0N0/DDim8bZ1D/DoEeMcB3wBeEi3fC3wvBFjntoVhCPozzL+JTDd8mc7KbeVqCFdXOtI4zpiDRnfGjJuX0L2ZGBvVd1WVd8F3gU8e5SAVfUxZp0kNqqquruqPtXd/wb9znj25XVLjVlV9c1u8dDuNvIx6CSbgJ8C3jRqrJWU5Gj6xfsqgKr6blV9reEqzgb+vqq+2CDWRuAh3UmIR/CDJyou1cnAJ6rqH6t/KeZfAT8zYsxJ1byGgHVkHOqINWT1asi4NRbDXA+/pnQfTXwa/T2DUWNtSPJp+lOuH6qqkWMCrwdeDvxTg1iDCvhgkr9L8sIG8R4DfAX44yQ3JnlTkiMbxN3vfPpTjiOpqi8B/xW4A7gb6FXVB0cMezPwtCQPS3IE8CwefJWFhjd2NQQmto5YQ8a0hoxbYzFW17oneSjwp/SPZ3191HhV9f2qehL9y/WenOTUEfP7V8C9VfV3o+Y2hzOr6nT6H+P8oiRPGzHeRvpTzX9UVacB3wJ+4DsnlqO7UmEr8O4GsX6I/h7wScCjgCOTPHeUmFW1m/5HXH8I+AD96ft9I6Y6qcaqhsBE1xFryJjWkHFrLIa5Hn5NSHIo/WLwjqp6T8vY3fTdR+mfhDaKM4GtSW6nPyX8k0nePmJMAKrqru7fe4H30p+CHsUMMDOwd3Ud/SLRwnnAp6rqyw1inQN8oaq+UlXfA94D/PioQavqqqo6vaqeRn/KfbGvMdTcxqaGwGTXEWvI+NaQcWsshrke/qBLEvrH8XZX1e81ivkjSY7p7j+E/sb3uVFiVtWlVbWpqk6k/7P8cFWN1Bl3+R2Z5Kj994Fn0p+KGyXXe4A7k/xY99DZwC0jJfqAC2gwhdm5A3hqkiO67eBs+sfGR5Lk4d2/JwA/S7t8J81Y1BCY7DpiDRnvGjLMJ2+uGTXP9fCjxExyDXAWcGySGeBVVXXViKmeCVwIfLY7lgnwG1W1Y4SYjwTe2n1T5CHAtVX1/hHzXCmPAN7b/51gI/DOqvpAg7i/DLyj+4NwG/CLowbsjjc+A/ilUWMBVNUnk1wHfIr+VOONwP9oEPpPkzwM+B7woqq6v0HMibMSNQSsIyvAGjLGNWTRbzeVJEka1rgdCpEkSWuYjYUkSWrGxkKSJDVjYyFJkpqxsZAkSc3YWEiSpGZsLCRJUjP/P4HwKpSuztd6AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1db58b1bac8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "with figsize(y=5.5):\n",
    "    for i in range (4):\n",
    "        random.seed(3)\n",
    "        plt.subplot(221+i)\n",
    "        train_filter(148+i, kernel=[.1, .8, .1], \n",
    "                     sensor_accuracy=.8,\n",
    "                     move_distance=4, do_print=False)\n",
    "        plt.title ('iteration {}'.format(148+i))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see that there was a problem on iteration 149 as the confidence degrades. But within a few iterations the filter is able to correct itself and regain confidence in the estimated position."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Bayes Theorem"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We developed the math in this chapter merely by reasoning about the information we have at each moment. In the process we discovered [*Bayes Theorem*](https://en.wikipedia.org/wiki/Bayes%27_theorem). Bayes theorem tells us how to compute the probability of an event given previous information. That is exactly what we have been doing in this chapter. With luck our code should match the Bayes Theorem equation! \n",
    "\n",
    "We implemented the `update()` function with this probability calculation:\n",
    "\n",
    "$$ \\mathtt{posterior} = \\frac{\\mathtt{likelihood}\\times \\mathtt{prior}}{\\mathtt{normalization}}$$ \n",
    "\n",
    "To review, the *prior* is the probability of something happening before we include the probability of the measurement (the *likelihood*) and the *posterior* is the probability we compute after incorporating the information from the measurement.\n",
    "\n",
    "Bayes theorem is\n",
    "\n",
    "$$P(A \\mid B) = \\frac{P(B \\mid A)\\, P(A)}{P(B)}$$\n",
    "\n",
    "If you are not familiar with this notation, let's review. $P(A)$ means the probability of event $A$. If $A$ is the event of a fair coin landing heads, then $P(A) = 0.5$.\n",
    "\n",
    "$P(A \\mid B)$ is called a [*conditional probability*](https://en.wikipedia.org/wiki/Conditional_probability). That is, it represents the probability of $A$ happening *if* $B$ happened. For example, it is more likely to rain today if it also rained yesterday because rain systems usually last more than one day. We'd write the probability of it raining today given that it rained yesterday as $P(\\mathtt{rain\\_today} \\mid \\mathtt{rain\\_yesterday})$.\n",
    "\n",
    "In the Bayes theorem equation above $B$ is the *evidence*, $P(A)$ is the *prior*, $P(B \\mid A)$ is the *likelihood*, and $P(A \\mid B)$ is the *posterior*. By substituting the mathematical terms with the corresponding words  you can see that Bayes theorem matches out update equation. Let's rewrite the equation in terms of our problem. We will use $x_i$ for the position at *i*, and $Z$ for the measurement. Hence, we want to know $P(x_i \\mid Z)$, that is, the probability of the dog being at $x_i$ given the measurement $Z$. \n",
    "\n",
    "So, let's plug that into the equation and solve it.\n",
    "\n",
    "$$P(x_i \\mid Z) = \\frac{P(Z \\mid x_i) P(x_i)}{P(Z)}$$\n",
    "\n",
    "That looks ugly, but it is actually quite simple. Let's figure out what each term on the right means. First is $P(Z \\mid x_i)$. This is the the likelihood, or the probability for the measurement at every cell $x_i$. $P(x_i)$ is the *prior* - our belief before incorporating the measurements. We multiply those together. This is just the unnormalized multiplication in the `update()` function:\n",
    "\n",
    "```python\n",
    "def update(likelihood, prior):\n",
    "    posterior = prior * likelihood   # P(Z|x)*P(x)\n",
    "    return normalize(posterior)\n",
    "```\n",
    "\n",
    "The last term to consider is the denominator $P(Z)$. This is the probability of getting the measurement $Z$ without taking the location into account. It is often called the *evidence*. We compute that by taking the sum of $x$, or `sum(belief)` in the code. That is how we compute the normalization! So, the `update()` function is doing nothing more than computing Bayes theorem.\n",
    "\n",
    "The literature often gives you these equations in the form of integrals. After all, an integral is just a sum over a continuous function. So, you might see Bayes' theorem written as\n",
    "\n",
    "$$P(A \\mid B) = \\frac{P(B \\mid A)\\, P(A)}{\\int P(B \\mid A_j) P(A_j) \\mathtt{d}A_j}\\cdot$$\n",
    "\n",
    "In practice the denominator can be fiendishly difficult to solve analytically (a recent opinion piece for the Royal Statistical Society [called it](http://www.statslife.org.uk/opinion/2405-we-need-to-rethink-how-we-teach-statistics-from-the-ground-up) a \"dog's breakfast\" [8].  Filtering textbooks are filled with integral laden equations which you cannot be expected to solve. We will learn more techniques to handle this in the **Particle Filters** chapter. Until then, recognize that in practice it is just a normalization term over which we can sum. What I'm trying to say is that when you are faced with a page of integrals, just think of them as sums, and relate them back to this chapter, and often the difficulties will fade. Ask yourself \"why are we summing these values\", and \"why am I dividing by this term\". Surprisingly often the answer is readily apparent."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "## Total Probability Theorem\n",
    "\n",
    "We now know the formal mathematics behind the `update()` function; what about the `predict()` function? `predict()` implements the [*total probability theorem*](https://en.wikipedia.org/wiki/Law_of_total_probability). Let's recall what `predict()` computed. It computed the probability of being at any given position given the probability of all the possible movement events. Let's express that as an equation. The probability of being at any position $i$ at time $t$ can be written as $P(X_i^t)$. We computed that as the sum of the prior at time $t-1$ $P(X_j^{t-1})$ multiplied by the probability of moving from cell $x_j$ to $x_i$. That is\n",
    "\n",
    "$$P(X_i^t) = \\sum_j P(X_j^{t-1})  P(x_i | x_j)$$\n",
    "\n",
    "That equation is called the *total probability theorem*. Quoting from Wikipedia [6] \"It expresses the total probability of an outcome which can be realized via several distinct events\". I could have given you that equation and implemented `predict()`, but your chances of understanding why the equation works would be slim. As a reminder, here is the code that computes this equation\n",
    "\n",
    "```python\n",
    "for i in range(N):\n",
    "    for k in range (kN):\n",
    "        index = (i + (width-k) - offset) % N\n",
    "        result[i] += prob_dist[index] * kernel[k]\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Summary\n",
    "\n",
    "The code is very short, but the result is impressive! We have implemented a form of a Bayesian filter. We have learned how to start with no information and derive information from noisy sensors. Even though the sensors in this chapter are very noisy (most sensors are more than 80% accurate, for example) we quickly converge on the most likely position for our dog. We have learned how the predict step always degrades our knowledge, but the addition of another measurement, even when it might have noise in it, improves our knowledge, allowing us to converge on the most likely result.\n",
    "\n",
    "This book is mostly about the Kalman filter. The math it uses is different, but the logic is exactly the same as used in this chapter. It uses Bayesian reasoning to form estimates from a combination of measurements and process models. \n",
    "\n",
    "**If you can understand this chapter you will be able to understand and implement Kalman filters.** I cannot stress this enough. If anything is murky, go back and reread this chapter and play with the code. The rest of this book will build on the algorithms that we use here. If you don't understand why this filter works you will have little success with the rest of the material. However, if you grasp the fundamental insight - multiplying probabilities when we measure, and shifting probabilities when we update leads to a converging solution - then after learning a bit of math you are ready to implement a Kalman filter."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## References\n",
    "\n",
    " * [1] D. Fox, W. Burgard, and S. Thrun. \"Monte carlo localization: Efficient position estimation for mobile robots.\" In *Journal of Artifical Intelligence Research*, 1999.\n",
    " \n",
    " http://www.cs.cmu.edu/afs/cs/project/jair/pub/volume11/fox99a-html/jair-localize.html\n",
    "\n",
    "\n",
    " * [2] Dieter Fox, et. al. \"Bayesian Filters for Location Estimation\". In *IEEE Pervasive Computing*, September 2003.\n",
    " \n",
    " http://swarmlab.unimaas.nl/wp-content/uploads/2012/07/fox2003bayesian.pdf\n",
    " \n",
    " \n",
    " * [3] Sebastian Thrun. \"Artificial Intelligence for Robotics\".\n",
    " \n",
    " https://www.udacity.com/course/cs373\n",
    " \n",
    " \n",
    " * [4] Khan Acadamy. \"Introduction to the Convolution\"\n",
    " \n",
    " https://www.khanacademy.org/math/differential-equations/laplace-transform/convolution-integral/v/introduction-to-the-convolution\n",
    " \n",
    " \n",
    "* [5] Wikipedia. \"Convolution\"\n",
    "\n",
    " http://en.wikipedia.org/wiki/Convolution\n",
    "\n",
    "* [6] Wikipedia. \"Law of total probability\"\n",
    "\n",
    "  http://en.wikipedia.org/wiki/Law_of_total_probability\n",
    "  \n",
    "* [7] Wikipedia. \"Time Evolution\"\n",
    "\n",
    " https://en.wikipedia.org/wiki/Time_evolution\n",
    " \n",
    "* [8] We need to rethink how we teach statistics from the ground up\n",
    " \n",
    " http://www.statslife.org.uk/opinion/2405-we-need-to-rethink-how-we-teach-statistics-from-the-ground-up"
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.4"
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "state": {},
    "version_major": 2,
    "version_minor": 0
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}