Assingment 2 - Solution.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# ML Summer School - Assignment 2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Welcome to Machine Learning Summer School (2018) - Assignment 2. In this, assignment you will be making a spam classifer. That is given a SMS, you have to build a model that classifies whether the message is a spam or ham (not spam). "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The first step we will do is to import the machine learning libraries. We will be using NumPy, Matplotlib, Pandas, and scikit-learn in this assignment. We will also be using NLTK (a library widely used for text processing)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Importing libraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "%matplotlib inline\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "from nltk.corpus import stopwords\n",
    "import pandas as pd\n",
    "from sklearn.feature_extraction.text import CountVectorizer\n",
    "from sklearn.linear_model import LogisticRegression\n",
    "from sklearn.model_selection import train_test_split\n",
    "from sklearn.metrics import classification_report\n",
    "from sklearn.metrics import f1_score\n",
    "from sklearn.naive_bayes import MultinomialNB"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Loading data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### TASK 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The first task you need to do is load the csv file as a Pandas DataFrame. First go ahead and open `sms-spam.csv` file in a text editor. Analyse the data - how many columns are there, how big the data is. Identify some patterns which may help the algorithm in classififcation.   \n",
    "\n",
    "Load the csv as a Pandas DataFrame. The Pandas DataFrame should be named `df` and must contain only two columns named `text` and `is spam`. The `text` column should contain the SMS and `is spam` column should contain `1` if the SMS is spam and `0` if the SMS is a ham.\n",
    "\n",
    "\n",
    "You will need to use Pandas' `read_csv` function. The csv file is in `latin1` encoding. You will need to care take of that. You may find `encoding`, `usecols` and `names` arguments of `read_csv` helpful.  \n",
    "To convert 'spam' and 'ham' to 1 and 0 respectively, you may find `DataFrame.apply` useful."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Free entry in 2 a wkly comp to win FA Cup fina...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>U dun say so early hor... U c already then say...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>Nah I don't think he goes to usf, he lives aro...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text\n",
       "1        0  Go until jurong point, crazy.. Available only ...\n",
       "2        0                      Ok lar... Joking wif u oni...\n",
       "3        1  Free entry in 2 a wkly comp to win FA Cup fina...\n",
       "4        0  U dun say so early hor... U c already then say...\n",
       "5        0  Nah I don't think he goes to usf, he lives aro..."
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# YOUR CODE STARTS HERE\n",
    "df = pd.read_csv('sms-spam.csv', encoding='latin1', usecols=[0, 1], names=['is spam', 'text'])[1:]\n",
    "df['is spam'] = df['is spam'].apply(lambda x: 0 if x == 'ham' else 1)\n",
    "# YOUR CODE ENDS HERE\n",
    "\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Analysing data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The second step in Machine Learning Pipeline is to analyse the data. Analysing the data helps in [Feature Engineering](https://medium.com/mindorks/what-is-feature-engineering-for-machine-learning-d8ba3158d97a).  \n",
    "\n",
    "The most important part of traditional Machine Learning is how well you represent the data. Tradional Machine Learning approaches can't work directly on raw data. You need to represent the data in a way that is easy for machines to work with.\n",
    "\n",
    "In this section, we will analyse the data and side by side engineer new features."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 5572 entries, 1 to 5572\n",
      "Data columns (total 2 columns):\n",
      "is spam    5572 non-null int64\n",
      "text       5572 non-null object\n",
      "dtypes: int64(1), object(1)\n",
      "memory usage: 87.1+ KB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We see that we don't have any data misising. So, we don't need to [handle missing data](https://machinelearningmastery.com/handle-missing-data-python/)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead tr th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe thead tr:last-of-type th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr>\n",
       "      <th></th>\n",
       "      <th colspan=\"4\" halign=\"left\">text</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th></th>\n",
       "      <th>count</th>\n",
       "      <th>unique</th>\n",
       "      <th>top</th>\n",
       "      <th>freq</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>is spam</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4825</td>\n",
       "      <td>4516</td>\n",
       "      <td>Sorry, I'll call later</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>747</td>\n",
       "      <td>653</td>\n",
       "      <td>Please call our customer service representativ...</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         text                                                               \n",
       "        count unique                                                top freq\n",
       "is spam                                                                     \n",
       "0        4825   4516                             Sorry, I'll call later   30\n",
       "1         747    653  Please call our customer service representativ...    4"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.groupby('is spam').describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[`groupby`](https://www.datacamp.com/community/tutorials/pandas-split-apply-combine-groupby) is a powerful way to analyse (and manipulate the data).  \n",
    "Using the above command, we can see that 747 messages are spam, while 4825 messages are ham. We also observe that most of the message are unique."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### TASK 2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Plot a pie chart showing the number of spam and ham messages in the dataset. Make sure you use you give it a title and use change the default colors (green or red maybe?)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWQAAAD7CAYAAABdXO4CAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAHMBJREFUeJzt3Xe8HHW9//HXmyQkpBBKAAkloUkJRQmhBJAWVFQUxWtElNDBggUUVNBDvPbeBbFwgYsooAJyFeFiKIoEEGIIYAQShBAJAVIIIfXz++M752bJL23P2T3fmd338/GYx9mc3Z15Z0/yPt/9zuyMIgIzM8tvvdwBzMwscSGbmZWEC9nMrCRcyGZmJeFCNjMrCReymVlJuJArTNJFkj7ToHVtK+lFSb2KP0+QdGoj1l2s7/eSxjVqfXVs9/OSZkv6d09v26xe8nHI5SRpOrAFsBRYBjwEXAb8OCKWd2Fdp0bELXU8ZwJwRUT8pJ5tFc+9ENgxIt5b73MbSdI2wFRgWETMypnFbF14hFxuR0fEIGAY8GXgPOCnjd6IpN6NXmdJDAOecxlbVbiQKyAi5kbE9cBYYJyk3QEkXSrp88XtIZJ+J2mOpOcl3SFpPUmXA9sCNxRTEudKGi4pJJ0i6V/ArTXfqy3nHSRNlDRX0nWSNim2daikp2ozSpouaYykNwKfBsYW25tU3P9/UyBFrgskPSFplqTLJA0u7uvMMU7Sv4rphvNX99pIGlw8/9lifRcU6x8D3AwMLXJcuornHirpqeI1mSVppqRjJL1J0tTidfx0zePXk/RJSY9Jek7Sr2pek36Srii+P0fSPZK2KO47UdLjkuZLmibp+OL7O0i6tXjObEn/LWmjmu3tLen+4nlXS/pl58+7uP8tkh4otvcXSXvW3HeepBnFc/8h6YjVvYZWIhHhpYQLMB0Ys4rv/wt4f3H7UuDzxe0vARcBfYrlYFZMSb1iXcBwIEhTIAOADWq+17t4zARgBrB78ZhrSVMYAIcCT60uL3Bh52Nr7p9AmjYBOBl4FNgeGAj8Grh8pWyXFLn2AhYBu67mdboMuA4YVDx3KnDK6nKu9NxDSVNCny1es9OAZ4Eri/WNAF4Gti8e/1Hgr8DWQF/gYuAXxX1nADcA/YFewEhgw+K1mwfsXDxuS2BEcXtH4MhiXZsBtwPfLu5bH3gC+EiR7R3A4pqf997ALGC/Ynvjip9BX2Bn4ElgaM1rukPuf9Ne1r54hFw9TwObrOL7S0j/2YdFxJKIuCOK/41rcGFELIiIhau5//KIeDAiFgCfAd7VudOvm44HvhkRj0fEi8CngHevNDofHxELI2ISMIlUzK9QZBkLfCoi5kfEdOAbwPvqyLIE+EJELAGuAoYA3ynWNwWYAnSOPM8Azo+IpyJiEekXzzuL3EuATUlz58si4r6ImFc8bzmwu6QNImJmsV4i4tGIuDkiFkXEs8A3gUOK5+wP9Aa+W/w8fw1MrMl9GnBxRNxdbO+/SL+49iftc+gL7CapT0RMj4jH6nhNLBMXcvVsBTy/iu9/jTTq/GPx9viT67CuJ+u4/wnSSG3IOqVcs6HF+mrX3Zu0E7NT7VERL5FG0isbwoqRZO26tqojy3MRsay43fmL6Zma+xfWbHsY8JtiimAO8DCp/LYALgduAq6S9LSkrxZluID0S+NMYKakGyXtAiBpc0lXFVML84ArWPH6DgVmrPRLtfbnMQw4pzNLkWcb0qj4UdJo/kJgVrGNoXW8JpaJC7lCJI0ilc2dK99XjOjOiYjtgaOBs2vmDVc3Ul7bCHqbmtvbkkaBs4EFpLfmnbl6kd5yr+t6nyYVSu26l/LKIlwXs4tMK69rRp3rWVdPAkdFxEY1S7+ImFGMYsdHxG7AaOAtwAkAEXFTRBxJegfzCGk6BtI0UwB7RsSGwHsBFffNBLaSpBWbf8XP40nSyL42S/+I+EWxzSsj4iDSaxPAVxr/clijuZArQNKGkt5Cekt9RURMXsVj3iJpx+I/8DzSyK1z5PcMab62Xu+VtJuk/sDngGuK0eRUoJ+kN0vqA1xAeovc6RlguKTV/fv6BfAxSdtJGgh8EfhlRCytJ1yR5VfAFyQNkjQMOJs00myGi4ptDQOQtJmktxW3D5O0R/HLaR7pF8UySVtIequkAaQphRdZ8XMZVPx5jqStgE/UbOuu4nEfktS72M6+NfdfApwpaT8lA4qfxyBJO0s6XFJf0hz4wpptWom5kMvtBknzSaOh80lzjCet5rE7AbeQ/oPfBfwwIiYU930JuKB4a/vxOrZ/OWnH4b+BfsCHIR31AXwA+AlpNLoAqD3q4uri63OS/raK9f6sWPftwDRSaZxVR65aZxXbf5z0zuHKYv3N8B3getK00HzSDr79ivteBVxDKuOHgdtIvxjWA84hvSt4njRH/IHiOeNJO+fmAjeSdm4CEBGLSTvyTgHmkEbPvyOVOhFxL2ke+fvAC6TpqhOLp/clHSY5m/Sz25x05AuSjpc0pSGvhjWcPxhiVhGS7gYuioif585izeERsllJSTpE0quKKYtxpKM9/pA7lzVPq35Cy6wV7EyaIx8IPAa8MyJm5o1kzeQpCzOzkvCUhZlZSbiQzcxKwoVsZlYSLmQzs5JwIZuZlYQL2cysJFzIZmYl4UI2MysJF7KZWUm4kM3MSsKFbGZWEi5kM7OScCGbmZWEC9nMrCRcyGZmJeFCNjMrCReymVlJuJDNzErChWxmVhIuZDOzknAhm5mVhAvZzKwkXMhmZiXRO3cAs/+PJGBjYBNgA2D9VSx9V/pzn+LZi2uWJcAiYCGwAHipWBYA84h4qWf+QmbrxoVsPUPqC2wHbAtsDgypWTZb6fYmQK8eyPQS8Awwq1hWd3smEc81PY+1PUVE7gzWKqRNgB2A7YuvtctWgPKF67a5wKPAP1daHiVids5g1jpcyFY/aQiwF/Ca4utupNLdKGesjOawoqCnAg8A9xIxI2sqqxwXsq2ZtAUwCtinWF4LDM2aqTpmAvcB9xbLPUTMyhvJysyFbCuknWl7AocDB5GKeJusmVrPU6wo6LuBv3jnonVyIbc7aRdSAR8OHELasWY9ZwkwEfgTcCtwFxEv541kubiQ2400HDgCOKxYPP1QLi8DdwI3ATcRMTlzHutBLuRWl6Yh9gOOBd5O2vlm1fE08EfgeuD3Hj23NhdyK5J6AQezooS3yhvIGuRF4HfA1aRyXpg5jzWYC7lVSH1IUxHHAm8jfcDCWteLwI3Ar3A5twwXctVJhwInkUp4cN4wlklnOV8N3OhpjepyIVeRtDlwInAqsFPeMFYyLwCXARcT8XDuMFYfF3JVpJ1zRwKnkUbDfdb8BDNuBy4CriVice4wtnYu5LKThgInA6cAw/OGsYp6FriUNGp+LHMWWwMXcllJ+wOfII2Gm3/mM2sHAdwC/Ai4jojlmfPYSlzIZZKmJd4CnEv66LJZs0wFvgRcQcTS3GEscSGXQTpu+Djgk8CIzGmsvUwDvgxc6nnm/FzIOUm9gROATwE7Zk5j7e0p4KvAJT5sLh8Xcg5pRHwScD7eUWfl8m/gG8CPiFiQO0y7cSH3NOn1pH/wu+eOYrYGs4HPAz8kYknuMO3ChdxT0mkuvwG8KXcUszpMBc4l4rrcQdrBerkDtDxpU6TvAZNxGVv1vBr47XLp5tGnyu/qmsyF3CxSH6SPkS6M+SF8hW+rqKXi6aPfw2Z3bcMDGq/varx8zpQm8ZRFM0hHAj/A55mwint8I/466nR2eb7/Ky5g+wxwHnBZdLhAGsmF3EjSINI88Wm5o5h1R8DLXxvNPee9noPX8LA/A++PDl/VpFFcyI0iHQH8FBiWO4pZdyzszaMHn0zcN3Sd3uEtJh1H/y2PlrvPhdxd0kDSAfVnAsqcxqxb7tqa248Yx6iFfdigzqfeDIyLjpjZjFztwoXcHenk8D8DtsucxKxblsOcD76ZRy4axf7dWM1s4OToiBsalavduJC7QtqANCr+IB4VW8U934+/73MGm07buGHXXvwRcE50+LJS9XIh10saDvwaeG3eIGbdE7Ds2t24893v5KBl6zX8FK8PAcdFR/y9wettaS7kekhjgKuATXNHMeuOpWLmMe9m1o07s1cTN7OIdAbD73iH37pxIa8r6ROk88f6ZPFWadM24u5Rp/Pq5/qzcQ9t8ibSaPmFHtpeZbmQ10bqT9pxNzZ3FLPuCHj5Gwcw8RNv4HUZNv8wcFR0xBMZtl0ZLuQ1kbYHfgPsmTuKWXcs7M1jrzuJ5fdulfXTozNJpTwpY4ZScyGvjnQ4cA302Ns6s6aYOJQ7DjuRkS+tT//cWYD5wDuiI27JHaSMXMirIr0DuBLomzuKWVcth7kfPoqHfrAfB+TOspIlwCnREZfnDlI2LuSVSacCF+Gdd1ZhL/Tj7yMbe2xxM3w6OuJLuUOUiQu5lvRx4Gu5Y5h1VcDy3+zCHe96V1OOLW6GHwJnRUcszx2kDFzInaQLgP/MHcOsq5aKmceO5Znrd+E1ubPU6TrSYXFt/8k+FzKAdCHQkTuGWVc9MZiJ+5zOjrMHsEnuLF10I3BMdMTS3EFy8hVDpPG4jK2iAhZ9ez9uH/4x9q1wGQO8mbTvpq219whZOpN0IhSzynm5F4+97iSW3bM1r86dpYH+Mzris7lD5NK+hSy9mTR3VYUdH2avcO+W3HHISaU5trjRzoyOuDh3iBzac8pC2hv4JS5jq5iAuR95I3eNOoODW7SMAX6g8TqmUSuTNFzSg41aXzO1XyFL2wK/AwbkjmJWjzl9mbzTWcz/7v6l+6BHo/UCfqHxOjB3kJ7WXoUsDQb+B9gydxSzdRWw/LqduW2zc9n1sU3ZOneeHtIPuEHjtWuD1tdL0iWSpkj6o6QNJJ0m6R5JkyRdq3QiMSRdKulHkv4k6XFJh0j6maSHJV3aoDyr1D6FLPUhnVh+RO4oZutqqfj3sWOZdMxxHLK0F71z5+lhGwN/0HgNbcC6dgJ+EBEjgDnAscCvI2JUROxFOhvdKStt+3DgY8ANwLdI3bGHpKYd590+hQxfIb3AZpXw5IZMHPpx+vxm17a+Os22wFUar+7u75kWEQ8Ut+8DhgO7S7pD0mTgeF45WLsh0hEPk4FnImJyRCwHphTPbYr2KOR0pY+P5o5hti4CFn13X27b9mz2fXaAr04DHAyc3811LKq5vQzoDVwKfCgi9gDGk6ZJVn788pWeu7x4blO0fiFLm5BeeF+M1EpvUS+mjT6F6R95E4fkzlIyn9V4jW7wOgcBM5WmM49v8Lq7pPULGS6GUp/xygyAv23JnZuex+Z/3Yadc2cpoV7AlRqvwQ1c52eAu4GbgUcauN4ua+0PhkjjSKNjs9IKmHfO63nwW6Np9AiwFV0WHTEud4hmad1ClrYDJpHelpiV0ty+TBl1Ohv+c1O2yZ2lQt4UHfH73CGaoTULWVoPuA04KHcUs1UJWH7jq7nj7WM5sA0PZ+uup4AR0RHzcgdptFadQ34fLmMrqWXimf94Fw8c/Z62PLa4EbYGvp47RDO03ghZ2gCYCm3ziSarkKcGcc/IM9hu1kCG5M7SAg6Ijvhr7hCN1Ioj5I/hMraSCVj8/VHcvu3Z7OMybpjxuQM0WmuNkKXNgEeBDXNHMeu0qBfTDhvHoru2ZZfcWVrQ6OiIu3KHaJRWGyF34DK2Enlgi3Rsscu4aVpqlNw6I2Tp1aTPmXsniWUXMO/cI5n89QNpu1NIZnBQdMSfc4dohFYqry/TWn8fq6h56zNl1OkMmjrEZdxDxgNjcodohNYYIafR8SP4fBWWUUD8fkduP+Y4Ri/pRZ/cedrMwdERd+YO0V2tMqI8C5exZbRMzDruWJ68enefFCiT8cARuUN0V/VHyNKGwAxgYO4o1p6eHsi9e5/JsGcGslnuLG3ukOiI23OH6I5WOMpiHC5jyyBg8UX7cNvW5zDSZVwKZ+YO0F2tMEKeBOyZO4a1l0W9mD7mBBbeOYxGXfPNum8+sHl0xMu5g3RVtUfI0khcxtbD/r45dw45lyEu49IZBLwhd4juqHYhw8m5A1j7CJj/yTH8ea8PcNCLfT1NVlLvzB2gO6o9ZSHNABpxRVqzNZq3Pg/tezoD/jGEYbmz2BrNJU1bLM4dpCuqO0KWdsdlbE0WEH/YgQlDzmMnl3ElDAaOzB2iq6pbyBV+0a0alolnj3snfzvqfRzqD3pUSmWnLao7ZSH9D3BU7hjWmmYO5N6RZzBs5iAfzlZBLwBbREcsyR2kXtUcIUvrgz8RZY0XsOSSvbltq3MY6TKurI2Bw3OH6IqqfnT6QKB/7hDWWhavxxNHnsCC24f7l30LOBC4KXeIelW1kD1/bA314Gb8efSp7Dm/r3fctYjdcgfoiqoW8gG5A1hrCHjx00cw6csH+1SZLaaSH9qp5k496Ul83Tzrpvnr8/D+p7LBQ5szPHcWa7glQP/oiKW5g9Sjejv1pH7AVrljWHUFxM3bc9uQc9nBZdyy+gA75Q5RrypOWWyHz31sXbRMPHvC23niyj29464N7AY8nDtEPapYyDvkDmDV9O8B3DfyDLZ5ekP2yZ3FekTl5pGrWMg75g5g1RKw5Gev5S+nvZXXhfzuqo1U7kiLKhayR8i2zhavx7/e8D7mT9jOUxRtyIXcA3ycqK2Th4bw5wNOZY95/dg2dxbL4lW5A9SrioXcN3cAK7eAFz9zGA984RAOyp3FsqpcV1SxkD0HaKv1Yh8e3v80+k3Z3GVsLuSeUL1jp63pAuLW7bj9TcdzwOLerJ87j5VC5f4dVO+TetKtwGG5Y1i5PDWIe64ewcLcOaxc5vbl0AsnVKfkqljIfwIOzR3DzEoviKjUO+pKhS1UMbOZ9TyfoL4HeKeema0LF3IPmJc7gJlVwvzcAepVxUJ+OncAM6uE6bkD1KuKhTwjdwAzq4THcweoVxUL+ancAcysElzIPaByL7KZZTEtd4B6VbGQp+YOYGaVULnBW/UKOWIGsCB3DDMrPY+Qe8iDuQOYWaktooL7m6payBNyBzCzUruLiGW5Q9SrqoV8a+4AZlZqt+QO0BVVLeQ7gcW5Q5hZabmQe0zES8DduWOYWSnNBe7NHaIrqlnIiactzGxVJlRx/hhcyGbWeio5XQFVPEF9J2l9YDYwKHcUMyuVXYl4JHeIrqjuCDliMXBV7hhmViqTqlrGUOVCTi7JHcDMSuXi3AG6o7pTFp2k+4HX5I5hZtktAIYSUdmLWFR9hAweJZtZclWVyxhaY4Q8mHQVkf65o5hZVvsScU/uEN1R/RFyxFzg6twxzCyr+6textAKhZz8OHcAM8uqJTqg+lMWnaSbgTG5Y5hZj5sFbE9E5c+T3iojZIDzgBb57WJmdfhiK5QxtNIIGUC6ChibO4aZ9ZgngZ2IWJQ7SCO00ggZ4HxgSe4QZtZjPtcqZQytVsgRj9Eik/tmtlZ/B36eO0QjtdaUBYC0BfAoMDB3FDNrqiOIaKmzPrbWCBkg4hng67ljmFlTXd9qZQytOEIGkPoC9wO75o5iZg03D9iTiCdyB2m01hshA8Uk/0lAJa8aYGZrdFYrljG0aiEDRNwNfCt3DDNrqGuIuCx3iGZpzSmLTlI/4B5g99xRzKzbZgJ7EPFc7iDN0pARsqQBkm6UNEnSg5LGSpou6SuSJhbLjsVjj5Z0t6T7Jd2idFQEki6U9F+S/lg89x2SvippsqQ/SOpTd7CIl4HjgJcb8fc0s6xOauUyhsZNWbwReDoi9oqI3YE/FN+fFxH7At8Hvl18705g/4h4LekSTOfWrGcH4M3A24ArgD9FxB7AwuL79Yt4cKVtmFn1/JCIm3KHaLZGFfJkYEwxIj440ikxAX5R8/WA4vbWwE2SJgOfAEbUrOf3EbGkWF8vVhT7ZGB4l9NFfA/4bZefb2Y5PULqipbXkEKOiKnASFJxfknSZzvvqn1Y8fV7wPeLke8ZQL+axywq1rccWBIrJriXA727GfO9pEPhzKw6ngPeSsRLuYP0hEbNIQ8FXoqIK0gfyti7uGtszde7ituDgRnF7XGN2P46SWeDOrpm22ZWbouAY4j4Z+4gPaW7o85OewBfk7ScdHKf9wPXAH0l3U0q/uOKx14IXC1pBvBXYLsGZVi7iBlIRwN3AAN6bLtmVq8g7cS7M3eQntS0w94kTQf2iYjZTdlAd0hvBX5DKx+HbVZtnyHi87lD9LT2LKSI64GP545hZqt0aTuWMbT6B0PWRvoB8IHcMczs/9wKvJF0tFXbafdCXg/4KXBi5iRmBhOBNxAxJ3eQXNpzyqJTOrzuZODi3FHM2twdwJh2LmNo90IGiAgizgS+kzuKWZu6mTRNMT93kNxcyJ0iPgp8JXcMszZzA3B0u3zwY21cyLUiPgmMzx3DrE38Cji2lS5S2l0u5JVFXAh8KncMsxZ3GfCedj2aYnVcyKsS8WXSzj7/5jZrvG8DJxLhK/qspL0Pe1sbaX/g18CWuaOYtYAlwAeI+EnuIGXlQl4baUtSKe+fO4pZhT1Lmi++I3eQMvOUxdpEzAQOBX6eOYlZVd0P7OsyXjsX8rqIWETEycCHgaW545hVyM+B0URMzx2kCjxlUS/pMNLhOkNyRzErsUXAh4n4ce4gVeJC7oo0r/wz0rUEzeyVJgPjiPAVeurkKYuuiJhJxFHAWaQLsJoZLAO+COzjMu4aj5C7S9oVuJx0TUGzdvUIaVQ8MXeQKvMIubsiHiYdEvdp/EESaz/LgW8Cr3UZd59HyI0k7Ubaq7xv7ihmPeAx0ifu2uq6d83kEXIjRTwEjAY+AryQOY1ZsywBvgXs5TJuLI+Qm0XalHTmuDOBXpnTmDXK74BziJiaO0grciE3mzSCNJo4MncUs26YApxNxB9zB2llnrJotogpRLweeCvwz9xxzOo0G/ggaXrCZdxkHiH3JGl90sevLwAGZ05jtiZLgO8Dn2v369z1JBdyDtIQ4GzSyGPDzGnMai0FriIVsd/R9TAXck7SRqQR80eATTKnsfa2CLgU+AoR0zJnaVsu5DKQBgLvB84BtsicxtrLAuBi4BtEPJ07TLtzIZeJ1A84FTgX2CZzGmttc4DvAd8h4rncYSxxIZeR1Ac4gXTyor0yp7HWMhP4LvBDIublDmOv5EIuO2k/4AxgLNA/cxqrrluBHwG/JcIXWSgpF3JVpB2A7yOV84jMaawangcuAy4i4h+5w9jauZCrSDqQVMz/AfTLnMbKJYBbgJ+SRsM+A2GFuJCrTNoEeC9wHL4qdrt7BPgl8HMinsgdxrrGhdwqpGHAu0hzzT5ZfnuYDFwDXEvElNxhrPtcyK1I2gF4R7HsByhvIGug+4BrgWv8SbrW40JuddJQ4G3A24GD8Zxz1SwHJrJiJDw9bxxrJhdyO0kfPDkQGAMcQZra8Bn/yucfwP8WywQins+cx3qIC7mdpUPpDmVFQe+SNU/7epJUvrcCtxIxI3Mey8SFbCtIWwGHA4eQRs8jgD5ZM7WeAB4H7gX+RCpgzwUb4EK2NZH6AnsC+5AKeiSwO9A7Z6wKCdJFCe4D/lZ8vd/nF7bVcSFbfdI89J6sKOg9gB3x6UNfBh4FHuCV5Ts/ayqrFBeyNYa0MbATqZw7l84/D8mYrJEWAtOBacBjwNSa5V9ELM8XzVqBC9maTxpMKubhwJbAq1ZahhTLgAzpAngBeHY1yyxWlPAz+D+MNZEL2cojzVlvWiybABsAfUnHTvddy+0gXfWic1m80p9rv7eAFYX7nM9+ZmXhQjYzKwl/KMDMrCRcyGZmJeFCNjMrCReymVlJuJDNzErChWxmVhIuZDOzknAhm5mVhAvZzKwkXMhmZiXhQjYzKwkXsplZSbiQzcxKwoVsZlYSLmQzs5JwIZuZlYQL2cysJFzIZmYl4UI2MysJF7KZWUm4kM3MSsKFbGZWEi5kM7OScCGbmZWEC9nMrCRcyGZmJeFCNjMrCReymVlJuJDNzErChWxmVhIuZDOzkvh/jkyRRQV6pLUAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe373280198>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# YOUR CODE STARTS HERE\n",
    "plt.title('Distribution of messages.')\n",
    "plt.pie([747, 4825], labels=['ham', 'spam'], colors=['g', 'r'])\n",
    "plt.plot()\n",
    "# YOUR CODE ENDS HERE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Adding features"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Percentage digits"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If you have gone through the dataset, you would have observed that spam messages have a lot more digits in them as compared to ham messages. So, lets create a feature based on that."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "      <th>percentage digits</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Free entry in 2 a wkly comp to win FA Cup fina...</td>\n",
       "      <td>16.129032</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>U dun say so early hor... U c already then say...</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>Nah I don't think he goes to usf, he lives aro...</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text  \\\n",
       "1        0  Go until jurong point, crazy.. Available only ...   \n",
       "2        0                      Ok lar... Joking wif u oni...   \n",
       "3        1  Free entry in 2 a wkly comp to win FA Cup fina...   \n",
       "4        0  U dun say so early hor... U c already then say...   \n",
       "5        0  Nah I don't think he goes to usf, he lives aro...   \n",
       "\n",
       "   percentage digits  \n",
       "1           0.000000  \n",
       "2           0.000000  \n",
       "3          16.129032  \n",
       "4           0.000000  \n",
       "5           0.000000  "
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def percentage_digits(text):\n",
    "    counter = 0\n",
    "    for i in text:\n",
    "        if i.isdigit():\n",
    "            counter += 1\n",
    "    return (counter / len(text)) * 100\n",
    "\n",
    "df['percentage digits'] = df['text'].apply(percentage_digits)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's plot to check if our observation was correct."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY8AAAEWCAYAAACe8xtsAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xm8HFWZ//HPlyTsgYAETMKSBDJgUEEmAo4KSBxAVIIMKv5kiIgiyjriCCgDCCIwjgOowyYwgAuLKLsIDBAYfjMQwiphkbAmJCEBQkLYE57545xOKk33vVXhdt/t+3697utWnTpV9XRVdT1dpzZFBGZmZlWs0N0BmJlZ7+PkYWZmlTl5mJlZZU4eZmZWmZOHmZlV5uRhZmaV9avkIeksSf/SRdPaUNJCSQNy/yRJ3+iKaefpXS9pYldNr8J8fyzpBUmz2z3vvkjS1yTdUehfKGl0yXFL130vvM5teQzs7gC6iqSngfWARcBi4GHgIuCciHgHICIOqDCtb0TEfzWrExHPAqu/t6iXzO84YJOI2Lsw/c90xbQrxrEBcDiwUUTMaff8u4qkScBvIuLc7o6lXkSU3maKdSVdAMyIiKO7Mp6+ss6t/frakcfnI2IwsBFwMnAEcF5Xz0RSn0m6dTYCXmzHTqQPL8Pepm3r3PqYiOgTf8DTwKfryrYG3gE+mPsvAH6cu9cBrgVeBl4C/puUTH+dx3kdWAh8HxgJBLAf8Cxwe6FsYJ7eJOAkYDIwH7gKWDsP24H0q/Fd8QK7AG8Bb+f5PVCY3jdy9wrA0cAzwBzSEdWaeVgtjok5theAH3awnNbM48/N0zs6T//T+TO/k+O4oMG4OwAzgB/k+TwNfLUwfCXg33IczwNnAavUjXsEMBv4dS6fANwPLACeAHYpxHkeMAt4DvgxMCAP+xpwR57XPOAp4DN52ImkI8838uf4ZS4/HZie53MP8MlC3KsAF+ZpPZLX+YzC8OHAH/Iyewo4pIPl+z7g6jyfycAJwB2F4UE6yqzVvSbXvTt/xnfVBfbP28db+TNdk4cfkZfNK8BjwPgWrvPDSdveLGDfzqbd2XpqEucmwG2k788LwKV1y+IQ4Mk87KeF+WwM3AK8mIf9FhhS9137Z+BB4FXSdrUecH1edv8FrNUkptrn/37h8+8O7Ar8lbTv+EGh/grAkaRt+UXgMpbuB1YGfpPLX87rfL3Csnoyx/MU+XtV4rNtBdyXx/s9cCl5H5eHf470/XoZ+B/gw4VhpbafpuurO3f4XflHg+SRy58Fvp27L2Bp8jiJtHMblP8+CajRtFi6g74IWI20s6mVFZPHc8AHc50/kJpOlmyAzeIFjqvVLQyfxNLk8XVgGjCa1FT2R5bufGtx/CrHtQXwJvCBJsvpIlJiG5zH/SuwX7M4G3yRFgH/TkoU25O+jJvm4aeRdpxr5+lfA5xUN+4pedxVSMl9PvD3pC/dCGCzXP9K4Oy8LNcl7Yi/VfiivQ18ExgAfBuYWVh/S5ZdIfa9STvrgaQd4Wxg5TzsZNJOay1gfdJOZkZhZ3APcAywYl4HTwI7N1lGl5B2GKvlbeE5miePS/LfqsBYUnJrVvcClt0pbJrrDy9sBxu3cJ0fT/qe7Aq8Rt7ZdjLtDtdTg3ldDPwwL/OVgU/ULYtbSdvWhnk+te/HJqRtaCVgKOnH3Wl137U7SQljBCkJ3At8JI9zC3BsJ5//mPz5v0lKlL/Ln3lz0g+V0bn+YXle6+dpnw1cnId9i/SdWDUvj78F1sjbygKWfo+GAZt39tlI2+MzwKE5tj1IPzBq+7it8mfdJs9vYl4WK1Fh+2m6bbR6p96uP5onjzvJv8RZNnkcnzf6TTqbFkt30KMblBWTx8mF4WPzihzAe08eNwPfqdtxvE3aEdbiWL8wfDKwV4PPNYCUWMYWyr4FTKq4I1mtUHYZ8C+ASIlk48KwjwFPFcZ9i7zDzmVnA6c2mM96Oc5VCmVfAW7N3V8DphWGrZqXwfvrl10Hn2UesEXuXiYZAN9gafLYBni2btyjgP9ssnzfJifAXPYTGh9N1OpuWhjW8MijftvN/ZuQdgyfBgZ18Dm7Yp2/Tt7Oc9kcYNsS0+5wPTWY10XAORS25bplsUuh/zvAzU2msztwX913rXiE/AfgzEL/wcCVnXz+2lHv4BzLNoU69wC75+5HKPyCJyWC2nf169T9+s91ViMdGfwDhW2+s88GbEf6caLC8DtYuo87EzihbvzHSD/6Sm0/Hf31tXMejYwgHVrW+ynp1/yNkp6UdGSJaU2vMPwZ0q+BdUpF2bHheXrFaQ8k7WRrilfKvEbjk/nrsPTXSnFaIyrEMi8iXq0bfzjpV9GqwD2SXpb0MvDnXF4zNyLeKPRvQDq8r7cRadnNKkzrbNIRSM2SzxsRr+XOpiejJR0u6RFJ8/P01mTpuhnOsuuu2L0RMLwWRx73Byy77GuGktZL/XbQSKO6nW1fS0TENNKv3OOAOZIukTS8QdWuWOcvRsSiQn9t+yoz7YbrSdIn89VkCyVNzeXfJ/0ImSxpqqSv18VRv1yHA0haN3/+5yQtIDUN1X/vni90v96gv6MLGV6MiMWFuo2mVxt/I+CKwrbyCKkZdT1Sk/gNwCWSZkr6V0mD8vfpy8ABpG3+Okmblfhsw4HnImeFBstoI+Dwum13A9LRRtntp6k+nTwkfZS0Id9RPywiXomIwyNiNPB54LuSxtcGN5lks/KaDQrdG5J+cbxA+kW+aiGuASy7U+1sujNJG0Jx2otYdgMu44UcU/20nqswjbUkrVY3/sw87ddJh9tD8t+asezVRfWfczqpTbfedNIv2nUK01ojIjYvGeMy85H0SVL77pdIzS1DSM1lylVmkZoZaorrcTrp6GlI4W9wROzaYL5zSeulfjtopFa32Xw7/EwAEfG7iPgEaX0GqUmwXles82aWe9oR8d8RsXr+2zyXzY6Ib0bEcNIRzBmSNimMVr9cZ+buk0if/8MRsQapiVJ0j+mk8zrF7WXliHguIt6OiB9FxFjg70jnI/YBiIgbIuLvSUcqj5KaoaHjzzYLGCGp+Fnrt90T62JZNSIuzvMss/001SeTh6Q1JH2O1J78m4j4S4M6n5O0SV7wC0i/Dmq/Lp4ntW1XtbeksZJWJTWLXZ5/sfwVWFnSZyUNIp1UXKkw3vPASEnN1sfFwD9JGiVpdVJTyKV1vwY7lWO5DDhR0mBJGwHfJf2aqeJHklbMO+XPAb+PdDn0r4BTJa0LIGmEpJ07mM55wL6SxktaIdffLCJmATcCP8vrcgVJG0vavmR89etvMGlHPRcYKOkYUltzzWXAUZLWkjQCOKgwbDKwQNIRklaRNEDSB/MPk2Xk5ftH4DhJq0oaS2pnfpcGdTcj70jKfCZJm0raUdJKpDb311m6/dbPpyvWebPP0GXTlvRFSbVkOo+0Qyt+pn/O62gDUjv/pbl8MOmE/8t5/f3z8sy/i5xFWh4bAUgaKmlC7v6UpA/lH48LSIl3saT1JO2Wf5S9Sfostc/d0Wf731zvIEkD83y2Lgz/FXCApG2UrJb3QYPLbj8d6WvJ4xpJr5Ay7g9JJ3b3bVJ3DOkqi4WklXBGREzKw04Cjs6Het+rMP9fk9qmZ5NO+B0CEBHzSW2055J+lb1KuoKj5vf5/4uS7m0w3fPztG8nXYnxBqmddnkcnOf/JOmI7Hd5+mXNJn2xZ5Ku/DggIh7Nw44gNQXemQ+x/4t0fqahiJhMWj+nko4EbmPpr9h9SE0iD+f5XU76VVbG6cCekuZJ+jmpqeB6UhJ/hrT8iof3x5PWx1M55stJX+LaDvLzwJZ5+Auk9bhmk3kfRGrCmE3aFv6zgzgPytOZTVq/F9fm28B5wNi8TV5J+vFxco5nNqlJ7wdNxn2v67wjXTntjwJ3SVpIuvDi0Ih4qjD8KtL5hfuB61h6Gf6PSCeH5+fyPy7n/LvC6aTYb8z7ojtJ580A3k/athaQmrNuIyXaFUgXccwkNbFvT9pfQAefLSLeIp0k3490zmRv0hWktW13CukE/y9J36FppPNQ0MH2I+mrhabEpmpXp5h1StIOpCO59Tur25tJ+jbpgoOyRzpdNd9TSCeTGx6t9GeSAhiT2+qtCUl3AWdFREc/WrpEXzvyMKtM0jBJH8/NY5uSfgVe0Yb5bibpw7lJYWvSL8iWz9f6DknbS3p/braaCHyYdKFKy/kuX7PUPHY2MIp0+H8JcEYb5juY1FQ1nHTZ5M9ITTNmZW1KOu+0OunKxT3zOcOWc7OVmZlV5mYrMzOrrE82W62zzjoxcuTI7g7DzKxXueeee16IiKGd1+yjyWPkyJFMmTKlu8MwM+tVJDV7IsK7uNnKzMwqc/IwM7PKnDzMzKwyJw8zM6vMycPMzCpz8jAzs8qcPMzMrDInDzMzq8zJw8zMKuuTd5i/VyOPvK6l03/65M+2dPpmZq3mIw8zM6vMycPMzCpz8jAzs8qcPMzMrDInDzMzq8zJw8zMKnPyMDOzypw8zMysMicPMzOrzMnDzMwqc/IwM7PKnDzMzKwyJw8zM6vMycPMzCpz8jAzs8qcPMzMrDInDzMzq8zJw8zMKmt58pA0QNJ9kq7N/aMk3SXpcUmXSloxl6+U+6fl4SML0zgqlz8maedWx2xmZh1rx5HHocAjhf5TgFMjYgwwD9gvl+8HzIuITYBTcz0kjQX2AjYHdgHOkDSgDXGbmVkTLU0ektYHPgucm/sF7AhcnqtcCOyeuyfkfvLw8bn+BOCSiHgzIp4CpgFbtzJuMzPrWKuPPE4Dvg+8k/vfB7wcEYty/wxgRO4eAUwHyMPn5/pLyhuMs4Sk/SVNkTRl7ty5Xf05zMysoGXJQ9LngDkRcU+xuEHV6GRYR+MsLYg4JyLGRcS4oUOHVo7XzMzKG9jCaX8c2E3SrsDKwBqkI5Ehkgbmo4v1gZm5/gxgA2CGpIHAmsBLhfKa4jhmZtYNWnbkERFHRcT6ETGSdML7loj4KnArsGeuNhG4KndfnfvJw2+JiMjle+WrsUYBY4DJrYrbzMw618ojj2aOAC6R9GPgPuC8XH4e8GtJ00hHHHsBRMRUSZcBDwOLgAMjYnH7wzYzs5q2JI+ImARMyt1P0uBqqYh4A/hik/FPBE5sXYRmZlaF7zA3M7PKnDzMzKwyJw8zM6vMycPMzCpz8jAzs8qcPMzMrDInDzMzq8zJw8zMKnPyMDOzypw8zMysMicPMzOrzMnDzMwqc/IwM7PKnDzMzKwyJw8zM6vMycPMzCpz8jAzs8qcPMzMrDInDzMzq6zT5CFpY0kr5e4dJB0iaUjrQzMzs56qzJHHH4DFkjYBzgNGAb9raVRmZtajlUke70TEIuALwGkR8U/AsNaGZWZmPVmZ5PG2pK8AE4Frc9mg1oVkZmY9XZnksS/wMeDEiHhK0ijgN60Ny8zMerKBnVWIiIclHQFsmPufAk5udWBmZtZzlbna6vPA/cCfc/+Wkq5udWBmZtZzlWm2Og7YGngZICLuJ11xZWZm/VSZ5LEoIubXlUUrgjEzs96h03MewEOS/h8wQNIY4BDgf1oblpmZ9WRljjwOBjYH3gQuBhYAh7UyKDMz69nKXG31GvDD/GdmZtZ58pB0De8+xzEfmAKcHRFvtCIwMzPruco0Wz0JLAR+lf8WAM8Df5P7zcysnylzwvwjEbFdof8aSbdHxHaSprYqMDMz67nKHHkMlbRhrSd3r5N732pJVGZm1qOVOfI4HLhD0hOASDcIfkfSasCFrQzOzMx6pjJXW/0p39+xGSl5PFo4SX5aK4MzM7OeqexraMcAmwIfBr4kaZ/ORpC0sqTJkh6QNFXSj3L5KEl3SXpc0qWSVszlK+X+aXn4yMK0jsrlj0naueqHNDOzrlXmwYjHAr/If58C/hXYrcS03wR2jIgtgC2BXSRtC5wCnBoRY4B5wH65/n7AvIjYBDg110PSWGAv0o2KuwBnSBpQ+hOamVmXK3PksScwHpgdEfsCWwArdTZSJAtz76D8F8COwOW5/EJg99w9gaXnUC4HxktSLr8kIt7Mj4OfRnpQo5mZdZMyyeP1iHgHWCRpDWAOMLrMxCUNkHR/Hucm4Ang5fxaW4AZwIjcPQKYDpCHzwfeVyxvME5xXvtLmiJpyty5c8uEZ2Zmy6lM8pgiaQjphsB7gHuByWUmHhGLI2JLYH3S0cIHGlXL/9VkWLPy+nmdExHjImLc0KFDy4RnZmbLqczVVt/JnWdJ+jOwRkQ8WGUmEfGypEnAtsAQSQPz0cX6wMxcbQawATBD0kBgTeClQnlNcRwzM+sGZU6Yfzzf0wHwCeBrkjYqMd7QfMSCpFWATwOPALeSzqMATASuyt1X537y8FsiInL5XvlqrFGkK79KHfmYmVlrlGm2OhN4TdIWwPeBZ4CLSow3DLhV0oPA3cBNEXEtcATwXUnTSOc0zsv1zwPel8u/CxwJEBFTgcuAh0mvwj0wIhaX/HxmZtYCZe4wXxQRIWkCcHpEnCdpYmcj5aatjzQof5IGV0vlGw+/2GRaJwInlojVzMzaoEzyeEXSUcDewHb5HotBrQ3LzMx6sjLNVl8m3fC3X0TMJl0m+9OWRmVmZj1aqSMPUnPVYkl/Q3rG1cWtDcvMzHqyMkcetwMrSRoB3AzsC1zQyqDMzKxnK5M8lN9jvgfwi4j4Auk5U2Zm1k+VSh6SPgZ8Fbgul/nBhGZm/ViZ5HEYcBRwRURMlTSadKOfmZn1U2UeT3IbcFvtLvN8n8YhrQ7MzMx6rjKPJ/mYpIdJjxZB0haSzmh5ZGZm1mOVabY6DdgZeBEgIh4AtmtlUGZm1rOVeg1tREyvK/KzpczM+rEyNwlOl/R3QOT3jR9CbsIyM7P+qcyRxwHAgaTHkswgvY/8wFYGZWZmPVuZq61eIN3jYWZmBpRIHvkFTAcDI4v1I2K31oVlZmY9WZlzHleSXtR0DfBOa8MxM7PeoEzyeCMift7ySMzMrNcokzxOl3QscCPpvR4ARMS9LYvKzMx6tDLJ40PAPwI7srTZKnK/mZn1Q2WSxxeA0RHxVquDMTOz3qHMfR4PAENaHYiZmfUeZY481gMelXQ3y57z8KW6Zmb9VJnkcWzLozAzs16l7Ps8zMzMlij1VF0zM7MiJw8zM6usafKQdHP+f0r7wjEzs96go3MewyRtD+wm6RJAxYG+w9zMrP/qKHkcAxwJrA/8e90w32FuZtaPNU0eEXE5cLmkf4mIE9oYk5mZ9XBlLtU9QdJuwHa5aFJEXNvasMzMrCfr9GorSScBhwIP579Dc5mZmfVTZe4w/yywZUS8AyDpQuA+4KhWBmZmZj1X2fs8ig9GXLMVgZiZWe9R5sjjJOA+SbeSLtfdDh91mJn1a2VOmF8saRLwUVLyOCIiZrc6MDMz67nKHHkQEbOAq1sci5mZ9RIte7aVpA0k3SrpEUlTJR2ay9eWdJOkx/P/tXK5JP1c0jRJD0raqjCtibn+45ImtipmMzMrp5UPRlwEHB4RHwC2BQ6UNJZ01/rNETEGuDn3A3wGGJP/9gfOhJRsSO8U2QbYGji2lnDMzKx7dJg8JK0g6aHlmXBEzKo9/yoiXgEeAUYAE4ALc7ULgd1z9wTgokjuBIZIGgbsDNwUES9FxDzgJmCX5YnJzMy6RofJI9/b8YCkDd/LTCSNBD4C3AWsl8+h1M6lrJurjQCmF0abkcualdfPY39JUyRNmTt37nsJ18zMOlHmhPkwYKqkycCrtcKy7zCXtDrwB+CwiFggqWnVBmXRQfmyBRHnAOcAjBs37l3Dzcys65RJHj9a3olLGkRKHL+NiD/m4uclDYuIWblZak4unwFsUBh9fWBmLt+hrnzS8sZkZmbvXacnzPM7zJ8GBuXuu4FO3+WhdIhxHvBIRBQf6X41ULtiaiJwVaF8n3zV1bbA/NysdQOwk6S18onynXKZmZl1k06PPCR9k3T109rAxqTzDWcB4zsZ9ePAPwJ/kXR/LvsBcDJwmaT9gGeBL+ZhfwJ2BaYBrwH7AkTES5JOICUtgOMj4qVSn87MzFqiTLPVgaRLZO8CiIjHJa3b8SgQEXfQ+HwFNEg8ERF5Xo2mdT5wfolYzcysDcrc5/FmRLxV65E0kAYnrM3MrP8okzxuk/QDYBVJfw/8HrimtWGZmVlPViZ5HAnMBf4CfIt0buLoVgZlZmY9W5mn6r6TXwB1F6m56rF8fsLMzPqpMldbfZZ0ddUTpBPgoyR9KyKub3VwZmbWM5W52upnwKciYhqApI2B6wAnDzOzfqrMOY85tcSRPcnSu8LNzKwfanrkIWmP3DlV0p+Ay0jnPL7I0hv2zMysH+qo2erzhe7nge1z91zA79MwM+vHmiaPiNi3nYGYmVnvUeZqq1HAwcDIYv2yj2Q3M7O+p8zVVleSno57DfBOa8MxM7PeoEzyeCMift7ySMzMrNcokzxOl3QscCPwZq2w9n5yMzPrf8okjw+R3suxI0ubrSL3m5lZP1QmeXwBGF18LLuZmfVvZe4wfwAY0upAzMys9yhz5LEe8Kiku1n2nIcv1TUz66fKJI9jWx6FmZn1KmXe53FbOwIxM7Peo8wd5q+w9J3lKwKDgFcjYo1WBmZmZj1XmSOPwcV+SbsDW7csIjMz6/HKXG21jIi4Et/jYWbWr5Vpttqj0LsCMI6lzVhmZtYPlbnaqvhej0XA08CElkRjZma9QplzHn6vh5mZLaOj19Ae08F4EREntCAeMzPrBTo68ni1QdlqwH7A+wAnDzOzfqqj19D+rNYtaTBwKLAvcAnws2bjmZlZ39fhOQ9JawPfBb4KXAhsFRHz2hGYmZn1XB2d8/gpsAdwDvChiFjYtqjMzKxH6+gmwcOB4cDRwExJC/LfK5IWtCc8MzPriTo651H57nMzM+sfnCDMzKwyJw8zM6vMycPMzCpz8jAzs8paljwknS9pjqSHCmVrS7pJ0uP5/1q5XJJ+LmmapAclbVUYZ2Ku/7ikia2K18zMymvlkccFwC51ZUcCN0fEGODm3A/wGWBM/tsfOBOW3KR4LLAN6QVUx9YSjpmZdZ+WJY+IuB14qa54AulOdfL/3QvlF0VyJzBE0jBgZ+CmiHgp39l+E+9OSGZm1mbtPuexXkTMAsj/183lI4DphXozclmzcjMz60Y95YS5GpRFB+XvnoC0v6QpkqbMnTu3S4MzM7NltTt5PJ+bo8j/5+TyGcAGhXrrAzM7KH+XiDgnIsZFxLihQ4d2eeBmZrZUu5PH1UDtiqmJwFWF8n3yVVfbAvNzs9YNwE6S1sonynfKZWZm1o3KvMN8uUi6GNgBWEfSDNJVUycDl0naD3gW+GKu/idgV2Aa8BrpvSFExEuSTgDuzvWOj4j6k/BmZtZmLUseEfGVJoPGN6gbwIFNpnM+cH4XhmZmZu9RTzlhbmZmvYiTh5mZVebkYWZmlTl5mJlZZU4eZmZWmZOHmZlV5uRhZmaVOXmYmVllTh5mZlaZk4eZmVXm5GFmZpU5eZiZWWVOHmZmVpmTh5mZVebkYWZmlTl5mJlZZU4eZmZWmZOHmZlV5uRhZmaVOXmYmVllTh5mZlaZk4eZmVXm5GFmZpU5eZiZWWVOHmZmVpmTh5mZVebkYWZmlTl5mJlZZU4eZmZWmZOHmZlV5uRhZmaVDezuAGxZI4+8rqXTf/rkz7Z0+mbWP/jIw8zMKnPyMDOzypw8zMysMicPMzOrzMnDzMwqc/IwM7PKes2lupJ2AU4HBgDnRsTJ3RxSn9Pqy4TBlwqb9RW94shD0gDgP4DPAGOBr0ga271RmZn1X73lyGNrYFpEPAkg6RJgAvBwt0ZlXaY7j3p8xGVWnSKiu2PolKQ9gV0i4hu5/x+BbSLioEKd/YH9c++mwGMVZrEO8EIXhdvVHNvycWzLp6fG1lPjgr4V20YRMbRMxd5y5KEGZctkvYg4BzhnuSYuTYmIccszbqs5tuXj2JZPT42tp8YF/Te2XnHOA5gBbFDoXx+Y2U2xmJn1e70ledwNjJE0StKKwF7A1d0ck5lZv9Urmq0iYpGkg4AbSJfqnh8RU7twFsvV3NUmjm35OLbl01Nj66lxQT+NrVecMDczs56ltzRbmZlZD+LkYWZmlfWr5CFpF0mPSZom6cgGw1eSdGkefpekkW2KawNJt0p6RNJUSYc2qLODpPmS7s9/x7QjtjzvpyX9Jc93SoPhkvTzvNwelLRVm+LatLA87pe0QNJhdXXattwknS9pjqSHCmVrS7pJ0uP5/1pNxp2Y6zwuaWIb4vqppEfz+rpC0pAm43a47lsU23GSniuss12bjNvh97lFsV1aiOtpSfc3GbfVy63hPqOt21tE9Is/0on2J4DRwIrAA8DYujrfAc7K3XsBl7YptmHAVrl7MPDXBrHtAFzbTcvuaWCdDobvClxPuh9nW+Cublq/s0k3OXXLcgO2A7YCHiqU/StwZO4+EjilwXhrA0/m/2vl7rVaHNdOwMDcfUqjuMqs+xbFdhzwvRLru8Pvcytiqxv+M+CYblpuDfcZ7dze+tORx5JHnETEW0DtESdFE4ALc/flwHhJjW5Q7FIRMSsi7s3drwCPACNaPd8uNAG4KJI7gSGShrU5hvHAExHxTJvnu0RE3A68VFdc3KYuBHZvMOrOwE0R8VJEzANuAnZpZVwRcWNELMq9d5LunWq7JsusjDLf55bFlvcLXwIu7sp5ltXBPqNt21t/Sh4jgOmF/hm8ewe9pE7+Ys0H3teW6LLcVPYR4K4Ggz8m6QFJ10vavI1hBXCjpHvyY2DqlVm2rbYXzb/I3bXcANaLiFmQvvDAug3qdPfy+zrpyLGRztZ9qxyUm9TOb9L00t3L7JPA8xHxeJPhbVtudfuMtm1v/Sl5dPqIk5J1WkbS6sAfgMMiYkHd4HtJTTJbAL8ArmxXXMDHI2Ir0lOND5S0Xd3w7l5uKwK7Ab9vMLg7l1tZ3bb8JP0QWAT8tkmVztZ9K5wJbAxsCcwiNQ/V69ZtDvgKHR91tGW5dbLPaDpag7LKy64/JY8yjzhZUkfSQGBNlu+QujJJg0gbwW8j4o/1wyNiQUQszN1/AgZJWqcdsUXEzPx/DnAFqcmgqLsfH/MZ4N6V5BcaAAAFuUlEQVSIeL5+QHcut+z5WhNe/j+nQZ1uWX75ROnngK9GbgyvV2Ldd7mIeD4iFkfEO8Cvmsyz27a5vG/YA7i0WZ12LLcm+4y2bW/9KXmUecTJ1UDtyoM9gVuafam6Um4/PQ94JCL+vUmd99fOv0jamrTuXmxDbKtJGlzrJp1ofaiu2tXAPkq2BebXDp3bpOmvwO5abgXFbWoicFWDOjcAO0laKzfR7JTLWkbp5WpHALtFxGtN6pRZ962IrXi+7AtN5tmdjyz6NPBoRMxoNLAdy62DfUb7trdWXQ3QE/9IVwX9lXSVxg9z2fGkLxDAyqSmj2nAZGB0m+L6BOmw8UHg/vy3K3AAcECucxAwlXRVyZ3A37UpttF5ng/k+deWWzE2kV7W9QTwF2BcG9fpqqRksGahrFuWGymBzQLeJv262490zuxm4PH8f+1cdxzpjZi1cb+et7tpwL5tiGsaqd27tr3VrjIcDvypo3Xfhth+nbejB0k7w2H1seX+d32fWx1bLr+gtn0V6rZ7uTXbZ7Rte/PjSczMrLL+1GxlZmZdxMnDzMwqc/IwM7PKnDzMzKwyJw8zM6vMycP6BEmL8xNMH5L0e0mrdlMch7V73pIukLRn7j5X0thO6h8gaZ/c/TVJw9sRp/UtTh7WV7weEVtGxAeBt0j3epQiaUAXxnEY6d6TbhER34iIhzupc1ZEXJR7v0a6R8GsEicP64v+G9gEQNLekibno5Kza4lC0kJJx0u6i/TgxI9K+p/8AMXJkgZLGqD03ou780P6vpXH3UHSJEmXK70T47f57vpDSDviWyXdmuueKWmK0jsXflQLUNKuedw7lN6Fcm0uXy0/DPBuSfdJeteTYvO8finpYUnXUXj4XY5rXO7eT9Jfc9mvJP0ylx8n6Xv5aGUc8Nu8fFaRdHKe7oOS/q0F68b6iq6+89F//uuOP2Bh/j+Q9EiGbwMfAK4BBuVhZwD75O4AvpS7VyS90+CjuX+NPJ39gaNz2UrAFGAU6R0h80nPBFoB+F/gE7ne0xTe48DSO3wHAJOAD5OeZDAdGJWHXUx+5wjwE2Dv3D2EdAf1anWfdQ/SY7QHkJLVy8CeedgkUkIYnmNZGxhESqi/zHWOI78vo1a/FivwGCy5eXhId69X//XcPx95WF+xitJb3aYAz5Ke+zMe+Fvg7jxsPOnREQCLSQ+VA9gUmBURd8OShykuIj3zZ5887l2kRz+MyeNMjogZkR7edz8wsklcX5J0L3AfsDnphT2bAU9GxFO5TvG5XDsBR+Z5TiIlmg3rprkdcHGkhwfOBG5pMN+tgdsivbPhbRo/cbjeAuAN4FxJewANn3llBunXlVlf8HpEbFksyA+PuzAijmpQ/42IWFyrSuNHUgs4OCKWeWicpB2ANwtFi2nwXZI0Cvge6YhmnqQLSMmgoxeMCfiHiHisgzo0ibd+OpVExKL88MjxpAcNHgTsWHU61j/4yMP6spuBPSWtC0ve77xRg3qPAsMlfTTXG6z02O0bgG8rPfoaSX+Tn5LakVdIrwWF1Pz1KjBf0nqkR8fX5jda6SU+AF8ujH8DcHDhScAfaTCP24G98jmZYcCnGtSZDGyfn5w6EPiHzuJVejfEmpEeXX8Y6X0aZg35yMP6rIh4WNLRpDe6rUB6OuqBwDN19d6S9GXgF5JWAV4nPXb7XFJz1L15Zz6Xxq/1LDoHuF7SrIj4lKT7SE9WfRL4/3l+r0v6DvBnSS+QdvQ1JwCnAQ/meT5NeudG0RWkI4K/kM6J3Nbgsz8n6Sek5raZwMOk8zT1LgDOkvQ6KbldJal2dPRPnXxW68f8VF2zbiBp9YhYmBPEfwCPR8SpLZrHQFLCOT8irujKeVj/5WYrs+7xzXxSfCrpjZVnt2Aex+V5PAQ8Rc98Ba/1Uj7yMDOzynzkYWZmlTl5mJlZZU4eZmZWmZOHmZlV5uRhZmaV/R9+/tjk2nhOTwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36acdafd0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 0]['percentage digits'], bins=10, range=(0, 20), rwidth=0.8)\n",
    "plt.xlabel('Percentage digits')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage digits of non-spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYgAAAEWCAYAAAB8LwAVAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xu8XfOd//HXW4KiIYmESeISVKl2Sk2oTlvSptO61KWttvpTQhlVl1arv0GZMr1MaUfRK4qiVaFat7aKqjCmQ8T9XhFBCAkicSd85o/vd8vKtvY561zW3icn7+fjcR5n3b+fvdba67O/6/JdigjMzMyaLdfpAMzMbGBygjAzs1JOEGZmVsoJwszMSjlBmJlZKScIMzMr5QSRSTpZ0r/307LWkfScpCG5f6qkfftj2Xl5l0ma3F/L60G535H0pKTH2132YCRpL0nXFfqfk7R+xXkrT9sX3ubLtqGdDqAdJM0C1gQWAa8BdwNnA6dGxOsAEbF/D5a1b0T8pdU0EfEw8Na+Rf1GeccAb4uIzxeWv11/LLuHcawNHAqsGxFz211+f5E0Ffh1RJzW6ViaRUTlfaY4raQzgdkRcVR/xjNYtrn13rJUg9gxIoYB6wLHAocBp/d3IZIGa9JdF3iqHQeKQbwOlzZt2+Y2QEXEoP8DZgEfaRq2JfA68K7cfybwndw9CvgD8AzwNPDfpGT6qzzPi8BzwL8B44EA9gEeBq4tDBualzcV+B4wDVgAXAyMzOMmkn79vSleYFvgFeDVXN5theXtm7uXA44CHgLmkmpGq+VxjTgm59ieBI7sYj2tluefl5d3VF7+R/Jnfj3HcWbJvBOB2cA3cjmzgN0L41cE/ivH8QRwMrBS07yHAY8Dv8rDdwZuBRYCDwDbFuI8HZgDPAp8BxiSx+0FXJfLmg88CGyXx32XVIN8KX+On+ThJwGP5HJuAj5YiHsl4Ky8rHvyNp9dGD8W+F1eZw8CX+5i/a4OXJLLmQZ8G7iuMD5ItcXGtJfmaW/Mn/FN0wL75f3jlfyZLs3jD8vr5lngPmBSDdu89HtS2IePINXW5wO/BN6Sx43I883L4/4ArFVY7tT8ef/W+Ex5fZxTWB/jW3ye8Xnd7J236Xxgf2AL4PYc60+a5vlC3rbzgctJNSYAASeQvlcL8vyN48X2+bM9m9fz1yt+tvVIx4hngb8APyXVaBvjt8qf+xngNmBiYdxewMw874MUvl+1HTvbdZDu5B8lCSIPfxj4Uu4+k8UJ4nukA9jy+e+DgMqWVdghzwZWIR1QGsOKCeJR4F15mt81dgq6SBC5+5jiDlRYXiNBfAGYAaxPOq31exYfYBtx/CLHtSnwMvCOFuvpbFLyGpbn/TuwT6s4m+adSDqF90NSMtgGeB7YKI8/kXRwHJmXfynwvaZ5j8vzrkRK4AuAfyEdsMYBG+fpLwJOyetyDdLB9ouFL9GrwL8CQ4AvAY8Vtt8b664Q++dJB6ChpFMqj7P4YHYscA3pi78W6SAxO49bjpRQvgmskLfBTOBjLdbRFOD8HPe78j7RKkFMyX8rA5uQDnatpj2TvO/m/o3y9GML+8EGNWzz7r4ndwJr523+Pyz+fq0OfCp/tmHAb4GLmvbvGcAGpAR2d47rI3kbnQ38skVM4/O6ORl4C/BR0g+Ci/K+Mo50wN8mT79LLusdedlHAX/L4z6Wt+9wUrJ4BzAmj5tD/iGR943NK362/yX9eFkB+AAp4TWOBeOAp0jJZznSvv8UMJq0zyxk8fdpDPDO2o+ddRcwEP5onSCuJ/+iZskE8a38pXlbd8sq7JDrlwwrJohjC+M3If3iG0LfE8RVwAGFcRuRDpBDC3EUf8FMA3Yr+VxDSMljk8KwLwJTc/eb4myafyLpIL9KYdj5wL/nL9fzFA5SwPuABwvzvkI+KOdhpwAnlJSzZo5zpcKwzwFX5+69gBmFcSvndfAPzeuui88yH9g0dy9xwAf2ZXGCeC/wcNO8R1By8Mrr91VyksvD/pPyWkFj2o0K40prEM37bu5/G+kg+BFg+S4+Z1+3eXffk/0L/dsDD7RYzmbA/Kb9+8hC//HAZYX+HYFbWyxrfF434wrDngI+W+j/HXBI7r6MnBBz/3LAC6TTax8mJaatyDWjwnQP53W1ajf70hufDViH9B1ZuTD+1yxOEIeRf9wVxl9OOgOwCqlW8SkK+37df8vSNYgy40hV42Y/IP2quELSTEmHV1jWIz0Y/xDpF9eoSlF2bWxeXnHZQ0kH0obiHSgvUH4BfRTpV03zssb1IJb5EfF80/xjSb+AVgZukvSMpGeAP+fhDfMi4qVC/9qk00rN1iWtuzmFZZ1C+nXY8MbnjYgXcmfLC8CSDpV0j6QFeXmrsXjbjGXJbVfsXhcY24gjz/sNllz3DaNJ26V5PyhTNm13+9cbImIGcAjpx8VcSVMkjS2ZtK/bvLvvSfNnHQsgaWVJp0h6SNJC0imX4Y27/rInCt0vlvR3d0G/6vzrAicVtt/TpB804yLir8BPSKeBnpB0qqRV83yfIiW9hyRdI+l9FT7bWODpwj7ZvI7WBT7dtD99gFRreR74LOl02RxJf5S0cTfroM+W2QQhaQvSF+G65nER8WxEHBoR65N+rXxN0qTG6BaLbDW8Ye1C9zqkX4hPkn5Zr1yIawhLHji7W+5jpB2ruOxFLPmFqOLJHFPzsh7twTJGSFqlaf7H8rJfJFWJh+e/1WLJu3aaP+cjpFMMzR4h/eodVVjWqhHxzooxLlGOpA+Sfrl9BhgREcNJp7aUJ5lDOrXUUNyOj5BqQcMLf8MiYvuScueRtkvzflCmMW2rcrv8TAAR8ZuI+ABpewbp9F2zPm3zbr4nzTE39gVIp/E2At4bEasCW+fhov0eIZ2eLG7DlSLibwAR8aOI+CfgncDbgf+fh98YETuTfphcRKotQ9efbQ4wUtIb33fevD/9qimWVSLi2Fzm5RHxL6TTS/eSTh3XaplLEJJWlfRx0vndX0fEHSXTfFzS2ySJdN7vtfwH6cDbm/vPPy9pk7xzfAu4ICJeI1Vh3yJpB0nLk86BrliY7wlgvKRW2+pc4KuS1pP0VtJpi/MiYlFPgsuxnA98V9IwSesCXyNVgXviPyStkA+8Hwd+G+lW4l8AJ0haA0DSOEkf62I5pwN7S5okabk8/cYRMQe4Ajg+b8vlJG0gaZuK8TVvv2Gkg/E8YKikbwKrFsafDxwhaYSkccBBhXHTgIWSDpO0kqQhkt6Vf3wsIa/f3wPH5F+Zm5BOHbxJybQbA3tW/UySNpL0YUkrks6/v8ji/be5nF5v826+JwAHSlpL0khSzeq8PHxYjumZPO7oKuXV5GTS9n0ngKTVJH06d28h6b35e/k8aV2+lvfv3SWtFhGvsvizQxefLSIeAqaTtusKudaxYyGWXwM7SvpY3pfeImliXodrStop/wB7mXTx/k3btL8tSwniUknPkrL0kaSLqXu3mHZD0h0Gz5EuKv0sIqbmcd8DjspVwK/3oPxfkc4VP066ePZlgIhYABwAnEb65fY86Y6eht/m/09JurlkuWfkZV9LurPhJeDgHsRVdHAufyapZvWbvPyqHiedv3+MdMfJ/hFxbx53GOl0xPW56v0X0i+tUhExjbR9TiD9or+Gxb909ySdGmncIXMB6VdVFScBu0qaL+lHpHO8l5ES9UOk9Ves9n+LtD0ezDFfQPqCNg6wO5LOMz9I+kV+GukUVZmDSKc2HiftC7/sIs6D8nIeJ23fcxvlljgd2CTvkxeRfmAcm+N5nPQr9xst5u3LNu/qe0Je1hV52TNJ11Eg3bCwUo7vetLpxo6IiAtJtaspeb+8E2g8Z7Qq6YfNfNK+8RTpAjPAHsCsPM/+pBsdoPvPtjvp+ttTpPVxHov3p0dId+59g/SD5RFSjWW5/Hco6bv1NOkmkAMg1YIlPdfnlVGicceBWZ9Imkiqka3V3bRLM0lfIl3kr1pj6a9yjyNdaC+tdQw0qvBAqYGk84B7I6KTtaiWlqUahFmPSRoj6f35VNZGpF9xF7ah3I0lvVvJlqTnbGov1+qVT1ttkPenbUk1hos6HVcrfmLVrGsrkO6SWo90m+EU4GdtKHcY6bTSWNItq8eTbim1pds/kK4vrU46dfmliLilsyG15lNMZmZWyqeYzMys1FJ9imnUqFExfvz4TodhZrZUuemmm56MiNHdTbdUJ4jx48czffr0TodhZrZUkdTqKf4l+BSTmZmVcoIwM7NSThBmZlbKCcLMzErVliAknSFprqQ7C8N+IOleSbdLulDS8MK4IyTNkHRfN424mZlZG9RZgziT9MrMoitJr+x7N6lxtCMAcsuWu5Ga1N0W+JmWbBvezMzarLYEERHX0vQynoi4otAM9fUsbu9+Z2BKRLwcEQ+SWv3csq7YzMyse528BvEFUjPLkF7cU2xieTYt3molaT9J0yVNnzdvXs0hmpktuzqSICQdSXpJyzmNQSWTlTYSFRGnRsSEiJgwenS3DwKamVkvtf1JakmTSW8amxSLWwqczZKv3luLxa8nNFvqjT/8j7WXMevYHWovw5Ytba1B5PbPDwN2anpx9yXAbpJWlLQe6U1V09oZm5mZLam2GoSkc4GJwChJs0nvZj2C9DrEK9NrbLk+IvaPiLsknU96heQi4MD8OkczM+uQ2hJERHyuZPDpXUz/XeC7dcVjZmY94yepzcyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVqi1BSDpD0lxJdxaGjZR0paT78/8Rebgk/UjSDEm3S9q8rrjMzKyaOmsQZwLbNg07HLgqIjYErsr9ANsBG+a//YCf1xiXmZlVUFuCiIhrgaebBu8MnJW7zwJ2KQw/O5LrgeGSxtQVm5mZda/d1yDWjIg5APn/Gnn4OOCRwnSz87A3kbSfpOmSps+bN6/WYM3MlmUD5SK1SoZF2YQRcWpETIiICaNHj645LDOzZVe7E8QTjVNH+f/cPHw2sHZhurWAx9ocm5mZFbQ7QVwCTM7dk4GLC8P3zHczbQUsaJyKMjOzzhha14IlnQtMBEZJmg0cDRwLnC9pH+Bh4NN58j8B2wMzgBeAveuKy8zMqqktQUTE51qMmlQybQAH1hWLmZn13EC5SG1mZgNMbTUIMxsYxh/+x9rLmHXsDrWXYe3nGoSZmZVygjAzs1JOEGZmVsoJwszMSjlBmJlZKScIMzMr1W2CkLSBpBVz90RJX5Y0vP7QzMysk6rUIH4HvCbpbcDpwHrAb2qNyszMOq5Kgng9IhYBnwBOjIivAn6Zj5nZIFclQbwq6XOk1lf/kIctX19IZmY2EFRJEHsD7wO+GxEPSloP+HW9YZmZWad12xZTRNwt6TBgndz/IKnZbjMzG8Sq3MW0I3Ar8Ofcv5mkS+oOzMzMOqvKKaZjgC2BZwAi4lbSnUxmZjaIVWnue1FELJBUHBY1xWNWm7qbvXaT1zbYVEkQd0r6f8AQSRsCXwb+Vm9YZmbWaVUSxMHAkcDLwLnA5cC36wzKzAYHv6xo6VblLqYXSAniyPrDMTOzgaLbBCHpUt58zWEBMB04JSJeqiMwMzPrrCp3Mc0EngN+kf8WAk8Ab8/9ZmY2CFW5BvGeiNi60H+ppGsjYmtJd9UVmJmZdVaVGsRoSes0enL3qNz7Si1RmZlZx1WpQRwKXCfpAUCkh+QOkLQKcFadwZmZWedUuYvpT/n5h41JCeLewoXpE3tTqKSvAvuSLn7fQWoQcAwwBRgJ3AzsERGuoZiZdUjVV45uCGwEvBv4jKQ9e1ugpHGkh+0mRMS7gCHAbsBxwAkRsSEwH9int2WYmVnfVWms72jgx/nvQ8D3gZ36WO5QYCVJQ4GVgTnAh4EL8vizgF36WIaZmfVBlRrErsAk4PGI2BvYFFixtwVGxKPAfwEPkxLDAuAm4Jn85jqA2cC43pZhZmZ9VyVBvBgRrwOLJK0KzAXW722BkkYAO5Mudo8FVgG2K5m0tEFASftJmi5p+rx583obhpmZdaNKgpguaTjpobibSBeQp/WhzI8AD0bEvIh4Ffg98M/A8HzKCWAt4LGymSPi1IiYEBETRo8e3YcwzMysK1XuYjogd54s6c/AqhFxex/KfBjYStLKwIuk01fTgatJp7OmkN5/fXEfyjAzsz6qcpH6/fmZB4APAHtJWre3BUbEDaSL0TeTbnFdDjgVOAz4mqQZwOrA6b0tw8zM+q7Kg3I/BzaVtCnwb6QD99nANr0tNCKOBo5uGjyT9OY6MzMbAKpcg1gUEUG6sHxSRJwEDKs3LDMz67QqNYhnJR0BfB7YWtIQYPl6wzIzs06rUoP4LOltcvtExOOk5xN+UGtUZmbWcZVqEKRTS69JejupTaZz6w3LzMw6rUoN4lpgxdyG0lWkhvXOrDMoMzPrvCo1CEXEC5L2AX4cEd+XdGvdgdXNL1M3M+talRqEJL0P2B1oHFWH1BeSmZkNBFUSxCHAEcCFEXGXpPVJTz2bmdkgVqWpjWuAaxpPU0fETNL7HMzMbBCr0tTG+yTdDdyT+zeV9LPaIzMzs46qcorpROBjwFMAEXEbsHWdQZmZWedVeuVoRDzSNOi1GmIxM7MBpMptro9I+mcgJK1Auv5wT71hmZlZp1WpQewPHEhqYmM2sFnuNzOzQazKXUxPkp6BMDOzZUi3CULSesDBwPji9BGxU31hmZlZp1W5BnER6SVBlwKv1xuOmZkNFFUSxEsR8aPaIzEzswGlSoI4SdLRwBWk90IAEBE31xaVmZl1XJUE8Y/AHsCHWXyKKXK/mZkNUlUSxCeA9SPilbqDMTOzgaPKcxC3AcPrDsTMzAaWKjWINYF7Jd3IktcgfJurmQ1YfilY31VJEEfXHoWZmQ04Vd8HYWZmy5hKrbmamdmypyMJQtJwSRdIulfSPfmlRCMlXSnp/vx/RCdiMzOzpGWCkHRV/n9cDeWeBPw5IjYGNiU1H344cFVEbAhclfvNzKxDuroGMUbSNsBOkqYAKo7s7ZPUklYlvZFur7ycV4BXJO0MTMyTnQVMBQ7rTRlmZtZ3XSWIb5J+xa8F/LBpXF+epF4fmAf8UtKmwE3AV4A1I2IOQETMkbRG2cyS9gP2A1hnnXV6GYKZmXWn5SmmiLggIrYDvh8RH2r660szG0OBzYGfR8R7gOfpwemkiDg1IiZExITRo0f3IQwzM+tKldtcvy1pJ9JpIYCpEfGHPpQ5G5gdETfk/gtICeIJSWNy7WEMMLcPZZiZWR91exeTpO+RTgHdnf++kof1SkQ8TnrP9UZ50KS83EuAyXnYZODi3pZhZmZ9V+VJ6h2AzSLidQBJZwG3AEf0odyDgXMkrQDMBPYmJavzJe0DPAx8ug/LNzOzPqqSICA11vd07l6tr4VGxK3AhJJRk/q6bDMz6x9VEsT3gFskXU261XVr+lZ7MDOzpUCVi9TnSpoKbEFKEIfl6whmZjaIVTrFlJ9PuKTmWMzMbABxY31mZlbKCcLMzEp1mSAkLSfpznYFY2ZmA0eXCSI/+3CbJDd6ZGa2jKlykXoMcJekaaR2kwC/k9rMbLCrkiD+o/YozMxswKn0TmpJ6wIbRsRfJK0MDKk/NDMz66RuE4SkfyW9f2EksAEwDjgZN4vRa+MP/2PtZcw6dofayzCzwa3Kba4HAu8HFgJExP1A6ct8zMxs8KiSIF7OrwUFQNJQ0hvlzMxsEKuSIK6R9A1gJUn/AvwWuLTesMzMrNOqJIjDSe+QvgP4IvAn4Kg6gzIzs86rchfT6/klQTeQTi3dFxE+xWRmNshVuYtpB9JdSw+QmvteT9IXI+KyuoMzM7POqfKg3PHAhyJiBoCkDYA/Ak4QZmaDWJVrEHMbySGbCcytKR4zMxsgWtYgJH0yd94l6U/A+aRrEJ8GbmxDbGZm1kFdnWLasdD9BLBN7p4HjKgtIjMzGxBaJoiI2LudgZiZ2cBS5S6m9YCDgfHF6d3ct5nZ4FblLqaLgNNJT0+/Xm84ZmY2UFRJEC9FxI9qj8TMzAaUKgniJElHA1cALzcGRsTNtUVlZmYdVyVB/COwB/BhFp9iitzfa5KGANOBRyPi4/laxxTSeyduBvYotiJrZmbtVSVBfAJYv4aD9VeAe4BVc/9xwAkRMUXSycA+wM/7uUwzM6uoypPUtwHD+7NQSWsBOwCn5X6RaiQX5EnOAnbpzzLNzKxnqtQg1gTulXQjS16D6MttricC/wYMy/2rA89ExKLcP5v0atM3kbQf6RWorLPOOn0IwTqh7tet+lWrNhAMltcKV0kQR/dngZI+Tmrf6SZJExuDSyYtbVI8Ik4FTgWYMGGCmx03M6tJlfdBXNPPZb4f2EnS9sBbSNcgTgSGSxqaaxFrAY/1c7lmZtYD3V6DkPSspIX57yVJr0la2NsCI+KIiFgrIsYDuwF/jYjdgauBXfNkk4GLe1uGmZn1XZUaxLBiv6RdgC1riOUwYIqk7wC3kJ7eNjOzDqlyDWIJEXGRpMP7o/CImApMzd0zqSfxmJlZL1RprO+Thd7lgAm0uIBsZmaDR5UaRPG9EIuAWcDOtURjZmYDRpVrEH4vhJnZMqirV45+s4v5IiK+XUM8ZmY2QHRVg3i+ZNgqpDaSVgecIMzMBrGuXjl6fKNb0jBS43p7k1pcPb7VfGZmNjh0eQ1C0kjga8DupAb0No+I+e0IzMzMOquraxA/AD5JavfoHyPiubZFZWZmHddVUxuHAmOBo4DHCs1tPNuXpjbMzGzp0NU1iCrvijAzs0HKScDMzEo5QZiZWSknCDMzK9Xj1lxt6efXfppZFa5BmJlZKScIMzMr5QRhZmalnCDMzKyUE4SZmZVygjAzs1JOEGZmVsoJwszMSjlBmJlZKScIMzMr5QRhZmalnCDMzKxU2xOEpLUlXS3pHkl3SfpKHj5S0pWS7s//R7Q7NjMzW6wTNYhFwKER8Q5gK+BASZsAhwNXRcSGwFW538zMOqTtCSIi5kTEzbn7WeAeYBywM3BWnuwsYJd2x2ZmZot19BqEpPHAe4AbgDUjYg6kJAKs0WKe/SRNlzR93rx57QrVzGyZ07EEIemtwO+AQyJiYdX5IuLUiJgQERNGjx5dX4BmZsu4jiQIScuTksM5EfH7PPgJSWPy+DHA3E7EZmZmSSfuYhJwOnBPRPywMOoSYHLungxc3O7YzMxssU68k/r9wB7AHZJuzcO+ARwLnC9pH+Bh4NMdiM3MzLK2J4iIuA5Qi9GT2hmLmZm15iepzcyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVGnAJQtK2ku6TNEPS4Z2Ox8xsWTWgEoSkIcBPge2ATYDPSdqks1GZmS2bBlSCALYEZkTEzIh4BZgC7NzhmMzMlkmKiE7H8AZJuwLbRsS+uX8P4L0RcVBhmv2A/XLvRsB9PShiFPBkP4Xb3xxb7zi2nhuocYFj662exrZuRIzubqKhvY+nFioZtkQGi4hTgVN7tXBpekRM6M28dXNsvePYem6gxgWOrbfqim2gnWKaDaxd6F8LeKxDsZiZLdMGWoK4EdhQ0nqSVgB2Ay7pcExmZsukAXWKKSIWSToIuBwYApwREXf1YxG9OjXVJo6tdxxbzw3UuMCx9VYtsQ2oi9RmZjZwDLRTTGZmNkA4QZiZWalBmSC6a65D0oqSzsvjb5A0vk1xrS3pakn3SLpL0ldKppkoaYGkW/PfN9sRWy57lqQ7crnTS8ZL0o/yertd0uZtimujwvq4VdJCSYc0TdO29SbpDElzJd1ZGDZS0pWS7s//R7SYd3Ke5n5Jk9sQ1w8k3Zu314WShreYt8ttX1Nsx0h6tLDNtm8xb63N77SI7bxCXLMk3dpi3rrXW+kxo237W0QMqj/Sxe0HgPWBFYDbgE2apjkAODl37wac16bYxgCb5+5hwN9LYpsI/KFD624WMKqL8dsDl5GeV9kKuKFD2/dx0oM+HVlvwNbA5sCdhWHfBw7P3YcDx5XMNxKYmf+PyN0jao7ro8DQ3H1cWVxVtn1NsR0DfL3C9u7y+1xHbE3jjwe+2aH1VnrMaNf+NhhrEFWa69gZOCt3XwBMklT2kF6/iog5EXFz7n4WuAcYV3e5/Whn4OxIrgeGSxrT5hgmAQ9ExENtLvcNEXEt8HTT4OI+dRawS8msHwOujIinI2I+cCWwbZ1xRcQVEbEo915Perao7Vqssypqb36nq9jyceEzwLn9WWZVXRwz2rK/DcYEMQ54pNA/mzcfhN+YJn95FgCrtyW6LJ/Weg9wQ8no90m6TdJlkt7ZxrACuELSTblJk2ZV1m3ddqP1l7VT6w1gzYiYA+lLDaxRMk2n198XSDXAMt1t+7oclE9/ndHiNEmn19kHgSci4v4W49u23pqOGW3Z3wZjgui2uY6K09RG0luB3wGHRMTCptE3k06fbAr8GLioXXEB74+IzUmt6R4oaeum8Z1ebysAOwG/LRndyfVWVcfWn6QjgUXAOS0m6W7b1+HnwAbAZsAc0qmcZh3d54DP0XXtoS3rrZtjRsvZSob1aN0NxgRRpbmON6aRNBRYjd5Vf3tM0vKkDX1ORPy+eXxELIyI53L3n4DlJY1qR2wR8Vj+Pxe4kFS9L+p0UyjbATdHxBPNIzq53rInGqfb8v+5JdN0ZP3li5MfB3aPfHK6WYVt3+8i4omIeC0iXgd+0aLMju1z+djwSeC8VtO0Y721OGa0ZX8bjAmiSnMdlwCNK/q7An9t9cXpT/l85unAPRHxwxbT/EPjeoikLUnb6Kk2xLaKpGGNbtLFzTubJrsE2FPJVsCCRjUGrl6sAAAFLElEQVS3TVr+muvUeiso7lOTgYtLprkc+KikEfl0ykfzsNpI2hY4DNgpIl5oMU2VbV9HbMXrV59oUWYnm9/5CHBvRMwuG9mO9dbFMaM9+1tdV987+Ue62+bvpLsfjszDvkX6kgC8hXSaYgYwDVi/TXF9gFTFux24Nf9tD+wP7J+nOQi4i3S3xvXAP7cptvVzmbfl8hvrrRibSC90egC4A5jQxm26MumAv1phWEfWGylJzQFeJf1K24d0Desq4P78f2SedgJwWmHeL+T9bgawdxvimkE6D93Y3xp3740F/tTVtm9DbL/K+9HtpAPemObYcv+bvs91x5aHn9nYvwrTtnu9tTpmtGV/c1MbZmZWajCeYjIzs37gBGFmZqWcIMzMrJQThJmZlXKCMDOzUk4QtlSR9FpuOfNOSb+VtHKH4jik3WVLOlPSrrn7NEmbdDP9/pL2zN17SRrbjjht8HCCsKXNixGxWUS8C3iF9CxEJZKG9GMch5CezeiIiNg3Iu7uZpqTI+Ls3LsX6R5+s8qcIGxp9t/A2wAkfV7StFy7OKWRDCQ9J+lbkm4gNea3haS/5Ub9pkkaJmmI0nsTbswNx30xzztR0lRJFyi9U+Gc/BT5l0kH26slXZ2n/bmk6Upt9v9HI0BJ2+d5r1N6l8Yf8vBVcgN1N0q6RdKbWijNZf1E0t2S/kihQbYc14TcvY+kv+dhv5D0kzz8GElfz7WOCcA5ef2sJOnYvNzbJf1XDdvGBoP+fvLPf/6r8w94Lv8fSmpe4EvAO4BLgeXzuJ8Be+buAD6Tu1cgtYm/Re5fNS9nP+CoPGxFYDqwHukdEwtIbdgsB/wv8IE83SwK7wFg8ZOsQ4CpwLtJT+w/AqyXx51LfmcF8J/A53P3cNKTwqs0fdZPkppoHkJKSM8Au+ZxU0kH/bE5lpHA8qSk+ZM8zTHk9y00pm/ECtzH4nfSD+/0dvXfwPxzDcKWNispvd1rOvAwqZ2aScA/ATfmcZNIzSAAvEZq6AxgI2BORNwIbzTwt4jURs2eed4bSM0YbJjnmRYRsyM1KHcrML5FXJ+RdDNwC/BO0ktdNgZmRsSDeZpiO1IfBQ7PZU4lJZN1mpa5NXBupAbtHgP+WlLulsA1kdr8f5Xylm6bLQReAk6T9EmgtI0ms6GdDsCsh16MiM2KA3KDZmdFxBEl078UEa81JqW8uWMBB0fEEg2ZSZoIvFwY9Bol3xlJ6wFfJ9VM5ks6k3TA7+olVAI+FRH3dTENLeJtXk6PRMSi3KDhJFLjdwcBH+7pcmzwcw3CBoOrgF0lrQFvvK933ZLp7gXGStoiTzdMqUnny4EvKTWrjKS359Y5u/Is6RWQkE5VPQ8skLQmqVnyRnnra/E7zz9bmP9y4OBCC7TvKSnjWmC3fI1kDPChkmmmAdvkFjuHAp/qLl6ldwusFqlZ9ENI72MwexPXIGypFxF3SzqK9Gav5Uitch4IPNQ03SuSPgv8WNJKwIukJp1PI506ujkfsOdR/grHolOByyTNiYgPSbqF1KLnTOB/cnkvSjoA+LOkJ0kH84ZvAycCt+cyZ5He2VB0IemX/R2kaxTXlHz2RyX9J+nU2GPA3aTrJs3OBE6W9CIpgV0sqVHL+Wo3n9WWUW7N1axGkt4aEc/lJPBT4P6IOKGmMoaSksoZEXFhf5ZhyyafYjKr17/mC9F3kd5ceEoNZRyTy7gTeJCB+bpVWwq5BmFmZqVcgzAzs1JOEGZmVsoJwszMSjlBmJlZKScIMzMr9X9L4ZJRW3eNigAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36ad22080>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 1]['percentage digits'], bins=10, range=(0, 20), rwidth=0.8)\n",
    "plt.xlabel('Percentage digits')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage digits of spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Indeed it was correct. Therefore, we can use this feature for our machine learning model. Let us create a bunch of more features like this."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Percentage question mark"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "      <th>percentage digits</th>\n",
       "      <th>percentage question mark</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Free entry in 2 a wkly comp to win FA Cup fina...</td>\n",
       "      <td>16.129032</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>U dun say so early hor... U c already then say...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>Nah I don't think he goes to usf, he lives aro...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text  \\\n",
       "1        0  Go until jurong point, crazy.. Available only ...   \n",
       "2        0                      Ok lar... Joking wif u oni...   \n",
       "3        1  Free entry in 2 a wkly comp to win FA Cup fina...   \n",
       "4        0  U dun say so early hor... U c already then say...   \n",
       "5        0  Nah I don't think he goes to usf, he lives aro...   \n",
       "\n",
       "   percentage digits  percentage question mark  \n",
       "1           0.000000                       0.0  \n",
       "2           0.000000                       0.0  \n",
       "3          16.129032                       0.0  \n",
       "4           0.000000                       0.0  \n",
       "5           0.000000                       0.0  "
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def percentage_question_mark(text):\n",
    "    counter = 0\n",
    "    for i in text:\n",
    "        if i == '?':\n",
    "            counter += 1\n",
    "    return (counter / len(text)) * 100\n",
    "\n",
    "df['percentage question mark'] = df['text'].apply(percentage_question_mark)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZYAAAEWCAYAAABFSLFOAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xm4HGWZ9/HvjySsAgESMCQhYYkgOIIYMLwoRlHZZFFhYF6QgGhkEWTEdwBlBMFRHEdZxpFFUQIoi1Eg7GAgIKMsYV8dQggkk0ACJGEHA/f7x/M0qXT6nFMnqT59+vD7XFdfXXvdXV1Vd9VTVU8pIjAzM6vKCq0OwMzM+hYnFjMzq5QTi5mZVcqJxczMKuXEYmZmlXJiMTOzSvXqxCLpbEn/WtG0NpD0iqR+uX2KpK9WMe08veskjatqet2Y7w8kPS/p2Z6et1VH0iOSxrY6ju6SdJKkiyqaltflPqJ/q2YsaQawHrAIeBt4FLgAODci3gGIiEO7Ma2vRsSfOhomIp4B3rd8Ub87v5OATSLigML0d6li2t2MYzhwDDAiIub29PyrImkKcFFE/KrVsfQESecDsyLihFq3iNiidRG1Xl9Zly1p9RnL7hGxOjACOBU4Fjiv6plIalkCbbIRwAs9sSH24WVoy6jidaLH1mXrARHRkg8wA/hMXbdtgXeAD+X284Ef5OZBwNXAAuBF4M+kxHhhHud14BXgX4CRQACHAM8AtxW69c/TmwL8CLgLWAhcCayd+40lHVEuFS+wM/AW8Pc8vwcK0/tqbl4BOAF4GphLOhNbM/erxTEux/Y88N1OltOaefx5eXon5Ol/Jv/md3Ic5zcYdywwC/hOns8MYP9C/5WA/8hxPAecDaxSN+6xwLPAhbn7nsD9wEvAk8DOhTjPA+YA/wv8AOiX+x0E3J7nNR94Ctgl9/s30hnrG/l3/Dx3PwOYmedzD/CJQtyrABPytB7L//msQv/1gT/kZfYUcFQny3cdYFKez13AKcDtdf9V/8Lw7/7Puf0rOYb5wA2kI24AAafl/38h8CDwIWA8ad15K//eq+q3h/y/nA7Mzp/TgZXq/pdj8rTnAAd38vum5P/iL7X55d/82/yb7wZGFobvbLmfBEwELsr9v5q7XZT7DwAuzst+xYrX5Ybbf2HZHU8q9ZgP/AZYOfdbK483L/e7Ghi2rMunLqba+nFwXmbzgUOBbfL/vYC8Pi/r+pL77Zp/28ukbevbJX/bhqR938vAn4D/qv1Xuf+Y/LsXAA8AYwv9DgKm53GforDfKLV/74kk0sGfMoO6xJK7PwMclpvPZ3Fi+RFpxzcgfz4BqNG0Cn/4BcBqpB1RrVsxsfwvaWNfjbQx1DaQsXSQWAob2EV1/aewOLF8BZgGbEQqfvsji3fMtTh+mePaEngT+GAHy+kCUtJbPY/7P8AhHcVZN+5YUlHjz0g7q08CrwKb5v6nk3aqa+fpXwX8qG7cH+dxVyEl/oXAZ0k7hKHAZnn4K4Bz8rJcl7ST/nphJf078DWgH3AYaYep+mVXiP0A0gben7QTfZbFO4tTgVtJG9Yw0kY4K/dbgbRD/B6wYv4PpgM7dbCMLgEuy3F/KK8TpRILsFf+nz+Y4zwB+Evut1OOYyBpp/FBYEj9et3B+nUycEdejoNJG/8pdf/LyaTtYFfgNWCtDn7flBzjxqQd+6OkdegzOeYLgN+UXO4n5f9xr7ycV8ndLsrN1+Tf1q8J63JX2//DwHDSuvzfLN5vrAN8CVg1z/f3wBXLunzqYqqtH2cDKwOfIx0gXZH/u6GkRPHJ5Vxf5pATPGmd37rkb/sr6WBuReDjpERZ28cNBV4grT8rkLbpF0jr22p52Np+YgiwRbf271Uliu5+6Dix3EE+gmfJxHJyXik36WpahT98owbdionl1EL/zUlHkf1Y/sQyGTi80G9T0gbZvxBH8cjiLmC/Br+rHynpbF7o9nVgSsmNcSxpJ7RaodtlwL/mlfdVYONCv+2ApwrjvkXeqeRu5wCnNZjPejnOVQrd/gm4JTcfBEwr9Fs1L4P31y+7Tn7LfGDL3LxEoiAdOdcSy8eAZ+rGPZ4GO4e8fP9OTo652w8pn1iuI+8Yc/sKpJ38CODTpB3UGPKRdWG48+k8sTwJ7FrotxMwo/C/vF4X01xgTAfLbQqFM2Lgp8B1hfbdgftLLveTgNvq+p9EOji5FTiTvLNvwrrc1fZ/aKF9V+DJDqazFTC/iuVTWD+GFrq9AOxbaP8DcPRyri/P5GW1RhfbyLu/DdiAtO2vWuh/EYsTy7Hkg91C/xtIJSmrkc5ivkRhm+7Op9XXWBoZSjrVrfcTUra/UdJ0SceVmNbMbvR/mnQkNKhUlJ1bP0+vOO3+pB1wTfHOl9dofGPBINLRRv20hnYjlvkR8Wrd+OuTjkxWBe6RtEDSAuD63L1mXkS8UWgfTtrp1RtBWnZzCtM6h3TUVvPu742I13JjhzdTSDpG0mOSFubprcni/2Z9lvzvis0jgPVrceRxv8OSy75mMOl/qV8PyhoBnFGYz4ukhD00Im4Gfk4qfnhO0rmS1ig53Ubrz/qF9hciYlGhvaP1p+a5QvPrDdrfHbeL5Q6Nt6kxwIdJB2rRQQzLuy53tf3X/4fr59+zqqRzJD0t6SVS0dDA2t2hWenl04Gy4y/r+vIlUrJ8WtKtkrYr8dvWB14sbGv1y2gEsE/ddvJx0lnSq8C+pGK9OZKukbRZF8tgCb0qsUjahrSi3V7fLyJejohjImIj0lHEtyTtWOvdwSQ76l4zvNC8Aeno9XnSkfyqhbj6seQOt6vpzib9ccVpL2LJFa6M53NM9dP6325MYy1Jq9WNPztP+3XSKe7A/FkzIoobUf3vnEkqMqg3k3Q0OqgwrTWi/J1OS8xH0idIR1T/SCriGUgqglMeZA6pCKym+D/OJJ11DSx8Vo+IXRvMdx7pf6lfD2pqCXnVQrf3183r63XzWiUi/gIQEWdGxEeBLYAPAP+v0e9toNH6M7uLcZZbieUOjWO/kVRUNVlSowQOy7kud7H9w9L/YW15HUMqMfhYRKwB7JC7F39TT1mm9SUi7o6IPUkHaleQSh2g8982B1hbUnHdrd9OLqyLZbWIODXP84aI+CypGOxxUtF9ab0isUhaQ9LnSeXdF0XEQw2G+bykTSSJVP73dv5A2mFvtAyzPkDS5nnhnwxMjIi3SaekK0vaTdIAUlnoSoXxngNGSupo+V0M/LOkDSW9j1S8cmndUWaXciyXAf8maXVJI4BvkU5pu+P7klbMO47PA7+PdEv3L4HTJK0LIGmopJ06mc55wMGSdpS0Qh5+s4iYQ9q5/DT/lytI2ljSJ0vGV///rU7a4c8D+kv6HlA82r8MOF7SWpKGAt8o9LsLeEnSsZJWkdRP0ofyQcsS8vL9I3BSPvrbnFQUUOs/j7TjOyBP5yssmVjPznFsASBpTUn75OZtJH0srz+vksrey66vFwMnSBosaRDpelElz4p0oavl3qGI+Hfgd6TkstRZ//Kuy11s/wBHSBomaW3SGeqlhd/0OrAg9zuxzPyapNvrS95u95e0ZkT8ncW/HTr5bRHxNDCVtG6vmM9ydi/EchGwu6Sd8rq9sqSxeRmuJ2mPfED6JummhuKy7lKrE8tVkl4mZc/vki4yH9zBsKNIdza8Qroo9YuImJL7/Yi0IS6Q9O1uzP9CUnn3s6SLb0cBRMRC4HDgV6Qdy6ukO3Fqfp+/X5B0b4Pp/jpP+zbSHRVvAEd2I66iI/P8p5PO5H6Xp1/Ws6Ry8tmkO10OjYjHc79jScULd+RT6T+RjoAaioi7SP/PaaQj2VtZfAR6IKmoo3ZnzkTS0U4ZZwB7S5ov6UxSWe91pAT/NGn5FU/jTyb9H0/lmCeSNoDaDmx3UnnzU6Qj5V+RinQa+QapqOJZ0rrwm7r+XyMdOb5AOpL8S61HRFxOurnhkrz8HgZqzzOtQUrc8/NveIF0IRVSgt48r69XNIjpB6SdwoPAQ8C9uVuzdbXcOxURp5COqP+Ud3T1lmdd7mz7J0/rxjzt6SxeXqeTbix4nnT99vqyv6dqy7G+fBmYkcc5lHSDBXT92/YnXTd9gbQ8LmXxdjKTdIfnd0gHEjNJ6/kK+XMMaZ/xIummn8MhndVKeqWr31q7q8L6IKUnuS+KiGFdDdvOJB1Guvmh7BlSZ9M6iHRx/uPLHZj1CJV4QNpA0qXA4xHR9LO2Vp+xmHWbpCGSts9FbpuSjq4ub3VcZr1JLl7bOG8nO5POUBqdIVfOT1NbO1qRdNfZhqTbIi8BftHSiMx6n/eTriGuQyo6Piwi7uuJGbsozMzMKuWiMDMzq1RbF4UNGjQoRo4c2eowzMzayj333PN8RAzueshl09aJZeTIkUydOrXVYZiZtRVJ3alhottcFGZmZpVyYjEzs0o5sZiZWaWcWMzMrFJOLGZmViknFjMzq5QTi5mZVcqJxczMKuXEYmZmlWrrJ++Xx8jjrmn6PGaculvT52Fm1ts09YxF0kBJEyU9LukxSdtJWlvSTZKeyN9r5WEl6UxJ0yQ9KGnrZsZmZmbN0eyisDOA6yNiM2BL4DHgOGByRIwCJud2SK/oHJU/44GzmhybmZk1QdMSi6Q1gB1I7/cmIt6KiAWkt5hNyINNAPbKzXsCF0RyBzBQUtl3ppuZWS/RzDOWjYB5wG8k3SfpV5JWA9aLiDkA+XvdPPxQYGZh/Fm52xIkjZc0VdLUefPmNTF8MzNbFs1MLP2BrYGzIuIjwKssLvZqRA26LfV6y4g4NyJGR8TowYOb9joBMzNbRs1MLLOAWRFxZ26fSEo0z9WKuPL33MLwwwvjDwNmNzE+MzNrgqYlloh4FpgpadPcaUfgUWASMC53GwdcmZsnAQfmu8PGAAtrRWZmZtY+mv0cy5HAbyWtCEwHDiYls8skHQI8A+yTh70W2BWYBryWhzUzszbT1MQSEfcDoxv02rHBsAEc0cx4zMys+Vyli5mZVcqJxczMKuXEYmZmlXJiMTOzSjmxmJlZpZxYzMysUk4sZmZWKScWMzOrlBOLmZlVyonFzMwq5cRiZmaVcmIxM7NKObGYmVmlnFjMzKxSTixmZlYpJxYzM6uUE4uZmVXKicXMzCrlxGJmZpVyYjEzs0o5sZiZWaWcWMzMrFJOLGZmViknFjMzq5QTi5mZVaqpiUXSDEkPSbpf0tTcbW1JN0l6In+vlbtL0pmSpkl6UNLWzYzNzMyaoyfOWD4VEVtFxOjcfhwwOSJGAZNzO8AuwKj8GQ+c1QOxmZlZxVpRFLYnMCE3TwD2KnS/IJI7gIGShrQgPjMzWw7NTiwB3CjpHknjc7f1ImIOQP5eN3cfCswsjDsrd1uCpPGSpkqaOm/evCaGbmZmy6J/k6e/fUTMlrQucJOkxzsZVg26xVIdIs4FzgUYPXr0Uv3NzKy1mnrGEhGz8/dc4HJgW+C5WhFX/p6bB58FDC+MPgyY3cz4zMysek1LLJJWk7R6rRn4HPAwMAkYlwcbB1yZmycBB+a7w8YAC2tFZmZm1j6aWRS2HnC5pNp8fhcR10u6G7hM0iHAM8A+efhrgV2BacBrwMFNjM3MzJqkaYklIqYDWzbo/gKwY4PuARzRrHjMzKxn+Ml7MzOrlBOLmZlVyonFzMwq1WVikbSxpJVy81hJR0ka2PzQzMysHZU5Y/kD8LakTYDzgA2B3zU1KjMza1tlEss7EbEI+AJwekT8M+A6vMzMrKEyieXvkv6J9DDj1bnbgOaFZGZm7axMYjkY2A74t4h4StKGwEXNDcvMzNpVlw9IRsSjko4FNsjtTwGnNjswMzNrT2XuCtsduB+4PrdvJWlSswMzM7P2VKYo7CRSrcQLACLiftKdYWZmZkspk1gWRcTCum5+D4qZmTVUphLKhyX9X6CfpFHAUcBfmhuWmZm1qzJnLEcCWwBvAhcDLwFHNzMoMzNrX2XuCnsN+G7+mJmZdarLxCLpKpa+prIQmAqcExFvNCMwMzNrT2WKwqYDrwC/zJ+XgOeAD+R2MzOzd5W5eP+RiNih0H6VpNsiYgdJjzQrMDMza09lzlgGS9qg1pKbB+XWt5oSlZmZta0yZyzHALdLehIQ6eHIwyWtBkxoZnBmZtZ+ytwVdm1+fmUzUmJ5vHDB/vRmBmdmZu2nzBkLwChgU2Bl4MOSiIgLmheWmZm1qzK3G58IjAU2B64FdgFuB5xYzMxsKWUu3u8N7Ag8GxEHA1sCKzU1KjMza1tlEsvrEfEOsEjSGsBcYKPmhmVmZu2qTGKZKmkg6WHIe4B7gbvKzkBSP0n3Sbo6t28o6U5JT0i6VNKKuftKuX1a7j+y27/GzMxarsvEEhGHR8SCiDgb+CwwLheJlfVN4LFC+4+B0yJiFDAfOCR3PwSYHxGbAKfl4czMrM2UeYPk9vmZFYCPAwdJGlFm4pKGAbsBv8rtAj4NTMyDTAD2ys17svi5mInAjnl4MzNrI2WKws4CXpO0JfAvwNOUvyPs9DzOO7l9HWBBRCzK7bOAobl5KDATIPdfmIdfgqTxkqZKmjpv3rySYZiZWU8p+wbJIJ1RnBERZwCrdzWSpM8DcyPinmLnBoNGiX6LO0ScGxGjI2L04MGDu47ezMx6VJkHJF+WdDxwALCDpH7AgBLjbQ/sIWlX0oOVa5DOYAZK6p/PSoYBs/Pws4DhwCxJ/YE1gRe79WvMzKzlypyx7Et6e+QhEfEsqcjqJ12NFBHHR8SwiBgJ7AfcHBH7A7eQno0BGAdcmZsn5XZy/5vzmZKZmbWRUmcspCKwtyV9gFRn2MXLMc9jgUsk/QC4Dzgvdz8PuFDSNNKZyn7LMQ8zM2uRMonlNuATktYCJpPeHLkvsH/ZmUTEFGBKbp4ObNtgmDeAfcpO08zMeqcyRWHK773/IvCfEfEFYIvmhmVmZu2qVGKRtB3pDOWa3K1f80IyM7N2ViaxHA0cD1weEY9I2oh0Ad7MzGwpZV70dStwa+3p+3yN5KhmB2ZmZu2pTJUu20l6lFzfl6QtJf2i6ZGZmVlbKlMUdjqwE/ACQEQ8AOzQzKDMzKx9lUksRMTMuk5vNyEWMzPrA8o8xzJT0v8BIr875SiWrAbfzMzsXWXOWA4FjiBV5TIL2Cq3m5mZLaXMXWHP042n7M3M7L2ty8QiaUPgSGBkcfiI2KN5YZmZWbsqc43lClIFkVex+IVdZmZmDZVJLG9ExJlNj8TMzPqEMonlDEknAjeS3ssCQETc27SozMysbZVJLP8AfBn4NIuLwiK3m5mZLaFMYvkCsFFEvNXsYMzMrP2VeY7lAWBgswMxM7O+ocwZy3rA45LuZslrLL7d2MzMllImsZzY9CjMzKzPKPs+FjMzs1JK1W5sZmZWlhOLmZlVqsPEImly/v5xz4VjZmbtrrNrLEMkfRLYQ9IlgIo9/eS9mZk10lli+R5wHDAM+Fldvy6fvJe0MnAbsFKez8SIODHXlnwJsDZwL/DliHhL0krABcBHSa9B3jciZnT7F5mZWUt1WBQWERMjYhfg3yPiU3WfMtW5vAl8OiK2JL0cbGdJY4AfA6dFxChgPnBIHv4QYH5EbAKcloczM7M20+XF+4g4RdIekv4jfz5fZsKRvJJbB+RP7UxnYu4+AdgrN++Z28n9d5S0RPGbmZn1fl0mFkk/Ar4JPJo/38zduiSpn6T7gbnATcCTwIKIWJQHmUV65TH5eyZA7r8QWKf8TzEzs96gzJP3uwFbRcQ7AJImAPcBx3c1YkS8DWwlaSBwOfDBRoPl70ZnJ1HfQdJ4YDzABhtsUCJ8MzPrSWWfYylWQrlmd2cSEQuAKcAYYKCkWkIbBszOzbOA4QC5/5rAiw2mdW5EjI6I0YMHD+5uKGZm1mRlEsuPgPsknZ/PVu4BftjVSJIG5zMVJK0CfAZ4DLgF2DsPNg64MjdPyu3k/jdHxFJnLGZm1ruVqSvsYklTgG1IxVXHRsSzJaY9BJggqR8pgV0WEVdLehS4RNIPSEVq5+XhzwMulDSNdKayX7d/jZmZtVyZayxExBzSGUVpEfEg8JEG3acD2zbo/gawT3fmYWZmvY/rCjMzs0o5sZiZWaU6TSySVpD0cE8FY2Zm7a/TxJKfXXlAkh8YMTOzUspcvB8CPCLpLuDVWke/897MzBopk1i+3/QozMyszyj1zntJI4BREfEnSasC/ZofmpmZtaMylVB+jVTb8Dm501DgimYGZWZm7avM7cZHANsDLwFExBPAus0MyszM2leZxPJmRLxVa8kVRLoOLzMza6hMYrlV0neAVSR9Fvg9cFVzwzIzs3ZVJrEcB8wDHgK+DlwLnNDMoMzMrH2VuSvsnVxd/p2kIrC/uTp7MzPrSJeJRdJuwNmk1woL2FDS1yPiumYHZ2Zm7afMA5I/BT4VEdMAJG0MXAM4sZiZ2VLKXGOZW0sq2XRgbpPiMTOzNtfhGYukL+bGRyRdC1xGusayD3B3D8RmZmZtqLOisN0Lzc8Bn8zN84C1mhaRmZm1tQ4TS0Qc3JOBmJlZ31DmrrANgSOBkcXhXW2+mZk1UuausCuA80hP27/T3HDMzKzdlUksb0TEmU2PxMzM+oQyieUMSScCNwJv1jpGxL1Ni8rMzNpWmcTyD8CXgU+zuCgscruZmdkSyiSWLwAbFavONzMz60iZJ+8fAAZ2d8KShku6RdJjkh6R9M3cfW1JN0l6In+vlbtL0pmSpkl6UNLW3Z2nmZm1XpnEsh7wuKQbJE2qfUqMtwg4JiI+CIwBjpC0Oaka/skRMQqYnNsBdgFG5c944Kxu/hYzM+sFyhSFnbgsE46IOcCc3PyypMeAocCewNg82ARgCnBs7n5BrpL/DkkDJQ3J0zEzszZR5n0sty7vTCSNBD5CeqfLerVkERFzJK2bBxsKzCyMNit3WyKxSBpPOqNhgw02WN7QzMysYl0WhUl6WdJL+fOGpLclvVR2BpLeB/wBODoiOhtPDbot9UKxiDg3IkZHxOjBgweXDcPMzHpImTOW1YvtkvYCti0zcUkDSEnltxHxx9z5uVoRl6QhLK6CfxYwvDD6MGB2mfmYmVnvUebi/RIi4gpKPMMiSaSqYB6LiJ8Vek0CxuXmccCVhe4H5rvDxgALfX3FzKz9lKmE8ouF1hWA0TQoompge9KDlQ9Juj93+w5wKnCZpEOAZ0jvdwG4FtgVmAa8Brh2ZTOzNlTmrrDie1kWATNId3B1KiJup/F1E4AdGwwfwBEl4jEzs16szDUWnzmYmVlpnb2a+HudjBcRcUoT4jEzszbX2RnLqw26rQYcAqwDOLGYmdlSOns18U9rzZJWB75JuqB+CfDTjsYzM7P3tk6vsUhaG/gWsD+p+pWtI2J+TwRmZmbtqbNrLD8BvgicC/xDRLzSY1GZmVnb6uwByWOA9YETgNmFal1e7k6VLmZm9t7S2TWWbj+Vb2Zm5uRhZmaVcmIxM7NKObGYmVmlnFjMzKxSTixmZlYpJxYzM6uUE4uZmVXKicXMzCrlxGJmZpVyYjEzs0o5sZiZWaWcWMzMrFJOLGZmViknFjMzq5QTi5mZVcqJxczMKuXEYmZmlWpaYpH0a0lzJT1c6La2pJskPZG/18rdJelMSdMkPShp62bFZWZmzdXMM5bzgZ3ruh0HTI6IUcDk3A6wCzAqf8YDZzUxLjMza6KmJZaIuA14sa7znsCE3DwB2KvQ/YJI7gAGShrSrNjMzKx5evoay3oRMQcgf6+buw8FZhaGm5W7LUXSeElTJU2dN29eU4M1M7Pu6y0X79WgWzQaMCLOjYjRETF68ODBTQ7LzMy6q6cTy3O1Iq78PTd3nwUMLww3DJjdw7GZmVkFejqxTALG5eZxwJWF7gfmu8PGAAtrRWZmZtZe+jdrwpIuBsYCgyTNAk4ETgUuk3QI8AywTx78WmBXYBrwGnBws+LqDUYed03T5zHj1N2aPg8zs0aallgi4p866LVjg2EDOKJZsZiZWc/pLRfvzcysj3BiMTOzSjmxmJlZpZxYzMysUk4sZmZWKScWMzOrlBOLmZlVyonFzMwq5cRiZmaVcmIxM7NKObGYmVmlnFjMzKxSTixmZlYpJxYzM6uUE4uZmVXKicXMzCrlxGJmZpVyYjEzs0o5sZiZWaWcWMzMrFJOLGZmViknFjMzq5QTi5mZVap/qwOwnjXyuGuaPo8Zp+7W6+ZtZj3HZyxmZlapXpVYJO0s6W+Spkk6rtXxmJlZ9/WaojBJ/YD/Aj4LzALuljQpIh5tbWTWVzS7KK6zYrj36rztvanXJBZgW2BaREwHkHQJsCfgxGLWpnxd7b1JEdHqGACQtDewc0R8Nbd/GfhYRHyjbrjxwPjcuinwt27MZhDwfAXhNoNjWza9NbbeGhc4tmXVl2IbERGDmxVMbzpjUYNuS2W9iDgXOHeZZiBNjYjRyzJuszm2ZdNbY+utcYFjW1aOrbzedPF+FjC80D4MmN2iWMzMbBn1psRyNzBK0oaSVgT2Aya1OCYzM+umXlMUFhGLJH0DuAHoB/w6Ih6peDbLVITWQxzbsumtsfXWuMCxLSvHVlKvuXhvZmZ9Q28qCjMzsz7AicXMzCrVJxNLV1XDSFpJ0qW5/52SRvai2A6SNE/S/fnz1R6K69eS5kp6uIP+knRmjvtBSVv3RFwlYxsraWFhmX2vh+IaLukWSY9JekTSNxsM05LlVjK2Vi23lSXdJemBHNv3GwzTkm20ZGwt2UbzvPtJuk/S1Q36tWy/tpSI6FMf0oX/J4GNgBWBB4DN64Y5HDg7N+8HXNqLYjsI+HkLltsOwNbAwx303xW4jvS80Rjgzl4U21jg6hYssyHA1rl5deB/GvyfLVluJWNr1XIT8L7cPAC4ExhTN0yrttEysbVkG83z/hbwu0b/W6uWWaNPXzxjebdqmIh4C6hVDVO0JzAhN08EdpTU6AHNVsTWEhFxG/BiJ4PsCVwQyR3AQElDeklsLRERcyLi3tz8MvAYMLRusJYst5KxtUReFq/k1gH5U38XUUu20ZKxtYSkYcBuwK86GKRV+7Wl9MXEMhSYWWifxdIb1LvDRMQiYCGwTi+JDeBLudhkoqThDfq3QtnYW2W7XHxxnaQtenoYq/BjAAAHUElEQVTmudjhI6Qj3KKWL7dOYoMWLbdcpHM/MBe4KSI6XG49vI2WiQ1as42eDvwL8E4H/Vu2zOr1xcRSpmqYUtXHNEGZ+V4FjIyIDwN/YvERSKu1apmVcS+p7qMtgf8ErujJmUt6H/AH4OiIeKm+d4NRemy5dRFby5ZbRLwdEVuRatjYVtKH6gZp2XIrEVuPb6OSPg/MjYh7OhusQbeWbKN9MbGUqRrm3WEk9QfWpGeKWrqMLSJeiIg3c+svgY/2QFxl9NoqdyLipVrxRURcCwyQNKgn5i1pAGnH/duI+GODQVq23LqKrZXLrRDDAmAKsHNdr1Zto13G1qJtdHtgD0kzSEXon5Z0Ud0wLV9mNX0xsZSpGmYSMC437w3cHPmKV6tjqyt/34NUNt4bTAIOzHc5jQEWRsScVgcFIOn9tbJkSduS1usXemC+As4DHouIn3UwWEuWW5nYWrjcBksamJtXAT4DPF43WEu20TKxtWIbjYjjI2JYRIwk7TdujogD6gZr1X5tKb2mSpeqRAdVw0g6GZgaEZNIG9yFkqaRMvp+vSi2oyTtASzKsR3UE7FJuph0l9AgSbOAE0kXLomIs4FrSXc4TQNeAw7uibhKxrY3cJikRcDrwH49tEFtD3wZeCiXyQN8B9igEFurlluZ2Fq13IYAE5Re7rcCcFlEXN0bttGSsbVkG22klyyzpeNqUUIzM7M+qi8WhZmZWQs5sZiZWaWcWMzMrFJOLGZmViknFjMzq5QTizWFpLdzza8PS/q9pFVbFMfRrZp3VSQNlHR4oX19SRNbGVNHJL3S9VDW1zmxWLO8HhFbRcSHgLeAQ8uOmJ8hqMrRQFsnFmAgqeZaACJidkTs3cJ4lpIfAPX+xAAnFusZfwY2AZB0gNL7Lu6XdE4tiUh6RdLJku4kVYy4jaS/5AoS75K0eq4c8CeS7s4VAH49jztW0pRcIeDjkn6bd3RHAesDt0i6JQ97lqSpqnvXhqRd87i3K70/5ercfTWl98HcrfQejKVqo87z+rmkRyVdI+laSXvnfjOUq0mRNFrSlM6mK2mLwvJ5UNIo4FRg49ztJ5JGKr+bRun9Ib+R9FCezqdy94Mk/VHS9ZKekPTvjf6YHN8PJf01L5etJd0g6UlJh+Zh3idpsqR783xqsY5Uet/LL0j1jg0vTHdQnuZuy7C+WLvrqfr5/XlvfYBX8nd/4ErgMOCDpAr8BuR+vwAOzM0B/GNuXhGYDmyT29fI0xkPnJC7rQRMBTYkPZW/kFQP1wrAX4GP5+FmAIMKca2dv/uR6oH6MLAyqVbYDXO/i8nvuwB+CByQmweS3muyWt1v/SJwU57m+sACYO/6+QOjgSmdTZdUGeT+heWwCjCSwrtoiu3AMcBvcvNmwDP59xyUl+Gauf1pYHiD/2kGcFhuPg14kPT+lsGkSg9r/+EauXkQqRYB5TjeofC+EuAVYD1STcqfbfV66E9rPn2uShfrNVbR4qpE/kyqbmI8qcK+u5WqqFqFVDU5wNukChMBNgXmRMTdkCpLBJD0OeDDtbMB0k5zFKmo7a6ImJWHu5+007u9QVz/KGk8aWc5BNiclIymR8RTeZiLc6wAnyNV/vft3L4yqVqUYv1QOwAXR8TbwGxJN5dYPh1N96/Ad5XevfHHiHhCnb9S4+OkZEREPC7paeADud/kiFgIIOlRYARLVuFfU6uv7iHSS65eBl6W9IZSvVmvAj+UtAMpkQwlJQ+ApyO9Z6ZmADAZOCIibi2xHKwPcmKxZnk9UtXj71LaQ06IiOMbDP9G3jFDOhpuVNeQgCMj4oa66Y4F3ix0epsG67akDYFvk86E5ks6n7RD72zPLeBLEfG3Toahg3gh1SdVK3JeucR0H8vFgbsBNyi99nZ6F/F1pMtlUjfcO3XjvJPH2Z90BvPRiPi7Ug27td/yat20FgH3ADsBTizvUb7GYj1pMrC3pHUBJK0taUSD4R4H1pe0TR5udaVqwG8gVZo4IHf/gKTVupjny6SiHUhFaq8CCyWtB+xSmN9GWvyO8H0L498AHJmTIpI+0mAetwH75WtAQ4BPFfrNYHG16l/qarqSNiKdPZ1JOpP4cN1vaDTv/fO4HyCd9XSVBLtrTVKx2N/zNZxG/1lNAF8BNpN0XMVxWJtwYrEeExGPAicAN0p6kHRdYqnX9EZ6bfO+wH9KeiAPtzLplayPAvfmi9fn0PVZ97nAdZJuiYgHgPuAR4BfA/+d5/c66a6r6yXdDjxHumYDcAqpeOfBPM9TGszjcuAJUlHSWSx5pP594AxJfyadNdR0NN19gYdzcd5mpNcavwD8t9Kt2z+pm/cvgH6SHgIuBQ6Kxe8KqcpvgdGSppKSWH0V90vIZ577AZ9S4TZpe+9w7cZmpDufIuKVfAbxX8ATEXHaMk7rfNLF/175rIlZs/mMxSz5Wj5LeIRU9HNOi+Mxa1s+YzEzs0r5jMXMzCrlxGJmZpVyYjEzs0o5sZiZWaWcWMzMrFL/H01sJWy3KWxyAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36ab8a2b0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 1]['percentage question mark'], bins=10, range=(0, 4), rwidth=0.8)\n",
    "plt.xlabel('Percentage question mark')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage question mark of spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAaoAAAEWCAYAAAA3h9P4AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xm8HFWZ//HPlxD2JWACZoOwRBCUzbD4U5FFWRVQccQRCYhGBERmGAWUkU2U0VEWlSUKAqIsImJAEBEIyCgkAcISAhIDSEggYQuE1YTn98c5TSqd7nsrye3uSu73/Xr161ad2p6qrqqn69S5VYoIzMzMqmq5TgdgZmbWFScqMzOrNCcqMzOrNCcqMzOrNCcqMzOrNCcqMzOrtI4nKknnSfrvHprXepLmSOqT+8dK+mJPzDvP7wZJI3tqfouw3O9IelbS0+1etvUcSZMk7dTpOBaVpJMkXdpD8/K+bIts+VbOXNLjwLrAXGAe8BBwCTA6It4CiIjDFmFeX4yIPzcbJyL+Cay2ZFG/vbyTgI0j4sDC/PfsiXkvYhxDgWOA9SNiZruX31MkjQUujYifdzqWdpB0ETAtIk6olUXE5p2LqPOWlX3Z2q8dV1Qfj4jVgfWB04FjgQt6eiGSWpp0O2h94Ll2HNjL8Da0xdTD+0Tb9mVbxkREyz7A48BH6sq2A94C3pP7LwK+k7v7A9cBLwLPA38hJdNf5mleA+YA3wCGAQEcCvwTuL1Qtnye31jge8A4YDbwe2DtPGwn0i/eheIF9gDeBP6Vl3dfYX5fzN3LAScATwAzSVeKa+ZhtThG5tieBb7VxXZaM08/K8/vhDz/j+R1fivHcVGDaXcCpgHfzMt5HPhcYfiKwP/mOJ4BzgNWrpv2WOBp4Je5fF9gIvAS8A9gj0KcFwAzgKeA7wB98rCDgTvysl4AHgP2zMNOI11Rv57X4ye5/Czgybycu4EPFeJeGbg4z2ty/s6nFYYPAn6bt9ljwFFdbN93AGPycsYBpwJ31H1XyxfGf/t7zv1fyDG8ANxIuiIAEHBG/v5nA/cD7wFGkfadN/P6Xlt/POTv5Uxgev6cCaxY970ck+c9Aziki/Ubm7+Lv9aWl9f5V3mdxwPDCuN3td1PAq4CLs3Dv5jLLs3D+wKX5W2/Qov25Ybr3Wze3e1/TbbZxsBt+Xt7FriiMCyAo4CpedgPCsvZCLgFeC4P+xXQr+4c8vW8L7xCOl7WBW4AXgb+DKzVJKba+n+jsP77AXsBfyedE79ZGH854DjSMfoccCXzz28r5e/wOdL5dDywbmFbTc3xPEY+X5RYt22Ae/N0vwGuIJ+78/CPkc4bL5L2xS0Kw44lnTNeBh4Bdl2kXNITCamLneFx6hJVLv8n8JXcfRHzE9X3SCfSvvnzIUCN5sX8E8wlwKqkE1utrJioniKdPFYlHVy1A24nmiSqwgF7aYMTQi1RfQGYAmxIqm68mvkn+locP8txbQm8Aby7yXa6hJREV8/T/h04tFmcDXbuucCPSCe/D5MOkE3y8DNJJ+m18/yvBb5XN+3/5GlXJv2QmA18lHQgDAY2zeNfA5yft+U6pJP+lws7/7+ALwF9gK+QTsCq33aF2A8knVCXJ52cngZWysNOJ51I1gKGkA78aYUD9G7g28AK+TuYCuzeZBtdTjqIV837wlOUTFSkE8UU4N05zhOAv+Zhu+c4+pGS1ruBgfX7dZP96xTgzrwdB5AO7FPrvpdTSMfBXsCrND/Bjc0xbkQ6mT9E2oc+kmO+BPhFye1+Uv4e98vbeeVcdmnu/kNetz4t3Jcbrnc38z6YLva/Bsu6DPhWXseVgA8WhgVwK+mYWS8vp7Y/bEw6NlbM39vtwJl13/GdpOQ0mJRw7gG2ztPcApzYzfp/O6//l0hJ+dd5nTcn/djbMI9/dF7WkDzv84HL8rAvk471VfL2eB+wBukYeIn554eBwObdrRvpOHsC+FqO7ZOkH2K1c/c2eV23z8sbmbfFisAmpB9GgwrH3EaLlEsWJwGVnnnzRHUn+QqDBRPVKXlH3Li7eTH/BLNhg7Jiojq9MHyzvHH7sOSJ6mbg8MKwTUgHyvKFOIYUho8DDmiwXn1ISWyzQtmXgbGLeHCvWii7Evhv0snzleJOAbwfeKww7Zvkk1QuOx84o8Fy1s1xrlwo+yxwa+FEMaUwbJW8Dd5Zv+26WJcXgC1z9wKJh/TLvpaotgf+WTft8RROxnXb91/kZJvLvkv5RHUD+WSY+5cjnTzXB3YhncR2IP/iLox3EV0nqn8AexWG7Q48XvheXquLaSawQ5PtNpbCFTvwQ+CGQv/HgYklt/tJwO11w08i/di5DTib5if/ntiXG653iXl3uf81WNYlwGgKx2hhWJBrEXL/4cDNTeazH3Bv3XdcrNH4LXBuof+rwDXdrH+tlmL1HMv2hXHuBvbL3ZMpXJmQkk7tHPQF6q5q8jirkq54PkXhWO5u3YAdST/wVBh+B/PP3eeSf2gVhj9C+uG8cf4ePwL07WqZzT6davU3mHQZW+8HpF+Gf5I0VdJxJeb15CIMf4L0a6B/qSi7NijPrzjv5Ukn9Jpiy6ZXadzQoz/zf60U5zV4EWJ5ISJeqZt+EOlX0SrA3ZJelPQi8MdcXjMrIl4v9A8lnUTrrU/adjMK8zqfdEVQ8/b6RsSrubNp4xZJx0iaLGl2nt+azP9uBrHgd1fsXh8YVIsjT/tNFtz2NQNI30v9flDW+sBZheU8T/oBMDgibgF+AvwUeEbSaElrlJxvo/1nUKH/uYiYW+hvtv/UPFPofq1B/9vTdrPdofExtQOwBemHXzSJoSf25WbrXWbeDfc/SR/KrYHnSJqUy79B+h7H5daYX6iLo35/GQQgaR1Jl0t6StJLpCvN+vNJ6e+igeciYl5h3Ebzq02/PvC7wr45mVTFvi7pdsmNwOWSpkv6vqS++TzxGeAw0rH8B0mblli3QcBTdd99/TF5TN0xOZR0FTWFdPV3EjAzL6O4r3er7YlK0rakneuO+mER8XJEHBMRG5J+Bf6npF1rg5vMsll5zdBC93qkXxzPkq40VinE1YcFT+DdzXc66cspznsuC+5UZTybY6qf11OLMI+1JK1aN/30PO/XSJf2/fJnzYgoHij16/kkqQqp3pOkX7T9C/NaI8q3ZFtgOZI+RKq3/jdS1U4/UpWj8igzSFUaNcXv8UnSVWG/wmf1iNirwXJnkb6X+v2gppbgVymUvbNuWV+uW9bKEfFXgIg4OyLeR6qWeRfp/sRC69tAo/1nejfTLLES2x0ax/4nUtX8zZIa/SCAntmXm1nseUfEXyJitfzZPJc9HRFfiohBpCuzcyRtXJisfn+pfTffI22fLSJiDVI1anHbtdOTpPtwxX1zpYh4KiL+FREnR8RmwP8j3T86CCAiboyIj5KuwB4m3aKArtdtBjBYUnFd64/J0+piWSUiLsvL/HVEfJD0/QXpdkNpbUtUktaQ9DHS/YJLI+KBBuN8TNLGeWO8RPp1UPt18QzpXsSiOlDSZpJWIVUtXpV/sfwdWEnS3pL6ku49rFiY7hlgmKRm2+gy4D8kbSBpNVJ10hV1vwa7lWO5EjhN0uqS1gf+k/RrZlGcLGmFfCL6GPCbSP8C8DPgDEnrAEgaLGn3LuZzAXCIpF0lLZfH3zQiZpBOVj/M3+VykjaS9OGS8dV/f6uTEsgsYHlJ3ybVoddcCRwvaS1Jg4EjC8PGAS9JOlbSypL6SHpP/hG0gLx9rwZOkrSKpM1I9ee14bNIJ7sD83y+wIKJ+rwcx+YAktaU9Oncva2k7fP+8wrp/kHZ/fUy4ARJAyT1J92X6JH/VepGd9u9qYj4Pul+yc055vrhPbUvN1p2j85b0qcl1X4IvUA6ec4rjPL1vO8NJd2XuSKXr05qDPJi3i+/TuecR9oe6wPkfWnf3L2zpPfmH+AvkZL8PEnrSton/7B9g7QutfXuat3+lsc7UtLyeTnbFYb/DDgsHw+StGo+t64uaRNJu0hakXSMvMaC27pb7UhU10p6mZRxv0W66X9Ik3GHk1rFzCFtmHMiYmwe9j3Sgf2ipP9ahOX/knS/4GnSTdOjACJiNqnu+eekE9UrpBY3Nb/Jf5+TdE+D+V6Y5307qeXM66T658Xx1bz8qaQrzV/n+Zf1NOlgm05qqXNYRDychx1Lqk69M1/O/5l0P62hiBhH+n7OIP3Svo35v2IPIlW/PJSXdxXpV1kZZwH7S3pB0tmkaokbSD8YniBtv2JVwimk7+OxHPNVpAOrdtL6OLBVHv4s6Xtcs8myjyRVlzxN2hd+UTf8S6SD8jnSldFfawMi4nekX3+X5+33IFD7f7o1SAfoC3kdniO1OoOU8DfL++s1DWL6DjCB1EjkAdIN9+80ib8ndbfduxQRp5Ia1fxZ0toNRlnSfbkrPTnvbYG7JM0h3X/7WkQ8Vhj+e9L9oImkBiS1f6k5mdRwYHYuv3oxl98TziLF/qd8jr2TdP8WUq3AVaQkNZl0HF9KOucfQzpXPE+6h3R4nqbpukXEm6QGFIeS7nEdSGqhXTsmJ5COo5+QjocppPuGkC4ATicdp0+Tbhd8E0DS5zS/OrapWossW0opPeng0ogY0t24SzNJXyE1Ril7BdfVvA4mNZb44BIHZsscSQEMz/dWrAlJdwHnRUT9D78e1/FHKJk1ImmgpA/kKsZNSL8Cf9fpuMx6K0kflvTOXPU3ktS45o/tWLafRGBVtQKpVeEGpKqGy4FzOhqRWe+2Cek+4WqklsH753vXLeeqPzMzqzRX/ZmZWaUtk1V//fv3j2HDhnU6DDOzpcrdd9/9bEQM6H7M9lomE9WwYcOYMGFCp8MwM1uqSFqUp7a0jav+zMys0pyozMys0pyozMys0pyozMys0pyozMys0pyozMys0pyozMys0pyozMys0pyozMys0pbJJ1MsqWHH/aHly3j89L1bvgwzs2WBr6jMzKzSnKjMzKzSnKjMzKzSnKjMzKzSnKjMzKzSnKjMzKzSnKjMzKzSnKjMzKzSnKjMzKzSWpaoJK0kaZyk+yRNknRyLr9I0mOSJubPVrlcks6WNEXS/ZK2KcxrpKRH82dkq2I2M7PqaeUjlN4AdomIOZL6AndIuiEP+3pEXFU3/p7A8PzZHjgX2F7S2sCJwAgggLsljYmIF1oYu5mZVUTLrqgimZN7++ZPdDHJvsAlebo7gX6SBgK7AzdFxPM5Od0E7NGquM3MrFpaeo9KUh9JE4GZpGRzVx50Wq7eO0PSirlsMPBkYfJpuaxZuZmZ9QItTVQRMS8itgKGANtJeg9wPLApsC2wNnBsHl2NZtFF+QIkjZI0QdKEWbNm9Uj8ZmbWeW1p9RcRLwJjgT0iYkau3nsD+AWwXR5tGjC0MNkQYHoX5fXLGB0RIyJixIABA1qwFmZm1gmtbPU3QFK/3L0y8BHg4XzfCUkC9gMezJOMAQ7Krf92AGZHxAzgRmA3SWtJWgvYLZeZmVkv0MpWfwOBiyX1ISXEKyPiOkm3SBpAqtKbCByWx78e2AuYArwKHAIQEc9LOhUYn8c7JSKeb2HcZmZWIS1LVBFxP7B1g/JdmowfwBFNhl0IXNijAZqZ2VLBT6YwM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKc6IyM7NKa1mikrSSpHGS7pM0SdLJuXwDSXdJelTSFZJWyOUr5v4pefiwwryOz+WPSNq9VTGbmVn1tPKK6g1gl4jYEtgK2EPSDsD/AGdExHDgBeDQPP6hwAsRsTFwRh4PSZsBBwCbA3sA50jq08K4zcysQlqWqCKZk3v75k8AuwBX5fKLgf1y9765nzx8V0nK5ZdHxBsR8RgwBdiuVXGbmVm1tPQelaQ+kiYCM4GbgH8AL0bE3DzKNGBw7h4MPAmQh88G3lEsbzBNcVmjJE2QNGHWrFmtWB0zM+uAliaqiJgXEVsBQ0hXQe9uNFr+qybDmpXXL2t0RIyIiBEDBgxY3JDNzKxi2tLqLyJeBMYCOwD9JC2fBw0BpufuacBQgDx8TeD5YnmDaczMbBnXylZ/AyT1y90rAx8BJgO3Avvn0UYCv8/dY3I/efgtERG5/IDcKnADYDgwrlVxm5lZtSzf/SiLbSBwcW6htxxwZURcJ+kh4HJJ3wHuBS7I418A/FLSFNKV1AEAETFJ0pXAQ8Bc4IiImNfCuM3MrEJalqgi4n5g6wblU2nQai8iXgc+3WRepwGn9XSMZmZWfd1W/UnaSNKKuXsnSUfVqvTMzMxarcw9qt8C8yRtTKqe2wD4dUujMjMzy8okqrfy/zV9AjgzIv6DdP/JzMys5cokqn9J+iypRd51uaxv60IyMzObr0yiOgR4P3BaRDyWm4hf2tqwzMzMkm5b/UXEQ5KOBdbL/Y8Bp7c6MDMzMyjX6u/jwETgj7l/K0ljWh2YmZkZlKv6O4n0f08vAkTERFLLPzMzs5Yrk6jmRsTsurKFHgprZmbWCmWeTPGgpH8H+kgaDhwF/LW1YZmZmSVlrqi+Snq77hvAZcBLwNGtDMrMzKymTKu/V4Fv5Y+ZmVlbdZuoJF3LwvekZgMTgPPzw2TNzMxaokzV31RgDvCz/HkJeAZ4V+43MzNrmTKNKbaOiB0L/ddKuj0idpQ0qVWBmZmZQbkrqgGS1qv15O7+uffNlkRlZmaWlbmiOga4Q9I/AJH+2fdwSasCF7cyODMzszKt/q7P/z+1KSlRPVxoQHFmK4MzMzMr+yr64cAmwErAFpKIiEtaF5aZmVlS5qG0JwI/zp+dge8D+5SYbqikWyVNljRJ0tdy+UmSnpI0MX/2KkxzvKQpkh6RtHuhfI9cNkXScYuxnmZmtpQqc0W1P7AlcG9EHCJpXeDnJaabCxwTEfdIWh24W9JNedgZEfG/xZElbQYcQHoKxiDgz5LelQf/FPgoMA0YL2lMRDxUIgYzM1vKlUlUr0XEW5LmSloDmAls2N1EETEDmJG7X5Y0GRjcxST7ApdHxBvAY5KmkJ7aDjAlIqYCSLo8j+tEZWbWC5Rpnj5BUj/SP/feDdwDjFuUhUgaBmwN3JWLjpR0v6QLJa2VywYDTxYmm5bLmpXXL2OUpAmSJsyaNWtRwjMzswrrNlFFxOER8WJEnEeqfhsZEYeUXYCk1YDfAkdHxEvAucBGwFakK64f1kZttPguyuvjHB0RIyJixIABA8qGZ2ZmFVemMcUH8v9MAXwQOFjS+mVmLqkvKUn9KiKuBoiIZyJiXkS8RbpKq1XvTQOGFiYfAkzvotzMzHqBMlV/5wKvStoS+AbwBNBt03RJAi4AJkfEjwrlAwujfQJ4MHePAQ6QtKKkDUhN4scB44HhkjaQtAKpwcWYEnGbmdkyoExjirkREZL2Bc6KiAskjSwx3QeAzwMPSJqYy74JfFbSVqTqu8eBLwNExCRJV5IaScwFjoiIeQCSjgRuBPoAF0aEnzFoZtZLlElUL0s6HjgQ2FFSH6BvdxNFxB00vr90fRfTnAac1qD8+q6mMzOzZVeZqr/PkN7ue2hEPE1qcfeDlkZlZmaWlbqiIlX5zcv/gLsp6ZX0ZmZmLVfmiup2YEVJg4GbgUOAi1oZlJmZWU2ZRKWIeBX4JPDjiPgE6TFHZmZmLVcqUUl6P/A54A+5rE/rQjIzM5uvTKI6Gjge+F1uQr4hcGtrwzIzM0vKvDjxNuC22tMp8sNhj2p1YGZmZlDuEUrvl/QQMDn3bynpnJZHZmZmRrmqvzOB3YHnACLiPmDHVgZlZmZWUyZRERFP1hXNa0EsZmZmCynzD79PSvp/QOSHwh5FrgY0MzNrtTJXVIcBR5AenTSN9B6pI1oZlJmZWU2ZVn/Pkv6HyszMrO26TVT53VBfBYYVx4+IfVoXlpmZWVLmHtU1pBcgXgu81dpwzMzMFlQmUb0eEWe3PBIzM7MGyiSqsySdCPyJ9F4qACLinpZFZWZmlpVJVO8lvVJ+F+ZX/UXuNzMza6kyzdM/AWwYER+OiJ3zp9skJWmopFslTZY0SdLXcvnakm6S9Gj+u1Yul6SzJU2RdL+kbQrzGpnHf1TSyMVdWTMzW/qUSVT3Af0WY95zgWMi4t3ADsARkjYDjgNujojhpBcxHpfH3xMYnj+jgHMhJTbgRGB7YDvgxFpyMzOzZV+Zqr91gYcljWfBe1RdNk+PiBnAjNz9sqTJpH8a3hfYKY92MTAWODaXXxIRAdwpqZ+kgXncmyLieQBJNwF7AJeVW0UzM1ualUlUJy7pQiQNA7YG7gLWzUmMiJghaZ082mCg+EzBabmsWXn9MkaRrsRYb731ljRkMzOriLLvo1psklYDfgscHREvSWo6aqPFd1G+YEHEaGA0wIgRIxYabmZmS6dST09fXJL6kpLUryLi6lz8TK7SI/+dmcunAUMLkw8BpndRbmZmvUDLEpXSpdMFwOSI+FFh0Big1nJvJPD7QvlBufXfDsDsXEV4I7CbpLVyI4rdcpmZmfUCTROVpJvz3/9ZzHl/gPz/V5Im5s9ewOnARyU9Cnw09wNcD0wFpgA/Aw4HyI0oTgXG588ptYYVZma27OvqHtVASR8G9pF0OXX3irp7MkVE3FE/TcGuDcYPmrw+JCIuBC7sanlmZrZs6ipRfZv0P05DgB/VDfOTKczMrC2aJqqIuAq4StJ/R8SpbYzJzMzsbWWap58qaR9gx1w0NiKua21YZmZmSbet/iR9D/ga8FD+fC2XmZmZtVyZJ1PsDWwVEW8BSLoYuBc4vpWBmZmZQfn/oyo+lHbNVgRiZmbWSJkrqu8B90q6ldTcfEd8NWVmZm1SpjHFZZLGAtuSEtWxEfF0qwMzMzODcldUtVd2jGlxLGZmZgtp6UNpzczMlpQTlZmZVVqXiUrScpIebFcwZmZm9bpMVPl/p+6T5FfmmplZR5RpTDEQmCRpHPBKrTAi9mlZVGZmZlmZRHVyy6MwMzNrosz/Ud0maX1geET8WdIqQJ/Wh2ZmZlbuobRfAq4Czs9Fg4FrWhmUmZlZTZnm6UeQXiv/EkBEPAqs08qgzMzMasokqjci4s1aj6TlSW/4NTMza7kyieo2Sd8EVpb0UeA3wLXdTSTpQkkzi/+HJekkSU9Jmpg/exWGHS9piqRHJO1eKN8jl02RdNyirZ6ZmS3tyiSq44BZwAPAl4HrgRNKTHcRsEeD8jMiYqv8uR5A0mbAAcDmeZpzJPWR1Af4KbAnsBnw2TyumZn1EmVa/b2VX5Z4F6nK75GI6LbqLyJulzSsZBz7ApdHxBvAY5KmANvlYVMiYiqApMvzuA+VnK+ZmS3lyrT62xv4B3A28BNgiqQ9l2CZR0q6P1cNrpXLBgNPFsaZlsualTeKc5SkCZImzJo1awnCMzOzKilT9fdDYOeI2CkiPgzsDJyxmMs7F9gI2AqYkecN6T1X9aKL8oULI0ZHxIiIGDFgwIDFDM/MzKqmzJMpZkbElEL/VGDm4iwsIp6pdUv6GXBd7p0GDC2MOgSYnrublZuZWS/QNFFJ+mTunCTpeuBK0tXMp4Hxi7MwSQPzSxgBPgHUWgSOAX4t6UfAIGA4MI50RTVc0gbAU6QGF/++OMs2M7OlU1dXVB8vdD8DfDh3zwLWWnj0BUm6DNgJ6C9pGnAisJOkrUgJ73FSK0IiYpKkK0mNJOYCR0TEvDyfI4EbSY9tujAiJpVdOTMzW/o1TVQRcciSzDgiPtug+IIuxj8NOK1B+fWkJvFmZtYLdXuPKle7fRUYVhzfr/kwM7N2KNOY4hrSldC1wFutDcfMzGxBZRLV6xFxdssjMTMza6BMojpL0onAn4A3aoURcU/LojIzM8vKJKr3Ap8HdmF+1V/kfjMzs5Yqk6g+AWxYfNWHmZlZu5R5hNJ9QL9WB2JmZtZImSuqdYGHJY1nwXtUbp5uZmYtVyZRndjyKMzMzJoo8z6q29oRiJmZWSNlnkzxMvNfrbEC0Bd4JSLWaGVgZmZmUO6KavViv6T9mP/2XTMzs5Yq0+pvARFxDf4fKjMza5MyVX+fLPQuB4ygyVt2zczMelqZVn/F91LNJb1Hat+WRGNmZlanzD2qJXovlZmZ2ZLo6lX03+5iuoiIU1sQj5mZ2QK6uqJ6pUHZqsChwDsAJyozM2u5pq3+IuKHtQ8wGlgZOAS4HNiwuxlLulDSTEkPFsrWlnSTpEfz37VyuSSdLWmKpPslbVOYZmQe/1FJI5dgXc3MbCnUZfP0nFi+A9xPuvraJiKOjYiZJeZ9EbBHXdlxwM0RMRy4OfcD7AkMz59RwLm15ZMe4bQ96X+3TqwlNzMz6x2aJipJPwDGAy8D742IkyLihbIzjojbgefrivcFLs7dFwP7FcovieROoJ+kgcDuwE0R8Xxe9k0snPzMzGwZ1tUV1THAIOAEYLqkl/LnZUkvLeby1o2IGQD57zq5fDDwZGG8abmsWbmZmfUSTRtTRMQiP7ViCahRCF2ULzwDaRSp2pD11luv5yIzM7OOamcyAngmV+mR/9budU0DhhbGGwJM76J8IRExOiJGRMSIAQMG9HjgZmbWGe1OVGOAWsu9kcDvC+UH5dZ/OwCzc9XgjcBuktbKjSh2y2VmZtZLlHmE0mKRdBmwE9Bf0jRS673TgSslHQr8E/h0Hv16YC9gCvAqqRk8EfG8pFNJjToATomI+gYaZma2DGtZooqIzzYZtGuDcQM4osl8LgQu7MHQzMxsKdLuqj8zM7NF4kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV5kRlZmaV1pFEJelxSQ9ImihpQi5bW9JNkh7Nf9fK5ZJ0tqQpku6XtE0nYjYzs87o5BXVzhGxVUSMyP3HATdHxHDg5twPsCcwPH9GAee2PVIzM+uYKlX97QtcnLsvBvYrlF8SyZ1AP0kDOxGgmZm1X6cSVQCClJhCAAALaUlEQVR/knS3pFG5bN2ImAGQ/66TywcDTxamnZbLFiBplKQJkibMmjWrhaGbmVk7Ld+h5X4gIqZLWge4SdLDXYyrBmWxUEHEaGA0wIgRIxYabmZmS6eOXFFFxPT8dybwO2A74JlalV7+OzOPPg0YWph8CDC9fdGamVkntT1RSVpV0uq1bmA34EFgDDAyjzYS+H3uHgMclFv/7QDMrlURmpnZsq8TVX/rAr+TVFv+ryPij5LGA1dKOhT4J/DpPP71wF7AFOBV4JD2h2xmZp3S9kQVEVOBLRuUPwfs2qA8gCPaEJqZmVVQlZqnm5mZLcSJyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKs2JyszMKq1Tr6K3Chp23B9avozHT9+75csws2WLE1XF9NZk0VvX28y650RlvV4nk2RvXbbZonCiMrNexQl66eNEZWZt11uTRW9d7yW11LT6k7SHpEckTZF0XKfjMTOz9lgqEpWkPsBPgT2BzYDPStqss1GZmVk7LBWJCtgOmBIRUyPiTeByYN8Ox2RmZm2giOh0DN2StD+wR0R8Mfd/Htg+Io4sjDMKGJV7NwEeWcTF9Aee7YFwe1pV4wLHtrgc26KralywbMW2fkQMaFUwi2tpaUyhBmULZNiIGA2MXuwFSBMiYsTiTt8qVY0LHNvicmyLrqpxgWNrh6Wl6m8aMLTQPwSY3qFYzMysjZaWRDUeGC5pA0krAAcAYzock5mZtcFSUfUXEXMlHQncCPQBLoyIST28mMWuNmyxqsYFjm1xObZFV9W4wLG13FLRmMLMzHqvpaXqz8zMeiknKjMzq7Relai6ewyTpBUlXZGH3yVpWIViO1jSLEkT8+eLbYrrQkkzJT3YZLgknZ3jvl/SNu2Iq2RsO0maXdhm325jbEMl3SppsqRJkr7WYJy2b7uScXVku0laSdI4Sffl2E5uME5HjtGSsXXkGC0sv4+keyVd12BYx85tPSIiesWH1AjjH8CGwArAfcBmdeMcDpyXuw8ArqhQbAcDP+nAdtsR2AZ4sMnwvYAbSP/rtgNwV4Vi2wm4rkP720Bgm9y9OvD3Bt9p27ddybg6st3ydlgtd/cF7gJ2qBunU8domdg6cowWlv+fwK8bfXed2m499elNV1RlHsO0L3Bx7r4K2FVSo3827kRsHRERtwPPdzHKvsAlkdwJ9JM0sCKxdUxEzIiIe3L3y8BkYHDdaG3fdiXj6oi8Hebk3r75U9/aqyPHaMnYOkbSEGBv4OdNRunUua1H9KZENRh4stA/jYUP0LfHiYi5wGzgHRWJDeBTuYroKklDGwzvhLKxd8r7c3XNDZI270QAuZpla9Kv8KKObrsu4oIObbdcfTURmAncFBFNt1mbj9EysUHnjtEzgW8AbzUZ3rHt1hN6U6Lq9jFMJcdphTLLvRYYFhFbAH9m/q+jTuvUNivjHtKzy7YEfgxc0+4AJK0G/BY4OiJeqh/cYJK2bLtu4urYdouIeRGxFenpM9tJek/dKB3bZiVi68gxKuljwMyIuLur0RqUVeU47VZvSlRlHsP09jiSlgfWpD1VS93GFhHPRcQbufdnwPvaEFcZlX28VUS8VKuuiYjrgb6S+rdr+ZL6kpLBryLi6gajdGTbdRdXp7dbXu6LwFhgj7pBnTpGu42tg8foB4B9JD1Oum2wi6RL68bp+HZbEr0pUZV5DNMYYGTu3h+4JfLdx07HVnfvYh/SvYUqGAMclFuw7QDMjogZnQ4KQNI7a/XwkrYj7e/PtWnZAi4AJkfEj5qM1vZtVyauTm03SQMk9cvdKwMfAR6uG60jx2iZ2Dp1jEbE8RExJCKGkc4dt0TEgXWjderc1iOWikco9YRo8hgmSacAEyJiDOkA/qWkKaRfGwdUKLajJO0DzM2xHdyO2CRdRmoF1l/SNOBE0o1kIuI84HpS67UpwKvAIe2Iq2Rs+wNfkTQXeA04oI0H5weAzwMP5PsaAN8E1ivE14ltVyauTm23gcDFSi9KXQ64MiKuq8IxWjK2jhyjzVRku/UIP0LJzMwqrTdV/ZmZ2VLIicrMzCrNicrMzCrNicrMzCrNicrMzCrNicraStK8/GTpByX9RtIqHYrj6E4tu6dI6ifp8EL/IElXdTKmZiTN6X4ss8acqKzdXouIrSLiPcCbwGFlJ8z/w9JTjgaW6kQF9CM9FRuAiJgeEft3MJ6F5H9m9nnGloh3IOukvwAbA0g6UOl9PxMlnV9LSpLmSDpF0l2kB6VuK+mv+YGp4yStnh8W+gNJ4/MDQb+cp91J0tj8gNCHJf0qnziPAgYBt0q6NY97rqQJqnvXkKS98rR3KL076rpcvqrS+7DGK70DaKGn3edl/UTSQ5L+IOl6SfvnYY8rP5ZI0ghJY7uar6TNC9vnfknDgdOBjXLZDyQNU343l9L7k34h6YE8n51z+cGSrpb0R0mPSvp+oy8mx/ddSX/L22UbSTdK+oekw/I4q0m6WdI9eTm1WIcpve/qHNJzA4cW5ts/z3PvxdhfrLdq1/tE/PEnIgDm5L/LA78HvgK8m/RAz7552DnAQbk7gH/L3SsAU4Ftc/8aeT6jgBNy2YrABGAD0lMrZpOeobcc8Dfgg3m8x4H+hbjWzn/7kJ7jtgWwEumJ0xvkYZeR3/UDfBc4MHf3I73XadW6df0kcFOe5yDgRWD/+uUDI4CxXc2X9HDYzxW2w8rAMArv4ir2A8cAv8jdmwL/zOtzcN6Ga+b+J4ChDb6nx4Gv5O4zgPtJ768aQHoAau07XCN39yc9YUM5jrcovK8JmAOsS3pS+0c7vR/6s3R9es0jlKwyVtb8R/f8hfRol1GkB3iOV3rE3MqkVykAzCM9QBVgE2BGRIyH9PBUAEm7AVvUrlZIJ+HhpKrFcRExLY83kXQSvaNBXP8maRTp5DsQ2IyU3KZGxGN5nMtyrAC7kR4E+l+5fyXSY4iKz3fbEbgsIuYB0yXdUmL7NJvv34BvKb136OqIeFRdv07og6TkRkQ8LOkJ4F152M0RMRtA0kPA+iz4upGa2vMmHyC9NPBl4GVJrys99+4V4LuSdiQlpsGkZATwRKR3bNX0BW4GjoiI20psB7O3OVFZu70W6VUJb1M6414cEcc3GP/1fKKH9Gu90TO/BHw1Im6sm+9OwBuFonk02OclbQD8F+lK7QVJF5ESRFeZQMCnIuKRLsahSbyQngdXq3pfqcR8J+fqz72BG5Vecz61m/ia6Xab1I33Vt00b+VpPke6wnpfRPxL6endtXV5pW5ec4G7gd0BJypbJL5HZVVwM7C/pHUAJK0taf0G4z0MDJK0bR5vdaVXFtxIeohq31z+LkmrdrPMl0lVWZCqEF8BZktaF9izsLwNlV4wCPCZwvQ3Al/NSRZJWzdYxu3AAfke2kBg58Kwx5n/GohPdTdfSRuSru7OJl3pbFG3Do2W/bk87btIV2XdJdVFtSapGvBf+R5Yo++sJoAvAJtKOq6H47BlnBOVdVxEPAScAPxJ0v2k+zoLvZI9It4kJYsfS7ovj7cS6fXbDwH35MYE59N9bcFo4AZJt0bEfcC9wCTgQuD/8vJeI7Wq+6OkO4BnSPe8AE4lVWfdn5d5aoNl/A54lFR1di4LXkmcDJwl6S+kq5qaZvP9DPBgrr7clPQK++eA/1Nq6v+DumWfA/SR9ABwBXBwzH9XUk/5FTBC0gRSUqx/JccC8pXxAcDOKjSrN+uOn55u1gVJq0XEnHyF81Pg0Yg4YzHndRGpMUYl/9fJrKp8RWXWtS/lq5hJpKqu8zscj1mv4ysqMzOrNF9RmZlZpTlRmZlZpTlRmZlZpTlRmZlZpTlRmZlZpf1/eGktqa7DXCcAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36ab6f518>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 0]['percentage question mark'], bins=10, range=(0, 4), rwidth=0.8)\n",
    "plt.xlabel('Percentage question mark')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage question mark of non-spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Percentage exclamation mark"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "      <th>percentage digits</th>\n",
       "      <th>percentage question mark</th>\n",
       "      <th>percentage exclamation mark</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Free entry in 2 a wkly comp to win FA Cup fina...</td>\n",
       "      <td>16.129032</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>U dun say so early hor... U c already then say...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>Nah I don't think he goes to usf, he lives aro...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text  \\\n",
       "1        0  Go until jurong point, crazy.. Available only ...   \n",
       "2        0                      Ok lar... Joking wif u oni...   \n",
       "3        1  Free entry in 2 a wkly comp to win FA Cup fina...   \n",
       "4        0  U dun say so early hor... U c already then say...   \n",
       "5        0  Nah I don't think he goes to usf, he lives aro...   \n",
       "\n",
       "   percentage digits  percentage question mark  percentage exclamation mark  \n",
       "1           0.000000                       0.0                          0.0  \n",
       "2           0.000000                       0.0                          0.0  \n",
       "3          16.129032                       0.0                          0.0  \n",
       "4           0.000000                       0.0                          0.0  \n",
       "5           0.000000                       0.0                          0.0  "
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def percentage_exclamation_mark(text):\n",
    "    counter = 0\n",
    "    for i in text:\n",
    "        if i == '!':\n",
    "            counter += 1\n",
    "    return (counter / len(text)) * 100\n",
    "\n",
    "df['percentage exclamation mark'] = df['text'].apply(percentage_exclamation_mark)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAaEAAAEWCAYAAADPZygPAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3XmcXFWZ//HPlyTsgUDSYEgCAYkgqAQmLA4ORkAFFKMjKo6sg0YUWX4yI4vIojCGUQFxJYgDOAoiKgRkXwLDyJKAIRACQ4RAYgJpEELYSXh+f5xT5Kao7r6ddPXt5ft+vepVd7/PXeo+dU+dOlcRgZmZWRVWqzoAMzPrv5yEzMysMk5CZmZWGSchMzOrjJOQmZlVxknIzMwq0+1JSNLPJX2ri5a1qaQXJQ3I/VMlfbErlp2Xd62kg7tqeZ1Y7+mSnpH0VHev2xqTdKGk06uOA6o7L1eVpEMk3dFFy/qKpKfz539oVyzTqjGwKxcmaS6wMbAUWAY8BFwMTI6INwEi4vBOLOuLEXFTW9NExJPAuqsW9VvrOxXYMiIOKCx/765YdifjGAUcC2wWEYu6e/1dRdJU4L8j4hdVx9Kb9ZTzsieRNAg4C9glIu6vOh5bNc24E9o3IgYDmwGTgOOAC7p6JZK6NIH2IJsBz3ZHAurD+9B6mC4+1zYG1gRmdeEyrSoR0WUvYC6wZ92wnYA3gffk/guB03P3MOBq4Hng78D/kBLjr/I8rwAvAt8ARgMBHAY8CdxeGDYwL28q8F3gHmAxcCWwYR43HpjfKF5gL+B14I28vvsLy/ti7l4NOAl4AlhEusNbP4+rxXFwju0Z4Jvt7Kf18/yteXkn5eXvmbf5zRzHhQ3mHQ/MB07M65kLfKEwfg3g+zmOp4GfA2vVzXsc8BTwqzx8AjADeAH4K7BXIc4LgIXA34DTgQF53CHAHXldzwGPA3vncWeQ7oRfzdvx4zz8h8C8vJ57gX8qxL0WcFFe1ux8zOcXxm8C/D7vs8eBo9rZv+3tg+OAu1h+znyFdDFbM/d/APgz6ZycBxzS4LzdgHTetuZ4rwZGFtY/Ne+rP+ftvwoYCvw6b/s0YHRh+ob7he4/Ly8Efgpcm9f3v8A7gHPydj4MbF+Y/njS+bKEVOrxqcK4Q/L8Z5M+26fnYXcUpvke6Rxav41jeA6wIL/OycPeBbyUt+tF4JYG864J/DfwbD6O04CNO7pG5PG/I302FpOuMduu7P5pEFcAXwUezfvsO8A7gTvzsb8MWL0w/cdJn8vnSefS+wrjjiN9JpcAjwB7FK630/PyngbOKrltQ0nnae38PL3uWG0N3JiP5SPAZwvj9snHf0mO6d86lTeanYTy8CeBrzT4MH+XdIEYlF//BKjRslj+gboYWId00aoNKyahvwHvydP8nlQkBO0kodx9am3auotJ7cP+r8AcYAtSEeAfWH4Rr8Vxfo5rO+A14N1t7KeLSSf/4Dzv/wGHtRVn3bzjScWdZ5E+lB8kfSi3yuPPAaYAG+blXwV8t27eM/O8a5FO2sXAh0kXtBHA1nn6K4Dz8r7ciPTB/XLhIvMG8CVgAOlivqBw/N7ad4XYDyCd7ANJRY5PsfziPwm4jXSBHwnMrO2HHNe9wMnA6vkYPAZ8tI191N4+WI30ATwVGEO6eGyfx21K+iB9nnQ+DgXGNjhvhwKfBtbOy/8dcEXdeTOHdIFZn/QB/T/Sl4yB+fj/V8n9cirdd15eSEpU/0C6kN9CSvgH5WN8OnBrYfrPkL4crAZ8jnQeDi+cH0uBI/N2rcXyLy6r5ZiuB9ZuI5Zvk74sbAS0kC7C36nbroFtzPvlfMzXznH/A7BeR9eIwv4czPIkOGNl90+DuIJ0Xq4HbJuPxc352NXOk4PztDuQvlTsnJd9MOl6tQawFelLyyaF/fHO3H0ncGDuXpdUZFlm2y7Nr7WBbfLy78jj1sn9h+ZjuUPeD9vm8QtZ/sVpA2CHTuWNzkzc4cLaTkJ3kb+BseKH+duki/GWHS2rcOJt0WBYMQlNKozfhvRNcgCrnoRuBr5aGLcV6SI8sBBH8dvwPcD+DbZrQD75tqn70EzN3W+Ls27+8aQP9zqFYZcB3wJEuhC8szDu/cDjhXlfJ1/g8rDzgLMbrGfjHOdahWGfJ3/ISBeUOYVxa+d98I76fdfOtjwHbJe7V0gqwBdZnoR2Bp6sm/cEChfywvB290HhvPk76Y7rhLpl/rGNWC8kn7cNxo0Fnqs7b75Z6P8BcG2hf18KF4AO9ku3nJeFbTy/0H8kMLvQ/17g+XbingFMKJwf9cfsEOBu4Leki//q7Szrr8A+hf6PAnMLx6+9JPSv1N051O27hteIBtMOyeup3Vmu6v4JYNdC/73AcXXnyTm5+2fkpFsY/wjpS+eWpAS1JzCobprbgdOAYR189t7aNtI16Q3yF9k8/q07IdIXjP+pm/884JTc/STpGrZee+ts69VdteNGkD709b5H+hZ3g6THJB1fYlnzOjH+CdI32mGlomzfJnl5xWUPJF2sa4q12V6mcaWJYaRv8/XLGtGJWJ6LiJfq5t+E9I1xbeBeSc9Leh64Lg+vaY2IVwv9o0gf+HqbkfbdwsKyziN9M615a3sj4uXc2WZFEUnHSpotaXFe3vosPzabsOKxK3ZvBmxSiyPPeyIr7vuaDvdBRMwFbiVdzH5SmLetfVG/HWtLOk/SE5JeIH3wh9RqaWZPF7pfadD/1n7qYL90pKvOy5WJ+yBJMwr7+T11cTf6rG5JKv49LSJebyeORtu1STvTF/2KdJd1qaQFkv4zV2ZoFNdb1whJAyRNkvTXfFzn5mmK21R6/7Sh7PybAcfWnfOjSHc/c4BjSF9QFkm6VFJt3xxGKrJ8WNI0SR8H6GDbWkjnTHufv53rYvkCqSgSUqnAPsATkm6T9P4O9sEKmp6EJO1IusC+rWpmRCyJiGMjYgvSt8OvS9qjNrqNRbY1vGZUoXtTUoZ/hvTteO1CXANY8eLc0XIXkA5GcdlLWfEkKuOZHFP9sv7WiWVsIGmduvkX5GW/QrpNHpJf60dE8YNRv53zSMVG9eaR7oSGFZa1XkRsWzLGFdYj6Z9I5difBTaIiCGkYkDlSRaSiuFqisdxHulOZkjhNTgi9mmw3g73gaR9SHdHN5O+CBXX02hf1DuWdMexc0SsB+xWW3SJeVdQYr9013nZKZI2IxWpfQ0YmuN+kBX3QaPYZ5OKda6VtFU7q2i0XQvKxBYRb0TEaRGxDfCPpN9WDipM0tY14l9ICXJP0heB0XmaTh/XLjAPOKPunF87Ii4BiIjfRMQHSPsoSEXsRMSjEfF50pfFM4HL87WivW1rJZ0z7X3+bquLZd2I+Epe57SImJDXeQWpZKa0piUhSevlLHwpqTjhgQbTfFzSlpJE+kFsWX5B+hBtsRKrPkDSNpLWJhX3XR4Ry0hl8mtK+lj+VnQSqWy05mlgtKS29sklwP+TtLmkdYH/AH4bEUs7E1yO5TLgDEmD84f566QfUjvjNEmr54vYx4HfRaoGfz5wtqSNACSNkPTRdpZzAXCopD0krZan3zoiFgI3AD/Ix3I1Se+U9MGS8dUfv8GkE70VGCjpZFLZeM1lwAmSNpA0gnRxq7kHeEHScZLWyt/q3pO/4Kygo30gaVje5i+Sytn3zUkJUsWBPSV9VtJASUMljW2wbYNJie55SRsCp5TcJ410tF+65bxcCeuQLn6tAJIOJd0JdShfSE8EbpLUVtK/BDhJUks+ZidT8jMi6UOS3pu/aL5ASjLLCpO0dY0YTPri9SzpC+t/lFlfk5wPHC5pZyXr5GvXYElbSdpd0hqkyj+vkLdP0gGSWvLn4Pm8rHa3LW/7H4BT813+1qyYtK8G3iXpQEmD8mtHSe/O16AvSFo/It5g+XW8tGYkoaskLSFlz2+SfkA/tI1pxwA3kWqa3An8NCKm5nHfJZ2Ez0v6t06s/1ekstunSD8eHgUQEYtJNVN+QbrreIlUU6zmd/n9WUn3NVjuL/Oybyf9GPkqqUx4ZRyZ1/8Y6Q7xN3n5ZT1F+t1gAenCeXhEPJzHHUcq4rwr33bfRPrW3lBE3EM6PmeTvoHfxvJvoAeRig4fyuu7HBheMsYfAvtJek7SuaTikWtJXwaeIO2/4i3/t0nH4/Ec8+WkD03tQ7Iv6beXx0nfWn9B+kbXSHv7YDJwZURcExHPkoovfiFpaKT/ne1DutP5O+k3ju0aLP8c0g/tz5B+77yu5D5ppKP90p3nZWkR8RDpN4w7SYnyvaTaYmXnv4h0zG+RNLrBJKeTannNBB4A7svDyngH6fx5gXTndRsrJrCG1whShZEnSNeHh0jHthIRMZ1U6efHpM/eHNJvapC+PE8inX9Pke5ATszj9gJmSXqR9BncPxe/d7RtXyN9np4i7Z9LWP75WwJ8BNifdM15iuWVmwAOBObmz9rhpIo2xcYENm1vW2s1mayXkDSedGc5sqNpezNJXyF9gMreeZl1SP4TdSmSziRVMjq42ety23HWI0gaLmnXXOy3Felu5I9Vx2XWH0jaWtL7ctHfTqQSgm75/Pkf89ZTrE6qfbc5qSz7UtIfA82s+QaTiuA2IVX//gHp7zNN1/TiuPzj4HTgbxHxcUmbky4wG5LKeQ+MiNfzj2wXk/4I9izwuVyV1szM+qjuKI47mvTjYM2ZpD9H1v6tflgefhjp/y9bkn4kP7MbYjMzswo19U5I0khSe2BnkKoh70uq0vmOiFiq9KemUyPio5Kuz913KjV2+BTQEu0EOGzYsBg9enTT4jcz64vuvffeZyKipeMpm6/ZvwmdQ2qIcnDuH0pq1qL2H4b5LG8pYAS5ampOUIvz9M8UFyhpIjARYNNNN2X69OlN3QAzs75G0hMdT9U9mvln1Y8DiyLi3uLgBpNGiXHLB0RMjohxETGupaVHJHIzM1tJzbwT2hX4RP43+pqkf4GfQ2pja2C+GxrJ8qY45pOaipifi+PWp3F7c2Zm1kc07U4oIk6IiJERMZr0T9tbIuILpIYj98uTHczyaoBTcj95/C3t/R5kZma9XxV/Vj2O1FDpHNJvPrWnrl4ADM3Dv056YJaZmfVh3fJn1dwe3NTc/RjpQWr107xKekiWmZn1E262x8zMKuMkZGZmlXESMjOzyjgJmZlZZfptK9qjj/9T09cxd9LHmr4OM7PezHdCZmZWGSchMzOrjJOQmZlVxknIzMwq4yRkZmaVcRIyM7PKOAmZmVllnITMzKwyTkJmZlYZJyEzM6uMk5CZmVXGScjMzCrjJGRmZpVpWhKStKakeyTdL2mWpNPy8AslPS5pRn6NzcMl6VxJcyTNlLRDs2IzM7OeoZmPcngN2D0iXpQ0CLhD0rV53L9HxOV10+8NjMmvnYGf5XczM+ujmnYnFMmLuXdQfkU7s0wALs7z3QUMkTS8WfGZmVn1mvqbkKQBkmYAi4AbI+LuPOqMXOR2tqQ18rARwLzC7PPzsPplTpQ0XdL01tbWZoZvZmZN1tQkFBHLImIsMBLYSdJ7gBOArYEdgQ2B4/LkarSIBsucHBHjImJcS0tLkyI3M7Pu0C214yLieWAqsFdELMxFbq8B/wXslCebD4wqzDYSWNAd8ZmZWTWaWTuuRdKQ3L0WsCfwcO13HkkCPgk8mGeZAhyUa8ntAiyOiIXNis/MzKrXzNpxw4GLJA0gJbvLIuJqSbdIaiEVv80ADs/TXwPsA8wBXgYObWJsZmbWAzQtCUXETGD7BsN3b2P6AI5oVjxmZtbzuMUEMzOrjJOQmZlVxknIzMwq4yRkZmaVcRIyM7PKOAmZmVllnITMzKwyTkJmZlYZJyEzM6uMk5CZmVXGScjMzCrjJGRmZpVxEjIzs8o4CZmZWWWchMzMrDJOQmZmVhknITMzq4yTkJmZVaZpSUjSmpLukXS/pFmSTsvDN5d0t6RHJf1W0up5+Bq5f04eP7pZsZmZWc/QzDuh14DdI2I7YCywl6RdgDOBsyNiDPAccFie/jDguYjYEjg7T2dmZn1Y05JQJC/m3kH5FcDuwOV5+EXAJ3P3hNxPHr+HJDUrPjMzq15TfxOSNEDSDGARcCPwV+D5iFiaJ5kPjMjdI4B5AHn8YmBog2VOlDRd0vTW1tZmhm9mZk3W1CQUEcsiYiwwEtgJeHejyfJ7o7ueeNuAiMkRMS4ixrW0tHRdsGZm1u26pXZcRDwPTAV2AYZIGphHjQQW5O75wCiAPH594O/dEZ+ZmVWjwyQk6Z2S1sjd4yUdJWlIiflaatNJWgvYE5gN3Arslyc7GLgyd0/J/eTxt0TE2+6EzMys7yhzJ/R7YJmkLYELgM2B35SYbzhwq6SZwDTgxoi4GjgO+LqkOaTffC7I018ADM3Dvw4c36ktMTOzXmdgx5PwZkQslfQp4JyI+JGkv3Q0U0TMBLZvMPwx0u9D9cNfBT5TIh4zM+sjytwJvSHp86SisqvzsEHNC8nMzPqLMknoUOD9wBkR8bikzYH/bm5YZmbWH3RYHBcRD0k6Dtg09z8OTGp2YGZm1veVqR23LzADuC73j5U0pdmBmZlZ31emOO5UUkWC5wEiYgaphpyZmdkqKZOElkbE4rph/v+OmZmtsjJVtB+U9C/AAEljgKOAPzc3LDMz6w/K3AkdCWxLejTDJcALwDHNDMrMzPqHMrXjXga+mV9mZmZdpsMkJOkq3v4b0GJgOnBebunAzMys08oUxz0GvAicn18vAE8D78r9ZmZmK6VMxYTtI2K3Qv9Vkm6PiN0kzWpWYGZm1veVuRNqkbRprSd3D8u9rzclKjMz6xfK3AkdC9wh6a+kp59uDnxV0jrARc0MzszM+rYyteOuyf8P2pqUhB4uVEY4p5nBmZlZ31bmTghgDLAVsCbwPklExMXNC8vMzPqDMlW0TwHGA9sA1wB7A3cATkJmZrZKylRM2A/YA3gqIg4FtgPWaGpUZmbWL5RJQq9ExJvAUknrAYuALTqaSdIoSbdKmi1plqSj8/BTJf1N0oz82qcwzwmS5kh6RNJHV3ajzMysdyjzm9B0SUNIf0y9l/TH1XtKzLcUODYi7pM0GLhX0o153NkR8f3ixJK2AfYntVO3CXCTpHdFxLKS22JmZr1MmdpxX82dP5d0HbBeRMwsMd9CYGHuXiJpNjCinVkmAJdGxGvA45LmkJ5jdGdH6zIzs96pzJNVd83/CQL4AHCIpM06sxJJo4HtgbvzoK9Jminpl5I2yMNGAPMKs82nQdKSNFHSdEnTW1tbOxOGmZn1MGV+E/oZ8LKk7YBvAE/QiZpxktYFfg8cExEv5OW9ExhLulP6QW3SBrO/7eF5ETE5IsZFxLiWlpayYZiZWQ9U9smqQSou+2FE/BAYXGbhkgaREtCvI+IPABHxdEQsy5UdzicVuUG68xlVmH0ksKDcZpiZWW9UJgktkXQCcADwJ0kDgEEdzSRJwAXA7Ig4qzB8eGGyTwEP5u4pwP6S1pC0OekPsmUqQJiZWS9Vpnbc54B/AQ6LiKdyA6bfKzHfrsCBwAOSZuRhJwKflzSWVNQ2F/gyQETMknQZ8BCpZt0RrhlnZta3lUlCS0jFcMskvYvUhtwlHc0UEXfQ+Heea9qZ5wzgjBIxmZlZH1CmOO52YA1JI4CbgUOBC5sZlJmZ9Q9lkpAi4mXgn4EfRcSnSH8oNTMzWyWlkpCk9wNfAP6Uhw1oXkhmZtZflElCxwAnAH/MlQe2AG5tblhmZtYflGm25zbgtlqrCRHxGHBUswMzM7O+r0yzPe+X9BAwO/dvJ+mnTY/MzMz6vDLFcecAHwWeBYiI+4HdmhmUmZn1D2WSEBExr26Q/0RqZmarrMyfVedJ+kcgJK1O+j1odnPDMjOz/qDMndDhwBGkxyrMJ7V+fUQzgzIzs/6hTO24Z0j/ETIzM+tSHSah3KL1kcDo4vQR8YnmhWVmZv1Bmd+EriA9kuEq4M3mhmNmZv1JmST0akSc2/RIzMys3ymThH4o6RTgBuC12sCIuK9pUZmZWb9QJgm9l/Rwut1ZXhwXud/MzGyllUlCnwK2iIjXmx2MdY/Rx/+p44lWwdxJH2vq8s2s7yjzP6H7gSHNDsTMzPqfMkloY+BhSddLmlJ7dTSTpFGSbpU0W9IsSUfn4RtKulHSo/l9gzxcks6VNEfSTEk7rNqmmZlZT1emOO6UlVz2UuDYiLhP0mDgXkk3AocAN0fEJEnHA8cDxwF7A2Pya2fgZ/ndzMz6qLLPE+q0iFgILMzdSyTNJjX9MwEYnye7CJhKSkITgIsjIoC7JA2RNDwvx8zM+qBSrWivKkmjge2Bu4GNa4klv2+UJxsBFFvrnp+H1S9roqTpkqa3trY2M2wzM2uypichSesCvweOiYgX2pu0wbB424CIyRExLiLGtbS0dFWYZmZWgTaTkKSb8/uZK7twSYNICejXEfGHPPhpScPz+OHAojx8PjCqMPtIYMHKrtvMzHq+9u6Ehkv6IPAJSdtL2qH46mjBkkRqc252RJxVGDUFODh3HwxcWRh+UK4ltwuw2L8HmZn1be1VTDiZVHNtJHBW3bgyLSbsSmpp4QFJM/KwE4FJwGWSDgOeBD6Tx10D7APMAV4GDi25DWZm1ku1mYQi4nLgcknfiojvdHbBEXEHjX/nAdijwfSBH5ZnZtavlKmi/R1JnwB2y4OmRsTVzQ3LzMz6gw5rx0n6LnA08FB+HZ2HmZmZrZIyLSZ8DBgbEW8CSLoI+AtwQjMDMzOzvq/s/4SKDZiu34xAzMys/ylzJ/Rd4C+SbiVVNNgN3wWZmVkXKFMx4RJJU4EdSUnouIh4qtmBmZlZ31fmTqjWxluHj28wMzPrjG5pwNTMzKwRJyEzM6tMu0lI0mqSHuyuYMzMrH9pNwnl/wbdL2nTborHzMz6kTIVE4YDsyTdA7xUGxgRn2haVGZm1i+USUKnNT0KMzPrl8r8T+g2SZsBYyLiJklrAwOaH5qZmfV1ZRow/RJwOXBeHjQCuKKZQZmZWf9Qpor2EaQH1L0AEBGPAhs1MygzM+sfyiSh1yLi9VqPpIGkJ6uamZmtkjJJ6DZJJwJrSfow8DvgquaGZWZm/UGZJHQ80Ao8AHwZuAY4qaOZJP1S0qLin10lnSrpb5Jm5Nc+hXEnSJoj6RFJH+38ppiZWW9Tpnbcm/lBdneTiuEeiYgyxXEXAj8GLq4bfnZEfL84QNI2wP7AtsAmwE2S3hURy0qsx8zMeqkyteM+BvwVOJeUVOZI2ruj+SLiduDvJeOYAFwaEa9FxOPAHGCnkvOamVkvVaY47gfAhyJifER8EPgQcPYqrPNrkmbm4roN8rARwLzCNPPzsLeRNFHSdEnTW1tbVyEMMzOrWpkktCgi5hT6HwMWreT6fga8ExgLLCQlOEgPy6vXsMgvIiZHxLiIGNfS0rKSYZiZWU/Q5m9Ckv45d86SdA1wGSkxfAaYtjIri4inC8s/H7g6984HRhUmHQksWJl1mJlZ79FexYR9C91PAx/M3a3ABm+fvGOShuentAJ8CqjVnJsC/EbSWaSKCWOAe1ZmHWZm1nu0mYQi4tBVWbCkS4DxwDBJ84FTgPGSxpLuqOaSqnwTEbMkXQY8BCwFjnDNODOzvq/DKtqSNgeOBEYXp+/oUQ4R8fkGgy9oZ/ozgDM6isfMzPqOMo9yuIKUPK4C3mxuOGZm1p+USUKvRsS5TY/EzMz6nTJJ6IeSTgFuAF6rDYyI+5oWlZmZ9QtlktB7gQOB3VleHBe538zMbKWVSUKfArYoPs7BzMysK5RpMeF+YEizAzEzs/6nzJ3QxsDDkqax4m9C7VbRNjMz60iZJHRK06MwM7N+qczzhG7rjkDMzKz/KdNiwhKWt2i9OjAIeCki1mtmYGZm1veVuRMaXOyX9En8wDkzM+sCZWrHrSAirsD/ETIzsy5Qpjjunwu9qwHjaOOBc2ZmZp1RpnZc8blCS0mPYJjQlGjMzKxfKfOb0Co9V8jMzKwt7T3e++R25ouI+E4T4jEzs36kvTuhlxoMWwc4DBgKOAmZmdkqae/x3j+odUsaDBwNHApcCvygrfnMzMzKareKtqQNJZ0OzCQlrB0i4riIWNTRgiX9UtIiSQ/WLe9GSY/m9w3ycEk6V9IcSTMl7bCK22VmZr1Am0lI0veAacAS4L0RcWpEPNeJZV8I7FU37Hjg5ogYA9yc+wH2Bsbk10TgZ51Yj5mZ9VLt3QkdC2wCnAQskPRCfi2R9EJHC46I24G/1w2eAFyUuy8CPlkYfnEkdwFDJA3vzIaYmVnv095vQp1uTaGEjSNiYV7+Qkkb5eEjgHmF6ebnYQubEIOZmfUQzUg0K0MNhjVslUHSREnTJU1vbW1tclhmZtZM3Z2Enq4Vs+X3WgWH+cCownQjgQWNFhARkyNiXESMa2lpaWqwZmbWXN2dhKYAB+fug4ErC8MPyrXkdgEW14rtzMys7yrTdtxKkXQJMB4YJmk+6Qmtk4DLJB0GPAl8Jk9+DbAPMAd4mfR/JDMz6+OaloQi4vNtjNqjwbQBHNGsWMzMrGfqKRUTzMysH3ISMjOzyjgJmZlZZZyEzMysMk5CZmZWGSchMzOrjJOQmZlVxknIzMwq07Q/q5r1NKOP/1NTlz930seaunyzvsh3QmZmVhknITMzq4yTkJmZVcZJyMzMKuMkZGZmlXESMjOzyjgJmZlZZZyEzMysMk5CZmZWGSchMzOrTCXN9kiaCywBlgFLI2KcpA2B3wKjgbnAZyPiuSriMzOz7lHlndCHImJsRIzL/ccDN0fEGODm3G9mZn1YTyqOmwBclLsvAj5ZYSxmZtYNqkpCAdwg6V5JE/OwjSNiIUB+36jRjJImSpouaXpra2s3hWtmZs1Q1aMcdo2IBZI2Am6U9HDZGSNiMjAZYNy4cdGsAM3MrPkquROKiAX5fRHwR2An4GlJwwHy+6IqYjMzs+7T7UlI0jqSBte6gY8ADwJTgIPzZAcDV3Z3bGZm1r2qKI7bGPijpNr6fxMR10maBlwm6TDgSeAzFcRmZmbdqNuTUEQ8BmzXYPizwB7dHY+ZmVWnJ1XRNjOzfsZJyMzMKuMkZGZmlXESMjOzyjgJmZlZZZyEzMysMk5CZma5LiLoAAAKAklEQVRWGSchMzOrjJOQmZlVxknIzMwq4yRkZmaVqep5QtZPjT7+T01d/txJH2vq8nujZu9z8H63lec7ITMzq4zvhMysT/IdYO/gJGTWDXxBNGvMxXFmZlYZJyEzM6uMk5CZmVWmxyUhSXtJekTSHEnHVx2PmZk1T4+qmCBpAPAT4MPAfGCapCkR8VC1kXUt/0ht/YXPdetIj0pCwE7AnIh4DEDSpcAEoE8lITPr25x8y1NEVB3DWyTtB+wVEV/M/QcCO0fE1wrTTAQm5t6tgEc6sYphwDNdFG5P4O3p2frS9vSlbQFvz2YR0dKsYDqjp90JqcGwFbJkREwGJq/UwqXpETFuZebtibw9PVtf2p6+tC3g7elJelrFhPnAqEL/SGBBRbGYmVmT9bQkNA0YI2lzSasD+wNTKo7JzMyapEcVx0XEUklfA64HBgC/jIhZXbiKlSrG68G8PT1bX9qevrQt4O3pMXpUxQQzM+tfelpxnJmZ9SNOQmZmVpk+mYQ6avpH0hqSfpvH3y1pdPdHWV6J7TlEUqukGfn1xSriLEPSLyUtkvRgG+Ml6dy8rTMl7dDdMXZGie0ZL2lx4dic3N0xliVplKRbJc2WNEvS0Q2m6TXHp+T29Kbjs6akeyTdn7fntAbT9KprGwAR0adepAoNfwW2AFYH7ge2qZvmq8DPc/f+wG+rjnsVt+cQ4MdVx1pye3YDdgAebGP8PsC1pP+M7QLcXXXMq7g944Grq46z5LYMB3bI3YOB/2twrvWa41Nye3rT8RGwbu4eBNwN7FI3Ta+5ttVeffFO6K2mfyLidaDW9E/RBOCi3H05sIekRn+U7QnKbE+vERG3A39vZ5IJwMWR3AUMkTS8e6LrvBLb02tExMKIuC93LwFmAyPqJus1x6fk9vQaeZ+/mHsH5Vd9zbLedG0D+mZx3AhgXqF/Pm8/8d6aJiKWAouBod0SXeeV2R6AT+fikcsljWowvrcou729yftzEcq1kratOpgycjHO9qRv20W98vi0sz3Qi46PpAGSZgCLgBsjos3j0wuubUDfTEIdNv1TcpqeokysVwGjI+J9wE0s/ybUG/WmY1PGfaR2urYDfgRcUXE8HZK0LvB74JiIeKF+dINZevTx6WB7etXxiYhlETGW1JrMTpLeUzdJrzs+fTEJlWn6561pJA0E1qfnFql0uD0R8WxEvJZ7zwf+oZtia4Y+1XRTRLxQK0KJiGuAQZKGVRxWmyQNIl2wfx0Rf2gwSa86Ph1tT287PjUR8TwwFdirblRvurYBfTMJlWn6ZwpwcO7eD7gl8i95PVCH21NXJv8JUtl3bzUFOCjXwtoFWBwRC6sOamVJeketTF7STqTP3LPVRtVYjvMCYHZEnNXGZL3m+JTZnl52fFokDcndawF7Ag/XTdabrm1AD2u2pytEG03/SPo2MD0ippBOzF9JmkP6lrB/dRG3r+T2HCXpE8BS0vYcUlnAHZB0CalG0jBJ84FTSD+wEhE/B64h1cCaA7wMHFpNpOWU2J79gK9IWgq8Auzfgy8KuwIHAg/k3x0ATgQ2hV55fMpsT286PsOBi5Qe/rkacFlEXN1br201brbHzMwq0xeL48zMrJdwEjIzs8o4CZmZWWWchMzMrDJOQmZmVhknIes0Sctyi8MPSvqdpLUriuOYqtbdWZIulLRfk9dxYl3/n5u5vpUlaW5v+EOodQ8nIVsZr0TE2Ih4D/A6cHjZGfN/HLrKMUCvSELdZIUkFBH/WFUgbeni4299gJOQrar/AbYEkHRAft7JDEnn1S44kl6U9G1Jd5Mai9xR0p9zo5H3SBqcG2b8nqRpuSHWL+d5x0uamhtmfVjSr/O/9Y8CNgFulXRrnvZnkqar7lkrkvbJ896h9Cycq/PwdZSeBzRN0l8kNWydXNK/F+I6LQ/bMfevmZczq9aOl6RvSHogb9+kBss7OS/vQUmTC//YnyrpbEm3Kz0DZ0dJf5D0qKTTC/NfIenevM6JedgkYK28739d2+/5XXnfPpjj+lx7+7ZBvCsdV6PjXxi+lqTrJH2prZPL+oGqnyXhV+97AS/m94HAlcBXgHeTGlIdlMf9FDgodwfw2dy9OvAYsGPuXy8vZyJwUh62BjAd2JzUGsFiUhtlqwF3Ah/I080FhhXi2jC/DyC1q/U+YE1Sq8Kb53GXkJ8fA/wHcEDuHkJ63sw6ddv6EWAyqWHI1YCrgd3yuNOB7wM/AU7Iw/YG/gysXRfThcB+xWG5+1fAvrl7KnBm7j6a1Cbb8Lw/5gND65a5FvBgYfiLbRynTwM35v2yMfBkXm6b+7ZuOasa11vHv3DcRpMa2z2o6vPZr2pfvhOylbGWUjMo00kXtAuAPUgNp07L4/YgPYgPYBmpEUmArYCFETEN3mpAcinpYn9QnvduUvPzY/I890TE/Ih4E5hBuoA18llJ9wF/AbYFtgG2Bh6LiMfzNJcUpv8IcHxe51RSwtq0bpkfya+/kFpc3roQ17eBDwPjgP/Mw/YE/isiXs7b16jxyA8pPfXyAWD3HGtNrV3AB4BZkZ6J8xopcdcaDj1K0v3AXXnYGNr3AeCSSC0wPw3cBuyYx5Xdt6sSV/H411xJ2k8XdxC79XF9ru046xavRGpO/i25GOeiiDihwfSvRsSy2qQ0blpewJERcX3dcscDrxUGLaPBeStpc+DfSHdYz0m6kJRU2nugl4BPR8QjHUzz3Yg4r8G4DYF1SW3FrQm8RNvbV4tzTdJd4riImCfp1DxvTW1b32TF7X4TGJj3x57A+yPiZUlT6+Zvaxva0uG+7YK4ise/5n+BvSX9JiLcdlg/5jsh6yo3A/tJ2ghA0oaSNmsw3cPAJpJ2zNMNVmpy/npSQ5KD8vB3SVqng3UuIT22GVKx3kvAYkkbk4rFauvbQumhZgCfK8x/PXBk4TeZ7Rus43rgX5WeSYOkEbVtJBXTfQv4NXBmHnZDnn7t2n6oW17twvxMXmZna8ytDzyXL/Rbkx6xXfNGbf/VuR34nNLvbi2kR5Lf08n1rkpcjZxMaq36p10ch/UyvhOyLhERD0k6CbhB0mrAG8ARwBN1072efxj/kVJz9K+QvkH/glQUdF9OCq3AJztY7WTgWkkLI+JDkv4CzCIVEf1vXt8rkr4KXCfpGVa8+H4HOAeYmdc5F/h4Xbw3SHo3cGfOVS8CB0jaC1gaEb9RqoDxZ0m7R8R1ksYC0yW9Tmp1+sTC8p6XdD6pWGsu6VEdnXEdcLikmcAjpKKv4v6YKem+iPhCYfgfSRUC7ifdpX0jIp7KyaKrtBdXW44BfinpPyPiG10Yi/UibkXb+jxJ60bEiznR/AR4NCLOrjouM3NxnPUPX8qVD2aRio0a/b5jZhXwnZCZmVXGd0JmZlYZJyEzM6uMk5CZmVXGScjMzCrjJGRmZpX5/7ORHUvaf9CBAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36ab6f470>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 1]['percentage exclamation mark'], bins=10, range=(0, 3), rwidth=0.8)\n",
    "plt.xlabel('Percentage exclamation mark')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage exclamation mark of spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAbUAAAEWCAYAAADhIgmdAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xm4HFWd//H3JwuyE5YLhiwkSFxAx8CE7aeDEZDNJaigOCqBQSOKCyOOLMMIsow4LiBuGAQBFyKiQkT2JTCIQAKEJQSGCIHEBBJICITVhO/vj3M6qTR9+9a9uX3v7b6f1/P001WnTlWdU1Vd31pOVykiMDMzawUDersAZmZm3cVBzczMWoaDmpmZtQwHNTMzaxkOamZm1jIc1MzMrGU0JKhJOkfSf3XTtEZKWi5pYO6fJukz3THtPL2rJE3srul1Yr6nSXpa0pM9PW+rTdIFkk7r7XJA722Xa0vSYZJu7aZpfV7SU/n3v3l3TNNa36DOjiBpLrAVsAJYCTwIXARMjojXACLiyE5M6zMRcX17eSLiCWDDzpaznfmdDGwXEZ8qTH//7ph2J8sxAjgG2CYiFvX0/LuLpGnAryLi571dlmbWV7bLvkTSYOD7wG4RcW9vl8eaR1fP1D4YERsB2wBnAMcC53VbqTJJnQ66TWIb4JmeCGgtvAytj+nmbW0rYF1gVjdO0/qDiOjUB5gL7F2VtgvwGvD23H8BcFru3gK4AngWWAL8LymY/jKP8xKwHPg6MAoI4AjgCeCWQtqgPL1pwLeAO4FlwOXAZnnYeGB+rfIC+wGvAv/I87u3ML3P5O4BwInA48Ai0hnoJnlYpRwTc9meBv6zznLaJI+/OE/vxDz9vXOdX8vluKDGuOOB+cAJeT5zgU8Whr8B+G4ux1PAOcB6VeMeCzwJ/DKnTwBmAs8BfwP2K5TzPGAh8HfgNGBgHnYYcGue11LgMWD/POx00pn6y7keP8rpPwDm5fncBfxLodzrARfmac3O63x+YfjWwO/zMnsM+HKd5VtvGRwL3M7qbebzpJ3jurn/3cBtpG1yHnBYje12U9J2uziX9wpgeGH+0/Kyui3X/0/A5sCvc92nA6MK+WsuF3p+u7wA+AlwVZ7fX4A3Amflej4E7FjIfxxpe3medFXmw4Vhh+XxzyT9tk/LabcW8nyHtA1t0s46PAtYkD9n5bQ3Ay/kei0Hbqwxbt16tzftqt/IMXl5LgQOr7PMau7DCvuX4/OyWQr8gtXbWbduQ+3U/3DSdrUUOBLYGbgvl/VHVeP8G+l3txS4hnSlCEB5HS4i7VPvY/W+/IBct+dJ+4evlazbaNL++3ngeuDHpKs6leG7sfo3eC8wvmq7ejSP+xiFfV+pGNUdQS2nPwF8vsbO4VukHc7g/PkXQLWmVVhRFwEbkHaClbRiUPs78Pac5/eVhUWdoJa7Ty4u2Bo7j38D5gDbki55/oHVQaFSjnNzud4JvAK8rZ3ldBEp4G6Ux/0/4Ij2ylk17njS5d3vk36c7yH9yN+Sh58FTAU2y9P/E/CtqnG/ncddj3TQsQx4H2kHOQx4a85/GfCzvCy3JB0sfK6wcf0D+CwwkBQcFhTW36plVyj7p0g/zEGkncaTrP6RnwHcTPpBDCf9eOYXdtx3Ad8A1snr4FFg33aWUb1lMID0gzoZGEP60e2Yh40k/Vg+QdoeNwfG1thuNwc+Cqyfp/874LKq7WYO8CbSgcGDeR3vnet+EfCLksvlZHpuu7yAFAD+mXQmdCNpx3FoXsenATcV8h9MOtgYAHyctB0OLWwfK4Av5Xqtx+oDoQG5TNcA67dTllNIBx9bAm2kndypVfUa1MFOvWa9O5j2+FzuU/I2cADwIrBpO/PqaB/2ADCCtC3+hQZtQ+3U/5y8HvchHWBelus8jBSk3pPzH5jn9bY87ROB2/KwfUm/vSGkAPe2wjpeyOoDsE2BnUrW7a+kg851SAeRz7F6Pz0MeCYv9wGk/dIzeT1tkPNW9nVDgR06FaM6k7lWICqk304+UmLNncMppJ37dh1Nq7Citq2RVgxqZxSGb0860h3I2ge1G4AvFIa9hbRTH1QoR/Fo5E7gkBr1Gkj6gW1fSPscMK3woyoT1DYopF0C/Ffe6F4A3lQYtjvwWGHcV8k7zJz2M+DMGvPZKpdzvULaJ8g7NdIOak5h2Pp5GbyxetnVqctS4J25e40gBXyG1UFtV+CJqnGPp8aPuqNlUNhulpCOTI+vmuYf2ynrBeTttsawscDSqu2meGbwPeCqQv8HgZkll0uPbJeFOp5b6P8SMLvQ/w7g2TrlnglMKGwf1evsMOAO4LekA8516kzrb8ABhf59gbmF9VcmqNWsdwfTHk+6WjKoMHwR6f5drXl1tA87stB/APC3Rm9DhfoPK6Q9A3y80P974OjcfRX5oDr3DyAF8m2APUnBdDfyGWgh3xOkfdfG7a3H6rqRDhxXUDiYAX7F6qB2LPmgrDD8GtJZ9waks7ePUtgvdebTna0fh5F2ItW+QzpCuFbSo5KOKzGteZ0Y/jjp6GmLUqWsb+s8veK0B5F2/hXF1oovUrsRyxakI5TqaQ3rRFmWRsQLVeNvTTqaWR+4S9Kzkp4Frs7pFYsj4uVC/wjSj7zaNqRlt7AwrZ+RjvQqVtU3Il7Mne023JF0jKTZkpbl6W3C6nWzNWuuu2L3NsDWlXLkcU9gzWVf0eEyiIi5wE2kH/+PC+O2tyyq67G+pJ9JelzSc6QzvyGVVrjZU4Xul2r0r1pOHSyXjnTXdtmVch8qaWZhOb+9qty1fqvbkS53fzMiXq1Tjlr12rpO/lraq3dH034mIlZUj1tobb1c0vI8rKN9WPX+aGvo/m2oHWXH3wb4QWE9LiEdHA6LiBuBH5F+J09Jmixp4zzeR0mB+nFJN0vavUTdtgaWFPYX1ctoG+Dgqt/6u0lnhy+QrggcSdov/VnSWztYBmvolqAmaWfSDvt1TXkj4vmIOCYitiUdeXxV0l6Vwe1Msr30ihGF7pGko9anSUfv6xfKNZA1d/YdTXcBaYEXp72CNTeUMp7OZaqe1t87MY1NJW1QNf6CPO2XSKfkQ/Jnk4gobvzV9ZxHusRRbR7pTG2LwrQ2jogdSpZxjflI+hfSUdjHSJdyhpAueypnWUi67FhRXI/zSGdaQwqfjSLigBrz7XAZSDqAdPZ2A2mnVJxPrWVR7RjSGdGuEbExsEdl0iXGXUOJ5dJT22WnSNqGdHnvi8DmudwPsOYyqFX22aR7PVdJekudWdSq14K1KvRaTjsinoiIDSufnFZvHwav3x9V5tNt21A3mEe6rVD8fa0XEbcBRMTZEfHPwA6ke5r/kdOnR8QE0oHuZaQrRlC/bguBzSSt2hfz+t/6L6vKskFEnJHneU1EvI906fEh0jZY2loFNUkbS/oAMIV0anl/jTwfkLSdJJGula7MH0g/ym27MOtPSdo+L7RTgEsjYiXpFHpdSe/PTYJPJN1XqngKGCWpvXpfDPy7pNGSNgT+G/ht1RFdh3JZLgFOl7RR3jl8lXQK3hnflLRO3il+APhdpL9NnAucKWlLAEnDJO1bZzrnAYdL2kvSgJz/rRGxELgW+F5elwMkvUnSe0qWr3r9bUTa2S4GBkn6BrBxYfglwPGSNpU0jLSzrLgTeE7SsZLWkzRQ0tvzAdMaOloGkrbIdf4M6ZLGB3OQg3QTfm9JH5M0SNLmksbWqNtGpMD5rKTNgJNKLpNaOlouPbJddsEGpKC1GEDS4aQztQ5FxMWkM+3rJbV3EHExcKKktrzOvkHnfyPt6bZpd7APAzhK0vC8nZxAuvQK3bsNra1zSL+9HQAkbSLp4Ny9s6Rd8z7zBdK9uZV53/NJSZtExD9YXXeoU7eIeByYAZycp7E76WCg4lek3+S++Xe+rqTxeRluJelD+YD+FVIDmuKy7lBXg9qfJD1Pirj/SWrQcHg7eceQWr8sJ908/ElETMvDvkXa8J6V9LVOzP+XpHsDT5Jukn4ZICKWAV8Afk46K3qB1Mqp4nf5+xlJd9eY7vl52reQbp6/TLrn0BVfyvN/lHQG+5s8/bKeJN13WUDaER8ZEQ/lYceSLofcnk/9rycdNdUUEXeS1s+ZpDOEm1l9FHso6VJppfXWpaQjpDJ+ABwkaamks0nXxa8iHVw8Tlp+xcsOp5DWx2O5zJeSNtzKgcAHSdfmHyOdjf2cdJmulnrLYDJweURcGRHPkFrT/lzS5pH+93gA6UhzCeke0TtrTP8sUgOEp0n3i68uuUxq6Wi59OR2WVpEPEi6z/NXUuB9B6khRNnxLySt8xsljaqR5TTSzu8+4H7g7pzWHbpz2vX2YZB+29eSfuuPFubTndvQWomIP5Iaj03Jv5cHgMp/ITcmHSQuJW2fz5AaeQB8GpibxzmS1OAJOq7bJ0lXSp4hLY/fsvq3Po90efoE0gHTPNKZ4YD8OYa031tCaiT3BUhXPLT6knC7Ki14rA+RNJ505ju8o7zNTNLnSTf2y54ZmvUpKvEACQNJvwUeioiGn6362Y/WYyQNlfSufJnzLaQjsj/2drnMrHvlS5pvyr/1/UhnZpf1xLz9tAnrSeuQWleOJjXbnUL6I7CZtZY3kv5PuTnplsPnI+KenpixLz+amVnL8OVHMzNrGS15+XGLLbaIUaNG9XYxzMyayl133fV0RLR1nLPvasmgNmrUKGbMmNHbxTAzayqSHu84V9/my49mZtYyHNTMzKxlOKiZmVnLcFAzM7OW4aBmZmYtw0HNzMxahoOamZm1DAc1MzNrGQ5qZmbWMlryiSJra9Rxf274POae8f6Gz8PMrL/xmZqZmbUMBzUzM2sZDmpmZtYyHNTMzKxlOKiZmVnLcFAzM7OW4aBmZmYtw0HNzMxaRsODmqSBku6RdEXuHy3pDkmPSPqtpHVy+hty/5w8fFRhGsfn9Icl7dvoMpuZWXPqiTO1rwCzC/3fBs6MiDHAUuCInH4EsDQitgPOzPmQtD1wCLADsB/wE0kDe6DcZmbWZBoa1CQNB94P/Dz3C9gTuDRnuRA4MHdPyP3k4Xvl/BOAKRHxSkQ8BswBdmlkuc3MrDk1+kztLODrwGu5f3Pg2YhYkfvnA8Ny9zBgHkAeviznX5VeYxwzM7NVGhbUJH0AWBQRdxWTa2SNDobVG6c4v0mSZkiasXjx4k6X18zMml8jz9TeBXxI0lxgCumy41nAEEmVtwMMBxbk7vnACIA8fBNgSTG9xjirRMTkiBgXEePa2tq6vzZmZtbnNSyoRcTxETE8IkaRGnrcGBGfBG4CDsrZJgKX5+6puZ88/MaIiJx+SG4dORoYA9zZqHKbmVnz6o33qR0LTJF0GnAPcF5OPw/4paQ5pDO0QwAiYpakS4AHgRXAURGxsueLbWZmfV2PBLWImAZMy92PUqP1YkS8DBzczvinA6c3roRmZtYK/EQRMzNrGQ5qZmbWMhzUzMysZTiomZlZy3BQMzOzluGgZmZmLcNBzczMWoaDmpmZtQwHNTMzaxkOamZm1jIc1MzMrGU4qJmZWctwUDMzs5bhoGZmZi3DQc3MzFqGg5qZmbWMhgU1SetKulPSvZJmSfpmTr9A0mOSZubP2JwuSWdLmiPpPkk7FaY1UdIj+TOxUWU2M7Pm1sg3X78C7BkRyyUNBm6VdFUe9h8RcWlV/v2BMfmzK/BTYFdJmwEnAeOAAO6SNDUiljaw7GZm1oQadqYWyfLcOzh/os4oE4CL8ni3A0MkDQX2Ba6LiCU5kF0H7NeocpuZWfNq6D01SQMlzQQWkQLTHXnQ6fkS45mS3pDThgHzCqPPz2ntpVfPa5KkGZJmLF68uNvrYmZmfV9Dg1pErIyIscBwYBdJbweOB94K7AxsBhybs6vWJOqkV89rckSMi4hxbW1t3VJ+MzNrLj3S+jEingWmAftFxMJ8ifEV4BfALjnbfGBEYbThwII66WZmZmtoZOvHNklDcvd6wN7AQ/k+GZIEHAg8kEeZChyaW0HuBiyLiIXANcA+kjaVtCmwT04zMzNbQyNbPw4FLpQ0kBQ8L4mIKyTdKKmNdFlxJnBkzn8lcAAwB3gROBwgIpZIOhWYnvOdEhFLGlhuMzNrUg0LahFxH7BjjfQ928kfwFHtDDsfOL9bC2hmZi3HTxQxM7OW4aBmZmYtw0HNzMxahoOamZm1jA6DmqQ3VZ76IWm8pC9XmuqbmZn1JWXO1H4PrJS0HXAeMBr4TUNLZWZm1gVlgtprEbEC+DBwVkT8O+k/aGZmZn1KmaD2D0mfACYCV+S0wY0rkpmZWdeUCWqHA7sDp0fEY5JGA79qbLHMzMw6r8MnikTEg5KOBUbm/seAMxpdMDMzs84q0/rxg6RnNF6d+8dKmtrogpmZmXVWmcuPJ5NeD/MsQETMJLWANDMz61PKBLUVEbGsKu11L+k0MzPrbWWe0v+ApH8FBkoaA3wZuK2xxTIzM+u8MmdqXwJ2AF4BLgaeA45uZKHMzMy6osOgFhEvRsR/RsTOETEud7/c0XiS1pV0p6R7Jc2S9M2cPlrSHZIekfRbSevk9Dfk/jl5+KjCtI7P6Q9L2rfr1TUzs1bW4eVHSX/i9ffQlgEzgJ/VCXCvAHtGxHJJg4FbJV0FfBU4MyKmSDoHOAL4af5eGhHbSToE+DbwcUnbA4eQzha3Bq6X9OaIWNnp2pqZWUsrc/nxUWA5cG7+PAc8Bbw599cUyfLcOzh/AtgTuDSnXwgcmLsn5H7y8L0kKadPiYhX8n/k5pBaY5qZma2hTEORHSNij0L/nyTdEhF7SJpVb0RJA4G7gO2AHwN/A57Nz5IEmA8My93DgHkAEbFC0jJg85x+e2GyxXGK85oETAIYOXJkiWqZmVmrKXOm1iZpVZTI3Vvk3lfrjRgRKyNiLDCcdHb1tlrZKpNuZ1h76dXzmpzv+Y1ra2urVywzM2tRZc7UjiHdD/sbKcCMBr4gaQNWXy6sKyKelTQN2A0YImlQPlsbDizI2eYDI4D5kgYBmwBLCukVxXHMzMxWKdP68UpgDKkZ/9HAWyLizxHxQkSc1d54ktoqLxOVtB6wNzAbuAk4KGebCFyeu6fmfvLwGyMicvohuXXk6FyWOztXTTMz6w/KnKlBCiRvAdYF/kkSEXFRB+MMBS7M99UGAJdExBWSHgSmSDoNuIf04lHy9y8lzSGdoR0CEBGzJF0CPAisAI5yy0czM6ulTJP+k4DxwPbAlcD+wK1A3aAWEfcBO9ZIf5QarRfzXwMObmdapwOnd1RWMzPr38o0FDkI2At4MiIOB94JvKGhpTIzM+uCMkHtpYh4DVghaWNgEbBtY4tlZmbWeWXuqc3IDT7OJf3nbDluqGFmZn1QmTdffyF3niPpamDjfL/MzMysTynz5ut35f+kAbwbOEzSNo0tlpmZWeeVuaf2U+BFSe8Evg48TgctH83MzHpD2TdfB+nBwj+IiB8AGzW2WGZmZp1XpqHI85KOBz4F7JH/TD24scUyMzPrvDJnah8nvRvtiIh4kvSE/O80tFRmZmZdUOpMjXTZcaWkNwNvBS5ubLHMzMw6r8yZ2i3AGyQNA24ADgcuaGShzMzMuqJMUFNEvAh8BPhhRHwY2KGxxTIzM+u8UkFN0u7AJ4E/57SBjSuSmZlZ15QJakcDxwN/zK+B2Zb0TjQzM7M+pcxjsm4Gbq48VSS/OubLjS6YmZlZZ5V5TNbu+cWes3P/OyX9pMR4IyTdJGm2pFmSvpLTT5b0d0kz8+eAwjjHS5oj6WFJ+xbS98tpcyQd16WamplZyyvTpP8sYF9gKkBE3CtpjxLjrQCOiYi7JW0E3CXpujzszIj4bjGzpO1Jb7veAdgauD7/hQDgx8D7gPnAdElTI+LBEmUwM7N+pExQIyLmSSomrSwxzkJgYe5+XtJs0h+32zMBmBIRrwCPSZrD6jdkz8mXPZE0Jed1UDMzszWUaSgyT9L/A0LSOpK+Rr4UWZakUcCOwB056YuS7pN0vqRNc9owYF5htPk5rb306nlMkjRD0ozFixd3pnhmZtYiygS1I4GjSIFkPjA295ciaUPg98DREfEc6an/b8rTWQh8r5K1xuhRJ33NhIjJETEuIsa1tbWVLZ6ZmbWQMq0fnyb9R63TJA0mBbRfR8Qf8vSeKgw/F7gi984HRhRGHw4syN3tpZuZma3SYVCTNBr4EjCqmD8iPtTBeALOA2ZHxPcL6UPz/TaADwMP5O6pwG8kfZ/UUGQMcCfpTG1MLsffSY1J/rVM5czMrH8p01DkMlJw+hPwWiem/S7g08D9kmbmtBOAT0gaS7qEOBf4HED+Y/clpAYgK4CjImIlgKQvAteQnmRyfkTM6kQ5zMysnygT1F6OiLM7O+GIuJXa98OurDPO6cDpNdKvrDeemZkZlAtqP5B0EnAt6b1qAETE3Q0rlZmZWReUCWrvIF1G3JPVlx8j95uZmfUZZYLah4FtI+LVRhfGzMxsbZT5n9q9wJBGF8TMzGxtlTlT2wp4SNJ01rynVrdJv5mZWU8rE9ROangpzMzMukHZ96mZmZn1eWXuqZmZmTUFBzUzM2sZ7QY1STfk72/3XHHMzMy6rt49taGS3gN8KL+Yc41HXvmJImZm1tfUC2rfAI4jverl+1XD/EQRMzPrc9oNahFxKXCppP+KiFN7sExmZmZdUqZJ/6mSPgTskZOmRcQV9cYxMzPrDR22fpT0LeArpPecPQh8JaeZmZn1KWWeKPJ+YGxEvAYg6ULgHuD4RhbMzMyss8r+T634QONNyowgaYSkmyTNljRL0ldy+maSrpP0SP7eNKdL0tmS5ki6T9JOhWlNzPkfkTSxbOXMzKx/KRPUvgXcI+mCfJZ2F/DfJcZbARwTEW8DdgOOkrQ9qUXlDRExBrgh9wPsD4zJn0nATyEFQdLzJ3cFdgFOqgRCMzOzog6DWkRcTApKf8if3SNiSonxFlb+yxYRzwOzgWHABODCnO1C4MDcPQG4KJLbgSGShgL7AtdFxJKIWApcB+zXiTqamVk/UeaeGhGxEJja1ZlIGgXsCNwBbJWnR0QslLRlzjYMmFcYbX5Oay+9eh6TSGd4jBw5sqtFNTOzJtbwZz9K2hD4PXB0RDxXL2uNtKiTvmZCxOSIGBcR49ra2rpWWDMza2oNDWqSBpMC2q8j4g85+al8WZH8vSinzwdGFEYfDiyok25mZraGukFN0gBJD3RlwpIEnAfMjojiY7amApUWjBOBywvph+ZWkLsBy/JlymuAfSRtmhuI7JPTzMzM1lD3nlpEvCbpXkkjI+KJTk77XcCngfslzcxpJwBnAJdIOgJ4Ajg4D7sSOACYA7wIHJ7LsETSqcD0nO+UiFjSybKYmVk/UKahyFBglqQ7gRcqiRHxoXojRcSt1L4fBrBXjfwBHNXOtM4Hzi9RVjMz68fKBLVvNrwUZmZm3aDMA41vlrQNMCYirpe0PjCw8UUzMzPrnDIPNP4scCnws5w0DLiskYUyMzPrijJN+o8iNfp4DiAiHgG2rDuGmZlZLygT1F6JiFcrPZIGUePPz2ZmZr2tTFC7WdIJwHqS3gf8DvhTY4tlZmbWeWWC2nHAYuB+4HOk/5Od2MhCmZmZdUWZ1o+v5VfO3EG67Phw/k+ZmZlZn9JhUJP0fuAc4G+kP1OPlvS5iLiq0YUzMzPrjDJ/vv4e8N6ImAMg6U3AnwEHNTMz61PK3FNbVAlo2aOsfrK+mZlZn9HumZqkj+TOWZKuBC4h3VM7mNUPFzYzM+sz6l1+/GCh+yngPbl7MbBpw0pkZmbWRe0GtYg4vCcLYmZmtrbKtH4cDXwJGFXM39GrZ8zMzHpamYYilwFzgR+SWkJWPnVJOl/SouKbsyWdLOnvkmbmzwGFYcdLmiPpYUn7FtL3y2lzJB3XibqZmVk/U6ZJ/8sRcXYXpn0B8CPgoqr0MyPiu8UESdsDhwA7AFsD10t6cx78Y+B9wHxguqSpEfFgF8pjZmYtrkxQ+4Gkk4BrgVcqiRFxd72RIuIWSaNKlmMCMCUiXgEekzQH2CUPmxMRjwJImpLzOqiZmdnrlAlq7wA+DewJvJbTIvd3xRclHQrMAI6JiKWkd7TdXsgzP6cBzKtK37XWRCVNAiYBjBw5sotFMzOzZlbmntqHgW0j4j0R8d786WpA+ynwJmAssJDV9+ZUI2/USX99YsTkiBgXEePa2tq6WDwzM2tmZYLavcCQ7phZRDwVESsj4jXgXFZfYpwPjChkHQ4sqJNuZmb2OmUuP24FPCRpOmveU+t0k35JQyNiYe79MFBpGTkV+I2k75MaiowB7iSdqY3Jfyv4O6kxyb92dr5mZtY/lAlqJ3VlwpIuBsYDW0ian6czXtJY0iXEuaT3sxERsyRdQmoAsgI4KiJW5ul8EbgGGAicHxGzulIeMzNrfWXep3ZzVyYcEZ+okXxenfynA6fXSL+S9GJSMzOzuso8UeR5VjfOWAcYDLwQERs3smBmZmadVeZMbaNiv6QDWd3Aw8zMrM8o0/pxDRFxGV3/j5qZmVnDlLn8+JFC7wBgHO38V8zMzKw3lWn9WHyv2gpSq8UJDSmNmZnZWihzT83vVTMzs6bQblCT9I0640VEnNqA8piZmXVZvTO1F2qkbQAcAWwOOKiZmVmf0m5Qi4hVLwKVtBHwFeBwYAolXhJqZmbW0+reU5O0GfBV4JPAhcBO+VUxZmZmfU69e2rfAT4CTAbeERHLe6xUZmZmXVDvz9fHkJ6YfyKwQNJz+fO8pOd6pnhmZmbl1bun1umnjZiZmfUmBy4zM2sZDmpmZtYyGhbUJJ0vaZGkBwppm0m6TtIj+XvTnC5JZ0uaI+k+STsVxpmY8z8iaWKjymtmZs2vkWdqFwD7VaUdB9wQEWOAG3I/wP7AmPyZBPwUVv2l4CRgV9Lrbk6qBEIzM7NqDQtqEXELsKQqeQLp/27k7wML6RdFcjswRNJQYF/guohYkv8fdx2vD5RmZmZAz99T2yoiFgLk7y1z+jBgXiHf/JzWXvrrSJokaYakGYsXL+72gpuZWd/XVxqKqEZa1El/fWLE5IgYFxHj2traurVwZmbWHHo6qD2VLyuSvxfl9PnAiEK+4cCCOulmZmav09NBbSqKulMwAAAMaklEQVRQacE4Ebi8kH5obgW5G7AsX568BthH0qa5gcg+Oc3MzOx1yrz5ukskXQyMB7aQNJ/UivEM4BJJRwBPAAfn7FcCBwBzgBdJbwMgIpZIOhWYnvOdEhHVjU/MzMyABga1iPhEO4P2qpE3gKPamc75wPndWDQzM2tRfaWhiJmZ2VpzUDMzs5bhoGZmZi3DQc3MzFqGg5qZmbUMBzUzM2sZDmpmZtYyHNTMzKxlOKiZmVnLcFAzM7OW4aBmZmYtw0HNzMxahoOamZm1DAc1MzNrGQ5qZmbWMnolqEmaK+l+STMlzchpm0m6TtIj+XvTnC5JZ0uaI+k+STv1RpnNzKzv680ztfdGxNiIGJf7jwNuiIgxwA25H2B/YEz+TAJ+2uMlNTOzptCXLj9OAC7M3RcCBxbSL4rkdmCIpKG9UUAzM+vbeiuoBXCtpLskTcppW0XEQoD8vWVOHwbMK4w7P6eZmZmtYVAvzfddEbFA0pbAdZIeqpNXNdLidZlScJwEMHLkyO4ppZmZNZVeOVOLiAX5exHwR2AX4KnKZcX8vShnnw+MKIw+HFhQY5qTI2JcRIxra2trZPHNzKyP6vGgJmkDSRtVuoF9gAeAqcDEnG0icHnungocmltB7gYsq1ymNDMzK+qNy49bAX+UVJn/byLiaknTgUskHQE8ARyc818JHADMAV4EDu/5IpuZWTPo8aAWEY8C76yR/gywV430AI7qgaKZmVmT60tN+s3MzNaKg5qZmbUMBzUzM2sZDmpmZtYyHNTMzKxlOKiZmVnLcFAzM7OW4aBmZmYtw0HNzMxahoOamZm1DAc1MzNrGQ5qZmbWMhzUzMysZfTWm6+tDxp13J8bPo+5Z7y/4fMws/7LZ2pmZtYyfKZm/Z7PUM1aR9MENUn7AT8ABgI/j4gzerlI1o36a2Dpr/U2a5SmCGqSBgI/Bt4HzAemS5oaEQ/2bsnMmldvBtT+Gsz7a717UlMENWAXYE5EPAogaQowAWi5oOaN3qyx/BtrbYqI3i5DhyQdBOwXEZ/J/Z8Gdo2ILxbyTAIm5d63AA93cjZbAE93Q3H7glaqC7g+fV0r1aeV6gKdr882EdHWqML0hGY5U1ONtDWicURMBiZ3eQbSjIgY19Xx+5JWqgu4Pn1dK9WnleoCrVefMpqlSf98YEShfziwoJfKYmZmfVSzBLXpwBhJoyWtAxwCTO3lMpmZWR/TFJcfI2KFpC8C15Ca9J8fEbO6eTZdvnTZB7VSXcD16etaqT6tVBdovfp0qCkaipiZmZXRLJcfzczMOuSgZmZmLaNfBTVJ+0l6WNIcScfVGP4GSb/Nw++QNKrnS1leifocJmmxpJn585neKGcZks6XtEjSA+0Ml6Szc13vk7RTT5exM0rUZ7ykZYV1842eLmNZkkZIuknSbEmzJH2lRp6mWT8l69NM62ddSXdKujfX55s18jTVvm2tRES/+JAamPwN2BZYB7gX2L4qzxeAc3L3IcBve7vca1mfw4Af9XZZS9ZnD2An4IF2hh8AXEX6z+JuwB29Xea1rM944IreLmfJugwFdsrdGwH/V2Nba5r1U7I+zbR+BGyYuwcDdwC7VeVpmn3b2n7605naqkdtRcSrQOVRW0UTgAtz96XAXpJq/fG7LyhTn6YREbcAS+pkmQBcFMntwBBJQ3umdJ1Xoj5NIyIWRsTduft5YDYwrCpb06yfkvVpGnmZL8+9g/OnugVgM+3b1kp/CmrDgHmF/vm8fkNelSciVgDLgM17pHSdV6Y+AB/Nl4MulTSixvBmUba+zWT3fMnoKkk79HZhysiXrXYknQ0UNeX6qVMfaKL1I2mgpJnAIuC6iGh3/TTBvm2t9Keg1uGjtkrm6SvKlPVPwKiI+CfgelYfqTWjZlo3ZdxNes7eO4EfApf1cnk6JGlD4PfA0RHxXPXgGqP06fXTQX2aav1ExMqIGEt62tIukt5elaXp1k9X9aegVuZRW6vySBoEbELfvYTUYX0i4pmIeCX3ngv8cw+VrRFa6lFpEfFc5ZJRRFwJDJa0RS8Xq12SBpMCwK8j4g81sjTV+umoPs22fioi4llgGrBf1aBm2retlf4U1Mo8amsqMDF3HwTcGPnOah/UYX2q7ml8iHTvoFlNBQ7Nrex2A5ZFxMLeLlRXSXpj5Z6GpF1Iv8VnerdUteVyngfMjojvt5OtadZPmfo02fppkzQkd68H7A08VJWtmfZta6UpHpPVHaKdR21JOgWYERFTSRv6LyXNIR3FHNJ7Ja6vZH2+LOlDwApSfQ7rtQJ3QNLFpBZnW0iaD5xEuuFNRJwDXElqYTcHeBE4vHdKWk6J+hwEfF7SCuAl4JA+vJN5F/Bp4P583wbgBGAkNOX6KVOfZlo/Q4ELlV6mPAC4JCKuaNZ929ryY7LMzKxl9KfLj2Zm1uIc1MzMrGU4qJmZWctwUDMzs5bhoGZmZi3DQc26jaSV+YnmD0j6naT1e6kcR/fWvDtL0gWSDmrwPE6o6r+tkfPrKklzm+EPzta3OahZd3opIsZGxNuBV4Ejy46Y/2PTXY4GmiKo9ZA1glpE/L/eKkh7unn9Wz/moGaN8r/AdgCSPpXf9zRT0s8qOzBJyyWdIukO0sNjd5Z0W36I7J2SNsoPav2OpOn5wcyfy+OOlzQtP6j5IUm/zk+z+DKwNXCTpJty3p9KmqGqd01JOiCPe6vSu8CuyOkbKL0PbbqkeyTVfPuBpP8olOubOW3n3L9uns6synP4JH1d0v25fmfUmN438vQekDS58ESLaZLOlHSL0jvAdpb0B0mPSDqtMP5lku7K85yU084A1svL/teV5Z6/lZftA7lcH6+3bGuUt8vlqrX+C+nrSbpa0mfb27jM2tXb777xp3U+wPL8PQi4HPg88DbSg5UH52E/AQ7N3QF8LHevAzwK7Jz7N87TmQScmNPeAMwARpOe1rGM9IzBAcBfgXfnfHOBLQrl2ix/DyQ9F++fgHVJTy0fnYddTH5/FvDfwKdy9xDS+7Y2qKrrPsBk0oNiBwBXAHvkYacB3wV+DByf0/YHbgPWryrTBcBBxbTc/Uvgg7l7GvDt3P0V0jMVh+blMR/YvGqa6wEPFNKXt7OePgpcl5fLVsATebrtLtuq6axtuVat/8J6G0V6+Pahvb09+9OcH5+pWXdaT+mxQzNIO8jzgL1ID1KenoftRXqxKcBK0kNlAd4CLIyI6bDqgbIrSMHj0DzuHaTXZYzJ49wZEfMj4jVgJmmHWMvHJN0N3APsAGwPvBV4NCIey3kuLuTfBzguz3MaKQCOrJrmPvlzD+mJ7m8tlOsU4H3AOOB/ctrewC8i4sVcv1oPk32v0luJ7wf2zGWtqDzX835gVqR3gr1COhCoPEj4y5LuBW7PaWOo793AxZGe8P4UcDOwcx5WdtmuTbmK67/ictJyuqiDspvV1G+e/Wg94qVIr79YJV+2ujAijq+R/+WIWFnJSu1XYQj4UkRcUzXd8cArhaSV1NieJY0GvkY6A1wq6QJSkKr3gkQBH42IhzvI862I+FmNYZsBG5Ke9bgu8ALt169SznVJZ7HjImKepJPzuBWVur7GmvV+DRiUl8fewO4R8aKkaVXjt1eH9nS4bLuhXMX1X/EXYH9Jv4kIP8PPOs1natZoNwAHSdoSQNJmkrapke8hYGtJO+d8Gym9IuMa0oNlB+f0N0vaoIN5Pg9slLs3JgWVZZK2Il0GrMxvW6WXRAJ8vDD+NcCXCve0dqwxj2uAf1N6JxeShlXqSLos+V/Ar4Fv57Rrc/71K8uhanqVHf3TeZqdbRG5CbA0B463ArsVhv2jsvyq3AJ8XOm+ZRuwB3BnJ+e7NuWq5Rukp+H/pJvLYf2Ez9SsoSLiQUknAtdKGgD8AzgKeLwq36u5ocIPlV6f8RLpCP/npEtfd+cgsxg4sIPZTgaukrQwIt4r6R5gFumS2F/y/F6S9AXgaklPs+bO/FTgLOC+PM+5wAeqynutpLcBf82xbznwKUn7ASsi4jdKDWJuk7RnRFwtaSwwQ9KrpKfan1CY3rOSziVdxptLerVQZ1wNHCnpPuBh0qW+4vK4T9LdEfHJQvofSQ007iWdRX49Ip7Mwae71CtXe44Gzpf0PxHx9W4si/UDfkq/9VuSNoyI5Tlw/Rh4JCLO7O1ymVnX+fKj9WefzY1BZpEuk9W6P2ZmTcRnamZm1jJ8pmZmZi3DQc3MzFqGg5qZmbUMBzUzM2sZDmpmZtYy/j/5AvFjcMreDgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36aa7e6a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 0]['percentage exclamation mark'], bins=10, range=(0, 3), rwidth=0.8)\n",
    "plt.xlabel('Percentage exclamation mark')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage exclamation mark of non-spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Percentage caps"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "      <th>percentage digits</th>\n",
       "      <th>percentage question mark</th>\n",
       "      <th>percentage exclamation mark</th>\n",
       "      <th>percentage caps</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2.702703</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>6.896552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Free entry in 2 a wkly comp to win FA Cup fina...</td>\n",
       "      <td>16.129032</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>6.451613</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>U dun say so early hor... U c already then say...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4.081633</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>Nah I don't think he goes to usf, he lives aro...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3.278689</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text  \\\n",
       "1        0  Go until jurong point, crazy.. Available only ...   \n",
       "2        0                      Ok lar... Joking wif u oni...   \n",
       "3        1  Free entry in 2 a wkly comp to win FA Cup fina...   \n",
       "4        0  U dun say so early hor... U c already then say...   \n",
       "5        0  Nah I don't think he goes to usf, he lives aro...   \n",
       "\n",
       "   percentage digits  percentage question mark  percentage exclamation mark  \\\n",
       "1           0.000000                       0.0                          0.0   \n",
       "2           0.000000                       0.0                          0.0   \n",
       "3          16.129032                       0.0                          0.0   \n",
       "4           0.000000                       0.0                          0.0   \n",
       "5           0.000000                       0.0                          0.0   \n",
       "\n",
       "   percentage caps  \n",
       "1         2.702703  \n",
       "2         6.896552  \n",
       "3         6.451613  \n",
       "4         4.081633  \n",
       "5         3.278689  "
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def percentage_caps(text):\n",
    "    counter = 0\n",
    "    for i in text:\n",
    "        if i.isupper():\n",
    "            counter += 1\n",
    "    return (counter / len(text)) * 100\n",
    "\n",
    "df['percentage caps'] = df['text'].apply(percentage_caps)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYgAAAEWCAYAAAB8LwAVAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3XmcHVWZ//HPN2GHYMCETBIgC0QcQIgacBwUIuCIgCAOKgwoILKobCOOhEVBkSGOg4DOCITFgEpYBVGQRWQZfsoSICCrQAgSEpKwJeyY8Pz+OOfSlUt19+1O366b7u/79bqvvvfUcp5bVV3PrVNVpxQRmJmZ1RtQdQBmZtaanCDMzKyUE4SZmZVygjAzs1JOEGZmVsoJwszMSjlBlJB0pqTv9NC81pf0iqSB+fPNkr7aE/PO8/u9pH16an5dqPcHkp6T9Gxv123NpeTnkl6UdGfV8Vh11N/ug5A0CxgGLAaWAA8BFwBTIuLtbszrqxHxhy5MczPwy4g4pyt15WlPADaMiL27Om1PkrQe8FdgVETMrzKWZbEs66Ivk/RxYBqwUUS8WnU8Vp3+egTxmYgYBIwCJgNHAef2dCWSVujpebaIUcDzvZEc+vAybGWjgFlODkZE9KsXMAvYvq5sS+BtYNP8eSrwg/x+CPA74CXgBeD/SIn1F3ma14FXgG8Do4EA9gf+BtxaKFshz+9m4GTgTmAh8Btg7TxsIjC7LF5gB+At4O+5vvsK8/tqfj8AOA54CphPOjJ6Tx5Wi2OfHNtzwLEdLKf35OkX5Pkdl+e/ff7Ob+c4ppZMOxGYDRyT65kF7FUYvjLw3zmOecCZwKp10x4FPAv8IpfvCswAFgFPADsU4jwXmAs8A/wAGJiH7Qvclut6EXgS+HQedhLpCPKN/D3+J5efDjyd67kb+Hgh7lWB8/O8Hs7rfHZh+Ajg8rzMngQO62D5rgqckpftwhxnbRlcmr/7QtI2tElhuql5ed0AvAzcQjqSAxBwal73C4H7ydt0Sf0jgKtI2/TjwAG5fP+8TJbk5fK9kmk3zPUuzOv34sKwAA4DZuZhPwIG5GEbAH8Ens/DfgUMrtvW/yPH/Wper8OA3+fv+gdgrXa+T227+Xb+/nOBzwI7ko52XwCOKYw/AJhE2paeBy6h7f9wFeCXufwl4C5gWGGbmpnjeZK8XTfw3T4E3JunuxS4mLyPycN3Jm3fLwF/AjYrDDuKtG2/DDwKbNdr+8veqqhVXpQkiFz+N+BrhX/CWoI4Of9DrphfH6etaW6pedG2E74AWJ20E6iVFRPEM8CmeZzLSc0c72zk7cULnFAbtzD8ZtoSxFdI/+xjgTWAX9O2g63FcXaOa3PgTeAf21lOF5CS16A87V+B/duLs27aiaQmvB+TksE2pH/4jfLw00g7p7Xz/H8LnFw37Q/ztKuSEvhC4JOkf+yRwPvz+FcCZ+VluQ4p8R6Uh+1LSqgHAAOBrwFzCuvvnWVXiH1v4L3ACsCRpB31KnnYZNKOcS1gXdKObHYeNoCUUL4LrJTXwUzgU+0so//N9Y/Msf0zsHJhPQ7K3/80YEZhuqmkHcXWefjpwG152KdyDINJyeIfgeHt1H8L8DPSznA8KaltV1hut3WwfqcBx+bvvArwscKwAG7K63b9vN3Uts8N8zpcGRhKSn6n1W3rt5OSwkjSjv4e4IN5mj8Cx3eyzX2X9H96QP5OF+ZluQkp8Y3N4x+R61o3z/ssYFoedhBpm1wtr5sPA2uStrFFtG3Hw8nJu6PvlreHp4DDc2yfI/3Yq+1jPpS/60dyffvkZbEysBHpB8uIwv/xBr22v+ytilrlRfsJ4nbyL2qWThDfJ+0oN+xsXrTthMeWlBUTxOTC8I3zxjKQZU8QNwJfLwzbiLSDXKEQx7qF4XcCe5R8r4Gk5LFxoewg4Ob8/l1x1k0/kfTPunqh7BLgO6Qd16vFjRz4KPBkYdq3yDvlXHYWcGpJPcNynKsWyvYEbsrv9wUeLwxbLS+Df6hfdh18lxeBzfP7pXb4wFdpSxAfAf5WN+3RwM9L5jmAdBS2eQPb6+Acc+1IcCpwUWH4GqRf++sB25J2yP9E/tXezjzXy9MMKpSdTD4apPMEcQEwpbgtFYYF+eguf/46cGM78/kscG/dtl480rwcOKPw+VDgyg62uddpO3oclGP5SGGcu4HP5vcPU/glTtrZ1/5XvkLdr/g8zuqkX/j/WtzmOvtupGT+DPmHSS67jbZ9zBnAiXXTP0r6YbUhKXlsD6zY2fbS06/+eg6izEjSYWi9H5F+lV8vaaakSQ3M6+kuDH+K9KtiSENRdmxEnl9x3iuQdqQ1xauOXiPtYOoNoe1XT3FeI7sQy4uxdBv2Uzm+oaQd9d2SXpL0EnBtLq9ZEBFvFD6vR2oKqDeKtOzmFuZ1FulIouad7xsRr+W3Zd8ZAElHSnpY0sI8v/fQtm5GsPS6K74fBYyoxZGnPYall33NENIv73d9J0kDJU2W9ISkRaSdZm2ad9UbEa+QttsREfFH4H9IRyfzJE2RtGZJ/SOAFyLi5UJZV9bvt0mJ/k5JD0r6St3w+u17RP5u60i6SNIz+bv9kndv9/MK718v+dzuuiOdF1tSGLdsfrXpRwFXFNbVw6SkOYzUfHwdcJGkOZL+S9KKeXv+InAwaZu7WtL7G/huI4BnIu/5S5bRKODIum1nPdI6fZx0tHMCMD/XMaKDZdCjnCAASVuQ/jluqx8WES9HxJERMRb4DPBNSdvVBrczy/bKa9YrvF+f9MvlOdIv69UKcQ1k6R1nZ/OdQ9rYivNezNL/JI14LsdUP69nujCPtSStXjf9nDzv10mH5oPz6z0RUfzHr/+eT5PaeOs9TTqCGFKY15oRsUmDMS5VT7565yjgC6S27sGkpi3lUeaSmiRqiuvxadJR0ODCa1BE7FhS73Ok5o6y7/RvpPMt25OS0+haeGX1SlqD1JwzByAifhIRHyY1qbyP1KZfbw6wtqRBhbKG129EPBsRB0TECNKR5c8kbVgWH23rHdJRSpB+ma9Jas4rfq/e9DTpfFRxfa0SEc9ExN8j4nsRsTGp6W9n4MsAEXFdRHySdMTxCKnJFjr+bnOBkZJK12GO5aS6WFaLiGm5zgsj4mOk/8cgNb/2in6dICStKWln4CJS081fSsbZWdKGeeUuIv3KqP1KmUdqa+6qvSVtLGk1UhPWZfmXz1+BVSTtJGlF0onhlQvTzQNGS2pvvU0D/l3SmLzj+E/SCcTFXQkux3IJcJKkQZJGAd8k/Srqiu9JWinveHcGLo10KfHZwKmS1gGQNFLSpzqYz7nAfpK2kzQgj//+iJgLXA+cktflAEkbSNqmwfjq198gUkJdAKwg6buktueaS4CjJa0laSRwSGHYncAiSUdJWjUfCWyaf3wsJS+D84AfSxqRx/2opJVzDG+STnauRlqH9XaU9DFJKwEnAndExNOStpD0kbztvErbyeb6+p8mNaGcLGkVSZuRTk7/qvNFBpI+L6mWKF8k7bSK9fxHXkbrkdrdL87lg0gnvl/Ky68sefWWM0nb9ygASUMl7Zrff0LSB/IPtEWkH0tLJA2TtEv+4fMm6bvUvndH3+3PebxDJK2Q69myMPxs4OC87iRp9bwPGCRpI0nb5m3jDdKPq3et02bprwnit5JeJmXuY0knU/drZ9xxpKsnXiGt6J9FxM152MnAcfmw8FtdqP8XpLbkZ0lNDYcBRMRCUpvtOaRfc6+SrsyouTT/fV7SPSXzPS/P+1bSFRZvkNptu+PQXP9M0pHVhXn+jXqWtPOYQ9rxHBwRj+RhR5Ga7W7Ph+N/IJ0vKRURd5LWz6mkX/S30HZ082VSc9hDub7LSL/uGnE6sLvSDWE/ITUr/J6UqJ8iLb9iU8D3SevjyRzzZaQdRS2pfoZ0wvdJ0lHCOaSjgDLfAv5CukLmBdKvwgGk9v2nSOv/IdK5sXoXAsfn6T4M7JXL1yTtbF7M83iedAVXmT1JRydzgCtIJ39vaGfcelsAd0h6hXSxweER8WRh+G9I7f0zgKtpu4T8e6QTsgtz+a8brK8ZTifFfn3eF9xOOo8E8A+kdbuI1PR0C+nH0QDShQtzSMt+G9L/K3Tw3SLiLdKJ6f1J5zD2Jl0ZWdt2ppNOqv8Pad09TjoPBOkH4mTS9vQsqfn0GABJe0l6sEeWRjv63Y1y1nySJpKOyNbtbNzlmaSvkU7yN3rE0hN1TiWdGD+ut+rsCkkBjMtt59YOSXcAZ0bEz6uOpSP99QjCrMskDZe0VW7K2oj0a/KKquOy1idpG0n/kJuY9gE2I12c0dJ8l6pZ41YiXSU1htRUcBHpXgKzzmxEOoe1Bunqtd3zObSW5iYmMzMr5SYmMzMrtVw3MQ0ZMiRGjx5ddRhmZsuVu++++7mIGNrZeMt1ghg9ejTTp0+vOgwzs+WKpKc6H8tNTGZm1g4nCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWanl+k7q5dnoSVc3df6zJu/U1PmbWd/XtAQh6TzSYybnR8Smuexi2p4cNhh4KSLGSxpNenLTo3nY7RFxcLNi6++anZzACcqsL2jmEcRU0iP0LqgVRMQXa+8lnUJ6PF/NExExvonxmJlZFzQtQUTErfnI4F0kCfgCsG2z6jczs2VT1UnqjwPzIuKxQtkYSfdKukXSx9ubUNKBkqZLmr5gwYLmR2pm1k9VlSD2BKYVPs8F1o+IDwLfBC6UtGbZhBExJSImRMSEoUM77c7czMy6qdcThKQVgM8BF9fKIuLNiHg+v7+b9MzW9/V2bGZm1qaKI4jtgUciYnatQNJQSQPz+7HAOGBmBbGZmVnWtAQhaRrwZ2AjSbMl7Z8H7cHSzUsAWwP3S7oPuAw4OCJeaFZsZmbWuWZexbRnO+X7lpRdDlzerFjMzKzr3NWGmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo1LUFIOk/SfEkPFMpOkPSMpBn5tWNh2NGSHpf0qKRPNSsuMzNrTDOPIKYCO5SUnxoR4/PrGgBJGwN7AJvkaX4maWATYzMzs040LUFExK3ACw2OvitwUUS8GRFPAo8DWzYrNjMz61wV5yAOkXR/boJaK5eNBJ4ujDM7l72LpAMlTZc0fcGCBc2O1cys3+rtBHEGsAEwHpgLnJLLVTJulM0gIqZExISImDB06NDmRGlmZr2bICJiXkQsiYi3gbNpa0aaDaxXGHVdYE5vxmZmZkvr1QQhaXjh425A7Qqnq4A9JK0saQwwDrizN2MzM7OlrdCsGUuaBkwEhkiaDRwPTJQ0ntR8NAs4CCAiHpR0CfAQsBj4RkQsaVZsVp3Rk65ueh2zJu/U9DrM+oOmJYiI2LOk+NwOxj8JOKlZ8ZiZWdf4TmozMyvlBGFmZqWcIMzMrJQThJmZlXKCMDOzUk4QZmZWygnCzMxKOUGYmVmpThOEpA0krZzfT5R0mKTBzQ/NzMyq1MgRxOXAEkkbku6EHgNc2NSozMysco0kiLcjYjGpc73TIuLfgeGdTGNmZsu5RhLE3yXtCewD/C6Xrdi8kMzMrBU0kiD2Az4KnBQRT+buuH/Z3LDMzKxqnfbmGhEPSToKWD9/fhKY3OzAzMysWo1cxfQZYAZwbf48XtJVzQ7MzMyq1UgT0wmkR4O+BBARM0hXMpmZWR/WSIJYHBEL68qiGcGYmVnraOSJcg9I+jdgoKRxwGHAn5oblpmZVa2RI4hDgU2AN4FpwCLgiGYGZWZm1WvkKqbXgGPzy8zM+olOE4Sk3/Lucw4LgenAWRHxRjvTnQfsDMyPiE1z2Y+AzwBvAU8A+0XES5JGAw8Dj+bJb4+Ig7v8bczMrMc00sQ0E3gFODu/FgHzgPflz+2ZCuxQV3YDsGlEbAb8FTi6MOyJiBifX04OZmYVa+Qk9QcjYuvC599KujUitpb0YHsTRcSt+cigWHZ94ePtwO5dCdbMzHpPI0cQQyWtX/uQ3w/JH99ahrq/Avy+8HmMpHsl3SLp4+1NJOlASdMlTV+wYMEyVG9mZh1p5AjiSOA2SU8AIt0k93VJqwPnd6dSSccCi4Ff5aK5wPoR8bykDwNXStokIhbVTxsRU4ApABMmTPD9GGZmTdLIVUzX5Psf3k9KEI8UTkyf1tUKJe1DOnm9XUREruNN0mW0RMTdORm9j3Qi3MzMKtDIEQTAOGAjYBVgM0lExAVdrUzSDsBRwDb58tla+VDghYhYImlsrm9mV+dvZmY9p5HLXI8HJgIbA9cAnwZuAzpMEJKm5emGSJoNHE+6amll4AZJ0HY569bA9yUtBpYAB0fEC937SmZm1hMaOYLYHdgcuDci9pM0DDins4kiYs+S4nPbGfdy0qNNzcysRTRyFdPrEfE2sFjSmsB8YGxzwzIzs6o1cgQxXdJg0k1xd5NumruzqVGZmVnlGrmK6ev57ZmSrgXWjIj7mxuWmZlVrZEnym2V73kA+Biwr6RRzQ3LzMyq1sg5iDOA1yRtDnwbeIpOrmAyM7PlX6NPlAtgV+D0iDgdGNTcsMzMrGqNnKR+WdLRwN7A1pIGAis2NywzM6taI0cQXyR1g7F/RDwLjAR+1NSozMyscg0dQZCalpZIeh+pT6ZpzQ2rd4yedHVT5z9r8k5Nnb+ZWTM1cgRxK7CypJHAjcB+pIcBmZlZH9ZIglDuWO9zwE8jYjdgk+aGZWZmVWsoQUj6KLAXUGuTGdi8kMzMrBU0kiCOIPXCekVEPJi7476puWGZmVnVGulq4xbgltrd1BExEzis2YGZmVm1Gulq46OSHgIezp83l/SzpkdmZmaVaqSJ6TTgU8DzABFxH+kBP2Zm1oc1kiCIiKfripY0IRYzM2shjdwo97SkfwZC0kqk8w8PNzcsMzOrWiNHEAcD3yB1sTEbGJ8/m5lZH9bIVUzPke6BMDOzfqTTBCFpDHAoMLo4fkTs0sC05wE7A/MjYtNctjZwcZ7fLOALEfGiJAGnAzsCrwH7RsQ9Xfs6ZmbWUxppYrqStCP/KXBK4dWIqcAOdWWTgBsjYhypb6dJufzTwLj8OpD0oCIzM6tIIyep34iIn3Rn5hFxq6TRdcW7AhPz+/OBm4GjcvkF+eFEt0saLGl4RMztTt1mZrZsGkkQp0s6Hrie9FwIAJah+WdYbacfEXMlrZPLRwLFy2ln57KlEoSkA0lHGKy//vrdDMHMzDrTSIL4APAlYFvg7VwW+XNPUklZvKsgYgowBWDChAnvGm5mZj2jkQSxGzA2It7qoTrn1ZqOJA0H5ufy2cB6hfHWBeb0UJ1mZtZFjZykvg8Y3IN1XgXsk9/vA/ymUP5lJf8ELPT5BzOz6jRyBDEMeETSXSx9DqKRy1ynkU5ID5E0GzgemAxcIml/4G/A5/Po15AucX2cdJnrfo1/DTMz62mNJIjjuzvziNiznUHblYwb+A5tM7OW0ejzIMzMrJ9pqDdXMzPrf5wgzMysVLsJQtKN+e8Pey8cMzNrFR2dgxguaRtgF0kXUXcjmzvSMzPr2zpKEN8ldaS3LvDjumHNuJPazMxaSLsJIiIuAy6T9J2IOLEXYzIzsxbQyGWuJ0raBdg6F90cEb9rblhmZla1Tq9iknQycDjwUH4dnsvMzKwPa+RO6p2A8RHxNoCk84F7gaObGZiZmVWr0fsgip31vacZgZiZWWtp5AjiZOBeSTeRLnXdGh89mJn1eY2cpJ4m6WZgC1KCOCoinm12YGZmVq1GjiDIz2W4qsmxmJlZC3FfTGZmVsoJwszMSnWYICQNkPRAbwVjZmato8MEke99uE/S+r0Uj5mZtYhGTlIPBx6UdCfwaq2wkWdSm5nZ8quRBPG9pkdhZmYtp6FnUksaBYyLiD9IWg0Y2N0KJW0EXFwoGkvqWnwwcACwIJcfExHXdLceMzNbNo101ncAcBlwVi4aCVzZ3Qoj4tGIGB8R44EPA68BV+TBp9aGOTmYmVWrkctcvwFsBSwCiIjHgHV6qP7tgCci4qkemp+ZmfWQRhLEmxHxVu2DpBVIT5TrCXsA0wqfD5F0v6TzJK1VNoGkAyVNlzR9wYIFZaOYmVkPaCRB3CLpGGBVSZ8ELgV+u6wVS1oJ2CXPD+AMYANgPDAXOKVsuoiYEhETImLC0KFDlzUMMzNrRyMJYhLpxPFfgIOAa4DjeqDuTwP3RMQ8gIiYFxFL8r0XZwNb9kAdZmbWTY1cxfR2fkjQHaSmpUcjoieamPak0LwkaXjuFBBgN8B3cJuZVajTBCFpJ+BM4AlSd99jJB0UEb/vbqX5UtlPko5Iav5L0nhSEppVN8zMzHpZIzfKnQJ8IiIeB5C0AXA10O0EERGvAe+tK/tSd+dnZmY9r5FzEPNrySGbCcxvUjxmZtYi2j2CkPS5/PZBSdcAl5Cafz4P3NULsZmZWYU6amL6TOH9PGCb/H4BUHqPglkrGz3p6qbXMWvyTk2vw6y3tJsgImK/3gzEzMxaSyNXMY0BDgVGF8d3d99mZn1bI1cxXQmcS7p7+u3mhmNmZq2ikQTxRkT8pOmRmJlZS2kkQZwu6XjgeuDNWmFE3NO0qMzMrHKNJIgPAF8CtqWtiSnyZzMz66MaSRC7AWOLXX6bmVnf18id1PeRHgdqZmb9SCNHEMOARyTdxdLnIHyZq5lZH9ZIgji+6VGYmVnLaeR5ELf0RiBmZtZaGrmT+mXankG9ErAi8GpErNnMwMzMrFqNHEEMKn6W9Fn8OFAzsz6vkauYlhIRV+J7IMzM+rxGmpg+V/g4AJhAW5OTmZn1UY1cxVR8LsRi0vOid21KNGZm1jIaOQfh50KYmfVDHT1y9LsdTBcRceKyVCxpFvAysARYHBETJK0NXEx69sQs4AsR8eKy1GNmZt3T0UnqV0teAPsDR/VQ/Z+IiPERMSF/ngTcGBHjgBvzZzMzq0BHjxw9pfZe0iDgcGA/4CLglPamW0a7AhPz+/OBm+m5ZGRmZl3Q4WWuktaW9APgflIy+VBEHBUR83ug7gCul3S3pANz2bCImAuQ/65TEtOBkqZLmr5gwYIeCMPMzMp0dA7iR8DngCnAByLilR6ue6uImCNpHeAGSY80MlFETMkxMWHCBF9ua2bWJB0dQRwJjACOA+ZIWpRfL0tatKwVR8Sc/Hc+cAXp7ux5koYD5L89caRiZmbd0G6CiIgBEbFqRAyKiDULr0HL2g+TpNXzeQ0krQ78C/AAcBWwTx5tH+A3y1KPmZl1XyM3yjXDMOAKSbUYLoyIa/MzJy6RtD/wN+DzFcVnZtbvVZIgImImsHlJ+fPAdr0fkZmZ1etyZ31mZtY/OEGYmVkpJwgzMyvlBGFmZqWcIMzMrJQThJmZlXKCMDOzUk4QZmZWygnCzMxKOUGYmVkpJwgzMyvlBGFmZqWcIMzMrJQThJmZlXKCMDOzUk4QZmZWygnCzMxKOUGYmVkpJwgzMyvlBGFmZqV6PUFIWk/STZIelvSgpMNz+QmSnpE0I7927O3YzMyszQoV1LkYODIi7pE0CLhb0g152KkR8d8VxGRmZnV6PUFExFxgbn7/sqSHgZG9HYeZmXWs0nMQkkYDHwTuyEWHSLpf0nmS1mpnmgMlTZc0fcGCBb0UqZlZ/1NFExMAktYALgeOiIhFks4ATgQi/z0F+Er9dBExBZgCMGHChOi9iM26b/Skq5tex6zJOzW9DutfKjmCkLQiKTn8KiJ+DRAR8yJiSUS8DZwNbFlFbGZmllRxFZOAc4GHI+LHhfLhhdF2Ax7o7djMzKxNFU1MWwFfAv4iaUYuOwbYU9J4UhPTLOCgCmIzM7OsiquYbgNUMuia3o7FzMza5zupzcyslBOEmZmVcoIwM7NSThBmZlbKCcLMzEo5QZiZWSknCDMzK+UEYWZmpZwgzMysVGW9uZpZ73BPstZdPoIwM7NSPoIws6bx0cvyzUcQZmZWygnCzMxKOUGYmVkpJwgzMyvlBGFmZqWcIMzMrJQThJmZlfJ9EGZmPayv3P/RcglC0g7A6cBA4JyImFxxSGa2HOorO+kqtVQTk6SBwP8CnwY2BvaUtHG1UZmZ9U8tlSCALYHHI2JmRLwFXATsWnFMZmb9kiKi6hjeIWl3YIeI+Gr+/CXgIxFxSGGcA4ED88eNgEe7UMUQ4LkeCrenObbucWzd06qxtWpc0LdiGxURQzsbqdXOQaikbKkMFhFTgCndmrk0PSImdGfaZnNs3ePYuqdVY2vVuKB/xtZqTUyzgfUKn9cF5lQUi5lZv9ZqCeIuYJykMZJWAvYArqo4JjOzfqmlmpgiYrGkQ4DrSJe5nhcRD/ZgFd1qmuoljq17HFv3tGpsrRoX9MPYWuoktZmZtY5Wa2IyM7MW4QRhZmal+k2CkLSDpEclPS5pUtXxFEmaJekvkmZIml5xLOdJmi/pgULZ2pJukPRY/rtWC8V2gqRn8rKbIWnHCuJaT9JNkh6W9KCkw3N55cutg9haYbmtIulOSffl2L6Xy8dIuiMvt4vzBSutEttUSU8Wltv43o4txzFQ0r2Sfpc/N2eZRUSff5FOeD8BjAVWAu4DNq46rkJ8s4AhVceRY9ka+BDwQKHsv4BJ+f0k4IctFNsJwLcqXmbDgQ/l94OAv5K6iql8uXUQWyssNwFr5PcrAncA/wRcAuyRy88EvtZCsU0Fdq9yueWYvglcCPwuf27KMusvRxDuwqNBEXEr8EJd8a7A+fn9+cBnezWorJ3YKhcRcyPinvz+ZeBhYCQtsNw6iK1ykbySP66YXwFsC1yWy6tabu3FVjlJ6wI7Aefkz6JJy6y/JIiRwNOFz7NpkX+SLIDrJd2duxJpNcMiYi6kHQ6wTsXx1DtE0v25CaqS5q8aSaOBD5J+cbbUcquLDVpgueWmkhnAfOAG0pH+SxGxOI9S2f9qfWwRUVtuJ+XldqqklSsI7TTg28Db+fN7adIy6y8JotMuPCq2VUR8iNSL7TckbV11QMuRM4ANgPHAXOCUqgKRtAbE+CJlAAAFlUlEQVRwOXBERCyqKo4yJbG1xHKLiCURMZ7Ua8KWwD+Wjda7UeVK62KTtClwNPB+YAtgbeCo3oxJ0s7A/Ii4u1hcMmqPLLP+kiBauguPiJiT/84HriD9o7SSeZKGA+S/8yuO5x0RMS//I78NnE1Fy07SiqQd8K8i4te5uCWWW1lsrbLcaiLiJeBmUjv/YEm1m3gr/18txLZDbrKLiHgT+Dm9v9y2AnaRNIvUVL4t6YiiKcusvySIlu3CQ9LqkgbV3gP/AjzQ8VS97ipgn/x+H+A3FcaylNoOONuNCpZdbgM+F3g4In5cGFT5cmsvthZZbkMlDc7vVwW2J50juQnYPY9W1XIri+2RQsIXqZ2/V5dbRBwdEetGxGjSfuyPEbEXzVpmVZ+N760XsCPpCo4ngGOrjqcQ11jSVVX3AQ9WHRswjdTk8HfSkdf+pDbOG4HH8t+1Wyi2XwB/Ae4n7ZCHVxDXx0iH9PcDM/Jrx1ZYbh3E1grLbTPg3hzDA8B3c/lY4E7gceBSYOUWiu2Pebk9APySfKVTFS9gIm1XMTVlmbmrDTMzK9VfmpjMzKyLnCDMzKyUE4SZmZVygjAzs1JOEGZmVsoJwpZLkpbk3jQfkHSppNUqiuOIquo2azYnCFtevR4R4yNiU+At4OBGJ5Q0sAfjOAJwgrA+yQnC+oL/AzYEkLR37sd/hqSzaslA0iuSvi/pDuCjkraQ9Kfc3/+dkgblztl+JOmu3BnbQXnaiZJulnSZpEck/UrJYcAI4CZJN+Vxz5A0vfgMgVy+Y572Nkk/KfTjv3ruLO+u3L9/aS/Dkr6t9MyQ+yRNzmUH5Onuk3R57UhG6ZkFZ0r6P0l/zf33IGmTwrK5X9K45qwO6zOqugvQL7+W5QW8kv+uQOpW4Gukjt5+C6yYh/0M+HJ+H8AX8vuVgJnAFvnzmnk+BwLH5bKVgenAGNIdqwtJfdwMAP4MfCyPN4vCszzId0uTnkFyM+mO3FVIvQmPycOm0XYH7H8Ce+f3g0l3+69e910/DfwJWK2ujvcWxvkBcGh+PxW4Nsc6jnTX+SrAT4G9Cstg1arXo1+t/ap17mS2vFk1d8UM6QjiXNIO/sPAXamrHFalrYO8JaQO6wA2AuZGxF0AkXtelfQvwGaSan3avIe0g30LuDMiZufxZgCjgdtK4vpC7rJ9BdLDejYm7ahnRsSTeZxpOVZIfW/tIulb+fMqwPqkPolqtgd+HhGv5Xhrz8TYVNIPSIllDeC6wjSXROqI7zFJM0k9kP4ZOFbpeQK/jojHSuI3e4cThC2vXo/UFfM7cgdq50fE0SXjvxERS2qjUt4dski/wq9bqlCaCLxZKFpCyf+OpDHAt0hHJi9Kmkra4Zd1x1ys818j4tFOximLdyrw2Yi4T9K+pCOdmvrxIyIuzE1sOwHXSfpqRPyxg3qtn/M5COtLbgR2l7QOvPNM6FEl4z0CjJC0RR5vUO4q+Trga7l7bCS9L/ew25GXSY/yhNRU9SqwUNIwUtNQrb6xSg/sAfhiYfrrgENzckPSB0vquB74SuEcw9q5fBAwN8e7V900n5c0QNIGpI7cHpU0lnQk8xNSB32bdfLdrJ/zEYT1GRHxkKTjSE/nG0Dq9fUbwFN1470l6YvAT3NXzq+TmnHOITUd3ZN32Avo/NGNU4DfS5obEZ+QdC+pV96ZwP/L9b0u6evAtZKeI/W6WXMiqT//+3Ods4Cd6+K9VtJ4YLqkt4BrgGOA75CeDvcUqYfRQYXJHgVuAYYBB0fEG/k77y3p78CzwPc7+W7Wz7k3V7NeIGmNiHglJ4H/BR6LiFObVNdU0knwyzob16wjbmIy6x0H5JPbD5JOfp9VcTxmnfIRhJmZlfIRhJmZlXKCMDOzUk4QZmZWygnCzMxKOUGYmVmp/w+HKJagA+jPPAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36aa844e0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 1]['percentage caps'], bins=10, range=(0, 40), rwidth=0.8)\n",
    "plt.xlabel('Percentage caps')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage caps of spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY4AAAEWCAYAAABxMXBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3XucHFWZ//HPl3CHQMAAvyQEEjCgoBIxICwuRlGuKuBPd2FBIoJBBYUVV4KioMiC63J1kYuCARUQUTQgchEJyCqQoOESLiaGYEJCEm5JuJvw7B/nNKkMPT1VcXq6Z+b7fr36NV2nbk9XV9cz51TVKUUEZmZmZa3W6gDMzKx3ceIwM7NKnDjMzKwSJw4zM6vEicPMzCpx4jAzs0r6beKQdKGkr3XTsraQ9LykAXl4sqQju2PZeXm/kTSuu5ZXYb3fkvSUpCd7et3WXEp+KOlZSfe0Oh7rXdQX7+OQNBvYDFgGLAceAi4HLo6I11ZhWUdGxG8rzDMZ+HFE/KDKuvK8pwBvjohDq87bnSQNB/4CbBkRC1sZyz/iH/ku+jJJ/wxcCWwbES+0Oh7rXfpyjePDETEQ2BI4AzgBuKS7VyJp9e5eZpvYEni6J5JGH96G7WxLYLaThq2SiOhzL2A28IEOZTsDrwFvy8MTgW/l94OB64HngGeA35OS6o/yPC8BzwNfBkYAARwB/A24o1C2el7eZOB04B5gMfArYOM8biwwt168wN7Aq8Df8/ruKyzvyPx+NeAk4HFgIakmtWEeV4tjXI7tKeCrDbbThnn+RXl5J+XlfyB/5tdyHBPrzDsWmAt8Ja9nNnBIYfxawH/nOBYAFwLrdJj3BOBJ4Ee5fH9gGrAE+CuwdyHOS4D5wBPAt4ABedwngTvzup4FHgP2yeNOI9U4X86f439y+bnAnLyee4F/LsS9DnBZXtbD+TufWxg/FPh53maPAV9osH3XAc7M23ZxjrO2DX6WP/ti0j60fWG+iXl73QIsBW4n1fwABJydv/vFwP3kfbrO+ocCk0j79Ezg07n8iLxNluft8o0683a6XRstO487BbiatG8tBaYDYxpsp52Bqfn7WACc1WF/Hg/My9//8R3m+yPpdzsf+B9gzcL4AD4HzMhxnApsnedZkmNcs5OYPgn8b97WzwGzgH/K5XPy9h9Xcn+ve3zJ404g7dNLgUeBPUp+tj3z9IuB7+V95MjC+E+R9t9ngZtWZf9peIzt6YN6T7yokzhy+d+AzxZ+nLXEcXr+otfIr39mRTPeSssq7MyXA+uRDg61smLieAJ4W57m56TmEmiQOAo/uh93GD+ZFYnjU6Qf6lbA+sAvWHHgrcXx/RzXDsArwFs72U6Xk5LawDzvX4AjOouzw7xjSU2BZ5F+NO8FXiA1fQCcQzqwbJyXfx1weod5v53nXYf0Q1kMfJCUvIYBb8nT/xK4KG/LTUkJ+ajCD/zvwKeBAcBnSQcZddx2hdgPBd4ErA4cTzqAr53HnUH6EW4EbE76Yc3N41YjJZqvA2vm72AWsFcn2+j8vP5hObZ/AtYqfI8D8+c/B5hWmG8i6UCyex5/LnBnHrdXjmEQ6SDwVmBIJ+u/nXRQWRsYTUp2exS2250Nvt+utmujZZ9CSkz75nlPB+5qsK4/Ap/I79cHdumwP1+Zv/u35/XUfivvAnbJ3+MI0oHyuMJyg7QPbgBsT/ot3Jq/tw1JTdjjGnz+ZcDh+TN8i3T8OD9/J3vm72j9Evt73eMLsC0pCQ0tfN6tu/pspES0BPhoHn9s/q5qx4gDSMeIt+bxJwF/qLr/NDzG9uQBvadedJ447iL/B87KieObpAPom7taVmFn3qpOWTFxnFEYvx2pJjGAfzxx3Ap8rjBu27zT1HawADYvjL8HOKjO5xpA+iFtVyg7Cpic378hzg7zjyX9sNYrlF0NfC3vkC/UfgR53K7AY4V5XyUfrHPZRcDZddazWY5znULZwcBtseIHPrMwbt28Df5fx23X4LM8C+yQ36+UCIAjWZE43g38rcO8JwI/rLPM1Ui1th1K7K+Dcsy1muNE4KrC+PVJtYPhwPtJCX4X8n+tnSxzeJ5nYKHsdHLtkXKJo+52LbHsU4Dfdtj/X2qwrjuAbwCDO5SPyOt8S6Hsv4BLOlnOccC1heEAdisM3wucUBg+EzinweefURh+e17eZoWyp0lJs6v9ve7xBXgz6T//DwBrdLGPvP7ZgMOAPxbGiZSAaseI35D/ASzsiy+SmidL7T9dvfryOY56hpGqih19h5Shb5Y0S9KEEsuaU2H846T/NAaXirKxoXl5xWWvTjrA1hSvgnqRdODpaDDpv+aOyxpWIZZnY+U28sdzfJuQDjT3SnpO0nPAjbm8ZlFEvFwYHk5qnupoS9K2m19Y1kWkmkfN6583Il7Mb+t9ZgAkHS/pYUmL8/I2ZMV3M5SVv7vi+y2BobU48rxfYeVtXzOY9N/4Gz6TpAGSzpD0V0lLSP841OZ5w3oj4nnSfjs0In5HarY4H1gg6WJJG9RZ/1DgmYhYWiir+v12tl3LLLvjPri2pNUlHZKvQHxe0m/y+COAbYBHJE2R9KEOcXT8LQ0FkLSNpOslPZm343/yxt/YgsL7l+oMd7qf1JmWiKg3f1f7e93jS0TMJCWEU4CFkq6SVOazrbSPRsoOcwtxbQmcW4jlGVJyGVZh/2mo3yQOSTuRduw7O46LiKURcXxEbAV8GPiipD1qoztZZGflNcML77cg1QqeIv1nsm4hrgGsfEDtarnzSDtGcdnLWHknL+OpHFPHZT1RYRkbSVqvw/zz8rJfIrXbD8qvDSOi+CPt+DnnkNqfO5pDqnEMLixrg4jYvmSMK60nX010AvAvwEYRMYjURKY8yXxSE1VN8XucQ/ovclDhNTAi9q2z3qdIzTX1PtO/kc7nfICUtEbUwqu3Xknrk5pA5gFExHkR8S5S88s2wH/UWcc8YGNJAwtlVb/fzqzysiPiJxGxfn7tk8tmRMTBpH8Gvg1c02G/6vhbmpffXwA8AoyKiA1ISby4DXtKw/290fElIq6IiPeQfodB+vzQ+LOttI9KEivvs3NITbnF/XSdiPhDXmeZ/aehPp84JG2Q/4O5itQE9ECdaT4k6c35C1hCqoYvz6MXkNpEqzpU0naS1iVVVa+JiOWkauLakvaTtAap/XGtwnwLgBGSOvturgT+XdLIfED5T+CnEbGsSnA5lquB0yQNlLQl8EXgx1WWA3xD0pr5gPwh4GeRLnn+PnC2pE0BJA2TtFeD5VwCHC5pD0mr5enfEhHzgZuBM/N3uZqkrSW9t2R8Hb+/gaREuwhYXdLXSW3gNVcDJ0raSNIw4JjCuHuAJZJOkLROrjm8Lf9TspK8DS4FzpI0NE+7q6S1cgyvkJo61iV9hx3tK+k9ktYkndS9OyLmSNpJ0rvzvvMCK05yd1z/HOAPwOmS1pb0DtJ/9j/pepM11t3LlnSopE3yNnsuFxc/09ckrStpe9I5h5/m8oGk3+vzkt5COg/T47ra3zs7vkjaVtL78z7xMin51D53o8/2a+Dtkg7IVyQeTWpCrLmQtA9vn9e/oaSP5/el9p+u9OXEcZ2kpaTs+1XSSdzDO5l2FPBb0hUmfwS+FxGT87jTgZNyte9LFdb/I1Jb9ZOkJosvAETEYtKVHj8g/Yf2AitXM3+W/z4t6U91lntpXvYdpCtdXgY+XyGuos/n9c8i1cSuyMsv60nS+YF5pIPGZyLikTzuBFL1/K5c1f4t6XxMXRFxD+n7OZtUA7idFbWhw0jNag/l9V0DDCkZ47nAx5RudDuPdIXJb0gJ/HHS9is2hXyT9H08lmO+hnSQryXbD5PatR8j/af5A1KtoZ4vAQ8AU0jNBd8m/eYuz+t+In+mu+rMewVwcp7vXcAhuXwD0kHq2byMp0lX89RzMKk2Mw+4Fjg5Im7pZNqqunPZewPTJT1P+r4O6tCMeTtpX7oV+O+IuDmXf4lUe1tK2iY/pXUa7e+dHV/WIl2M8RTpt7QpqWYBDT5bRDwFfJx0vudp0jmkqazYT68l7WtX5VgeBPbJs3e6/0j6SqH5sKE+eQOgNZ+ksaQa3OZdTdubSfos6UBWtobTHeucSDohf1JPrbMdSRpBStBrVK1R9ye5dWIu6XL423pinX25xmFWmaQhknbLTWLbki7XvbbVcZkVSdpL0qDczFU7/1Gv5toUvmPXbGVrkq7aGklqb7+KdL+CWTvZldScWWvCPSAiXuqplbupyszMKnFTlZmZVdInm6oGDx4cI0aMaHUYZma9yr333vtURGzS1XR9MnGMGDGCqVOntjoMM7NeRdLjXU/lpiozM6vIicPMzCpx4jAzs0qcOMzMrBInDjMzq8SJw8zMKnHiMDOzSpw4zMysEicOMzOrpE/eOf6PGjHh101fx+wz9mv6OszMmsE1DjMzq8SJw8zMKnHiMDOzSpw4zMysEicOMzOrxInDzMwqceIwM7NKnDjMzKwSJw4zM6vEicPMzCpx4jAzs0qcOMzMrBInDjMzq8SJw8zMKnHiMDOzSpw4zMysEicOMzOrxInDzMwqceIwM7NKmpY4JA2XdJukhyVNl3RsLj9F0hOSpuXXvoV5TpQ0U9KjkvYqlO+dy2ZKmtCsmM3MrGurN3HZy4DjI+JPkgYC90q6JY87OyL+uzixpO2Ag4DtgaHAbyVtk0efD3wQmAtMkTQpIh5qYuxmZtaJpiWOiJgPzM/vl0p6GBjWYJb9gasi4hXgMUkzgZ3zuJkRMQtA0lV5WicOM7MW6JFzHJJGAO8E7s5Fx0i6X9KlkjbKZcOAOYXZ5uayzso7rmO8pKmSpi5atKibP4GZmdU0PXFIWh/4OXBcRCwBLgC2BkaTaiRn1iatM3s0KF+5IOLiiBgTEWM22WSTbondzMzeqJnnOJC0Bilp/CQifgEQEQsK478PXJ8H5wLDC7NvDszL7zsrNzOzHtbMq6oEXAI8HBFnFcqHFCY7EHgwv58EHCRpLUkjgVHAPcAUYJSkkZLWJJ1An9SsuM3MrLFm1jh2Az4BPCBpWi77CnCwpNGk5qbZwFEAETFd0tWkk97LgKMjYjmApGOAm4ABwKURMb2JcZuZWQPNvKrqTuqfn7ihwTynAafVKb+h0XxmZtZzfOe4mZlV4sRhZmaVOHGYmVklThxmZlaJE4eZmVXixGFmZpU4cZiZWSVOHGZmVokTh5mZVeLEYWZmlThxmJlZJU4cZmZWiROHmZlV4sRhZmaVOHGYmVklThxmZlaJE4eZmVXixGFmZpV0mTgkbS1prfx+rKQvSBrU/NDMzKwdlalx/BxYLunNwCXASOCKpkZlZmZtq0zieC0ilgEHAudExL8DQ5oblpmZtasyiePvkg4GxgHX57I1mheSmZm1szKJ43BgV+C0iHhM0kjgx80Ny8zM2tXqXU0QEQ9JOgHYIg8/BpzR7MDMzKw9lbmq6sPANODGPDxa0qRmB2ZmZu2pTFPVKcDOwHMAETGNdGWVmZn1Q2USx7KIWNyhLJoRjJmZtb8uz3EAD0r6N2CApFHAF4A/NDcsMzNrV2VqHJ8HtgdeAa4ElgDHdTWTpOGSbpP0sKTpko7N5RtLukXSjPx3o1wuSedJminpfkk7FpY1Lk8/Q9K4VfmgZmbWPbpMHBHxYkR8NSJ2iogx+f3LJZa9DDg+It4K7AIcLWk7YAJwa0SMAm7NwwD7AKPyazxwAaREA5wMvJt0ruXkWrIxM7Oe12VTlaTreOM5jcXAVOCizpJIRMwH5uf3SyU9DAwD9gfG5skuAyYDJ+TyyyMigLskDZI0JE97S0Q8k+O5BdibVPsxM7MeVqapahbwPPD9/FoCLAC2ycNdkjQCeCdwN7BZTiq15LJpnmwYMKcw29xc1ll5x3WMlzRV0tRFixaVCcvMzFZBmZPj74yI3QvD10m6IyJ2lzS9q5klrU/qKPG4iFgiqdNJ65RFg/KVCyIuBi4GGDNmjK/6MjNrkjI1jk0kbVEbyO8H58FXG80oaQ1S0vhJRPwiFy/ITVDkvwtz+VxgeGH2zYF5DcrNzKwFyiSO44E78xVSk4HfA/8haT3SOYq6lKoWlwAPR8RZhVGTSB0mkv/+qlB+WL66ahdgcW7KugnYU9JG+aT4nrnMzMxaoExfVTfk+zfeQmo2eqRwQvycBrPuBnwCeEDStFz2FVI/V1dLOgL4G/DxPO4GYF9gJvAiqXNFIuIZSacCU/J036ydKDczs55X5hwHpEtktwXWBt4hiYi4vNEMEXEn9c9PAOxRZ/oAju5kWZcCl5aM1czMmqjM5bgnky6J3Y5UK9gHuBNomDjMzKxvKnOO42OkGsKTEXE4sAOwVlOjMjOztlUmcbwUEa8ByyRtQLoKaqvmhmVmZu2qzDmOqZIGkW72u5d0M+A9TY3KzMzaVpmrqj6X314o6UZgg4i4v7lhmZlZuyrzBMDd8j0bAO8BPilpy+aGZWZm7arMOY4LgBcl7QB8GXgcX1FlZtZvlX0CYJB6rz03Is4FBjY3LDMza1dlTo4vlXQicCiwu6QBwBrNDcvMzNpVmRrHv5Ke/ndERDxJ6tL8O02NyszM2lapGgepiWq5pG1IfVb5IUpmZv1UmRrHHcBakoaRHvV6ODCxmUGZmVn7KpM4FBEvAh8FvhsRBwLbNzcsMzNrV6USh6RdgUOAX+eyAc0LyczM2lmZxHEccCJwbURMl7QVcFtzwzIzs3ZVpsuR24Hba3ePR8Qs4AvNDszMzNpTmS5HdpX0EPBwHt5B0veaHpmZmbWlMk1V5wB7AU8DRMR9wO7NDMrMzNpXmcRBRMzpULS8CbGYmVkvUOYGwDmS/gkISWuSzm883NywzMysXZWpcXwGOJrU1chcYHQeNjOzfqjMVVVPke7hMDMz6zpxSBoJfB4YUZw+Ij7SvLDMzKxdlTnH8UvgEuA64LXmhmNmZu2uTOJ4OSLOa3okZmbWK5RJHOdKOhm4mfRcDgAi4k9Ni8rMzNpWmcTxduATwPtZ0VQVedjMzPqZMpfjHghsFRHvjYj35VeXSUPSpZIWSnqwUHaKpCckTcuvfQvjTpQ0U9KjkvYqlO+dy2ZKmlD1A5qZWfcqkzjuAwatwrInAnvXKT87Ikbn1w0AkrYDDiI952Nv4HuSBuTnm58P7ANsBxycpzUzsxYp01S1GfCIpCmsfI6j4eW4EXGHpBEl49gfuCoiXgEekzQT2DmPm5l75EXSVXnah0ou18zMulmZxHFyN6/zGEmHAVOB4yPiWdJd6XcVppmbywDmdCh/dzfHY2ZmFZR9Hkd3uQA4lXRy/VTgTOBTgOqtmvpNaVFvwZLGA+MBtthii+6I1czM6ijVO253iYgFEbE8Il4Dvs+K5qi5wPDCpJsD8xqU11v2xRExJiLGbLLJJt0fvJmZAT2cOCQNKQweCNSuuJoEHCRprdzFySjgHmAKMErSyNwz70F5WjMza5FOm6ok3RoRe0j6dkScUHXBkq4ExgKDJc0lnSsZK2k0qblpNnAUQH6W+dWkk97LgKMjYnlezjHATcAA4NKImF41lt5kxIRfN30ds8/Yr+nrMLO+q9E5jiGS3gt8JF/NtNJ5iK7uHI+Ig+sUX9Jg+tOA0+qU3wDc0GhdZmbWcxoljq8DE0jnFc7qMM53jpuZ9VOdJo6IuAa4RtLXIuLUHozJzMzaWJnLcU+V9BFg91w0OSKub25YZmbWrrq8qkrS6cCxpBPXDwHH5jIzM+uHytw5vh8wOt97gaTLgD8DJzYzMDMza09l7+ModnK4YTMCMTOz3qFMjeN04M+SbiNdkrs7rm2YmfVbZU6OXylpMrATKXGcEBFPNjswMzNrT2VqHETEfNzVh5mZ0cN9VZmZWe/nxGFmZpU0TBySVis+M9zMzKxh4sj3btwnyU9GMjMzoNzJ8SHAdEn3AC/UCrt65riZmfVNZRLHN5oehZmZ9RqlnjkuaUtgVET8VtK6pIcqmZlZP1Smk8NPA9cAF+WiYcAvmxmUmZm1rzKX4x4N7AYsAYiIGcCmzQzKzMzaV5nE8UpEvFobkLQ66QmAZmbWD5VJHLdL+gqwjqQPAj8DrmtuWGZm1q7KJI4JwCLgAeAo4AbgpGYGZWZm7avMVVWv5Yc33U1qono0ItxUZWbWT3WZOCTtB1wI/JXUrfpISUdFxG+aHZyZmbWfMjcAngm8LyJmAkjaGvg14MRhZtYPlTnHsbCWNLJZwMImxWNmZm2u0xqHpI/mt9Ml3QBcTTrH8XFgSg/EZmZmbahRU9WHC+8XAO/N7xcBGzUtIjMza2udJo6IOLwnAzEzs96hTF9VIyWdJekXkibVXiXmu1TSwuKDoCRtLOkWSTPy341yuSSdJ2mmpPsl7ViYZ1yefoakcav6Qc3MrHuUOTn+S2A28F3SFVa1V1cmAnt3KJsA3BoRo4Bb8zDAPsCo/BoPXAAp0QAnA+8GdgZOriUbMzNrjTKX474cEedVXXBE3CFpRIfi/YGx+f1lwGTghFx+eb6x8C5JgyQNydPeEhHPAEi6hZSMrqwaj5mZdY8yieNcSScDNwOv1Aoj4k+rsL7NImJ+nn++pFovu8OAOYXp5uayzsrfQNJ4Um2FLbbwk27NzJqlTOJ4O/AJ4P3Aa7ks8nB3UZ2yaFD+xsKIi4GLAcaMGeMuUczMmqRM4jgQ2KrYtfo/YIGkIbm2MYQVNxLOBYYXptscmJfLx3Yon9wNcZiZ2Soqc3L8PmBQN61vElC7Mmoc8KtC+WH56qpdgMW5SesmYE9JG+WT4nvmMjMza5EyNY7NgEckTWHlcxwfaTSTpCtJtYXBkuaSro46A7ha0hHA30h3oUPqqn1fYCbwInB4Xsczkk5lxZ3q36ydKDczs9YokzhOXpUFR8TBnYzao860QXpEbb3lXApcuioxmJlZ9yvzPI7beyIQMzPrHco8j2MpK65kWhNYA3ghIjZoZmBmZtaeytQ4BhaHJR1AuovbzMz6oTJXVa0kIn5J997DYWZmvUiZpqqPFgZXA8bQyU14ZmbW95W5qqr4XI5lpA4P929KNGZm1vbKnOPwcznMzOx1jR4d+/UG80VEnNqEeMzMrM01qnG8UKdsPeAI4E2AE4eZWT/U6NGxrz+sSdJA4FhSVyBXUe5BTmZm1gc1PMeRn8D3ReAQ0oOXdoyIZ3siMDMza0+NznF8B/go6RkXb4+I53ssKjMza1uNbgA8HhgKnATMk7Qkv5ZKWtIz4ZmZWbtpdI6j8l3lZmbW9zk5mJlZJU4cZmZWiROHmZlV4sRhZmaVOHGYmVklThxmZlaJE4eZmVXixGFmZpU4cZiZWSVOHGZmVokTh5mZVeLEYWZmlThxmJlZJU4cZmZWSUsSh6TZkh6QNE3S1Fy2saRbJM3IfzfK5ZJ0nqSZku6XtGMrYjYzs6SVNY73RcToiBiThycAt0bEKODWPAywDzAqv8YDF/R4pGZm9rp2aqran/Rcc/LfAwrll0dyFzBI0pBWBGhmZq1LHAHcLOleSeNz2WYRMR8g/900lw8D5hTmnZvLViJpvKSpkqYuWrSoiaGbmfVvnT46tsl2i4h5kjYFbpH0SINpVacs3lAQcTFwMcCYMWPeMN7MzLpHS2ocETEv/10IXAvsDCyoNUHlvwvz5HOB4YXZNwfm9Vy0ZmZW1OOJQ9J6kgbW3gN7Ag8Ck4BxebJxwK/y+0nAYfnqql2AxbUmLTMz63mtaKraDLhWUm39V0TEjZKmAFdLOgL4G/DxPP0NwL7ATOBF4PCeD9nMzGp6PHFExCxghzrlTwN71CkP4OgeCM3MzEpop8txzcysF3DiMDOzSpw4zMysEicOMzOrxInDzMwqceIwM7NKnDjMzKwSJw4zM6vEicPMzCpx4jAzs0qcOMzMrJJWPY/D2tCICb9u+jpmn7Ff09dhZs3lGoeZmVXixGFmZpU4cZiZWSVOHGZmVokTh5mZVeLEYWZmlThxmJlZJU4cZmZWiROHmZlV4sRhZmaVOHGYmVklThxmZlaJOzm0tuAOFs16D9c4zMysEicOMzOrxInDzMwq6TXnOCTtDZwLDAB+EBFntDgk6yN8fsWsml6ROCQNAM4HPgjMBaZImhQRD7U2MrN/jJOW9Ua9InEAOwMzI2IWgKSrgP0BJw6zVdTKpNVf191XKCJaHUOXJH0M2DsijszDnwDeHRHHFKYZD4zPg9sCj1ZczWDgqW4It7u1a1zg2FaVY6uuXeOCvhXblhGxSVcT9ZYah+qUrZTxIuJi4OJVXoE0NSLGrOr8zdKucYFjW1WOrbp2jQv6Z2y95aqqucDwwvDmwLwWxWJm1q/1lsQxBRglaaSkNYGDgEktjsnMrF/qFU1VEbFM0jHATaTLcS+NiOndvJpVbuZqsnaNCxzbqnJs1bVrXNAPY+sVJ8fNzKx99JamKjMzaxNOHGZmVkm/TxyS9pb0qKSZkia0Op4iSbMlPSBpmqSpLY7lUkkLJT1YKNtY0i2SZuS/G7VRbKdIeiJvu2mS9m1BXMMl3SbpYUnTJR2by1u+3RrE1g7bbW1J90i6L8f2jVw+UtLdebv9NF8o0y6xTZT0WGG7je7p2HIcAyT9WdL1ebg52ywi+u2LdKL9r8BWwJrAfcB2rY6rEN9sYHCr48ix7A7sCDxYKPsvYEJ+PwH4dhvFdgrwpRZvsyHAjvn9QOAvwHbtsN0axNYO203A+vn9GsDdwC7A1cBBufxC4LNtFNtE4GOt3G45pi8CVwDX5+GmbLP+XuN4vSuTiHgVqHVlYh1ExB3AMx2K9wcuy+8vAw7o0aCyTmJruYiYHxF/yu+XAg8Dw2iD7dYgtpaL5Pk8uEZ+BfB+4Jpc3qrt1llsLSdpc2A/4Ad5WDRpm/X3xDEMmFMYnkub/HiyAG6WdG/uUqXdbBYR8yEdiIBNWxxPR8dIuj83ZbWkGa1G0gjgnaT/UNtqu3WIDdpgu+Uml2nAQuAWUsvAcxGxLE/Sst9qx9giorbdTsvb7WxJa7UgtHOALwOv5eE30aRt1t8TR5ddmbTYbhGxI7APcLSk3VsdUC9yAbA1MBqYD5zZqkAkrQ/8HDguIpa0Ko566sTWFtstIpZHxGhSLxE7A2+tN1nPRpVX2iEbWdkHAAAFeElEQVQ2SW8DTgTeAuwEbAyc0JMxSfoQsDAi7i0W15m0W7ZZf08cbd2VSUTMy38XAteSfkDtZIGkIQD578IWx/O6iFiQf+CvAd+nRdtO0hqkA/NPIuIXubgttlu92Nplu9VExHPAZNJ5hEGSajctt/y3Woht79z0FxHxCvBDen677QZ8RNJsUpP7+0k1kKZss/6eONq2KxNJ60kaWHsP7Ak82HiuHjcJGJffjwN+1cJYVlI7MGcH0oJtl9uYLwEejoizCqNavt06i61Nttsmkgbl9+sAHyCdg7kN+FierFXbrV5sjxT+ERDpPEKPbreIODEiNo+IEaTj2O8i4hCatc1afRVAq1/AvqQrSv4KfLXV8RTi2op0ldd9wPRWxwZcSWq6+DuppnYEqQ31VmBG/rtxG8X2I+AB4H7SgXpIC+J6D6lp4H5gWn7t2w7brUFs7bDd3gH8OcfwIPD1XL4VcA8wE/gZsFYbxfa7vN0eBH5MvvKqFS9gLCuuqmrKNnOXI2ZmVkl/b6oyM7OKnDjMzKwSJw4zM6vEicPMzCpx4jAzs0qcOKxPkbQ89076oKSfSVq3RXEc16p1mzWbE4f1NS9FxOiIeBvwKvCZsjNKGtCNcRwHOHFYn+TEYX3Z74E3A0g6ND9HYZqki2pJQtLzkr4p6W5gV0k7SfpDft7CPZIG5k7tviNpSu7E7qg871hJkyVdI+kRST9R8gVgKHCbpNvytBdImlp8hkMu3zfPe6ek8wrPUVgvdzI4JT9foW6vzZK+rPTMlvsknZHLPp3nu0/Sz2s1H6VnRlwo6feS/pL7N0LS9oVtc7+kUc35OqzPaNXdjX751YwX8Hz+uzqpe4XPkjrIuw5YI4/7HnBYfh/Av+T3awKzgJ3y8AZ5OeOBk3LZWsBUYCTpDt3FpD6AVgP+CLwnTzebwrNUyHeHk54BM5l0B/LapN6ZR+ZxV7Lijt//BA7N7weRejdYr8Nn3Qf4A7Buh3W8qTDNt4DP5/cTgRtzrKNId9mvDXwXOKSwDdZp9ffoV3u/ap1fmfUV6+QuryHVOC4hHfjfBUxJXQmxDis6FlxO6ugPYFtgfkRMAYjck62kPYF3SKr1+bMh6cD7KnBPRMzN000DRgB31onrX3LX+KuTHqK0HekAPisiHsvTXJljhdQ32UckfSkPrw1sQeqzqeYDwA8j4sUcb+2ZJG+T9C1SwlkfuKkwz9WROjCcIWkWqUfXPwJfVXqewy8iYkad+M1e58Rhfc1Lkbq8fl3ueO6yiDixzvQvR8Ty2qTU73ZapP/ab1qpUBoLvFIoWk6d35SkkcCXSDWZZyVNJCWCet1eF9f5/yPi0S6mqRfvROCAiLhP0idJNaOajtNHRFyRm+r2A26SdGRE/K7Beq2f8zkO6w9uBT4maVN4/ZnfW9aZ7hFgqKSd8nQDc5fUNwGfzd2QI2mb3GNxI0tJj2SF1OT1ArBY0makJqba+rZSepASwL8W5r8J+HxOekh6Z5113Ax8qnAOY+NcPhCYn+M9pMM8H5e0mqStSR3gPSppK1LN5zxSx4bv6OKzWT/nGof1eRHxkKSTSE9TXI3Ui+7RwOMdpntV0r8C381dZr9Eag76AakJ6k/5QL6Irh/BeTHwG0nzI+J9kv5M6uV4FvC/eX0vSfoccKOkp0i9mNacSnqewv15nbOBD3WI90ZJo4Gpkl4FbgC+AnyN9DS/x0k9tg4szPYocDuwGfCZiHg5f+ZDJf0deBL4Zhefzfo5945r1kKS1o+I53NyOB+YERFnN2ldE0kn36/palqzRtxUZdZan84n1aeTTrpf1OJ4zLrkGoeZmVXiGoeZmVXixGFmZpU4cZiZWSVOHGZmVokTh5mZVfJ/63SGhQ3MEu0AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36a97b3c8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 0]['percentage caps'], bins=10, range=(0, 40), rwidth=0.8)\n",
    "plt.xlabel('Percentage caps')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of percentage caps of non-spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Length"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "      <th>percentage digits</th>\n",
       "      <th>percentage question mark</th>\n",
       "      <th>percentage exclamation mark</th>\n",
       "      <th>percentage caps</th>\n",
       "      <th>length</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2.702703</td>\n",
       "      <td>111</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>6.896552</td>\n",
       "      <td>29</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Free entry in 2 a wkly comp to win FA Cup fina...</td>\n",
       "      <td>16.129032</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>6.451613</td>\n",
       "      <td>155</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>U dun say so early hor... U c already then say...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>4.081633</td>\n",
       "      <td>49</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>0</td>\n",
       "      <td>Nah I don't think he goes to usf, he lives aro...</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3.278689</td>\n",
       "      <td>61</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text  \\\n",
       "1        0  Go until jurong point, crazy.. Available only ...   \n",
       "2        0                      Ok lar... Joking wif u oni...   \n",
       "3        1  Free entry in 2 a wkly comp to win FA Cup fina...   \n",
       "4        0  U dun say so early hor... U c already then say...   \n",
       "5        0  Nah I don't think he goes to usf, he lives aro...   \n",
       "\n",
       "   percentage digits  percentage question mark  percentage exclamation mark  \\\n",
       "1           0.000000                       0.0                          0.0   \n",
       "2           0.000000                       0.0                          0.0   \n",
       "3          16.129032                       0.0                          0.0   \n",
       "4           0.000000                       0.0                          0.0   \n",
       "5           0.000000                       0.0                          0.0   \n",
       "\n",
       "   percentage caps  length  \n",
       "1         2.702703     111  \n",
       "2         6.896552      29  \n",
       "3         6.451613     155  \n",
       "4         4.081633      49  \n",
       "5         3.278689      61  "
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['length'] = df['text'].apply(len)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYgAAAEWCAYAAAB8LwAVAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3XmYHWWZ9/HvjxD2QIA0MSSQgAQdxGExIggCgiM7AQcURAQGB3llHfEdgqCGUV5xFBBGBaMgoLIJCmEZBZFFZmRJMAFCQGIIEBKyICRhCyTc7x/Pc8xJU91d3Umdc+j+fa7rXF311HZXndN1Vz1V9ZQiAjMzs/ZWaXYAZmbWmpwgzMyskBOEmZkVcoIwM7NCThBmZlbICcLMzAo5QbQYSZdI+tpKmtemkl6R1C/33y3pCytj3nl+/y3pqJU1v24s91uS5kt6oWDY7pJmNjqmvOyxkn6xkuY1WNK9khZJOm9lzNOsu1ZtdgB9iaQZwGBgCbAUeBy4EhgXEW8DRMTx3ZjXFyLi9x2NExHPAuusWNR/X95YYIuI+Fzd/PdZGfPuZhybAKcBwyNibqOXXxfH7sAvImJYRYs4DpgPrBt+WMmaxGcQjXdARAwAhgPnAqcDl67shUjqrcl/OPBiM5NDgwwHHndysKaKCH8a9AFmAJ9oV7YD8Dawde6/HPhW7h4E3AK8DPwN+CMpqf88T/M68Arw78AIIIBjgWeBe+vKVs3zuxv4NvAgsAC4CdggD9sdmFkUL7A38CbwVl7e5Lr5fSF3rwKcBTwDzCWdGa2Xh9XiOCrHNh84s5PttF6efl6e31l5/p/I6/x2juPygmmXWw9gY+CGPK+ngZPrho0FrsvLWgRMAUbVDd8e+HMe9ivgWuBbwNrt4nglL6fT+RXE+lHgofxdPAR8tO438Fbe5q/Q7jeTx9mXdAa6CHge+Er9+gNfzdt5BnBE3XT75XVaCDwHjK0bVvuejsnDXgKOBz4MPEL6Hf6gk/UZm7fTL3JcjwJbAmfk38RzwCfbfc+XArPzOnwL6JeHbQHck7fNfODaXC7ggjy/BTmurbtatzz886Tf04vA16j7fyT9vsYAf83Dr2PZ/8YaeZ1ezNvgIWBws/cnDdlnNTuAvvShIEHk8meB/5O7L2dZgvg2cAnQP38+BqhoXnX/3FeSdmBrUpwgnge2zuPcQKom+fuOpaN48z//L9oNv5tlCeJfgGnA5qRqrV8DP28X209yXNsAi4F/6GA7XUlKXgPytH8Bju0oznbT/n14/qefCHwdWC3HNh3Yq26d3iDtbPvl7X1/HrZa3pmckrf9p0g77G91sr06nF9BnBuQdsBHkqp6D8/9G7b/HXQw/WzgY7l7fWD7uriWAOcDqwO7Aa8C76sb/sG8bf4RmAMc1O57uoS0U/xkXp8bgY2AoaQd824dxFRb/73yOl1JSspn5m34r8DTdePfCPyY9FvciHTg8sU87Oo83So5ll1y+V75Ox1IShb/AAwpsW5bkZLtLvm7/R4pCdd+36cC9wPD8nb7MXB1HvZF4GZgrfy9fohU9df0fUrVH1cxtYZZpB1Ge28BQ0j17W9FxB8j/2I7MTYiXo2I1zsY/vOIeCwiXiUdRX26dhF7BR0BnB8R0yPiFdJR42HtqrrOjojXI2IyMJmUKJaTY/kMcEZELIqIGcB5pB1pd30YaIuI/4iINyNiOilJHVY3zn0RcVtELCWdmdVi2pG0k7sob/tfk3ZgXelofu3tBzwVET+PiCURcTXwBHBAyXV7C9hK0roR8VJEPNxu+NciYnFE3APcCnwaICLujohHI+LtiHiEtCPerd2034yINyLidlJyuToi5kbE86Sz2O06ieuPEfG7iFhCOptoA86NiLeAa4ARkgZKGgzsA5yaf69zSWcGte/mLVI128Y5lvvqygcA7ycdLE2NiNkl1u0Q4OaIuC8i3iQdNNT/L32RdFY7MyIWk5LdIfn3+xawIeka3NKImBgRCzvZBr2GE0RrGEqqQmrvu6Sj8tslTZc0psS8nuvG8GdIR3aDSkXZuY3z/OrnvSrponxN/V1Hr1F8AX0Qy47e6+c1tAcxDQc2lvRy7UOqeukspjXyTmFj4Pl2CbmrbdvZ/Nprv72ge+v5z6QzlWck3SNpp7phL+UDgPr5bgwg6SOS7pI0T9ICUhVS++9/Tl336wX9nd340H7c+TlZ1vrJ0w8n/fZm1303PyadSUCqNhXwoKQpkv4FICL+APwA+CEwR9I4SeuWWLeNqfv+IuI1UpVRzXDgN3WxTCXdSDKYlOh/B1wjaZak/5TUv5Nt0Gs4QTSZpA+Tdgr3tR+Wj6BPi4jNSUeWX5a0Z21wB7Ps6gxjk7ruTUlHR/NJR4pr1cXVj3T0V3a+s0j/ZPXzXsLyO4wy5rPs6LF+Xs93cz6QdghPR8TAus+AiNi3xLSzgaGSVFdWv+1W9OJx++0F3VjPiHgoIkaTdqg3kurMa9aXtHa7+c7K3VcB44FNImI9UnVS/To2ynOkasZBdd/NuhHxAYCIeCEi/jUiNiYd3f9I0hZ52EUR8SHgA6RrHP83z7OzdZtNqj4CQNKapLOC+nj2afdbWSMins9nkGdHxFak60b7k65n9HpOEE0iaV1J+5NOu38REY8WjLO/pC3yTmoh6YimdjQ2h1Sn3l2fk7SVpLWA/wCuz0d4fyEd7e6Xj47OItXF1swhVQ909Ju5Gvg3SZtJWgf4f6QLi0u6E1yO5TrgHEkDJA0Hvky6SNhdDwILJZ0uaU1J/SRtnZNyV/5E2tYnSlpV0mjSDQU1c4ANJa3Xg7gAbgO2lPTZPP/PkOrJb+lqQkmrSTpC0nq56qb226h3dh7vY6Qd2q9y+QDgbxHxhqQdgM/2MP4VkquFbgfOy/8Lq0h6r6TdACQdKqm2Q3+JlJCXSvpwPlPoTzqoeYNl697Zul0PHCDpo5JWA85m+cR4Cek3Nzwvvy1/50j6uKQP5oOmhaQDmPbbu1dygmi8myUtIh2xnEm6mHhMB+OOBH5Purj2J+BHEXF3HvZt4Kx8SvyVbiz/56QLoC+QLv6dDBARC4AvAT8lHcW+Srobpqa2g3lRUvv6boDL8rzvJV2YfAM4qRtx1TspL3866czqqjz/bsnJ5gBg2xzTfNL6dblTz/XUnyLdFfYy8DnSzntxHv4EKSlOz9/Bxt2M7UXSjvs0UlXHvwP7R8T8krM4EpghaSGpKuVzdcNeIO1UZwG/BI7P8UL6jv8j/wa/zvJnHo32eVJ14uOkeK8nXXODdP3oAUmvkM4KTomIp4F1SdeRXmLZHUnfy9N0uG4RMYX0u7qGdDaxiHTBfXEe5cK8nNvz9PcDH8nD3pNjW0iqerqHfMCi9GDrJStnc7Se2h0xZtYFSQ8Al0TEz5odS0ca8ABfr5DPcl8GRubEYwV8BmHWAUm7SXpPrgI6inTr5G+bHZf1jKQDJK2Vr898j/ScxozmRtXanCDMOvY+0u24C0hVQYfUbqm0d6XRpGq3WaTq28NK3Dbep1VexZQv7Ewg3TK4v6TNSPWAGwAPA0dGxJuSVic9WPMhUr3iZ/I98GZm1gSNOIM4hXRhp+Y7wAURMZJ0oenYXH4s6f7tLUgPzHynAbGZmVkHKj2DyLepXQGcQ7pV8QBSmzjviYgl+eGesRGxl6Tf5e4/5QeLXiA9BdthgIMGDYoRI0ZUFr+ZWW80ceLE+RHR1tV4Vbf4+X3S7XsDcv+GwMt198bPZNmTo0PJTzrm5LEgj7/cbX+SjiM1hcymm27KhAkTKl0BM7PeRlL7p/gLVVbFlB8CmxsRE+uLC0aNEsOWFUSMi4hRETGqra3LBGhmZj1U5RnEzsCBkvYlPZC1LumMYqCkVfNZxDCWNQEwk9SUwcxcxbQexe0TmZlZA1R2BhERZ0TEsIgYQWqh8Q8RcQRwF6llRUjvB7gpd4/P/eThf/AtaGZmzdOM5yBOJzU6N410jaH2NrVLSW3bTCNd0C7TcqmZmVWkIa+lzO0H3Z27p7N8o2e1cd4ADm1EPGZm1jU/SW1mZoWcIMzMrJAThJmZFXKCMDOzQg25SG1mfdOIMbdWvowZ5+5X+TL6Kp9BmJlZIScIMzMr5ARhZmaFnCDMzKyQE4SZmRVygjAzs0JOEGZmVsgJwszMCjlBmJlZIScIMzMr5ARhZmaFnCDMzKyQE4SZmRWqLEFIWkPSg5ImS5oi6excfrmkpyVNyp9tc7kkXSRpmqRHJG1fVWxmZta1Kpv7XgzsERGvSOoP3Cfpv/Ow/xsR17cbfx9gZP58BLg4/zUzsyao7Awikldyb//8iU4mGQ1cmae7HxgoaUhV8ZmZWecqvQYhqZ+kScBc4I6IeCAPOidXI10gafVcNhR4rm7ymbms/TyPkzRB0oR58+ZVGb6ZWZ9WaYKIiKURsS0wDNhB0tbAGcD7gQ8DGwCn59FVNIuCeY6LiFERMaqtra2iyM3MrCF3MUXEy8DdwN4RMTtXIy0GfgbskEebCWxSN9kwYFYj4jMzs3eq8i6mNkkDc/eawCeAJ2rXFSQJOAh4LE8yHvh8vptpR2BBRMyuKj4zM+tclXcxDQGukNSPlIiui4hbJP1BUhupSmkScHwe/zZgX2Aa8BpwTIWxmZlZFypLEBHxCLBdQfkeHYwfwAlVxWNmZt3jJ6nNzKyQE4SZmRVygjAzs0JOEGZmVsgJwszMCjlBmJlZIScIMzMr5ARhZmaFnCDMzKyQE4SZmRVygjAzs0JOEGZmVsgJwszMCjlBmJlZIScIMzMr5ARhZmaFnCDMzKyQE4SZmRWqLEFIWkPSg5ImS5oi6excvpmkByQ9JelaSavl8tVz/7Q8fERVsZmZWdeqPINYDOwREdsA2wJ7S9oR+A5wQUSMBF4Cjs3jHwu8FBFbABfk8czMrEkqSxCRvJJ7++dPAHsA1+fyK4CDcvfo3E8evqckVRWfmZl1rtJrEJL6SZoEzAXuAP4KvBwRS/IoM4GhuXso8BxAHr4A2LBgnsdJmiBpwrx586oM38ysT6s0QUTE0ojYFhgG7AD8Q9Fo+W/R2UK8oyBiXESMiohRbW1tKy9YMzNbTkPuYoqIl4G7gR2BgZJWzYOGAbNy90xgE4A8fD3gb42Iz8zM3qnLBCHpvZJWz927SzpZ0sAS07XVxpO0JvAJYCpwF3BIHu0o4KbcPT73k4f/ISLecQZhZmaNUeYM4gZgqaQtgEuBzYCrSkw3BLhL0iPAQ8AdEXELcDrwZUnTSNcYLs3jXwpsmMu/DIzp1pqYmdlKtWrXo/B2RCyRdDDw/Yj4L0l/7mqiiHgE2K6gfDrpekT78jeAQ0vEY2ZmDVDmDOItSYeTqn9uyWX9qwvJzMxaQZkEcQywE3BORDwtaTPgF9WGZWZmzdZlFVNEPC7pdGDT3P80cG7VgZmZWXOVuYvpAGAS8Nvcv62k8VUHZmZmzVWmimks6aLyywARMYl0J5OZmfViZRLEkohY0K7MzyeYmfVyZW5zfUzSZ4F+kkYCJwP/W21YZmbWbGXOIE4CPkBqvvtqYCFwapVBmZlZ85W5i+k14Mz8MTOzPqLLBCHpZt55zWEBMAH4cX4C2szMepkyVUzTgVeAn+TPQmAOsGXuNzOzXqjMRertImLXuv6bJd0bEbtKmlJVYGZm1lxlziDaJG1a68ndg3Lvm5VEZWZmTVfmDOI04D5JfyW99W0z4EuS1mbZO6TNzKyXKXMX0235+Yf3kxLEE3UXpr9fZXBmZtY8Zc4gAEYC7wPWAP5REhFxZXVhmZlZs5W5zfUbwO7AVsBtwD7AfYAThJlZL1bmIvUhwJ7ACxFxDLANsHqlUZmZWdOVSRCvR8TbwBJJ6wJzgc27mkjSJpLukjRV0hRJp+TysZKelzQpf/atm+YMSdMkPSlpr56ulJmZrbgy1yAmSBpIeihuIumhuQdLTLcEOC0iHpY0AJgo6Y487IKI+F79yJK2Ag4jtfu0MfB7SVtGxNKS62JmZitRmbuYvpQ7L5H0W2DdiHikxHSzgdm5e5GkqcDQTiYZDVwTEYuBpyVNI72H4k9dLcvMzFa+Mm+U2zk/8wCwC3C0pOHdWYikEcB2wAO56ERJj0i6TNL6uWwo8FzdZDMpSCiSjpM0QdKEefPmdScMMzPrhjLXIC4GXpO0DfDvwDN04w4mSesANwCnRsTCPL/3AtuSzjDOq41aMPk7XkwUEeMiYlREjGpraysbhpmZdVPZN8oFqQrowoi4EBhQZuaS+pOSwy8j4tcAETEnIpbmC98/IVUjQTpj2KRu8mHArHKrYWZmK1uZBLFI0hnA54BbJfUD+nc1kSQBlwJTI+L8uvIhdaMdDDyWu8cDh0laXdJmpIfzylwMNzOzCpS5i+kzwGeBYyPihdxY33dLTLczcCTwqKRJueyrwOGStiVVH80AvggQEVMkXQc8TroD6gTfwWRm1jxlEsQiUtXSUklbktpkurqriSLiPoqvK9zWyTTnAOeUiMnMzCpWporpXmB1SUOBO4FjgMurDMrMzJqvTIJQfi/1p4D/ioiDSQ+zmZlZL1YqQUjaCTgCuDWX9asuJDMzawVlEsSpwBnAb/KF5M2Bu6oNy8zMmq1MUxv3APfUnqaOiOnAyVUHZmZmzVWmqY2dJD0OTM3920j6UeWRmZlZU5WpYvo+sBfwIkBETAZ2rTIoMzNrvjIJgoh4rl2RH2AzM+vlyjwo95ykjwIhaTXS9Yep1YZlZmbNVuYM4njgBFLT2zNJrbCeUGVQZmbWfGXuYppPegbCzMz6kC4TRG5Z9SRgRP34EXFgdWGZmVmzlbkGcSOp2e6bgberDcfMzFpFmQTxRkRcVHkkZmbWUsokiAslfQO4HVhcK4yIhyuLyszMmq5Mgvgg6cU/e7Csiilyv5mZ9VJlEsTBwOYR8WbVwZiZWeso8xzEZGBg1YGYmVlrKZMgBgNPSPqdpPG1T1cTSdpE0l2SpkqaIumUXL6BpDskPZX/rp/LJekiSdMkPSJp+xVbNTMzWxFlqpi+0cN5LwFOi4iHJQ0AJkq6AzgauDMizpU0BhgDnA7sA4zMn48AF+e/ZmbWBGXfB9FtETEbmJ27F0maSmquYzSwex7tCuBuUoIYDVwZEQHcL2mgpCF5PmZm1mClWnNdUZJGANsBDwCDazv9/HejPNpQoL7V2Jm5rP28jpM0QdKEefPmVRm2mVmfVnmCkLQOcANwakQs7GzUgrJ4R0HEuIgYFRGj2traVlaYZmbWTocJQtKd+e93ejpzSf1JyeGXEfHrXDxH0pA8fAgwN5fPBDapm3wYMKunyzYzsxXT2RnEEEm7AQdK2k7S9vWfrmYsSaQ2nKZGxPl1g8YDR+Xuo4Cb6so/n+9m2hFY4OsPZmbN09lF6q+T7jAaBpzfbliZJ6l3Jj2B/aikSbnsq8C5wHWSjgWeBQ7Nw24D9gWmAa8Bx5RcBzMzq0CHCSIirgeul/S1iPhmd2ccEfdRfF0BYM+C8QO/iMjMrGWUuc31m5IOBHbNRXdHxC3VhmVmZs3W5V1Mkr4NnAI8nj+n5DIzM+vFyjxJvR+wbUS8DSDpCuDPwBlVBmZmZs1V9jmI+sb61qsiEDMzay1lziC+DfxZ0l2ki8674rMHM7Ner8xF6qsl3Q18mJQgTo+IF6oOzMzMmqvMGUStzaQum/g2M7PeoyGN9ZmZ2buPE4SZmRXqNEFIWkXSY40KxszMWkenCSI/+zBZ0qYNisfMzFpEmYvUQ4Apkh4EXq0VRsSBlUVlZmZNVyZBnF15FGZm1nJKvZNa0nBgZET8XtJaQL/qQzMzs2Yq01jfvwLXAz/ORUOBG6sMyszMmq/Mba4nkF7+sxAgIp4CNqoyKDMza74yCWJxRLxZ65G0KumNcmZm1ouVSRD3SPoqsKakfwJ+BdxcbVhmZtZsZRLEGGAe8CjwRdK7o8/qaiJJl0maW/+gnaSxkp6XNCl/9q0bdoakaZKelLRX91fFzMxWpjJ3Mb2dXxL0AKlq6cn8/uiuXA78ALiyXfkFEfG9+gJJWwGHAR8ANgZ+L2nLiFhaYjlmZlaBMncx7Qf8FbiItMOfJmmfrqaLiHuBv5WMYzRwTUQsjoingWnADiWnNTOzCpSpYjoP+HhE7B4RuwEfBy5YgWWeKOmRXAW1fi4bCjxXN87MXPYOko6TNEHShHnz5q1AGGZm1pkyCWJuREyr658OzO3h8i4G3gtsC8wmJR9ILyJqr7AaKyLGRcSoiBjV1tbWwzDMzKwrHV6DkPSp3DlF0m3AdaSd9qHAQz1ZWETMqZv/T4Bbcu9MYJO6UYcBs3qyDDMzWzk6u0h9QF33HGC33D0PWP+do3dN0pD8djqAg4HaHU7jgasknU+6SD0SeLAnyzAzs5WjwwQREcesyIwlXQ3sDgySNBP4BrC7pG1JZyIzSLfNEhFTJF0HPA4sAU7wHUxmZs3V5W2ukjYDTgJG1I/fVXPfEXF4QfGlnYx/DnBOV/GYmVljlGnu+0bSjv1m4O1qwzEzs1ZRJkG8EREXVR6JmZm1lDIJ4kJJ3wBuBxbXCiPi4cqiMjOzpiuTID4IHAnswbIqpsj9ZmbWS5VJEAcDm9c3+W1mZr1fmSepJwMDqw7EzMxaS5kziMHAE5IeYvlrEJ3e5mpmZu9uZRLENyqPwswqM2LMrZUvY8a5+1W+DGu8Mu+DuKcRgZiZWWsp8yT1Ipa1rLoa0B94NSLWrTIwMzNrrjJnEAPq+yUdhF/mY2bW65W5i2k5EXEjfgbCzKzXK1PF9Km63lWAUXTwMh8zM+s9ytzFVP9eiCWkZrpHVxKNmZm1jDLXIFbovRBmZvbu1NkrR7/eyXQREd+sIB4zM2sRnZ1BvFpQtjZwLLAh4ARhZtaLdfbK0fNq3ZIGAKcAxwDXAOd1NJ2ZmfUOnV6DkLQB8GXgCOAKYPuIeKnMjCVdBuwPzI2Irevmdy3p9aUzgE9HxEuSBFwI7Au8Bhzt902Y2YpwEyMrrsPnICR9F3gIWAR8MCLGlk0O2eXA3u3KxgB3RsRI4M7cD7APMDJ/jgMu7sZyzMysAp09KHcasDFwFjBL0sL8WSRpYVczjoh7gb+1Kx5NOhMh/z2orvzKSO4HBkoa0p0VMTOzlauzaxDdfsq6hMERMTvPf7akjXL5UOC5uvFm5rLZFcRgZmYlVJEEekIFZYVPa0s6TtIESRPmzZtXcVhmZn1XoxPEnFrVUf47N5fPBDapG28YMKtoBhExLiJGRcSotra2SoM1M+vLGp0gxgNH5e6jgJvqyj+vZEdgQa0qyszMmqNMW0w9IulqYHdgkKSZpDfTnQtcJ+lY4Fng0Dz6baRbXKeRbnN18x5mZk1WWYKIiMM7GLRnwbgBnFBVLGZm1n2tcpHazMxajBOEmZkVcoIwM7NCThBmZlbICcLMzAo5QZiZWSEnCDMzK+QEYWZmhZwgzMyskBOEmZkVcoIwM7NCThBmZlbICcLMzAo5QZiZWSEnCDMzK+QEYWZmhZwgzMyskBOEmZkVcoIwM7NClb2TujOSZgCLgKXAkogYJWkD4FpgBDAD+HREvNSM+MzMrEkJIvt4RMyv6x8D3BkR50oak/tPb05oZivXiDG3Vr6MGefuV/kyrG9ppSqm0cAVufsK4KAmxmJm1uc1K0EEcLukiZKOy2WDI2I2QP67UdGEko6TNEHShHnz5jUoXDOzvqdZVUw7R8QsSRsBd0h6ouyEETEOGAcwatSoqCpAM7O+rilnEBExK/+dC/wG2AGYI2kIQP47txmxmZlZ0vAEIWltSQNq3cAngceA8cBRebSjgJsaHZuZmS3TjCqmwcBvJNWWf1VE/FbSQ8B1ko4FngUObUJsZmaWNTxBRMR0YJuC8heBPRsdj5mZFWul21zNzKyFOEGYmVkhJwgzMyvkBGFmZoWcIMzMrJAThJmZFXKCMDOzQs1s7tusoapuctvNbVtv4wRhDeWdtNm7h6uYzMyskBOEmZkVcoIwM7NCvgbRB/k6gJmV4TMIMzMr5ARhZmaFnCDMzKyQE4SZmRVygjAzs0ItdxeTpL2BC4F+wE8j4twmh7TSVX0XEfhOIjNbcS2VICT1A34I/BMwE3hI0viIeLy5kZmZlddbDgJbKkEAOwDTImI6gKRrgNHASk8QveULNDOriiKi2TH8naRDgL0j4gu5/0jgIxFxYt04xwHH5d73AU92YxGDgPkrKdyVzbH1jGPrvlaNCxxbT3U3tuER0dbVSK12BqGCsuUyWESMA8b1aObShIgY1ZNpq+bYesaxdV+rxgWOraeqiq3V7mKaCWxS1z8MmNWkWMzM+rRWSxAPASMlbSZpNeAwYHyTYzIz65NaqoopIpZIOhH4Hek218siYspKXESPqqYaxLH1jGPrvlaNCxxbT1USW0tdpDYzs9bRalVMZmbWIpwgzMysUJ9JEJL2lvSkpGmSxjQ5lk0k3SVpqqQpkk7J5WMlPS9pUv7s24TYZkh6NC9/Qi7bQNIdkp7Kf9dvQlzvq9sukyQtlHRqs7aZpMskzZX0WF1Z4XZSclH+7T0iafsmxPZdSU/k5f9G0sBcPkLS63Xb75ImxNbhdyjpjLzdnpS0VxNiu7YurhmSJuXyhm23TvYX1f/eIqLXf0gXvP8KbA6sBkwGtmpiPEOA7XP3AOAvwFbAWOArTd5WM4BB7cr+ExiTu8cA32mB7/MFYHizthmwK7A98FhX2wnYF/hv0nM+OwIPNCG2TwKr5u7v1MU2on68Jm23wu8w/09MBlYHNsv/w/0aGVu74ecBX2/0dutkf1H5762vnEH8vQmPiHgTqDXh0RQRMTsiHs7di4CpwNBmxVPCaOCK3H0FcFATYwHYE/hrRDzTrAAi4l7gb+2KO9pOo4ErI7kfGChpSCNji4jbI2JJ7r2f9IxRw3Ww3ToyGrgmIhZHxNPANNL/csNjkyTg08DVVS2/I53sLyr/vfWVBDEUeK6ufyYtskOWNALYDnggF52YTwsva0ZVDunJ9dslTVRq1gRgcETMhvRjBTZqQlz1DmP5f9Rmb7OajrZTq/3+/oV0hFmzmaQ/S7pH0seaFFPRd9hK2+1jwJyIeKqurOHbrd3+ovLfW19JEF024dEMktYBbgBx89ZFAAAF+UlEQVROjYiFwMXAe4FtgdmkU9pG2zkitgf2AU6QtGsTYuiQ0gOUBwK/ykWtsM260jK/P0lnAkuAX+ai2cCmEbEd8GXgKknrNjisjr7DltluwOEsf1DS8O1WsL/ocNSCsh5tt76SIFquCQ9J/Ulf9i8j4tcAETEnIpZGxNvAT6jwdLojETEr/50L/CbHMKd2ipr/zm10XHX2AR6OiDnQGtusTkfbqSV+f5KOAvYHjohcWZ2rb17M3RNJ9fxbNjKuTr7DVtluqwKfAq6tlTV6uxXtL2jA762vJIiWasIj12deCkyNiPPryuvrCQ8GHms/bcVxrS1pQK2bdGHzMdK2OiqPdhRwUyPjame5I7lmb7N2OtpO44HP57tLdgQW1KoGGkXpRVynAwdGxGt15W1K72FB0ubASGB6g2Pr6DscDxwmaXVJm+XYHmxkbNkngCciYmatoJHbraP9BY34vTXiKnwrfEhX9v9CyvRnNjmWXUinfI8Ak/JnX+DnwKO5fDwwpMFxbU66a2QyMKW2nYANgTuBp/LfDZq03dYCXgTWqytryjYjJanZwFukI7ZjO9pOpFP+H+bf3qPAqCbENo1UL137vV2Sx/3n/F1PBh4GDmhCbB1+h8CZebs9CezT6Nhy+eXA8e3Gbdh262R/UfnvzU1tmJlZob5SxWRmZt3kBGFmZoWcIMzMrJAThJmZFXKCMDOzQk4Q1tIkvVLx/I+WtHFd/wxJg1ZgflfnJiP+beVEaNY8LfXKUbMmOJr0YNYKP6Er6T3ARyNi+IrOy6wV+AzC3nXyU6w3SHoof3bO5WNzY293S5ou6eS6ab6m9D6EO/JR/lckHQKMAn6Z2/RfM49+kqSHld6L8f6C5a8h6Wd5+J8lfTwPuh3YKM/rY+2muVzSxUrt+k+XtFuOdaqky+vG+6SkP+Xl/yq3v4OkcyU9ns9OvpfLDpX0mKTJku7NZSMk/TFP/7Ckj+byVST9SOl9ArdIui2vP5I+lBucmyjpd6qwpVl7l6nyyUR//FnRD/BKQdlVwC65e1NSEwSQ3ivwv6T3BwwiPXXdn5QEJgFrktrTf4r8/gHgbuqeNCW9D+Ok3P0l4KcFyz8N+Fnufj/wLLAGnbwjgPQ07jWkp1xHAwuBD5IO0iaSGqobBNwLrJ2nOR34OrAB6Uni2oOtA/PfR4Gh7crWAtbI3SOBCbn7EOC2vLz3AC/lsv55m7Xl8T4DXNbs792f1vi4isnejT4BbJWaqAFg3VobUsCtEbEYWCxpLjCY1FTBTRHxOoCkm7uYf60xtImkRtra2wX4L4CIeELSM6SG2jprYRPg5ogISY+Smo5+NMczhZRchpFeBPM/ed1WA/6U5/sG8FNJtwK35Pn9D3C5pOvqYu4P/EDStsBSljUgtwvwq0gN4r0g6a5c/j5ga+COvMx+pOYmzJwg7F1pFWCn2g6/Ju/gFtcVLSX9xouaP+5MbR616dvr7vzaz/dtlo/z7bycpcAdEXH4OxYo7UB6UdJhwInAHhFxvKSPAPsBk3JSOAmYA2xD2k5vdBGzgCkRsVMP18l6MV+DsHej20k7SQDyjrEz9wEH5GsH65B2qDWLSNVO3XEvcERe9pakaq4nuzmPIvcDO0vaIs97LUlb5pjXi4jbgFNJ1VFIem9EPBARXwfmk5p4Xg+Ync8UjiSdEUDaBv+cr0UMBnbP5U8CbZJ2yvPsL+kDK2FdrBfwGYS1urUkzazrPx84GfihpEdIv+F7geM7mkFEPCRpPKnlzWeACcCCPPhy4BJJrwNlj6J/lKd5lPTynaMjYnFdlVePRMQ8SUcDV0taPRefRUpiN0lag3TEX7uF9ruSRuayO0nr9yPgBkmHAncBr+ZxbyCdgTxGatX4AVIz0G/mi9UXSVqPtD2/T2qp1Po4t+ZqfYKkdSLiFUlrkRLKcZHf89tX1G2DDUnvVdg5Il5odlzWunwGYX3FOElbke42uqKvJYfsFkkDSRe/v+nkYF3xGYSZmRXyRWozMyvkBGFmZoWcIMzMrJAThJmZFXKCMDOzQv8fGBqCnmTQVvMAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36a9d2748>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 1]['length'], bins=10, range=(0, 200), rwidth=0.8)\n",
    "plt.xlabel('Length of message')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of length of spam messages.')\n",
    "plt.show()\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY4AAAEWCAYAAABxMXBSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xm8HFWZ//HP17CvAXJBSIAECWjEUWIGQRRQFNmjDgioEBicyMim4g/CIqDAiOMGqMAgRBaREEElLAqIQEaHJQkQIIQlhAAxIQv7Gkjy/P44p03n0rdv1723l5v7fb9e/erqU9vT1dX1VNWpOqWIwMzMrFbvaXYAZmbWuzhxmJlZIU4cZmZWiBOHmZkV4sRhZmaFOHGYmVkhThxNIOlCSd/toWltJuk1Sf3y5zskfa0npp2n9ydJo3pqegXme6akhZKeq9BvF0mzGx1Tnvfpkn7TQ9PaSNJESa9K+klPTNOsEVZqdgArGkmzgI2AxcAS4BHgcuCiiFgKEBFHFJjW1yLiLx0NExHPAGt1L+p/zu90YMuI+GrZ9PfoiWkXjGNT4Dhg84iY3+j5l8WxC/CbiBhUp1mMBhYC64RvqLJexEcc9bFPRKwNbA6cDZwAXNLTM5G0oib+zYHnm5k0GmRz4BEnDet1IsKvHnwBs4DPtCvbDlgKbJM/XwqcmbsHADcALwEvAP9LSuhX5HHeBF4DjgcGAwEcDjwDTCwrWylP7w7gB8C9wMvAdcD6ud8uwOxK8QK7A28D7+T5TS2b3tdy93uAU4CngfmkI6l1c79SHKNybAuBk6ssp3Xz+Avy9E7J0/9M/s5LcxyXVhh3ue8BbAJcm6f1FHBMWb/TgfF5Xq8C04ARZf2HA/fnfr8DrgbOBNZsF8dreT5Vp1ch1o8Dk/JvMQn4eNk68E5e5q/Rbp0pG+aXwI15XvcA7+ts2mW/2xnA3/O4twADqsR5KDAzD/sU8JWy8r8DP8/zeRTYtWy8w4DpebyZwNfb/06kdXc+MBf4PLAn8DhpfT+pSkyXAucDf8rL6O/Ae4FzgBdzLNvWuB5sB0wGXgHmAT/N5asBvwGeJ/0HJwEbdfbdcv/j83eaA3yNtP5vmfutCvyY9F+YB1wIrF7tP9/sbVeh7VyzA1jRXlRIHLn8GeA/c/elLEscP8gr1cr59UlAlabFso3z5aQN2+pUThz/ALbJw1xLOt3yzz9yR/GSNoq/adf/DpYljn8HZgBbkE6P/R64ol1sv8pxfRhYBHygg+V0OSmprZ3HfRw4vKM42437z/6kZDMFOBVYJcc2E/hc2Xd6i7Sx6peX99253yqkpHVsXvZfJG3Iz6yyvDqcXoU41ydt4A4mnRY+KH/eoP160MH4l5I2LNvl8a8ExtU47TuAJ4Gt8u9xB3B2B/NZk7RB3Tp/3hj4YO4+lHTa9Vt5GR1ASiClnZG9gPcBAnYG3gCGly2/xfm3WRn4D9JG/bf5d/9gXpZbVPn+C4GPkjbwfyUlhEPysj8TuL3G9eAu4ODcvRawfe7+OnA9sEae5kdJpw47+267A8/l77AGaUevPHGcA0zIv9PaeR4/6Ow/31tePlXVOHNIK1F775D+qJtHxDsR8b+R164qTo+I1yPizQ76XxERD0fE68B3gS+VKs+76SukPbWZEfEacCJwYLtTZt+LiDcjYiowlZRAlpNjOQA4MSJejYhZwE9IG8Gi/hVoi4jvR8TbETGTlLwOLBvmbxFxU0QsIf3BSzFtT9ronpeX/e9JR2qd6Wh67e0FPBERV0TE4oi4irSXvE+B7/f7iLg3IhaTEsdHCkz71xHxeF5PxpeNW8lSYBtJq0fE3IiYVtZvPnBOXkZXA4/l+RMRN0bEk5HcSTqy+WTZuO8AZ0XEO8A40t72ufl3n0Y6YvuXKnH9ISKmRMRbwB+AtyLi8rzsrwa2zcN1th68A2wpaUBEvBYRd5eVb0Da4C/J83qlhu/2pbx8p0XEG8D3SgFLEilJfisiXoiIV4H/ahdL0f98S3HiaJyBpL3H9n5E2ou/RdJMSWNqmNazBfo/TdqrGVBTlNVtkqdXPu2VSBcDlJRfBfUGlSvuB7Bsb798WgO7ENPmwCaSXiq9gJM6iWm1nOw2Af7R7k/b2bKtNr322i8vKP49O1qetUy74rj5qr7X8uukvINxAHAEMFfSjZLeXzZu+2X0dJ4/kvaQdLekF/Ky35Pl17Xn80Ye0qk/SKduKCurdnFH+2E7Grez9eBw0tHXo5ImSdo7l18B3AyMkzRH0n9LWrmG77YJy68r5d1tpKOQKWWx/DmXQ9f+8y3FiaMBJP0r6Q/9t/b98p7XcRGxBWlv8duSdi317mCSne2dbFrWvRlpD2ch8DpphS7F1Y9lK3Mt051D+oOWT3sxy/+Za7Ewx9R+Wv8oOB1If9inIqJ/2WvtiNizhnHnAgPzHmJJ+bLr7l5g++UFXf+ePTbtiDgiItbKr//KZTdHxGdJe8KPkvbWS9ovo82AOZJWJZ0K/TGpXqA/cBPp1E6jVV0PIuKJiDgI2BD4IXCNpDXzHv/3ImIYqc5ob+CQGr7bXKD8arvy9WYhKal9sCyWdSNirRxLtf98r+DEUUeS1sl7NuNIdQcPVRhmb0lb5j/mK6RLeEt7aPNI52qL+qqkYZLWAL4PXJP3+h4n7R3vlfeqTiFV4pXMAwZL6mi9uAr4lqQhktYiHX5fnU+j1CzHMh44S9LakjYHvk2qpCzqXuAVSSdIWl1SP0nb5GTdmbtIy/ooSStJGkmqTyiZB2wgad0uxAVpQ7OVpC/n6R8ADCNVjHZXj00730+yr6Q1SfVSr7FsHYS0sT1G0sqS9gc+kOe/Cmn9WQAslrQHsFu3vlXXVV0PJH1VUlukS+JfyuMskfQpSR/KO1GvkHZoltD5dxsPHCbpA/l/dmqpR57Hr4CfSdowz3+gpM/l7mr/+V7BiaM+rpf0Kmkv6GTgp6QrNCoZCvyF9Ge9Czg/Iu7I/X4AnJIPd79TYP5XkCoWnyNVKh4DEBEvA98ALibtmb5Ouuql5Hf5/XlJ91WY7tg87YmkSsq3gKMLxFXu6Dz/maQjsd/m6ReSk9A+pPP3T5H29i4mXbXV2bhvkyrEDydtTL5K2vAuyv0fJSXLmfk32KRgbM+T9mCPI121czywd0QsLDKdBkz7PXk6c0inU3cmrScl95DW04XAWcB+EfF8Pnd/DGkj+iLwZVKFcMPVsB7sDkyT9BpwLnBgrjd5L3ANaQM+HbiTtJNX9btFxJ+A84DbSaed7sq9FuX3E3L53ZJeIf3Ht879OvzPK91we1KPLJQ6Kl29Y2aApHuACyPi182OpRVIOpR0Vd0nmh1LK5P0AeBhYNWiR+C9kY84rE+TtLOk9+bTPaNIV/j8udlxWeuT9AVJq0haj1Rvcn1fSBrgxGG2Nemy4ZdJp2v2i4i5zQ3Jeomvk+pAniTVUfxnc8NpnLqdqpI0lnQOdn5EbFNWfjRwFOlqnBsj4vhcfiLpXPMS0h2fN+fy3UnnJPsBF0fE2XUJ2MzMalLPxLETqfLn8lLikPQpUmXxXhGxSNKGETFf0jBSJeR2pOuj/0K65hrSlUCfJVXiTgIOiohH6hK0mZl1qm6N5EXEREmD2xX/J6nZg9JVK6VG7EaSmlJYBDwlaQbLLoucke8CRdK4PGzVxDFgwIAYPLj9rM3MrJopU6YsjIi2zoZrdOuqWwGflHQW6VLO70TEJNLNcXeXDTebZXfAPtuu/GOVJixpNKmZajbbbDMmT57cw6Gbma3YJLVvjaCiRleOrwSsR2oj6P8B4/NNMJXuNI0q5e8ujLgoIkZExIi2tk4TppmZdVGjjzhmkxptC+BeSUtJbb/MZvlb9geRbkaiSrmZmTVBo484/gh8GkDSVqTb+heS7sg8UNKqkoaQ7qy8l1QZPjQ3cbEKqXXJptyZamZmSd2OOCRdRWqPf4DS86FPIzUpMVbSw6TnHozKRx/TJI0nVXovBo4stagp6ShS65X9gLGxfHPPZmbWYCtkkyMjRowIV46bmRUjaUpEjOhsON85bmZmhThxmJlZIU4cZmZWiBOHmZkV0uj7OKwTg8fcWPd5zDp7r7rPw8xWXD7iMDOzQpw4zMysECcOMzMrxInDzMwKceIwM7NCnDjMzKwQJw4zMyvEicPMzApx4jAzs0KcOMzMrBAnDjMzK8SJw8zMCnHiMDOzQuqWOCSNlTQ/P1+8fb/vSApJA/JnSTpP0gxJD0oaXjbsKElP5NeoesVrZma1qecRx6XA7u0LJW0KfBZ4pqx4D2Bofo0GLsjDrg+cBnwM2A44TdJ6dYzZzMw6UbfEERETgRcq9PoZcDwQZWUjgcsjuRvoL2lj4HPArRHxQkS8CNxKhWRkZmaN09A6Dkn7Av+IiKnteg0Eni37PDuXdVReadqjJU2WNHnBggU9GLWZmZVrWOKQtAZwMnBqpd4VyqJK+bsLIy6KiBERMaKtra3rgZqZWVWNPOJ4HzAEmCppFjAIuE/Se0lHEpuWDTsImFOl3MzMmqRhiSMiHoqIDSNicEQMJiWF4RHxHDABOCRfXbU98HJEzAVuBnaTtF6uFN8tl5mZWZPU83Lcq4C7gK0lzZZ0eJXBbwJmAjOAXwHfAIiIF4AzgEn59f1cZmZmTbJSvSYcEQd10n9wWXcAR3Yw3FhgbI8GZ2ZmXeY7x83MrBAnDjMzK8SJw8zMCnHiMDOzQpw4zMysECcOMzMrxInDzMwKceIwM7NCnDjMzKwQJw4zMyvEicPMzApx4jAzs0KcOMzMrBAnDjMzK8SJw8zMCnHiMDOzQpw4zMysECcOMzMrpJ7PHB8rab6kh8vKfiTpUUkPSvqDpP5l/U6UNEPSY5I+V1a+ey6bIWlMveI1M7Pa1POI41Jg93ZltwLbRMS/AI8DJwJIGgYcCHwwj3O+pH6S+gG/BPYAhgEH5WHNzKxJ6pY4ImIi8EK7slsiYnH+eDcwKHePBMZFxKKIeAqYAWyXXzMiYmZEvA2My8OamVmTNLOO49+BP+XugcCzZf1m57KOyt9F0mhJkyVNXrBgQR3CNTMzaFLikHQysBi4slRUYbCoUv7uwoiLImJERIxoa2vrmUDNzOxdVmr0DCWNAvYGdo2IUhKYDWxaNtggYE7u7qjczMyaoNMjDknvk7Rq7t5F0jHlV0MVIWl34ARg34h4o6zXBOBASatKGgIMBe4FJgFDJQ2RtAqpAn1CV+ZtZmY9o5ZTVdcCSyRtCVwCDAF+29lIkq4C7gK2ljRb0uHAL4C1gVslPSDpQoCImAaMBx4B/gwcGRFLckX6UcDNwHRgfB7WzMyapJZTVUsjYrGkLwDnRMTPJd3f2UgRcVCF4kuqDH8WcFaF8puAm2qI08zMGqCWI453JB0EjAJuyGUr1y8kMzNrZbUkjsOAHYCzIuKpXAfxm/qGZWZmrarTU1UR8YikE4DN8uengLPrHZiZmbWmWq6q2gd4gFRpjaSPSPKVTWZmfVQtp6pOJzX98RJARDxAurLKzMz6oFoSx+KIeLldWcW7t83MbMVXy+W4D0v6MtBP0lDgGOD/6huWmZm1qlqOOI4mNXe+CLgKeAX4Zj2DMjOz1lXLVVVvACfnl5mZ9XGdJg5J1/PuOo2XgcnA/0TEW/UIzMzMWlMtp6pmAq8Bv8qvV4B5wFb5s5mZ9SG1VI5vGxE7lX2+XtLEiNhJkhscNDPrY2o54miTtFnpQ+4ekD++XZeozMysZdVyxHEc8DdJT5KeyDcE+IakNYHL6hmcmZm1nlquqrop37/xflLieLSsQvycegZnZmatp9ZHxw4FtgZWA/5FEhFxef3CMjOzVlXL5binAbsAw0gPVNoD+BvgxGFm1gfVcsSxH/Bh4P6IOEzSRsDF9Q3LmmHwmBvrPo9ZZ+9V93mYWX3VclXVmxGxFFgsaR1gPrBFZyNJGitpvqSHy8rWl3SrpCfy+3q5XJLOkzRD0oOShpeNMyoP/4SkUcW/opmZ9aRaEsdkSf1JN/tNAe4D7q1hvEuB3duVjQFui4ihwG35M6TTX0PzazRwAaREA5wGfIzUtPtppWRjZmbN0WniiIhvRMRLEXEh8FlgVEQcVsN4E4EX2hWPZNklvJcBny8rvzySu4H+kjYGPgfcGhEvRMSLwK28OxmZmVkD1fIEwB3zPRsAnwAOlbR5F+e3UUTMBcjvG+bygcCzZcPNzmUdlVeKc7SkyZImL1iwoIvhmZlZZ2o5VXUB8IakDwPHA0/T81dUqUJZVCl/d2HERRExIiJGtLW19WhwZma2TK1PAAzS6aRzI+JcYO0uzm9ePgVFfp+fy2cDm5YNNwiYU6XczMyapJbE8aqkE4GvAjdK6ges3MX5TQBKV0aNAq4rKz8kX121PfByPpV1M7CbpPVypfhuuczMzJqklvs4DgC+DBweEc/lRg5/1NlIkq4i3Tg4QNJs0tVRZwPjJR0OPAPsnwe/CdgTmAG8ARwGEBEvSDoDmJSH+35EtK9wNzOzBqolcbxKOkW1RNJWpDarrupspIg4qINeu1YYNoAjO5jOWGBsDXGamVkD1HKqaiKwqqSBpHsvDiPdo2FmZn1QLYlD+bnjXwR+HhFfAD5Y37DMzKxV1ZQ4JO0AfAUoNWbUr34hmZlZK6slcXwTOBH4Q0RMk7QFcHt9wzIzs1ZVy4Oc7gTuLN09HhEzgWPqHZiZmbWmWpoc2UHSI8D0/PnDks6ve2RmZtaSajlVdQ6pscHnASJiKrBTPYMyM7PWVUviICKebVe0pA6xmJlZL1DLDYDPSvo4EJJWIdVvTK9vWGZm1qpqOeI4gnRX90BSo4MfoYO7vM3MbMVXy1VVC0n3cJiZmXWeOCQNAY4GBpcPHxH71i8sMzNrVbXUcfwRuAS4Hlha33DMzKzV1ZI43oqI8+oeiZmZ9Qq1JI5zJZ0G3AIsKhVGxH11i8rMzFpWLYnjQ8DBwKdZdqoq8mczM+tjakkcXwC2iIi36x2MmZm1vlru45gK9K93IGZm1jvUcsSxEfCopEksX8fR5ctxJX0L+BrplNdDpKcKbgyMA9YH7gMOjoi3Ja0KXA58lNRe1gERMaur8zYzs+6pJXGc1pMzzI+gPQYYFhFvShoPHAjsCfwsIsZJuhA4HLggv78YEVtKOhD4IXBAT8ZkZma1q/V5HPWY7+qS3gHWAOaSKtu/nPtfBpxOShwjczfANcAvJCkiog5xmZlZJ2pqHbcnRcQ/gB8Dz5ASxsvAFOCliFicB5tNahuL/P5sHndxHn6D9tOVNFrSZEmTFyxYUN8vYWbWhzU8cUhaj3QUMQTYBFgT2KPCoKUjClXpt6wg4qKIGBERI9ra2noqXDMza6fDxCHptvz+wx6e52eApyJiQUS8A/we+DjQX1Lp1NkgYE7ung1smmNZCVgXeKGHYzIzsxpVO+LYWNLOwL6StpU0vPzVjXk+A2wvaQ1JAnYFHgFuB/bLw4wCrsvdE/Jncv+/un7DzKx5qlWOnwqMIe39/7Rdvy7fOR4R90i6hnTJ7WLgfuAi4EZgnKQzc9kleZRLgCskzSAdaRzYlfmamVnP6DBxRMQ1wDWSvhsRZ/TkTCPiNN59me9MYLsKw74F7N+T8zczs66r5XLcMyTtC+yUi+6IiBvqG5aZmbWqTq+qkvQD4FhSPcQjwLG5zMzM+qBa7hzfC/hIRCwFkHQZqQ7ixHoGZmZmranW+zjKGzlctx6BmJlZ71DLEccPgPsl3U66GW8nfLRhZtZn1VI5fpWkO4B/JSWOEyLiuXoHZmZmramWIw4iYi7pRjwzM+vjGt5WlZmZ9W5OHGZmVkjVxCHpPZIeblQwZmbW+qomjnzvxlRJmzUoHjMza3G1VI5vDEyTdC/weqmwO88cNzOz3quWxPG9ukdhZma9Rk3PHJe0OTA0Iv4iaQ2gX/1DMzOzVlRLI4f/AVwD/E8uGgj8sZ5BmZlZ66rlctwjgR2BVwAi4glgw3oGZWZmrauWxLEoIt4ufcjP/fajW83M+qhaEsedkk4CVpf0WeB3wPX1DcvMzFpVLYljDLAAeAj4OnATcEp3Ziqpv6RrJD0qabqkHSStL+lWSU/k9/XysJJ0nqQZkh6UNLw78zYzs+6p5aqqpfnhTfeQTlE9FhHdPVV1LvDniNhP0irAGsBJwG0RcbakMaSEdQKwBzA0vz4GXJDfbQUyeMyNdZ/HrLP3qvs8zPqCWq6q2gt4EjgP+AUwQ9IeXZ2hpHVIz/S4BCAi3o6Il4CRwGV5sMuAz+fukcDlkdwN9Je0cVfnb2Zm3VPLqaqfAJ+KiF0iYmfgU8DPujHPLUinvn4t6X5JF0taE9goN99easa9dOXWQODZsvFn57LlSBotabKkyQsWLOhGeGZmVk0tiWN+RMwo+zwTmN+Nea4EDAcuiIhtSc2YjKkyvCqUvetUWURcFBEjImJEW1tbN8IzM7NqOqzjkPTF3DlN0k3AeNIGe39gUjfmORuYHRH35M/XkBLHPEkbR8TcfCpqftnwm5aNPwiY0435m5lZN1Q74tgnv1YD5gE7A7uQTjOt19UZ5sfOPitp61y0K/AI6QmDo3LZKOC63D0BOCRfXbU98HLplJaZmTVeh0ccEXFYHed7NHBlvqJqJnAYKYmNl3Q48AzpyAbS5b97AjOAN/KwZmbWJJ1ejitpCGlDP7h8+O40qx4RDwAjKvTatcKwQWr2xMzMWkAtzar/kXTp7PXA0vqGY2Zmra6WxPFWRJxX90jMzKxXqCVxnCvpNOAWYFGpMCLuq1tUZmbWsmpJHB8CDgY+zbJTVZE/m5lZH1NL4vgCsEV50+pmZtZ31XLn+FSgf70DMTOz3qGWI46NgEclTWL5Oo4uX45rZma9Vy2J47S6R2FmZr1GLc/juLMRgZiZWe9Qy53jr7KsNdpVgJWB1yNinXoGZmZmramWI461yz9L+jywXd0iMjOzllbLVVXLiYg/4ns4zMz6rFpOVX2x7ON7SI0TdveZ42Zm1kvVclXVPmXdi4FZpOeAm5lZH1RLHYeff2FmZv9U7dGxp1YZLyLijDrEY2ZmLa7aEcfrFcrWBA4HNgCcOMzM+qBqj479Salb0trAsaTHto4DftLReGZmtmKrejmupPUlnQk8SEoywyPihIiY390ZS+on6X5JN+TPQyTdI+kJSVfn55EjadX8eUbuP7i78zYzs67rMHFI+hEwCXgV+FBEnB4RL/bgvI8Fppd9/iHws4gYCrxIOiVGfn8xIrYEfpaHMzOzJqlWx3EcqTXcU4CTJZXKRaoc73KTI5IGAXsBZwHfVpr4p4Ev50EuA04HLiBd+nt6Lr8G+IUkRYTvJbEeMXjMjXWfx6yz96r7PMwapVodR+G7ygs4BzgeKDVnsgHwUkQszp9nAwNz90Dg2RzTYkkv5+EX1jE+MzPrQD2TQ0WS9gbmR8SU8uIKg0YN/cqnO1rSZEmTFyxY0AORmplZJQ1PHMCOwL6SZpGu0Po06Qikv6TSEdAgYE7ung1sCpD7rwu80H6iEXFRRIyIiBFtbW31/QZmZn1YwxNHRJwYEYMiYjBwIPDXiPgKcDuwXx5sFHBd7p6QP5P7/9X1G2ZmzdOMI46OnECqKJ9BqsO4JJdfAmyQy78NjGlSfGZmRm2NHNZNRNwB3JG7Z1LhOR8R8Rawf0MDMzOzDrXSEYeZmfUCThxmZlaIE4eZmRXixGFmZoU4cZiZWSFOHGZmVkhTL8c1s77JDUv2bj7iMDOzQpw4zMysECcOMzMrxInDzMwKceIwM7NCnDjMzKwQX45r1kS+LNV6IycOsz7KScu6yqeqzMysECcOMzMrxInDzMwKceIwM7NCGp44JG0q6XZJ0yVNk3RsLl9f0q2Snsjv6+VySTpP0gxJD0oa3uiYzcxsmWYccSwGjouIDwDbA0dKGgaMAW6LiKHAbfkzwB7A0PwaDVzQ+JDNzKyk4YkjIuZGxH25+1VgOjAQGAlclge7DPh87h4JXB7J3UB/SRs3OGwzM8uaWschaTCwLXAPsFFEzIWUXIAN82ADgWfLRpudy9pPa7SkyZImL1iwoJ5hm5n1aU1LHJLWAq4FvhkRr1QbtEJZvKsg4qKIGBERI9ra2noqTDMza6cpiUPSyqSkcWVE/D4Xzyudgsrv83P5bGDTstEHAXMaFauZmS2vGVdVCbgEmB4RPy3rNQEYlbtHAdeVlR+Sr67aHni5dErLzMwarxltVe0IHAw8JOmBXHYScDYwXtLhwDPA/rnfTcCewAzgDeCwxoZrZmblGp44IuJvVK63ANi1wvABHFnXoMzMrGZuHbcCtxpqZtYxNzliZmaFOHGYmVkhThxmZlaIE4eZmRXixGFmZoU4cZiZWSFOHGZmVojv4zCzPsX3aXWfjzjMzKwQJw4zMyvEicPMzApx4jAzs0KcOMzMrBAnDjMzK8SJw8zMCvF9HGZmDbKi3EPiIw4zMyuk1yQOSbtLekzSDEljmh2PmVlf1SsSh6R+wC+BPYBhwEGShjU3KjOzvqlXJA5gO2BGRMyMiLeBccDIJsdkZtYnKSKaHUOnJO0H7B4RX8ufDwY+FhFHlQ0zGhidP24NPFZwNgOAhT0Qbk9r1bjAsXWVYyuuVeOCFSu2zSOirbOBestVVapQtlzGi4iLgIu6PANpckSM6Or49dKqcYFj6yrHVlyrxgV9M7becqpqNrBp2edBwJwmxWJm1qf1lsQxCRgqaYikVYADgQlNjsnMrE/qFaeqImKxpKOAm4F+wNiImNbDs+nyaa46a9W4wLF1lWMrrlXjgj4YW6+oHDczs9bRW05VmZlZi3DiMDOzQvp84milpkwkbSrpdknTJU2TdGwuP13SPyQ9kF97Nim+WZIeyjFMzmXrS7pV0hP5fb0Gx7R12XJ5QNIrkr7ZzGUmaayk+ZIeLiuruJyUnJfXvwclDW9wXD+S9Gie9x8k9c/lgyW9Wbb8LqxXXFVi6/A3lHRiXmaPSfpcE2K7uiyuWZIeyOUNW25Vthf1X9cios++SBXtTwJbAKsAU4FhTYxnY2B47l4beJzUxMrpwHdaYHnNAga0K/tvYEzuHgP8sMm/53PA5s1cZsBOwHDg4c6WE7An8CfSvUrbA/c0OK6c8ySPAAAHFklEQVTdgJVy9w/L4hpcPlyTllnF3zD/J6YCqwJD8n+4XyNja9f/J8CpjV5uVbYXdV/X+voRR0s1ZRIRcyPivtz9KjAdGNiseGo0Ergsd18GfL6JsewKPBkRTzcxBiJiIvBCu+KOltNI4PJI7gb6S9q4UXFFxC0RsTh/vJt0j1TDdbDMOjISGBcRiyLiKWAG6b/c8NgkCfgScFW95t+RKtuLuq9rfT1xDASeLfs8mxbZUEsaDGwL3JOLjsqHl2MbfTqoTAC3SJqi1MQLwEYRMRfSigxs2KTYIN3fU/4HboVlVtLRcmqldfDfSXukJUMk3S/pTkmfbFJMlX7DVlpmnwTmRcQTZWUNX27tthd1X9f6euLotCmTZpC0FnAt8M2IeAW4AHgf8BFgLunQuBl2jIjhpFaKj5S0U5PieBelG0P3BX6Xi1plmXWmJdZBSScDi4Erc9FcYLOI2Bb4NvBbSes0OKyOfsOWWGbZQSy/s9Lw5VZhe9HhoBXKurTc+nriaLmmTCStTFoJroyI3wNExLyIWBIRS4FfUcfD8moiYk5+nw/8Iccxr3S4m9/nNyM2UjK7LyLm5RhbYpmV6Wg5NX0dlDQK2Bv4SuST4fk00PO5ewqpHmGrRsZV5Tds+jIDkLQS8EXg6lJZo5dbpe0FDVjX+nriaKmmTPL50kuA6RHx07Ly8vOQXwAebj9uA2JbU9LapW5SperDpOU1Kg82Criu0bFly+35tcIya6ej5TQBOCRf8bI98HLpNEMjSNodOAHYNyLeKCtvU3oODpK2AIYCMxsVV55vR7/hBOBASatKGpJju7eRsWWfAR6NiNmlgkYut462FzRiXWtE7X8rv0hXGjxO2jM4ucmxfIJ06Pgg8EB+7QlcATyUyycAGzchti1IV7JMBaaVlhWwAXAb8ER+X78Jsa0BPA+sW1bWtGVGSmBzgXdIe3mHd7ScSKcPfpnXv4eAEQ2OawbpvHdpfbswD/tv+XeeCtwH7NOEZdbhbwicnJfZY8AejY4tl18KHNFu2IYttyrbi7qva25yxMzMCunrp6rMzKwgJw4zMyvEicPMzApx4jAzs0KcOMzMrBAnDuuVJL1W5+kfKmmTss+zJA3oxvSuyk1nfKtnIjRrnl7x6FizJjiUdMNZt+9IlvRe4OMRsXl3p2XWCnzEYSuMfNfutZIm5deOufz03EjeHZJmSjqmbJzvKj2P4tZ8VPAdSfsBI4Ar8zMVVs+DHy3pPqVnkry/wvxXk/Tr3P9+SZ/KvW4BNszT+mS7cS6VdIHScxVmSto5xzpd0qVlw+0m6a48/9/l9omQdLakR/LRzI9z2f6SHpY0VdLEXDZY0v/m8e+T9PFc/h5J5ys9z+EGSTfl74+kj+aG+qZIull1arXXeqF63nHpl1/1egGvVSj7LfCJ3L0ZqSkGSM91+D/S8xsGkO4yX5mUHB4AVic9z+AJ8vMfgDsou7OW9CySo3P3N4CLK8z/OODXufv9wDPAalR5RgPp7uNxpLt6RwKvAB8i7dRNITXwNwCYCKyZxzkBOBVYn3TndOlG3v75/SFgYLuyNYDVcvdQYHLu3g+4Kc/vvcCLuWzlvMza8nAHAGOb/bv71Rovn6qyFclngGGpCR8A1im1rwXcGBGLgEWS5gMbkZpsuC4i3gSQdH0n0y81IjeF1Lhde58Afg4QEY9KeprUwF21FksBro+IkPQQqYnuh3I800hJZxDpAT1/z99tFeCuPN23gIsl3QjckKf3d+BSSePLYl4Z+IWkjwBLWNbw3ieA30VqSPA5Sbfn8q2BbYBb8zz7kZrdMHPisBXKe4AdSomgJG/4FpUVLSGt+5Wama6mNI3S+O0VnV776S5l+TiX5vksAW6NiIPeNUNpO9IDrA4EjgI+HRFHSPoYsBfwQE4WRwPzgA+TltNbncQsYFpE7NDF72QrMNdx2IrkFtLGE4C8wazmb8A+uW5iLdKGtuRV0umrIiYCX8nz3op0uuyxgtOo5G5gR0lb5mmvIWmrHPO6EXET8E3SaS0kvS8i7omIU4GFpKa01wXm5iOLg0lHEJCWwb/luo6NgF1y+WNAm6Qd8jRXlvTBHvgutgLwEYf1VmtIml32+afAMcAvJT1IWrcnAkd0NIGImCRpAqkl06eBycDLufelwIWS3gRq3es+P4/zEOmhSIdGxKKyU2ddEhELJB0KXCVp1Vx8Cim5XSdpNdIRQulS3x9JGprLbiN9v/OBayXtD9wOvJ6HvZZ0xPIwqZXoe0jNbb+dK8nPk7QuaXmeQ2r51fo4t45rfZqktSLiNUlrkBLN6MjPce4rypbBBqTnWuwYEc81Oy5rXT7isL7uIknDSFc/XdbXkkZ2g6T+pEr3M5w0rDM+4jAzs0JcOW5mZoU4cZiZWSFOHGZmVogTh5mZFeLEYWZmhfx/qRNR9CPQhpQAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fe36a89d0b8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.hist(df[df['is spam'] == 0]['length'], bins=10, range=(0, 200), rwidth=0.8)\n",
    "plt.xlabel('Length of message')\n",
    "plt.ylabel('Number of messages')\n",
    "plt.title('Distribution of length of non-spam messages.')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### TASK 3"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Your task is to analyse the data, either manually or by Pandas' functions such as `groupby` and `describe` and add atleast one feature. The features created should be supported by some statistic, or some plot. \n",
    "\n",
    "Treat this task very seriously. Students whose features are most creative (and effective) will be given a special mention."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "# YOUR CODE STARTS HERE\n",
    "\n",
    "\n",
    "# YOUR CODE ENDS HERE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Creating Features from the text"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Uptil now, we have created additional features from the text. But we have not represented the text itself.   \n",
    "\n",
    "Remember that machine learning algorithms such as Logistic Regression work by multiplying the feature values by some (learnable) weights. Clealy, we can't use text as it as feature. We need to convert into numbers, a form machine learning algorithm can deal with.     "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Bag of Words"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "    How do we convert them to some kind of numeric representation for machine learning? One common approach is called a Bag of Words. The Bag of Words model learns a vocabulary from all of the documents, then models each document by counting the number of times each word appears. For example, consider the following two sentences:\n",
    "\n",
    "    Sentence 1: \"The cat sat on the hat\"\n",
    "\n",
    "    Sentence 2: \"The dog ate the cat and the hat\"\n",
    "\n",
    "    From these two sentences, our vocabulary is as follows:\n",
    "\n",
    "    { the, cat, sat, on, hat, dog, ate, and }\n",
    "\n",
    "    To get our bags of words, we count the number of times each word occurs in each sentence. In Sentence 1, \"the\" appears twice, and \"cat\", \"sat\", \"on\", and \"hat\" each appear once, so the feature vector for Sentence 1 is:\n",
    "\n",
    "    { the, cat, sat, on, hat, dog, ate, and }\n",
    "\n",
    "    Sentence 1: { 2, 1, 1, 1, 1, 0, 0, 0 }\n",
    "\n",
    "    Similarly, the features for Sentence 2 are: { 3, 1, 0, 0, 1, 1, 1, 1}\n",
    "    \n",
    "More on Bag of Words, [here](https://www.kaggle.com/c/word2vec-nlp-tutorial#part-1-for-beginners-bag-of-words), [here](https://machinelearningmastery.com/gentle-introduction-bag-words-model/) and [here](http://scikit-learn.org/stable/modules/feature_extraction.html#text-feature-extraction).\n",
    "\n",
    "It is imperative that you understand Bag of Words before moving on.\n",
    "\n",
    "Bag of Words is not fact the only (and the best) way to represent text. It suffers from problems such as creating too many features, not being able to represent similarities between similar words, and not being able to take into account the sequence in which words appear.  \n",
    "After learning Deep Learning, you will come to know of other methods to represent text such as using Word vectors and LSTMs."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Cleaning the text"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we clean the text by removing non-alphabetic words and [stopwords](http://text-analytics101.rxnlp.com/2014/10/all-about-stop-words-for-text-mining.html) from the text. Stop Words are words that most commonly appear in the language, for example, 'the', 'and', etc. They don't add useful information to the text so they can be removed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "def isalpha(word):\n",
    "    wrod = word.replace('.', '')\n",
    "    return word.isalpha()\n",
    "\n",
    "def clean_sms(text):\n",
    "    text = text.lower()\n",
    "    return (' '.join(filter(lambda x: isalpha(x) and x not in stopwords.words(\"english\"), text.split()))).replace('.', '').split()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will be using `CountVectorizer` to convert the SMSes to a matrix of token counts. You should try and fiddle with the arguments to `CountVectorizer`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>is spam</th>\n",
       "      <th>text</th>\n",
       "      <th>percentage digits</th>\n",
       "      <th>percentage question mark</th>\n",
       "      <th>percentage exclamation mark</th>\n",
       "      <th>percentage caps</th>\n",
       "      <th>length</th>\n",
       "      <th>abiola</th>\n",
       "      <th>able</th>\n",
       "      <th>abt</th>\n",
       "      <th>...</th>\n",
       "      <th>yet</th>\n",
       "      <th>ym</th>\n",
       "      <th>yo</th>\n",
       "      <th>yoga</th>\n",
       "      <th>yr</th>\n",
       "      <th>yrs</th>\n",
       "      <th>yun</th>\n",
       "      <th>yup</th>\n",
       "      <th>zed</th>\n",
       "      <th>ìï</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>Go until jurong point, crazy.. Available only ...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2.702703</td>\n",
       "      <td>111</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>Ok lar... Joking wif u oni...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>6.896552</td>\n",
       "      <td>29</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2 rows × 1290 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   is spam                                               text  \\\n",
       "1        0  Go until jurong point, crazy.. Available only ...   \n",
       "2        0                      Ok lar... Joking wif u oni...   \n",
       "\n",
       "   percentage digits  percentage question mark  percentage exclamation mark  \\\n",
       "1                0.0                       0.0                          0.0   \n",
       "2                0.0                       0.0                          0.0   \n",
       "\n",
       "   percentage caps  length  abiola  able  abt ...  yet  ym  yo  yoga  yr  yrs  \\\n",
       "1         2.702703     111       0     0    0 ...    0   0   0     0   0    0   \n",
       "2         6.896552      29       0     0    0 ...    0   0   0     0   0    0   \n",
       "\n",
       "   yun  yup  zed  ìï  \n",
       "1    0    0    0   0  \n",
       "2    0    0    0   0  \n",
       "\n",
       "[2 rows x 1290 columns]"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cv = CountVectorizer(strip_accents='ascii', min_df=5, analyzer=clean_sms)\n",
    "df = pd.concat([df, pd.DataFrame(cv.fit_transform(df['text']).todense(), columns=cv.get_feature_names(), index=np.arange(1, cv.fit_transform(df['text']).todense().shape[0] + 1))], axis=1)\n",
    "df.head(2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is how our final feature vector (plus the target vector) looks like."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>percentage digits</th>\n",
       "      <th>percentage question mark</th>\n",
       "      <th>percentage exclamation mark</th>\n",
       "      <th>percentage caps</th>\n",
       "      <th>length</th>\n",
       "      <th>abiola</th>\n",
       "      <th>able</th>\n",
       "      <th>abt</th>\n",
       "      <th>accept</th>\n",
       "      <th>access</th>\n",
       "      <th>...</th>\n",
       "      <th>yet</th>\n",
       "      <th>ym</th>\n",
       "      <th>yo</th>\n",
       "      <th>yoga</th>\n",
       "      <th>yr</th>\n",
       "      <th>yrs</th>\n",
       "      <th>yun</th>\n",
       "      <th>yup</th>\n",
       "      <th>zed</th>\n",
       "      <th>ìï</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>is spam</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.420082</td>\n",
       "      <td>0.544954</td>\n",
       "      <td>0.233188</td>\n",
       "      <td>5.952566</td>\n",
       "      <td>71.023627</td>\n",
       "      <td>0.001865</td>\n",
       "      <td>0.005389</td>\n",
       "      <td>0.005181</td>\n",
       "      <td>0.001865</td>\n",
       "      <td>0.000415</td>\n",
       "      <td>...</td>\n",
       "      <td>0.004145</td>\n",
       "      <td>0.001036</td>\n",
       "      <td>0.004974</td>\n",
       "      <td>0.001036</td>\n",
       "      <td>0.000622</td>\n",
       "      <td>0.000622</td>\n",
       "      <td>0.001036</td>\n",
       "      <td>0.006425</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.010777</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>11.579405</td>\n",
       "      <td>0.169521</td>\n",
       "      <td>0.524716</td>\n",
       "      <td>11.061228</td>\n",
       "      <td>138.866131</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.006693</td>\n",
       "      <td>...</td>\n",
       "      <td>0.001339</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.001339</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.014726</td>\n",
       "      <td>0.004016</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.006693</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2 rows × 1288 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         percentage digits  percentage question mark  \\\n",
       "is spam                                                \n",
       "0                 0.420082                  0.544954   \n",
       "1                11.579405                  0.169521   \n",
       "\n",
       "         percentage exclamation mark  percentage caps      length    abiola  \\\n",
       "is spam                                                                       \n",
       "0                           0.233188         5.952566   71.023627  0.001865   \n",
       "1                           0.524716        11.061228  138.866131  0.000000   \n",
       "\n",
       "             able       abt    accept    access    ...          yet        ym  \\\n",
       "is spam                                            ...                          \n",
       "0        0.005389  0.005181  0.001865  0.000415    ...     0.004145  0.001036   \n",
       "1        0.000000  0.000000  0.000000  0.006693    ...     0.001339  0.000000   \n",
       "\n",
       "               yo      yoga        yr       yrs       yun       yup       zed  \\\n",
       "is spam                                                                         \n",
       "0        0.004974  0.001036  0.000622  0.000622  0.001036  0.006425  0.000000   \n",
       "1        0.001339  0.000000  0.014726  0.004016  0.000000  0.000000  0.006693   \n",
       "\n",
       "               ìï  \n",
       "is spam            \n",
       "0        0.010777  \n",
       "1        0.000000  \n",
       "\n",
       "[2 rows x 1288 columns]"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.groupby('is spam').mean()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The table above shows mean values for all the features grouped by whether the text is spam or ham.  \n",
    "Clearly, the values are very different for the features we manually created. That means we have created good features."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Training model and calculating accuracy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### TASK 4"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Extract `X`, the feature vectors by removing the label (`is spam` column) and the text (`text` column) from the `df` DataFrame.  \n",
    "Similarly extract the target vectors, by assigning `Y` to the `is spam` column."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "# YOUR CODE STARTS HERE\n",
    "X = df.drop(['is spam', 'text'], axis = 1)\n",
    "y = df['is spam']\n",
    "# YOUR CODE ENDS HERE"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "X.shape: (5572, 1287)\n",
      "y.shape: (5572,)\n"
     ]
    }
   ],
   "source": [
    "print(\"X.shape:\", X.shape)\n",
    "print(\"y.shape:\", y.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we divide the dataset into 3 parts, `train`, `cv` and `test`. We train our model on the training set, tune the hyperparameters (regularisation factor, which algorithm to use) on the validation set and finally report the our results on the test set.\n",
    "\n",
    "In this case we keep 60% of the data in training set, 20% of the data in validation set, and 20% of the data in test set. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Splitting the dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train dataset size:  3343\n",
      "CV size:  1114\n",
      "Test size:  1115\n"
     ]
    }
   ],
   "source": [
    "X_train, X_other, y_train, y_other = train_test_split(X, y, test_size=0.4, random_state=42)\n",
    "X_cv, X_test, y_cv, y_test = train_test_split(X_other, y_other, test_size=0.5, random_state=42)\n",
    "\n",
    "print(\"Train dataset size: \", X_train.shape[0])\n",
    "print(\"CV size: \", X_cv.shape[0])\n",
    "print(\"Test size: \", X_test.shape[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we try out different models and fiddle around with the hyperparameters, seeing their accuracy on the validation set."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Logistic Regression"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now will use the Logistic Regression class from the scikit-learn library to create a classifier object and train it on our data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [],
   "source": [
    "clf = LogisticRegression()\n",
    "clf = clf.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Fiddle around the paramaters while creating the classifier object, particularly with `C` - the regularisation strength, `class_weight` - a useful paramter when dealing with skewed class distribution like this. You can change the regularisation strength by observing how it is performing on the training set and the validation set."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will be using f1-score to evaluate the model. F1-score is used when the class distribution is skewed (like in this example).   \n",
    "More about F1-Score [here](https://machinelearningmastery.com/classification-accuracy-is-not-enough-more-performance-measures-you-can-use/). Do read this before moving on."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "             precision    recall  f1-score   support\n",
      "\n",
      "        ham       0.99      1.00      0.99       955\n",
      "       spam       0.97      0.94      0.96       159\n",
      "\n",
      "avg / total       0.99      0.99      0.99      1114\n",
      "\n",
      "F1 score: 0.9551282051282051\n"
     ]
    }
   ],
   "source": [
    "print(classification_report(y_cv, clf.predict(X_cv), target_names=['ham', 'spam']))\n",
    "print('F1 score:', f1_score(y_cv, clf.predict(X_cv)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Naive Bayes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Similarly fiddle around with the hyper parameters of this model. You can find the documentation on the scikit-learn website."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "clf = MultinomialNB()\n",
    "clf = clf.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "             precision    recall  f1-score   support\n",
      "\n",
      "        ham       0.99      0.98      0.98       955\n",
      "       spam       0.86      0.92      0.89       159\n",
      "\n",
      "avg / total       0.97      0.97      0.97      1114\n",
      "\n",
      "F1 score: 0.8936170212765958\n"
     ]
    }
   ],
   "source": [
    "print(classification_report(y_cv, clf.predict(X_cv), target_names=['ham', 'spam']))\n",
    "print('F1 score:', f1_score(y_cv, clf.predict(X_cv)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### TASK 5"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Use [SVM Classifier](http://scikit-learn.org/stable/modules/generated/sklearn.svm.SVC.html) instead of Logistic Regression and Naive Bayes. \n",
    "Print out the classification report and F1 Score as done above."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "# YOUR CODE STARTS HERE\n",
    "\n",
    "# YOUR CODE ENDS HERE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Bonus Task"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Try using one of the most basic ensembling method the [VotingClassifier](http://scikit-learn.org/stable/modules/generated/sklearn.ensemble.VotingClassifier.html).\n",
    "You can read more about ensembing [here](http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/), and [here](https://mlwave.com/kaggle-ensembling-guide/)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "# YOUR CODE STARTS HERE\n",
    "\n",
    "# YOUR CODE ENDS HERE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Training the final model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [],
   "source": [
    "y_actual = y_test\n",
    "y_predicted = clf.predict(X_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [],
   "source": [
    "true_positives = X_test[(y_actual == 1) & (y_predicted == 1)]\n",
    "true_negatives = X_test[(y_actual == 0) & (y_predicted == 0)]\n",
    "false_positives = X_test[(y_actual == 0) & (y_predicted == 1)]\n",
    "false_negatives = X_test[(y_actual == 1) & (y_predicted == 0)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Precision: 0.7865853658536586\n",
      "Recall: 0.9214285714285714\n",
      "F1 score: 0.8486842105263158\n"
     ]
    }
   ],
   "source": [
    "precision = true_positives.shape[0] / (true_positives.shape[0] + false_positives.shape[0])\n",
    "print(\"Precision:\", precision)\n",
    "recall = true_positives.shape[0] / (true_positives.shape[0] + false_negatives.shape[0])\n",
    "print(\"Recall:\", recall)\n",
    "f1_score = 2 * precision * recall / (precision + recall)\n",
    "print(\"F1 score:\", f1_score)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The one with the highest F1 Score will get a special mention. To improve on the F1 Score, you can engineer new features, try out more algorithms and loggically fiddle with their parameters."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Observing examples where the algorithm failed, or was successful."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>text</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1671</th>\n",
       "      <td>Lmao!nice 1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>450</th>\n",
       "      <td>10 min later k...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5045</th>\n",
       "      <td>We have sent JD for Customer Service cum Accou...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1565</th>\n",
       "      <td>Tmrw. Im finishing 9 doors</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5290</th>\n",
       "      <td>Hey! Congrats 2u2. id luv 2 but ive had 2 go h...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>Oops. 4 got that bit.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>991</th>\n",
       "      <td>26th OF JULY</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>578</th>\n",
       "      <td>ÌÏ wait 4 me in sch i finish ard 5..</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2616</th>\n",
       "      <td>2marrow only. Wed at  &amp;lt;#&amp;gt;  to 2 aha.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>219</th>\n",
       "      <td>I have to take exam with march 3</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>544</th>\n",
       "      <td>4 oclock at mine. Just to bash out a flat plan.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4886</th>\n",
       "      <td>Or just do that 6times</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1946</th>\n",
       "      <td>Can Ì_ call me at 10:10 to make sure dat i've ...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>806</th>\n",
       "      <td>I dled 3d its very imp</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2998</th>\n",
       "      <td>No b4 Thursday</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2837</th>\n",
       "      <td>1's reach home call me.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1236</th>\n",
       "      <td>Your opinion about me? 1. Over 2. Jada 3. Kusr...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1766</th>\n",
       "      <td>Hi this is yijue... It's regarding the 3230 te...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2641</th>\n",
       "      <td>Pandy joined 4w technologies today.he got job..</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3836</th>\n",
       "      <td>Then Ì_ come n pick me at 530 ar?</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3117</th>\n",
       "      <td>Now am free call me pa.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3327</th>\n",
       "      <td>what number do u live at? Is it 11?</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1260</th>\n",
       "      <td>We have sent JD for Customer Service cum Accou...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4377</th>\n",
       "      <td>How much is torch in 9ja.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2759</th>\n",
       "      <td>What time. IÛ÷m out until prob 3 or so</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4882</th>\n",
       "      <td>As usual u can call me ard 10 smth.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>799</th>\n",
       "      <td>Ok i msg u b4 i leave my house.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2043</th>\n",
       "      <td>Me not waking up until 4 in the afternoon, sup</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3130</th>\n",
       "      <td>Ok. But i finish at 6.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2440</th>\n",
       "      <td>Rightio. 11.48 it is then. Well arent we all u...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2571</th>\n",
       "      <td>From 5 to 2 only my work timing.</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4005</th>\n",
       "      <td>, ow u dey.i paid 60,400thousad.i told  u woul...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5129</th>\n",
       "      <td>Wot about on wed nite I am 3 then but only til 9!</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5433</th>\n",
       "      <td>Thanx a lot 4 ur help!</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5364</th>\n",
       "      <td>I think your mentor is , but not 100 percent s...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                   text  text\n",
       "1671                                        Lmao!nice 1     0\n",
       "450                                   10 min later k...     0\n",
       "5045  We have sent JD for Customer Service cum Accou...     0\n",
       "1565                         Tmrw. Im finishing 9 doors     0\n",
       "5290  Hey! Congrats 2u2. id luv 2 but ive had 2 go h...     0\n",
       "293                               Oops. 4 got that bit.     0\n",
       "991                                        26th OF JULY     0\n",
       "578                ÌÏ wait 4 me in sch i finish ard 5..     0\n",
       "2616         2marrow only. Wed at  &lt;#&gt;  to 2 aha.     0\n",
       "219                    I have to take exam with march 3     0\n",
       "544     4 oclock at mine. Just to bash out a flat plan.     0\n",
       "4886                             Or just do that 6times     0\n",
       "1946  Can Ì_ call me at 10:10 to make sure dat i've ...     0\n",
       "806                              I dled 3d its very imp     0\n",
       "2998                                     No b4 Thursday     0\n",
       "2837                            1's reach home call me.     0\n",
       "1236  Your opinion about me? 1. Over 2. Jada 3. Kusr...     0\n",
       "1766  Hi this is yijue... It's regarding the 3230 te...     0\n",
       "2641    Pandy joined 4w technologies today.he got job..     0\n",
       "3836                  Then Ì_ come n pick me at 530 ar?     0\n",
       "3117                            Now am free call me pa.     0\n",
       "3327                what number do u live at? Is it 11?     0\n",
       "1260  We have sent JD for Customer Service cum Accou...     0\n",
       "4377                          How much is torch in 9ja.     0\n",
       "2759            What time. IÛ÷m out until prob 3 or so     0\n",
       "4882                As usual u can call me ard 10 smth.     0\n",
       "799                     Ok i msg u b4 i leave my house.     0\n",
       "2043     Me not waking up until 4 in the afternoon, sup     0\n",
       "3130                             Ok. But i finish at 6.     0\n",
       "2440  Rightio. 11.48 it is then. Well arent we all u...     0\n",
       "2571                   From 5 to 2 only my work timing.     0\n",
       "4005  , ow u dey.i paid 60,400thousad.i told  u woul...     0\n",
       "5129  Wot about on wed nite I am 3 then but only til 9!     0\n",
       "5433                             Thanx a lot 4 ur help!     0\n",
       "5364  I think your mentor is , but not 100 percent s...     0"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.loc[list(false_positives.index)]['text']"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}