Disability_on_Desert_Island_Discs.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "1e68b2fa-8f1a-484c-b316-f0a97971c8b8",
   "metadata": {},
   "source": [
    "In the terminal, before starting:\n",
    "\n",
    "```\n",
    "pip install wikipedia\n",
    "pip install --force-reinstall openpyxl\n",
    "```\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2bc1b786-c79d-457f-916d-4ffd166bd6fc",
   "metadata": {},
   "source": [
    "## Libraries\n",
    "\n",
    "Let's start with the basic dependencies."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "2de538c2-391e-48bd-85cb-ff7de49143b5",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy\n",
    "import wikipedia"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0bc6429f-7c32-4e5a-8804-2fd2340b834b",
   "metadata": {},
   "source": [
    "## Get the data\n",
    "\n",
    "Now import the spreadsheet. The code is based on https://alan-turing-institute.github.io/TuringDataStories-fastpages/data%20exploration/data%20wrangling/data%20visualisation/digital%20humanities/2022/03/09/Desert-Island-Discs.html\n",
    "\n",
    "I'm using the version of the spreadsheet that includes Wikipedia links, so I don't have to take care of disambiguation on my own. This means the most recent episodes are not included. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "id": "d77bfaed-e368-4f33-b1cf-33fa5ebf6533",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>episode_ref</th>\n",
       "      <th>date</th>\n",
       "      <th>castaway_ref</th>\n",
       "      <th>name</th>\n",
       "      <th>std_name</th>\n",
       "      <th>gender</th>\n",
       "      <th>profession</th>\n",
       "      <th>country_of_citizenship</th>\n",
       "      <th>place_of_birth</th>\n",
       "      <th>country_of_birth</th>\n",
       "      <th>date_of_birth</th>\n",
       "      <th>favTrack</th>\n",
       "      <th>luxury</th>\n",
       "      <th>book</th>\n",
       "      <th>wiki_link</th>\n",
       "      <th>link</th>\n",
       "      <th>year</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2828</td>\n",
       "      <td>1942-01-29</td>\n",
       "      <td>2855</td>\n",
       "      <td>Vic Oliver</td>\n",
       "      <td>vic oliver</td>\n",
       "      <td>male</td>\n",
       "      <td>['actor', 'performing artist', 'artist', 'prof...</td>\n",
       "      <td>Austria-Hungary</td>\n",
       "      <td>Vienna</td>\n",
       "      <td>Austria</td>\n",
       "      <td>1898-07-08</td>\n",
       "      <td>NA by NA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>https://en.wikipedia.org/wiki/Vic_Oliver</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009y0nq</td>\n",
       "      <td>1942</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   episode_ref       date  castaway_ref        name    std_name gender  \\\n",
       "0         2828 1942-01-29          2855  Vic Oliver  vic oliver   male   \n",
       "\n",
       "                                          profession country_of_citizenship  \\\n",
       "0  ['actor', 'performing artist', 'artist', 'prof...        Austria-Hungary   \n",
       "\n",
       "  place_of_birth country_of_birth date_of_birth  favTrack luxury book  \\\n",
       "0         Vienna          Austria    1898-07-08  NA by NA    NaN  NaN   \n",
       "\n",
       "                                  wiki_link  \\\n",
       "0  https://en.wikipedia.org/wiki/Vic_Oliver   \n",
       "\n",
       "                                        link  year  \n",
       "0  https://www.bbc.co.uk/programmes/p009y0nq  1942  "
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hc_data_url = (\n",
    "    \"https://hcommons.org/deposits/download/hc:42512/CONTENT/desert_island_discs.xlsx\"\n",
    " )\n",
    "\n",
    "castaways_df = pd.read_excel(\n",
    "    hc_data_url,\n",
    "    sheet_name=\"castaways\",\n",
    "    parse_dates=[\"date\", \"date_of_birth\"],\n",
    "    index_col=0\n",
    ")\n",
    "castaways_df[\"year\"] = [i.year for i in castaways_df[\"date\"].dt.date]\n",
    "castaways_df.head(1)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2fa31c8d-1abe-4b78-b728-f49dd5048fc2",
   "metadata": {},
   "source": [
    "# Get the Wikipedia Categories\n",
    "\n",
    "For each one, let's open the Wikipedia article and make a big list of categories."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "id": "5e5147ae-5252-40de-86dc-b932868101bd",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>episode_ref</th>\n",
       "      <th>date</th>\n",
       "      <th>castaway_ref</th>\n",
       "      <th>name</th>\n",
       "      <th>std_name</th>\n",
       "      <th>gender</th>\n",
       "      <th>profession</th>\n",
       "      <th>country_of_citizenship</th>\n",
       "      <th>place_of_birth</th>\n",
       "      <th>country_of_birth</th>\n",
       "      <th>date_of_birth</th>\n",
       "      <th>favTrack</th>\n",
       "      <th>luxury</th>\n",
       "      <th>book</th>\n",
       "      <th>wiki_link</th>\n",
       "      <th>link</th>\n",
       "      <th>year</th>\n",
       "      <th>wiki_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2828</td>\n",
       "      <td>1942-01-29</td>\n",
       "      <td>2855</td>\n",
       "      <td>Vic Oliver</td>\n",
       "      <td>vic oliver</td>\n",
       "      <td>male</td>\n",
       "      <td>['actor', 'performing artist', 'artist', 'prof...</td>\n",
       "      <td>Austria-Hungary</td>\n",
       "      <td>Vienna</td>\n",
       "      <td>Austria</td>\n",
       "      <td>1898-07-08</td>\n",
       "      <td>NA by NA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>https://en.wikipedia.org/wiki/Vic_Oliver</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009y0nq</td>\n",
       "      <td>1942</td>\n",
       "      <td>Vic_Oliver</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   episode_ref       date  castaway_ref        name    std_name gender  \\\n",
       "0         2828 1942-01-29          2855  Vic Oliver  vic oliver   male   \n",
       "\n",
       "                                          profession country_of_citizenship  \\\n",
       "0  ['actor', 'performing artist', 'artist', 'prof...        Austria-Hungary   \n",
       "\n",
       "  place_of_birth country_of_birth date_of_birth  favTrack luxury book  \\\n",
       "0         Vienna          Austria    1898-07-08  NA by NA    NaN  NaN   \n",
       "\n",
       "                                  wiki_link  \\\n",
       "0  https://en.wikipedia.org/wiki/Vic_Oliver   \n",
       "\n",
       "                                        link  year     wiki_id  \n",
       "0  https://www.bbc.co.uk/programmes/p009y0nq  1942  Vic_Oliver  "
      ]
     },
     "execution_count": 88,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "castaways_df['wiki_id'] = castaways_df['wiki_link'].replace('https://en.wikipedia.org/wiki/', '', regex=True)\n",
    "castaways_df.head(1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "id": "c92adac3-5c9a-45f3-8414-4e2648d81c0d",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/opt/conda/lib/python3.10/site-packages/wikipedia/wikipedia.py:389: GuessedAtParserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system (\"html.parser\"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.\n",
      "\n",
      "The code that caused this warning is on line 389 of the file /opt/conda/lib/python3.10/site-packages/wikipedia/wikipedia.py. To get rid of this warning, pass the additional argument 'features=\"html.parser\"' to the BeautifulSoup constructor.\n",
      "\n",
      "  lis = BeautifulSoup(html).find_all('li')\n"
     ]
    }
   ],
   "source": [
    "all_categories = set()\n",
    "for page_id in castaways_df['wiki_id']:\n",
    "    try:\n",
    "        if pd.isna(page_id):\n",
    "            continue\n",
    "        page = wikipedia.page(page_id, auto_suggest = False)\n",
    "        all_categories.update(page.categories)\n",
    "    except Exception as e:\n",
    "        continue"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "id": "5834c4ad-dd59-4ba0-9aaf-4a6a1f9cf4f7",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "pd.Series(list(all_categories)).sort_values().to_csv(\"categories.csv\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "e4967583-3505-439c-bbd6-dacf9b6a35c6",
   "metadata": {},
   "source": [
    "Next, I manually choose the categories that should select for disabled interviewees.\n",
    "\n",
    "More on the thinking here in the blog post, but I end up with `included_categories.csv`."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "14765a27-65b8-4c62-9492-65087c5175fd",
   "metadata": {},
   "source": [
    "## Get the Matching People"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "11417bdd-169d-4240-b412-436e7d7dc160",
   "metadata": {},
   "source": [
    "First, let's import the included categories:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "id": "cfb1ac8d-b824-4529-ae0d-a7e410a62201",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "included_categories_csv = pd.read_csv(\"included_categories.csv\")\n",
    "included_categories = set(included_categories_csv[\"category\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 92,
   "id": "0a5ea831-385a-4bc3-bbe8-c3207197e3aa",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Eric Sykes\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/opt/conda/lib/python3.10/site-packages/wikipedia/wikipedia.py:389: GuessedAtParserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system (\"html.parser\"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.\n",
      "\n",
      "The code that caused this warning is on line 389 of the file /opt/conda/lib/python3.10/site-packages/wikipedia/wikipedia.py. To get rid of this warning, pass the additional argument 'features=\"html.parser\"' to the BeautifulSoup constructor.\n",
      "\n",
      "  lis = BeautifulSoup(html).find_all('li')\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Wee Georgie Wood\n",
      "George Shearing\n",
      "Michael Flanders\n",
      "David Hockney\n",
      "Michael Ansell\n",
      "Barry Humphries\n",
      "Itzhak Perlman\n",
      "David Scott Blackhall\n",
      "Tristan Jones\n",
      "Richard Leakey\n",
      "Douglas Bader\n",
      "Rosemary Sutcliff\n",
      "Christopher Reeve\n",
      "Ved Mehta\n",
      "Anthony Hopkins\n",
      "Bobby Robson\n",
      "Stephanie Beacham\n",
      "David Blunkett\n",
      "Sue Townsend\n",
      "Stephen Hawking\n",
      "Evelyn Glennie\n",
      "Jack Ashley, Baron Ashley of Stoke\n",
      "Oliver Sacks\n",
      "John Wilson (blind activist)\n",
      "Gordon Brown\n",
      "Eric Sykes\n",
      "Ian Dury\n",
      "Tanni Grey-Thompson\n",
      "Bobby Robson\n",
      "Frank Gardner (journalist)\n",
      "Thomas Quasthoff\n",
      "Barry Humphries\n",
      "Jane Campbell, Baroness Campbell of Surbiton\n",
      "Ade Adepitan\n",
      "Chris Packham\n",
      "Yinka Shonibare\n",
      "Warwick Davis\n",
      "Philip Craven\n"
     ]
    }
   ],
   "source": [
    "disability_column = []\n",
    "for page_id in castaways_df['wiki_id']:\n",
    "    try:\n",
    "        if pd.isna(page_id):\n",
    "            disability_column.append(None)\n",
    "            continue\n",
    "        page = wikipedia.page(page_id, auto_suggest = False)\n",
    "        if included_categories.intersection(set(page.categories)):\n",
    "            print(page.title)\n",
    "            disability_column.append(True)\n",
    "        else:\n",
    "            disability_column.append(False)\n",
    "        \n",
    "    except Exception as e:\n",
    "        disability_column.append(None)\n",
    "        continue"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "id": "7253749e-f6c8-43ad-8a6a-e99b71e66b06",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "castaways_df[\"disability_status\"] = disability_column"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "id": "dcc5787c-ee31-4963-a468-1379c3f04b3b",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>episode_ref</th>\n",
       "      <th>date</th>\n",
       "      <th>castaway_ref</th>\n",
       "      <th>name</th>\n",
       "      <th>std_name</th>\n",
       "      <th>gender</th>\n",
       "      <th>profession</th>\n",
       "      <th>country_of_citizenship</th>\n",
       "      <th>place_of_birth</th>\n",
       "      <th>country_of_birth</th>\n",
       "      <th>date_of_birth</th>\n",
       "      <th>favTrack</th>\n",
       "      <th>luxury</th>\n",
       "      <th>book</th>\n",
       "      <th>wiki_link</th>\n",
       "      <th>link</th>\n",
       "      <th>year</th>\n",
       "      <th>wiki_id</th>\n",
       "      <th>disability_status</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>362</th>\n",
       "      <td>2954</td>\n",
       "      <td>1957-12-09</td>\n",
       "      <td>852</td>\n",
       "      <td>Eric Sykes</td>\n",
       "      <td>eric sykes</td>\n",
       "      <td>male</td>\n",
       "      <td>['screenwriter', 'writer', 'author', 'creator'...</td>\n",
       "      <td>United Kingdom</td>\n",
       "      <td>Oldham</td>\n",
       "      <td>United Kingdom</td>\n",
       "      <td>1923-05-04</td>\n",
       "      <td>NA by NA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>https://en.wikipedia.org/wiki/Eric_Sykes</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009y8l4</td>\n",
       "      <td>1957</td>\n",
       "      <td>Eric_Sykes</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>562</th>\n",
       "      <td>2608</td>\n",
       "      <td>1961-11-06</td>\n",
       "      <td>2893</td>\n",
       "      <td>Wee Georgie Wood</td>\n",
       "      <td>wee georgie wood</td>\n",
       "      <td>male</td>\n",
       "      <td>['comedian', 'actor', 'performing artist', 'ar...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1894-12-17</td>\n",
       "      <td>Private Lives Act 1 by Noel Coward &amp; Gertrude ...</td>\n",
       "      <td>Writing materials</td>\n",
       "      <td>Memoirs of a Midget - Walter de la Mare</td>\n",
       "      <td>https://en.wikipedia.org/wiki/Wee_Georgie_Wood</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009y6ck</td>\n",
       "      <td>1961</td>\n",
       "      <td>Wee_Georgie_Wood</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>613</th>\n",
       "      <td>2558</td>\n",
       "      <td>1962-11-05</td>\n",
       "      <td>985</td>\n",
       "      <td>George Shearing</td>\n",
       "      <td>george shearing</td>\n",
       "      <td>male</td>\n",
       "      <td>['composer', 'musician', 'artist', 'profession...</td>\n",
       "      <td>United Kingdom</td>\n",
       "      <td>London</td>\n",
       "      <td>Roman Empire</td>\n",
       "      <td>1919-08-13</td>\n",
       "      <td>Cantata No. 54: Widerstehe doch der S√ºnde by ...</td>\n",
       "      <td>Metal construction set</td>\n",
       "      <td>Masterman Ready - Frederick Marryat</td>\n",
       "      <td>https://en.wikipedia.org/wiki/George_Shearing</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009y5t1</td>\n",
       "      <td>1962</td>\n",
       "      <td>George_Shearing</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>769</th>\n",
       "      <td>2396</td>\n",
       "      <td>1965-12-27</td>\n",
       "      <td>1850</td>\n",
       "      <td>Michael Flanders</td>\n",
       "      <td>michael flanders</td>\n",
       "      <td>male</td>\n",
       "      <td>['actor', 'performing artist', 'artist', 'prof...</td>\n",
       "      <td>United Kingdom</td>\n",
       "      <td>London</td>\n",
       "      <td>Roman Empire</td>\n",
       "      <td>1922-03-01</td>\n",
       "      <td>Sanctus / Agnus Dei from Missa Criolla by Arie...</td>\n",
       "      <td>Horn</td>\n",
       "      <td>Blank book and pencils</td>\n",
       "      <td>https://en.wikipedia.org/wiki/Michael_Flanders</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009y3r8</td>\n",
       "      <td>1965</td>\n",
       "      <td>Michael_Flanders</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1082</th>\n",
       "      <td>2080</td>\n",
       "      <td>1972-02-07</td>\n",
       "      <td>603</td>\n",
       "      <td>David Hockney</td>\n",
       "      <td>david hockney</td>\n",
       "      <td>male</td>\n",
       "      <td>['painter', 'visual artist', 'artist', 'profes...</td>\n",
       "      <td>England</td>\n",
       "      <td>Bradford</td>\n",
       "      <td>United Kingdom</td>\n",
       "      <td>1937-07-09</td>\n",
       "      <td>Liebestod (from Tristan und Isolde) by NA</td>\n",
       "      <td>Paper, pencils and a battery-operated sharpener</td>\n",
       "      <td>Route 69 - Floyd Carter</td>\n",
       "      <td>https://en.wikipedia.org/wiki/David_Hockney</td>\n",
       "      <td>https://www.bbc.co.uk/programmes/p009nc50</td>\n",
       "      <td>1972</td>\n",
       "      <td>David_Hockney</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      episode_ref       date  castaway_ref              name  \\\n",
       "362          2954 1957-12-09           852        Eric Sykes   \n",
       "562          2608 1961-11-06          2893  Wee Georgie Wood   \n",
       "613          2558 1962-11-05           985   George Shearing   \n",
       "769          2396 1965-12-27          1850  Michael Flanders   \n",
       "1082         2080 1972-02-07           603     David Hockney   \n",
       "\n",
       "              std_name gender  \\\n",
       "362         eric sykes   male   \n",
       "562   wee georgie wood   male   \n",
       "613    george shearing   male   \n",
       "769   michael flanders   male   \n",
       "1082     david hockney   male   \n",
       "\n",
       "                                             profession  \\\n",
       "362   ['screenwriter', 'writer', 'author', 'creator'...   \n",
       "562   ['comedian', 'actor', 'performing artist', 'ar...   \n",
       "613   ['composer', 'musician', 'artist', 'profession...   \n",
       "769   ['actor', 'performing artist', 'artist', 'prof...   \n",
       "1082  ['painter', 'visual artist', 'artist', 'profes...   \n",
       "\n",
       "     country_of_citizenship place_of_birth country_of_birth date_of_birth  \\\n",
       "362          United Kingdom         Oldham   United Kingdom    1923-05-04   \n",
       "562                     NaN            NaN              NaN    1894-12-17   \n",
       "613          United Kingdom         London     Roman Empire    1919-08-13   \n",
       "769          United Kingdom         London     Roman Empire    1922-03-01   \n",
       "1082                England       Bradford   United Kingdom    1937-07-09   \n",
       "\n",
       "                                               favTrack  \\\n",
       "362                                            NA by NA   \n",
       "562   Private Lives Act 1 by Noel Coward & Gertrude ...   \n",
       "613   Cantata No. 54: Widerstehe doch der S√ºnde by ...   \n",
       "769   Sanctus / Agnus Dei from Missa Criolla by Arie...   \n",
       "1082          Liebestod (from Tristan und Isolde) by NA   \n",
       "\n",
       "                                               luxury  \\\n",
       "362                                               NaN   \n",
       "562                                 Writing materials   \n",
       "613                            Metal construction set   \n",
       "769                                              Horn   \n",
       "1082  Paper, pencils and a battery-operated sharpener   \n",
       "\n",
       "                                         book  \\\n",
       "362                                       NaN   \n",
       "562   Memoirs of a Midget - Walter de la Mare   \n",
       "613       Masterman Ready - Frederick Marryat   \n",
       "769                    Blank book and pencils   \n",
       "1082                  Route 69 - Floyd Carter   \n",
       "\n",
       "                                           wiki_link  \\\n",
       "362         https://en.wikipedia.org/wiki/Eric_Sykes   \n",
       "562   https://en.wikipedia.org/wiki/Wee_Georgie_Wood   \n",
       "613    https://en.wikipedia.org/wiki/George_Shearing   \n",
       "769   https://en.wikipedia.org/wiki/Michael_Flanders   \n",
       "1082     https://en.wikipedia.org/wiki/David_Hockney   \n",
       "\n",
       "                                           link  year           wiki_id  \\\n",
       "362   https://www.bbc.co.uk/programmes/p009y8l4  1957        Eric_Sykes   \n",
       "562   https://www.bbc.co.uk/programmes/p009y6ck  1961  Wee_Georgie_Wood   \n",
       "613   https://www.bbc.co.uk/programmes/p009y5t1  1962   George_Shearing   \n",
       "769   https://www.bbc.co.uk/programmes/p009y3r8  1965  Michael_Flanders   \n",
       "1082  https://www.bbc.co.uk/programmes/p009nc50  1972     David_Hockney   \n",
       "\n",
       "     disability_status  \n",
       "362               True  \n",
       "562               True  \n",
       "613               True  \n",
       "769               True  \n",
       "1082              True  "
      ]
     },
     "execution_count": 94,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "disabled_castaways = castaways_df[castaways_df[\"disability_status\"] == True]\n",
    "disabled_castaways.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "id": "84da6d23-bb73-40f9-80c3-474be2075c6d",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "disabled_castaways.to_csv(\"disabled_castaways.csv\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "5a65bc59-4e19-4002-a84f-bd88cbb274ef",
   "metadata": {},
   "source": [
    "Finally, let's get the core data into Markdown ready to use in the blog. \n",
    "\n",
    "I'll edit it manually for readability before publishing. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "id": "8f86571f-af30-4019-a3b7-fe3d2a30f0b4",
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "- **Eric Sykes** (1957) - \n",
      "Eric Sykes  (4 May 1923 – 4 July 2012) was an English radio, stage, television and film writer, comedian, actor, and director whose performing career spanned more than 50 years.\n",
      "[Eric Sykes on Wikipedia](https://en.wikipedia.org/wiki/Eric_Sykes), [Eric Sykes on Desert Island Discs](https://www.bbc.co.uk/programmes/p009y8l4), \n",
      "- **Wee Georgie Wood** (1961) - \n",
      "George Wood Bamlett OBE (17 December 1895 – 19 February 1979), known professionally as Wee Georgie Wood, was a British comic entertainer and actor who appeared in films, plays and music hall revues.\n",
      "[Wee Georgie Wood on Wikipedia](https://en.wikipedia.org/wiki/Wee_Georgie_Wood), [Wee Georgie Wood on Desert Island Discs](https://www.bbc.co.uk/programmes/p009y6ck), \n",
      "- **George Shearing** (1962) - \n",
      "Sir George Albert Shearing,  (13 August 1919 –  14 February 2011) was a British jazz pianist who for many years led a popular jazz group that recorded for Discovery Records, MGM Records and Capitol Records.\n",
      "[George Shearing on Wikipedia](https://en.wikipedia.org/wiki/George_Shearing), [George Shearing on Desert Island Discs](https://www.bbc.co.uk/programmes/p009y5t1), \n",
      "- **Michael Flanders** (1965) - \n",
      "Michael Henry Flanders  (1 March 1922 – 14 April 1975) was an English actor, broadcaster, and writer and performer of comic songs.\n",
      "[Michael Flanders on Wikipedia](https://en.wikipedia.org/wiki/Michael_Flanders), [Michael Flanders on Desert Island Discs](https://www.bbc.co.uk/programmes/p009y3r8), \n",
      "- **David Hockney** (1972) - \n",
      "David Hockney  (born 9 July 1937) is an English painter, draftsman, printmaker, stage designer, and photographer.\n",
      "[David Hockney on Wikipedia](https://en.wikipedia.org/wiki/David_Hockney), [David Hockney on Desert Island Discs](https://www.bbc.co.uk/programmes/p009nc50), \n",
      "- **Michael Ansell** (1973) - \n",
      "Colonel Sir Michael Picton Ansell, CBE, DSO (26 March 1905 – 17 February 1994) was a soldier, show jumping rider, polo player, and horse show administrator.\n",
      "[Michael Ansell on Wikipedia](https://en.wikipedia.org/wiki/Michael_Ansell), [Michael Ansell on Desert Island Discs](https://www.bbc.co.uk/programmes/p009n8t9), \n",
      "- **Barry Humphries** (1973) - \n",
      "John Barry Humphries  (born 17 February 1934) is an Australian comedian, actor, author and satirist.\n",
      "[Barry Humphries on Wikipedia](https://en.wikipedia.org/wiki/Barry_Humphries), [Barry Humphries on Desert Island Discs](https://www.bbc.co.uk/programmes/p009n8cn), \n",
      "- **Itzhak Perlman** (1978) - \n",
      "Itzhak Perlman (Hebrew: יצחק פרלמן; born August 31, 1945) is an Israeli-American violinist widely considered one of the greatest violinists in the world.\n",
      "[Itzhak Perlman on Wikipedia](https://en.wikipedia.org/wiki/Itzhak_Perlman), [Itzhak Perlman on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mysv), \n",
      "- **David Scott Blackhall** (1980) - \n",
      "David Scott Blackhall was a radio personality, author and poet.\n",
      "[David Scott Blackhall on Wikipedia](https://en.wikipedia.org/wiki/David_Scott_Blackhall), [David Scott Blackhall on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mw1h), \n",
      "- **Tristan Jones** (1980) - \n",
      "Arthur Jones, pen name Tristan Jones (8 May 1929 – 21 June 1995) was a British mariner and author.\n",
      "[Tristan Jones on Wikipedia](https://en.wikipedia.org/wiki/Tristan_Jones), [Tristan Jones on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mvz0), \n",
      "- **Richard Leakey** (1981) - \n",
      "Richard Erskine Frere Leakey  (19 December 1944 – 2 January 2022) was a Kenyan paleoanthropologist, conservationist and politician.\n",
      "[Richard Leakey on Wikipedia](https://en.wikipedia.org/wiki/Richard_Leakey), [Richard Leakey on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mv29), \n",
      "- **Douglas Bader** (1981) - \n",
      "Group Captain Sir Douglas Robert Steuart Bader,  (; 21 February 1910 – 5 September 1982) was a Royal Air Force flying ace during the Second World War.\n",
      "[Douglas Bader on Wikipedia](https://en.wikipedia.org/wiki/Douglas_Bader), [Douglas Bader on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mthn), \n",
      "- **Rosemary Sutcliff** (1983) - \n",
      "Rosemary Sutcliff  (14 December 1920 – 23 July 1992) was an English novelist best known for children's books, especially historical fiction and retellings of myths and legends.\n",
      "[Rosemary Sutcliff on Wikipedia](https://en.wikipedia.org/wiki/Rosemary_Sutcliff), [Rosemary Sutcliff on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mj4y), \n",
      "- **Christopher Reeve** (1984) - \n",
      "Christopher D'Olier Reeve (September 25, 1952 – October 10, 2004) was an American actor, film director, author, and activist, best known for playing the title character in the film Superman (1978) and three sequels.\n",
      "[Christopher Reeve on Wikipedia](https://en.wikipedia.org/wiki/Christopher_Reeve), [Christopher Reeve on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mhk0), \n",
      "- **Ved Mehta** (1984) - \n",
      "Ved Parkash Mehta (21 March 1934 – 9 January 2021) was an Indian-born writer who lived and worked mainly in the United States.\n",
      "[Ved Mehta on Wikipedia](https://en.wikipedia.org/wiki/Ved_Mehta), [Ved Mehta on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mh8b), \n",
      "- **Anthony Hopkins** (1985) - \n",
      "Sir Philip Anthony Hopkins  (born 31 December 1937) is a Welsh actor, director, and producer.\n",
      "[Anthony Hopkins on Wikipedia](https://en.wikipedia.org/wiki/Anthony_Hopkins), [Anthony Hopkins on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mn5s), \n",
      "- **Bobby Robson** (1986) - \n",
      "Sir Robert William Robson  (18 February 1933 – 31 July 2009) was an English footballer and football manager.\n",
      "[Bobby Robson on Wikipedia](https://en.wikipedia.org/wiki/Bobby_Robson), [Bobby Robson on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mmml), \n",
      "- **Stephanie Beacham** (1988) - \n",
      "Stephanie Beacham (born 28 February 1947) is an English television, film, radio and theatre actress.\n",
      "[Stephanie Beacham on Wikipedia](https://en.wikipedia.org/wiki/Stephanie_Beacham), [Stephanie Beacham on Desert Island Discs](https://www.bbc.co.uk/programmes/p009mgcr), \n",
      "- **David Blunkett** (1990) - \n",
      "David Blunkett, Baron Blunkett,  (born 6 June 1947) is a British Labour Party politician who has been a Member of the House of Lords since 2015, and previously served as the Member of Parliament (MP) for  Sheffield Brightside and Hillsborough from  1987 to 2015, when he stood down.\n",
      "[David Blunkett on Wikipedia](https://en.wikipedia.org/wiki/David_Blunkett), [David Blunkett on Desert Island Discs](https://www.bbc.co.uk/programmes/p009406m), \n",
      "- **Sue Townsend** (1991) - \n",
      "Susan Lillian Townsend  (née Johnstone; 2 April 1946 – 10 April 2014), was an English writer and humorist whose work encompasses novels, plays and works of journalism.\n",
      "[Sue Townsend on Wikipedia](https://en.wikipedia.org/wiki/Sue_Townsend), [Sue Townsend on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093yl0), \n",
      "- **Stephen Hawking** (1992) - \n",
      "Stephen William Hawking  (8 January 1942 – 14 March 2018) was an English theoretical physicist, cosmologist, and author who, at the time of his death, was director of research at the Centre for Theoretical Cosmology at the University of Cambridge.\n",
      "[Stephen Hawking on Wikipedia](https://en.wikipedia.org/wiki/Stephen_Hawking), [Stephen Hawking on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093xb2), \n",
      "- **Evelyn Glennie** (1993) - \n",
      "Dame Evelyn Elizabeth Ann Glennie,  (born 19 July 1965) is a Scottish percussionist.\n",
      "[Evelyn Glennie on Wikipedia](https://en.wikipedia.org/wiki/Evelyn_Glennie), [Evelyn Glennie on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093x6y), \n",
      "- **Jack Ashley, Baron Ashley of Stoke** (1993) - \n",
      "Jack Ashley, Baron Ashley of Stoke,  (6 December 1922 – 20 April 2012) was a British politician.\n",
      "[Jack Ashley, Baron Ashley of Stoke on Wikipedia](https://en.wikipedia.org/wiki/Jack_Ashley,_Baron_Ashley_of_Stoke), [Jack Ashley, Baron Ashley of Stoke on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093wqf), \n",
      "- **Oliver Sacks** (1994) - \n",
      "Oliver Wolf Sacks  (9 July 1933 – 30 August 2015) was a British neurologist, naturalist, historian of science, and writer.\n",
      "[Oliver Sacks on Wikipedia](https://en.wikipedia.org/wiki/Oliver_Sacks), [Oliver Sacks on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093r1l), \n",
      "- **John Wilson (blind activist)** (1995) - \n",
      "Sir John Foster Wilson CBE (20 January 1919 – 25 November 1999) was a British public health advocate, best known for working to prevent blindness in developing countries in Africa and South and South East Asia.\n",
      "[John Wilson (blind activist) on Wikipedia](https://en.wikipedia.org/wiki/John_Wilson_(blind_activist)), [John Wilson (blind activist) on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093qm9), \n",
      "- **Gordon Brown** (1996) - \n",
      "James Gordon Brown  (born 20 February 1951) is a British politician who served as Prime Minister of the United Kingdom and Leader of the Labour Party from 2007 to 2010.\n",
      "[Gordon Brown on Wikipedia](https://en.wikipedia.org/wiki/Gordon_Brown), [Gordon Brown on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093nrg), \n",
      "- **Eric Sykes** (1997) - \n",
      "Eric Sykes  (4 May 1923 – 4 July 2012) was an English radio, stage, television and film writer, comedian, actor, and director whose performing career spanned more than 50 years.\n",
      "[Eric Sykes on Wikipedia](https://en.wikipedia.org/wiki/Eric_Sykes), [Eric Sykes on Desert Island Discs](https://www.bbc.co.uk/programmes/p009447g), \n",
      "- **Ian Dury** (2000) - \n",
      "Ian Robins Dury (12 May 1942 –  27 March 2000) was a British singer, songwriter and actor who rose to fame during the late 1970s, during the punk and new wave era of rock music.\n",
      "[Ian Dury on Wikipedia](https://en.wikipedia.org/wiki/Ian_Dury), [Ian Dury on Desert Island Discs](https://www.bbc.co.uk/programmes/p0093n4m), \n",
      "- **Tanni Grey-Thompson** (2001) - \n",
      "Carys Davina Grey-Thompson, Baroness Grey-Thompson,  (born 26 July 1969), is a Welsh life peeress, television presenter and former wheelchair racer.\n",
      "[Tanni Grey-Thompson on Wikipedia](https://en.wikipedia.org/wiki/Tanni_Grey-Thompson), [Tanni Grey-Thompson on Desert Island Discs](https://www.bbc.co.uk/programmes/p00948z1), \n",
      "- **Bobby Robson** (2004) - \n",
      "Sir Robert William Robson  (18 February 1933 – 31 July 2009) was an English footballer and football manager.\n",
      "[Bobby Robson on Wikipedia](https://en.wikipedia.org/wiki/Bobby_Robson), [Bobby Robson on Desert Island Discs](https://www.bbc.co.uk/programmes/p009367v), \n",
      "- **Frank Gardner (journalist)** (2005) - \n",
      "Francis Rolleston Gardner  (born 31 July 1961) is a British journalist, author and retired British Army Reserve officer.\n",
      "[Frank Gardner (journalist) on Wikipedia](https://en.wikipedia.org/wiki/Frank_Gardner_(journalist)), [Frank Gardner (journalist) on Desert Island Discs](https://www.bbc.co.uk/programmes/p00935dk), \n",
      "- **Thomas Quasthoff** (2009) - \n",
      "Thomas Quasthoff (born 9 November 1959) is a German bass-baritone.\n",
      "[Thomas Quasthoff on Wikipedia](https://en.wikipedia.org/wiki/Thomas_Quasthoff), [Thomas Quasthoff on Desert Island Discs](https://www.bbc.co.uk/programmes/b00h4d2l), \n",
      "- **Barry Humphries** (2009) - \n",
      "John Barry Humphries  (born 17 February 1934) is an Australian comedian, actor, author and satirist.\n",
      "[Barry Humphries on Wikipedia](https://en.wikipedia.org/wiki/Barry_Humphries), [Barry Humphries on Desert Island Discs](https://www.bbc.co.uk/programmes/b00khkxy), \n",
      "- **Jane Campbell, Baroness Campbell of Surbiton** (2012) - \n",
      "Jane Susan Campbell, Baroness Campbell of Surbiton,  (born 19 April 1959) is a British disability rights campaigner and a life peer in the House of Lords.\n",
      "[Jane Campbell, Baroness Campbell of Surbiton on Wikipedia](https://en.wikipedia.org/wiki/Jane_Campbell,_Baroness_Campbell_of_Surbiton), [Jane Campbell, Baroness Campbell of Surbiton on Desert Island Discs](https://www.bbc.co.uk/programmes/b01lh96q), \n",
      "- **Ade Adepitan** (2012) - \n",
      "Adedoyin Olayiwola \"Ade\" Adepitan  (born 27 March 1973) is a Nigerian-born British television presenter and wheelchair basketball player.\n",
      "[Ade Adepitan on Wikipedia](https://en.wikipedia.org/wiki/Ade_Adepitan), [Ade Adepitan on Desert Island Discs](https://www.bbc.co.uk/programmes/b01n0t5n), \n",
      "- **Chris Packham** (2013) - \n",
      "Christopher Gary Packham CBE (born 4 May 1961) is an English naturalist, nature photographer, television presenter and author, best known for his television work including the CBBC children's nature series The Really Wild Show from 1986 to 1995.\n",
      "[Chris Packham on Wikipedia](https://en.wikipedia.org/wiki/Chris_Packham), [Chris Packham on Desert Island Discs](https://www.bbc.co.uk/programmes/b03cd94y), \n",
      "- **Yinka Shonibare** (2016) - \n",
      "Yinka Shonibare CBE, RA, (born 9 August 1962), is a British-Nigerian artist living in the United Kingdom.\n",
      "[Yinka Shonibare on Wikipedia](https://en.wikipedia.org/wiki/Yinka_Shonibare), [Yinka Shonibare on Desert Island Discs](https://www.bbc.co.uk/programmes/b0735y62), \n",
      "- **Warwick Davis** (2016) - \n",
      "Warwick Ashley Davis ( WORR-ik, born 3 February 1970) is an English actor and television presenter.\n",
      "[Warwick Davis on Wikipedia](https://en.wikipedia.org/wiki/Warwick_Davis), [Warwick Davis on Desert Island Discs](https://www.bbc.co.uk/programmes/b07ff0hj), \n",
      "- **Philip Craven** (2016) - \n",
      "Sir Philip Lee Craven  (born 4 July 1950) is an English sports administrator, former Paralympic wheelchair basketball player, swimmer and track and field athlete.\n",
      "[Philip Craven on Wikipedia](https://en.wikipedia.org/wiki/Philip_Craven), [Philip Craven on Desert Island Discs](https://www.bbc.co.uk/programmes/b0848q7q), \n"
     ]
    }
   ],
   "source": [
    "for i in disabled_castaways.index:\n",
    "    castaway_id = disabled_castaways.loc[i][\"wiki_id\"]\n",
    "    page = wikipedia.page(castaway_id, auto_suggest = False)\n",
    "    episode_url = disabled_castaways.loc[i][\"link\"]\n",
    "    print(\"- **{}** ({}) - \".format(page.title, disabled_castaways.loc[i][\"year\"]))\n",
    "    print(wikipedia.summary(castaway_id, sentences = 1, auto_suggest = False))\n",
    "    print(\"[{} on Wikipedia]({}), [{} on Desert Island Discs]({}), \".format(page.title, page.url, page.title, episode_url))\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.9"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}