README.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Prosodic 2\n",
    "\n",
    "[![Code coverage](https://codecov.io/gh/quadrismegistus/prosodic/branch/develop/graph/badge.svg)](https://codecov.io/gh/quadrismegistus/prosodic)\n",
    "\n",
    "Prosodic is a metrical-phonological parser written in Python. Currently, it can parse English and Finnish text, but adding additional languages is easy with a pronunciation dictionary or a custom python function. Prosodic was built by [Ryan Heuser](https://github.com/quadrismegistus), [Josh Falk](https://github.com/jsfalk), and [Arto Anttila](http://web.stanford.edu/~anttila/). Josh also maintains [another repository](https://github.com/jsfalk/prosodic1b), in which he has rewritten the part of this project that does phonetic transcription for English and Finnish. [Sam Bowman](https://github.com/sleepinyourhat) has contributed to the codebase as well, adding several new metrical constraints.\n",
    "\n",
    "\"Prosodic 2\", in this `develop` branch, is a near-total rewrite of Prosodic.\n",
    "\n",
    "Supports Python>=3.8."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Install"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1. Install python package\n",
    "\n",
    "For now, pip-install directly from this develop branch:\n",
    "\n",
    "```\n",
    "pip install git+https://github.com/quadrismegistus/prosodic@develop\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 2. Install espeak\n",
    "\n",
    "Install [espeak](https://espeak.sourceforge.net), free text-to-speak (TTS) software, to ‘sound out’ unknown words.\n",
    "\n",
    "* *Mac*: `brew install espeak`. (First install [homebrew](brew.sh) if not already installed.)\n",
    "\n",
    "* *Linux*: `apt-get install espeak`\n",
    "\n",
    "* *Windows*: Download and install from http://espeak.sourceforge.net/download.html."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Usage\n",
    "\n",
    "### Web app"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Prosodic has a new GUI (graphical user interface) in a web app. After installing, run:\n",
    "\n",
    "```\n",
    "prosodic\n",
    "```\n",
    "\n",
    "Then navigate to [http://127.0.0.1:5000/](http://127.0.0.1:5000/). It should look like this:\n",
    "\n",
    "<img width=\"800\" alt=\"prosodic-gui2\" src=\"https://github.com/quadrismegistus/prosodic/assets/733853/8acd4225-7425-43a9-8f68-aa5c1ff567f2\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Python"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Read texts"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# import prosodic\n",
    "import prosodic\n",
    "\n",
    "# load a text\n",
    "sonnet = prosodic.Text(\"\"\"\n",
    "Those hours, that with gentle work did frame\n",
    "The lovely gaze where every eye doth dwell,\n",
    "Will play the tyrants to the very same\n",
    "And that unfair which fairly doth excel;\n",
    "For never-resting time leads summer on\n",
    "To hideous winter, and confounds him there;\n",
    "Sap checked with frost, and lusty leaves quite gone,\n",
    "Beauty o’er-snowed and bareness every where:\n",
    "Then were not summer’s distillation left,\n",
    "A liquid prisoner pent in walls of glass,\n",
    "Beauty’s effect with beauty were bereft,\n",
    "Nor it, nor no remembrance what it was:\n",
    "But flowers distill’d, though they with winter meet,\n",
    "Leese but their show; their substance still lives sweet.\n",
    "\"\"\")\n",
    "\n",
    "# can also load by filename\n",
    "shaksonnets = prosodic.Text(fn='corpora/corppoetry_en/en.shakespeare.txt')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Stanzas, lines, words, syllables, phonemes\n",
    "\n",
    "Texts in prosodic are organized into a tree structure. The `.children` of a `Text` object is a list of `Stanza`'s, whose `.parent` objects point back to the `Text`. In turn, in each stanza's `.children` is a list of `Line`'s, whose `.parent`'s point back to the stanza; so on down the tree."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Text()\n",
      "|   Stanza(num=1)\n",
      "|       Line(num=1, txt='Those hours, that with gentle work did frame')\n",
      "|           WordToken(num=1, txt='Those', sent_num=1, sentpart_num=1)\n",
      "|               WordType(num=1, txt='Those', lang='en', num_forms=1)\n",
      "|                   WordForm(num=1, txt='Those')\n",
      "|                       Syllable(ipa='ðoʊz', num=1, txt='Those', is_stressed=False, is_heavy=True)\n",
      "|                           Phoneme(num=1, txt='ð', syl=-1, son=-1, cons=1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=1, cor=1, distr=1, lab=-1, hi=-1, lo=-1, back=-1, round=-1, velaric=-1, tense=0, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=3, txt='o', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=-1, lo=-1, back=1, round=1, velaric=-1, tense=1, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=3, txt='ʊ', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=1, lo=-1, back=1, round=1, velaric=-1, tense=-1, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=4, txt='z', syl=-1, son=-1, cons=1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=1, cor=1, distr=-1, lab=-1, hi=-1, lo=-1, back=-1, round=-1, velaric=-1, tense=0, long=-1, hitone=0, hireg=0)\n",
      "|           WordToken(num=2, txt=' hours', sent_num=1, sentpart_num=1)\n",
      "|               WordType(num=1, txt='hours', lang='en', num_forms=2)\n",
      "|                   WordForm(num=1, txt='hours')\n",
      "|                       Syllable(ipa=\"'aʊ\", num=1, txt='ho', is_stressed=True, is_heavy=True, is_strong=True, is_weak=False)\n",
      "|                           Phoneme(num=2, txt='a', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=-1, lo=1, back=-1, round=-1, velaric=-1, tense=1, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=3, txt='ʊ', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=1, lo=-1, back=1, round=1, velaric=-1, tense=-1, long=-1, hitone=0, hireg=0)\n",
      "|                       Syllable(ipa='ɛːz', num=2, txt='urs', is_stressed=False, is_heavy=True, is_strong=False, is_weak=True)\n",
      "|                           Phoneme(num=2, txt='ɛː', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=-1, lo=-1, back=-1, round=-1, velaric=-1, tense=-1, long=1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=4, txt='z', syl=-1, son=-1, cons=1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=1, cor=1, distr=-1, lab=-1, hi=-1, lo=-1, back=-1, round=-1, velaric=-1, tense=0, long=-1, hitone=0, hireg=0)\n",
      "|                   WordForm(num=2, txt='hours')\n",
      "|                       Syllable(ipa=\"'aʊrz\", num=1, txt='hours', is_stressed=True, is_heavy=True)\n",
      "|                           Phoneme(num=2, txt='a', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=-1, lo=1, back=-1, round=-1, velaric=-1, tense=1, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=3, txt='ʊ', syl=1, son=1, cons=-1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=0, cor=-1, distr=0, lab=-1, hi=1, lo=-1, back=1, round=1, velaric=-1, tense=-1, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=4, txt='r', syl=-1, son=1, cons=1, cont=1, delrel=0, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=1, cor=1, distr=-1, lab=-1, hi=0, lo=0, back=0, round=-1, velaric=-1, tense=0, long=-1, hitone=0, hireg=0)\n",
      "|                           Phoneme(num=4, txt='z', syl=-1, son=-1, cons=1, cont=1, delrel=-1, lat=-1, nas=-1, strid=0, voi=1, sg=-1, cg=-1, ant=1, cor=1, distr=-1, lab=-1, hi=-1, lo=-1, back=-1, round=-1, velaric=-1, tense=0, long=-1, hitone=0, hireg=0)\n",
      "|           WordToken(num=3, txt=',', sent_num=1, sentpart_num=1)\n",
      "|               WordType(num=1, txt=',', lang='en', num_forms=0, is_punc=True)\n",
      "|           WordToken(num=4, txt=' that', sent_num=1, sentpart_num=1)\n",
      "|               WordType(num=1, txt='that', lang='en', num_forms=3)\n"
     ]
    }
   ],
   "source": [
    "# Take a peek at this tree structure \n",
    "# and the features particular entities have\n",
    "sonnet.show(maxlines=30, incl_phons=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>word_num_forms</th>\n",
       "      <th>syll_is_stressed</th>\n",
       "      <th>syll_is_heavy</th>\n",
       "      <th>syll_is_strong</th>\n",
       "      <th>syll_is_weak</th>\n",
       "      <th>word_is_punc</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>stanza_num</th>\n",
       "      <th>line_num</th>\n",
       "      <th>line_txt</th>\n",
       "      <th>sent_num</th>\n",
       "      <th>sentpart_num</th>\n",
       "      <th>wordtoken_num</th>\n",
       "      <th>wordtoken_txt</th>\n",
       "      <th>word_lang</th>\n",
       "      <th>wordform_num</th>\n",
       "      <th>syll_num</th>\n",
       "      <th>syll_txt</th>\n",
       "      <th>syll_ipa</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">Those hours, that with gentle work did frame</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">1</th>\n",
       "      <th>1</th>\n",
       "      <th>Those</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>Those</th>\n",
       "      <th>ðoʊz</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"3\" valign=\"top\">2</th>\n",
       "      <th rowspan=\"3\" valign=\"top\">hours</th>\n",
       "      <th rowspan=\"3\" valign=\"top\">en</th>\n",
       "      <th rowspan=\"2\" valign=\"top\">1</th>\n",
       "      <th>1</th>\n",
       "      <th>ho</th>\n",
       "      <th>'aʊ</th>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>urs</th>\n",
       "      <th>ɛːz</th>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>1</th>\n",
       "      <th>hours</th>\n",
       "      <th>'aʊrz</th>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>,</th>\n",
       "      <th>en</th>\n",
       "      <th>0</th>\n",
       "      <th>0</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"5\" valign=\"top\">14</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">Leese but their show; their substance still lives sweet.</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">1</th>\n",
       "      <th>7</th>\n",
       "      <th>substance</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>tance</th>\n",
       "      <th>stəns</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <th>still</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>still</th>\n",
       "      <th>'stɪl</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <th>lives</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>lives</th>\n",
       "      <th>'lɪvz</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <th>sweet</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>sweet</th>\n",
       "      <th>'swiːt</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <th>.</th>\n",
       "      <th>en</th>\n",
       "      <th>0</th>\n",
       "      <th>0</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>195 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "Text()"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# take a peek at it in dataframe form\n",
    "sonnet.df   # by-syllable dataframe representation\n",
    "sonnet      # ...which will also be shown when text object displayed (in a notebook)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "# you can loop over this directly if you want\n",
    "for stanza in shaksonnets.stanzas:\n",
    "    for line in sonnet:\n",
    "        for wordtoken in line:\n",
    "            for wordtype in wordtoken:\n",
    "                for wordform in wordtype:\n",
    "                    for syllable in wordform:\n",
    "                        for phoneme in syllable:\n",
    "                            # ...\n",
    "                            pass"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "Shakespeare's sonnets have:\n",
      "  * 154 \"stanzas\"        (in this text, each one a sonnet)\n",
      "  * 2,155 lines\n",
      "  * 20,317 wordtokens    (including punctuation)\n",
      "  * 20,317 wordtypes     (each token has one wordtype object)\n",
      "  * 17,601 wordforms     (a word + IPA pronunciation; no punctuation)\n",
      "  * 21,915 syllables\n",
      "  * 63,614 phonemes\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# or directly access components\n",
    "print(f'''\n",
    "Shakespeare's sonnets have:\n",
    "  * {len(shaksonnets.stanzas):,} \"stanzas\"        (in this text, each one a sonnet)\n",
    "  * {len(shaksonnets.lines):,} lines\n",
    "  * {len(shaksonnets.wordtokens):,} wordtokens    (including punctuation)\n",
    "  * {len(shaksonnets.wordtypes):,} wordtypes     (each token has one wordtype object)\n",
    "  * {len(shaksonnets.wordforms):,} wordforms     (a word + IPA pronunciation; no punctuation)\n",
    "  * {len(shaksonnets.syllables):,} syllables\n",
    "  * {len(shaksonnets.phonemes):,} phonemes\n",
    "''')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>word_num_forms</th>\n",
       "      <th>syll_is_stressed</th>\n",
       "      <th>syll_is_heavy</th>\n",
       "      <th>syll_is_strong</th>\n",
       "      <th>syll_is_weak</th>\n",
       "      <th>word_is_punc</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>line_num</th>\n",
       "      <th>line_txt</th>\n",
       "      <th>sent_num</th>\n",
       "      <th>sentpart_num</th>\n",
       "      <th>wordtoken_num</th>\n",
       "      <th>wordtoken_txt</th>\n",
       "      <th>word_lang</th>\n",
       "      <th>wordform_num</th>\n",
       "      <th>syll_num</th>\n",
       "      <th>syll_txt</th>\n",
       "      <th>syll_ipa</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"11\" valign=\"top\">Those hours, that with gentle work did frame</th>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th>1</th>\n",
       "      <th>Those</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>Those</th>\n",
       "      <th>ðoʊz</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"3\" valign=\"top\">2</th>\n",
       "      <th rowspan=\"3\" valign=\"top\">hours</th>\n",
       "      <th rowspan=\"3\" valign=\"top\">en</th>\n",
       "      <th rowspan=\"2\" valign=\"top\">1</th>\n",
       "      <th>1</th>\n",
       "      <th>ho</th>\n",
       "      <th>'aʊ</th>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>urs</th>\n",
       "      <th>ɛːz</th>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>1</th>\n",
       "      <th>hours</th>\n",
       "      <th>'aʊrz</th>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>,</th>\n",
       "      <th>en</th>\n",
       "      <th>0</th>\n",
       "      <th>0</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <th>gentle</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>tle</th>\n",
       "      <th>təl</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <th>work</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>work</th>\n",
       "      <th>'wɛːk</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"2\" valign=\"top\">8</th>\n",
       "      <th rowspan=\"2\" valign=\"top\">did</th>\n",
       "      <th rowspan=\"2\" valign=\"top\">en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>did</th>\n",
       "      <th>dɪd</th>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>1</th>\n",
       "      <th>did</th>\n",
       "      <th>'dɪd</th>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <th>frame</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>frame</th>\n",
       "      <th>'freɪm</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>15 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "Line(num=1, txt='Those hours, that with gentle work did frame')"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# access lines\n",
    "\n",
    "# text.line{num} will return text.lines[num-1]\n",
    "assert sonnet.line1 is sonnet.lines[0]\n",
    "assert sonnet.line10 is sonnet.lines[9]\n",
    "\n",
    "# show the line\n",
    "sonnet.line1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "\u001b[34m\u001b[1mtokenizing\u001b[0m\u001b[36m @ 2023-12-15 14:14:17,991\u001b[0m\n",
      "\u001b[34m\u001b[1m⎿ 0 seconds\u001b[0m\u001b[36m @ 2023-12-15 14:14:17,992\u001b[0m\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>word_num_forms</th>\n",
       "      <th>syll_is_stressed</th>\n",
       "      <th>syll_is_heavy</th>\n",
       "      <th>word_is_punc</th>\n",
       "      <th>syll_is_strong</th>\n",
       "      <th>syll_is_weak</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>line_txt</th>\n",
       "      <th>sent_num</th>\n",
       "      <th>sentpart_num</th>\n",
       "      <th>wordtoken_num</th>\n",
       "      <th>wordtoken_txt</th>\n",
       "      <th>word_lang</th>\n",
       "      <th>wordform_num</th>\n",
       "      <th>syll_num</th>\n",
       "      <th>syll_txt</th>\n",
       "      <th>syll_ipa</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"11\" valign=\"top\">A horse, a horse, my kingdom for a horse!</th>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th>1</th>\n",
       "      <th>A</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>A</th>\n",
       "      <th>eɪ</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>horse</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>horse</th>\n",
       "      <th>'hɔːrs</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>,</th>\n",
       "      <th>en</th>\n",
       "      <th>0</th>\n",
       "      <th>0</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <th>a</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>a</th>\n",
       "      <th>eɪ</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <th>horse</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>horse</th>\n",
       "      <th>'hɔːrs</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <th>kingdom</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>dom</th>\n",
       "      <th>dəm</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <th>for</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>for</th>\n",
       "      <th>fɔːr</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <th>a</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>a</th>\n",
       "      <th>eɪ</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <th>horse</th>\n",
       "      <th>en</th>\n",
       "      <th>1</th>\n",
       "      <th>1</th>\n",
       "      <th>horse</th>\n",
       "      <th>'hɔːrs</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <th>!</th>\n",
       "      <th>en</th>\n",
       "      <th>0</th>\n",
       "      <th>0</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <td>0</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>13 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "Line(txt='A horse, a horse, my kingdom for a horse!')"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# build lines directly\n",
    "line_from_richardIII = prosodic.Line('A horse, a horse, my kingdom for a horse!')\n",
    "line_from_richardIII"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Metrical parsing\n",
    "\n",
    "##### Parsing lines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>parse_score</th>\n",
       "      <th>parse_is_bounded</th>\n",
       "      <th>meterpos_num_slots</th>\n",
       "      <th>*w_peak</th>\n",
       "      <th>*w_stress</th>\n",
       "      <th>*s_unstress</th>\n",
       "      <th>*unres_across</th>\n",
       "      <th>*unres_within</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>line_txt</th>\n",
       "      <th>parse_rank</th>\n",
       "      <th>parse_txt</th>\n",
       "      <th>parse_meter</th>\n",
       "      <th>parse_stress</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>A horse, a horse, my kingdom for a horse!</th>\n",
       "      <th>1</th>\n",
       "      <th>a HORSE a HORSE my KING dom FOR a HORSE</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "ParseList(line_txt='A horse, a horse, my kingdom for a horse!', num_parses=1)"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# parse with default options by just reaching for best parse\n",
    "plausible_parses = line_from_richardIII.parse()\n",
    "plausible_parses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>.violation { color:#f43838; }\n",
       ".meter_strong { text-decoration: overline;}\n",
       ".miniquote { margin-left:0em;margin-top:.5em;font-family:monospace; font-size:.8em;}\n",
       ".parse {font-family:monospace;}\n",
       ".stress_strong { text-decoration: underline; text-underline-offset: 3px; }\n",
       ".stress_strong.meter_strong { text-decoration: underline overline; text-underline-offset: 3px; }\n",
       "</style><div class=\"parse\"><span class=\"meter_weak stress_weak\">A</span> <span class=\"meter_strong stress_strong\">horse</span> <span class=\"meter_weak stress_weak\">a</span> <span class=\"meter_strong stress_strong\">horse</span> <span class=\"meter_weak stress_weak\">my</span> <span class=\"meter_strong stress_strong\">king</span><span class=\"meter_weak stress_weak\">dom</span> <span class=\"meter_strong stress_weak violation\">for</span> <span class=\"meter_weak stress_weak\">a</span> <span class=\"meter_strong stress_strong\">horse</span></div><div class=\"miniquote\">⎿ Parse(rank=1, meter='-+-+-+-+-+', stress='-+-+-+---+', score=1, is_bounded=0)</div>"
      ],
      "text/plain": [
       "Parse(line_txt='A horse, a horse, my kingdom for a horse!', txt='a HORSE a HORSE my KING dom FOR a HORSE', rank=1, meter='-+-+-+-+-+', stress='-+-+-+---+', score=1, is_bounded=0)"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# see best parse\n",
    "line_from_richardIII.best_parse"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>parse_score</th>\n",
       "      <th>parse_is_bounded</th>\n",
       "      <th>meterpos_num_slots</th>\n",
       "      <th>*w_peak</th>\n",
       "      <th>*s_unstress</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>line_txt</th>\n",
       "      <th>parse_rank</th>\n",
       "      <th>parse_txt</th>\n",
       "      <th>parse_meter</th>\n",
       "      <th>parse_stress</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"6\" valign=\"top\">A horse, a horse, my kingdom for a horse!</th>\n",
       "      <th>1</th>\n",
       "      <th>a HORSE a HORSE my KING dom FOR a HORSE</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>a HORSE a HORSE my KING dom FOR a.horse</th>\n",
       "      <th>-+-+-+-+--</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>a HORSE a HORSE my KING dom.for A horse</th>\n",
       "      <th>-+-+-+--+-</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <th>a HORSE a HORSE my KING dom.for A.HORSE</th>\n",
       "      <th>-+-+-+--++</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <th>a HORSE a HORSE my KING.DOM for.a HORSE</th>\n",
       "      <th>-+-+-++--+</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <th>a HORSE a HORSE my KING dom FOR.A horse</th>\n",
       "      <th>-+-+-+-++-</th>\n",
       "      <th>-+-+-+---+</th>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "ParseList(line_txt='A horse, a horse, my kingdom for a horse!', num_parses=6)"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# parse with different options\n",
    "diff_parses = line_from_richardIII.parse(constraints=('w_peak','s_unstress'))\n",
    "diff_parses"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Parsing texts"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "\u001b[34m\u001b[1mparsing 14 lines [5x]\u001b[0m\u001b[36m @ 2023-12-15 14:17:43,563\u001b[0m\n",
      "\u001b[1;34m￨ stanza 01, line 14: LEESE but.their SHOW their SUBS tance STILL lives SWEET: 100%|\u001b[0;36m██████████\u001b[0;36m| 14/14 [00:00<00:00, 45.78it/s]\n",
      "\u001b[34m\u001b[1m⎿ 0.3 seconds\u001b[0m\u001b[36m @ 2023-12-15 14:17:43,873\u001b[0m\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>parse_score</th>\n",
       "      <th>parse_is_bounded</th>\n",
       "      <th>meterpos_num_slots</th>\n",
       "      <th>*w_peak</th>\n",
       "      <th>*w_stress</th>\n",
       "      <th>*s_unstress</th>\n",
       "      <th>*unres_across</th>\n",
       "      <th>*unres_within</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>stanza_num</th>\n",
       "      <th>line_num</th>\n",
       "      <th>line_txt</th>\n",
       "      <th>parse_rank</th>\n",
       "      <th>parse_txt</th>\n",
       "      <th>parse_meter</th>\n",
       "      <th>parse_stress</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"11\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"3\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"3\" valign=\"top\">Those hours, that with gentle work did frame</th>\n",
       "      <th>1</th>\n",
       "      <th>those HO urs THAT with GEN tle WORK did FRAME</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>those HOURS that.with GEN tle WORK did FRAME</th>\n",
       "      <th>-+--+-+-+</th>\n",
       "      <th>-+--+-+-+</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>those HOURS that.with GEN tle WORK did FRAME</th>\n",
       "      <th>-+--+-+-+</th>\n",
       "      <th>-+--+-+-+</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"2\" valign=\"top\">2</th>\n",
       "      <th rowspan=\"2\" valign=\"top\">The lovely gaze where every eye doth dwell,</th>\n",
       "      <th>1</th>\n",
       "      <th>the LO vely GAZE where E very EYE doth DWELL</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>the LO vely GAZE where E ve.ry EYE doth DWELL</th>\n",
       "      <th>-+-+-+--+-+</th>\n",
       "      <th>-+-+-+--+-+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"4\" valign=\"top\">13</th>\n",
       "      <th rowspan=\"4\" valign=\"top\">But flowers distill'd, though they with winter meet,</th>\n",
       "      <th>1</th>\n",
       "      <th>but FLO wers DIS.TILL'D though THEY with WIN ter MEET</th>\n",
       "      <th>-+-++-+-+-+</th>\n",
       "      <th>-+--+-+-+-+</th>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>but FLO wers.dis TILL'D though THEY with WIN ter MEET</th>\n",
       "      <th>-+--+-+-+-+</th>\n",
       "      <th>-+--+-+-+-+</th>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>but FLO.WERS dis TILL'D though THEY with WIN ter MEET</th>\n",
       "      <th>-++-+-+-+-+</th>\n",
       "      <th>-+--+-+-+-+</th>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <th>but FLO wers DIS till'd THOUGH they.with WIN ter MEET</th>\n",
       "      <th>-+-+-+--+-+</th>\n",
       "      <th>-+--+---+-+</th>\n",
       "      <td>4.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <th>Leese but their show; their substance still lives sweet.</th>\n",
       "      <th>1</th>\n",
       "      <th>LEESE but.their SHOW their SUBS tance STILL lives SWEET</th>\n",
       "      <th>+--+-+-+-+</th>\n",
       "      <th>+--+-+-+++</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>37 rows × 8 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "ParseList(line_num=1, line_txt='Those hours, that with gentle work did frame', num_parses=37)"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# small texts\n",
    "sonnet.parse()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "\u001b[34m\u001b[1mparsing 2155 lines [5x]\u001b[0m\u001b[36m @ 2023-12-15 14:17:52,124\u001b[0m\n",
      "\u001b[1;34m￨ stanza 154, line 14: love's FI re HEATS.WA ter WA ter COOLS not LOVE       : 100%|\u001b[0;36m██████████\u001b[0;36m| 2155/2155 [00:56<00:00, 38.03it/s]\n",
      "\u001b[34m\u001b[1m⎿ 57.4 seconds\u001b[0m\u001b[36m @ 2023-12-15 14:18:49,496\u001b[0m\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th>parse_score</th>\n",
       "      <th>parse_is_bounded</th>\n",
       "      <th>meterpos_num_slots</th>\n",
       "      <th>*w_peak</th>\n",
       "      <th>*w_stress</th>\n",
       "      <th>*s_unstress</th>\n",
       "      <th>*unres_across</th>\n",
       "      <th>*unres_within</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>stanza_num</th>\n",
       "      <th>line_num</th>\n",
       "      <th>line_txt</th>\n",
       "      <th>parse_rank</th>\n",
       "      <th>parse_txt</th>\n",
       "      <th>parse_meter</th>\n",
       "      <th>parse_stress</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th rowspan=\"5\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"4\" valign=\"top\">1</th>\n",
       "      <th rowspan=\"4\" valign=\"top\">FROM fairest creatures we desire increase,</th>\n",
       "      <th>1</th>\n",
       "      <th>from FAI rest CREA tures WE de SIRE in CREASE</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>from FAI rest CREA tures WE de SI re IN crease</th>\n",
       "      <th>-+-+-+-+-+-</th>\n",
       "      <th>-+-+-+-+-++</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>from FAI rest CREA tures WE de SI re IN.CREASE</th>\n",
       "      <th>-+-+-+-+-++</th>\n",
       "      <th>-+-+-+-+-++</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <th>from FAI rest CREA tures WE de SI re.in CREASE</th>\n",
       "      <th>-+-+-+-+--+</th>\n",
       "      <th>-+-+-+-+--+</th>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <th>That thereby beauty's rose might never die,</th>\n",
       "      <th>1</th>\n",
       "      <th>that THE reby BEA uty's ROSE might NE ver DIE</th>\n",
       "      <th>-+-+-+-+-+</th>\n",
       "      <th>-+++-+-+-+</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th rowspan=\"5\" valign=\"top\">154</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">14</th>\n",
       "      <th rowspan=\"5\" valign=\"top\">Love's fire heats water, water cools not love.</th>\n",
       "      <th>2</th>\n",
       "      <th>love's FI re HEATS wa.ter WA ter COOLS not LOVE</th>\n",
       "      <th>-+-+--+-+-+</th>\n",
       "      <th>++-++-+-+-+</th>\n",
       "      <td>4.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <th>love's FI.RE heats WA ter WA ter COOLS not LOVE</th>\n",
       "      <th>-++-+-+-+-+</th>\n",
       "      <th>++-++-+-+-+</th>\n",
       "      <td>4.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <th>LOVE'S fire HEATS wa.ter WA ter COOLS not LOVE</th>\n",
       "      <th>+-+--+-+-+</th>\n",
       "      <th>++++-+-+-+</th>\n",
       "      <td>4.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <th>LOVE'S.FI re HEATS.WA ter WA ter COOLS not LOVE</th>\n",
       "      <th>++-++-+-+-+</th>\n",
       "      <th>++-++-+-+-+</th>\n",
       "      <td>4.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>15</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <th>love's FI re HEATS wa TER wa TER cools NOT love</th>\n",
       "      <th>-+-+-+-+-+-</th>\n",
       "      <th>++-++-+-+++</th>\n",
       "      <td>9.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>11</td>\n",
       "      <td>2</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>7277 rows × 8 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "ParseList(line_num=1, line_txt='FROM fairest creatures we desire increase,', num_parses=7277)"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# and big texts\n",
    "shaksonnets.parse()"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "venv",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.12.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}