Get text and values form pdf?

[Rapid1898-code]

Hello - i try to read the data from the attached pdf using the following code:

import pdfplumber
import os
import sys
if __name__ == '__main__':  
  path = os.path.abspath(os.path.dirname(sys.argv[0])) 
  listFiles = [x for x in os.listdir(path) if ".pdf" in x]
  for idx, wPDF in enumerate(listFiles):
    print(f"Working for {wPDF}")
    fn = os.path.join(path, wPDF)
    table_settings = {
        "vertical_strategy": "lines",
        "horizontal_strategy": "lines"
    }
    pdf = pdfplumber.open(fn)    
    workLines = []    
    for idxPage, page in enumerate(pdf.pages, start=1):                         
      print(f"Reading tables for page {idxPage}")    
      erg=page.extract_tables(table_settings)
      workLines.extend(page.extract_text().splitlines())
      for l in workLines:
        print(l)
      exit()
    pdf.close()    

I get all the text like:
"Authorized capital of the company as on the date of filing"
but i don´t get the values from the boxes on the right side beside the text
eg. in that case "1,000,000"

How can i get this all with the text and the values?
In the same order as it can be seen in the pdf?

Form AOC-4-04042021_signed.pdf

[jsvine]

These values are represented in the PDF not as standard text, but rather as "annotations". You can access a page's annotations via page.annots, which returns a list of the annotation objects. Each object contains a lot of detail, but to get just the key-value pairs, you can run this:

{ a["title"]:a["data"]["V"].decode("utf-8")
  for a in page.annots if "V" in a["data"] }

[Rapid1898-code]

Thx - is there any way to get the text and the value of the annotations in the correct order line by line?

[jsvine]

Currently, this would have to be something you handle with custom logic, comparing the positions (x0, top, x1, bottom) of the results of page.annots and page.extract_words().

[Rapid1898-code]

Thx a lot again - i think it working fine with your suggestion - i now use the following code:
The only thing i see is that i have some problems reading the page 14 of the document -

Using this code:

import pdfplumber
import os
import sys

if __name__ == '__main__':
  path = os.path.abspath(os.path.dirname(sys.argv[0]))   
  fn = os.path.join(path, "Form AOC-4-04042021_signed.pdf")
  pdf = pdfplumber.open(fn)    
  wPage = pdf.pages[-1]
  ergAnnots = wPage.annots   

i get this RecursionError:

  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in <dictcomp>
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 72, in resolve_all
    return resolve_all(resolved)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in resolve_all
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in <dictcomp>
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 74, in resolve_all
    return type(x)(resolve_all(v) for v in x)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 74, in <genexpr>
    return type(x)(resolve_all(v) for v in x)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 72, in resolve_all
    return resolve_all(resolved)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in resolve_all
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in <dictcomp>
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 74, in resolve_all
    return type(x)(resolve_all(v) for v in x)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 74, in <genexpr>
    return type(x)(resolve_all(v) for v in x)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 72, in resolve_all
    return resolve_all(resolved)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in resolve_all
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in <dictcomp>
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in resolve_all
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 77, in <dictcomp>
    return {k: v if k in exceptions else resolve_all(v) for k, v in x.items()}
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfplumber\utils\pdfinternals.py", line 66, in resolve_all
    resolved = x.resolve()
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfminer\pdftypes.py", line 106, in resolve
    return self.doc.getobj(self.objid)
  File "G:\DEV\.venv\pdf\lib\site-packages\pdfminer\pdfdocument.py", line 852, in getobj
    log.debug("getobj: objid=%r", objid)
  File "C:\Users\marku\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1464, in debug
    if self.isEnabledFor(DEBUG):
RecursionError: maximum recursion depth exceeded

(its a very long error-log - i just copied the last few rows of the message - but it happens when doing wPage.annots and it only happens on the page 14 - all other pages are working fine)

Why do i get a recurions error on the page 14?

[jsvine]

It appears that the PDF is malformed. When repairing the PDF, I see this error raised:

The following errors were encountered at least once while processing this file:
        circular reference to indirect object

The following warnings were encountered at least once while processing this file:
        A Form XObject had a BBox with a width or height of 0

   **** This file had errors that were repaired or ignored.
   **** The file was produced by: 
   **** >>>> Adobe XML Form Module Library <<<<
   **** Please notify the author of the software that produced this
   **** file that it does not conform to Adobe's published PDF
   **** specification.

After repairing, though, the script you've provided appears to work as intended. (Thanks for providing that code!)

[88arvin]

@Rapid1898-code
Hey, I tried running your code but I'm encountering the same error. Is your code working fine on your end? If so, could you suggest what might be causing the issue on my side?