Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DSK Processing #299

Open
wants to merge 17 commits into
base: main
Choose a base branch
from
Open

DSK Processing #299

wants to merge 17 commits into from

Commits on Oct 25, 2024

  1. Updating dolma dependency as version on pypi is now up to date

    @kris927b
    kris927b committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    34afcd0 View commit details
    Browse the repository at this point in the history

  2. Adding processing script for DSK data

    @kris927b
    kris927b committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    5f4dbda View commit details
    Browse the repository at this point in the history

  3. Adhering to the desired format

    @kris927b
    kris927b committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    9a31be0 View commit details
    Browse the repository at this point in the history

  4. Minor adjustments to file handling

    @kris927b
    kris927b committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1bc6552 View commit details
    Browse the repository at this point in the history

  5. Minor change to the entry id. Using filename rather than path

    @kris927b
    kris927b committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    fd7fffe View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Extracting util into separate file

    @kris927b
    kris927b committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    23e9537 View commit details
    Browse the repository at this point in the history

  2. Testing extracting documents using Docling

    @kris927b
    kris927b committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    3fcb91b View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. Using docling to extract data from PDF, DOCX, PPTX, MD.

    @kris927b
    kris927b committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    819648c View commit details
    Browse the repository at this point in the history

  2. Removing test files

    @kris927b
    kris927b committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    3e6c045 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. Adding lower bounds on dependencies

    @kris927b
    kris927b committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e89f50f View commit details
    Browse the repository at this point in the history

  2. Moving utils to dfm-data package

    @kris927b
    kris927b committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    404abf3 View commit details
    Browse the repository at this point in the history

  3. Removing unused methods to clean up code

    @kris927b
    kris927b committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    52ad08a View commit details
    Browse the repository at this point in the history

  4. Fixing spelling error

    @kris927b
    kris927b committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    dc2291d View commit details
    Browse the repository at this point in the history

  5. Separating document processing in dfm-data.

    @kris927b
    kris927b committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    bf11fcc View commit details
    Browse the repository at this point in the history

  6. Adding missing docstrings.

    @kris927b
    kris927b committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    79dcae4 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Adding .msg functionality

    @kris927b
    kris927b committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    32768f3 View commit details
    Browse the repository at this point in the history

  2. Adding extract-msg to pyproject.

    @kris927b
    kris927b committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    19244de View commit details
    Browse the repository at this point in the history