Code

34 manual token labeling#40

Code

Merged

jettjaniak merged 18 commits intomaindelphi-suite/delphi:mainfrom 34-manual-token-labelingdelphi-suite/delphi:34-manual-token-labelingCopy head branch name to clipboardMar 13, 2024

+558-54

Commits

Commits on Feb 28, 2024

• add pandas to requirements.txt

  joshuawe

  committed
  36ffb7b

• visualize token label stats

  joshuawe

  committed
  62e9b84

• added CSV creation for token labelling

  joshuawe

  committed
  6915061

• add command line arguments save_dir and output_format

  joshuawe

  committed
  54b58ce

• factor out the token labelling

  joshuawe

  committed
  ca43948

• add test_label_tokens_from_tokenizer

  joshuawe

  committed
  c7be073

• add import_token_labels function

  joshuawe

  committed
  b313650

• add convert label dict to pd dataframe

  joshuawe

  committed
  8c07c6f

• bug fix datatypes

  joshuawe

  committed
  533ec9c

• refactor

  joshuawe

  committed
  130418e

• add test_import_token_labels

  joshuawe

  committed
  7a16cc8

Commits on Mar 1, 2024

• small fixes

  joshuawe

  committed
  7ef56c3

Commits on Mar 5, 2024

• remove the save as pickle option for token label file

  joshuawe

  committed
  4797c0c

Commits on Mar 6, 2024

• remove pytest-dependency and associated code

  joshuawe

  committed
  a49a2f0

Commits on Mar 10, 2024

• skipped all tests for token labelling

  transcendingvictor

  committed
  be84c4b

• renamed labelling .py files, and .csv output to spacy_

  transcendingvictor

  committed
  010921d

• added a #FIXME comment warning about the CSV export problem with disappearing spaces

  transcendingvictor

  committed
  8123fed

Commits on Mar 12, 2024

• cancel spacy tests and renaming

  transcendingvictor

  committed
  4a04e54