Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v2.3.0 #202

Merged
merged 30 commits into from
Feb 1, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
277ed33
change dependabot target branch to dev
nobu-g Oct 30, 2023
6bcfac9
tweak
nobu-g Oct 31, 2023
c857362
update deps
nobu-g Nov 2, 2023
776b1ba
add tests for CLI
nobu-g Nov 2, 2023
9ba51ee
refactor
nobu-g Nov 2, 2023
4d7baa4
refactor tests
nobu-g Nov 2, 2023
566e4e3
update rhoknp and cohesion-tools
nobu-g Nov 8, 2023
9a1564e
increase recursion limit to load long documents
nobu-g Nov 10, 2023
d49b2d1
keep doc_id and sent_id during analysis
nobu-g Nov 18, 2023
f6fc759
add tests for seq2seq module
nobu-g Nov 18, 2023
208a408
Merge remote-tracking branch 'origin/dev' into dev
nobu-g Nov 18, 2023
6847377
update deps
nobu-g Nov 18, 2023
79a1ae6
add type hintings
nobu-g Nov 18, 2023
a24490c
fix a bug
nobu-g Nov 18, 2023
0f1cca9
update deps
nobu-g Nov 18, 2023
a218d99
remove unused arguments
nobu-g Dec 5, 2023
107151e
tweak
nobu-g Dec 5, 2023
55bc34c
Merge branch 'main' into dev
nobu-g Jan 31, 2024
df9900c
support Python 3.12
nobu-g Jan 31, 2024
a778e28
fix
nobu-g Jan 31, 2024
b947d38
fix
nobu-g Jan 31, 2024
84ea790
update numpy
nobu-g Jan 31, 2024
3d4f464
update deps
nobu-g Jan 31, 2024
ee8853c
Merge pull request #201 from ku-nlp/support-python3.12
nobu-g Jan 31, 2024
6f31e15
update transformers and tokenizers
nobu-g Feb 1, 2024
bd308b5
update CHANGELOG.md
nobu-g Feb 1, 2024
1c28b3d
bump version to 2.3.0
nobu-g Feb 1, 2024
7159102
tweak
nobu-g Feb 1, 2024
db8350b
increase max-parallel for github actions
nobu-g Feb 1, 2024
23f5c9f
update python dependencies by dependabot
nobu-g Feb 1, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 13 additions & 1 deletion .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,23 @@

version: 2
updates:
- package-ecosystem: "pip"
directory: "/"
schedule:
interval: "monthly"
timezone: "Asia/Tokyo"
groups:
dependencies:
patterns:
- "*"
target-branch: "dev"
versioning-strategy: lockfile-only

- package-ecosystem: "github-actions"
# Workflow files stored in the
# default location of `.github/workflows`
directory: "/"
schedule:
interval: "monthly"
timezone: "Asia/Tokyo"
target-branch: "main"
target-branch: "dev"
8 changes: 6 additions & 2 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,24 +7,28 @@ jobs:
name: Build the project
runs-on: ${{ matrix.os }}
strategy:
max-parallel: 4
max-parallel: 8
fail-fast: false
matrix:
os: [ ubuntu-latest, macos-latest, windows-latest ]
python-version: [ "3.8", "3.9", "3.10", "3.11" ]
python-version: [ "3.8", "3.9", "3.10", "3.11", "3.12" ]
steps:
- name: Checkout repository
uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v5
id: setup-python
with:
python-version: ${{ matrix.python-version }}
- name: Install Poetry
run: |
pipx install poetry
echo "$HOME/.local/bin" >> $GITHUB_PATH
- name: Install dependencies
env:
POETRY_PYTHON: ${{ steps.setup-python.outputs.python-path }}
run: |
poetry env use $POETRY_PYTHON
poetry install --no-interaction --without dev,test
- name: Build KWJA
run: |
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,10 @@ jobs:
lint:
runs-on: ubuntu-latest
strategy:
max-parallel: 4
max-parallel: 5
fail-fast: false
matrix:
python-version: [ "3.8", "3.9", "3.10", "3.11" ]
python-version: [ "3.8", "3.9", "3.10", "3.11", "3.12" ]
steps:
- name: Checkout repository
uses: actions/checkout@v4
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,10 +7,10 @@ jobs:
name: Run tests with pytest
runs-on: ubuntu-latest
strategy:
max-parallel: 4
max-parallel: 5
fail-fast: false
matrix:
python-version: [ "3.8", "3.9", "3.10", "3.11" ]
python-version: [ "3.8", "3.9", "3.10", "3.11", "3.12" ]
steps:
- name: Checkout repository
uses: actions/checkout@v4
Expand Down Expand Up @@ -47,7 +47,7 @@ jobs:
max-parallel: 4
fail-fast: false
matrix:
python-version: [ "3.8", "3.9", "3.10", "3.11" ]
python-version: [ "3.8", "3.9", "3.10", "3.11", "3.12" ]
steps:
- name: Checkout repository
uses: actions/checkout@v4
Expand Down
26 changes: 13 additions & 13 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,14 +2,14 @@ default_language_version:
python: python3.10
repos:
- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v4.4.0
rev: v4.5.0
hooks:
- id: end-of-file-fixer
- id: trailing-whitespace
- id: check-yaml
- id: check-toml
- repo: https://github.com/psf/black-pre-commit-mirror
rev: 23.9.0
rev: 23.11.0
hooks:
- id: black
- repo: https://github.com/PyCQA/flake8
Expand All @@ -22,22 +22,22 @@ repos:
hooks:
- id: isort
- repo: https://github.com/pre-commit/mirrors-mypy
rev: v1.5.1
rev: v1.7.0
hooks:
- id: mypy
additional_dependencies:
- rhoknp==1.5.0
- rhoknp==1.6.0
- hydra-core==1.3.2
- torch==2.0.0
- torchmetrics==1.1.0
- transformers==4.32.1
- tokenizers==0.13.3
- wandb==0.15.9
- typer==0.9.0
- types-PyYAML==6.0.12.11
- git+https://github.com/nobu-g/cohesion-tools[email protected]
- torch==2.1.1
- torchmetrics==1.2.0
- transformers==4.34.1
- tokenizers
- wandb
- typer
- types-PyYAML
- cohesion-tools==0.5.7
- repo: https://github.com/asottile/pyupgrade
rev: v3.10.1
rev: v3.15.0
hooks:
- id: pyupgrade
args:
Expand Down
10 changes: 9 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,13 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

## [Unreleased]

## [v2.3.0] - 2024-02-01
### Added
- Support Python 3.12.

### Fixed
- Preserve document IDs when they are given as input.

## [v2.2.0] - 2023-10-27
### Added
- Support `jumanpp` and `knp` input formats. This functionality allows you to partly use tokenization results of `jumanpp` as input.
Expand Down Expand Up @@ -190,7 +197,8 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Removed
- Remove an unnecessary dependency, `fugashi`.

[Unreleased]: https://github.com/ku-nlp/kwja/compare/v2.2.0...HEAD
[Unreleased]: https://github.com/ku-nlp/kwja/compare/v2.3.0...HEAD
[2.3.0]: https://github.com/ku-nlp/kwja/compare/v2.2.0...v2.3.0
[2.2.0]: https://github.com/ku-nlp/kwja/compare/v2.1.3...v2.2.0
[2.1.3]: https://github.com/ku-nlp/kwja/compare/v2.1.2...v2.1.3
[2.1.2]: https://github.com/ku-nlp/kwja/compare/v2.1.1...v2.1.2
Expand Down
Loading
Loading