Skip to content

Commit

Permalink
feat!: complete codebase reconstruction
Browse files Browse the repository at this point in the history
BREAKING CHANGE: This commit introduces a full reconstruction of the codebase, focusing on the model loading process, evaluation logic within the evaluator, and interface design.
  • Loading branch information
Ki-Seki committed Aug 18, 2024
1 parent c62c2a8 commit 7978293
Show file tree
Hide file tree
Showing 177 changed files with 8,399 additions and 160,401 deletions.
7 changes: 3 additions & 4 deletions .github/CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ We appreciate your interest in contributing. To ensure a smooth collaboration, p
```
3. Make your changes and commit them:
```bash
git commit -m "Add a concise commit message"
git commit -m "feat: add new feature"
```
4. Push your changes to your fork:
```bash
Expand All @@ -23,8 +23,7 @@ We appreciate your interest in contributing. To ensure a smooth collaboration, p

## Code Style

- Use [isort](https://marketplace.visualstudio.com/items?itemName=ms-python.isort) to reorder import statements
- Use [yapf](https://marketplace.visualstudio.com/items?itemName=eeyore.yapf) to format Python codes into Google style
- We use `based_on_style = "google"`. See https://google.github.io/styleguide/pyguide.html
- Use [isort](https://pycqa.github.io/isort/) to reorder import statements
- Use [black](https://black.readthedocs.io/en/stable/) to format code
- Use [Google Docstring Format](https://sphinxcontrib-napoleon.readthedocs.io/en/latest/example_google.html) to standardize docstrings
- Use [Conventional Commits](https://www.conventionalcommits.org/) to make commit messages more readable
2 changes: 1 addition & 1 deletion .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Please read the [Contribution Guidelines](./CONTRIBUTING.md) before creating a pull request!
Please read the [contribution guidelines](./CONTRIBUTING.md) before creating a pull request!

请阅读[贡献指南](./CONTRIBUTING.md)后再创建拉取请求!
8 changes: 5 additions & 3 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
.vscode
__pycache__
real_config.py
/.vscode/
/output/

__pycache__/

*.log
6 changes: 0 additions & 6 deletions CITATION.bib

This file was deleted.

29 changes: 29 additions & 0 deletions CITATION.cff
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
cff-version: 1.2.0
preferred-citation:
title: "UHGEval: Benchmarking the Hallucination of Chinese Large Language Models via Unconstrained Generation"
year: "2024"
type: conference-paper
conference: "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
authors:
- family-names: Liang
given-names: Xun
- family-names: Song
given-names: Shichao
- family-names: Niu
given-names: Simin
- family-names: Li
given-names: Zhiyu
- family-names: Xiong
given-names: Feiyu
- family-names: Tang
given-names: Bo
- family-names: Wang
given-names: Yezhaohui
- family-names: He
given-names: Dawei
- family-names: Peng
given-names: Cheng
- family-names: Wang
given-names: Zhonghao
- family-names: Deng
given-names: Haiying
234 changes: 88 additions & 146 deletions README.md

Large diffs are not rendered by default.

Binary file removed assets/eval_framework.png
Binary file not shown.
72 changes: 0 additions & 72 deletions config.yaml

This file was deleted.

Loading

0 comments on commit 7978293

Please sign in to comment.