Skip to content

Add simple dict mode

Compare
Choose a tag to compare
@ikawaha ikawaha released this 07 Sep 23:08
· 98 commits to master since this release
  • Add simple dict mode to save memory usage
  • Remove unsafe
  • Fix golint

Using simple dict. mode, the analysis result does not change.
But the output contents (活用型, 活用形, 基本形, 読み, 発音) are omitted.

memory usage:

dict old full simple
IPA 193MB 175MB 132MB
UNI 872MB 795MB 590MB

Full Dict.

BOS
寿司    名詞,一般,*,*,*,*,寿司,スシ,スシ
が      助詞,格助詞,一般,*,*,*,が,ガ,ガ
食べ    動詞,自立,*,*,一段,連用形,食べる,タベ,タベ
たい    助動詞,*,*,*,特殊・タイ,基本形,たい,タイ,タイ
。      記号,句点,*,*,*,*,。,。,。
EOS

Simple Dict.

BOS
寿司    名詞,一般,*,*,*,*
が      助詞,格助詞,一般,*,*,*
食べ    動詞,自立,*,*,一段,連用形
たい    助動詞,*,*,*,特殊・タイ,基本形
。      記号,句点,*,*,*,*
EOS