ES分词插件需求征集 #40

sing1ee · 2019-08-02T02:31:21Z

之前比较忙，最近有空梳理一下分词插件的问题。
大家有什么需求都可以提出来，我这边根据需求的重要程度进行开发。

wa-ooo · 2019-08-11T10:04:31Z

你好，请问怎么在不停止服务更新词典，我试了下替换词典，reopen index 词典貌似不生效

wangyifaer · 2019-09-19T08:23:49Z

es集成jieba分词做全文检索的时候，es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改，问题已经解决，发现效果很好。
https://github.com/wangyifaer/esplugins-jieba

wangyifaer · 2019-09-19T08:57:58Z

您好还有一个问题，es结成jieba后，一旦加入自定义分词，就会导致所有es索引自动关闭，原因应该是读取自定义词典失败

sing1ee · 2019-09-20T02:03:21Z

提一个PR吧 wangyifaer <[email protected]> 于2019年9月19日周四下午4:23写道：

…

es集成jieba分词做全文检索的时候，es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改，问题已经解决，发现效果很好。 https://github.com/wangyifaer/esplugins-jieba <http://url> — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#40?email_source=notifications&email_token=AAICIWQRM3KL7X4IPXQVWELQKMZJNA5CNFSM4IIZ2UE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7CU26A#issuecomment-533024120>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAICIWW7KVSOGMDVKQ5XXUTQKMZJNANCNFSM4IIZ2UEQ> .

nuass · 2020-03-05T09:14:16Z

jieba字典怎么热更新？

leafney · 2020-03-30T10:55:33Z

jieba字典怎么热更新？

同问

yataosu · 2020-04-22T02:57:10Z

能否加入对自定义词典的热更新功能, 每次重启服务太伤了

sing1ee · 2020-04-22T13:41:06Z

更新词典，之前已经创建的索引该如何处理呢？苏 <[email protected]> 于2020年4月22日周三上午10:57写道：

…

能否加入对自定义词典的热更新功能, 每次重启服务太伤了 — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#40 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAICIWSAI34APHOBMD5G5NTRNZMJLANCNFSM4IIZ2UEQ> .

sing1ee · 2020-04-22T13:44:08Z

@nuass @leafney @Old-Su
字典的热更新可以加，不过有一个疑问：更新字典，总是需要重建索引的。

iwaitu · 2020-05-14T12:48:53Z

什么时候能跟上es 的官方版本呀，7.70 了

sing1ee · 2020-05-28T13:59:02Z

@iwaitu OK了

sing1ee · 2020-06-06T14:57:24Z

@wa-ooo @nuass @leafney 最新的master分支和7.7.0的分支都支持字典的热更新了。具体使用见在线更新字段说明

jerry-00 · 2021-02-01T06:25:27Z

还有7.6.2的版本么?

sing1ee · 2021-02-10T11:24:51Z

还有7.6.2的版本么?

这个改一下版本号，自己打包即可。

icelighting · 2021-04-07T02:54:33Z

为啥我用7.7.0版本改6.8.0版本也没有热更新

phpsxg · 2021-04-07T12:25:12Z

我使用的es是7.9.2，下载源码后，修改build.gradle，plugin-descriptor.properties文件对应的版本后执行gradle pz，报如下错误

What went wrong:
Could not determine the dependencies of task ':pz'.

Could not resolve all task dependencies for configuration ':distJars'.
Could not resolve project :jieba-analysis.
Required by:
project :
> Project : declares a dependency from configuration 'compile' to configuration 'default' which is not declared in the descriptor for project :jieba-analysis.

Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
Get more help at https://help.gradle.org

phpsxg · 2021-04-08T00:47:06Z

还有7.6.2的版本么?

这个改一下版本号，自己打包即可。

你那边打包正常吗，我这边打包报错如下：
Downloading https://services.gradle.org/distributions/gradle-4.4.1-bin.zip

Exception in thread "main" java.net.ConnectException: Connection timed out (Connection timed out)

sing1ee · 2021-04-08T03:13:44Z

网络得问题，想想办法孙晓光 ***@***.***> 于2021年4月8日周四上午8:47写道：

…

还有7.6.2的版本么? 这个改一下版本号，自己打包即可。你那边打包正常吗，我这边打包报错如下： Downloading https://services.gradle.org/distributions/gradle-4.4.1-bin.zip Exception in thread "main" java.net.ConnectException: Connection timed out (Connection timed out) — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#40 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAICIWXI3K4DHTTOCVI3TKLTHT4JVANCNFSM4IIZ2UEQ> .

phpsxg · 2021-04-08T03:26:19Z

网络得问题，想想办法孙晓光 @.***> 于2021年4月8日周四上午8:47写道：
…
还有7.6.2的版本么? 这个改一下版本号，自己打包即可。你那边打包正常吗，我这边打包报错如下： Downloading https://services.gradle.org/distributions/gradle-4.4.1-bin.zip Exception in thread "main" java.net.ConnectException: Connection timed out (Connection timed out) — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#40 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAICIWXI3K4DHTTOCVI3TKLTHT4JVANCNFSM4IIZ2UEQ .
执行gradel pz报如下错误，你遇到过吗

root@DESKTOP-LAKGMPD:/mnt/f/STHG/install/ElasticSearch/aaa/elasticsearch-jieba-plugin-7.7.1# gradle pz

FAILURE: Build failed with an exception.

* What went wrong:
Could not determine the dependencies of task ':pz'.
> Could not resolve all task dependencies for configuration ':distJars'.
   > Could not resolve project :jieba-analysis.
     Required by:
         project :
      > Project : declares a dependency from configuration 'compile' to configuration 'default' which is not declared in the descriptor for project :jieba-analysis.

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 1s
root@DESKTOP-LAKGMPD:/mnt/f/STHG/install/ElasticSearch/aaa/elasticsearch-jieba-plugin-7.7.1#

hezhiqiang · 2021-10-12T09:36:19Z

es集成jieba分词做全文检索的时候，es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改，问题已经解决，发现效果很好。 https://github.com/wangyifaer/esplugins-jieba

高亮问题具体要怎么改？能说说吗？我也碰到这个问题了

hezhiqiang · 2021-10-13T03:49:00Z

能否加自定义分词功能，用户可以配置，比如：说客英语 => 说客英语 , 说客，这个说客英语就被分词为说客英语和说客

sing1ee · 2021-10-14T15:12:25Z

高亮问题具体要怎么改？能说说吗？我也碰到这个问题了

这个问题，我来看一下。具体给我个例子吧

wangyifaer · 2021-10-15T02:23:40Z

es集成jieba分词做全文检索的时候，es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改，问题已经解决，发现效果很好。 https://github.com/wangyifaer/esplugins-jieba

高亮问题具体要怎么改？能说说吗？我也碰到这个问题了

注意一下高亮那块的代码是否有问题，或者升级es最新版本试试，有可能是分词器和es兼容导致的。如果还不行，就自己修改一下es源码里的position定位那块内容

zyokia · 2024-02-04T09:16:58Z

现在有版本可以支持动态删除词库吗，我看只有新加词库

sing1ee added the enhancement label Aug 2, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ES分词插件需求征集 #40

ES分词插件需求征集 #40

sing1ee commented Aug 2, 2019

wa-ooo commented Aug 11, 2019

wangyifaer commented Sep 19, 2019

wangyifaer commented Sep 19, 2019

sing1ee commented Sep 20, 2019 via email

nuass commented Mar 5, 2020

leafney commented Mar 30, 2020

yataosu commented Apr 22, 2020

sing1ee commented Apr 22, 2020 via email

sing1ee commented Apr 22, 2020 •

edited

Loading

iwaitu commented May 14, 2020

sing1ee commented May 28, 2020

sing1ee commented Jun 6, 2020

jerry-00 commented Feb 1, 2021

sing1ee commented Feb 10, 2021

icelighting commented Apr 7, 2021

phpsxg commented Apr 7, 2021

phpsxg commented Apr 8, 2021

sing1ee commented Apr 8, 2021 via email

phpsxg commented Apr 8, 2021

hezhiqiang commented Oct 12, 2021

hezhiqiang commented Oct 13, 2021

sing1ee commented Oct 14, 2021

wangyifaer commented Oct 15, 2021

zyokia commented Feb 4, 2024

ES分词插件需求征集 #40

ES分词插件需求征集 #40

Comments

sing1ee commented Aug 2, 2019

wa-ooo commented Aug 11, 2019

wangyifaer commented Sep 19, 2019

wangyifaer commented Sep 19, 2019

sing1ee commented Sep 20, 2019 via email

nuass commented Mar 5, 2020

leafney commented Mar 30, 2020

yataosu commented Apr 22, 2020

sing1ee commented Apr 22, 2020 via email

sing1ee commented Apr 22, 2020 • edited Loading

iwaitu commented May 14, 2020

sing1ee commented May 28, 2020

sing1ee commented Jun 6, 2020

jerry-00 commented Feb 1, 2021

sing1ee commented Feb 10, 2021

icelighting commented Apr 7, 2021

phpsxg commented Apr 7, 2021

phpsxg commented Apr 8, 2021

sing1ee commented Apr 8, 2021 via email

phpsxg commented Apr 8, 2021

hezhiqiang commented Oct 12, 2021

hezhiqiang commented Oct 13, 2021

sing1ee commented Oct 14, 2021

wangyifaer commented Oct 15, 2021

zyokia commented Feb 4, 2024

sing1ee commented Apr 22, 2020 •

edited

Loading