New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The parameter 'token_pattern' will not be used since 'tokenizer' is not None' #353

Open

XinFP opened this issue Dec 11, 2023 · 0 comments

XinFP commented Dec 11, 2023

Hello, I am getting an error when trying to load Top2Vec.

2023-12-11 12:36:37,845 - top2vec - INFO - Pre-processing documents for training
INFO:top2vec:Pre-processing documents for training
/local_disk0/.ephemeral_nfs/envs/pythonEnv-5738285b-a4b1-4031-a6d1-b3e53f12c655/lib/python3.10/site-packages/sklearn/feature_extraction/text.py:525: UserWarning: The parameter 'token_pattern' will not be used since 'tokenizer' is not None'
  warnings.warn(

and use the news data example the first topic for medicine is

[array(['th', 'de', 'um', 'le', 'der', 'the', 'da', 'la', 'des', 'ai',
        'an', 'un', 'al', 'van', 'll', 'il', 'of', 'du', 'ed', 'do', 'ma',
        'whereas', 'dos', 'die', 'op', 'given', 'aw', 'it', 'af', 'em',
        'wa', 'er', 'as', 'el', 'ie', 'that', 'au', 'se', 'que', 'its',
        'on', 'nd', 'di', 'los', 'so', 'at', 'oo', 'ha', 'dot', 'su'],
       dtype='<U15'

I've tried all type of models and it still getting the same error.

The text was updated successfully, but these errors were encountered:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment