Skip to content
This repository has been archived by the owner on Sep 5, 2023. It is now read-only.

Divide by zero in Parsimonious #28

Open
joepio opened this issue Jun 30, 2020 · 1 comment
Open

Divide by zero in Parsimonious #28

joepio opened this issue Jun 30, 2020 · 1 comment

Comments

@joepio
Copy link
Member

joepio commented Jun 30, 2020

trends_1            | /opt/trends/src/weighwords/weighwords/parsimonious.py:206: RuntimeWarning: divide by zero encountered in log
trends_1            |   tf = np.log(tf)
trends_1            | /opt/trends/src/weighwords/weighwords/parsimonious.py:219: RuntimeWarning: invalid value encountered in subtract
trends_1            |   diff = new_p_term - p_term
trends_1            | /opt/trends/src/weighwords/weighwords/specific_term_estimators.py:58: RuntimeWarning: divide by zero encountered in log
trends_1            |   for tf in document_term_frequencies
trends_1            | /opt/trends/src/weighwords/weighwords/logsum.py:28: RuntimeWarning: invalid value encountered in subtract
trends_1            |   out = np.log(np.nansum(np.exp(x - vmax), axis=0))
@jurrian
Copy link
Contributor

jurrian commented Jun 30, 2020

Seems to be related to a lack of RAM. Due to earlier problems docker has been max'd to 3Gb of RAM which is reached almost directly. The mentioned divide by zero is a warning which should not impact the process, and probably occurs because we use an old version of the weighwords package.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants