Can we run large language model to generate text using brainJS? #873
-
As I ask in #335 (comment) Hi, I'm writing a electronjs based tiddlywiki app https://github.com/tiddly-gittly/TidGi-Desktop that is offline-first, and I want to make it possible to run a large language model (around 1GB is ok I think?). Can brainJS do text generation now? The size of model is not a problem, because I'm going to use it in an electron app. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Yes. The neural network which does this is the
The same answer as the above. |
Beta Was this translation helpful? Give feedback.
Yes. The neural network which does this is the
brain.recurrent.LSTM
class. It however isn't GPU accelerated, so it can be slow if the network is larger than say a hidden layer of size 500+.The same answer as the above.