Skip to content

Releases: nikolaydubina/llama2.go

v0.7.1

21 Mar 11:56
9086ea4
Compare
Choose a tag to compare

Sync with llama2.c

19 Aug 06:13
fbb7585
Compare
Choose a tag to compare

Sync from llama2.c

07 Aug 07:59
Compare
Choose a tag to compare

bugfix key cache size in transformer

31 Jul 10:13
Compare
Choose a tag to compare

optimisations Fuzz tests and enabling by default

29 Jul 17:18
Compare
Choose a tag to compare

paralelism by goroutines

29 Jul 02:12
Compare
Choose a tag to compare
  • 1.5x to 2x speedup

added prompt

29 Jul 01:47
Compare
Choose a tag to compare
v0.3.0

fix

🔥 works with high temperature

27 Jul 16:53
Compare
Choose a tag to compare
  • bugfix high temperatures. was multiplying wrong matrix in final RMS step in transformer
  • test for mat mul
  • nits

update default temperature to 0.1

25 Jul 18:56
2195021
Compare
Choose a tag to compare
v0.1.1

Update README.md

works with low temperature

25 Jul 18:52
Compare
Choose a tag to compare
  • deterministic (zero temperature, full argmax) works
  • low temperature works
  • reading from binary checkpoint works
  • (bug) high temperature is unstable