iter 🔁

A code iteration tool running on the Groq API.

This is an UX experiment and demo for code iteration with RHLF-based LLMs. It takes the form of a REPL with free-form text that lets the user quickly iterate on diffs and pipe feedback (e.g. compilers and test suites) into the LLM before triggering self-reflection.

usage

• Create an account and generate your API key from Groq!

• Install Nix.

• Install iter via:

  nix profile install github:freuk/iter#iter
  

  Or directly run the iter binary via nix run github:freuk/iter#iter.

By default, iter uses mixtral-8x7b-32768, a 32k sequence length MoE of 7b parameter language models from Mistral AI. Use --config (see demos/ for examples) to change this choice to one of the other available models.

development

nix-shell will give you a development environment for iter.

• ghcid: live GHC feedback
• just: useful commands for interactive development