Code

Generate code evaluators#231

Code

Merged

ianarawjo merged 22 commits intomainianarawjo/ChainForge:mainfrom gen-code-evalianarawjo/ChainForge:gen-code-evalCopy head branch name to clipboardFeb 28, 2024

+1,519-435

Commits

Commits on Feb 24, 2024

• Bug fix: clear RF state first before loading a flow

  ianarawjo

  committed
  3e33948

• Adds 'settings template vars' to parametrize on model settings.

  ianarawjo

  committed
  80e1fd6

• Typecast settings vars params

  ianarawjo

  committed
  160972a

• wip

  ianarawjo

  committed
  64c44e5

• Componentized the CodeEvaluator inner UI and run logic

  ianarawjo

  committed
  f4ea4cf

• wip

  ianarawjo

  committed
  a082e31

• WIP fix LLM scorer

  ianarawjo

  committed
  dcde921

• Add expected format to LLM scorer

  ianarawjo

  committed
  fdd7476

• Componentize LLM evaluator inner UI and logic

  ianarawjo

  committed
  49bd0d1

• Add GenAI button to code evaluator nodes

  ianarawjo

  committed
  e7d6b1a

• Add var and metavar context to the code eval gen prompt

  ianarawjo

  committed
  01aaf64

• Styling tweaks

  ianarawjo

  committed
  a98577c

• Change default model to Mistral-7B

  ianarawjo

  committed
  c17075d

• build

  ianarawjo

  committed
  a8e3b96

• Add edit button to gen code feature

  ianarawjo

  committed
  4df98f5

• wip

  ianarawjo

  committed
  ffd7dc0

• Fix merge errors

  ianarawjo

  committed
  29ad692

• Refining the grading and pick criteria modals

  ianarawjo

  committed
  7e11166

• Transition grade resp modal into a container

  ianarawjo

  committed
  44ee9b7

• Run prettier and eslint, fix issues

  ianarawjo

  committed
  67c5cf1

Commits on Feb 28, 2024

• Delete multi-eval features. Fix right-click on Inspector error.

  ianarawjo

  committed
  33c7dc2

• Fix bug w init cached scores in LLM scorer

  ianarawjo

  committed
  6d15601