Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Eval #87

Merged
merged 22 commits into from
May 3, 2024
Merged

Eval #87

merged 22 commits into from
May 3, 2024

Commits on Apr 29, 2024

  1. Start a tech note on eval.

    @jlewi
    jlewi committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    f2595d0 View commit details
    Browse the repository at this point in the history

  2. Start crafting an eval dataset.

    @jlewi
    jlewi committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    be743a0 View commit details
    Browse the repository at this point in the history

  3. Add mathematical equation.

    @jlewi
    jlewi committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    2551f6e View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. First draft of the tech note. Create a hack program to render mathjax… 

    … although looks like we may not need it because we can just use vscode.
    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    279d06c View commit details
    Browse the repository at this point in the history

  2. Fix markdown.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    e87f5e5 View commit details
    Browse the repository at this point in the history

  3. Fix line breaks.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f1b49fe View commit details
    Browse the repository at this point in the history

  4. More fixes to markdown.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    672ada9 View commit details
    Browse the repository at this point in the history

  5. more fixes.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    da295b7 View commit details
    Browse the repository at this point in the history

  6. More fixes.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    6f16346 View commit details
    Browse the repository at this point in the history

  7. Add alternatives.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    3eb1897 View commit details
    Browse the repository at this point in the history

  8. Clean up mathjax

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    85cb9a4 View commit details
    Browse the repository at this point in the history

  9. Compute edit distance.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    43de012 View commit details
    Browse the repository at this point in the history

  10. Define the distance metric.

    @jlewi
    jlewi committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f9785c7 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Start using protos and creating an evaluator.

    @jlewi
    jlewi committed May 1, 2024
    Configuration menu
    Copy the full SHA
    4de82ee View commit details
    Browse the repository at this point in the history

  2. Add some code to write to Google Sheets.

    @jlewi
    jlewi committed May 1, 2024
    Configuration menu
    Copy the full SHA
    7b71c32 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Parameterize the code for writing to sheets so we don't hardcode things.

    @jlewi
    jlewi committed May 2, 2024
    Configuration menu
    Copy the full SHA
    1ddabe3 View commit details
    Browse the repository at this point in the history

  2. Compute evaluation and load into a gsheet.

    @jlewi
    jlewi committed May 2, 2024
    Configuration menu
    Copy the full SHA
    7efbdf9 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Start defining an experiment.

    @jlewi
    jlewi committed May 3, 2024
    Configuration menu
    Copy the full SHA
    78842c3 View commit details
    Browse the repository at this point in the history

  2. Update the code to use the new experiment resource.

    @jlewi
    jlewi committed May 3, 2024
    Configuration menu
    Copy the full SHA
    4063f6f View commit details
    Browse the repository at this point in the history

  3. Add an apply command.

    @jlewi
    jlewi committed May 3, 2024
    Configuration menu
    Copy the full SHA
    cdddafc View commit details
    Browse the repository at this point in the history

  4. tidy.

    @jlewi
    jlewi committed May 3, 2024
    Configuration menu
    Copy the full SHA
    de1de31 View commit details
    Browse the repository at this point in the history

  5. Fix lint.

    @jlewi
    jlewi committed May 3, 2024
    Configuration menu
    Copy the full SHA
    8fd8116 View commit details
    Browse the repository at this point in the history