New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat/idea: A/B testesting diff / horizontal layout #40

Open

sammcj opened this issue Aug 26, 2024 · 1 comment

Labels

question

Contributor

sammcj commented Aug 26, 2024

It might be nice to be able to:

Layout the generated output horiztonally / in a grid. This would make it easier to compare results.
Optionally use diff style highlighting to show differences in the output.

Here's a crappy mock I whipped up:

Just an idea - feel free to close if not desirable.

Owner

dezoito commented Aug 27, 2024

I like this idea.

Some possible issues to brainstorm (and I am interested in inputs from anyone that likes it as well).

Since a user can generate 100s of results in a single experiment, and that might make scrolling horizontally uncomfortable, and cause issues with the diffing, what if we let the user generate the results then select two of them to compare (like when you compare two different products on Amazon)?
If we were to display more than two results side by side, should we diff from the first result or from the previous result?

I think diffing the inference parameters is a great idea, BTW!

dezoito added the question label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment