Skip to content

Instantly share code, notes, and snippets.

@mlabonne

mlabonne/AlphaMonarch-7B-Eq-bench.md

Created April 4, 2024 22:00
Show Gist options
  • Save mlabonne/18bbe39269faa7cb8b201ba3bab8e05c to your computer and use it in GitHub Desktop.
Save mlabonne/18bbe39269faa7cb8b201ba3bab8e05c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
AlphaMonarch-7B-Eq-bench.md
Model EQ-Bench Average
AlphaMonarch-7B 73.62 73.62

EQ-Bench

Task Version Metric Value Stderr
eq_bench 2.1 eqbench,none 73.62
eqbench_stderr,none 2
percent_parseable,none 97.66
percent_parseable_stderr,none 1.16
alias eq_bench

Average: 73.62%

Average score: 73.62%

Elapsed time: 00:08:55

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment