We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
If a scoring function has no ... and an argument is passed to the solver:
...
> chores_eval() Using model = "claude-3-7-sonnet-latest". ✔ Solving [3s] ✖ Scoring [15ms] Error in `fn()`: ! unused argument (solver_chat = <environment>)
The text was updated successfully, but these errors were encountered:
This is pretty easy to get to with model_graded_qa() too. With:
model_graded_qa()
are_task <- Task$new( dataset = are, solver = generate(), scorer = model_graded_qa( chat_anthropic(model = "claude-3-7-sonnet-latest"), partial_credit = TRUE ), name = "An R Eval" )
I see:
Error in `purrr::map_chr()`: ℹ In index: 1. Caused by error: ! All unnamed arguments must be length 1
as there's no scorer_chat = .
scorer_chat =
Sorry, something went wrong.
No branches or pull requests
If a scoring function has no
...
and an argument is passed to the solver:The text was updated successfully, but these errors were encountered: