New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

update scrolls #2602

Merged

baberabb merged 2 commits into main from scrollsupdate

Jan 2, 2025

Contributor

baberabb commented Dec 30, 2024 •

edited

Loading

Updates scroll to use the updated Hugging Face evaluate API (downloads metric from refs/pr/5 branch of the scrolls ds)
Adds apply_chat_template parameter to construct_requests - when enabled, removes the leading space from choices (changes format from <context><assistant>" <choice>" to <context><assistant>"<choice>")


          update evaluate; update construct requests

349aea6

baberabb requested a review from lintangsutawika as a code owner

December 30, 2024 00:32


          update construct requests to handle apply_chat_template kwarg

77f5065

baberabb merged commit 1044db9 into main

7 of 8 checks passed

baberabb deleted the scrollsupdate branch

January 2, 2025 11:07

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet