-
Notifications
You must be signed in to change notification settings - Fork 2.6k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
2420c62
commit 000ccfa
Showing
523 changed files
with
4,096 additions
and
0 deletions.
There are no files selected for viewing
3 changes: 3 additions & 0 deletions
3
evals/registry/data/articulate_rules/articulation/in-context/freeform/contains_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...istry/data/articulate_rules/articulation/in-context/freeform/contains_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...registry/data/articulate_rules/articulation/in-context/freeform/contains_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...a/articulate_rules/articulation/in-context/freeform/contains_the_word_w_and_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...culate_rules/articulation/in-context/freeform/contains_the_word_w_and_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...s/articulation/in-context/freeform/contains_the_word_w_and_is_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...lation/in-context/freeform/contains_the_word_w_and_the_word_w_prime_in_sorted_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...iculate_rules/articulation/in-context/freeform/contains_the_word_w_at_least_k_times.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...es/articulation/in-context/freeform/contains_the_word_w_between_k_and_k_prime_times.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...late_rules/articulation/in-context/freeform/contains_the_word_w_followed_by_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...tion/in-context/freeform/contains_the_word_w_within_x_positions_of_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
.../articulate_rules/articulation/in-context/freeform/contains_the_words_w_and_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...a/articulate_rules/articulation/in-context/freeform/contains_the_words_w_or_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...rules/articulation/in-context/freeform/contains_the_words_w_or_w_prime_but_not_both.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
.../data/articulate_rules/articulation/in-context/freeform/does_not_contain_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ta/articulate_rules/articulation/in-context/freeform/does_not_start_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...egistry/data/articulate_rules/articulation/in-context/freeform/ends_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
.../articulation/in-context/freeform/ends_with_the_word_w_or_contains_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
.../registry/data/articulate_rules/articulation/in-context/freeform/repeats_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...late_rules/articulation/in-context/freeform/repeats_the_word_w_and_contains_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ules/articulation/in-context/freeform/repeats_the_word_w_and_contains_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...s/articulation/in-context/freeform/repeats_the_word_w_and_contains_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...es/articulation/in-context/freeform/repeats_the_word_w_and_is_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...iculate_rules/articulation/in-context/freeform/repeats_the_word_w_and_starts_with_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...istry/data/articulate_rules/articulation/in-context/freeform/starts_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...in-context/freeform/starts_with_the_word_w_or_repeats_the_word_w_prime_but_not_both.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...data/articulate_rules/articulation/in-context/freeform/word_w_appears_in_position_i.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...a/articulate_rules/articulation/in-context/freeform/words_are_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...late_rules/articulation/in-context/freeform/words_are_in_reverse_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...stry/data/articulate_rules/articulation/in-context/multiple-choice/contains_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ata/articulate_rules/articulation/in-context/multiple-choice/contains_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...y/data/articulate_rules/articulation/in-context/multiple-choice/contains_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ulate_rules/articulation/in-context/multiple-choice/contains_the_word_w_and_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...rules/articulation/in-context/multiple-choice/contains_the_word_w_and_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ulation/in-context/multiple-choice/contains_the_word_w_and_is_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...in-context/multiple-choice/contains_the_word_w_and_the_word_w_prime_in_sorted_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
..._rules/articulation/in-context/multiple-choice/contains_the_word_w_at_least_k_times.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...culation/in-context/multiple-choice/contains_the_word_w_between_k_and_k_prime_times.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...les/articulation/in-context/multiple-choice/contains_the_word_w_followed_by_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...-context/multiple-choice/contains_the_word_w_within_x_positions_of_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...late_rules/articulation/in-context/multiple-choice/contains_the_words_w_and_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ulate_rules/articulation/in-context/multiple-choice/contains_the_words_w_or_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...rticulation/in-context/multiple-choice/contains_the_words_w_or_w_prime_but_not_both.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...rticulate_rules/articulation/in-context/multiple-choice/does_not_contain_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...culate_rules/articulation/in-context/multiple-choice/does_not_start_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
.../data/articulate_rules/articulation/in-context/multiple-choice/ends_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...lation/in-context/multiple-choice/ends_with_the_word_w_or_contains_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ry/data/articulate_rules/articulation/in-context/multiple-choice/repeats_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...les/articulation/in-context/multiple-choice/repeats_the_word_w_and_contains_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ticulation/in-context/multiple-choice/repeats_the_word_w_and_contains_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ulation/in-context/multiple-choice/repeats_the_word_w_and_contains_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...culation/in-context/multiple-choice/repeats_the_word_w_and_is_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
..._rules/articulation/in-context/multiple-choice/repeats_the_word_w_and_starts_with_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ata/articulate_rules/articulation/in-context/multiple-choice/starts_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ext/multiple-choice/starts_with_the_word_w_or_repeats_the_word_w_prime_but_not_both.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ticulate_rules/articulation/in-context/multiple-choice/word_w_appears_in_position_i.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ulate_rules/articulation/in-context/multiple-choice/words_are_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...les/articulation/in-context/multiple-choice/words_are_in_reverse_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ry/data/articulate_rules/classification/in-context/in-distribution/contains_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...a/articulate_rules/classification/in-context/in-distribution/contains_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...data/articulate_rules/classification/in-context/in-distribution/contains_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ate_rules/classification/in-context/in-distribution/contains_the_word_w_and_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...les/classification/in-context/in-distribution/contains_the_word_w_and_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ication/in-context/in-distribution/contains_the_word_w_and_is_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...in-context/in-distribution/contains_the_word_w_and_the_word_w_prime_in_sorted_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ules/classification/in-context/in-distribution/contains_the_word_w_at_least_k_times.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...fication/in-context/in-distribution/contains_the_word_w_between_k_and_k_prime_times.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...s/classification/in-context/in-distribution/contains_the_word_w_followed_by_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...-context/in-distribution/contains_the_word_w_within_x_positions_of_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...te_rules/classification/in-context/in-distribution/contains_the_words_w_and_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ate_rules/classification/in-context/in-distribution/contains_the_words_w_or_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ssification/in-context/in-distribution/contains_the_words_w_or_w_prime_but_not_both.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...iculate_rules/classification/in-context/in-distribution/does_not_contain_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...late_rules/classification/in-context/in-distribution/does_not_start_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ata/articulate_rules/classification/in-context/in-distribution/ends_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...cation/in-context/in-distribution/ends_with_the_word_w_or_contains_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
.../data/articulate_rules/classification/in-context/in-distribution/repeats_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...s/classification/in-context/in-distribution/repeats_the_word_w_and_contains_a_digit.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...sification/in-context/in-distribution/repeats_the_word_w_and_contains_a_french_word.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ication/in-context/in-distribution/repeats_the_word_w_and_contains_the_word_w_prime.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...fication/in-context/in-distribution/repeats_the_word_w_and_is_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ules/classification/in-context/in-distribution/repeats_the_word_w_and_starts_with_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...a/articulate_rules/classification/in-context/in-distribution/starts_with_the_word_w.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ext/in-distribution/starts_with_the_word_w_or_repeats_the_word_w_prime_but_not_both.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...culate_rules/classification/in-context/in-distribution/word_w_appears_in_position_i.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...ate_rules/classification/in-context/in-distribution/words_are_in_alphabetical_order.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...s/classification/in-context/in-distribution/words_are_in_reverse_alphabetical_order.jsonl
Git LFS file not shown
Empty file.
Empty file.
Empty file.
Empty file.
3 changes: 3 additions & 0 deletions
3
...n-context/out-of-distribution/contains_a_digit/DecreaseNumberOfWordsAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
3 changes: 3 additions & 0 deletions
3
...n-context/out-of-distribution/contains_a_digit/IncreaseNumberOfWordsAttackBehaviour.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...fication/in-context/out-of-distribution/contains_a_digit/InfillTrickAttackBehaviour.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...-context/out-of-distribution/contains_a_digit/InsertRandomCharactersAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
3 changes: 3 additions & 0 deletions
3
...in-context/out-of-distribution/contains_a_digit/InstructionInjectionAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
Empty file.
3 changes: 3 additions & 0 deletions
3
...ication/in-context/out-of-distribution/contains_a_digit/RemoveSpacesAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
3 changes: 3 additions & 0 deletions
3
...ext/out-of-distribution/contains_a_french_word/DecreaseNumberOfWordsAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
3 changes: 3 additions & 0 deletions
3
...ext/out-of-distribution/contains_a_french_word/IncreaseNumberOfWordsAttackBehaviour.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...on/in-context/out-of-distribution/contains_a_french_word/InfillTrickAttackBehaviour.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions
3
...xt/out-of-distribution/contains_a_french_word/InsertRandomCharactersAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
3 changes: 3 additions & 0 deletions
3
...text/out-of-distribution/contains_a_french_word/InstructionInjectionAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
Empty file.
3 changes: 3 additions & 0 deletions
3
...n/in-context/out-of-distribution/contains_a_french_word/RemoveSpacesAttackBehaviour.jsonl
Git LFS file not shown
Empty file.
3 changes: 3 additions & 0 deletions
3
...cation/in-context/out-of-distribution/contains_the_word_w/ChangeCaseAttackBehaviour.jsonl
Git LFS file not shown
Oops, something went wrong.