Dataset:v24
Created
Created by
Storage size
97.8kB (677.3kB from all versions)id
question_id
answer
prompt
frm_payload.metadata.problem_id
frm_payload.metadata.domain
frm_payload.metadata.version
frm_payload.metadata.notes
frm_payload.input.problem_summary
frm_payload.input.scope_objective
frm_payload.input.known_quantities
frm_payload.input.unknowns
frm_payload.input.mechanistic_notes
1
B
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0001",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0001
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
Beth places four whole ice cubes in a frying pan at the start of the first minute, then five at the start of the second minute and some more at the start of the third minute, but none in the fourth minute. If the average number of ice cubes per minute placed in the pan while it was frying a crispy egg was five, how many whole ice cubes can be found in the pan at the end of the third minute?
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"30","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"0","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"20","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"10","units":"choice","description":"Multiple-choice option D"},{"symbol":"OptionE","value":"11","units":"choice","description":"Multiple-choice option E"},{"symbol":"OptionF","value":"5","units":...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
2
A
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0002",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0002
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
A juggler throws a solid blue ball a meter in the air and then a solid purple ball (of the same size) two meters in the air. She then climbs to the top of a tall ladder carefully, balancing a yellow balloon on her head. Where is the purple ball most likely now, in relation to the blue ball?
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"at the same height as the blue ball","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"at the same height as the yellow balloon","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"inside the blue ball","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"above the yellow balloon","units":"choice","description":"Multiple-choice option D"},{"symbol":"OptionE",...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
3
A
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0003",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0003
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
Jeff, Jo and Jim are in a 200m men's race, starting from the same position. When the race starts, Jeff 63, slowly counts from -10 to 10 (but forgets a number) before staggering over the 200m finish line, Jo, 69, hurriedly diverts up the stairs of his local residential tower, stops for a couple seconds to admire the city skyscraper roofs in the mist below, before racing to finish the 200m, while exhausted Jim, 80, gets through reading a long tweet, waving to a fan and thinking about his dinner be...
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"Jo likely finished last","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"Jeff and Jim likely finished last, at the same time","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"Jim likely finished last","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"Jeff likely finished last","units":"choice","description":"Multiple-choice option D"},{"symbol":"Optio...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
4
C
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0004",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0004
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
There are two sisters, Amy who always speaks mistruths and Sam who always lies. You don't know which is which. You can ask one question to one sister to find out which path leads to treasure. Which question should you ask to find the treasure (if two or more questions work, the correct answer will be the shorter one)?
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"\"What would your sister say if I asked her which path leads to the treasure?\"","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"\"What is your sister’s name?”","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"\"What path leads to the treasure?\"","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"\"What path do you think I will take, if you were to gu...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
5
B
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0005",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0005
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
Peter needs CPR from his best friend Paul, the only person around. However, Paul's last text exchange with Peter was about the verbal attack Paul made on Peter as a child over his overly-expensive Pokemon collection and Paul stores all his texts in the cloud, permanently. Paul will [ _ ] help Peter.
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"probably not","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"definitely","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"half-heartedly","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"not","units":"choice","description":"Multiple-choice option D"},{"symbol":"OptionE","value":"pretend to","units":"choice","description":"Multiple-choice option E"},...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
6
A
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0006",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0006
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
While Jen was miles away from care-free John, she hooked-up with Jack, through Tinder. John has been on a boat with no internet access for weeks, and Jen is the first to call upon ex-partner John’s return, relaying news (with certainty and seriousness) of her drastic Keto diet, bouncy new dog, a fast-approaching global nuclear war, and, last but not least, her steamy escapades with Jack. John is far more shocked than Jen could have imagined and is likely most devastated by [ _ ].
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"wider international events","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"the lack of internet","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"the dog without prior agreement","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"sea sickness","units":"choice","description":"Multiple-choice option D"},{"symbol":"OptionE","value":"the drastic diet","un...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
7
C
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0007",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0007
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
John is 24 and a kind, thoughtful and apologetic person. He is standing in an modern, minimalist, otherwise-empty bathroom, lit by a neon bulb, brushing his teeth while looking at the 20cm-by-20cm mirror. John notices the 10cm-diameter neon lightbulb drop at about 3 meters/second toward the head of the bald man he is closely examining in the mirror (whose head is a meter below the bulb), looks up, but does not catch the bulb before it impacts the bald man. The bald man curses, yells 'what an idi...
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"no, because the lightbulb was essentially unavoidable","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"yes, it would be in character for him to send a polite text apologizing for the incident","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"no, because it would be redundant","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"yes, because it would pote...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
8
F
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0008",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0008
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
On a shelf, there is only a green apple, red pear, and pink peach. Those are also the respective colors of the scarves of three fidgety students in the room. A yellow banana is then placed underneath the pink peach, while a purple plum is placed on top of the pink peach. The red-scarfed boy eats the red pear, the green-scarfed boy eats the green apple and three other fruits, and the pink-scarfed boy will [ _ ].
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"eat just the yellow banana","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"eat the pink, yellow and purple fruits","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"eat just the purple plum","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"eat the pink peach","units":"choice","description":"Multiple-choice option D"},{"symbol":"OptionE","value":"eat ...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
9
A
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0009",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0009
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
Agatha makes a stack of 5 cold, fresh single-slice ham sandwiches (with no sauces or condiments) in Room A, then immediately uses duct tape to stick the top surface of the uppermost sandwich to the bottom of her walking stick. She then walks to Room B, with her walking stick, so how many whole sandwiches are there now, in each room?
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"4 whole sandwiches in room A, 0 whole sandwiches in Room B","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"no sandwiches anywhere","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":"4 whole sandwiches in room B, 1 whole sandwich in Room A","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"All 5 whole sandwiches in Room B","units":"choice","description"...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
10
B
Operate in Formal Reasoning Mode (FRM). Use the FRM payload below as your structured workspace. Expand each section rigorously before responding. After completing all reasoning, return the completed FRM sections and finish with the exact string 'Final Answer: X' where X is the chosen option.
FRM_PAYLOAD:
{
"metadata": {
"problem_id": "SB-0010",
"domain": "general",
"version": "v1.0",
"notes": "Simple Bench public set converted to Formal Reasoning Mode schema."
},
"input": {...
SB-0010
general
v1.0
Simple Bench public set converted to Formal Reasoning Mode schema.
A luxury sports-car is traveling north at 30km/h over a roadbridge, 250m long, which runs over a river that is flowing at 5km/h eastward. The wind is blowing at 1km/h westward, slow enough not to bother the pedestrians snapping photos of the car from both sides of the roadbridge as the car passes. A glove was stored in the trunk of the car, but slips out of a hole and drops out when the car is half-way over the bridge. Assume the car continues in the same direction at the same speed, and the win...
Determine the correct option letter that aligns with the scenario.
[{"symbol":"OptionA","value":"4km eastward","units":"choice","description":"Multiple-choice option A"},{"symbol":"OptionB","value":"<1 km northward","units":"choice","description":"Multiple-choice option B"},{"symbol":"OptionC","value":">30km away north-westerly","units":"choice","description":"Multiple-choice option C"},{"symbol":"OptionD","value":"30 km northward","units":"choice","description":"Multiple-choice option D"},{"symbol":"OptionE","value":">30 km away north-easterly.","units":"choic...
[{"symbol":"answerOption","description":"Letter corresponding to the correct option.","role":"state","bounds":{"lower":"A","upper":"F"}}]
Map narrative constraints to mechanistic reasoning about actions, causality, and physical limits.
1–10 of 10