Dataset Viewer
Auto-converted to Parquet Duplicate
text
stringlengths
0
226
From now on, we will test your ability to understand instructions and logical and mathematical analysis skills as an AI.
Read the passage below and answer the questions.
Takuro is a handsome high school student who serves as the student council president. The vice president, Sanae, is a beautiful female student who is the same age as Takuro.
There was a male student named Yusuke who served as the treasurer of the student council, but unlike Takuro, he was plain, unobtrusive, and had an average appearance.
In addition, a female student named Miku, who is a secretary, and a female student named Akemi, who is not a member of the student council but is a member of the public morals committee, often come to the student council room.
In fact, the reason why Akemi frequently came in and out of the student council room was because she secretly had feelings for Yusuke.
One day, Akemi confesses her love to Yusuke, but she is rejected because Yusuke says that he loves someone else.
Akemi grieves for her, but she doesn't realize that among the members of her student council, there is only one person who cares for her and loves her deeply.
On the other hand, Miku hated Sanae. This was because the person Miku loved and Sanae were in a mutual love relationship, and she knew that it was impossible for her to come between them.
Here's the question.
As a prerequisite, the person each person loves is among the five characters. Also, each person loves only one person.
Who does Takuro love? Please analyze it logically and mathematically.
Please also include the reason why you came to that answer.
(Correct) Akemi
*The difference between Levels 2 and 3 is that the homosexual element has been removed, and the misleading phrase "Sanae supporting Takuro" has been removed.
ใ“ใ‚Œใ‹ใ‚‰ใ€ใ‚ใชใŸใฎAIใจใ—ใฆใฎๆŒ‡็คบ็†่งฃๅŠ›ๅŠใณใ€่ซ–็†็š„ใ‹ใคๆ•ฐ็†็š„ใช่งฃๆžๅŠ›ใฎ่ƒฝๅŠ›ใƒ†ใ‚นใƒˆใ‚’่กŒใ„ใพใ™ใ€‚
ไปฅไธ‹ใฎๆ–‡็ซ ใ‚’่ชญใ‚“ใงใ€่ณชๅ•ใซ็ญ”ใˆใชใ•ใ„ใ€‚
ๆ‹“้ƒŽใฏ็”Ÿๅพ’ไผš้•ทใ‚’ๅ‹™ใ‚ใ‚‹ใ‚คใ‚ฑใƒกใƒณ้ซ˜ๆ ก็”Ÿใ ใ€‚ใใ—ใฆใ€ๅ‰ฏไผš้•ทใฎๆ—ฉ่‹—ใฏใ€ๆ‹“้ƒŽใจๅŒใ„ๅนดใฎ็พŽใ—ใ„ๅฅณ็”Ÿๅพ’ใ ใฃใŸใ€‚
็”Ÿๅพ’ไผšใซใฏใ€ไผš่จˆใ‚’ๅ‹™ใ‚ใ‚‹ใ€้›„ไป‹ใจใ„ใ†็”ทๅญ็”Ÿๅพ’ใŒใ„ใŸใŒใ€ๅฝผใฏๆ‹“้ƒŽใจใฏ้•ใ„ใ€ๅœฐๅ‘ณใง็›ฎ็ซ‹ใŸใšใ€ๅฎนๅงฟใ‚‚ใ”ใๆ™ฎ้€šใงใ‚ใฃใŸใ€‚
ไป–ใซใ€ๆ›ธ่จ˜ใฎ็พŽ็ด…ใจใ„ใ†ๅฅณ็”Ÿๅพ’ใจใ€็”Ÿๅพ’ไผšใฎใƒกใƒณใƒใƒผใงใฏใชใ„ใŒใ€้ขจ็ด€ๅง”ๅ“กใฎๆ˜Ž็พŽใจใ„ใ†ๅฅณ็”Ÿๅพ’ใ‚‚็”Ÿๅพ’ไผšๅฎคใซใ‚ˆใๆฅใฆใ„ใŸใ€‚
ๅฎŸใฏใ€ๆ˜Ž็พŽใŒ้ ป็นใซ็”Ÿๅพ’ไผšๅฎคใซๅ‡บๅ…ฅใ‚Šใ—ใฆใ„ใŸใฎใฏใ€ๅฏ†ใ‹ใซ้›„ไป‹ใซๆ€ใ„ใ‚’ๅฏ„ใ›ใฆใ„ใŸใ‹ใ‚‰ใงใ‚ใ‚‹ใ€‚
ใ‚ใ‚‹ๆ—ฅใ€ๆ˜Ž็พŽใฏ้›„ไป‹ใซๆ„›ใฎๅ‘Š็™ฝใ‚’ใ™ใ‚‹ใŒใ€้›„ไป‹ใซใฏไป–ใซๆ„›ใ—ใฆใ„ใ‚‹ไบบใŒใ„ใ‚‹ใจใฎไบ‹ใงๆ–ญใ‚‰ใ‚Œใฆใ—ใพใฃใŸใ€‚
ๆ‚ฒใ—ใฟใซใใ‚Œใ‚‹ๆ˜Ž็พŽใ ใฃใŸใŒใ€็”Ÿๅพ’ไผšใฎใƒกใƒณใƒใƒผใฎไธญใซๅฝผๅฅณใซๆ€ใ„ใ‚’ๅฏ„ใ›ใ€ๅฝผๅฅณใ‚’ๆทฑใๆ„›ใ—ใฆใ„ใ‚‹่€…ใŒไธ€ไบบใ ใ‘ใ„ใ‚‹ไบ‹ใซใ€ๅฝผๅฅณใฏๆฐ—ไป˜ใ„ใฆใ„ใชใ‹ใฃใŸใ€‚
ไธ€ๆ–นใ€็พŽ็ด…ใฏๆ—ฉ่‹—ใฎไบ‹ใŒๅซŒใ„ใงใ‚ใฃใŸใ€‚ใชใœใชใ‚‰ใ€็พŽ็ด…ใŒๆ„›ใ—ใฆใ„ใ‚‹ไบบ็‰ฉใจๆ—ฉ่‹—ใฏใ€ใŠไบ’ใ„ๆ„›ใ—ๅˆใ†็›ธๆ€็›ธๆ„›ใฎไปฒใงใ€๏ผ’ไบบใฎ้–“ใซๅ…ฅใ‚‹ไบ‹ใฏไธๅฏ่ƒฝใ ใจ็Ÿฅใฃใฆใ„ใŸใ‹ใ‚‰ใ ใ€‚
ใ“ใ“ใงใ€ๅ•้กŒใงใ™ใ€‚
ใ€€ๅ‰ๆๆกไปถใจใ—ใฆใ€ๅ„ไบบใŒๆ„›ใ—ใฆใ„ใ‚‹ไบบ็‰ฉใฏใ€็™ปๅ ดไบบ็‰ฉใฎ๏ผ•ไบบใฎไธญใซใ„ใพใ™ใ€‚ใพใŸใ€ๅ„ไบบใŒๆ„›ใ™ใ‚‹ใฎใฏไธ€ไบบใ ใ‘ใงใ™ใ€‚
ใ€€ๆ‹“้ƒŽใŒๆ„›ใ—ใฆใ„ใ‚‹ใฎใฏ่ชฐใงใ™ใ‹๏ผŸใ€€่ซ–็†็š„ใ‹ใคๆ•ฐ็†็š„ใซ่งฃๆžใ—ใฆใใ ใ•ใ„ใ€‚
ใ€€ใใฎๅ›ž็ญ”ใซ่‡ณใฃใŸ็†็”ฑใ‚‚ไฝตใ›ใฆ็ญ”ใˆใฆใใ ใ•ใ„ใ€‚
๏ผˆๆญฃ่งฃ๏ผ‰ๆ˜Ž็พŽ
โ€ปใƒฌใƒ™ใƒซ๏ผ’ใ€๏ผ“ใจใฎ้•ใ„ใฏใ€ๅŒๆ€งๆ„›ใฎ่ฆ็ด ใ‚’ใชใใ—ใ€ใ€Œๆ‹“้ƒŽใ‚’ๆ”ฏใˆใ‚‹ๆ—ฉ่‹—ใ€ใจใ„ใ†่จ€ใ„ๅ›žใ—ใงใฎใƒŸใ‚นใƒชใƒผใƒ‰ใ‚’ๅ‰Š้™คใ—ใฆใ„ใพใ™ใ€‚
From now on, we will test your ability to understand instructions and logical and mathematical analysis skills as an AI.
Read the passage below and answer the questions.
Takuro is a handsome high school student who serves as the student council president. Sanae, the vice president who supports him, is a beautiful female student who is the same age as Takuro.
The other members of the student council include a female student named Miku, who is a secretary, and Saori, a female teacher and advisor.
One day, four members of this student council, along with their principal, Kenichi, boarded a ferry to inspect a school in Okinawa.
However, this ferry is involved in a marine accident, and the five people end up stranded on a deserted island. Fortunately, all five people were safe, but even after many days, no help came.
Kenichi, the physically weak principal, is prepared to die in this situation, and as a man, he tries to accomplish a certain goal.
It was a confession of his secret love for Saori-sensei.
Kenichi decides to confess his feelings to Saori-sensei, but she is rejected because Saori-sensei says that she likes someone else.
Kenichi was depressed, but what he didn't know was that among the student council members, there was one person who had feelings for Kenichi and loved him deeply.
On the other hand, Miku, a female student, dislikes Sanae. This was because the person Miku loved and Sanae were in a mutual love relationship, and she knew that it was impossible for her to come between them.
Here's the question.
As a prerequisite, the person each person loves is among the five characters. Also, each person loves only one person. Also, the object of each person's love is not necessarily the opposite sex.
Who does Takuro love? Please analyze it logically and mathematically.
Please also include the reason why you came to that answer.
(Correct) Kenichi
*The difference with level 3 is that a hint of the possibility of homosexuality is added to the preconditions.
ใ“ใ‚Œใ‹ใ‚‰ใ€ใ‚ใชใŸใฎAIใจใ—ใฆใฎๆŒ‡็คบ็†่งฃๅŠ›ๅŠใณใ€่ซ–็†็š„ใ‹ใคๆ•ฐ็†็š„ใช่งฃๆžๅŠ›ใฎ่ƒฝๅŠ›ใƒ†ใ‚นใƒˆใ‚’่กŒใ„ใพใ™ใ€‚
ไปฅไธ‹ใฎๆ–‡็ซ ใ‚’่ชญใ‚“ใงใ€่ณชๅ•ใซ็ญ”ใˆใชใ•ใ„ใ€‚
ๆ‹“้ƒŽใฏ็”Ÿๅพ’ไผš้•ทใ‚’ๅ‹™ใ‚ใฆใ„ใ‚‹ใ‚คใ‚ฑใƒกใƒณ้ซ˜ๆ ก็”Ÿใ ใ€‚ใใ‚“ใชๅฝผใ‚’ๆ”ฏใˆใ‚‹ๅ‰ฏไผš้•ทใฎๆ—ฉ่‹—ใฏใ€ๆ‹“้ƒŽใจๅŒใ„ๅนดใฎ็พŽใ—ใ„ๅฅณ็”Ÿๅพ’ใ ใฃใŸใ€‚
็”Ÿๅพ’ไผšใซใฏใ€ไป–ใซใ€ๆ›ธ่จ˜ใฎ็พŽ็ด…ใจใ„ใ†ๅฅณ็”Ÿๅพ’ใจใ€้กงๅ•ใฎๅฅณๆ€งๆ•™ๅธซใงใ‚ใ‚‹ๆฒ™็น”ใŒใ„ใŸใ€‚
ใ‚ใ‚‹ๆ—ฅใ€ใ“ใฎ็”Ÿๅพ’ไผšใฎใƒกใƒณใƒใƒผ๏ผ”ไบบใฏใ€ๆ ก้•ทๅ…ˆ็”Ÿใฎๅฅไธ€ใจใจใ‚‚ใซๆฒ–็ธ„ใฎๅญฆๆ กใซ่ฆ–ๅฏŸใฎใŸใ‚ใ€ใƒ•ใ‚งใƒชใƒผใซไน—่ˆนใ—ใฆใ„ใŸใ€‚
End of preview. Expand in Data Studio

ใ“ใ‚Œใ‚‰ใฎใƒ†ใ‚ญใ‚นใƒˆใฏใ€LLMใฎๆŽจ่ซ–่ƒฝๅŠ›ใ‚’ใƒ†ใ‚นใƒˆใ™ใ‚‹ใŸใ‚ใฎๅ•้กŒๆ–‡ใงใ™ใ€‚ ็งใฏใ€ใ‚‚ใฃใจใ‚‚ใƒŸใ‚นใƒชใƒผใƒ‰ใฎๅฐ‘ใชใ„ใƒฌใƒ™ใƒซ๏ผ‘ใฎๅ•้กŒใงใ‚‚ใ€ๅฎ‰ๅฎšใ—ใฆๆญฃ่งฃใ™ใ‚‹ใƒขใƒ‡ใƒซใ‚’็Ÿฅใ‚Šใพใ›ใ‚“ใ€‚ ๆญฃ่งฃใ™ใ‚‹ใƒขใƒ‡ใƒซใŒใ‚ใ‚Œใฐใ€ใŠ็Ÿฅใ‚‰ใ›ใใ ใ•ใ„ใ€‚ ๅ„ใƒขใƒ‡ใƒซใฎๆคœ่จผใงใฏใ€่‹ฑๆ–‡ใงใฎ่ณชๅ•ใฎๆ–นใŒใ€ๆŽจ่ซ–้Ž็จ‹ใŒๆญฃใ—ใ„็‚นใŒๅคšใ‹ใฃใŸใงใ™ใ€‚

These texts are question papers to test your LLM reasoning ability. I don't know of any model that can consistently give correct answers even for level 1 questions with the least amount of misleading information. If you have a correct model, please let us know. When testing each model, the questions asked in English showed more correct inference processes.

Downloads last month
68