Dataset Viewer
Auto-converted to Parquet Duplicate
id
stringclasses
10 values
task
stringclasses
10 values
segments
dict
question
stringclasses
10 values
question_language
stringclasses
1 value
expected_answer
stringclasses
10 values
inputs
dict
language_01
color_left
{ "S1": { "A": "Object A is red. Object B is blue.", "B": "物体 A 是红色的。物体 B 是蓝色的。" }, "S2": { "A": "Object A is to the left of Object B.", "B": "物体 A 在物体 B 的左边。" } }
What color is the object on the left?
en
red
{ "AA": "Object A is red. Object B is blue.\n\nObject A is to the left of Object B.\n\nQuestion: What color is the object on the left?", "AB": "Object A is red. Object B is blue.\n\n物体 A 在物体 B 的左边。\n\nQuestion: What color is the object on the left?", "BA": "物体 A 是红色的。物体 B 是蓝色的。\n\nObject A is to the left of Objec...
language_02
shape_above
{ "S1": { "A": "Object A is a circle. Object B is a square.", "B": "物体 A 是圆形的。物体 B 是正方形的。" }, "S2": { "A": "Object B is above Object A.", "B": "物体 B 在物体 A 的上方。" } }
What shape is the object above the other object?
en
square
{ "AA": "Object A is a circle. Object B is a square.\n\nObject B is above Object A.\n\nQuestion: What shape is the object above the other object?", "AB": "Object A is a circle. Object B is a square.\n\n物体 B 在物体 A 的上方。\n\nQuestion: What shape is the object above the other object?", "BA": "物体 A 是圆形的。物体 B 是正方形的。\n\n...
language_03
size_right
{ "S1": { "A": "Object A is small. Object B is large.", "B": "物体 A 很小。物体 B 很大。" }, "S2": { "A": "Object B is to the right of Object A.", "B": "物体 B 在物体 A 的右边。" } }
What size is the object on the right?
en
large
{ "AA": "Object A is small. Object B is large.\n\nObject B is to the right of Object A.\n\nQuestion: What size is the object on the right?", "AB": "Object A is small. Object B is large.\n\n物体 B 在物体 A 的右边。\n\nQuestion: What size is the object on the right?", "BA": "物体 A 很小。物体 B 很大。\n\nObject B is to the right of O...
language_04
count_below
{ "S1": { "A": "Box A contains three balls. Box B contains five balls.", "B": "盒子 A 里有三个球。盒子 B 里有五个球。" }, "S2": { "A": "Box A is below Box B.", "B": "盒子 A 在盒子 B 的下方。" } }
How many balls are in the lower box?
en
3
{ "AA": "Box A contains three balls. Box B contains five balls.\n\nBox A is below Box B.\n\nQuestion: How many balls are in the lower box?", "AB": "Box A contains three balls. Box B contains five balls.\n\n盒子 A 在盒子 B 的下方。\n\nQuestion: How many balls are in the lower box?", "BA": "盒子 A 里有三个球。盒子 B 里有五个球。\n\nBox A i...
language_05
material_between
{ "S1": { "A": "Object A is made of wood. Object B is made of metal. Object C is made of plastic.", "B": "物体 A 是木制的。物体 B 是金属制的。物体 C 是塑料制的。" }, "S2": { "A": "Object B is between Object A and Object C.", "B": "物体 B 在物体 A 和物体 C 之间。" } }
What material is the object in the middle made of?
en
metal
{ "AA": "Object A is made of wood. Object B is made of metal. Object C is made of plastic.\n\nObject B is between Object A and Object C.\n\nQuestion: What material is the object in the middle made of?", "AB": "Object A is made of wood. Object B is made of metal. Object C is made of plastic.\n\n物体 B 在物体 A 和物体 C 之间。\...
language_06
owner_near
{ "S1": { "A": "Bag A belongs to Amina. Bag B belongs to Juma.", "B": "包 A 属于 Amina。包 B 属于 Juma。" }, "S2": { "A": "Bag A is near the door. Bag B is far from the door.", "B": "包 A 离门很近。包 B 离门很远。" } }
Who owns the bag near the door?
en
Amina
{ "AA": "Bag A belongs to Amina. Bag B belongs to Juma.\n\nBag A is near the door. Bag B is far from the door.\n\nQuestion: Who owns the bag near the door?", "AB": "Bag A belongs to Amina. Bag B belongs to Juma.\n\n包 A 离门很近。包 B 离门很远。\n\nQuestion: Who owns the bag near the door?", "BA": "包 A 属于 Amina。包 B 属于 Juma。\...
language_07
contents_inside
{ "S1": { "A": "Box A contains a key. Box B contains a coin.", "B": "盒子 A 里有一把钥匙。盒子 B 里有一枚硬币。" }, "S2": { "A": "Box B is inside the cupboard. Box A is outside the cupboard.", "B": "盒子 B 在柜子里面。盒子 A 在柜子外面。" } }
What is in the box inside the cupboard?
en
coin
{ "AA": "Box A contains a key. Box B contains a coin.\n\nBox B is inside the cupboard. Box A is outside the cupboard.\n\nQuestion: What is in the box inside the cupboard?", "AB": "Box A contains a key. Box B contains a coin.\n\n盒子 B 在柜子里面。盒子 A 在柜子外面。\n\nQuestion: What is in the box inside the cupboard?", "BA": "盒...
language_08
weight_comparison
{ "S1": { "A": "Object A weighs two kilograms. Object B weighs five kilograms.", "B": "物体 A 重两千克。物体 B 重五千克。" }, "S2": { "A": "Object A is white. Object B is black.", "B": "物体 A 是白色的。物体 B 是黑色的。" } }
What color is the heavier object?
en
black
{ "AA": "Object A weighs two kilograms. Object B weighs five kilograms.\n\nObject A is white. Object B is black.\n\nQuestion: What color is the heavier object?", "AB": "Object A weighs two kilograms. Object B weighs five kilograms.\n\n物体 A 是白色的。物体 B 是黑色的。\n\nQuestion: What color is the heavier object?", "BA": "物体...
language_09
arrival_order
{ "S1": { "A": "Amina carries a book. Juma carries a cup.", "B": "Amina 带着一本书。Juma 带着一个杯子。" }, "S2": { "A": "Juma arrives before Amina.", "B": "Juma 比 Amina 先到。" } }
What does the person who arrives first carry?
en
cup
{ "AA": "Amina carries a book. Juma carries a cup.\n\nJuma arrives before Amina.\n\nQuestion: What does the person who arrives first carry?", "AB": "Amina carries a book. Juma carries a cup.\n\nJuma 比 Amina 先到。\n\nQuestion: What does the person who arrives first carry?", "BA": "Amina 带着一本书。Juma 带着一个杯子。\n\nJuma ar...
language_10
count_selected_pair
{ "S1": { "A": "Box A contains two balls. Box B contains four balls. Box C contains six balls.", "B": "盒子 A 里有两个球。盒子 B 里有四个球。盒子 C 里有六个球。" }, "S2": { "A": "Box A and Box C are on the table. Box B is on the floor.", "B": "盒子 A 和盒子 C 在桌子上。盒子 B 在地板上。" } }
How many balls in total are in the boxes on the table?
en
8
{ "AA": "Box A contains two balls. Box B contains four balls. Box C contains six balls.\n\nBox A and Box C are on the table. Box B is on the floor.\n\nQuestion: How many balls in total are in the boxes on the table?", "AB": "Box A contains two balls. Box B contains four balls. Box C contains six balls.\n\n盒子 A 和盒子 ...

English–Chinese language transitions

Ten synthetic, text-only examples for PoC1 language-transition experiments. Each example has four matched prompts (40 prompts total), using English (A) and Simplified Chinese (B). These examples are not sampled from PixMo.

Conditions and structure

Condition letters specify the representation of segments S1 and S2, respectively:

Condition S1 S2
AA A A
AB A B
BA B A
BB B B

Each question requires information from both segments. Meanings, identifiers, and the English question remain fixed across conditions. The fixed English prose question can introduce an additional boundary after S2 in AB and BB.

language.json preserves the original project file, including top-level setup metadata and an examples list. The dataset configuration exposes that list as the test split. This split name denotes evaluation examples; no train/test sampling or held-out benchmark construction is implied.

Each example includes id, task, segments, question, question_language, and inputs. Gold answers are in expected_answer.

Loading

from datasets import load_dataset

examples = load_dataset("talzoomanzoo/language", split="test")
prompt = examples[0]["inputs"]["AB"]

To preserve the complete JSON document and its setup metadata:

import json
from huggingface_hub import hf_hub_download

path = hf_hub_download(
    repo_id="talzoomanzoo/language",
    filename="language.json",
    repo_type="dataset",
)
with open(path, encoding="utf-8") as f:
    document = json.load(f)
prompt = document["examples"][0]["inputs"]["AB"]

Send only the selected inputs value to the model. Gold answers and other metadata are for evaluation and auditing, and must not be included in the prompt.

Intended use and limitations

These small examples support setup validation for inference, token-position activation capture, representation comparisons, and probing experiments. They are not a representative benchmark. Establish model-specific accuracy in AA and BB before interpreting transition effects. Keep all four conditions of an example together when constructing any later evaluation partitions.

Chinese translations are draft examples and should receive fluent-speaker review before experimental use. The design follows the project's PoC1 matched-input construction described in tue-meeting.pdf; that document is not included in this repository.

Downloads last month
-

Collection including talzoomanzoo/language