Dataset Preview
The full dataset viewer is not available (click to read why). Only showing a preview of the rows.
The dataset generation failed because of a cast error
Error code: DatasetGenerationCastError
Exception: DatasetGenerationCastError
Message: An error occurred while generating the dataset
All the data files must have the same columns, but at some point there are 2 new columns ({'temp_grounding', 'dataset_name'})
This happened while the json dataset builder was generating data using
hf://datasets/yepeng98/TempGCap/sub1/hacs_instruct_segcap_fromto.json (at revision 0f51f17ce8d9e1386d3c807479f9336657b7c95b), ['hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/didemo_anetboth_second_multiprompt_fromto_id2.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/hacs_instruct_segcap_fromto.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_k700.json'], ['hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/didemo_anetboth_second_multiprompt_fromto_id2.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/hacs_instruct_segcap_fromto.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_k700.json']
Please either edit the data files to have matching columns, or separate them into different configurations (see docs at https://hf.co/docs/hub/datasets-manual-configuration#multiple-configurations)
Traceback: Traceback (most recent call last):
File "/usr/local/lib/python3.14/site-packages/datasets/builder.py", line 1848, in _prepare_split_single
writer.write_table(table)
~~~~~~~~~~~~~~~~~~^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/arrow_writer.py", line 765, in write_table
self._write_table(pa_table, writer_batch_size=writer_batch_size)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/arrow_writer.py", line 773, in _write_table
pa_table = table_cast(pa_table, self._schema)
File "/usr/local/lib/python3.14/site-packages/datasets/table.py", line 2378, in table_cast
return cast_table_to_schema(table, schema)
File "/usr/local/lib/python3.14/site-packages/datasets/table.py", line 2306, in cast_table_to_schema
raise CastError(
...<3 lines>...
)
datasets.table.CastError: Couldn't cast
id: int64
dataset_name: string
video: string
duration: double
temp_grounding: list<item: double>
child 0, item: double
conversations: list<item: struct<from: string, value: string>>
child 0, item: struct<from: string, value: string>
child 0, from: string
child 1, value: string
to
{'video': Value('string'), 'id': Value('string'), 'conversations': List({'from': Value('string'), 'value': Value('string')}), 'duration': Value('float64')}
because column names don't match
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 1369, in compute_config_parquet_and_info_response
parquet_operations, partial, estimated_dataset_info = stream_convert_to_parquet(
~~~~~~~~~~~~~~~~~~~~~~~~~^
builder, max_dataset_size_bytes=max_dataset_size_bytes
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 948, in stream_convert_to_parquet
builder._prepare_split(split_generator=splits_generators[split], file_format="parquet")
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/builder.py", line 1694, in _prepare_split
for job_id, done, content in self._prepare_split_single(
~~~~~~~~~~~~~~~~~~~~~~~~~~^
gen_kwargs=gen_kwargs, job_id=job_id, **_prepare_split_args
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
):
^
File "/usr/local/lib/python3.14/site-packages/datasets/builder.py", line 1850, in _prepare_split_single
raise DatasetGenerationCastError.from_cast_error(
...<4 lines>...
)
datasets.exceptions.DatasetGenerationCastError: An error occurred while generating the dataset
All the data files must have the same columns, but at some point there are 2 new columns ({'temp_grounding', 'dataset_name'})
This happened while the json dataset builder was generating data using
hf://datasets/yepeng98/TempGCap/sub1/hacs_instruct_segcap_fromto.json (at revision 0f51f17ce8d9e1386d3c807479f9336657b7c95b), ['hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/didemo_anetboth_second_multiprompt_fromto_id2.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/hacs_instruct_segcap_fromto.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_k700.json'], ['hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/didemo_anetboth_second_multiprompt_fromto_id2.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub1/hacs_instruct_segcap_fromto.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_ActivityNet_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_VATEX_duration.json', 'hf://datasets/yepeng98/TempGCap@0f51f17ce8d9e1386d3c807479f9336657b7c95b/sub2/tariser2_sub_k700.json']
Please either edit the data files to have matching columns, or separate them into different configurations (see docs at https://hf.co/docs/hub/datasets-manual-configuration#multiple-configurations)Need help to make the dataset viewer work? Make sure to review how to configure the dataset viewer, and open a discussion for direct support.
video string | id string | conversations list | duration float64 |
|---|---|---|---|
didemo/videos/54322086@N00_2408598493_274c77d26a.mp4 | 54322086@N00_2408598493_274c77d26a | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 14.8 second in the video."
},
{
"from": "gpt",
"value": "a brown rat goes into someone's hand then onto a cage."
}
] | 29.06 |
didemo/videos/67801451@N00_5358663022_243bd90fbc.mp4 | 67801451@N00_5358663022_243bd90fbc | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 15.0 second to 20.0 second in the video?"
},
{
"from": "gpt",
"value": "a person walks outside and then back in"
}
] | 26.26 |
didemo/videos/64379474@N00_4479342537_7b5a3d3f1d.mp4 | 64379474@N00_4479342537_7b5a3d3f1d | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 14.8 second to 25.0 second in the video?"
},
{
"from": "gpt",
"value": "the guards spin around 180 degrees"
}
] | 29.06 |
didemo/videos/63122283@N06_9978694646_e72011157f.mp4 | 63122283@N06_9978694646_e72011157f | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 19.9 second to 28.1 second in the video."
},
{
"from": "gpt",
"value": "the plane flies off the roof"
}
] | 28.07 |
didemo/videos/38928586@N07_12110094074_85bfd8e4bb.mp4 | 38928586@N07_12110094074_85bfd8e4bb | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 0.0 second to 14.9 second in the video."
},
{
"from": "gpt",
"value": "a young girl on a tricycle points at something."
}
] | 25.76 |
didemo/videos/32005048@N06_5252757341_6749a9a2bd.mp4 | 32005048@N06_5252757341_6749a9a2bd | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 4.8 second to 15.0 second in the video."
},
{
"from": "gpt",
"value": "a bird runs behind a tree."
}
] | 25.36 |
didemo/videos/38438821@N05_3967168792_18cfde0fc5.mp4 | 38438821@N05_3967168792_18cfde0fc5 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 14.9 second in the video?"
},
{
"from": "gpt",
"value": "a woman in a gray jacket smiles at the camera."
}
] | 24.02 |
didemo/videos/55016393@N00_3335074996_39dd2e0278.mp4 | 55016393@N00_3335074996_39dd2e0278 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 15.0 second to 19.9 second in the video?"
},
{
"from": "gpt",
"value": "a brown dog runs to retrieve a red ball."
}
] | 28.79 |
didemo/videos/12289718@N00_4955434740_80ae47ef41.mp4 | 12289718@N00_4955434740_80ae47ef41 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 0.0 second to 4.9 second in the video."
},
{
"from": "gpt",
"value": "a man in a hat dials a number on his phone."
}
] | 29.06 |
didemo/videos/34418903@N00_5271280795_b561e95d46.mp4 | 34418903@N00_5271280795_b561e95d46 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 19.8 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "baby yells at camera and plays with toy"
}
] | 29.06 |
didemo/videos/76236359@N00_4283045069_40f7510c03.mp4 | 76236359@N00_4283045069_40f7510c03 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 25.0 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "a cat jumps off of a bed while chasing a laser pointer."
}
] | 29.06 |
didemo/videos/20148960@N00_3951736137_8aee69f6f7.mp4 | 20148960@N00_3951736137_8aee69f6f7 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 19.8 second to 25.0 second in the video."
},
{
"from": "gpt",
"value": "a baby is reaching for something then takes a bite of food."
}
] | 29.06 |
didemo/videos/39346508@N00_3097148199_ee152ea273.mp4 | 39346508@N00_3097148199_ee152ea273 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 14.9 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "a child holding a camera waves at the camera."
}
] | 24.42 |
didemo/videos/64194819@N00_2481079905_c0df9212a9.mp4 | 64194819@N00_2481079905_c0df9212a9 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 19.8 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "the kids run past the camera."
}
] | 29.06 |
didemo/videos/87719130@N00_4156236069_0c530f3d65.mp4 | 87719130@N00_4156236069_0c530f3d65 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.8 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "two people go around each other in a circle then pirouette."
}
] | 29.06 |
didemo/videos/10955425@N00_5507632479_b5b8f6cd0b.mp4 | 10955425@N00_5507632479_b5b8f6cd0b | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 4.8 second to 9.9 second in the video."
},
{
"from": "gpt",
"value": "the middle child on the stage puts his hands on his hips."
}
] | 30 |
didemo/videos/8071066@N04_4240441600_2f984e817e.mp4 | 8071066@N04_4240441600_2f984e817e | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 15.0 second in the video."
},
{
"from": "gpt",
"value": "two penguins move towards each other on the ice."
}
] | 21.12 |
didemo/videos/92431035@N00_6990277885_8b3cdfaf50.mp4 | 92431035@N00_6990277885_8b3cdfaf50 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 24.9 second to 29.7 second in the video."
},
{
"from": "gpt",
"value": "little boy in shallow water falls down"
}
] | 30.03 |
didemo/videos/34418903@N00_6095169007_d2ed0735b8.mp4 | 34418903@N00_6095169007_d2ed0735b8 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 9.9 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "little girl realizes shes made a big mess"
}
] | 30.03 |
didemo/videos/95239135@N00_3600500186_0e4cbe517f.mp4 | 95239135@N00_3600500186_0e4cbe517f | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 4.9 second to 14.8 second in the video?"
},
{
"from": "gpt",
"value": "kitten bites woman's pinky finger."
}
] | 29.06 |
didemo/videos/22837634@N02_3853299361_1570049e56.mp4 | 22837634@N02_3853299361_1570049e56 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 4.9 second to 9.8 second in the video."
},
{
"from": "gpt",
"value": "woman in sunglasses moves her head close to the camera."
}
] | 28.82 |
didemo/videos/19251296@N00_4478203456_d0f06bf1ba.mp4 | 19251296@N00_4478203456_d0f06bf1ba | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 4.9 second to 24.8 second in the video."
},
{
"from": "gpt",
"value": "little boy runs up red porch"
}
] | 28.82 |
didemo/videos/25958034@N03_4542467095_30fde9b376.mp4 | 25958034@N03_4542467095_30fde9b376 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 14.8 second in the video?"
},
{
"from": "gpt",
"value": "the doctor gives a baby a shot."
}
] | 29.06 |
didemo/videos/34831177@N06_7962850080_8d9683c2f2.mp4 | 34831177@N06_7962850080_8d9683c2f2 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 15.0 second to 30.0 second in the video."
},
{
"from": "gpt",
"value": "girl on bike talks to camera"
}
] | 30 |
didemo/videos/16933239@N05_9651948133_c0fd984a94.mp4 | 16933239@N05_9651948133_c0fd984a94 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 14.9 second to 24.9 second in the video."
},
{
"from": "gpt",
"value": "baby claps in the basket"
}
] | 28.03 |
didemo/videos/11054484@N04_6231798967_b93788d4e6.mp4 | 11054484@N04_6231798967_b93788d4e6 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.8 second to 24.9 second in the video?"
},
{
"from": "gpt",
"value": "cat gets petted with hand wearing a ring"
}
] | 30.03 |
didemo/videos/75654019@N00_6991147608_597530f374.mp4 | 75654019@N00_6991147608_597530f374 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 19.8 second to 24.9 second in the video."
},
{
"from": "gpt",
"value": "the girl in the white hat speaks to the camera"
}
] | 30.03 |
didemo/videos/39787674@N00_3902581172_957490ae17.mp4 | 39787674@N00_3902581172_957490ae17 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 19.9 second to 24.8 second in the video."
},
{
"from": "gpt",
"value": "the musician sets his music stand down"
}
] | 28.82 |
didemo/videos/11054484@N04_8455678355_bf3fa55b14.mp4 | 11054484@N04_8455678355_bf3fa55b14 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 4.8 second in the video?"
},
{
"from": "gpt",
"value": "the little girl puts something in her mouth without speaking first"
}
] | 30.03 |
didemo/videos/10770768@N08_3448935461_2498513c58.mp4 | 10770768@N08_3448935461_2498513c58 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 14.8 second in the video."
},
{
"from": "gpt",
"value": "the girl in the pink sweatshirt pushes off from the wall and continues skating"
}
] | 29.06 |
didemo/videos/23368098@N05_4895311765_65288776af.mp4 | 23368098@N05_4895311765_65288776af | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 19.9 second to 28.1 second in the video."
},
{
"from": "gpt",
"value": "man puts crazy hat on"
}
] | 28.07 |
didemo/videos/32161074@N04_6531994237_dc9ec33e52.mp4 | 32161074@N04_6531994237_dc9ec33e52 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 19.8 second to 29.7 second in the video."
},
{
"from": "gpt",
"value": "ballerinas perform a dance"
}
] | 30.03 |
didemo/videos/8571427@N04_7382511952_ef3c6c3291.mp4 | 8571427@N04_7382511952_ef3c6c3291 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "little boy dances"
}
] | 30.03 |
didemo/videos/81894727@N00_3063066131_f053c78b81.mp4 | 81894727@N00_3063066131_f053c78b81 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "mounted policeman on horse crosses street"
}
] | 29.1 |
didemo/videos/63985404@N00_8351615846_8a4a391d1b.mp4 | 63985404@N00_8351615846_8a4a391d1b | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 9.9 second to 14.9 second in the video."
},
{
"from": "gpt",
"value": "lady takes off her glasses"
}
] | 24.79 |
didemo/videos/60844215@N00_3017795013_01491bd994.mp4 | 60844215@N00_3017795013_01491bd994 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 14.8 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "an adult shows a baby how to play with a toy"
}
] | 29.06 |
didemo/videos/71628335@N00_3151447202_906a3e503f.mp4 | 71628335@N00_3151447202_906a3e503f | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 14.8 second to 19.9 second in the video."
},
{
"from": "gpt",
"value": "a baby drinks from a bottle"
}
] | 21.82 |
didemo/videos/49616536@N00_2413537965_6a6d4a6c9c.mp4 | 49616536@N00_2413537965_6a6d4a6c9c | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 25.0 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "a dog runs quickly away"
}
] | 29.06 |
didemo/videos/96675095@N00_5928607902_42e5546d60.mp4 | 96675095@N00_5928607902_42e5546d60 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 15.0 second to 24.5 second in the video."
},
{
"from": "gpt",
"value": "girl gives a 'peace sign.'"
}
] | 24.52 |
didemo/videos/53535391@N00_3750252633_962cb160c8.mp4 | 53535391@N00_3750252633_962cb160c8 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 9.9 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "kid makes a 'cheering' gesture."
}
] | 29.06 |
didemo/videos/81894727@N00_5449771865_b7ff2cb307.mp4 | 81894727@N00_5449771865_b7ff2cb307 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 4.8 second in the video?"
},
{
"from": "gpt",
"value": "a man sticks his tongue out at the camera."
}
] | 30.03 |
didemo/videos/80591230@N00_3439589008_d11dbb6927.mp4 | 80591230@N00_3439589008_d11dbb6927 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 4.9 second in the video?"
},
{
"from": "gpt",
"value": "a boy hits the oncoming ping pong ball and it flies to his left."
}
] | 29.06 |
didemo/videos/54449436@N00_6787585195_9aec27c676.mp4 | 54449436@N00_6787585195_9aec27c676 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 9.9 second in the video?"
},
{
"from": "gpt",
"value": "a girl in a blue shirt waves to the camera."
}
] | 30.03 |
didemo/videos/28789213@N00_4263851962_ec2d5775b9.mp4 | 28789213@N00_4263851962_ec2d5775b9 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 24.8 second to 28.8 second in the video."
},
{
"from": "gpt",
"value": "the man raises his head to reveal the road behind him"
}
] | 28.82 |
didemo/videos/66252507@N00_3413224176_3b3d9e53ff.mp4 | 66252507@N00_3413224176_3b3d9e53ff | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 9.9 second to 14.9 second in the video."
},
{
"from": "gpt",
"value": "the cat leaps away from the person"
}
] | 22.61 |
didemo/videos/92582562@N00_5614839112_cf7d80ca4d.mp4 | 92582562@N00_5614839112_cf7d80ca4d | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 29.7 second in the video."
},
{
"from": "gpt",
"value": "a man holds a pillow up to the camera"
}
] | 30.03 |
didemo/videos/9161595@N03_9676201305_78aa08336b.mp4 | 9161595@N03_9676201305_78aa08336b | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 24.9 second to 28.0 second in the video."
},
{
"from": "gpt",
"value": "guards turn and lift one knee up in unison"
}
] | 28.03 |
didemo/videos/71628335@N00_2638349338_602f9fe2db.mp4 | 71628335@N00_2638349338_602f9fe2db | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.9 second to 23.2 second in the video?"
},
{
"from": "gpt",
"value": "a single biker goes down the path"
}
] | 23.19 |
didemo/videos/18548283@N00_3205233992_7e73f9e96f.mp4 | 18548283@N00_3205233992_7e73f9e96f | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 14.8 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "waves splash against mans feet"
}
] | 29.06 |
didemo/videos/22735328@N00_8515923489_fa3554e85f.mp4 | 22735328@N00_8515923489_fa3554e85f | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 4.8 second to 9.9 second in the video."
},
{
"from": "gpt",
"value": "a boy dribbles a ball up the court."
}
] | 30.03 |
didemo/videos/22837634@N02_3854089156_b9b104059d.mp4 | 22837634@N02_3854089156_b9b104059d | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 4.9 second to 9.8 second in the video?"
},
{
"from": "gpt",
"value": "a man wearing sunglasses is talking."
}
] | 28.82 |
didemo/videos/84491786@N00_5360595399_deab383d50.mp4 | 84491786@N00_5360595399_deab383d50 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.8 second to 15.0 second in the video."
},
{
"from": "gpt",
"value": "a baby put a blue object on a toy."
}
] | 28.84 |
didemo/videos/38928365@N06_4485750784_06a22534f2.mp4 | 38928365@N06_4485750784_06a22534f2 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 4.9 second to 9.9 second in the video."
},
{
"from": "gpt",
"value": "a little boy goes and pours some water in something then makes it back almost to the other children."
}
] | 29.06 |
didemo/videos/63853971@N00_3126019136_36a7d77387.mp4 | 63853971@N00_3126019136_36a7d77387 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.8 second to 25.0 second in the video?"
},
{
"from": "gpt",
"value": "santa gives the little boy something blue."
}
] | 29.06 |
didemo/videos/82832950@N00_2892477928_67a0f1f613.mp4 | 82832950@N00_2892477928_67a0f1f613 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 9.8 second to 14.9 second in the video."
},
{
"from": "gpt",
"value": "the man in glasses points at the camera."
}
] | 24.46 |
didemo/videos/11054484@N04_7686759608_8f40ba6acd.mp4 | 11054484@N04_7686759608_8f40ba6acd | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 4.8 second to 9.9 second in the video."
},
{
"from": "gpt",
"value": "the little girl leans in and kisses the man."
}
] | 30.03 |
didemo/videos/44124367255@N01_2433870917_f1865a4b7d.mp4 | 44124367255@N01_2433870917_f1865a4b7d | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 14.8 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "someone is tickling a cat's nose."
}
] | 29.06 |
didemo/videos/86378412@N00_2742197146_de63631351.mp4 | 86378412@N00_2742197146_de63631351 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 9.9 second to 14.8 second in the video."
},
{
"from": "gpt",
"value": "a man writes something near the bottom of the paper."
}
] | 29.06 |
didemo/videos/7844032@N03_5913789999_10c6c89b8f.mp4 | 7844032@N03_5913789999_10c6c89b8f | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 19.8 second to 29.7 second in the video."
},
{
"from": "gpt",
"value": "a cat sits down on a small table."
}
] | 30.03 |
didemo/videos/51378257@N00_4963450616_37ab59fb4b.mp4 | 51378257@N00_4963450616_37ab59fb4b | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 25.0 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "a man licks a bone sample"
}
] | 29.06 |
didemo/videos/60844215@N00_5516186952_e74e6ceae4.mp4 | 60844215@N00_5516186952_e74e6ceae4 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 14.7 second in the video."
},
{
"from": "gpt",
"value": "the adult woman puts her left hand over her mouth"
}
] | 30.03 |
didemo/videos/30185327@N07_2866564169_9882cb6dbb.mp4 | 30185327@N07_2866564169_9882cb6dbb | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 25.0 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "a man in a blue shirt talks to the camera"
}
] | 29.06 |
didemo/videos/92024390@N00_3613042430_9d8cf20bfa.mp4 | 92024390@N00_3613042430_9d8cf20bfa | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 0.0 second to 4.9 second in the video."
},
{
"from": "gpt",
"value": "one girl jumped off the stage."
}
] | 28.84 |
didemo/videos/31266237@N00_5357712621_d1487326d2.mp4 | 31266237@N00_5357712621_d1487326d2 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 4.9 second to 14.8 second in the video."
},
{
"from": "gpt",
"value": "two men with drinks talking in front of a christmas tree."
}
] | 29.06 |
didemo/videos/34025889@N00_6185657653_a8288880b1.mp4 | 34025889@N00_6185657653_a8288880b1 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 0.0 second to 4.8 second in the video."
},
{
"from": "gpt",
"value": "sunglasses on the table"
}
] | 29.9 |
didemo/videos/9781230@N06_5069299300_859f6b7b39.mp4 | 9781230@N06_5069299300_859f6b7b39 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 14.8 second to 25.0 second in the video."
},
{
"from": "gpt",
"value": "drum major twirls baton"
}
] | 29.06 |
didemo/videos/84687617@N00_3376239645_19ffbb10a1.mp4 | 84687617@N00_3376239645_19ffbb10a1 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 15.0 second to 19.9 second in the video?"
},
{
"from": "gpt",
"value": "cat sits down"
}
] | 28.82 |
didemo/videos/64353172@N00_8259996337_3537cf5401.mp4 | 64353172@N00_8259996337_3537cf5401 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.8 second to 24.9 second in the video?"
},
{
"from": "gpt",
"value": "laptop screen shown"
}
] | 30.03 |
didemo/videos/28994929@N06_4098208711_6c134fdd27.mp4 | 28994929@N06_4098208711_6c134fdd27 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 9.9 second to 14.8 second in the video."
},
{
"from": "gpt",
"value": "someone moves an orange go kart off a track"
}
] | 29.06 |
didemo/videos/51229679@N03_5415885839_a25a9b0f44.mp4 | 51229679@N03_5415885839_a25a9b0f44 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 0.0 second to 15.0 second in the video."
},
{
"from": "gpt",
"value": "a person strums on a guitar"
}
] | 30 |
didemo/videos/45822315@N00_7187185131_9c8b9e734c.mp4 | 45822315@N00_7187185131_9c8b9e734c | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 14.7 second to 19.8 second in the video?"
},
{
"from": "gpt",
"value": "a person drinks from a gold cup"
}
] | 30.03 |
didemo/videos/26232232@N07_3528754424_73d6ea2ed0.mp4 | 26232232@N07_3528754424_73d6ea2ed0 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 14.8 second to 25.0 second in the video."
},
{
"from": "gpt",
"value": "the dog rolls over and gets a belly rub."
}
] | 29.06 |
didemo/videos/66908011@N00_3583710962_746390e15d.mp4 | 66908011@N00_3583710962_746390e15d | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 9.9 second to 14.8 second in the video?"
},
{
"from": "gpt",
"value": "the cat jumps over some boots to get to the ball."
}
] | 22.49 |
didemo/videos/77395664@N00_5195942390_382dbc680b.mp4 | 77395664@N00_5195942390_382dbc680b | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 25.0 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "the man in a grey shirt dumps the contents of the red cup into the big bowl."
}
] | 29.06 |
didemo/videos/22843806@N03_8641012115_5a42eeda5f.mp4 | 22843806@N03_8641012115_5a42eeda5f | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 19.8 second to 29.7 second in the video."
},
{
"from": "gpt",
"value": "little girl grabs something and throws it"
}
] | 30.03 |
didemo/videos/34989799@N00_3512292740_5332fe1227.mp4 | 34989799@N00_3512292740_5332fe1227 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.8 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "gerbils run on exercise wheel"
}
] | 29.06 |
didemo/videos/88711420@N00_2909312090_36a0b39eda.mp4 | 88711420@N00_2909312090_36a0b39eda | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 19.8 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "man standing up and giving a bow."
}
] | 29.06 |
didemo/videos/53829072@N00_6530972085_4165968ac2.mp4 | 53829072@N00_6530972085_4165968ac2 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 19.8 second to 29.7 second in the video."
},
{
"from": "gpt",
"value": "child dangling and then falling from a chair."
}
] | 30.03 |
didemo/videos/72575954@N00_4909555405_9159189d96.mp4 | 72575954@N00_4909555405_9159189d96 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 19.8 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "cat meeting a new friend."
}
] | 29.06 |
didemo/videos/39346508@N00_3097148199_ee152ea273.mp4 | 39346508@N00_3097148199_ee152ea273 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 0.0 second to 4.9 second in the video."
},
{
"from": "gpt",
"value": "a man in a maroon sweater shakes something"
}
] | 24.42 |
didemo/videos/87719130@N00_4156236069_0c530f3d65.mp4 | 87719130@N00_4156236069_0c530f3d65 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 14.8 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "two ice skaters come out of a cave"
}
] | 29.06 |
didemo/videos/43762471@N00_12771668963_26ececc373.mp4 | 43762471@N00_12771668963_26ececc373 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 14.9 second to 24.9 second in the video."
},
{
"from": "gpt",
"value": "sleeping through the storm."
}
] | 28.03 |
didemo/videos/33195950@N00_4369109814_5ac0ac4417.mp4 | 33195950@N00_4369109814_5ac0ac4417 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 14.8 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "a woman takes something off of a table then walks out of the room."
}
] | 29.06 |
didemo/videos/20143551@N00_3082151523_36c927298f.mp4 | 20143551@N00_3082151523_36c927298f | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 9.9 second to 14.8 second in the video."
},
{
"from": "gpt",
"value": "the toy runs into a box."
}
] | 23.49 |
didemo/videos/28322281@N03_4550745116_b2eebe91ab.mp4 | 28322281@N03_4550745116_b2eebe91ab | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 0.0 second to 9.9 second in the video."
},
{
"from": "gpt",
"value": "a child swims on an orange and yellow floatie."
}
] | 29.06 |
didemo/videos/12244719@N00_5070000391_f91f7aabfd.mp4 | 12244719@N00_5070000391_f91f7aabfd | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 14.8 second to 19.8 second in the video."
},
{
"from": "gpt",
"value": "a white car drives on the road in the distance."
}
] | 29.06 |
didemo/videos/19765873@N00_3877539840_2d5dd7a2fb.mp4 | 19765873@N00_3877539840_2d5dd7a2fb | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 20.0 second to 24.9 second in the video."
},
{
"from": "gpt",
"value": "a man moves from the machine to the left and out of view."
}
] | 27.03 |
didemo/videos/11054484@N04_7784057808_c66ed7f73d.mp4 | 11054484@N04_7784057808_c66ed7f73d | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 9.9 second to 14.7 second in the video."
},
{
"from": "gpt",
"value": "a baby pulls a red block out of a toy and puts it in her mouth."
}
] | 30.03 |
didemo/videos/14539247@N00_2880187006_cc603169b9.mp4 | 14539247@N00_2880187006_cc603169b9 | [
{
"from": "human",
"value": "<image>\nSummarize the activity shown from 4.9 second to 9.9 second in the video."
},
{
"from": "gpt",
"value": "a woman in a red shirt comes up on stage and stands in front of a microphone."
}
] | 29.06 |
didemo/videos/25373834@N08_3648342581_cc602cff33.mp4 | 25373834@N08_3648342581_cc602cff33 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 14.8 second in the video?"
},
{
"from": "gpt",
"value": "a message is posted on the wall."
}
] | 29.06 |
didemo/videos/81894727@N00_5449771865_b7ff2cb307.mp4 | 81894727@N00_5449771865_b7ff2cb307 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 24.9 second to 29.7 second in the video?"
},
{
"from": "gpt",
"value": "the roller coaster goes past a building with windows."
}
] | 30.03 |
didemo/videos/54449436@N00_6787585195_9aec27c676.mp4 | 54449436@N00_6787585195_9aec27c676 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 4.8 second to 9.9 second in the video?"
},
{
"from": "gpt",
"value": "a girl waves then talks."
}
] | 30.03 |
didemo/videos/98771204@N00_2676657779_5cdafd72ec.mp4 | 98771204@N00_2676657779_5cdafd72ec | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 15.0 second to 28.8 second in the video."
},
{
"from": "gpt",
"value": "the baby is hand fed a small piece of food."
}
] | 28.82 |
didemo/videos/12289718@N00_5248920068_c69bbbcbf5.mp4 | 12289718@N00_5248920068_c69bbbcbf5 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 19.8 second to 29.1 second in the video."
},
{
"from": "gpt",
"value": "the singer walks through the crowd giving hi-fives."
}
] | 29.06 |
didemo/videos/7429469@N05_4499858445_34371f5544.mp4 | 7429469@N05_4499858445_34371f5544 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 15.0 second to 19.9 second in the video."
},
{
"from": "gpt",
"value": "the boy picks something out of the bin."
}
] | 28.82 |
didemo/videos/25958034@N03_5246259680_74885d7bc9.mp4 | 25958034@N03_5246259680_74885d7bc9 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 19.8 second to 29.1 second in the video?"
},
{
"from": "gpt",
"value": "the baby throws a fit over the taken sucker"
}
] | 29.06 |
didemo/videos/75654019@N00_5214512361_b0bf3aa001.mp4 | 75654019@N00_5214512361_b0bf3aa001 | [
{
"from": "human",
"value": "<image>\nDescribe the event occurring from 0.0 second to 25.0 second in the video."
},
{
"from": "gpt",
"value": "baby throws toys off couch"
}
] | 29.06 |
didemo/videos/25958034@N03_5884211194_e7771e9562.mp4 | 25958034@N03_5884211194_e7771e9562 | [
{
"from": "human",
"value": "<image>\nPlease describe the content from 9.9 second to 15.0 second in the video."
},
{
"from": "gpt",
"value": "a toddler picks up something blue."
}
] | 30 |
didemo/videos/82386510@N00_3676853256_ab5afe123f.mp4 | 82386510@N00_3676853256_ab5afe123f | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 15.0 second to 19.9 second in the video?"
},
{
"from": "gpt",
"value": "a woman blows out a puff of smoke."
}
] | 23.4 |
didemo/videos/23392683@N00_3749474444_a2d043b536.mp4 | 23392683@N00_3749474444_a2d043b536 | [
{
"from": "human",
"value": "<image>\nWhat happens in the scene from 0.0 second to 4.9 second in the video?"
},
{
"from": "gpt",
"value": "a cat tries to open a door."
}
] | 21.12 |
End of preview.
README.md exists but content is empty.
- Downloads last month
- 20