Mapping between the example in `annotations.jsonl` and `physical-interaction-tfrecords`

[yingShen-ys]

Hello, thank you for the great work!

I have downloaded the annotations.jsonl and physical-interaction-tfrecords. However it is not clear to me how can I find the mapping between the examples in annotations.jsonl and the tfrecords in physical-interaction-tfrecords.

Specifically, what I need is to find the corresponding image frames (pre-condition and post-condition) for the each example in the annotation file. Could you help me with this?

Thank you!

[rowanz]

Hi Ying,

If you want the images, I think you might have to do a matching -- but hopefully there's info in there that should help, including the fields "fn" (e.g. /home/rowan/datasets3/ipk-v1/slice_objectx/G70FvDNyl4H0.h5); where each trajectory was initially stored, or "slug", e.g. "data_dec_2_2020/PickupObject-CounterTop-Potato/G70FvDNyl4H0" - a shorter name for each one.

thanks --

Rowan

[yingShen-ys]

Hi Ying,

If you want the images, I think you might have to do a matching -- but hopefully there's info in there that should help, including the fields "fn" (e.g. /home/rowan/datasets3/ipk-v1/slice_objectx/G70FvDNyl4H0.h5); where each trajectory was initially stored, or "slug", e.g. "data_dec_2_2020/PickupObject-CounterTop-Potato/G70FvDNyl4H0" - a shorter name for each one.

thanks --

Rowan

Does each entry in the annotations.jsonl has its corresponding tfrecord? I can only find 17 matches between annotations.jsonl and physical-interaction-tfrecords using the ['meta']['fn'] field.