Skip to content

Problem loading dataset in huggingface #4

@dimakarp1996

Description

@dimakarp1996

Hello. I faced a problem while using russian SuperGlue in HuggingFace. While having 1.16.0 version of HuggingFace library datasets, and trying to make command

from datasets import load_dataset
load_dataset('russian_super_glue','rcb')

I face the ArrowTypeError mentioned on the screenshot. Cleaning up the directory where the dataset file was cached (.cache/huggingface/datasets/json) didn't solve this issue.
Screenshot from 2022-09-09 12-58-53

Note that the similar command
load_dataset('super_glue','cb')
was completed successfully, so the problem is not on the HuggingFace side.

When I use (on different machine) datasets 2.4.0, I get the following error.
Screenshot from 2022-09-09 13-30-52
And again, similar command with any english SuperGLUE dataset works well.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions