Skip to content

binary annotation formats#228

Open
lucasgautheron wants to merge 7 commits intomasterfrom
types/gzip
Open

binary annotation formats#228
lucasgautheron wants to merge 7 commits intomasterfrom
types/gzip

Conversation

@lucasgautheron
Copy link
Collaborator

@lucasgautheron lucasgautheron commented Jun 4, 2021

(ultra low priority; proof of concept)

  • tests passing
  • documentation
  • dynamic extension
  • set output format an option for the merger
  • gzip
  • hdf5
  • parquet

@lucasgautheron lucasgautheron changed the title multiple storage support for annotations: add gzip gzip and hdf5 formats for annotations Jul 15, 2021
@lucasgautheron lucasgautheron changed the title gzip and hdf5 formats for annotations binary annotation formats Jul 15, 2021
@lucasgautheron lucasgautheron added the enhancement New feature or request label Jul 15, 2021
@lucasgautheron
Copy link
Collaborator Author

According to this benchmark, it is not worth using HDF_Fixed in any case.

So we should use HDF_Table, taking advantage of categoricals, AND maybe merging annotations from different recordings together (which will require a bit of work and will make it harder to use datasets without the python API)

@lucasgautheron lucasgautheron force-pushed the master branch 2 times, most recently from 63e3c64 to 46fcda4 Compare November 14, 2021 16:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant