Replies: 2 comments
-
Probably should be an issue in aind-metadata-mapper |
Beta Was this translation helpful? Give feedback.
-
This might require a longer discussion to try to solve this issue in a more holistic way. Regardless, I will try to start this discussion with some notes: The case for flat binary filesPeople tend to gravitate towards the same formats in neuroscience. For instance, ephys and ophys data is often saved as flat binary files, where data can be readily decoded by having access to some logging "metadata". For this specific case, a user would need to know: Layout: [ColumnMajor, RowMajor] CSVsCSVs are another great example of how people tend to log their data. They have a defined standard, and although far from efficient, do offer some human-readability to the user. Harp binary filesThe harp protocol is a well-defined binary protocol, with recommend logging practices. Similary to the binary file, a few metadata fields could suffice: Json FilesThis one is a bit more obvious, but saving a deserialized object that follows a pre-existing schema is super powerful, especially if one allows arrays of objects in a single file SchemaSource: url to schema These are just some examples. Obviously, each of these logger objects should inherit from a base object that should have some core properties: RootFolder |
Beta Was this translation helpful? Give feedback.
-
Loggers that describe data format headers. Bruno and Josh to provide examples
Beta Was this translation helpful? Give feedback.
All reactions