Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restructuring parallel trees (Raw vs. XDI) #14

Open
jmaruland opened this issue Jan 20, 2022 · 0 comments
Open

Restructuring parallel trees (Raw vs. XDI) #14

jmaruland opened this issue Jan 20, 2022 · 0 comments

Comments

@jmaruland
Copy link
Contributor

Currently, when a user wants to use tiled on a dataset of LabVIEW files, they can configure an adapter that creates a tree with two distinct main branches: one branch called unnormalized that will contain the data of the files as it is (also referred to as raw data), the other branch is named normalized and it represents a filtered version of the original data that follows the XAS Data Interchange Format (XDI) (https://github.com/XraySpectroscopy/XAS-Data-Interchange/blob/master/specification/dictionary.md#defined-items-in-the-column-namespace).

These two versions of the same dataset created some confusion for some scientists and after a thorough discussion, it was decided to reorganize the tree with a more optimal format. The new approach will create a single tree with all the data and the column names that qualify as part of the XDI standard will be renamed, if necessary. Also, the adapter will save the information about conversion in a section of the metadata. This information could be a dictionary linking the old column name with the new column name.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant