Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

set up gom dataset.xml files #47

Closed
7yl4r opened this issue Apr 28, 2023 · 17 comments
Closed

set up gom dataset.xml files #47

7yl4r opened this issue Apr 28, 2023 · 17 comments
Assignees

Comments

@7yl4r
Copy link
Member

7yl4r commented Apr 28, 2023

dataset status
moda_oc_7d_gom working
moda_sst4_7d_gom new dataset.xml
vsnpp_sstn_7d_gom new dataset.xml
vsnpp_sst_7d_gom new dataset.xml
vsnpp_oc_7d_gom new dataset.xml

What I need for docker exec -it erddap bash -c "cd webapps/erddap/WEB-INF/ && bash GenerateDatasetsXml.sh -verbose"

  • type: EDDGridFromNcFiles
  • dir:
    • pattern: /mnt/sdb/{sensor}_{product}_{temporal_resolution}_{roi}/
    • eg: /mnt/sdb/moda_oc_7d_gom/
  • regex: .*.nc
@7yl4r 7yl4r self-assigned this Apr 28, 2023
@7yl4r
Copy link
Member Author

7yl4r commented Apr 28, 2023

waiting to see if ERDDAP server figures these out

@dotis
Copy link
Contributor

dotis commented May 1, 2023

I don't see that this is working. The dataset.xml for moda_sst4_7d_gom looks ok. The source attribute section of the file is grayed out. Not sure if that makes a difference.

@dotis
Copy link
Contributor

dotis commented May 2, 2023

Having the source attributes did not seem to help. I have grayed them out again. In the one working xml file (moda_oc_7d_gom), there are no source attributes in the file at all. Perhaps I should remove them altogether?

@dotis
Copy link
Contributor

dotis commented May 2, 2023

Created a new file https://github.com/USF-IMARS/erddap-config/blob/master/datasets/moda_sst4_7d_gom/dataset.xml

There were some differences between the working file (moda_oc_7d_gom) and the moda_sst4_7d_gom in the "axis variable" section. Let's see if this helps.

@dotis
Copy link
Contributor

dotis commented May 2, 2023

Still failing. I can't tell from the status page what the errors might be.

@7yl4r
Copy link
Member Author

7yl4r commented May 2, 2023

I need to log in to erddap and run the DasDds.sh script on each failing dataset to debug them. I am going to open new issues for each failing dataset so that I get less confused.

@dotis
Copy link
Contributor

dotis commented May 2, 2023

Ok. Currently just trying to make moda_sst4_7d_gom work. Checking the input files to see if there are differences between the OC and SST4 for gom.

@7yl4r
Copy link
Member Author

7yl4r commented May 2, 2023

I found an unrelated error in the erddap configuration that may have been preventing your updates from applying.

The setup.xml had become malformed because of a git merge collision caused by the update cronjob. I don't know how that happened, but I have reset things and hoping it doesn't happen again.

@7yl4r
Copy link
Member Author

7yl4r commented May 2, 2023

turns out all 4 of the datasets have the same issue: #48

@dotis
Copy link
Contributor

dotis commented May 2, 2023

Ok. If moda_sst4_7d_gom fails, we can go back to the old xml, which I stashed in the "trash"

@dotis
Copy link
Contributor

dotis commented May 3, 2023

moda_sst4_7d_gom is working. The title it shows is a bit weird: "USF data from a local source" rather than a descriptive title, but it's in there. It seems I need to change the dataset.xml files for the other datasets.

@7yl4r Can we add a moda_sst_7d_gom? Thanks.

@dotis
Copy link
Contributor

dotis commented May 3, 2023

I figured out how to change the title.

7yl4r added a commit that referenced this issue May 3, 2023
as requested on #47
@dotis
Copy link
Contributor

dotis commented May 3, 2023

I made the title changes in the dataset.xml files for the two working datasets, but I don't see that the changes have taken effect yet. Does this take awhile? Or, perhaps I needed to change the title elsewhere as well.

@dotis
Copy link
Contributor

dotis commented May 3, 2023

I changed the xml for vsnpp_sst4_7d_gom and vsnpp_oc_7d_gom. Let's see if these work.

@dotis
Copy link
Contributor

dotis commented May 3, 2023

The xml have been updated for all six datasets. I also updated the product names. Will this work? Stay tuned!

@dotis
Copy link
Contributor

dotis commented May 3, 2023

Seems like all six datasets are working!

@dotis
Copy link
Contributor

dotis commented May 3, 2023

Number of failing datasets = 0

@dotis dotis closed this as completed May 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants