Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add motu product #52

Open
3 tasks
7yl4r opened this issue Jun 16, 2023 · 3 comments
Open
3 tasks

add motu product #52

7yl4r opened this issue Jun 16, 2023 · 3 comments

Comments

@7yl4r
Copy link
Member

7yl4r commented Jun 16, 2023

add mirrored product from MOTU.

https://my.cmems-du.eu/thredds/dodsC/cmems_obs-sl_glo_phy-ssh_my_allsat-l4-duacs-0.25deg_P1M-m

A .sh script is being added here to download the .nc files using methods described in noaa-onms/climate-dashboard#3

Steps to complete:

  • download data script working
  • generateDatasetXml.sh run on the new .nc files
  • xml added & confirmed working in ERDDAP
@7yl4r
Copy link
Member Author

7yl4r commented Jun 16, 2023

data pipeline :

flowchart TD
    ERDDAP[("ERDDAP")]
    MOTU[(MOTU)]

    MOTU --> mirror_motu{mirror motu} --> ERDDAP

%% crontabed script to dl from MOTU
%% erddap config to include data from MOTU

    local_files[".nc local files"]
    
    ERDDAP -- "extractR" --> local_files

    local_files -- polygon_subset --> csv_files

    %% https://github.com/7yl4r/extracted_sat_ts_gom_csv_data
    csv_upload{csv_upload}

    csv_files --> csv_upload
    gh[(github)]
    csv_upload --> gh

    gh --> dashboard
Loading

@7yl4r
Copy link
Member Author

7yl4r commented Jun 16, 2023

opened discussion thread on ERDDAP forum: https://groups.google.com/g/erddap/c/e_ey473ocAM

@7yl4r
Copy link
Member Author

7yl4r commented Jun 16, 2023

implementation started on the motu branch but waiting to hear back from the forum before putting more work in

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant