Add Nighttime Lights Analysis (#4)

datapartnership · Oct 30, 2023 · 19d7541 · 19d7541
1 parent f916781
commit 19d7541
Show file tree

Hide file tree

Showing 4 changed files with 1,513 additions and 62 deletions.
diff --git a/docs/_toc.yml b/docs/_toc.yml
@@ -2,27 +2,15 @@ format: jb-book
 root: README
 
 parts:
-  - caption: Examples
-    numbered: True
+  - caption: Introduction to Data Goods
     chapters:
-      - file: notebooks/world-bank-api.ipynb
-      - file: notebooks/world-bank-package.ipynb
-      - file: notebooks/nasa-apod.ipynb
-      - file: notebooks/bibliography.ipynb
-  - caption: Gallery
+      - file: docs/introduction_to_data_goods
+  - caption: Foundational Datasets
     chapters:
-      - file: docs/gallery
-  - caption: Templates
+      - file: docs/foundational_datasets_and_data_products.md
+  - caption: Data Products
     chapters:
-      - file: docs/CODE_OF_CONDUCT
-      - file: CONTRIBUTING
-  - caption: Additional Resources
+      - file: notebooks/nighttime-lights/nighttime-lights.ipynb
+  - caption: Acknowledgements
     chapters:
-      - url: https://datapartnership.org
-        title: Development Data Partnership
-      - url: https://wbdatalab.org
-        title: World Bank Data Lab
-      - url: https://www.worldbank.org/en/about/unit/unit-dec
-        title: World Bank DEC
-      - url: https://www.worldbank.org/en/research/dime
-        title: World Bank DIME
+      - file: docs/team
diff --git a/docs/bibliography.bib b/docs/bibliography.bib
@@ -1,39 +1,13 @@
-@book{WorldBank2021WorldDevelopmentReport,
-  author      = {{World Bank}},
-  publisher = {World Bank},
-  url         = {http://hdl.handle.net/10986/35218},
-  date        = {2021},
-  note        = {License: CC BY 3.0 IGO},
-  title       = {{W}orld {D}evelopment {R}eport 2021 : {D}ata for {B}etter {L}ives},
-  type        = {World Development Report},
-  year         = {2021},
-}
-@book{WorldBank2022WorldDevelopmentReport,
-  author      = {{World Bank}},
-  publisher = {World Bank},
-  url         = {http://hdl.handle.net/10986/36883},
-  date        = {2022},
-  note        = {License: CC BY 3.0 IGO},
-  title       = {{W}orld {D}evelopment {R}eport 2022 : {F}inance for an {E}quitable {R}ecovery},
-  type        = {World Development Report},
-  year         = {2022},
-},
-@book{WorldBank2023WorldDevelopmentReport,
-  author      = {{World Bank}},
-  publisher = {World Bank},
-  url         = {https://openknowledge.worldbank.org/handle/10986/39696},
-  date        = {2023},
-  note        = {License: CC BY 3.0 IGO},
-  title       = {{W}orld {D}evelopment {R}eport 2021 : {M}igrants, {R}efugees, and {S}ocieties},
-  type        = {World Development Report},
-  year         = {2023},
-}
-@misc{sdgatlas2020,
-  author      = {Pirlea, A. F. and U. Serajuddin and D. Wadhwa and M. Welch and A. Whitby},
-  publisher = {World Bank},
-  url         = {https://datatopics.worldbank.org/sdgatlas.},
-  date        = {2020},
-  note        = {License: CC BY 3.0 IGO},
-  title       = {{A}tlas of the {S}ustainable {D}evelopment {G}oals 2020: {F}rom {W}orld {D}evelopment {I}ndicators},
-  year         = {2020},
+@article{ROMAN2018113,
+title = {NASA's Black Marble nighttime lights product suite},
+journal = {Remote Sensing of Environment},
+volume = {210},
+pages = {113-143},
+year = {2018},
+issn = {0034-4257},
+doi = {https://doi.org/10.1016/j.rse.2018.03.017},
+url = {https://www.sciencedirect.com/science/article/pii/S003442571830110X},
+author = {Miguel O. Román and Zhuosen Wang and Qingsong Sun and Virginia Kalb and Steven D. Miller and Andrew Molthan and Lori Schultz and Jordan Bell and Eleanor C. Stokes and Bhartendu Pandey and Karen C. Seto and Dorothy Hall and Tomohiro Oda and Robert E. Wolfe and Gary Lin and Navid Golpayegani and Sadashiva Devadiga and Carol Davidson and Sudipta Sarkar and Cid Praderas and Jeffrey Schmaltz and Ryan Boller and Joshua Stevens and Olga M. {Ramos González} and Elizabeth Padilla and José Alonso and Yasmín Detrés and Roy Armstrong and Ismael Miranda and Yasmín Conte and Nitza Marrero and Kytt MacManus and Thomas Esch and Edward J. Masuoka},
+keywords = {Suomi-NPP, JPSS, NASA black marble, VIIRS, Night lights, NTL, Urban dynamics, Long-term monitoring, Lunar BRDF, Albedo, Atmospheric correction},
+abstract = {NASA's Black Marble nighttime lights product suite (VNP46) is available at 500 m resolution since January 2012 with data from the Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) onboard the Suomi National Polar-orbiting Platform (SNPP). The retrieval algorithm, developed and implemented for routine global processing at NASA's Land Science Investigator-led Processing System (SIPS), utilizes all high-quality, cloud-free, atmospheric-, terrain-, vegetation-, snow-, lunar-, and stray light-corrected radiances to estimate daily nighttime lights (NTL) and other intrinsic surface optical properties. Key algorithm enhancements include: (1) lunar irradiance modeling to resolve non-linear changes in phase and libration; (2) vector radiative transfer and lunar bidirectional surface anisotropic reflectance modeling to correct for atmospheric and BRDF effects; (3) geometric-optical and canopy radiative transfer modeling to account for seasonal variations in NTL; and (4) temporal gap-filling to reduce persistent data gaps. Extensive benchmark tests at representative spatial and temporal scales were conducted on the VNP46 time series record to characterize the uncertainties stemming from upstream data sources. Initial validation results are presented together with example case studies illustrating the scientific utility of the products. This includes an evaluation of temporal patterns of NTL dynamics associated with urbanization, socioeconomic variability, cultural characteristics, and displaced populations affected by conflict. Current and planned activities under the Group on Earth Observations (GEO) Human Planet Initiative are aimed at evaluating the products at different geographic locations and time periods representing the full range of retrieval conditions.}
 }
diff --git a/docs/foundational_datasets_and_data_products.md b/docs/foundational_datasets_and_data_products.md
@@ -16,8 +16,8 @@ Where feasible, all datasets that can be obtained through the Development Data H
 
 | ID  | Name | License | Description | Update Frequency | Access | Contact |
 | --- | ---- | ------- | ----------- | ---------------- | ------ | ------- |
-| 1      | Palestine - Subnational Administrative Boundaries                       | Open                   | Admin boundaries up to level 2                                                                                      | Every year (Last updated in 20 October 2023)                                      | [HDX](<https://data.humdata.org/dataset/cod-ab-pse>                                     | [Data Lab](mailto:[email protected])
-| 2   |   Visible Infrared Imaging Radiometer Suite (VIIRS) Nighttime Lights   |    Open     |      Timestamped lat/lon points       |      Daily            |   [NASA's Black Marble](http://blackmarble.gsfc.nasa.gov)     |    [Geospatial Operations Support Team](mailto:[email protected])) or [Data Lab](mailto:[email protected])     |
+| 1      | Palestine - Subnational Administrative Boundaries                       | Open                   | Admin boundaries up to level 2                                                                                      | Every year (Last updated in 20 October 2023)                                      | [HDX](https://data.humdata.org/dataset/cod-ab-pse)                                     | [Data Lab](mailto:[email protected])
+| 2   |   NASA's Black Marble Nighttime Lights  |    Open     |      Visible Infrared Imaging Radiometer Suite (VIIRS) Nighttime Lights       |      Daily            |   [NASA's Black Marble](http://blackmarble.gsfc.nasa.gov)     |    [Geospatial Operations Support Team](mailto:[email protected]) or [Data Lab](mailto:[email protected])     |
 
 ## Data Products Summary
 
@@ -26,5 +26,5 @@ Where feasible, all datasets that can be obtained through the Development Data H
 Following is a summary of Data Products used in this Data Good:
 
 | ID  | Name | Description | Limitations | Foundational Datasets Used (ID#) |
-| --- | ---- | ----------- | ----------- | -------------------------------- |                       |
-| A   |  Observed changes in NightLight Data    |   Weekly aggregated trends in nightlight connectivity          |  Changes in nighttime lights could be driven by multiple factors—such as rescue efforts generating lights, to damages and people leaving high-hit areas causing a reduction in nighttime lights           |          1,2                        |
+| --- | ---- | ----------- | ----------- | -------------------------------- |
+| A   |  Observed changes in NightLight Data    |   Weekly aggregated trends in nighttime luminosity          |  Changes in nighttime lights could be driven by multiple factors—such as rescue efforts generating lights, to damages and people leaving high-hit areas causing a reduction in nighttime lights           |          1,2                       |