Skip to content

Commit

Permalink
feat: add separate press names list (#182)
Browse files Browse the repository at this point in the history
* share existing translation logic & map access

* add JSON resource & script

* add CSV generate

* allow generate with daily workflow

* add doc page

* include total record count on docs page

* fix type issue

* fix build issue

* switch back to derived csv pattern due to build timing

* include same icon for press list in main index

* quote notes in csv to avoid col splitting

* fix csv w/ unquote before quoting

* update mapping for missing parts

* update json

* killed-in-gaza: json update

* add update post

* update CPJ links

---------

Co-authored-by: sterlingwes <[email protected]>
  • Loading branch information
sterlingwes and sterlingwes authored May 2, 2024
1 parent d5909ac commit 956b7cd
Show file tree
Hide file tree
Showing 24 changed files with 1,169 additions and 92 deletions.
5 changes: 4 additions & 1 deletion .github/workflows/gen-daily.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,10 @@ jobs:
run: bun install

- name: generate daily datasets
run: bun run gen-daily
run: |
bun run gen-daily
mkdir -p site/src/generated/killed-in-gaza
bun run gen-killed-press
env:
TFP_SHEET_KEY: ${{ secrets.TFP_SHEET_KEY }}

Expand Down
80 changes: 40 additions & 40 deletions killed-in-gaza.json
Original file line number Diff line number Diff line change
Expand Up @@ -4290,7 +4290,7 @@
"age": 53,
"sex": "f",
"source": "h",
"en_name": "Hanan Omar Athman Alnadi"
"en_name": "Hanan Omar Athman al-Nadi"
},
{
"id": "957463656",
Expand Down Expand Up @@ -10131,7 +10131,7 @@
"age": 54,
"sex": "f",
"source": "h",
"en_name": "Nuha Abdalrzaq Khamis Alnadi"
"en_name": "Nuha Abdalrzaq Khamis al-Nadi"
},
{
"id": "932096878",
Expand All @@ -10140,7 +10140,7 @@
"age": 56,
"sex": "m",
"source": "h",
"en_name": "Samaih Abdalrzaq Khamis Alnadi"
"en_name": "Samaih Abdalrzaq Khamis al-Nadi"
},
{
"id": "932096845",
Expand All @@ -10149,7 +10149,7 @@
"age": 64,
"sex": "f",
"source": "h",
"en_name": "Shfa Abdalrazq Khamis Alnadi"
"en_name": "Shfa Abdalrazq Khamis al-Nadi"
},
{
"id": "932096787",
Expand All @@ -10158,7 +10158,7 @@
"age": 60,
"sex": "m",
"source": "h",
"en_name": "Muhammad Ismail Khamis Alnadi"
"en_name": "Muhammad Ismail Khamis al-Nadi"
},
{
"id": "932091770",
Expand Down Expand Up @@ -13920,7 +13920,7 @@
"age": 42,
"sex": "m",
"source": "h",
"en_name": "Aataallah Muhammad Aataallah Jrghon"
"en_name": "Aataallah Muhammad Aataallah Jarghoun"
},
{
"id": "926666587",
Expand Down Expand Up @@ -18780,7 +18780,7 @@
"age": 75,
"sex": "f",
"source": "h",
"en_name": "Sobhiah Khalil Salem Jrghon"
"en_name": "Sobhiah Khalil Salem Jarghoun"
},
{
"id": "914650882",
Expand Down Expand Up @@ -19086,7 +19086,7 @@
"age": 92,
"sex": "f",
"source": "h",
"en_name": "Alaiah Muhammad Ibrahem Jrghon"
"en_name": "Alaiah Muhammad Ibrahem Jarghoun"
},
{
"id": "914313465",
Expand Down Expand Up @@ -20373,7 +20373,7 @@
"age": 53,
"sex": "f",
"source": "h",
"en_name": "Rhaifah Aaraf Ali Alnadi"
"en_name": "Rhaifah Aaraf Ali al-Nadi"
},
{
"id": "911570505",
Expand Down Expand Up @@ -32100,7 +32100,7 @@
"age": 47,
"sex": "f",
"source": "h",
"en_name": "Maroah Harab Diab Jrghon"
"en_name": "Maroah Harab Diab Jarghoun"
},
{
"id": "900783572",
Expand Down Expand Up @@ -35043,7 +35043,7 @@
"age": 30,
"sex": "f",
"source": "h",
"en_name": "Eman Jamal Ahmed Alaqailai"
"en_name": "Eman Jamal Ahmed al-Aqailai"
},
{
"id": "804797231",
Expand Down Expand Up @@ -53592,7 +53592,7 @@
"age": 32,
"sex": "m",
"source": "h",
"en_name": "Jehad Omar Abdalltaif Jrghon"
"en_name": "Jehad Omar Abdalltaif Jarghoun"
},
{
"id": "803843960",
Expand Down Expand Up @@ -53700,7 +53700,7 @@
"age": 31,
"sex": "m",
"source": "c",
"en_name": "Khaled Muhammad Abdal-majid Alnadi"
"en_name": "Khaled Muhammad Abdal-majid al-Nadi"
},
{
"id": "803830348",
Expand Down Expand Up @@ -54123,7 +54123,7 @@
"age": 31,
"sex": "m",
"source": "h",
"en_name": "Wissam Ahmed Abdullah Alnadi"
"en_name": "Wissam Ahmed Abdullah al-Nadi"
},
{
"id": "803775949",
Expand Down Expand Up @@ -64698,7 +64698,7 @@
"age": 35,
"sex": "m",
"source": "h",
"en_name": "Alaaa Nasr Nadi Jrghon"
"en_name": "Alaaa Nasr Nadi Jarghoun"
},
{
"id": "802369769",
Expand Down Expand Up @@ -74985,7 +74985,7 @@
"age": 37,
"sex": "f",
"source": "h",
"en_name": "Abi Zahi Saeed Jrghon"
"en_name": "Abi Zahi Saeed Jarghoun"
},
{
"id": "800686503",
Expand All @@ -75012,7 +75012,7 @@
"age": 37,
"sex": "m",
"source": "h",
"en_name": "Ismail Ibrahem Ayesh Jrghon"
"en_name": "Ismail Ibrahem Ayesh Jarghoun"
},
{
"id": "800683500",
Expand Down Expand Up @@ -81897,7 +81897,7 @@
"age": 2,
"sex": "f",
"source": "h",
"en_name": "Sham Muhammad Jehad Jrghon"
"en_name": "Sham Muhammad Jehad Jarghoun"
},
{
"id": "445813322",
Expand Down Expand Up @@ -86991,7 +86991,7 @@
"age": 2,
"sex": "f",
"source": "h",
"en_name": "Tia Mahmoud Hassan Jrghon"
"en_name": "Tia Mahmoud Hassan Jarghoun"
},
{
"id": "444815617",
Expand Down Expand Up @@ -87459,7 +87459,7 @@
"age": 1,
"sex": "m",
"source": "h",
"en_name": "Nasr Alaaa Nasr Jrghon"
"en_name": "Nasr Alaaa Nasr Jarghoun"
},
{
"id": "444646855",
Expand Down Expand Up @@ -91581,7 +91581,7 @@
"age": 4,
"sex": "m",
"source": "h",
"en_name": "Nooral-deen Hamadah Ahmed Jrghon"
"en_name": "Nooral-deen Hamadah Ahmed Jarghoun"
},
{
"id": "442998605",
Expand Down Expand Up @@ -91725,7 +91725,7 @@
"age": 3,
"sex": "m",
"source": "h",
"en_name": "Jehad Muhammad Jehad Jrghon"
"en_name": "Jehad Muhammad Jehad Jarghoun"
},
{
"id": "442972303",
Expand Down Expand Up @@ -93327,7 +93327,7 @@
"age": 4,
"sex": "m",
"source": "h",
"en_name": "Hamzah Alaaa Nasr Jrghon"
"en_name": "Hamzah Alaaa Nasr Jarghoun"
},
{
"id": "442335022",
Expand Down Expand Up @@ -94902,7 +94902,7 @@
"age": 5,
"sex": "f",
"source": "h",
"en_name": "Riama Muhammad Jehad Jrghon"
"en_name": "Riama Muhammad Jehad Jarghoun"
},
{
"id": "441220605",
Expand Down Expand Up @@ -100257,7 +100257,7 @@
"age": 20,
"sex": "f",
"source": "h",
"en_name": "Ruba Abdullah Muhammad Jrghon"
"en_name": "Ruba Abdullah Muhammad Jarghoun"
},
{
"id": "44079844",
Expand Down Expand Up @@ -101472,7 +101472,7 @@
"age": 6,
"sex": "m",
"source": "h",
"en_name": "Omar Muhammad Omar Jrghon"
"en_name": "Omar Muhammad Omar Jarghoun"
},
{
"id": "44072555",
Expand Down Expand Up @@ -102948,7 +102948,7 @@
"age": 6,
"sex": "m",
"source": "h",
"en_name": "Baraa Alaaa Nasr Jrghon"
"en_name": "Baraa Alaaa Nasr Jarghoun"
},
{
"id": "440554947",
Expand Down Expand Up @@ -106593,7 +106593,7 @@
"age": 7,
"sex": "m",
"source": "h",
"en_name": "Bilal Mahmoud Hassan Jrghon"
"en_name": "Bilal Mahmoud Hassan Jarghoun"
},
{
"id": "438395964",
Expand Down Expand Up @@ -110391,7 +110391,7 @@
"age": 7,
"sex": "f",
"source": "h",
"en_name": "Ayat Alaaa Nasr Jrghon"
"en_name": "Ayat Alaaa Nasr Jarghoun"
},
{
"id": "437081367",
Expand Down Expand Up @@ -114693,7 +114693,7 @@
"age": 9,
"sex": "m",
"source": "h",
"en_name": "Yazin Arafat Khalil Jrghon"
"en_name": "Yazin Arafat Khalil Jarghoun"
},
{
"id": "435223458",
Expand Down Expand Up @@ -119166,7 +119166,7 @@
"age": 11,
"sex": "f",
"source": "h",
"en_name": "Nour Hamadah Ahmed Jrghon"
"en_name": "Nour Hamadah Ahmed Jarghoun"
},
{
"id": "433745379",
Expand Down Expand Up @@ -142053,7 +142053,7 @@
"age": 18,
"sex": "m",
"source": "h",
"en_name": "Osama Ibrahem Ayesh Jrghon"
"en_name": "Osama Ibrahem Ayesh Jarghoun"
},
{
"id": "422592006",
Expand Down Expand Up @@ -157857,7 +157857,7 @@
"age": 22,
"sex": "m",
"source": "h",
"en_name": "Muhammad Arafat Khalil Jrghon"
"en_name": "Muhammad Arafat Khalil Jarghoun"
},
{
"id": "407954254",
Expand Down Expand Up @@ -169251,7 +169251,7 @@
"age": 26,
"sex": "f",
"source": "h",
"en_name": "Diana Arafat Khalil Jrghon"
"en_name": "Diana Arafat Khalil Jarghoun"
},
{
"id": "403790108",
Expand Down Expand Up @@ -169494,7 +169494,7 @@
"age": 26,
"sex": "m",
"source": "h",
"en_name": "Ismail Naiam Ismail Alnadi"
"en_name": "Ismail Naiam Ismail al-Nadi"
},
{
"id": "403761745",
Expand Down Expand Up @@ -171042,7 +171042,7 @@
"age": 26,
"sex": "m",
"source": "h",
"en_name": "Muhammad Rafiq Mahmoud Jrghon"
"en_name": "Muhammad Rafiq Mahmoud Jarghoun"
},
{
"id": "403248479",
Expand Down Expand Up @@ -173328,7 +173328,7 @@
"age": 27,
"sex": "f",
"source": "h",
"en_name": "Aml Muhammad Ismail Alnadi"
"en_name": "Aml Muhammad Ismail al-Nadi"
},
{
"id": "402495550",
Expand Down Expand Up @@ -177711,7 +177711,7 @@
"age": 29,
"sex": "m",
"source": "h",
"en_name": "Muhammad Sama Abdullah Jrghon"
"en_name": "Muhammad Sama Abdullah Jarghoun"
},
{
"id": "400835054",
Expand Down Expand Up @@ -180546,7 +180546,7 @@
"age": 29,
"sex": "m",
"source": "h",
"en_name": "Khaled Muhammad Ismail Alnadi"
"en_name": "Khaled Muhammad Ismail al-Nadi"
},
{
"id": "400235677",
Expand Down Expand Up @@ -182247,7 +182247,7 @@
"age": 20,
"sex": "m",
"source": "h",
"en_name": "Ibrahem Ismail Ibrahem Jrghon"
"en_name": "Ibrahem Ismail Ibrahem Jarghoun"
},
{
"id": "305452",
Expand Down
2 changes: 1 addition & 1 deletion killed-in-gaza.min.json

Large diffs are not rendered by default.

3 changes: 2 additions & 1 deletion package.json
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,13 @@
"gen-daily": "bun run gen-daily-v2 && bun run gen-wbdaily",
"gen-wbdaily": "bun run scripts/data/v2/west-bank-daily.ts",
"gen-killed": "bun run scripts/data/v2/killed-in-gaza.ts",
"gen-killed-press": "bun run scripts/data/v2/press-killed-in-gaza.ts",
"gen-killed-derived": "bun run scripts/data/v2/derived/killed-names.ts && bun run scripts/data/v2/derived/killed-indices.ts",
"gen-killed-child-names": "bun run scripts/data/v2/derived/killed-child-name-counts.ts",
"gen-derived": "bun run gen-summaries && bun run gen-csv && bun run gen-killed-derived",
"gen-summaries": "bun run scripts/data/v3/summary.ts && bun run scripts/data/v2/summary.ts && bun run scripts/data/v1/summary.ts",
"gen-csv": "bun run scripts/data/v2/derived/csv.ts",
"gen-all": "bun run gen-daily && bun run gen-killed && bun run gen-derived",
"gen-all": "bun run gen-daily && bun run gen-killed && bun run gen-killed-press && bun run gen-derived",
"chart-viz": "bun run site/src/components/HomeDailyChart/generator/chart-generator.ts",
"chart-viz-dev": "bun --watch site/src/components/HomeDailyChart/generator/chart-generator.ts",
"flightcheck": "bun run types && bun run reset-manifest && bun run gen-all && bun run docs-build && bun run docs-serve",
Expand Down
Loading

0 comments on commit 956b7cd

Please sign in to comment.