Merge feature/enslavers into main (#146)
* Started work on enslaver importation script.
Modifying enslaver models to use enumeration tables for role, relation type.
Removed AfricanNames from solr index (part of the legacy clean-up effort - issue 79).
* Initial working version of enslaver importation script.
(Based on Google Sheets data).
* Adding EnslaverVoyageConnection entries on Enslaver import script.
* New feature to map network graph tool.
It is now possible to load the flows corresponding to a saved search in either Trans or IAm voyages.
* Initial implementation of Enslaver search functionality.
* Changing Enslaver models (Place fks) and removing unused model.
* Extending EnslaverSearch to include voyage related fields, sorting etc.
* Adding nested voyage data to Enslaver search results.
MultiValueHelper now applies a "distinct" modifier to fields to avoid duplicates.
* Adding Ship Name filter on Oceans of Kinfolk dataset.
* Adding back js files needed for TinyMCE editor initialization.
* TranslatedTextField now defaults to not applying unidecode.
This change allows accented characters to be indexed by Solr in translated fields.
* Adding an automation tool to match geo coordinages with voyage Regions.
* Improving scripts to handle Place matching automation.
* Adding structured enslavement relations to the output of the Enslaver search API.
* Fixing a couple of bugs on EnslaverSearch.
* change MySQL package Version
* Adding v0 of enslavers database page.
* Adding name search on enslavers database page
* Fixing voyages list show after search. Toggling "+" button to "-" when openning voyages list.
* Adding source bulk importation with validation.
* blog system
* blog system
* blog system
* Blog pagination
* Fix estimates query save py3 issue: sha1 hash needs encoded bytes.
* Blog improvements: tags and thumbnail.
* Blog improvements: tags and thumbnail.
* Enslaver import now supports argument for start pk value.
* Centering voyages button on enslavers datatables. Aligning right enslavers columns with numbers. Changing column header names. Adding popup on voyages list to show full details. Adding Voyage Year on voyages list. Closing opened child rows before opening another. Aligning right voyages list table. Adding blog link on top menu.
* Blog improvements: tags and thumbnail.
* Merging Rice's feature/enslavers into DotProduct/PLab feature branch.
* Adding itinerary and source filters on enslavers page.
* Changing enslaver importation to detect merged rows.
* Patches after analyzing http500's in prod logs.
* Enslaver cached properties model.
EnslaverSearch now supports sorting and filtering over cached properties (for now just enslaved_count).
Importation fix to allow identities with duplicate primary alias (e.g. John Adams).
* Adding more cached properties to Enslavers.
* Changing enslavers header color to match enslaved page. Adding Number of Captive filter and column ordering on enslavers page. Adding Role column to enslavers voyages table.
* Fixed importenslavercsv bug (alias was being imported even when the identity failed to causing an integrity error in db).
Added more cached properties to enslavers.
* spss codebook 2022 added
* Adding vessel outcome as default field for Enslaved search results.
* Enslaver importation now supports remapping of places and sources.
This will allow additional remapping CSVs to help "correct" the place names and source references in the imported CSV without requiring changes to those files.
* Adding vessel_fate to the EnslavedSearch.
* Adding "Vessel Fate" column and search on African Origins UI
* Adding vessel outcome as default field for Enslaved search results.
* blog - layout changes
* Adding vessel_fate to the EnslavedSearch.
* Adding "Vessel Fate" column and search on African Origins UI
* Feature flag implementation.
These utilities allow certain parts of the site to be hidden/disabled based on which flags are set in the localsettings.py configuration file.
* Blog: editor, image upload, image selection, colors, share icons, host images...
* Blog: thumbnail / layout bugfixes
* Blog: thumbnail / layout bugfixes
* Blog: thumbnail / layout bugfixes
* Blog: thumbnail / layout bugfixes
* Blog: thumbnail / layout bugfixes
* Blog: thumbnail / layout bugfixes
* Removing sort from alias column. Adding relations child table on enslavers. Number of Captives filter default "is at least"
* automatic blog posts translation
* Changing Blog Post translation approach.
Removed PostTranslation model.
Added language field to the post model.
The unique key is now the composite (slug, language code).
Post queries were adapted to use the request language code automatically.
The URLs for individual posts only need the slug, the right translation will be used based on the request language code.
* Updates settings.py for template debug
* BLOG: now cloning tags / authors. Author's page: listing only current language posts.
* BLOG: now cloning tags / authors. Author's page: listing only current language posts. Fixed image error in Institutions Listing.
* Backend updates to support searching and sorting over related voyage links.
* Blog: Created tags for author and institution profiles and changed author / institution pages. Fixed thumbnail problems.
* Blog - reusable carousel component.
* Blog - reusable carousel component.
* Blog - reusable carousel component.
* Blog - reusable carousel component - limit number of slides.
* Blog - small bugfixes.
* Blog - reusable carousel component - Added parameter to limit the number of slides.
* Blog - bugfixes / layout improvements
* Blog - added Author / Institution generic profiles.
* Blog / News: Add News Tag.
* Blog - Post Listing bugfixes
* Blog - Added Admin actions to change status of selected posts. This not auto-translate the posts.
* Blog / News - Added admin menu item (admin->posts) to convert existing news into blog format. Changed Post Title (unique = false). Minor bugfixes.
* News/Blog - redirecting existing news urls to new blog urls
* Blog - Consolidated all migrations into one single migration file. News - added a new News Frontpage.
* Blog - Consolidated all migrations into one single migration file. News - added a new News Frontpage.
* Minor fixes to enslavers importation script.
* News - menu fixes / feature flags
* Washington University Logos
* stacked washu logos
* Blog - layout changes. RSS Feed - languages. Frontpage / News - Using pagebreak to display post snippet. Admin / Post - added actions to translate selected posts. Other - Minor bug fixes / changes.
* Blog - Post Admin - Small bugfix.
* Frontpage / news - added 'Click to read more...' in the popover
* Blog / translation - minor changes.
* Carousel - added CAROUSEL_MAX_POSTS setting
* Carousel - small fix
* Carousel - change call to static images
* Adding Linked Voyages column and filter to Transatlantic and Intra-American databases
* Blog - changed 'Created On' to be editable.
* Blog - minor fixes.
* Adding a db integrity check script to catch invalid FKs.
Updated Dockerfile since the build was not successful due to not finding
some package versions of mysql, libmysqldev.
Updated the solr-thumbnail package version: the reason is that the older
version did not include the migration script to generate the appropriate
table in the db. This caused deployments from "scratch" to not include
the needed table. The updated version has the migration.
* Formatting linked voyages on column and voyage pop-up
* Minor improvements to the Enslaver importation script
and supporting automation scripts.
* Implementing cached voyage dataset values for Enslavers.
Enslavers search can now filter on a selection of voyage datasets.
* Adding a fuzzy match for place names in enslaver importation script.
Improved place bulk import to handle some errors found in the first batch.
* Changing some labels to SPSS variabels as translation keys. Creating "en" translation files and updating "es" and "pt" files, merging with old ones
* Changing default for ShowOnMap to True on bulk importation.
* Adding new fields to voyage model.
* Adding support for multi-valued Tries.
This can be of some help to handle some simple duplicates in the place csv remap in the enslaver importation.
* Adding new fields to Voyage CSV import (untested).
* Adding new fields in publication/export CSV.
Note: the editorial platform does not support the new fields yet. There is a lot of work that needs to be done for that to happen.
* Adding new fields to Solr schema and indexing.
Everything so far is untested as we do not have the data for it.
* Minor change: unique pair of columns for VoyageCargoConnection.
Since we use three types of cargo columns in the importation, I've added a constant to indicate how many we can import/export in CSV format.
* Initial support for AFRINFO in editorial platform.
* Adding support for Cargo in interim templates.
Publication code now includes the new variables (untested).
* Adding js to format cargo and afrinfo as badges
* Adding CARGO and AFRINFO to datatable columns. Adding CARGO, AFRINFO and COMMENTS to voyage popup details
* Improved display of AFRINFO and CARGO vars in contribute interim/summary.
* Adding blur to possibly offensive AFRINFO badges.
Improving js resiliency in new var code for contribution interim voyage pages.
* Removing CARGO/AFRINFO columns from TAST datatable. Removing sort from CARGO/AFRINFO from IAM datatable columns
* Some carousel tweaks
* Some carousel tweaks
* Fixing json formatting
* Setting default enslavers sort by descending Number of Captives
* Merging Full Name and Alias List columns on enslavers page.
* Fix enslaver roles on list
* Fixing a few bugs on PAST.
- enslaver UI should use a specific endpoint for enumerating places.
- adding new variable enumerations to LiveAdmin for editing.
- interim.html would crash the js code due to some elements not being present in a "new voyage" interim form.
* Removing column from default display o I-Am
* Adding cargo/african info ids to Solr schema so they can be searched.
* Fixing sorting by fuzzy Enslaver search ranking.
Enabling fuzzy search on two consecutive names for composite names.
E.g. "South Sea Company" can be matched with "sea company" and tolerate a few typos.
* Adding a possibly_offensive field to AfricanInfo.
The badges that contain these offensive labels will be blurred and on mouse hover will display a popup with customizable text via translation framework.
* Replicating possibly_offensive behavior to voyage popup.
* Adding CARGO and AFRINFO search options on IAM ui
* Adding Search Ranking column on enslavers fuzzy search
* Allowing Enslaver search on "neither" dataset.
* Fixing Enslaved search for voyage dataset.
* Adding dataset search on Enslavers page ui
* Resetting pagination after search changes without clearing all DataTable state.
This allow toggled columns to remain after search changes.
* Adding AFRINFO description text on filter. Fixing Search Ranking sort on pagination. Fixing pagination reset on filter.
* Enabling language group on African Origins table.
Adding two separate entries for the enslaved database in PAST menu.
* Fixing link to past enslaved contribute.
* washu logo & package updates
* essays error handling patch (attempt)
* Initial work on backend support for handling PAST (Origins) contributions.
* Adding endpoints for African Origins contribution backend API.
* Fixing issue in saved queries: test if query is of type "bytes".
* Enslaver importation script with more aggressive de-duping.
* Fixing missing route for Enslaver restored query.
* Fixing issue in modern name sorting in African Origins.
* Adding notes field to Enslaver.
Enslaver importation now attempts to merge "cells" to ensure as little data loss as possible.
Column header names updated in the importation script to follow the latest consolidated sheets.
* libxslt1-dev bump
* Adding modern country to Enslaved/contrib.
Starting work on the Enslaver editorial backend.
* Display buttons on Enslavers page to view and reset filters.
* Lots of small UI improvements.
- Changed some labels and textual descriptions.
- Changing PAST menu.
- Adding enslavers/understanding db url.
* Adding an API to initalize an enslaver contribution.
* Improved performance for Enslaver search.
The MySQL query planner was choking on the ORM generated queries for enslaver searches. We are addressing this issue by taking more control over the query generation.
* Applying search query perf improvements to EnslavedSearch.
* Fixing page length in all the DataTables.
* bump ubuntu mysql version
* Fixing a double counting issue in Enslaved count by Enslaver in cached property update.
Co-authored-by: Domingos <[email protected]>
Co-authored-by: Leonardo Barros <[email protected]>
Co-authored-by: wagnerps <[email protected]>
Co-authored-by: Derek Keller <[email protected]>
Co-authored-by: jcm10+1-at-391170303014 <[email protected]>
