TODO: Data Review Update

[sebastiandig]

Hi @7yl4r,

Take a look over this and we should talk about getting this moved along.

Here is a summary of the Data Review as suggested by Abby.
I have updated examples of data here.

Summary:

First Entry

• There should be no overlap between fields in the event table and fields in the occurrence table
• drop catologNumber - label on vials that are stored
  • Might do in the future because we will still have stored samples in ethanol
• drop basisOfRecord, recordedBy, and recordedByID from event, only for occurence
• drop parentEventID
  • unless you will have information that will only be included at the parent
    level and not repeated in the child events .
  • Both of these Abbey can add, will need to check if we need catalogNumber
• NEED institutionCode when doing PreservedSpecimen, using "USF"
• NEED a collectionCode
  • Abby B. can do this
• datasetName include zoo, location, mesh?
  • something unqiue to other FL MBON
  • as of April 17, 2023:
    • "MBON/USF-IMaRS Florida Keys National Marine Sanctuary Zooplankton Net Tows"
• suggest dropping informationWithheld
• drop eventDateTime and eventTime
• rename eventDateTime to eventDate
• eventDate is in UTC, add "Z" to the end
• yes, the naming is an issue because some taxa can only be identified to a certain level that may be shared between two or more
  • ex. Veliger Larvae can only be identified to Bivalvia and Bivalve larvae is also Bivalvia, so when creating occurrenceID, they would be the same.
  • fixed by using verbatimName instead of aphiaID
• drop taxonID
• drop individualCount in occurence, but keep in MoF?
  • resolved by adding aliquots together, but didn't drop
• Any measurements or facts that are about the occurrences need to have occurrenceID added.
  • Abby: I think it's only "Abundance" and "Count" that would need to have occurrenceID added but if there are any others that relate specifically to the occurrence then you'll need to add it there too.
• drop measurementUnitID and keep in MoF
• drop establishmentMeans
• drop datasetID, eventDate and any other fields that are already in the event core.
• georeferenceVerificationStatus instead of georeferenceVerificationStatusProperty
• datasetID from the eMoF table

Update of Mar 21, 2023

• change recordedBy to identifiedBy and recordedByID to identifiedByID
• add eventID in MoF when there is an occurenceID
• continue fixing measurementType
• add organismQuantity and organismQuantityType to "occurence"
• remove individualCount and move to "MoF"
  • changed individualCount to organismquantity and include quantitytype as "summation of aliquots"
  • TODO: ask to remove entirely

[sebastiandig]

edited with @7yl4r

[sebastiandig]

add update