Pre Release Testing Script

The following items should be manually tested in the application before a release to fluxnotes.org is made. Verify each endpoint works and do the remainder of the testing on /pilot1.

After testing, any issues found should be make into Jira items. Review with team to determine priority and if any items will impact a release.

This document can evolve over time as features are changed and added.

Before testing

• Check that new features added in the current sprint are included as items in this script.

Local storage

• At the start of testing, clear local storage and reload the application. Later steps will test that preferences are saved and reloaded correctly.

Scripts

• Ensure the script to update all dates on the hardcoded JSON files runs correctly (NOTE: Recent Encounter will only appear in app before 4:00pm)
  • yarn patient-date-update src/dataaccess/BreastMainTreatmentDebraV09.json 32
  • yarn patient-date-update src/dataaccess/BreastMainTreatmentDiabetesHypertensionJaneV09.json 33
  • yarn patient-date-update src/dataaccess/BreastMainTreatmentTry3EllaV09.json 100
  • yarn patient-date-update src/dataaccess/GistAdjuvantIhanosV09.json 100

Application loads

• /demo1 loads and has a visit reason
• /demo2 loads and has a visit reason
• /pilot1 loads and has a visit reason
• /poc loads
• /mvp loads
• /ccp loads
• /ccp2 loads
• /pilot1np loads
• /launchcompass loads
  • Visit Moonshot Dev Server
  • Launch http://localhost:3000/launchcompass
  • At patient select, choose a McOde patient that isn't Marissa (She has > 1000 encounters and will take a long time to load)
  • N.B. If you run into problems find Dylan Hall or Rob Dingwell for troubleshooting

Targeted Data Panel

• Each section can be loaded
• Each section can toggle between their different visualizations (to ensure type of each visualization works)
  • Reload application and ensure all sections kept their preferred visualizer
  • Ensure numbers are in red in tabular views of vitals and labs based on points that are in red on graphs
• Timeline loads correctly and can pan/zoom in time.
  • Timeline pans correctly on IE, without losing view of medication names .
• Filters can be applied to sections (Timeline - filter Over the Counter Meds)
  • Reload application and ensure filter preferences are used
• Clicking the minimap scrolls to the correct location in TDP
• Minimap can be edited and sections can be added and removed.
  • The TDP reloads all sections correctly when done editing.
  • Searching for results in sections that are removed are not found.
• Open Source Note for disease status value in Condition Summary section
• View source for the condition in Condition Summary section
• View source attachment for Pathology Report

Note Editing

Click "New Note" and confirm the following regarding templates:

• Blank note is an available option
• Searching in the template search filters down the available templates
• Hovering the template options changes color of option and turns mouse pointer into a clicker
• Hovering the eye-icon, preview button changes the color and turns mouse pointer into a clicker
• Clicking the preview button opens the template-preview viewer
  • Preview content makes sense
  • Esc closes the preview
  • Clicking the X in upper-right closes the preview
  • Clicking "Choose template" does just that

Create a new note and do the following:

• Insert follow up template
  • Confirm the insertion of two incompletes - @condition and @onocohist
  • Clicking @condition opens a completion portal
  • Selecting Gist via-clicking completes @oncohist
  • Focus the cursor in the middle of a line in the ONCOHIST section. Type some text and confirm that the text shows up as regular black text
  • Focus the cursor at the end of a line in the ONCOHIST section. Hit enter and type some text and confirm that the newline and text are inserted properly.
  • Close and re-open the note. Confirm that the typed content remains in the note.
• Insert @recent labs
  • Click in the context tray to insert
• Insert @vitals
  • Autocomplete typing to insert
• Insert #disease status
  • Autocomplete typing to insert
• Insert #progressing
  • Type "#pro"; Choose from the context portal by clicking
• Insert #enrollment
  • Type # and no other characters; choose from the context portal by clicking
• Insert #imaging
  • Choose from the context portal by using the arrow keys and enter key
• Insert #as of #date and choose the date from the calendar
• Confirm TDP updates with new disease status value in summary with dashed line, line chart has new point plotted, and timeline has new event.
• Insert "experiencing #toxicity fatigue" (NOTE: test without using the hashtag)
• Insert #stop medication @active medication and choose a medication from the dropdown. Confirm updates in TDP.
• Insert a placeholder. Switch to Point of Care and fill in placeholders. Confirm selections are added to note and reflected in TDP.
• Confirm breadcrumbs updated to reflect all shortcuts used.
• Hit enter to create a new paragraph. Ensure breadcrumbs are updated.
• Insert the condition from the Summary section in TDP.
• Copy "experiencing #toxicity fatigue" from the note and paste it back into the note.
• Insert #nlptoxicity nausea grade 1. Confirm NLP engine updates phrases. *
• Change the note name *
• Check that bold and unordered lists work in the editor
  • Check that underline, italics, and ordered lists work *
• Sign the note. Confirm new data has solid underline.
• Open the source note from the new disease status value.
• Open the source note from the new stopped medication value.
• Open the source note from the new disease status icon on the timeline.
• Open a signed note and ensure it cannot be edited.

Create a second note and do the following:

• Insert cancer condition, insert #disease status #stable. Also insert #staging M1.
• Delete all staging information. Ensure TDP updates to remove new staging data.
• Insert same list of previous shortcuts, and delete all of them at once successfully.
• Use the Close button to close the note. Then reopen the note to ensure data reloads correctly.
• Delete the note. Ensure TDP updates to remove new disease status data.

Create a third note and do the following (shortcut guidance features):

• Insert #disease status and expand
  • disease status should be incomplete before you expand
  • Note: You will need to autocomplete disease status since no condition is added yet
• Click on #status and ensure status options open. Without choosing an option or clicking to close the portal, click on #reason and ensure the right portals close and open.
• Check sign note button is disabled
• Fill out missing disease status values
  • Ensure status, reason, date all display as complete
• Add cancer condition before the disease status
  • Ensure #disease status is marked as complete
  • Ensure disease status values are displayed in the TDP in Condition Summary, Disease Status Graph, and Timeline
• Check sign note button is enabled again
• Remove the cancer condition
  • Ensure disease status is marked as incomplete
  • Ensure values in TDP are removed
• Add back the cancer condition. Then select all and delete all shortcuts. Ensure they can all be deleted and TDP values are reset.
• Add cancer condition, #disease status and expand
  • Move cursor to right before disease status and ensure that expand option is not available
• Add #as of
  • Check that it is marked as incomplete
• Expand #as of
  • Ensure that date has the default value of today in the editor and in the TDP
  • Check that expand option is not available for #as of once the date is there

Search

• Search for the following phrases and ensure that TDP and clinical notes scroll and highlight
  • Search for 'complete'
  • Search for 'section'
  • Search for 'ibuprofen'
  • Search for 'remission'
  • Search for 'status'
• Search for plain text in an open note
• Search for structured data in an open note

Condition selection

• Changing condition selection to Fracture updates TDP. Can change back to cancer condition.

Commands

• Run the following commands and confirm updates to note, TDP, and scrolling:
  • Insert GIST Condition
  • Insert toxicity placeholder by typing
  • Insert disease status placeholder by choosing from note assistant.
  • Switch to Point of Care mode.
  • flux_command('insert-structured-phrase', {phrase:'toxicity', fields: [{name:'adverseEvent', value: 'nausea'}, {name:'grade', value: 'grade 2'}]})
  • flux_command('insert-structured-phrase', {phrase:'toxicity', fields: [{name:'adverseEvent', value: 'fatigue'}, {name:'grade', value: 'grade 2'}]})
  • flux_command('insert-structured-phrase', {phrase:'disease status', fields: [{name:'status', value: 'Stable'}, {name:'reasons', value: ['Physical exam', 'Symptoms']}]})
  • flux_command('navigate_targeted_data_panel', {section:'Summary', subsection:'Most Recent Visit'})

Compass Treatment Options

• Filter buttons work for similar patients selection
  • Select all selects every filter
  • Unselect all deselects every filter
  • Clicking on the age filter selects that filter
    • Selected treatments lose some patients when the filter is selected
  • Clicking on a topic header (e.g. demographic) selects all filters of that topic
    • Selecting all demographic filters reduces the patient count for the treatments
  • Clicking on the topic header again unselects all filters of that topic if they are all selected
• Table loads data
  • A list of similar patient treatments and combinations of treatments populate in the first column
  • Number of patients with the corresponding treatment or treatment combination populates in the second column, initially sorted from most to least
  • Overall survival rates of 1 yr, 3 yr, and 5 yr populate with bar charts showing percentage
  • Side effects initially filtered by Most Common appear in the last column
  • The table legend appears at the bottom of the table showing survived with treatment and all deaths
• Verify sorting buttons in table work
  • Clicking on the user icon sorts the rows by number of patients
  • Clicking on 1 yr, 3 yr, and 5 yr headers sorts each row by survival rate for that column
  • Clicking on a header twice reverses sort order, and a third time brings it back to normal
• Clicking the side effects dropdown produces a list of options
  • Selecting fatigue changes the side effect column for the treatments to a single percentage value
  • Selecting Most Common shows two side effects with their name and percentage value listed
• Selecting a treatment works
  • Clicking on the compare icon for chemotherapy will move its column to the top
    • The first row should be visually distinct from the rest of the rows
    • The remaining columns should have survival bar charts which compare to the first row
    • The legend should include items for an increase and decrease in survival due to treatment
    • Sorting should work on all rows except the first row
• Deselecting the selected chemotherapy treatment should revert everything to its initial state
• Icons view works
  • Clicking icons button switches from table view to icons view
    • Surgery should be displayed as default if no treatment is selected
    • Switching to icons view with no treatments (when similar patient count is 0) shows "No data. Choose a different selection or similar patients criteria."
  • Selecting chemotherapy will move it to the top row and display it
    • The Overall Survival column of all other treatments will change to reflect number of additional (+) or less (-) patients survived for the selected timescale
      • (+) will be green
      • (-) will be red
      • 0 will be black
    • With chemotherapy selected, clicking on other treatment rows (not the compare icon) will display the icons chart for that treatment
      • Clicking on a treatment that has a positive overall survival number will show that number of green outline circles and reference it in the text (green)
      • Clicking on a treatment that has a zero or negative overall survival number will reference it in the text (red for negative, black for zero)
  • Changing patient props to reduce the patient cohort will remove the selected treatment if it is no longer in the data and display the defaulted top treatment instead
  • Deselecting the treatment will revert everything to its initial state
  • Selecting radiation therapy for treatment renders the corresponding bubble grid
    • Survival should match percentage in the corresponding table bar chart for that timescale
  • Clicking 1 yr, 3 yr, and 5 yr buttons changes the data in the view
    • The numerator of the text on the right (deaths) matches the number of solid gray bubbles
  • Can toggle between additional treatments to see changes
    • Clicking on a treatment option changes the number of bubbles grayed in
  • Deselecting a treatment row (not the compare icon) will no display a chart and instead show "No treatment selected."

View

• Ensure iPad Pro view looks good

* Items that are not strictly required, but are features in the app and should be working.