Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ce ubuntu18 upgrade #192

Open
wants to merge 190 commits into
base: ce
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
190 commits
Select commit Hold shift + click to select a range
e247d58
update schema and create test data for award and experiment
mingjiecn Mar 10, 2021
bf63e3e
updated biofile
mingjiecn Mar 10, 2021
c9453d8
link biospecimen with experiment through biofile
mingjiecn Mar 10, 2021
0c457ad
embed biofile in biospecimen
mingjiecn Mar 10, 2021
eb2195f
enmed biofile in patient, add file path in biofile
mingjiecn Mar 10, 2021
350efc2
move award from dataset to biofile
mingjiecn Mar 10, 2021
b1eb5d5
add award in biofile test data
mingjiecn Mar 10, 2021
82af671
embed biofile.award
mingjiecn Mar 10, 2021
e87c3ef
update bioexperiment.js
mingjiecn Mar 10, 2021
a190bb4
update test data for genomics
mingjiecn Mar 10, 2021
b71a4b8
remove document in biospecimen
mingjiecn Mar 10, 2021
08e2806
clean up
mingjiecn Mar 11, 2021
ed2fc74
add more test data
mingjiecn Mar 11, 2021
68ad234
fix test data
mingjiecn Mar 11, 2021
a5f8625
update UI for biospecimen
mingjiecn Mar 11, 2021
b917543
fix test data
mingjiecn Mar 12, 2021
d6526ab
update facet and column for bioexperiment
mingjiecn Mar 12, 2021
2946133
embed biofile.award for biospecimen
mingjiecn Mar 12, 2021
26aa21f
add facets
mingjiecn Mar 12, 2021
5cbb9f0
shown project list in experiment
mingjiecn Mar 12, 2021
462a7ee
update assay term enum and project enum
mingjiecn Mar 12, 2021
88941f0
update genomicsTable
mingjiecn Mar 12, 2021
bc93e9e
First pass at reorder of filters. Close #387.
vsmalladi Mar 12, 2021
34f8aa5
Refort surgery to pathreport for better linkage.
vsmalladi Mar 15, 2021
0516f85
Fix links.
vsmalladi Mar 15, 2021
195a144
Update mapping for biospecimen to surgery pathology report.
vsmalladi Mar 16, 2021
1f743ca
fix issue #392
mingjiecn Mar 16, 2021
a13ee5f
add period
mingjiecn Mar 16, 2021
c45a716
change patient limit to <= 10
mingjiecn Mar 16, 2021
73f6ac6
Merge pull request #396 from utsw-bicf/392-minimum
vsmalladi Mar 16, 2021
eb4166c
Change syntax.
vsmalladi Mar 18, 2021
9ae6a57
Fix mapping.
vsmalladi Mar 18, 2021
ec5a0ad
Fix mapping to surgery procedure.
vsmalladi Mar 18, 2021
94c44a8
Fix calc field.
vsmalladi Mar 18, 2021
3037fe7
update calculated fields
mingjiecn Mar 22, 2021
a0d29d1
Fix calculated fields.
vsmalladi Mar 22, 2021
7b0a1d4
Fix merge.
vsmalladi Mar 22, 2021
6e80919
Fix merge.
vsmalladi Mar 22, 2021
3f57ad6
update patientPathTable.js
mingjiecn Mar 23, 2021
d8f6f0b
update surgery.js
mingjiecn Mar 23, 2021
b895e1d
fix surgery search view
mingjiecn Mar 23, 2021
81fadd1
update path report ui in biospecimen.js
mingjiecn Mar 24, 2021
5f6187b
Remove status.
vsmalladi Mar 24, 2021
66f86a9
Updagte change log.
vsmalladi Mar 24, 2021
4cd8197
Merge branch 'kce' into 333-surgical_reformat
vsmalladi Mar 24, 2021
0b3c5f7
revert back summary.js.
vsmalladi Mar 24, 2021
0b5f08e
Update the display to remove NOS for site.
vsmalladi Mar 24, 2021
9c928b2
Update filters
vsmalladi Mar 24, 2021
f276283
add status back to columns in surgery
mingjiecn Mar 25, 2021
07aaa84
Merge pull request #394 from utsw-bicf/333-surgical_reformat
vsmalladi Mar 25, 2021
3ba2fac
Merge KCE.
vsmalladi Mar 25, 2021
5824a9c
Fix summary display.
vsmalladi Mar 26, 2021
33dea83
Merge pull request #400 from utsw-bicf/399-specimen_site
vsmalladi Mar 26, 2021
ea4441a
add new consent schema and test data for loading real data
SenseCode Apr 1, 2021
52a59f8
add scanned copy as required field
SenseCode Apr 1, 2021
db1d330
add sugery info in biospecimen table
mingjiecn Apr 1, 2021
f7345e3
change status, add facets and columns, edit description
SenseCode Apr 1, 2021
2fc5da8
update consent schemas according to real data
SenseCode Apr 9, 2021
25364c4
edit status.js and test patient status
SenseCode Apr 12, 2021
dd09576
testing branch
SenseCode Apr 19, 2021
7bdea9f
test to add a calculated field
SenseCode Apr 19, 2021
0dfadd8
recovered genomic_released
SenseCode May 3, 2021
f7a457e
embed patient failed through embed from path. Need help the embed way
SenseCode May 4, 2021
d723a0e
switch branch
SenseCode May 4, 2021
0ceaed3
Test consent.
vsmalladi May 5, 2021
acbcbde
hide the genomic table in biospecimen page
SenseCode May 6, 2021
a09cf47
edit patient genomic_release
SenseCode May 11, 2021
61aac56
remove patient genomice_release
SenseCode May 11, 2021
6d55eb7
test and consent_list are none, need to try embed from other ways
SenseCode May 11, 2021
d3b7d0c
add filegallary in bioexperiment
SenseCode May 12, 2021
cd14744
clean codes
SenseCode May 12, 2021
1b4c2c8
Merge pull request #403 from utsw-bicf/381-specimen_table
vsmalladi May 12, 2021
7c204f7
add bioexperiment genomic_release field
SenseCode May 12, 2021
15f9fb4
add genomic_release status in facet.
SenseCode May 12, 2021
c9c1d0e
hide filegallary accordding to genomic_release status
SenseCode May 12, 2021
8486c7d
add tooltips and dictionary for tumor stage
SenseCode May 12, 2021
7982b3f
edit tooltips and dictionary with at presentation
SenseCode May 12, 2021
a14e56f
add pN2
SenseCode May 12, 2021
bae0bff
remove pT0, pM0
SenseCode May 13, 2021
f10270e
Merge branch 'kce' into 371-tumorstage_tooltips
vsmalladi May 13, 2021
b63bb6b
Merge pull request #402 from utsw-bicf/391-consent
vsmalladi May 13, 2021
64c5daf
Update some of the verbage.
vsmalladi May 13, 2021
27fbe63
Merge branch 'kce' into 371-tumorstage_tooltips
vsmalladi May 13, 2021
e14c2a7
Merge pull request #405 from utsw-bicf/371-tumorstage_tooltips
vsmalladi May 13, 2021
1d7a0ae
Resolve conflicts.
vsmalladi May 13, 2021
04b4429
Remove venv.
vsmalladi May 13, 2021
be493f4
Fix embedding logic.
vsmalladi May 14, 2021
1141ed9
add restriction in status, test work, update biofile status with geno…
SenseCode May 14, 2021
f1f5864
edit biofile insert for test revoked biospecimen
SenseCode May 14, 2021
b4bb8da
cleaning codes
SenseCode May 14, 2021
67a1c9e
fix bioexperiment page cannot show
SenseCode May 14, 2021
6e900e6
remove genomic_release in biofile, edit biofile inserts with restricted
SenseCode May 18, 2021
6429bcd
remove genomice_release
SenseCode May 18, 2021
54688ff
remove biofile genome_release, edit biofile inserts
SenseCode May 18, 2021
1e8a036
fix merge
SenseCode May 18, 2021
aaadfde
edit insert data
SenseCode May 18, 2021
2c64e7d
fix biodataset
SenseCode May 19, 2021
c2db79d
Merge pull request #404 from utsw-bicf/consent_genomic
vsmalladi May 19, 2021
ec102a8
Merge.
vsmalladi May 19, 2021
3ee6b69
Update the logig of consent.
vsmalladi May 19, 2021
12b4828
Fix issues raised in review.
vsmalladi May 19, 2021
8344b78
Fix supportive meds.
vsmalladi May 20, 2021
cd49c87
Merge pull request #393 from utsw-bicf/387-patient_filters
vsmalladi May 20, 2021
a1b33e3
modify dominant tumor
mingjiecn May 20, 2021
e48bdc8
fix bug
mingjiecn May 20, 2021
71dd5d4
Fix typo.
vsmalladi May 20, 2021
fce91e3
Update page order and add in medication.
vsmalladi May 20, 2021
9ecc734
fix audit UnboundLocalError
mingjiecn May 21, 2021
7f79a6a
Update surgical mangement.
vsmalladi May 21, 2021
bc323d1
Merge pull request #409 from utsw-bicf/383-audit_error
vsmalladi May 21, 2021
9dba2aa
Merge pull request #408 from utsw-bicf/374-report_bug
vsmalladi May 21, 2021
7970b22
fix bioreplicate and biolibrary, biofile in bioexperiment link, still…
SenseCode May 21, 2021
ba02222
fix filegallary
SenseCode May 21, 2021
d55777e
Fix title.
vsmalladi May 22, 2021
7a28ecf
Update surgical pathology serach with suggestions.
vsmalladi May 22, 2021
61103fd
Add unknown.
vsmalladi May 24, 2021
3480f5f
Add in FNA in mets biopsy.
vsmalladi May 24, 2021
403c551
Update logic.
vsmalladi May 24, 2021
521df0d
Add a diagnosis procedure that duplicates nephrectomy.
vsmalladi May 25, 2021
f4959e8
Fix variable name.
vsmalladi May 25, 2021
da7c4c3
Add not available
vsmalladi May 25, 2021
ce8ed7e
Add back procedure in columns.
vsmalladi May 25, 2021
0dc50ae
update diagnosis date
mingjiecn May 27, 2021
edc5eb1
fix y-axis
SenseCode May 27, 2021
8b92e89
Merge pull request #410 from utsw-bicf/406-filegallary_fix
vsmalladi May 28, 2021
10299ff
Remove duplicate medication.
vsmalladi May 28, 2021
03961df
Update some patient display.
vsmalladi May 28, 2021
98ad152
Merge branch 'kce' into 388-surgery-filters
vsmalladi May 28, 2021
16aea81
Update view on surgery page.
vsmalladi May 28, 2021
dbb3645
Merge pull request #411 from utsw-bicf/388-surgery-filters
vsmalladi May 28, 2021
ad562c2
Add authentication to utsouthwestern microsoft.
vsmalladi May 28, 2021
2efcb07
remove >, fix cannot log in
SenseCode Jun 1, 2021
0e7194e
Update labs.
vsmalladi Jun 8, 2021
5b72265
Fix email.
vsmalladi Jun 8, 2021
c34608d
Fix the redirect issue.
vsmalladi Jun 9, 2021
913d284
Merge pull request #412 from utsw-bicf/19-utsw_login
vsmalladi Jun 9, 2021
720919b
Add in logic for medication.
vsmalladi Jun 9, 2021
2d36c67
Add test data.
vsmalladi Jun 9, 2021
73afc2e
update status for data protection
mingjiecn Jun 9, 2021
1566cb8
fix publication
mingjiecn Jun 10, 2021
43e0a45
Fix logic.
vsmalladi Jun 10, 2021
5245d31
fix summary
mingjiecn Jun 10, 2021
594081d
update barchart
mingjiecn Jun 10, 2021
320d273
Merge branch '413-genomics_count' of https://github.com/utsw-bicf/pan…
mingjiecn Jun 10, 2021
b35d107
update barchart label and text
mingjiecn Jun 10, 2021
04e0bbe
Provde greater security and control. Also add in language to protect …
vsmalladi Jun 11, 2021
0981068
Try to protect all item pages.
vsmalladi Jun 11, 2021
1c81e24
add tickangle for yaxis
mingjiecn Jun 21, 2021
0ec15d0
adjust chart setting
mingjiecn Jun 22, 2021
3f3d305
Merge pull request #414 from utsw-bicf/361-experimental_meds
vsmalladi Jun 22, 2021
71cd3df
resolve merge conlfict on patients.
vsmalladi Jun 22, 2021
ecb2c30
Merge pull request #415 from utsw-bicf/413-genomics_count
vsmalladi Jul 8, 2021
78da78f
add ivp_a1v3 version, edit patient files
SenseCode Sep 7, 2021
a1666cc
remove related kce class
SenseCode Sep 7, 2021
c585e98
can load data, clean codes
SenseCode Sep 7, 2021
c254e70
clean codes
SenseCode Sep 7, 2021
06c2b20
add formstable
SenseCode Sep 7, 2021
e1435e9
add fvp_a1v3
SenseCode Sep 7, 2021
6869abe
fix pie-chart, add pattern for patient no.
SenseCode Sep 7, 2021
4ba9984
edit search.js
SenseCode Sep 7, 2021
30cbba7
fix search page showing issue
SenseCode Sep 9, 2021
415c40f
add fvp schemas
SenseCode Sep 10, 2021
3aab81f
add ivp schemas
SenseCode Sep 10, 2021
c719726
add tvp schemas and concussion_history
SenseCode Sep 10, 2021
2cff222
add inserts fvp data
SenseCode Sep 10, 2021
54ccbb2
add test data of ivp
SenseCode Sep 10, 2021
67b3c9d
add test data of tvp and concussion_history
SenseCode Sep 10, 2021
8c2157f
add ivp, fvp and tvp, concussion_history changelogs
SenseCode Sep 10, 2021
33659b6
add ivp, fvp, tvp and concussion_history py files, and m1 related files
SenseCode Sep 10, 2021
18b1ed0
edit formver, all loaded
SenseCode Sep 10, 2021
a814625
recommit add all py files
SenseCode Sep 11, 2021
55fb0bf
update patient.js
SenseCode Sep 11, 2021
a77eba6
embed all the schemas into patient
SenseCode Sep 11, 2021
33c5988
rewrite patient.py with new load order
SenseCode Sep 14, 2021
644a48d
add seperate line
SenseCode Sep 14, 2021
13ce849
successfully load all parts after commit version 1 and version 2
SenseCode Sep 14, 2021
6bbce61
merge concussion_history_follow_up
SenseCode Mar 16, 2021
a5a8e55
add updrs schema
SenseCode Mar 17, 2021
7587ab2
add visit_contact schema, connect with patient , put in showpage
SenseCode Mar 18, 2021
fc0f82f
add physical_exam schema, connect with patient, put on showpage
SenseCode Mar 19, 2021
9a8c8f7
add moca schema
SenseCode Mar 19, 2021
8533844
edit local tests and load all the local forms
SenseCode Sep 15, 2021
33c5ced
edit concussion_history_follow_up
SenseCode Sep 16, 2021
ad0e850
fix facets mapping issue in ivp_a5v3, m1
SenseCode Sep 22, 2021
122a73d
remove genetice_modification update json file, which bring mapping error
SenseCode Sep 22, 2021
300077b
update schemas
SenseCode Sep 24, 2021
38bb508
edit test data, load all forms now
SenseCode Sep 24, 2021
f346c17
update loadxl.py file
SenseCode Sep 24, 2021
f60a4c5
rewrite formtable with separate version order
SenseCode Oct 5, 2021
15afca5
edit format, test load
SenseCode Oct 5, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
6 changes: 4 additions & 2 deletions CHANGES.rst
Original file line number Diff line number Diff line change
@@ -1,14 +1,16 @@
Changes
=======
=======

2.0 (inprogress)
----------------
1. Scrub old encode schema (#270)
2. Implemment Summary view for biosamples, patients, histology, and genomics (#147)
3. Add stage info for dominant tumor (#378)
4. Add patient minimum filter (#392)
5. Reformat surgery and pathology linkage to make it eaiser for query (#333)
6. Update the display to remove NOS for site. (#399)


1.0 (unreleased)
----------------
Initial move of framework from php to encoded

1 change: 1 addition & 0 deletions src/encoded/audit/item.py
Original file line number Diff line number Diff line change
Expand Up @@ -73,6 +73,7 @@ def audit_item_schema(value, system):

# private statuses (visible for consortium members only)
'in progress': 50,
'restricted':50,
'pending dcc review': 50,
'submitted': 50,
'uploading': 50,
Expand Down
24 changes: 12 additions & 12 deletions src/encoded/batch_download.py
Original file line number Diff line number Diff line change
Expand Up @@ -47,14 +47,14 @@ def includeme(config):
('Biosample type', ['biosample_ontology.classification']),
('Biosample organism', ['replicates.library.biosample.organism.scientific_name']),
('Biosample genetic modifications methods', ['replicates.library.biosample.applied_modifications.method']),
('Biosample genetic modifications categories', ['replicates.library.biosample.applied_modifications.category']),
('Biosample genetic modifications targets', ['replicates.library.biosample.applied_modifications.modified_site_by_target_id']),
('Biosample genetic modifications gene targets', ['replicates.library.biosample.applied_modifications.modified_site_by_gene_id']),
('Biosample genetic modifications categories', ['replicates.library.biosample.applied_modifications.category']),
('Biosample genetic modifications targets', ['replicates.library.biosample.applied_modifications.modified_site_by_target_id']),
('Biosample genetic modifications gene targets', ['replicates.library.biosample.applied_modifications.modified_site_by_gene_id']),
('Biosample genetic modifications site coordinates', ['replicates.library.biosample.applied_modifications.modified_site_by_coordinates.assembly',
'replicates.library.biosample.applied_modifications.modified_site_by_coordinates.chromosome',
'replicates.library.biosample.applied_modifications.modified_site_by_coordinates.start',
'replicates.library.biosample.applied_modifications.modified_site_by_coordinates.end']),
('Biosample genetic modifications zygosity', ['replicates.library.biosample.applied_modifications.zygosity']),
'replicates.library.biosample.applied_modifications.modified_site_by_coordinates.end']),
('Biosample genetic modifications zygosity', ['replicates.library.biosample.applied_modifications.zygosity']),
('Experiment target', ['target.name']),
('Library made from', ['replicates.library.nucleic_acid_term_name']),
('Library depleted in', ['replicates.library.depleted_in_term_name']),
Expand Down Expand Up @@ -489,7 +489,7 @@ def _batch_download_publicationdata(request):
)


@view_config(route_name='peak_metadata', request_method='GET')
@view_config(route_name='peak_metadata', request_method='GET', permission='search')
def peak_metadata(context, request):
param_list = parse_qs(request.matchdict['search_params'])
param_list['field'] = []
Expand Down Expand Up @@ -541,7 +541,7 @@ def peak_metadata(context, request):
)


@view_config(route_name='metadata', request_method='GET')
@view_config(route_name='metadata', request_method='GET', permission='search')
def metadata_tsv(context, request):
qs = QueryString(request)
param_list = qs.group_values_by_key()
Expand Down Expand Up @@ -682,7 +682,7 @@ def metadata_tsv(context, request):
)


@view_config(route_name='batch_download', request_method=('GET', 'POST'))
@view_config(route_name='batch_download', request_method=('GET', 'POST'), permission='search')
def batch_download(context, request):
default_params = [
('limit', 'all'),
Expand Down Expand Up @@ -843,7 +843,7 @@ def restricted_files_present(exp_file):

def is_no_file_available(exp_file):
return exp_file.get('no_file_available', False)


def lookup_column_value(value, path):
nodes = [value]
Expand Down Expand Up @@ -883,7 +883,7 @@ def _convert_camel_to_snake(type_str):
return re.sub('([a-z0-9])([A-Z])', r'\1_\2', tmp).lower()


@view_config(route_name='report_download', request_method='GET')
@view_config(route_name='report_download', request_method='GET', permission='search')
def report_download(context, request):
downloadtime = datetime.datetime.now()

Expand All @@ -902,7 +902,7 @@ def report_download(context, request):
def format_header(seq):
newheader="%s\t%s%s?%s\r\n" % (downloadtime, request.host_url, '/report/', request.query_string)
return(bytes(newheader, 'utf-8'))


# Work around Excel bug; can't open single column TSV with 'ID' header
if len(columns) == 1 and '@id' in columns:
Expand All @@ -917,7 +917,7 @@ def generate_rows():
values = [lookup_column_value(item, path) for path in columns]
yield format_row(values)


# Stream response using chunked encoding.
request.response.content_type = 'text/tsv'
request.response.content_disposition = 'attachment;filename="{}_report_{}_{}_{}_{}h_{}m.tsv"'.format(
Expand Down
Loading