Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optional alignment subworkflow #83

Merged
merged 32 commits into from
Oct 18, 2023
Merged
Show file tree
Hide file tree
Changes from 7 commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
c5ed715
Use the path under resources/nextflow
muffato Jul 19, 2023
2364346
Download the databases to make it work on GitHub
muffato Aug 1, 2023
8b78ae5
This should be a S3 path too
muffato Aug 1, 2023
fccd64e
Need to use the CRAM files from S3 too
muffato Aug 1, 2023
fe9e34c
quay.io os now the default registry
muffato Aug 1, 2023
d66492f
quay.io os now the default registry
muffato Aug 1, 2023
567ff71
This file is changed on purpose
muffato Aug 1, 2023
1429168
Override the BUSCO settings in the test profile
muffato Aug 4, 2023
c061190
Our new convention is use per-pipeline directories under pipeline_info/
muffato Aug 4, 2023
47dc957
Latest nomenclature
muffato Aug 14, 2023
56f82e8
The minimum version is actually 22.10 (tested on GitHub)
muffato Aug 14, 2023
ea0e6d7
Use the latest version of the Tower action
muffato Aug 14, 2023
eeffa82
Final version of the BUSCO database
muffato Aug 14, 2023
4eddcc4
Update sanger_test.yml
gq1 Aug 16, 2023
23b0c4f
Update sanger_test_full.yml
gq1 Aug 16, 2023
fbd8e06
Update sanger_test.yml
gq1 Aug 16, 2023
4b26819
Update sanger_test_full.yml update workflow name
gq1 Aug 16, 2023
418c500
New tolsoft details
muffato Aug 18, 2023
6ad007e
Fixed the repository name
muffato Aug 18, 2023
fcf0df7
adding alignment modules
priyanka-surana Sep 17, 2023
bc50336
created alignment subworkflow from template
priyanka-surana Sep 17, 2023
53cb038
minimap alignment subworkflow
priyanka-surana Sep 17, 2023
24a9653
update modules
priyanka-surana Sep 17, 2023
1023126
all tests work
priyanka-surana Sep 17, 2023
d4b93da
update nextflow schema
priyanka-surana Sep 17, 2023
c3486ae
forgot to add busco diff
priyanka-surana Sep 17, 2023
54f5568
Moved all the test data to the S3 bucket
muffato Sep 18, 2023
f09fa15
Merge pull request #82 from sanger-tol/test_ci
priyanka-surana Sep 26, 2023
021565a
review comments
priyanka-surana Sep 27, 2023
dfa2b93
prettier fix
priyanka-surana Sep 27, 2023
44776b3
prepare genome subworkflow
priyanka-surana Sep 27, 2023
378ab70
Merge pull request #84 from sanger-tol/prepare_genome
priyanka-surana Oct 18, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions assets/test/samplesheet_raw.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
sample,datatype,datafile
mMelMel1,illumina,/lustre/scratch123/tol/resources/nextflow/test-data/Meles_meles/genomic_data/mMelMel1/illumina/31231_3#1_subset.cram
mMelMel2,illumina,/lustre/scratch123/tol/resources/nextflow/test-data/Meles_meles/genomic_data/mMelMel2/illumina/31231_4#1_subset.cram
mMelMel3,hic,/lustre/scratch123/tol/resources/nextflow/test-data/Meles_meles/genomic_data/mMelMel3/hic-arima2/35528_2#1_subset.cram
5 changes: 4 additions & 1 deletion bin/check_samplesheet.py
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,10 @@ class RowChecker:

"""

VALID_FORMATS = (".cram",)
VALID_FORMATS = (
".cram",
".bam",
)

VALID_DATATYPES = (
"hic",
Expand Down
24 changes: 24 additions & 0 deletions conf/modules.config
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,30 @@ process {
]
}

withName: "MINIMAP2_HIC" {
ext.args = "-ax sr"
}

withName: "MINIMAP2_ILMN" {
ext.args = "-ax sr"
}

withName: "MINIMAP2_CCS" {
ext.args = "-ax map-hifi --cs=short"
}

withName: "MINIMAP2_CLR" {
ext.args = "-ax map-pb"
}

withName: "MINIMAP2_ONT" {
ext.args = "-ax map-ont"
}

withName: "SAMTOOLS_INDEX" {
ext.args = "-c"
}

withName: "GOAT_TAXONSEARCH" {
ext.args = "-l -b"
}
Expand Down
36 changes: 36 additions & 0 deletions conf/test_raw.config
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
/*
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Nextflow config file for running minimal tests
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Defines input files and everything required to run a fast and simple pipeline test.

Use as follows:
nextflow run sanger-tol/blobtoolkit -profile test_raw,<docker/singularity> --outdir <OUTDIR>

----------------------------------------------------------------------------------------
*/

params {
config_profile_name = 'Test profile'
config_profile_description = 'Minimal test dataset to check pipeline function'

// Limit resources so that this can run on GitHub Actions
max_cpus = 2
max_memory = '6.GB'
max_time = '6.h'

// Input test data
// Specify the paths to your test data
// Give any required params for the test so that command line flags are not needed
input = "${projectDir}/assets/test/samplesheet_raw.csv"

// Fasta references
fasta = "/lustre/scratch123/tol/resources/nextflow/test-data/Meles_meles/assembly/release/mMelMel3.1_paternal_haplotype/GCA_922984935.2.subset.fasta.gz"
accession = "GCA_922984935.2"
taxon = "Meles meles"

// Databases
taxdump = "/lustre/scratch123/tol/teams/grit/geval_pipeline/btk_databases/taxdump"
busco = "/lustre/scratch123/tol/resources/nextflow/busco_2021_06_reduced/"
uniprot = "${projectDir}/assets/test/mCerEla1.1.buscogenes.dmnd"
}
25 changes: 20 additions & 5 deletions modules.json
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,13 @@
"nf-core": {
"busco": {
"branch": "master",
"git_sha": "911696ea0b62df80e900ef244d7867d177971f73",
"git_sha": "6d6552cb582f56b6101c452e16ee7c23073f91de",
"installed_by": ["modules"],
"patch": "modules/nf-core/busco/busco.diff"
},
"custom/dumpsoftwareversions": {
"branch": "master",
"git_sha": "911696ea0b62df80e900ef244d7867d177971f73",
"git_sha": "05c280924b6c768d484c7c443dad5e605c4ff4b4",
"installed_by": ["modules"]
},
"diamond/blastp": {
Expand All @@ -33,23 +33,38 @@
},
"gunzip": {
"branch": "master",
"git_sha": "5c460c5a4736974abde2843294f35307ee2b0e5e",
"git_sha": "e06548bfa36ee31869b81041879dd6b3a83b1d57",
"installed_by": ["modules"]
},
"minimap2/align": {
"branch": "master",
"git_sha": "603ecbd9f45300c9788f197d2a15a005685b4220",
"installed_by": ["modules"]
},
"mosdepth": {
"branch": "master",
"git_sha": "911696ea0b62df80e900ef244d7867d177971f73",
"git_sha": "ebb27711cd5f4de921244bfa81c676504072d31c",
"installed_by": ["modules"]
},
"multiqc": {
"branch": "master",
"git_sha": "a6e11ac655e744f7ebc724be669dd568ffdc0e80",
"installed_by": ["modules"]
},
"samtools/fasta": {
"branch": "master",
"git_sha": "911696ea0b62df80e900ef244d7867d177971f73",
"installed_by": ["modules"]
},
"samtools/view": {
"samtools/index": {
"branch": "master",
"git_sha": "911696ea0b62df80e900ef244d7867d177971f73",
"installed_by": ["modules"]
},
"samtools/view": {
"branch": "master",
"git_sha": "3ffae3598260a99e8db3207dead9f73f87f90d1f",
"installed_by": ["modules"]
}
}
},
Expand Down
19 changes: 0 additions & 19 deletions modules/nf-core/busco/busco.diff

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

17 changes: 10 additions & 7 deletions modules/nf-core/busco/main.nf

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

22 changes: 21 additions & 1 deletion modules/nf-core/busco/meta.yml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 3 additions & 3 deletions modules/nf-core/custom/dumpsoftwareversions/main.nf

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 7 additions & 3 deletions modules/nf-core/gunzip/main.nf

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

48 changes: 48 additions & 0 deletions modules/nf-core/minimap2/align/main.nf

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

65 changes: 65 additions & 0 deletions modules/nf-core/minimap2/align/meta.yml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions modules/nf-core/mosdepth/main.nf

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading