From 8c2e4b31e7bf47a8db64aa1be8fef9d903be77f1 Mon Sep 17 00:00:00 2001 From: Quarto GHA Workflow Runner Date: Tue, 17 Oct 2023 10:14:48 +0000 Subject: [PATCH] Built site for gh-pages --- .nojekyll | 2 +- blogs.html | 368 ++++++++++++++++- blogs/2022-06-08/index.html | 414 +++++++++++++++++++ blogs/2022-06-14/index.html | 422 +++++++++++++++++++ blogs/2022-06-22/index.html | 419 +++++++++++++++++++ blogs/2022-06-29/index.html | 418 +++++++++++++++++++ blogs/2022-07-06/index.html | 425 +++++++++++++++++++ blogs/2022-07-13/index.html | 417 +++++++++++++++++++ blogs/2022-07-18/index.html | 413 +++++++++++++++++++ blogs/2022-08-31/index.html | 431 ++++++++++++++++++++ blogs/2022-09-05/index.html | 413 +++++++++++++++++++ blogs/2022-10-11a/index.html | 415 +++++++++++++++++++ blogs/2022-10-11b/index.html | 416 +++++++++++++++++++ blogs/2022-10-18/index.html | 413 +++++++++++++++++++ blogs/2022-11-07/index.html | 421 +++++++++++++++++++ blogs/2022-12-16a/index.html | 411 +++++++++++++++++++ blogs/2022-12-16b/index.html | 420 +++++++++++++++++++ blogs/2023-02-02/index.html | 417 +++++++++++++++++++ blogs/2023-04-19a/index.html | 425 +++++++++++++++++++ blogs/2023-04-19b/index.html | 411 +++++++++++++++++++ blogs/2023-04-26/index.html | 410 +++++++++++++++++++ blogs/2023-05-09/index.html | 408 ++++++++++++++++++ blogs/{2023-10-17 => 2023-05-11}/index.html | 0 listings.json | 22 +- search.json | 146 ++++++- sitemap.xml | 124 +++++- upcoming_courses.html | 6 +- 27 files changed, 8965 insertions(+), 42 deletions(-) create mode 100644 blogs/2022-06-08/index.html create mode 100644 blogs/2022-06-14/index.html create mode 100644 blogs/2022-06-22/index.html create mode 100644 blogs/2022-06-29/index.html create mode 100644 blogs/2022-07-06/index.html create mode 100644 blogs/2022-07-13/index.html create mode 100644 blogs/2022-07-18/index.html create mode 100644 blogs/2022-08-31/index.html create mode 100644 blogs/2022-09-05/index.html create mode 100644 blogs/2022-10-11a/index.html create mode 100644 blogs/2022-10-11b/index.html create mode 100644 blogs/2022-10-18/index.html create mode 100644 blogs/2022-11-07/index.html create mode 100644 blogs/2022-12-16a/index.html create mode 100644 blogs/2022-12-16b/index.html create mode 100644 blogs/2023-02-02/index.html create mode 100644 blogs/2023-04-19a/index.html create mode 100644 blogs/2023-04-19b/index.html create mode 100644 blogs/2023-04-26/index.html create mode 100644 blogs/2023-05-09/index.html rename blogs/{2023-10-17 => 2023-05-11}/index.html (100%) diff --git a/.nojekyll b/.nojekyll index fbaeff1..8d09149 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -fe8565d8 \ No newline at end of file +9bc1d361 \ No newline at end of file diff --git a/blogs.html b/blogs.html index a07c130..8cc0390 100644 --- a/blogs.html +++ b/blogs.html @@ -75,7 +75,8 @@ const options = { valueNames: ['listing-title','listing-author','listing-date','listing-image','listing-description','listing-categories',{ data: ['index'] },{ data: ['categories'] },{ data: ['listing-date-sort'] },{ data: ['listing-file-modified-sort'] }], - + page: 18, + pagination: { item: "
    • " }, searchColumns: ["listing-title","listing-author","listing-date","listing-image","listing-description","listing-categories"], }; @@ -180,7 +181,7 @@

    Blogs

    +
    Categories
    All (26)
    Announcements (1)
    Behind-the-scenes (1)
    Genomics (2)
    Open science (1)
    @@ -193,8 +194,110 @@
    Categories
    -
    - +
    + +
    +
     
    +
    +
    +šŸ—“ļø Save the date 20th June! šŸ—“ļø NEW online workshop - Introduction to R 09/05/23 Sarah Dowsland Save the date - registration opening soon! Join us for this free onlineā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +FAIR at Cloud-SPAN 29/06/22 Evelyn Greeves +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Cloud-SPAN April Code Retreat 14/06/22 Evelyn Greeves +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Making the Prenomics summary poster 06/07/22 +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Our Solutions to Challenges in Environmental ā€™Omics 31/08/22 Evelyn Greeves Hereā€™s what weā€™re doing at Cloud-SPAN to address the challenges we discussed previously. +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +How do we support our learners? 07/11/22 Evelyn Greeves Learning new skills can be difficult, and itā€™s easy to go away from a course feeling like youā€™reā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    +
     
    @@ -210,10 +313,248 @@
    Categories
    +
    + +
    +
     
    +
    +
    +More online computational training for life scientists! 08/06/22 Emma Rand +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +šŸ’øScholarships to attend the Northern Bioinformatics User Group meeting 9th September 18/07/22 Emma Rand +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +šŸ“¢ Online workshop on FAIR data hosted by the UK Reproducibility Network 11/10/22 Sarah Dowsland Just to let you know regarding an event happening on Wednesday 19th Octoberā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Prenomics: Lowering barriers to participation 18/10/22 Evelyn Greeves For most of our new learners, the idea of doing things like using the command line and accessing theā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Cloud-SPAN awarded NERC funding to expand training courses 05/09/22 Sarah Dowsland The Cloud-SPAN team has been awarded a grant to expand our training to the Naturalā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +In depth: course feedback 02/02/23 Evelyn Greeves Weā€™ve finished our analysis of the feedback from our courses held at the end of last year: Prenomics, Genomics andā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Scholarships, funding and so much more! 11/10/22 Sarah Dowsland Here at Cloud-SPAN HQ our official tagline is that we are here to upskill researchers and enable them toā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Bioinformatics Meeting on ā€˜Career pathways into bioinformaticsā€™ 22/06/22 Sarah Dowsland +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Congratulations to James Chong and the team! 26/04/23 Sarah Dowsland Professor James Chong selected as an Oracle Research Fellow Cloud-SPAN PI, Prof James Chong has recentlyā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +NorthernBUG Meeting 19/04/23 Sarah Dowsland Hi everyone! We are pleased to announce that registration is open for the 9thā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Cloud-SPAN Code Retreat 19/04/23 Sarah Dowsland We are excited to announce that our next Code Retreat will take place at 10:30-15:00 onā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Cloud-SPAN Code Retreat 16/12/22 Sarah Dowsland We are excited to announce that our next Code Retreat will take place on Mondayā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +šŸ’øScholarships to attend the Northern Bioinformatics User Group meeting 13th Jan 16/12/22 Sarah Dowsland We haveā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    + +
    +
     
    +
    +
    +Challenges in Environmental ā€˜Omics 13/07/22 Evelyn Greeves Hardware The size and nature of ā€˜omics data means it is often necessary to employ high performance computing (HPC)ā€¦ +
    +
    +
    + +
    +
    +
    +
    +     +
    +
    -

    A graphic showing the 4 FAIR Principles: Findable (illustrated with a magnifying glass), Accessible (illustrated with an open lock), Interoperable (illustrated with interlocking gears) and Reusable (illustrated with a green recycling symbol)

    +

    A graphic showing the 4 FAIR Principles: Findable (illustrated with a magnifying glass), Accessible (illustrated with an open lock), Interoperable (illustrated with interlocking gears) and Reusable (illustrated with a green recycling symbol)

    What is FAIR data? @@ -238,11 +579,11 @@
    -
    +

    - +

    @@ -271,10 +612,10 @@
    -
    +
    -

    A dumbbell plot with each topic covered in the course on its own line. The graph indicates the rating given before the course was taken and the score after, with a line joining the two. For all topics the score increases, usually by two or so points.

    +

    A dumbbell plot with each topic covered in the course on its own line. The graph indicates the rating given before the course was taken and the score after, with a line joining the two. For all topics the score increases, usually by two or so points.

    Course Update @@ -302,7 +643,7 @@
    -
    +
     
    @@ -322,7 +663,7 @@
    -
    +
     
    @@ -346,6 +687,9 @@
    No matching items
    +
    + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    More online computational training for life scientists! 08/06/22 Emma Rand

    +

    The Cloud-SPAN team would like to let you know about more opportunities for online training! Ed-DaSH from the University of Edinburgh, is a Data Science training programme for Health and Biosciences funded under the same scheme as Cloud-SPAN (UKRI innovation scholars award). Like Cloud-SPAN, Ed-DaSH is partnered with the The Software Sustainability Institute and you will find similarities in our approach to teaching computational topics to life scientists. Their upcoming workshops are:

    +

    13:00-17:00 14-17 June ā€“ FAIR in (Biological) Practice

    +

    10:00-13:00 5-8 July ā€“ Introduction to Statistics with R (this is a course written by Cloud-SPANā€™s Emma Rand and Univerity of York Biology PhD student Ezra Herman)

    +

    09:30-13:00 26-29 July ā€“ High dimensional statistics with R

    +

    13:00-16:00 23-26 August ā€“ Machine learning

    +

    You can register via the University of Edinburgh ePay system - the courses are free but have a refundable deposit. Contact them at ed-dash@ed.ac.uk or on Twitter @EdDaSH_Training, with any questions

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-06-14/index.html b/blogs/2022-06-14/index.html new file mode 100644 index 0000000..6fbf826 --- /dev/null +++ b/blogs/2022-06-14/index.html @@ -0,0 +1,422 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Cloud-SPAN April Code Retreat 14/06/22 Evelyn Greeves

    +

    In April we held our first code retreat event: a chance for course alumni to come together and work on their own data problems with the support of Cloud-SPAN instructors. The event took place at the University of York, with several participants travelling from other institutions for the day.

    +

    Some people took the opportunity to revisit course materials and ask questions about the topics they didnā€™t understand. There were plenty of helpers on hand to answer questions and test understanding.

    +

    Others chose to apply the workflows and analyses taught in the Genomics course to their own datasets. Again, helpers were on hand to discuss topics such as:

    +

    how to organise bioinformatics projects;

    +

    which tools are most effective;

    +

    how to approach a problem;

    +

    what analysis is best for a certain type of data;

    +

    as well as many others.

    +

    Some participants knew what help they needed and had specific questions to address during the day. Those with a less clear understanding of their problem benefited from talking through their data and getting guidance from our experienced instructors. Some even tried out new software tools not discussed during the course.

    +

    Finally, some participants decided to trial our new self-study course on creating your own Amazon Web Services cloud instance. They were able to ask questions about the content and provided valuable feedback on which parts of the course needed improvement.

    +

    Everyone enjoyed the chance to meet new people and find out about each othersā€™ research. It was a great chance to network and build some community amongst course alumni.

    +

    Our next code retreat for Cloud-SPAN course alumni will be on July 6th at the University of York. We cover travel expenses and lunch is provided. Weā€™re looking forward to meeting more of our community members and providing valuable one-to-one support!

    +

    Contact us at cloud-span-project@york.ac.uk to sign up.

    +

    Image: Instructors and course alumni at Aprilā€™s code retreat.

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-06-22/index.html b/blogs/2022-06-22/index.html new file mode 100644 index 0000000..6796e93 --- /dev/null +++ b/blogs/2022-06-22/index.html @@ -0,0 +1,419 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Bioinformatics Meeting on ā€˜Career pathways into bioinformaticsā€™ 22/06/22 Sarah Dowsland

    +

    Join the University of Yorkā€™s Bioinformatics Meeting on ā€˜Career pathways into bioinformaticsā€™.

    +

    Hosted by Sarah Forrester, we have a jam packed hour and a half.

    +

    Evelyn Greeves from the Cloud-SPAN team will be leading a short session on ā€œIntroduction to FAIR and metadataā€ with an opportunity for you to ask any questions that you may have.

    +

    Following this, have you pondered what direction to take your career or how to use your data skills in future projects? We have 3 speakers who explain how data analysis has been incorporated into their work.

    +

    šŸ”ø Emma Rand highlights the different paths into academia and using big data skills.

    +

    šŸ”ø James Chong explains how learning bioinformatics was the only way to get past the bottleneck of being able to analyse data he was generating.

    +

    šŸ”ø Sarah Forrester explores how bioinformatics opens doors to moving between different research niches.

    +

    We will then have a discussion with all speakers for the remainder of the session, which will include signposting resources.

    +

    Session slides will be available following the event.

    +

    Event details: Wednesday, 6th July, 15:00-16:30 in room B/T/019 University of York.

    +

    Contact us on cloud-span-project@york.ac.uk to be added to the Bioinformatics regular mailing list!

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-06-29/index.html b/blogs/2022-06-29/index.html new file mode 100644 index 0000000..15f6301 --- /dev/null +++ b/blogs/2022-06-29/index.html @@ -0,0 +1,418 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    FAIR at Cloud-SPAN 29/06/22 Evelyn Greeves

    +

    Previously we shared some information about FAIR data, and explained why itā€™s important to make sure your data is as reusable as possible.

    +

    The FAIR principles arenā€™t just for data. Our aim is to apply the principles to all our training resources to ensure that they can be reused and remixed by others for their own teaching purposes. Hereā€™s a look at how weā€™re doing it:

    +

    Findable Remember, findability is about making it easy to find your data or resource. Weā€™ve added metadata to our resources, which enables us to register our courses with TeSS, a life sciences training repository. The metadata means people can search and filter to find our course based on what they need. You can see the metadata for our Prenomics course at the top of the source page here.

    +

    In addition, we have also registered our training resources on Zenodo, another repository which assigns a DOI to each stored item. This persistent identifier will give our resources a permanent home, even after other links become deprecated.

    +

    Accessible To be accessible it needs to be easy to retrieve a resource without any special tools. It should also be clear how to do this. Weā€™ve made this really easy for ourselves by hosting our courses online for free on a dedicated set of webpages via GitHub Pages.

    +

    Interoperable Interoperability means ensuring that computers can understand and open a resource. We do this by providing data for analysis in de facto file standards such as FASTQ and using Markdown (a widely-used and platform-independent text formatting language for writing resources) for course material.

    +

    We also help computers to understand how our resources fit into a bigger picture by using an ā€˜ontologyā€™ to describe the topics of our courses. This forms part of the metadata and helps people to filter and understand what our resources are about. For example, we use the EDAM ontology of bioscientific data analysis and data management. Weā€™ve labelled our Prenomics course as falling under topics 3372 (software engineering) and 0622 (genomics).

    +

    Reusable All of the things just described help promote reusability. In particular, we promote reusability by tagging our resources with rich metadata - we use the Bioschemas Training Material protocol which suggests a list of metadata properties for biosciences training materials.

    +

    We also help people reuse our materials by applying a Creative Commons Attribution (CC-BY) licence, which means anyone can distribute, remix, adapt or build on our work as long as they credit us. We include details of this licence in our metadata, in our GitHub repositories and at the bottom of our course pages so itā€™s clear to everyone what the rules are.

    +

    Over to you! What steps are you taking to make your data and other digital resources as FAIR as possible? There are some great resources available online to help you if youā€™re not sure where to start - try howtofair.dk or the FAIR Cookbook for helpful articles, videos and step-by-step guides!

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-07-06/index.html b/blogs/2022-07-06/index.html new file mode 100644 index 0000000..1f9f4e3 --- /dev/null +++ b/blogs/2022-07-06/index.html @@ -0,0 +1,425 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Making the Prenomics summary poster 06/07/22

    +

    I recently designed a poster that acts as a ā€œcheat sheetā€ for Cloud-SPANā€™s Prenomics course. Here Iā€™ll give a quick overview of my thought process while making the poster and how I chose what to include.

    +

    Command cheatsheet I started with the command cheatsheet, which is a bit back-to-front given that the command line comes chronologically last in the course. However, it seemed like an easy entry point. I had previously produced a glossary for Prenomics, so I took this and organised the commands into logical groupings based on their function.

    +

    I ended up with four groups: navigating files, viewing files, editing files and searching files. There were two commands which didnā€™t fit into these groups, which were history and man. I tried to find a way to include them, but ultimately left them out as I decided they were not crucial knowledge.

    +

    I tried to format the commands in a way that made it clear how to use them while still keeping it general and easily readable. I used colour to clarify which parts of the command corresponded to which parts of the explanation. For example:

    +

    Example from poster showing the command mv file directory and the explanation ā€˜move file to directoryā€™. In this case ā€˜fileā€™ (the file to be moved) is pale blue while ā€˜directoryā€™ (the location to which the file should be moved) is dark blue. I also used underlining to indicate where the command came from - in this case, mv comes from the m and the v of ā€˜moveā€™. My aim here was to aid recall of the command in future, as hopefully it will help the reader make a stronger mental connection between the command mv and its function (ā€˜move a fileā€™).

    +

    Files, paths and file types The command line makes up a significant portion of the Prenomics course, but it could be summarised in a relatively small amount of space. To work out what else should be included, I looked at the course more holistically. The first lesson of the course is about files and directories, so it was clear to me that there needed to be a section about this. This lesson also covers the file types used in the course, including .FASTQ and .PEM files which are likely to be new to most learners, so I wanted to include this too.

    +

    I found it difficult to summarise the information about file paths and directories into a mostly graphical format. In particular, I found that I couldnā€™t rely on giving examples as much as we do in the course itself, due to the need to reduce text as much as possible. I ended up just including definitions of absolute and relative paths, along with a diagram of the file system inside the Cloud-SPAN AWS instance.

    +

    If Iā€™d had space, I would have included more information on working directories and examples of how the file system diagram can be represented with file paths.

    +

    Why useā€¦? The next sections I designed were the ā€˜Why learn command line?ā€™ and ā€˜Why use the cloud?ā€™ sections.

    +

    The question of why the command line is useful is covered in episode three of the first day of Prenomics, as part of the introduction to the shell. I distilled the reasons given here down into four main themes: automation of repetitive tasks, reducing human error (as a result of automation), improving reproducibility and the ability to access new tools (either because the command line offers more functionality or because it opens up use of high performance computing systems (HPC) such as the cloud).

    +

    Extract from poster section ā€˜Why learn command line?ā€™. Icons and text give four reasons: improve reproducibility, reduce human error, access new tools, and automate repetitive tasks. The other question- why cloud computing is useful- is not technically covered in Prenomics material. However, it is discussed in our Genomics course, where the three reasons given for using HPC are lack of resources needed to run analyses, analyses taking a long time to run and problems installing software. These reasons align closely with three of the challenges identified by Cloud-SPAN project lead, James Chong, as facing the field of metagenomics (hardware, time and software).

    +

    However, these reasons could actually be used as a reason to use any kind of HPC resource, not just the cloud. I wanted to include reasons specific to the cloud. The two major reasons I came across were the ability to share software or data containers across different institutions, and use of the cloud when other HPC is inaccessible.

    +

    In an earlier version of the poster, the ā€˜why use cloud?ā€™ section was framed in terms of challenges that users might face, such as long analysis times or issues installing software. I reworded this section to match the framing of the ā€˜why learn command line?ā€™ section; that is, a solutions-oriented summary, with ā€˜shorten analysis timesā€™ replacing ā€˜long analysis timesā€™ and ā€˜use pre-installed softwareā€™ā€™ replacing ā€˜issues installing softwareā€™.

    +

    Extract from poster section ā€˜Why use the cloud?ā€™. Icons and text give five reasons: access more hardware resources, use pre-installed software, shorten analysis time, share software or data containers, and overcome barriers to accessing high performance computing File types Lastly I wanted to include a brief summary of the file types used in the Prenomics course, as it is likely that two out of three of these will be new to learners. This part was quite easy - I just wrote a short sentence to describe each file type and paired it with the relevant file extension.

    +

    In the course a significant amount of time is dedicated to introducing the .fastq file structure, which codes sequencing data into a text format with four lines per read. I considered including this information but I didnā€™t have room.

    +

    The big revealā€¦ And finally, hereā€™s the full poster! You can download a high-res version of the poster for your own enjoyment here.

    +

    An image of the finished poster with sections: why learn command line?, why use the cloud?, file types, files and paths, and command cheatsheet

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-07-13/index.html b/blogs/2022-07-13/index.html new file mode 100644 index 0000000..2c98907 --- /dev/null +++ b/blogs/2022-07-13/index.html @@ -0,0 +1,417 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Challenges in Environmental ā€˜Omics 13/07/22 Evelyn Greeves Hardware The size and nature of ā€˜omics data means it is often necessary to employ high performance computing (HPC) resources for analysis. This presents an inherent challenge as use of such resources requires a specific skill set that not all researchers will have (see ā€˜skillsā€™ below for more details).

    +

    A secondary challenge relating to hardware is the rapidly changing HPC landscape. Between institutions HPC architectures can vary wildly. Although the basic skills needed to access them remain the same, the setup and execution of jobs may look quite different. Even within institutions, HPC setups mature and are replaced regularly as new technologies develop and the demand for resources grows. For example, the Biology department at the University of York has had access to three different setups (c2d2, YARCC and Viking) in the last nine years, with a new iteration (Viking2) currently in the works. This frequent turnover requires users to continually adjust and adapt their workflows to the new system.

    +

    Software There are several issues surrounding the software involved in analysis of environmental omics datasets. Firstly, software tends to have a steep learning curve, requiring a substantial time investment for researchers. This investment will not necessarily always pay off, if the end result is not what is required.

    +

    Secondly, even if a piece of software does do what is needed, it is not guaranteed that it will be usable on the HPC architecture available. Installation of software is not always straightforward, if it is allowed in the first place. The rapid turnover and replacement of HPC architectures only serves to compound this problem, and the heterogeneity of HPC setups between institutions makes it difficult to find bespoke instructions for software installation.

    +

    The final, broader issue is around access to learning resources and tutorials. Some popular, non-field-specific tools such as R or Python have countless online tutorials and instructions dedicated to their use, aimed at all different levels of understanding. Others, especially more niche software programs, have very few resources. Those that do exist may be out of date, or assume a level of knowledge beyond that of most novices (for example, many documentation pages are entirely inaccessible to a newcomer). As new software emerges and supersedes previously popular programs, the lack of help available only worsens.

    +

    Skills As previously mentioned, environmental omics analysis has a steep learning curve. A major challenge for many new researchers is grappling with previously unencountered skills such as using the UNIX command line, navigating file systems, writing shell scripts, grappling with dependencies and specifying resources for HPC. This is all before any specific pieces of software are involved, each of which will require its own set of skills and understanding.

    +

    These skills are required on top of the experimental design and data collection skills needed to generate datasets in the first place. Often those collecting data are the ones best placed to know how to interrogate it, as all experiments are different and bespoke analysis is crucial. This requires researchers to learn and juggle a large collection of skills, not all of which are immediately relevant to their chosen area of study.

    +

    Time Finally, there are time investments involved in all of the above challenges. There is the ā€˜brain timeā€™ involved in learning new skills, problem-solving and working with new software. Then, once an analysis is ready to run, it will take time to run. HPC resources are usually shared across many users, with jobs being added to a queue to run when resources are available - analyses requiring large amounts of compute may be queued for days or weeks waiting for the required resources to come available. In addition, some analyses take a long time to run given the size of the datasets involved and the complexity of the analysis.

    +

    Once analysis is completed time must be invested in interpreting and visualising the results. If parameters need to be adjusted following this, then the whole process must begin again. This makes optimisation of analysis difficult and time-consuming to the point that it may not even happen at all.

    +

    At Cloud-SPAN our goal is to help you overcome these challenges. Read more about the courses we offer or take a look at our introductory ā€˜Prenomicsā€™ course materials or specialised Genomics course to see how our training can equip you better!

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-07-18/index.html b/blogs/2022-07-18/index.html new file mode 100644 index 0000000..db40bad --- /dev/null +++ b/blogs/2022-07-18/index.html @@ -0,0 +1,413 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    šŸ’øScholarships to attend the Northern Bioinformatics User Group meeting 9th September 18/07/22 Emma Rand

    +

    Hello Cloud-SPAN community! We have scholarships to cover expenses to attend the Northern Bioinformatics User Group (Northern BUG) meeting to be held on September 9th 2022 at the University of Bradford.

    +

    NorthernBUG is a network of bioinformaticians and users or bioinformatics services in the north of England which hold quarterly meetings to build a community of researchers and others using big data in biology. NorthernBUG meetings are open to anyone interested in bioinformatics or its application in life science research and beyond. Meetings are free and early career researchers are especially encouraged career to attend and present their work. Itā€™s a great forum to practice your talks, float new ideas and approaches, and present early work.

    +

    One of my project students, Chloe Brook, presented her work there:

    +

    She is now at the Edinburgh Parallel Computing Centre.

    +

    We have scholarships to cover travel expenses for five of our Cloud-SPAN ā€˜graduatesā€™ to attend NBUG. Register for NBUG here and complete a scholarship application with us here by Monday 22nd August.

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-08-31/index.html b/blogs/2022-08-31/index.html new file mode 100644 index 0000000..fe54d91 --- /dev/null +++ b/blogs/2022-08-31/index.html @@ -0,0 +1,431 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Our Solutions to Challenges in Environmental ā€™Omics 31/08/22 Evelyn Greeves Hereā€™s what weā€™re doing at Cloud-SPAN to address the challenges we discussed previously.

    +

    Just to recap, here are our four main challenges:

    +

    Hardware - the size and nature of ā€™omics data means high performance computing (HPC) resources are needed, which are rapidly evolving and differ between institutions.

    +

    Software - software used for analysis has a steep learning curve, can be difficult to install and tends to have limited teaching resources.

    +

    Skills - using HPC requires skills many scientists do not have, such as using the command line and specifying resources.

    +

    Time - there are time investments needed for learning new skills, running long analysis scripts and interpreting the results.

    +

    At Cloud-SPAN we have two main weapons in our arsenal against these challenges: cloud computing and training. Letā€™s look at each of those in detail.

    +

    Cloud HPC We use commercially-available cloud computing resources to address the challenges of hardware, software and time.

    +

    Hereā€™s how it works: we teach our courses inside a containerised instance, which is a virtual environment containing pre-loaded software and files. The instance runs on hardware borrowed from a commercial provider (in our case, Amazon Web Services). All our learners have to do is log into the cloud instance we provide, and they will have access to all of the software and data used in the course. The instances all start out identical, so the file structure always looks the same, and they run on enough borrowed resources to make analysis relatively quick and easy.

    +

    Using this kind of pre-loaded instance benefits our learners by removing complications around different HPC setups and the installation of software onto a cluster. It also makes it easier for us to teach - we know that everyone is starting with the same setup, so we can offer our courses to anyone regardless of institution. It allows us to model best practices for directory structure and project organisation, and save time when troubleshooting issues.

    +

    Another major advantage of running analyses on cloud resources is that we donā€™t have to wait in a queue for resources to be available, as weā€™ve already loaned out the resources we need. This can save a lot of time for large analyses, and is especially useful for teaching.

    +

    After completing one of our courses, learners can go away and apply their new skills to their own data by setting up their own cloud instance, which is identical to the one used in the course. It contains all the same software and basic file structures, so provides a familiar environment for further learning and analysis. Using these kinds of services outside of the course does incur a cost, but we also support learners in applying for research credits.

    +

    Training Our other main solution is providing high quality, free-of-charge training courses with a low barrier to entry and no assumptions of prior knowledge. These courses allow us to address challenges around skills and the skills gap.

    +

    All of our courses are underpinned by a core ā€˜Prenomicsā€™ module, which provides a supportive and carefully paced introduction to navigating directories and using the UNIX command line. Accessing the cloud HPC services described above is impossible without these skills. Using our purpose-built environment we guide new learners through the basics with a strong focus on contextualising new skills within the field of environmental ā€™omics.

    +

    We also provide core modules in using the programming language R, again with a focus on analysis and visualisation of ā€™omics data, and on creating cloud instances.

    +

    Our specialised courses follow on from Prenomics and cover topics such as genomics, metagenomics, automating analyses and designing statistically useful experiments. Again, we keep the barrier to participation low by contextualising learning and keeping new ideas to the bare minimum - no frills!

    +

    Summary In summary, the Cloud-SPAN project combines high-quality training with cloud computing expertise to address four major challenges in the field of environmental ā€™omics. Using our unique containerised instances we can provide adequate resources for efficient analysis with software pre-installed, saving time and effort. Our courses are designed to equip learners with the skills they need to perform analyses on these cloud instances and beyond, with the overall aim to lessen the load of learning on the backs of researchers and help them improve analysis times and efficiency.

    +

    Our containerised instances solve the challenges of:

    +

    Hardware, by providing a harmonised HPC platform across institutions and potentially increasing the compute resources available to individuals.

    +

    Software, by providing pre-installed software which removes the time-consuming step of software installation.

    +

    Time, by speeding up analyses and eradicating the need to queue to access HPC.

    +

    Our training approach solves the challenge of:

    +

    Skills, by ensuring a low barrier to participation and equipping researchers with vital skills.

    +

    Find out for yourself how our solutions to these challenges could benefit you. Read more about the courses we offer or take a look at our introductory ā€˜Prenomicsā€™ course materials or specialised Genomics course to see how our training can equip you better!

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-09-05/index.html b/blogs/2022-09-05/index.html new file mode 100644 index 0000000..bdffab2 --- /dev/null +++ b/blogs/2022-09-05/index.html @@ -0,0 +1,413 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Cloud-SPAN awarded NERC funding to expand training courses 05/09/22 Sarah Dowsland The Cloud-SPAN team has been awarded a grant to expand our training to the Natural Environment Research Council (NERC) remit under the Advanced training for early-career environmental scientists call. We will be developing an accessible online course ā€œGetting started with High Performance Computing: FAIR training for environmental scientistsā€ using the same cloud-based infrastructure used in our other courses. We will supply AWS services to up to 60 participants undertaking the course either in tutor-led workshops or by self-study.

    +

    Those needing funds for childcare or accessibility to enable their participation in the training will be able apply for a Scholarship and up to 30 participants will receive headsets and second monitors facilitate online engagement. The course will be running in April 2023 - please let your ecology colleagues know to look out for the course!

    +

    Key info šŸ”· Metagenomics with High Performance Computing ā–¶ 11-21 April (Online workshop)

    +

    šŸ”· Scholarship deadline 13 March

    +

    šŸ”· Register for the online workshop

    +

    šŸ”· Register for the self-study mode

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-10-11a/index.html b/blogs/2022-10-11a/index.html new file mode 100644 index 0000000..521c638 --- /dev/null +++ b/blogs/2022-10-11a/index.html @@ -0,0 +1,415 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    šŸ“¢ Online workshop on FAIR data hosted by the UK Reproducibility Network 11/10/22 Sarah Dowsland Just to let you know regarding an event happening on Wednesday 19th October which might be of interest: the UK Reproducibility Network are running an online workshop on FAIR data in the life sciences which should be really informative and useful. Youā€™ll learn about what FAIR data is, why itā€™s important and where you can go for further training on this issue. Plus, our very own Cloud-SPANā€™s Evelyn Greeves will be talking about Cloud-SPAN and how weā€™ve made our courses FAIR!

    +

    If youā€™re:

    +

    šŸ‘©ā€šŸ”¬šŸ‘©šŸæā€šŸ”¬šŸ‘ØšŸ½ā€šŸ”¬ someone who produces and analyses data šŸ“Š a bioinformatician šŸ‘©šŸ»ā€šŸ’»šŸ‘ØšŸ¾ā€šŸ’» a research software engineer šŸ”¢ a statistician

    +

    then this workshop is for you. You can read more about the workshop here and register to attend here. We hope to see some of you there!

    +

    Upcoming Cloud-SPAN Courses

    +

    Prenomics: 22-23 November 2022 (online workshop or complete via self-study)

    +

    Genomics: 6-7 December 2022 (in-person workshop or complete via self-study)

    +

    Genomics self-study: registration now open - start at anytime

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-10-11b/index.html b/blogs/2022-10-11b/index.html new file mode 100644 index 0000000..d7e9ca7 --- /dev/null +++ b/blogs/2022-10-11b/index.html @@ -0,0 +1,416 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Scholarships, funding and so much more! 11/10/22 Sarah Dowsland Here at Cloud-SPAN HQ our official tagline is that we are here to upskill researchers and enable them to perform complex analyses on cloud-based platforms. Which we are achieving through the provision of training courses and online modules. However, as a member of the team who works behind the scenes as project manager, I feel that we are offering much more than that.

    +

    Welcoming learning environment Up until now we have delivered courses online and held code retreats in person. The course materials and delivery are excellent thanks to our talented instructors. I find the real added value here is that the learning environment is very welcoming, encouraging and inclusive. A lot of our participants are complete beginners or new to this world of big data, command line and cloud computing. And learning such new skills could be very daunting for some. At our courses there arenā€™t any big egos, thereā€™s just someone there to work through questions and find solutions to your problems.

    +

    Community We can see that through the provision of these events it has created valuable networks between the learners. We know that on an everyday basis they may be the only one in their lab or team working on this type of work and they lack contact with a colleague where they can chat through ideas or get some advice. We offer a Slack channel, weekly online help sessions and code retreats to help support learners. We are also pleased to be working closely with SSI, NorthernBUG, EBnet and University of York Bioinformatics Group which also enables learners a wider access to learning resources and opportunity to network.

    +

    Equality and diversity When organising courses and online sessions we strive to accommodate individualsā€™ specific needs to ensure that all learners have the same equal access and opportunities to our learning resources. We recognise that unfortunately it is still the case that women, members of the LGBTQ community, people with disabilities and those from ethnic-minorities or socially-disadvantaged groups are consistently underrepresented in research and HPC. To try and combat this, we offer Equality and Diversity Scholarships to help those from underrepresented groups to support costs related to completing the training courses such as travel, childcare etc.

    +

    Funding We understand that financial hardship and lack of available funding is a key player in preventing people accessing and attending training activities, a problem which has been exacerbated by the recent increases in cost of living. Therefore we have recently introduced Hardship Scholarships which are available to anyone who requires financial assistance to attend Cloud-SPAN courses and events. Scholarships can be used to cover travel, childcare or general costs associated with completing the training.

    +

    How to apply for funding Check your eligibility on the scholarships page on our website. To apply for funding please complete the course registration form and include the relevant information in the scholarship section. All applications received before the Scholarship deadline will be reviewed by the Scholarship Panel.

    +

    Upcoming scholarship deadlines šŸ”· Scholarship deadline 13 March Metagenomics with High Performance Computing 11-21 April (Online workshop)

    +

    šŸ”· Scholarship deadline 31 March Statistically useful experimental design 14 April 2023 (University of York)

    +

    Any questions get in touch cloud-span-project@york.ac.uk or follow us @SpanCloud

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-10-18/index.html b/blogs/2022-10-18/index.html new file mode 100644 index 0000000..d7d45f3 --- /dev/null +++ b/blogs/2022-10-18/index.html @@ -0,0 +1,413 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Prenomics: Lowering barriers to participation 18/10/22 Evelyn Greeves For most of our new learners, the idea of doing things like using the command line and accessing the cloud is completely new and a bit overwhelming. But these are skills which, once learned, can totally transform how you do your analysis. Thatā€™s why Cloud-SPAN offers a core ā€˜Prenomicsā€™ course to help you gain confidence in these key skills and prepare you for the Genomics course.

    +

    How Prenomics was born When we ran our first Genomics course in autumn 2021, we discovered that a major sticking point for many participants was directory structure and navigation. This was making it really difficult to help people log into the cloud, where we could then teach them core command line skills. We spent much more time troubleshooting and going over these basic skills than weā€™d expected, meaning we had to rush through more complex content later on about analysis tools and pipelines.

    +

    Overall, this meant our learners began their command line journey from a place of frustration (which has a huge impact on confidence) and we were forced to minimise the amount of time spent on the ā€˜genomicsā€™ part of the Genomics course.

    +

    As a result, we split the original Genomics curriculum across two courses: Prenomics and Genomics. In Prenomics, all the focus is on the command line. We teach about files and directory structure, and spend lots of time guiding learners through creating a folder and navigating to it without using the command line. We also teach those crucial core skills - commonly used commands like ls, cd and mv. Later, as learners gain confidence, we move on to more complex commands like grep and redirection with > and >>.

    +

    Why is Prenomics important? Separating the curriculum into two courses has several benefits. Most importantly, it gives us lots more time to dedicate to core skills and troubleshooting. It also gives us more time to spend on Genomics, as learners start that course already confident about their command line abilities. Plus, those already familiar with the command line can skip Prenomics and go straight to Genomics.

    +

    And it works! We know this because we collect evaluation feedback from participants both before and after the course, asking them to evaluate their understanding of various topics. After we ran the newly designed Prenomics/Genomics combo course in Spring 2022, we compared the understanding scores of learners across three general themes of Command Line, Genomics and Project Organisation (a higher number means a higher level of understanding, with no understanding being 1 and most confident understanding being 6).

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-11-07/index.html b/blogs/2022-11-07/index.html new file mode 100644 index 0000000..dd36fa1 --- /dev/null +++ b/blogs/2022-11-07/index.html @@ -0,0 +1,421 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    How do we support our learners? 07/11/22 Evelyn Greeves Learning new skills can be difficult, and itā€™s easy to go away from a course feeling like youā€™re even more confused than when you started! Hereā€™s what do we do at Cloud-SPAN to make sure all our learners complete our courses feeling confident in their newly-learned skills.

    +

    Prenomics Are you completely new to concepts like cloud computing and the command line? Our Prenomics course is designed to give you the best possible start to your command line journey. It requires absolutely zero prior knowledge or experience! We take it slow, starting at the beginning with file paths and directories before building up to logging onto the cloud for the first time. Once youā€™re logged on, we take you through all the core commands you need to work in the command line effectively.

    +

    All of this is done using the same files and environment as the Genomics course, meaning that youā€™ll feel extra prepared to continue your learning.

    +

    Live Coding We use a technique called live coding to teach all our courses. This means that you code along with us, copying what we type and seeing the output in real time on your own computer. Live coding keeps things interesting and gives you lots of practice at the new skills weā€™re teaching you. In addition, it means that we can help solve any errors you come across as we go through the course.

    +

    Instructors and Helpers Each of our courses is led by one or two experienced instructors, who will do most of the teaching and live coding. Thereā€™ll also be several helpers, who are there to help you with any problems you encounter. No problem is too small! We want you to succeed, and weā€™ll try our best to get you there.

    +

    Code Retreats After finishing one of our courses, your next thought should be ā€œwhat nextā€? Itā€™s likely that youā€™ll want to apply the techniques you just learned to your own research data. If so, you can get help with this by attending a Code Retreat, where our instructors will be happy to help you work on your own analyses. If you have any questions, weā€™ll do our best to get them answered. Code Retreats are also a great networking opportunity where you can meet others working on similar projects to your own and share problems, achievements and tips for success.

    +

    Drop-ins Some of our courses have regular online drop-in sessions where you can get help and troubleshoot your problems. How this works varies depending on the course.

    +

    For our ā€˜Metagenomicsā€™ course, drop-ins occur once a week for the month-long duration of the taught course. We run it like this because some of the analyses can take a long time, so it would be impractical to teach in long blocks. Instead, we let you run these time-consuming analyses in your own time (they can run in the background of your usual work!).

    +

    For our self-taught ā€˜Create Your Own AWS Instanceā€™ course, troubleshooting drop-ins happen online once a week. You get access to this useful resource when you register.

    +

    Slack Channel Participating in a Cloud-SPAN course also gives you access to our Slack channel, where you can ask more questions and keep up with the latest news. We also share links to other training and workshops which we think might be useful for our learners. Itā€™s a friendly, supportive environment and the best place to get your questions answered outside of the course itself.

    +

    How to Get Involved If you like the sound of all this, why not sign up for one of our free courses today? Our full catalogue of courses is listed on our website.

    +

    Upcoming Courses Prenomics āž” 22-23 November 2022 (online workshop or complete via self-study)

    +

    Genomics āž” 6-7 December 2022 (in-person workshop or complete via self-study)

    +

    Genomics self-study āž” registration now open - start at anytime

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-12-16a/index.html b/blogs/2022-12-16a/index.html new file mode 100644 index 0000000..ff6a13f --- /dev/null +++ b/blogs/2022-12-16a/index.html @@ -0,0 +1,411 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    šŸ’øScholarships to attend the Northern Bioinformatics User Group meeting 13th Jan 16/12/22 Sarah Dowsland We have scholarships to cover expenses to attend the Northern Bioinformatics User Group (Northern BUG) meeting to be held on Friday 13th January 2023 at the University of Huddersfield.

    +

    NorthernBUG is a network of bioinformaticians and users or bioinformatics services in the north of England which hold quarterly meetings to build a community of researchers and others using big data in biology. NorthernBUG meetings are open to anyone interested in bioinformatics or its application in life science research and beyond. Meetings are free and early career researchers are especially encouraged career to attend and present their work. Itā€™s a great forum to practice your talks, float new ideas and approaches, and present early work.

    +

    We have scholarships to cover travel expenses for five of our Cloud-SPAN ā€˜graduatesā€™ to attend NBUG. Register for NBUG and complete a scholarship application with us here by Thursday 5th January 2023.

    +

    If you are interested in attending our free training courses please visit our website for further information.

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2022-12-16b/index.html b/blogs/2022-12-16b/index.html new file mode 100644 index 0000000..b2aa357 --- /dev/null +++ b/blogs/2022-12-16b/index.html @@ -0,0 +1,420 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Cloud-SPAN Code Retreat 16/12/22 Sarah Dowsland We are excited to announce that our next Code Retreat will take place on Monday 9th January 2023 at the University of York. It provides a chance for course alumni to come together and work on their own data problems with the support of Cloud-SPAN instructors.

    +

    What happens at a Code Retreat? At previous retreats some people took the opportunity to revisit course materials and ask questions about the topics they didnā€™t understand. There are plenty of helpers on hand to answer questions and test understanding.

    +

    You could also apply the workflows and analyses taught in the Genomics course to your own datasets. Helpers are also on hand to discuss topics such as:

    +

    how to organise bioinformatics projects;

    +

    which tools are most effective;

    +

    how to approach a problem;

    +

    what analysis is best for a certain type of data;

    +

    as well as many others.

    +

    Some participants already know what help they will need and have specific questions to address during the day. Those with a less clear understanding of their problem could benefit from talking through their data and getting guidance from our experienced instructors. You could even try out new software tools.

    +

    What do previous participants have to say? ā€œI had a great time at the Cloud-Span retreat. I went from Lancaster just for it, and it was worth it. I got support in analysing the data I had in hand. That was really satisfying applying what we preciously learned (using our data this time). Having the Cloud-Span Team around to support us was essential. Itā€™s been great learning with them, and I would 100% recommend them!ā€

    +

    Join us for our next event! Our next Code Retreat for Cloud-SPAN Alumni will take on 10:30-15:30, Monday 9th January 2023 at the University of York. Feel free to stay for the whole event or drop in when you are free. Lunch will be provided and we offer support to cover travel expenses.

    +

    Sign up using the registration form

    +

    Training courses If you are interested in attending our free training courses please visit our website for further information.

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2023-02-02/index.html b/blogs/2023-02-02/index.html new file mode 100644 index 0000000..d43e2c1 --- /dev/null +++ b/blogs/2023-02-02/index.html @@ -0,0 +1,417 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    In depth: course feedback 02/02/23 Evelyn Greeves Weā€™ve finished our analysis of the feedback from our courses held at the end of last year: Prenomics, Genomics and Metagenomics. Weā€™re pleased to see that on average participants saw an improvement across all of the learning outcomes for all of our courses - if they didnā€™t weā€™d be doing something wrong!

    +

    Methodology We ask all our learners the same questions before and after the course, asking them to rate their level of comfort with, and understanding of, a range of topics. The options range from ā€œI donā€™t understand what this involvesā€ to ā€œConfidentā€. For analysis purposes these answers are recoded as numbers with 1 being the least confident and 6 being the most confident. Weā€™re interested in the mean scores across participants and how they differ before and after the course.

    +

    The dumbbell charts you will see below indicate the average improvement in score for each criteria. The lighter colour circle represents the score before the course, and the darker one represents the score after the course.

    +

    We donā€™t currently have a way to track individual participants and how their scores change. Everything is done on averages. This gives us a good overall idea of how learnersā€™ understanding might have improved as a result of the course.

    +

    Prenomics Overall the biggest improvements were seen in our Prenomics course, which is what we might expect. Most participants started with little to no knowledge of most of the topics discussed, and we saw their confidence soar over the two day course. Prenomics is designed to give participants a gentle introduction to the command line and provide a confidence boost for those who might feel intimidated, so weā€™re really happy to see that this seems to be working.

    +

    In particular participants saw a big leap in their confidence using the command line with a mean score increase of almost 3.5 points. On average learners finished the course feeling somewhere between ā€œcomfortable most of the timeā€ (5) and ā€œconfidentā€ (6), which is excellent news.

    +

    Genomics We also saw big improvements in confidence in Genomics. We also saw great improvement in Genomics topics - approximately equal across all themes. Most participants started the course with a middling level of confidence using the command line, likely as a result of taking part in Prenomics beforehand. The average increase in score was between 2 and 2.5 points depending on the topic, with the average score after taking the course hovering around 5 - ā€œfairly comfortable most of the timeā€.

    +

    Metagenomics The Metagenomics course feedback was of particular interest as it was the first time we had run the course, so we were keen to see how people got on. Overall, participants finished the course with an average understanding score between 4 (ā€œFairly comfortable in some aspectsā€) and 5 (ā€œComfortable most of the timeā€) for all of the topics. Most learners started the course with a higher initial understanding for core knowledge such as command line and sequencing, so the scope for improvement was more limited than in, for example, the Prenomics course. Overall weā€™re pleased with the increase in understanding but are looking at how we can make things even clearer during the course, to boost confidence even further.

    +

    Upcoming courses We will be running our Metagenomics course again from Tuesday 11 April until Friday 21 April 2023. This course is aimed at environmental scientists looking to use high performance computing for metagenomics analysis, but would be suitable for anyone with an interest in metagenomics. āž”ļø Register here! ā¬…ļø

    +

    We will also be running a workshop on Statistically Useful Experimental Design on Friday 14 April 2023. This course will be held in-person at University of York campus and is primarily discussion-based. āž”ļø Register here! ā¬…ļø

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2023-04-19a/index.html b/blogs/2023-04-19a/index.html new file mode 100644 index 0000000..498e924 --- /dev/null +++ b/blogs/2023-04-19a/index.html @@ -0,0 +1,425 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Cloud-SPAN Code Retreat 19/04/23 Sarah Dowsland We are excited to announce that our next Code Retreat will take place at 10:30-15:00 on 31st May 2023 at the University of York. It provides a chance for course alumni to come together and work on their own data problems with the support of Cloud-SPAN instructors.

    +

    What happens at a Code Retreat?

    +

    At previous retreats some people took the opportunity to revisit course materials and ask questions about the topics they didnā€™t understand. There are plenty of helpers on hand to answer questions and test understanding.

    +

    You could also apply the workflows and analyses taught in the Genomics course to your own datasets. Helpers are also on hand to discuss topics such as:

    +

    how to organise bioinformatics projects;

    +

    which tools are most effective;

    +

    how to approach a problem;

    +

    what analysis is best for a certain type of data;

    +

    as well as many others.

    +

    Some participants already know what help they will need and have specific questions to address during the day. Those with a less clear understanding of their problem could benefit from talking through their data and getting guidance from our experienced instructors. You could even try out new software tools.

    +

    What do previous participants have to say?

    +

    ā€œI had a great time at the Cloud-Span retreat. I went from Lancaster just for it, and it was worth it. I got support in analysing the data I had in hand. That was really satisfying applying what we preciously learned (using our data this time). Having the Cloud-Span Team around to support us was essential. Itā€™s been great learning with them, and I would 100% recommend them!ā€

    +

    Join us for our next event!

    +

    Our next Code Retreat for Cloud-SPAN Alumni will take place 10:30-15:00 on 31st May 2023 at the University of York. Feel free to stay for the whole event or drop in when you are free. Lunch will be provided and we offer support to cover travel expenses.

    +

    Registration deadline - 12pm Wednesday 24th May.

    +

    Sign up using the registration form.

    +

    Training courses

    +

    If you are interested in attending our free training courses>> please visit our website for further information.

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2023-04-19b/index.html b/blogs/2023-04-19b/index.html new file mode 100644 index 0000000..6db99d5 --- /dev/null +++ b/blogs/2023-04-19b/index.html @@ -0,0 +1,411 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    NorthernBUG Meeting 19/04/23 Sarah Dowsland Hi everyone! We are pleased to announce that registration is open for the 9th NorthernBUG Meeting! Itā€™s a great opportunity to meet people and network so we hope to see you all there! Please spread this widely among your networks so we can maximize the reach.

    +

    Meeting Details šŸ“ University of Liverpool šŸ“… 16th June 2023 ā„¹ļø View more information here āœØ Confirm your attendance (registration deadline 31 May 2023)

    +

    NorthernBUG is a really useful and free meeting where lots of people working on bioinformatics get a chance to get together. More importantly, because the meeting is free, registration early is essential so that the appropriate level of catering can be ordered. So if youā€™re interested in going, please register by the 31st of May. If you would like to give a poster/talk the deadline for this is the 30th of April. There will be prizes for posters so it is well worth submitting for a poster. NorthernBUG is a great event to go to whether you are completely new to bioinformatics or a seasoned bioinformatician.

    +

    For further information please contact Emily.Johnson@liverpool.ac.uk or jamie.soul@liverpool.ac.uk for more details if needed.

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2023-04-26/index.html b/blogs/2023-04-26/index.html new file mode 100644 index 0000000..e5cc669 --- /dev/null +++ b/blogs/2023-04-26/index.html @@ -0,0 +1,410 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    Congratulations to James Chong and the team! 26/04/23 Sarah Dowsland Professor James Chong selected as an Oracle Research Fellow Cloud-SPAN PI, Prof James Chong has recently been selected (as one of three globally) Oracle for Research Fellows for their Spring 2023 cohort. This industrially-funded fellowship includes a cash award of $100,000 (Ā£81,000) and Ā£132,200 of Oracle Cloud compute credits for a project entitled Using shotgun metagenomics data to develop a synthetic anaerobic digestion (AD) community.

    +

    Although James officially holds the award, the successful application was a team effort driven by Dr Sarah Forrester and Annabel Cansdale, both part of the Centre of Excellence for Anaerobic Digestion (CEAD) and Cloud-SPAN Instructors, who were heavily involved in preparing the application, and who will make use of the Cloud compute award throughout this project.

    +

    Read more about the Spring 2023 Oracle Fellows Program cohort!

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2023-05-09/index.html b/blogs/2023-05-09/index.html new file mode 100644 index 0000000..c9c72f4 --- /dev/null +++ b/blogs/2023-05-09/index.html @@ -0,0 +1,408 @@ + + + + + + + + + +Cloud-SPAN ā€“ index + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    +
    + +
    + +
    + + + + +
    + + + +

    šŸ—“ļø Save the date 20th June! šŸ—“ļø NEW online workshop - Introduction to R 09/05/23 Sarah Dowsland Save the date - registration opening soon! Join us for this free online two-hour workshop which provides an introduction to R for complete beginners. By the end of the course you will be able to; find your way around RStudio use the basic data types and structures in R organise your work with scripts and projects import data, summarise it and create and format a graph The workshop assumes no prior experience of coding. We allow plenty of time for questions and we provide a high level of support for each learner. The workshop will be delivered by Emma Rand, an excellent instructor with a passion for teaching. Event details šŸ’» Core R Workshop šŸ—“ļø Tuesday 20th June 2023 šŸ•‘ 2-4 pm šŸ“ Online Places available There are 30 places available for this online course. Priority will be given to NERC funded students and researchers, as well as researchers from underrepresented groups, although we encourage everyone to apply. Application deadline: Friday 9th June. Applicants will be notified by Tuesday 13th June if they have been allocated a place. Registration fee This workshop is funded by the Natural Environment Research Council (NERC) and therefore it is free to attend for candidates based in the UK. How to register Registration will open shortly; an online registration form will be available on the Cloud-SPAN website. If you so wish, you can also register your interest in the workshop and we will contact you when registration opens. Keep in touch! LinkedIn Twitter Cloud-SPAN website

    + + + +
    + +
    + + + + + \ No newline at end of file diff --git a/blogs/2023-10-17/index.html b/blogs/2023-05-11/index.html similarity index 100% rename from blogs/2023-10-17/index.html rename to blogs/2023-05-11/index.html diff --git a/listings.json b/listings.json index f01725d..32219a3 100644 --- a/listings.json +++ b/listings.json @@ -14,7 +14,27 @@ { "listing": "/blogs.html", "items": [ - "/blogs/2023-10-17/index.html", + "/blogs/2023-05-09/index.html", + "/blogs/2022-06-29/index.html", + "/blogs/2022-06-14/index.html", + "/blogs/2022-07-06/index.html", + "/blogs/2022-08-31/index.html", + "/blogs/2022-11-07/index.html", + "/blogs/2023-05-11/index.html", + "/blogs/2022-06-08/index.html", + "/blogs/2022-07-18/index.html", + "/blogs/2022-10-11a/index.html", + "/blogs/2022-10-18/index.html", + "/blogs/2022-09-05/index.html", + "/blogs/2023-02-02/index.html", + "/blogs/2022-10-11b/index.html", + "/blogs/2022-06-22/index.html", + "/blogs/2023-04-26/index.html", + "/blogs/2023-04-19b/index.html", + "/blogs/2023-04-19a/index.html", + "/blogs/2022-12-16b/index.html", + "/blogs/2022-12-16a/index.html", + "/blogs/2022-07-13/index.html", "/blogs/05-31-22/index.html", "/blogs/05-22-22/index.html", "/blogs/12-14-21/index.html", diff --git a/search.json b/search.json index 594abd4..3f4ddde 100644 --- a/search.json +++ b/search.json @@ -49,11 +49,67 @@ "text": "Challenges in Environmental ā€™Omics\n\n\n \n\nSoftware installation for data analysis is complex and involves multiple dependencies.\n\n\n\n \n\nHPC architectures vary between institutions and accessibility is a lottery.\n\n\n\n \n\nMetagenomic analyses involve large datasets and take a long time to run.\n\n\n\n \n\nBig data ā€™omics analyses using HPC are not core skills for researchers and have a steep learning curve.\n\n\n\n\n\n\n\nSolutions\n\n\n \n\nWe use cloud-based containerised instances with pre-installed software which are scalable and easy to access.\n\n\n\n \n\nWe deliver high quality training with a low barrier to participation - absolutely zero previous experience needed!\n\n\n\n\n\n\nOur Approach\n\n\n \n\nWe offer training in both self-study and workshop formats, with a mix of online and in-person teaching\n\n\n\n \n\nWe are building a community of practice: a community of bioinformaticians who can support one another.\n\n\n\n \n\nWe are following open science principles and making our resources FAIR (findable, accessible, interoperable, reusable)." }, { - "objectID": "blogs/2023-10-17/index.html", - "href": "blogs/2023-10-17/index.html", + "objectID": "blogs/2022-07-13/index.html", + "href": "blogs/2022-07-13/index.html", "title": "Cloud-SPAN", "section": "", - "text": "Online Core R Workshop 11/05/23 Sarah Dowsland Join us for this free online two-hour workshop which provides an introduction to R for complete beginners. By the end of the course you will be able to;\nfind your way around RStudio\nuse the basic data types and structures in R\norganise your work with scripts and projects\nimport data, summarise it and create and format a graph\nThe workshop assumes no prior experience of coding.\nEvent details\nšŸ’» Core R Workshop\nšŸ—“ļø Tuesday 20th June 2023\nšŸ•‘ 2-4 pm\nšŸ“ Online\nRegistration\nThere are 30 places available for this online course. Priority will be given to NERC funded students and researchers, as well as researchers from underrepresented groups, although we encourage everyone to apply.\nApplication deadline: 12pm Monday 5th June. Applicants will be notified by Tuesday 6th June if they have been allocated a place. Scholarships and funding for headsets and monitors will be available.\nā–¶ļø Registration is now closed." + "text": "Challenges in Environmental ā€˜Omics 13/07/22 Evelyn Greeves Hardware The size and nature of ā€˜omics data means it is often necessary to employ high performance computing (HPC) resources for analysis. This presents an inherent challenge as use of such resources requires a specific skill set that not all researchers will have (see ā€˜skillsā€™ below for more details).\nA secondary challenge relating to hardware is the rapidly changing HPC landscape. Between institutions HPC architectures can vary wildly. Although the basic skills needed to access them remain the same, the setup and execution of jobs may look quite different. Even within institutions, HPC setups mature and are replaced regularly as new technologies develop and the demand for resources grows. For example, the Biology department at the University of York has had access to three different setups (c2d2, YARCC and Viking) in the last nine years, with a new iteration (Viking2) currently in the works. This frequent turnover requires users to continually adjust and adapt their workflows to the new system.\nSoftware There are several issues surrounding the software involved in analysis of environmental omics datasets. Firstly, software tends to have a steep learning curve, requiring a substantial time investment for researchers. This investment will not necessarily always pay off, if the end result is not what is required.\nSecondly, even if a piece of software does do what is needed, it is not guaranteed that it will be usable on the HPC architecture available. Installation of software is not always straightforward, if it is allowed in the first place. The rapid turnover and replacement of HPC architectures only serves to compound this problem, and the heterogeneity of HPC setups between institutions makes it difficult to find bespoke instructions for software installation.\nThe final, broader issue is around access to learning resources and tutorials. Some popular, non-field-specific tools such as R or Python have countless online tutorials and instructions dedicated to their use, aimed at all different levels of understanding. Others, especially more niche software programs, have very few resources. Those that do exist may be out of date, or assume a level of knowledge beyond that of most novices (for example, many documentation pages are entirely inaccessible to a newcomer). As new software emerges and supersedes previously popular programs, the lack of help available only worsens.\nSkills As previously mentioned, environmental omics analysis has a steep learning curve. A major challenge for many new researchers is grappling with previously unencountered skills such as using the UNIX command line, navigating file systems, writing shell scripts, grappling with dependencies and specifying resources for HPC. This is all before any specific pieces of software are involved, each of which will require its own set of skills and understanding.\nThese skills are required on top of the experimental design and data collection skills needed to generate datasets in the first place. Often those collecting data are the ones best placed to know how to interrogate it, as all experiments are different and bespoke analysis is crucial. This requires researchers to learn and juggle a large collection of skills, not all of which are immediately relevant to their chosen area of study.\nTime Finally, there are time investments involved in all of the above challenges. There is the ā€˜brain timeā€™ involved in learning new skills, problem-solving and working with new software. Then, once an analysis is ready to run, it will take time to run. HPC resources are usually shared across many users, with jobs being added to a queue to run when resources are available - analyses requiring large amounts of compute may be queued for days or weeks waiting for the required resources to come available. In addition, some analyses take a long time to run given the size of the datasets involved and the complexity of the analysis.\nOnce analysis is completed time must be invested in interpreting and visualising the results. If parameters need to be adjusted following this, then the whole process must begin again. This makes optimisation of analysis difficult and time-consuming to the point that it may not even happen at all.\nAt Cloud-SPAN our goal is to help you overcome these challenges. Read more about the courses we offer or take a look at our introductory ā€˜Prenomicsā€™ course materials or specialised Genomics course to see how our training can equip you better!" + }, + { + "objectID": "blogs/2022-12-16b/index.html", + "href": "blogs/2022-12-16b/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Cloud-SPAN Code Retreat 16/12/22 Sarah Dowsland We are excited to announce that our next Code Retreat will take place on Monday 9th January 2023 at the University of York. It provides a chance for course alumni to come together and work on their own data problems with the support of Cloud-SPAN instructors.\nWhat happens at a Code Retreat? At previous retreats some people took the opportunity to revisit course materials and ask questions about the topics they didnā€™t understand. There are plenty of helpers on hand to answer questions and test understanding.\nYou could also apply the workflows and analyses taught in the Genomics course to your own datasets. Helpers are also on hand to discuss topics such as:\nhow to organise bioinformatics projects;\nwhich tools are most effective;\nhow to approach a problem;\nwhat analysis is best for a certain type of data;\nas well as many others.\nSome participants already know what help they will need and have specific questions to address during the day. Those with a less clear understanding of their problem could benefit from talking through their data and getting guidance from our experienced instructors. You could even try out new software tools.\nWhat do previous participants have to say? ā€œI had a great time at the Cloud-Span retreat. I went from Lancaster just for it, and it was worth it. I got support in analysing the data I had in hand. That was really satisfying applying what we preciously learned (using our data this time). Having the Cloud-Span Team around to support us was essential. Itā€™s been great learning with them, and I would 100% recommend them!ā€\nJoin us for our next event! Our next Code Retreat for Cloud-SPAN Alumni will take on 10:30-15:30, Monday 9th January 2023 at the University of York. Feel free to stay for the whole event or drop in when you are free. Lunch will be provided and we offer support to cover travel expenses.\nSign up using the registration form\nTraining courses If you are interested in attending our free training courses please visit our website for further information." + }, + { + "objectID": "blogs/2023-04-19b/index.html", + "href": "blogs/2023-04-19b/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "NorthernBUG Meeting 19/04/23 Sarah Dowsland Hi everyone! We are pleased to announce that registration is open for the 9th NorthernBUG Meeting! Itā€™s a great opportunity to meet people and network so we hope to see you all there! Please spread this widely among your networks so we can maximize the reach.\nMeeting Details šŸ“ University of Liverpool šŸ“… 16th June 2023 ā„¹ļø View more information here āœØ Confirm your attendance (registration deadline 31 May 2023)\nNorthernBUG is a really useful and free meeting where lots of people working on bioinformatics get a chance to get together. More importantly, because the meeting is free, registration early is essential so that the appropriate level of catering can be ordered. So if youā€™re interested in going, please register by the 31st of May. If you would like to give a poster/talk the deadline for this is the 30th of April. There will be prizes for posters so it is well worth submitting for a poster. NorthernBUG is a great event to go to whether you are completely new to bioinformatics or a seasoned bioinformatician.\nFor further information please contact Emily.Johnson@liverpool.ac.uk or jamie.soul@liverpool.ac.uk for more details if needed." + }, + { + "objectID": "blogs/2022-06-22/index.html", + "href": "blogs/2022-06-22/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Bioinformatics Meeting on ā€˜Career pathways into bioinformaticsā€™ 22/06/22 Sarah Dowsland\nJoin the University of Yorkā€™s Bioinformatics Meeting on ā€˜Career pathways into bioinformaticsā€™.\nHosted by Sarah Forrester, we have a jam packed hour and a half.\nEvelyn Greeves from the Cloud-SPAN team will be leading a short session on ā€œIntroduction to FAIR and metadataā€ with an opportunity for you to ask any questions that you may have.\nFollowing this, have you pondered what direction to take your career or how to use your data skills in future projects? We have 3 speakers who explain how data analysis has been incorporated into their work.\nšŸ”ø Emma Rand highlights the different paths into academia and using big data skills.\nšŸ”ø James Chong explains how learning bioinformatics was the only way to get past the bottleneck of being able to analyse data he was generating.\nšŸ”ø Sarah Forrester explores how bioinformatics opens doors to moving between different research niches.\nWe will then have a discussion with all speakers for the remainder of the session, which will include signposting resources.\nSession slides will be available following the event.\nEvent details: Wednesday, 6th July, 15:00-16:30 in room B/T/019 University of York.\nContact us on cloud-span-project@york.ac.uk to be added to the Bioinformatics regular mailing list!" + }, + { + "objectID": "blogs/2022-10-11b/index.html", + "href": "blogs/2022-10-11b/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Scholarships, funding and so much more! 11/10/22 Sarah Dowsland Here at Cloud-SPAN HQ our official tagline is that we are here to upskill researchers and enable them to perform complex analyses on cloud-based platforms. Which we are achieving through the provision of training courses and online modules. However, as a member of the team who works behind the scenes as project manager, I feel that we are offering much more than that.\nWelcoming learning environment Up until now we have delivered courses online and held code retreats in person. The course materials and delivery are excellent thanks to our talented instructors. I find the real added value here is that the learning environment is very welcoming, encouraging and inclusive. A lot of our participants are complete beginners or new to this world of big data, command line and cloud computing. And learning such new skills could be very daunting for some. At our courses there arenā€™t any big egos, thereā€™s just someone there to work through questions and find solutions to your problems.\nCommunity We can see that through the provision of these events it has created valuable networks between the learners. We know that on an everyday basis they may be the only one in their lab or team working on this type of work and they lack contact with a colleague where they can chat through ideas or get some advice. We offer a Slack channel, weekly online help sessions and code retreats to help support learners. We are also pleased to be working closely with SSI, NorthernBUG, EBnet and University of York Bioinformatics Group which also enables learners a wider access to learning resources and opportunity to network.\nEquality and diversity When organising courses and online sessions we strive to accommodate individualsā€™ specific needs to ensure that all learners have the same equal access and opportunities to our learning resources. We recognise that unfortunately it is still the case that women, members of the LGBTQ community, people with disabilities and those from ethnic-minorities or socially-disadvantaged groups are consistently underrepresented in research and HPC. To try and combat this, we offer Equality and Diversity Scholarships to help those from underrepresented groups to support costs related to completing the training courses such as travel, childcare etc.\nFunding We understand that financial hardship and lack of available funding is a key player in preventing people accessing and attending training activities, a problem which has been exacerbated by the recent increases in cost of living. Therefore we have recently introduced Hardship Scholarships which are available to anyone who requires financial assistance to attend Cloud-SPAN courses and events. Scholarships can be used to cover travel, childcare or general costs associated with completing the training.\nHow to apply for funding Check your eligibility on the scholarships page on our website. To apply for funding please complete the course registration form and include the relevant information in the scholarship section. All applications received before the Scholarship deadline will be reviewed by the Scholarship Panel.\nUpcoming scholarship deadlines šŸ”· Scholarship deadline 13 March Metagenomics with High Performance Computing 11-21 April (Online workshop)\nšŸ”· Scholarship deadline 31 March Statistically useful experimental design 14 April 2023 (University of York)\nAny questions get in touch cloud-span-project@york.ac.uk or follow us @SpanCloud" + }, + { + "objectID": "blogs/2022-09-05/index.html", + "href": "blogs/2022-09-05/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Cloud-SPAN awarded NERC funding to expand training courses 05/09/22 Sarah Dowsland The Cloud-SPAN team has been awarded a grant to expand our training to the Natural Environment Research Council (NERC) remit under the Advanced training for early-career environmental scientists call. We will be developing an accessible online course ā€œGetting started with High Performance Computing: FAIR training for environmental scientistsā€ using the same cloud-based infrastructure used in our other courses. We will supply AWS services to up to 60 participants undertaking the course either in tutor-led workshops or by self-study.\nThose needing funds for childcare or accessibility to enable their participation in the training will be able apply for a Scholarship and up to 30 participants will receive headsets and second monitors facilitate online engagement. The course will be running in April 2023 - please let your ecology colleagues know to look out for the course!\nKey info šŸ”· Metagenomics with High Performance Computing ā–¶ 11-21 April (Online workshop)\nšŸ”· Scholarship deadline 13 March\nšŸ”· Register for the online workshop\nšŸ”· Register for the self-study mode" + }, + { + "objectID": "blogs/2022-10-11a/index.html", + "href": "blogs/2022-10-11a/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "šŸ“¢ Online workshop on FAIR data hosted by the UK Reproducibility Network 11/10/22 Sarah Dowsland Just to let you know regarding an event happening on Wednesday 19th October which might be of interest: the UK Reproducibility Network are running an online workshop on FAIR data in the life sciences which should be really informative and useful. Youā€™ll learn about what FAIR data is, why itā€™s important and where you can go for further training on this issue. Plus, our very own Cloud-SPANā€™s Evelyn Greeves will be talking about Cloud-SPAN and how weā€™ve made our courses FAIR!\nIf youā€™re:\nšŸ‘©ā€šŸ”¬šŸ‘©šŸæā€šŸ”¬šŸ‘ØšŸ½ā€šŸ”¬ someone who produces and analyses data šŸ“Š a bioinformatician šŸ‘©šŸ»ā€šŸ’»šŸ‘ØšŸ¾ā€šŸ’» a research software engineer šŸ”¢ a statistician\nthen this workshop is for you. You can read more about the workshop here and register to attend here. We hope to see some of you there!\nUpcoming Cloud-SPAN Courses\nPrenomics: 22-23 November 2022 (online workshop or complete via self-study)\nGenomics: 6-7 December 2022 (in-person workshop or complete via self-study)\nGenomics self-study: registration now open - start at anytime" + }, + { + "objectID": "blogs/2022-06-08/index.html", + "href": "blogs/2022-06-08/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "More online computational training for life scientists! 08/06/22 Emma Rand\nThe Cloud-SPAN team would like to let you know about more opportunities for online training! Ed-DaSH from the University of Edinburgh, is a Data Science training programme for Health and Biosciences funded under the same scheme as Cloud-SPAN (UKRI innovation scholars award). Like Cloud-SPAN, Ed-DaSH is partnered with the The Software Sustainability Institute and you will find similarities in our approach to teaching computational topics to life scientists. Their upcoming workshops are:\n13:00-17:00 14-17 June ā€“ FAIR in (Biological) Practice\n10:00-13:00 5-8 July ā€“ Introduction to Statistics with R (this is a course written by Cloud-SPANā€™s Emma Rand and Univerity of York Biology PhD student Ezra Herman)\n09:30-13:00 26-29 July ā€“ High dimensional statistics with R\n13:00-16:00 23-26 August ā€“ Machine learning\nYou can register via the University of Edinburgh ePay system - the courses are free but have a refundable deposit. Contact them at ed-dash@ed.ac.uk or on Twitter @EdDaSH_Training, with any questions" + }, + { + "objectID": "blogs/2022-11-07/index.html", + "href": "blogs/2022-11-07/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "How do we support our learners? 07/11/22 Evelyn Greeves Learning new skills can be difficult, and itā€™s easy to go away from a course feeling like youā€™re even more confused than when you started! Hereā€™s what do we do at Cloud-SPAN to make sure all our learners complete our courses feeling confident in their newly-learned skills.\nPrenomics Are you completely new to concepts like cloud computing and the command line? Our Prenomics course is designed to give you the best possible start to your command line journey. It requires absolutely zero prior knowledge or experience! We take it slow, starting at the beginning with file paths and directories before building up to logging onto the cloud for the first time. Once youā€™re logged on, we take you through all the core commands you need to work in the command line effectively.\nAll of this is done using the same files and environment as the Genomics course, meaning that youā€™ll feel extra prepared to continue your learning.\nLive Coding We use a technique called live coding to teach all our courses. This means that you code along with us, copying what we type and seeing the output in real time on your own computer. Live coding keeps things interesting and gives you lots of practice at the new skills weā€™re teaching you. In addition, it means that we can help solve any errors you come across as we go through the course.\nInstructors and Helpers Each of our courses is led by one or two experienced instructors, who will do most of the teaching and live coding. Thereā€™ll also be several helpers, who are there to help you with any problems you encounter. No problem is too small! We want you to succeed, and weā€™ll try our best to get you there.\nCode Retreats After finishing one of our courses, your next thought should be ā€œwhat nextā€? Itā€™s likely that youā€™ll want to apply the techniques you just learned to your own research data. If so, you can get help with this by attending a Code Retreat, where our instructors will be happy to help you work on your own analyses. If you have any questions, weā€™ll do our best to get them answered. Code Retreats are also a great networking opportunity where you can meet others working on similar projects to your own and share problems, achievements and tips for success.\nDrop-ins Some of our courses have regular online drop-in sessions where you can get help and troubleshoot your problems. How this works varies depending on the course.\nFor our ā€˜Metagenomicsā€™ course, drop-ins occur once a week for the month-long duration of the taught course. We run it like this because some of the analyses can take a long time, so it would be impractical to teach in long blocks. Instead, we let you run these time-consuming analyses in your own time (they can run in the background of your usual work!).\nFor our self-taught ā€˜Create Your Own AWS Instanceā€™ course, troubleshooting drop-ins happen online once a week. You get access to this useful resource when you register.\nSlack Channel Participating in a Cloud-SPAN course also gives you access to our Slack channel, where you can ask more questions and keep up with the latest news. We also share links to other training and workshops which we think might be useful for our learners. Itā€™s a friendly, supportive environment and the best place to get your questions answered outside of the course itself.\nHow to Get Involved If you like the sound of all this, why not sign up for one of our free courses today? Our full catalogue of courses is listed on our website.\nUpcoming Courses Prenomics āž” 22-23 November 2022 (online workshop or complete via self-study)\nGenomics āž” 6-7 December 2022 (in-person workshop or complete via self-study)\nGenomics self-study āž” registration now open - start at anytime" }, { "objectID": "blogs/05-22-22/index.html", @@ -62,6 +118,34 @@ "section": "", "text": "We are pleased to announce that the registration for Genomics self-study is now live!Ā \nHere at Cloud-SPAN we recognise that all learners are individuals with specific needs and different levels of ability. This is why we have developed a Genomics ā€˜self-studyā€™ option, where you can create your own schedule and learn at your own pace. These modules teach data management and analytical skills for genomic research.Ā \nHereā€™s how to get involved:\n\nStep 1 - Register!šŸ“\nThe educational materials are available free of charge, however we ask that you complete the registration form so we are able to send you updates and useful information.Ā \n\n\nStep 2 - Create your own instanceā›…\nStart with the ā€˜Create your own instanceā€™ module, where you receive a step by step guide to creating your own Amazon Web Services instance. You will go on to use this instance to complete the subsequent Prenomics and Genomics modules.Ā Ā \n\n\nStep 3 - Prenomics šŸ’»\nIf you are new to the realm of navigating file systems and using the command line we recommend that you complete the Prenomics module. We have designed this module to allow more time for those with less experience to cover some foundation concepts. If you arenā€™t sure how to gauge your skills take the self-assessment quiz to help you decide.Ā \n\n\nStep 4 - GenomicsšŸ§¬\nĀ The Genomics module allows you to move on to the more fun stuff as you develop your skills in managing data. You will tackle tasks such as assessing read quality, trimming and filtering, and variant calling.Ā \n\n\nStep 5 - Community šŸ¤øā€ā™‚ļø\nAfter completing the modules we hope that you will be able to attend one of our regular code retreats, where our course instructors will be on-hand to help solve any issues you encounter while applying your new skills to your own datasets. We also strongly encourage you to take advantage of our welcoming Cloud-SPAN community, so donā€™t be afraid to lean on your peers for help or discussions on our forum.Ā \n\n\nNeed support?\nJoin the Cloud-SPAN Slack workspace (you will receive a link upon registering), post on the forum or follow us on social media. All three are good options for you to continue on your mission to master the art of genomics!\nView the website for further information or drop us an email at cloud-span-project@york.ac.uk if you have any questions." }, + { + "objectID": "blogs/2022-07-06/index.html", + "href": "blogs/2022-07-06/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Making the Prenomics summary poster 06/07/22\nI recently designed a poster that acts as a ā€œcheat sheetā€ for Cloud-SPANā€™s Prenomics course. Here Iā€™ll give a quick overview of my thought process while making the poster and how I chose what to include.\nCommand cheatsheet I started with the command cheatsheet, which is a bit back-to-front given that the command line comes chronologically last in the course. However, it seemed like an easy entry point. I had previously produced a glossary for Prenomics, so I took this and organised the commands into logical groupings based on their function.\nI ended up with four groups: navigating files, viewing files, editing files and searching files. There were two commands which didnā€™t fit into these groups, which were history and man. I tried to find a way to include them, but ultimately left them out as I decided they were not crucial knowledge.\nI tried to format the commands in a way that made it clear how to use them while still keeping it general and easily readable. I used colour to clarify which parts of the command corresponded to which parts of the explanation. For example:\nExample from poster showing the command mv file directory and the explanation ā€˜move file to directoryā€™. In this case ā€˜fileā€™ (the file to be moved) is pale blue while ā€˜directoryā€™ (the location to which the file should be moved) is dark blue. I also used underlining to indicate where the command came from - in this case, mv comes from the m and the v of ā€˜moveā€™. My aim here was to aid recall of the command in future, as hopefully it will help the reader make a stronger mental connection between the command mv and its function (ā€˜move a fileā€™).\nFiles, paths and file types The command line makes up a significant portion of the Prenomics course, but it could be summarised in a relatively small amount of space. To work out what else should be included, I looked at the course more holistically. The first lesson of the course is about files and directories, so it was clear to me that there needed to be a section about this. This lesson also covers the file types used in the course, including .FASTQ and .PEM files which are likely to be new to most learners, so I wanted to include this too.\nI found it difficult to summarise the information about file paths and directories into a mostly graphical format. In particular, I found that I couldnā€™t rely on giving examples as much as we do in the course itself, due to the need to reduce text as much as possible. I ended up just including definitions of absolute and relative paths, along with a diagram of the file system inside the Cloud-SPAN AWS instance.\nIf Iā€™d had space, I would have included more information on working directories and examples of how the file system diagram can be represented with file paths.\nWhy useā€¦? The next sections I designed were the ā€˜Why learn command line?ā€™ and ā€˜Why use the cloud?ā€™ sections.\nThe question of why the command line is useful is covered in episode three of the first day of Prenomics, as part of the introduction to the shell. I distilled the reasons given here down into four main themes: automation of repetitive tasks, reducing human error (as a result of automation), improving reproducibility and the ability to access new tools (either because the command line offers more functionality or because it opens up use of high performance computing systems (HPC) such as the cloud).\nExtract from poster section ā€˜Why learn command line?ā€™. Icons and text give four reasons: improve reproducibility, reduce human error, access new tools, and automate repetitive tasks. The other question- why cloud computing is useful- is not technically covered in Prenomics material. However, it is discussed in our Genomics course, where the three reasons given for using HPC are lack of resources needed to run analyses, analyses taking a long time to run and problems installing software. These reasons align closely with three of the challenges identified by Cloud-SPAN project lead, James Chong, as facing the field of metagenomics (hardware, time and software).\nHowever, these reasons could actually be used as a reason to use any kind of HPC resource, not just the cloud. I wanted to include reasons specific to the cloud. The two major reasons I came across were the ability to share software or data containers across different institutions, and use of the cloud when other HPC is inaccessible.\nIn an earlier version of the poster, the ā€˜why use cloud?ā€™ section was framed in terms of challenges that users might face, such as long analysis times or issues installing software. I reworded this section to match the framing of the ā€˜why learn command line?ā€™ section; that is, a solutions-oriented summary, with ā€˜shorten analysis timesā€™ replacing ā€˜long analysis timesā€™ and ā€˜use pre-installed softwareā€™ā€™ replacing ā€˜issues installing softwareā€™.\nExtract from poster section ā€˜Why use the cloud?ā€™. Icons and text give five reasons: access more hardware resources, use pre-installed software, shorten analysis time, share software or data containers, and overcome barriers to accessing high performance computing File types Lastly I wanted to include a brief summary of the file types used in the Prenomics course, as it is likely that two out of three of these will be new to learners. This part was quite easy - I just wrote a short sentence to describe each file type and paired it with the relevant file extension.\nIn the course a significant amount of time is dedicated to introducing the .fastq file structure, which codes sequencing data into a text format with four lines per read. I considered including this information but I didnā€™t have room.\nThe big revealā€¦ And finally, hereā€™s the full poster! You can download a high-res version of the poster for your own enjoyment here.\nAn image of the finished poster with sections: why learn command line?, why use the cloud?, file types, files and paths, and command cheatsheet" + }, + { + "objectID": "blogs/2022-06-14/index.html", + "href": "blogs/2022-06-14/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Cloud-SPAN April Code Retreat 14/06/22 Evelyn Greeves\nIn April we held our first code retreat event: a chance for course alumni to come together and work on their own data problems with the support of Cloud-SPAN instructors. The event took place at the University of York, with several participants travelling from other institutions for the day.\nSome people took the opportunity to revisit course materials and ask questions about the topics they didnā€™t understand. There were plenty of helpers on hand to answer questions and test understanding.\nOthers chose to apply the workflows and analyses taught in the Genomics course to their own datasets. Again, helpers were on hand to discuss topics such as:\nhow to organise bioinformatics projects;\nwhich tools are most effective;\nhow to approach a problem;\nwhat analysis is best for a certain type of data;\nas well as many others.\nSome participants knew what help they needed and had specific questions to address during the day. Those with a less clear understanding of their problem benefited from talking through their data and getting guidance from our experienced instructors. Some even tried out new software tools not discussed during the course.\nFinally, some participants decided to trial our new self-study course on creating your own Amazon Web Services cloud instance. They were able to ask questions about the content and provided valuable feedback on which parts of the course needed improvement.\nEveryone enjoyed the chance to meet new people and find out about each othersā€™ research. It was a great chance to network and build some community amongst course alumni.\nOur next code retreat for Cloud-SPAN course alumni will be on July 6th at the University of York. We cover travel expenses and lunch is provided. Weā€™re looking forward to meeting more of our community members and providing valuable one-to-one support!\nContact us at cloud-span-project@york.ac.uk to sign up.\nImage: Instructors and course alumni at Aprilā€™s code retreat." + }, + { + "objectID": "blogs/2022-06-29/index.html", + "href": "blogs/2022-06-29/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "FAIR at Cloud-SPAN 29/06/22 Evelyn Greeves\nPreviously we shared some information about FAIR data, and explained why itā€™s important to make sure your data is as reusable as possible.\nThe FAIR principles arenā€™t just for data. Our aim is to apply the principles to all our training resources to ensure that they can be reused and remixed by others for their own teaching purposes. Hereā€™s a look at how weā€™re doing it:\nFindable Remember, findability is about making it easy to find your data or resource. Weā€™ve added metadata to our resources, which enables us to register our courses with TeSS, a life sciences training repository. The metadata means people can search and filter to find our course based on what they need. You can see the metadata for our Prenomics course at the top of the source page here.\nIn addition, we have also registered our training resources on Zenodo, another repository which assigns a DOI to each stored item. This persistent identifier will give our resources a permanent home, even after other links become deprecated.\nAccessible To be accessible it needs to be easy to retrieve a resource without any special tools. It should also be clear how to do this. Weā€™ve made this really easy for ourselves by hosting our courses online for free on a dedicated set of webpages via GitHub Pages.\nInteroperable Interoperability means ensuring that computers can understand and open a resource. We do this by providing data for analysis in de facto file standards such as FASTQ and using Markdown (a widely-used and platform-independent text formatting language for writing resources) for course material.\nWe also help computers to understand how our resources fit into a bigger picture by using an ā€˜ontologyā€™ to describe the topics of our courses. This forms part of the metadata and helps people to filter and understand what our resources are about. For example, we use the EDAM ontology of bioscientific data analysis and data management. Weā€™ve labelled our Prenomics course as falling under topics 3372 (software engineering) and 0622 (genomics).\nReusable All of the things just described help promote reusability. In particular, we promote reusability by tagging our resources with rich metadata - we use the Bioschemas Training Material protocol which suggests a list of metadata properties for biosciences training materials.\nWe also help people reuse our materials by applying a Creative Commons Attribution (CC-BY) licence, which means anyone can distribute, remix, adapt or build on our work as long as they credit us. We include details of this licence in our metadata, in our GitHub repositories and at the bottom of our course pages so itā€™s clear to everyone what the rules are.\nOver to you! What steps are you taking to make your data and other digital resources as FAIR as possible? There are some great resources available online to help you if youā€™re not sure where to start - try howtofair.dk or the FAIR Cookbook for helpful articles, videos and step-by-step guides!" + }, + { + "objectID": "blogs/2023-05-09/index.html", + "href": "blogs/2023-05-09/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "šŸ—“ļø Save the date 20th June! šŸ—“ļø NEW online workshop - Introduction to R 09/05/23 Sarah Dowsland Save the date - registration opening soon! Join us for this free online two-hour workshop which provides an introduction to R for complete beginners. By the end of the course you will be able to; find your way around RStudio use the basic data types and structures in R organise your work with scripts and projects import data, summarise it and create and format a graph The workshop assumes no prior experience of coding. We allow plenty of time for questions and we provide a high level of support for each learner. The workshop will be delivered by Emma Rand, an excellent instructor with a passion for teaching. Event details šŸ’» Core R Workshop šŸ—“ļø Tuesday 20th June 2023 šŸ•‘ 2-4 pm šŸ“ Online Places available There are 30 places available for this online course. Priority will be given to NERC funded students and researchers, as well as researchers from underrepresented groups, although we encourage everyone to apply. Application deadline: Friday 9th June. Applicants will be notified by Tuesday 13th June if they have been allocated a place. Registration fee This workshop is funded by the Natural Environment Research Council (NERC) and therefore it is free to attend for candidates based in the UK. How to register Registration will open shortly; an online registration form will be available on the Cloud-SPAN website. If you so wish, you can also register your interest in the workshop and we will contact you when registration opens. Keep in touch! LinkedIn Twitter Cloud-SPAN website" + }, { "objectID": "blogs/12-14-21/index.html", "href": "blogs/12-14-21/index.html", @@ -69,6 +153,41 @@ "section": "", "text": "Well, itā€™s been a couple of weeks since we ran our first course and weā€™ve certainly learned a lot from it! Most of the problems we stumbled into were minor teething issues, but weā€™re also going to be making some fairly major changes based on what we learned. Hereā€™s a bit of an update:\n\nFirst thingā€™s first... positive feedback!\nWe had some amazing feedback from our first run-through! We asked our participants to rate their level of comfort with a number of topics before and after completing the course.\nAs you can see in the graph below, on average our participants felt that their level of comfort had improved after taking the course for all topics. This is great news!\nIn particular, participants ended the course feeling really comfortable with using the command line to navigate file directories, create and modify files and search for keywords.\n\n\n\nThe BIG Problem: Time flies\nThe biggest problem we ran into was time. We just didnā€™t have enough of it...\n...and that means we need to seriously rethink how we structure the content of our course. You can see from the graph above that the topics people felt they had improved their confidence the least in were those relating to genomics - assessing read quality, trimming and filtering, and variant calling.\nThatā€™s because before we could teach those topics, we had to make sure people felt really comfortable using the command line and organising their files. Unfortunately, as we got more and more behind schedule, this meant the genomics topics got less and less time allocated to them.\nThis is a problem, because the title of the course was Foundational Genomics. If participants are finishing our course feeling like they are not comfortable with variant calling (which is what a score of 3 means) then we need to make some changes. Plus, the genomics bit is meant to be the fun bit!\nThe written feedback we had from participants after the course, while mostly positive, generally reflected this sentiment too.\n\n\nThe BIG Solution: Course structure\nIn light of this feedback, weā€™ve decided to split our 4 x half-day Foundational Genomics course into two shorter courses: one 2 x half-day ā€œPrenomicsā€ course and one 4 x half-day ā€œGenomicsā€ course.\nThe Prenomics course will be aimed at complete beginners and will be a gentle introduction to file directories, working paths and basic command line commands. By giving ourselves two half-days to cover this content we should be able to ensure all participants are fully on board before we move onto anything more complex.\nThis course will also be optional for those who already have some basic experience using the command line. We plan to screen potential attendees using a self-test to help them determine whether they would benefit from attending the Prenomics course, or skipping straight to Genomics.\nThe Genomics course will follow directly on from Prenomics, using many of the same commands and building on them further. We should have much more time to cover essential topics such as read quality and variant calling which were rushed last time, allowing us to offer a much better educational experience.\n\n\nSome smaller problems which this change also solves...\n\nWe plan to run the Genomics course over two weeks, with 2 x half days per week. This, combined with a hopefully much less stressful volume of content to cover, will decrease pressure on our instructors and helpers, most of whom have multiple other work and teaching commitments.\nSome of our participants felt the course went far too slowly; others felt it went too fast. By screening for those who have the least experience working in the command line, we should be able to both provide more support to those who need it and stop more experienced participants from getting bored.\n\n\n\nOther updates in the pipeline\nThese two new courses, Prenomics and Genomics, will make up the ā€˜Foundationalā€™ element of our content. We still have plans to developed ā€˜Advancedā€™ modules on topics such as automation and setting up cloud instances. We asked our participants to let us know what theyā€™d like to see, and weā€™ll be taking these suggestions into account as we go.\nWe also have plans to run some (hopefully) in-person ā€˜hack daysā€™ for alumni of our Foundational courses, where we can help participants apply the skills learned in the course to their own problems, and assist in troubleshooting any problems. We hope this will help develop our community of practice further by providing opportunities for networking and building relationships.\nAnd thatā€™s it. Thanks for reading this far - we hope it explains some of our rationale for why the course is structured the way it is. Weā€™re really proud of our achievements with our first ever course, and weā€™re looking forward to trying some new stuff out next time.\nTill next time! šŸ‘‹" }, + { + "objectID": "blogs/2022-08-31/index.html", + "href": "blogs/2022-08-31/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Our Solutions to Challenges in Environmental ā€™Omics 31/08/22 Evelyn Greeves Hereā€™s what weā€™re doing at Cloud-SPAN to address the challenges we discussed previously.\nJust to recap, here are our four main challenges:\nHardware - the size and nature of ā€™omics data means high performance computing (HPC) resources are needed, which are rapidly evolving and differ between institutions.\nSoftware - software used for analysis has a steep learning curve, can be difficult to install and tends to have limited teaching resources.\nSkills - using HPC requires skills many scientists do not have, such as using the command line and specifying resources.\nTime - there are time investments needed for learning new skills, running long analysis scripts and interpreting the results.\nAt Cloud-SPAN we have two main weapons in our arsenal against these challenges: cloud computing and training. Letā€™s look at each of those in detail.\nCloud HPC We use commercially-available cloud computing resources to address the challenges of hardware, software and time.\nHereā€™s how it works: we teach our courses inside a containerised instance, which is a virtual environment containing pre-loaded software and files. The instance runs on hardware borrowed from a commercial provider (in our case, Amazon Web Services). All our learners have to do is log into the cloud instance we provide, and they will have access to all of the software and data used in the course. The instances all start out identical, so the file structure always looks the same, and they run on enough borrowed resources to make analysis relatively quick and easy.\nUsing this kind of pre-loaded instance benefits our learners by removing complications around different HPC setups and the installation of software onto a cluster. It also makes it easier for us to teach - we know that everyone is starting with the same setup, so we can offer our courses to anyone regardless of institution. It allows us to model best practices for directory structure and project organisation, and save time when troubleshooting issues.\nAnother major advantage of running analyses on cloud resources is that we donā€™t have to wait in a queue for resources to be available, as weā€™ve already loaned out the resources we need. This can save a lot of time for large analyses, and is especially useful for teaching.\nAfter completing one of our courses, learners can go away and apply their new skills to their own data by setting up their own cloud instance, which is identical to the one used in the course. It contains all the same software and basic file structures, so provides a familiar environment for further learning and analysis. Using these kinds of services outside of the course does incur a cost, but we also support learners in applying for research credits.\nTraining Our other main solution is providing high quality, free-of-charge training courses with a low barrier to entry and no assumptions of prior knowledge. These courses allow us to address challenges around skills and the skills gap.\nAll of our courses are underpinned by a core ā€˜Prenomicsā€™ module, which provides a supportive and carefully paced introduction to navigating directories and using the UNIX command line. Accessing the cloud HPC services described above is impossible without these skills. Using our purpose-built environment we guide new learners through the basics with a strong focus on contextualising new skills within the field of environmental ā€™omics.\nWe also provide core modules in using the programming language R, again with a focus on analysis and visualisation of ā€™omics data, and on creating cloud instances.\nOur specialised courses follow on from Prenomics and cover topics such as genomics, metagenomics, automating analyses and designing statistically useful experiments. Again, we keep the barrier to participation low by contextualising learning and keeping new ideas to the bare minimum - no frills!\nSummary In summary, the Cloud-SPAN project combines high-quality training with cloud computing expertise to address four major challenges in the field of environmental ā€™omics. Using our unique containerised instances we can provide adequate resources for efficient analysis with software pre-installed, saving time and effort. Our courses are designed to equip learners with the skills they need to perform analyses on these cloud instances and beyond, with the overall aim to lessen the load of learning on the backs of researchers and help them improve analysis times and efficiency.\nOur containerised instances solve the challenges of:\nHardware, by providing a harmonised HPC platform across institutions and potentially increasing the compute resources available to individuals.\nSoftware, by providing pre-installed software which removes the time-consuming step of software installation.\nTime, by speeding up analyses and eradicating the need to queue to access HPC.\nOur training approach solves the challenge of:\nSkills, by ensuring a low barrier to participation and equipping researchers with vital skills.\nFind out for yourself how our solutions to these challenges could benefit you. Read more about the courses we offer or take a look at our introductory ā€˜Prenomicsā€™ course materials or specialised Genomics course to see how our training can equip you better!" + }, + { + "objectID": "blogs/2023-05-11/index.html", + "href": "blogs/2023-05-11/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Online Core R Workshop 11/05/23 Sarah Dowsland Join us for this free online two-hour workshop which provides an introduction to R for complete beginners. By the end of the course you will be able to;\nfind your way around RStudio\nuse the basic data types and structures in R\norganise your work with scripts and projects\nimport data, summarise it and create and format a graph\nThe workshop assumes no prior experience of coding.\nEvent details\nšŸ’» Core R Workshop\nšŸ—“ļø Tuesday 20th June 2023\nšŸ•‘ 2-4 pm\nšŸ“ Online\nRegistration\nThere are 30 places available for this online course. Priority will be given to NERC funded students and researchers, as well as researchers from underrepresented groups, although we encourage everyone to apply.\nApplication deadline: 12pm Monday 5th June. Applicants will be notified by Tuesday 6th June if they have been allocated a place. Scholarships and funding for headsets and monitors will be available.\nā–¶ļø Registration is now closed." + }, + { + "objectID": "blogs/2022-07-18/index.html", + "href": "blogs/2022-07-18/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "šŸ’øScholarships to attend the Northern Bioinformatics User Group meeting 9th September 18/07/22 Emma Rand\nHello Cloud-SPAN community! We have scholarships to cover expenses to attend the Northern Bioinformatics User Group (Northern BUG) meeting to be held on September 9th 2022 at the University of Bradford.\nNorthernBUG is a network of bioinformaticians and users or bioinformatics services in the north of England which hold quarterly meetings to build a community of researchers and others using big data in biology. NorthernBUG meetings are open to anyone interested in bioinformatics or its application in life science research and beyond. Meetings are free and early career researchers are especially encouraged career to attend and present their work. Itā€™s a great forum to practice your talks, float new ideas and approaches, and present early work.\nOne of my project students, Chloe Brook, presented her work there:\nShe is now at the Edinburgh Parallel Computing Centre.\nWe have scholarships to cover travel expenses for five of our Cloud-SPAN ā€˜graduatesā€™ to attend NBUG. Register for NBUG here and complete a scholarship application with us here by Monday 22nd August." + }, + { + "objectID": "blogs/2022-10-18/index.html", + "href": "blogs/2022-10-18/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Prenomics: Lowering barriers to participation 18/10/22 Evelyn Greeves For most of our new learners, the idea of doing things like using the command line and accessing the cloud is completely new and a bit overwhelming. But these are skills which, once learned, can totally transform how you do your analysis. Thatā€™s why Cloud-SPAN offers a core ā€˜Prenomicsā€™ course to help you gain confidence in these key skills and prepare you for the Genomics course.\nHow Prenomics was born When we ran our first Genomics course in autumn 2021, we discovered that a major sticking point for many participants was directory structure and navigation. This was making it really difficult to help people log into the cloud, where we could then teach them core command line skills. We spent much more time troubleshooting and going over these basic skills than weā€™d expected, meaning we had to rush through more complex content later on about analysis tools and pipelines.\nOverall, this meant our learners began their command line journey from a place of frustration (which has a huge impact on confidence) and we were forced to minimise the amount of time spent on the ā€˜genomicsā€™ part of the Genomics course.\nAs a result, we split the original Genomics curriculum across two courses: Prenomics and Genomics. In Prenomics, all the focus is on the command line. We teach about files and directory structure, and spend lots of time guiding learners through creating a folder and navigating to it without using the command line. We also teach those crucial core skills - commonly used commands like ls, cd and mv. Later, as learners gain confidence, we move on to more complex commands like grep and redirection with > and >>.\nWhy is Prenomics important? Separating the curriculum into two courses has several benefits. Most importantly, it gives us lots more time to dedicate to core skills and troubleshooting. It also gives us more time to spend on Genomics, as learners start that course already confident about their command line abilities. Plus, those already familiar with the command line can skip Prenomics and go straight to Genomics.\nAnd it works! We know this because we collect evaluation feedback from participants both before and after the course, asking them to evaluate their understanding of various topics. After we ran the newly designed Prenomics/Genomics combo course in Spring 2022, we compared the understanding scores of learners across three general themes of Command Line, Genomics and Project Organisation (a higher number means a higher level of understanding, with no understanding being 1 and most confident understanding being 6)." + }, + { + "objectID": "blogs/2023-02-02/index.html", + "href": "blogs/2023-02-02/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "In depth: course feedback 02/02/23 Evelyn Greeves Weā€™ve finished our analysis of the feedback from our courses held at the end of last year: Prenomics, Genomics and Metagenomics. Weā€™re pleased to see that on average participants saw an improvement across all of the learning outcomes for all of our courses - if they didnā€™t weā€™d be doing something wrong!\nMethodology We ask all our learners the same questions before and after the course, asking them to rate their level of comfort with, and understanding of, a range of topics. The options range from ā€œI donā€™t understand what this involvesā€ to ā€œConfidentā€. For analysis purposes these answers are recoded as numbers with 1 being the least confident and 6 being the most confident. Weā€™re interested in the mean scores across participants and how they differ before and after the course.\nThe dumbbell charts you will see below indicate the average improvement in score for each criteria. The lighter colour circle represents the score before the course, and the darker one represents the score after the course.\nWe donā€™t currently have a way to track individual participants and how their scores change. Everything is done on averages. This gives us a good overall idea of how learnersā€™ understanding might have improved as a result of the course.\nPrenomics Overall the biggest improvements were seen in our Prenomics course, which is what we might expect. Most participants started with little to no knowledge of most of the topics discussed, and we saw their confidence soar over the two day course. Prenomics is designed to give participants a gentle introduction to the command line and provide a confidence boost for those who might feel intimidated, so weā€™re really happy to see that this seems to be working.\nIn particular participants saw a big leap in their confidence using the command line with a mean score increase of almost 3.5 points. On average learners finished the course feeling somewhere between ā€œcomfortable most of the timeā€ (5) and ā€œconfidentā€ (6), which is excellent news.\nGenomics We also saw big improvements in confidence in Genomics. We also saw great improvement in Genomics topics - approximately equal across all themes. Most participants started the course with a middling level of confidence using the command line, likely as a result of taking part in Prenomics beforehand. The average increase in score was between 2 and 2.5 points depending on the topic, with the average score after taking the course hovering around 5 - ā€œfairly comfortable most of the timeā€.\nMetagenomics The Metagenomics course feedback was of particular interest as it was the first time we had run the course, so we were keen to see how people got on. Overall, participants finished the course with an average understanding score between 4 (ā€œFairly comfortable in some aspectsā€) and 5 (ā€œComfortable most of the timeā€) for all of the topics. Most learners started the course with a higher initial understanding for core knowledge such as command line and sequencing, so the scope for improvement was more limited than in, for example, the Prenomics course. Overall weā€™re pleased with the increase in understanding but are looking at how we can make things even clearer during the course, to boost confidence even further.\nUpcoming courses We will be running our Metagenomics course again from Tuesday 11 April until Friday 21 April 2023. This course is aimed at environmental scientists looking to use high performance computing for metagenomics analysis, but would be suitable for anyone with an interest in metagenomics. āž”ļø Register here! ā¬…ļø\nWe will also be running a workshop on Statistically Useful Experimental Design on Friday 14 April 2023. This course will be held in-person at University of York campus and is primarily discussion-based. āž”ļø Register here! ā¬…ļø" + }, { "objectID": "blogs/05-31-22/index.html", "href": "blogs/05-31-22/index.html", @@ -76,6 +195,27 @@ "section": "", "text": "At Cloud-SPAN we care deeply about making science as open as possible. A lot of this comes down to project management and data organisation - which we teach as part of our Genomics course. Today we want to introduce you to the FAIR data principles, which are a framework for thinking about how to ensure the scientific community gets the most out of the data we produce. In this case, this means making it easier for people to find and reuse our hard-earned data!\nThe FAIR framework aims to encourage data reuse by both humans and computers by improving the findability, accessibility, interoperability and reusability of data and other resources. So what are the steps involved in FAIR-ifying data?\n\n\nF is for Findable\nBefore data can be reused, we need to make sure it can be found. One way to do this is by tagging it with metadata (information about the data), such as what type of data it is, who collected it, the conditions used, and so on. This allows it to be indexed in a searchable registry so more people will see it. Metadata is important for both helping people find your data and for understanding the context they were generated in.\nAnother key way to make sure data is findable is by assigning it a persistent identifier. This is a long-lasting digital reference which ensures a resource can always be found, no matter where it's stored. DOIs (digital object identifiers) are one type of persistent identifier that you have probably heard of before - they can be applied to things like journal articles, data sets and other publications.\n\n\nA is for Accessible\nOnce we've made sure people can find our data, we need to make sure they can access it if they have permission. This means making it retrievable using some kind of standardised protocol, without any need for specialised or proprietary tools. We also need to tell people how they can get access, so we should include this as one of our metadata fields.\nA common misconception is that all FAIR data is 'open' or 'free'. Heavily protected or private data can still be FAIR as long as it is clear under which conditions the data is accessible.\n\n\nI is for Interoperable\nSo now we've made it possible for someone to find and access our data. How can we make sure they can actually use it? There are two aspects to interoperability. The first is using standardised and open formats so that data can be exchanged and used across multiple different applications and systems. This means avoiding proprietary formats and conforming with field-specific standards about what format data should come in.\nThe second relates to how computers understand our data in comparison with other data. This is possible using a 'controlled vocabulary' or 'ontology' which ensures that everyone is using the same words for the same thing. Again, we should try and conform with field-specific standards around ontologies.\n\n\nR is for Reusable\nThis final principle emphasises the idea that by following the previous three principles- findable, accessible, interoperable- we should be aiming to make our data as reusable as possible. This means using accurate and richly described metadata that gives a full overview of our experimental process and data analysis workflow.\nWe should also make it clear what rights the discoverer has when reusing our data. This is achieved by applying a licence, and clearly specifying this in the metadata. For example, a Creative Commons Attribution 4.0 International licence (or CC-BY for short) lets anyone reuse, remix and adapt material as long as credit is given to the original creator.Ā \n\n\nSummary\nThe FAIR framework guides us through ensuring that our data is easy to find, easy to understand and easy to reuse. This ensures that our data is used to the fullest extent possible.\nThe FAIR principles apply to digital objects beyond just data. At Cloud-SPAN we are working hard to make sure our learning resources are as FAIR as possible. Find out what we're doing to achieve this by visiting our handbook, or look out for our next blog post!\nFurther reading:\n\nThe 10 FAIR Principles\nPaper in Nature: The FAIR Guiding Principles for scientific data management and stewardship" }, + { + "objectID": "blogs/2023-04-26/index.html", + "href": "blogs/2023-04-26/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Congratulations to James Chong and the team! 26/04/23 Sarah Dowsland Professor James Chong selected as an Oracle Research Fellow Cloud-SPAN PI, Prof James Chong has recently been selected (as one of three globally) Oracle for Research Fellows for their Spring 2023 cohort. This industrially-funded fellowship includes a cash award of $100,000 (Ā£81,000) and Ā£132,200 of Oracle Cloud compute credits for a project entitled Using shotgun metagenomics data to develop a synthetic anaerobic digestion (AD) community.\nAlthough James officially holds the award, the successful application was a team effort driven by Dr Sarah Forrester and Annabel Cansdale, both part of the Centre of Excellence for Anaerobic Digestion (CEAD) and Cloud-SPAN Instructors, who were heavily involved in preparing the application, and who will make use of the Cloud compute award throughout this project.\nRead more about the Spring 2023 Oracle Fellows Program cohort!" + }, + { + "objectID": "blogs/2023-04-19a/index.html", + "href": "blogs/2023-04-19a/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "Cloud-SPAN Code Retreat 19/04/23 Sarah Dowsland We are excited to announce that our next Code Retreat will take place at 10:30-15:00 on 31st May 2023 at the University of York. It provides a chance for course alumni to come together and work on their own data problems with the support of Cloud-SPAN instructors.\nWhat happens at a Code Retreat?\nAt previous retreats some people took the opportunity to revisit course materials and ask questions about the topics they didnā€™t understand. There are plenty of helpers on hand to answer questions and test understanding.\nYou could also apply the workflows and analyses taught in the Genomics course to your own datasets. Helpers are also on hand to discuss topics such as:\nhow to organise bioinformatics projects;\nwhich tools are most effective;\nhow to approach a problem;\nwhat analysis is best for a certain type of data;\nas well as many others.\nSome participants already know what help they will need and have specific questions to address during the day. Those with a less clear understanding of their problem could benefit from talking through their data and getting guidance from our experienced instructors. You could even try out new software tools.\nWhat do previous participants have to say?\nā€œI had a great time at the Cloud-Span retreat. I went from Lancaster just for it, and it was worth it. I got support in analysing the data I had in hand. That was really satisfying applying what we preciously learned (using our data this time). Having the Cloud-Span Team around to support us was essential. Itā€™s been great learning with them, and I would 100% recommend them!ā€\nJoin us for our next event!\nOur next Code Retreat for Cloud-SPAN Alumni will take place 10:30-15:00 on 31st May 2023 at the University of York. Feel free to stay for the whole event or drop in when you are free. Lunch will be provided and we offer support to cover travel expenses.\nRegistration deadline - 12pm Wednesday 24th May.\nSign up using the registration form.\nTraining courses\nIf you are interested in attending our free training courses>> please visit our website for further information." + }, + { + "objectID": "blogs/2022-12-16a/index.html", + "href": "blogs/2022-12-16a/index.html", + "title": "Cloud-SPAN", + "section": "", + "text": "šŸ’øScholarships to attend the Northern Bioinformatics User Group meeting 13th Jan 16/12/22 Sarah Dowsland We have scholarships to cover expenses to attend the Northern Bioinformatics User Group (Northern BUG) meeting to be held on Friday 13th January 2023 at the University of Huddersfield.\nNorthernBUG is a network of bioinformaticians and users or bioinformatics services in the north of England which hold quarterly meetings to build a community of researchers and others using big data in biology. NorthernBUG meetings are open to anyone interested in bioinformatics or its application in life science research and beyond. Meetings are free and early career researchers are especially encouraged career to attend and present their work. Itā€™s a great forum to practice your talks, float new ideas and approaches, and present early work.\nWe have scholarships to cover travel expenses for five of our Cloud-SPAN ā€˜graduatesā€™ to attend NBUG. Register for NBUG and complete a scholarship application with us here by Thursday 5th January 2023.\nIf you are interested in attending our free training courses please visit our website for further information." + }, { "objectID": "self_study_courses.html", "href": "self_study_courses.html", diff --git a/sitemap.xml b/sitemap.xml index 2dfe154..2102d56 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -2,82 +2,162 @@ https://cloud-span.github.io/cloud-span-quarto-site/upcoming_courses.html - 2023-10-17T08:47:19.992Z + 2023-10-17T10:14:47.980Z https://cloud-span.github.io/cloud-span-quarto-site/upcoming/NERC Metagenomics/index.html - 2023-10-17T08:47:19.052Z + 2023-10-17T10:14:47.132Z https://cloud-span.github.io/cloud-span-quarto-site/about.html - 2023-10-17T08:47:17.472Z + 2023-10-17T10:14:45.804Z https://cloud-span.github.io/cloud-span-quarto-site/contact-us.html - 2023-10-17T08:47:15.900Z + 2023-10-17T10:14:44.388Z https://cloud-span.github.io/cloud-span-quarto-site/self_study/Genomics/index.html - 2023-10-17T08:47:14.316Z + 2023-10-17T10:14:42.444Z https://cloud-span.github.io/cloud-span-quarto-site/self_study/Create Your Own AWS Instance/index.html - 2023-10-17T08:47:13.576Z + 2023-10-17T10:14:41.808Z https://cloud-span.github.io/cloud-span-quarto-site/cloud-span-aims.html - 2023-10-17T08:47:12.412Z + 2023-10-17T10:14:40.788Z - https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-10-17/index.html - 2023-10-17T08:47:10.892Z + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-07-13/index.html + 2023-10-17T10:14:39.528Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-12-16b/index.html + 2023-10-17T10:14:38.776Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-04-19b/index.html + 2023-10-17T10:14:38.068Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-06-22/index.html + 2023-10-17T10:14:37.388Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-10-11b/index.html + 2023-10-17T10:14:36.596Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-09-05/index.html + 2023-10-17T10:14:35.788Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-10-11a/index.html + 2023-10-17T10:14:35.036Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-06-08/index.html + 2023-10-17T10:14:34.380Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-11-07/index.html + 2023-10-17T10:14:33.724Z https://cloud-span.github.io/cloud-span-quarto-site/blogs/05-22-22/index.html - 2023-10-17T08:47:09.984Z + 2023-10-17T10:14:32.860Z - https://cloud-span.github.io/cloud-span-quarto-site/blogs/blog post 4/index.html - 2023-10-17T08:47:09.140Z + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-07-06/index.html + 2023-10-17T10:14:32.144Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-06-14/index.html + 2023-10-17T10:14:31.356Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-06-29/index.html + 2023-10-17T10:14:30.504Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-05-09/index.html + 2023-10-17T10:14:29.756Z https://cloud-span.github.io/cloud-span-quarto-site/blogs/12-14-21/index.html - 2023-10-17T08:47:08.368Z + 2023-10-17T10:14:30.988Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/blog post 4/index.html + 2023-10-17T10:14:31.680Z https://cloud-span.github.io/cloud-span-quarto-site/blogs/blog post 5/index.html - 2023-10-17T08:47:09.508Z + 2023-10-17T10:14:32.448Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-08-31/index.html + 2023-10-17T10:14:33.312Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-05-11/index.html + 2023-10-17T10:14:34.052Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-07-18/index.html + 2023-10-17T10:14:34.708Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-10-18/index.html + 2023-10-17T10:14:35.420Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-02-02/index.html + 2023-10-17T10:14:36.204Z https://cloud-span.github.io/cloud-span-quarto-site/blogs/05-31-22/index.html - 2023-10-17T08:47:10.508Z + 2023-10-17T10:14:37.044Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-04-26/index.html + 2023-10-17T10:14:37.728Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2023-04-19a/index.html + 2023-10-17T10:14:38.428Z + + + https://cloud-span.github.io/cloud-span-quarto-site/blogs/2022-12-16a/index.html + 2023-10-17T10:14:39.108Z https://cloud-span.github.io/cloud-span-quarto-site/self_study_courses.html - 2023-10-17T08:47:11.552Z + 2023-10-17T10:14:40.076Z https://cloud-span.github.io/cloud-span-quarto-site/self_study/Metagenomics for Microbiologists/index.html - 2023-10-17T08:47:13.204Z + 2023-10-17T10:14:41.456Z https://cloud-span.github.io/cloud-span-quarto-site/self_study/Prenomics/index.html - 2023-10-17T08:47:13.952Z + 2023-10-17T10:14:42.136Z https://cloud-span.github.io/cloud-span-quarto-site/blogs.html - 2023-10-17T08:47:15.156Z + 2023-10-17T10:14:43.740Z https://cloud-span.github.io/cloud-span-quarto-site/index.html - 2023-10-17T08:47:16.684Z + 2023-10-17T10:14:45.112Z https://cloud-span.github.io/cloud-span-quarto-site/upcoming/Core R/index.html - 2023-10-17T08:47:18.296Z + 2023-10-17T10:14:46.512Z https://cloud-span.github.io/cloud-span-quarto-site/upcoming/Code Retreat/index.html - 2023-10-17T08:47:19.476Z + 2023-10-17T10:14:47.492Z diff --git a/upcoming_courses.html b/upcoming_courses.html index aaea178..1a98a10 100644 --- a/upcoming_courses.html +++ b/upcoming_courses.html @@ -191,7 +191,7 @@

    Upcoming Courses

    -
    +

    @@ -213,7 +213,7 @@

    -
    +

    @@ -235,7 +235,7 @@

    -
    +