Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ingest tutorials #195

Merged
merged 9 commits into from
Apr 3, 2024
Merged

Add ingest tutorials #195

merged 9 commits into from
Apr 3, 2024

Commits on Mar 29, 2024

  1. Configuration menu
    Copy the full SHA
    0d7d415 View commit details
    Browse the repository at this point in the history
  2. tutorial: Add "Using a pathogen repo" section

    This commit's main purpose is to split out the tutorials for more
    complex workflows into a separate section than our existing "Quickstart"
    zika-tutorial. This new section of tutorials was motivated by the
    SAB meeting¹ that emphasized the need to keep the simple zika-tutorial
    for new users.
    
    The new section only holds the new "Running an ingest workflow"
    docs, but will be expanded in the future to cover how to run
    and customize other workflows within an existing pathogen
    repository.
    
    ¹ https://docs.google.com/document/d/1zDwbn16ZRlMMcKLGWWVJ3lYPNwo5_v_WmgBsHv30_lU/edit?disco=AAABKGP5kEc
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    ce41d28 View commit details
    Browse the repository at this point in the history
  3. tutorial: Add "Creating a pathogen repo" section

    Intended to mirror the new "Using a pathogen repo" tutorials with
    tutorials on how to set up each individual workflow in a pathogen repo.
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    703f35b View commit details
    Browse the repository at this point in the history
  4. Add creating-an-ingest-workflow tutorial

    Based on contents of the initial draft of the tutorial
    https://docs.google.com/document/d/1_16VYT5MU8oXJ4t6HUHp_smx_kgF9OMsORSCldee1_0/edit#heading=h.r95jmyuit0s0
    
    Split out the steps to get the uncurated NCBI Dataset data into a
    snippet that can be shared between the two ingest tutorials.
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    5e417b8 View commit details
    Browse the repository at this point in the history
  5. uncurated-ncib-dataset: Separate commands to give explanation

    Explain what each step of the example command is doing to give readers
    a better understanding.
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    00ee4a5 View commit details
    Browse the repository at this point in the history
  6. creating-an-ingest-workflow: use dump_ncbi_dataset_report

    The pathogen-repo-guide will be updated to included the target
    `dump_ncbi_dataset_report` to easily generate the uncurated NCBI Dataset
    metadata.¹
    
    This commit updates the tutorial to use this new target so that the
    user does not need to manually run the extra commands to see the raw
    metadata.
    
    ¹ nextstrain/pathogen-repo-guide#38
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    43b0f77 View commit details
    Browse the repository at this point in the history
  7. Remove snippets/uncurated-ncbi-dataset.rst

    The previous commit updates the creating-an-ingest-workflow tutorial
    to use a custom Snakemake target to generate the uncurated NCBI Dataset
    metadata so we no longer need the separate snippet.
    
    I am still providing the extra commands to generate the uncurated
    data in the running-an-ingest-workflow tutorial because I wanted users
    to be able to see the uncurated data even if the existing pathogen
    workflow does _not_ include the custom Snakemake target.
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    6019d50 View commit details
    Browse the repository at this point in the history
  8. ingest tutorials: Update "Next steps"

    Include our intention to write phylogenetic tutorials
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    f021e76 View commit details
    Browse the repository at this point in the history
  9. running-an-ingest-workflow: Replace big YAML block

    Replace big YAML block with written instructions to create the custom
    config file based on suggestion from @jameshadfield in review.
    
    #195 (comment)
    joverlee521 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    9255b1a View commit details
    Browse the repository at this point in the history