Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding scripts to liftover gnomAD. Also bugfixes for Funcotator NIO. #5514

Merged
merged 5 commits into from
Dec 17, 2018

Conversation

jonn-smith
Copy link
Collaborator

  • Added liftover chain file creation script.
  • Added WDLs and some arguments to lift over gnomAD
  • Added chain file for b37->hg38 and arguments for liftover.
  • Limited to 1000 records in memory.
  • Added stack trace option to all wdls and sub tasks.
  • Fixed output to be consistent with local files for indexing.
  • Added timing information on wdls.
  • Added a wdl/json to create a TSV from gnomAD allele freq data.
  • Updated indexFeatureFile wdl, added params for run to index gnomAD.
  • Added json file for indexing a large gnomad file.
  • Fixed critical issues with NIO data sources.
  • Updates to the test script to save output and point to full cloud data.
  • Added some logging hooks to SeekableByteChannelPrefetcher

I haven't reviewed this since I made the changes to it to see what should stay, so it may need a fair bit of work.

* Added WDLs and some arguments to lift over gnomAD
* Added chain file for b37->hg38 and arguments for liftover.
* Limited to 1000 records in memory.
* Added stack trace option to all wdls and sub tasks.
* Fixed output to be consistent with local files for indexing.
* Added timing information on wdls.
* Added a wdl/json to create a TSV from gnomAD allele freq data.
* Updated indexFeatureFile wdl, added params for run to index gnomAD.
* Added json file for indexing a large gnomad file.
* Fixed critical issues with NIO data sources.
* Updates to the test script to save output and point to full cloud data.
* Added some logging hooks to SeekableByteChannelPrefetcher
@jonn-smith jonn-smith changed the title Adding scripts to liftover gnomad. Also bugfixes for NIO. Adding scripts to liftover gnomAD. Also bugfixes for Funcotator NIO. Dec 11, 2018
@codecov-io
Copy link

codecov-io commented Dec 11, 2018

Codecov Report

Merging #5514 into master will decrease coverage by 0.006%.
The diff coverage is 47.619%.

@@               Coverage Diff               @@
##              master     #5514       +/-   ##
===============================================
- Coverage     87.076%   87.069%   -0.006%     
- Complexity     31320     31323        +3     
===============================================
  Files           1921      1921               
  Lines         144564    144577       +13     
  Branches       15951     15949        -2     
===============================================
+ Hits          125880    125882        +2     
- Misses         12895     12902        +7     
- Partials        5789      5793        +4
Impacted Files Coverage Δ Complexity Δ
...ender/utils/nio/SeekableByteChannelPrefetcher.java 78.443% <100%> (+0.13%) 27 <1> (ø) ⬇️
...r/dataSources/cosmic/CosmicFuncotationFactory.java 63.38% <30.769%> (-3.537%) 27 <1> (+1)
.../tools/funcotator/dataSources/DataSourceUtils.java 64.041% <71.429%> (-0.319%) 48 <1> (+1)
...der/tools/walkers/annotator/OriginalAlignment.java 85.714% <0%> (-14.286%) 7% <0%> (-3%)
...bender/tools/walkers/annotator/AlleleFraction.java 80.952% <0%> (-4.762%) 7% <0%> (-1%)
...r/tools/walkers/annotator/PerAlleleAnnotation.java 75% <0%> (-2.778%) 16% <0%> (ø)
...tools/walkers/haplotypecaller/graphs/SeqGraph.java 87.059% <0%> (-2.353%) 23% <0%> (-2%)
.../tools/walkers/mutect/SomaticGenotypingEngine.java 89.944% <0%> (-0.817%) 72% <0%> (-3%)
...der/tools/walkers/mutect/M2ArgumentCollection.java 87.5% <0%> (-0.5%) 9% <0%> (ø)
...ools/walkers/haplotypecaller/graphs/BaseGraph.java 82.49% <0%> (-0.389%) 93% <0%> (-1%)
... and 9 more

Copy link
Contributor

@LeeTL1220 LeeTL1220 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jonn-smith If you answer my questions and make changes, feel free to merge.

@@ -0,0 +1,567 @@
#!/usr/bin/env bash
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How was this verified to work? Did you give the results to the comms team to post somewhere?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For now the resulting liftover file hasn't been validated. The liftover of gnomAD resulting from using this file is going to be QC'd, then it will have been verified.

I haven't yet given them the liftover file.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm working with them now.

@jonn-smith jonn-smith merged commit 02682d5 into master Dec 17, 2018
@jonn-smith jonn-smith deleted the jts_gnomad_liftover_5457 branch December 17, 2018 14:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants