Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the trackhub composite datatype #2348

Merged
merged 9 commits into from
Jul 22, 2016

Conversation

remimarenco
Copy link
Contributor

@remimarenco remimarenco commented May 12, 2016

Hi!

Some of you are maybe aware we are building, at goeckslab, a workflow for genome annotation which is very tied with Galaxy: G-OnRamp.

One of the tools of G-OnRamp workflow is called HubArchiveCreator and allows to visualize tracks generated inside Galaxy, onto UCSC TrackHub.

To enable this, I needed to add a datatype, and a display_application.

With @jgoecks, we though it could be really useful to have TrackHub UCSC / G-OnRamp compatibility being directly available on Galaxy installation, so here is the PR :).

Here is a print screen of the result:
screen shot 2016-05-11 at 10 00 45 pm

To test the datatype:

(Remove the .txt extension => GitHub does not accept .fa or .bed)

  • Run HubArchiveCreator with dbia3.fa as reference genome and:
    • Format: BED
    • Bed Choice: BED Simple Repeats
    • Bed Simple Repeats (Bed4+12) File: trfBig.bed

This image might help:
screen shot 2016-05-11 at 10 08 45 pm

And you're done! You have huba datatype installed, and you can visualize:

  • BED
  • BED simple repeats
  • GTF
  • GFF3
  • BigWig
  • Bam

files into UCSC TrackHub :)

@galaxybot galaxybot added this to the 16.07 milestone May 12, 2016
@@ -0,0 +1,6 @@
<display id="ucsc_huba" version="1.0.0" name="display at Track Hub UCSC">
<link id="main" name="main">
<url>https://genome.ucsc.edu/cgi-bin/hgHubConnect?hubUrl=${qp($hub_file.url + '/myHub/hub.txt')}&amp;hgHub_do_firstDb=on&amp;hgHub_do_redirect=on&amp;hgHubConnect.remakeTrackHub=on</url>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be configurable?
There are many UCSC instances which could be used.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will be happy to set this configurable, how do we set this up?

@bgruening
Copy link
Member

@remimarenco good to start a day with such a great idea! Thanks a lot!
I would maybe rename the datatype to make it more obvious that it is UCSC specific.

@remimarenco
Copy link
Contributor Author

Thanks for all the reviews @bgruening and @dannon! Will take care of this soon :)

…uba.xml to trackhub.xml, changed iteritems to items, removed hubAssembly.py to port it into tracks.py
remimarenco added a commit to goeckslab/hub-archive-creator that referenced this pull request May 16, 2016
remimarenco added a commit to goeckslab/hub-archive-creator that referenced this pull request May 16, 2016
@remimarenco remimarenco changed the title Add the composite datatype Add the trackhub composite datatype May 18, 2016
<display id="ucsc_trackhub" version="1.0.0" name="display at Track Hub UCSC">
<link id="main" name="main">
<url>https://genome.ucsc.edu/cgi-bin/hgHubConnect?hubUrl=${qp($hub_file.url + '/myHub/hub.txt')}&amp;hgHub_do_firstDb=on&amp;hgHub_do_redirect=on&amp;hgHubConnect.remakeTrackHub=on</url>
<param type="data" name="hub_file" url="galaxy_${DATASET_HASH}" allow_extra_files_access="True" strip_https="True"/>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is strip_https="True" actually needed here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just followed the wiki about this.

What is advised for this / what are the cases?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It swaps https to http (when Galaxy is under https) for the url that Galaxy gives to the external display application. At one point the UCSC genome browser was not able to fetch https URLs; I do not think this is the case any longer.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok perfect! I will change also that on the wiki then?

remimarenco added a commit to goeckslab/hub-archive-creator that referenced this pull request Jun 4, 2016
@jmchilton
Copy link
Member

@galaxybot test this

@jmchilton jmchilton merged commit 40fde4e into galaxyproject:dev Jul 22, 2016
@jmchilton
Copy link
Member

Thanks @remimarenco - good luck with G-OnRamp. Any progress on testing composite datatypes?

nsoranzo added a commit to nsoranzo/galaxy that referenced this pull request Jul 22, 2016
@nsoranzo
Copy link
Member

@jmchilton This was merged with 3 unaddressed comments, see #2646.

@remimarenco
Copy link
Contributor Author

@jmchilton @nsoranzo Thank you for taking care of this. (Yes @jmchilton, workshop about it tomorrow, for two days! Exciting :) )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants