Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error executing process > 'pipeline:differential_expression:build_minimap_index_transcriptome' #82

Open
kamegh opened this issue Apr 4, 2024 · 21 comments

Comments

@kamegh
Copy link

kamegh commented Apr 4, 2024

Operating System

macOS

Other Linux

No response

Workflow Version

v1.1.1-g999fb4e

Workflow Execution

Command line

EPI2ME Version

No response

CLI command run

./nextflow run epi2me-labs/wf-transcriptomes
--fastq /Users/kamegalan/analisis/reads_2
--de_analysis --ref_genome /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.fna.gz
--transcriptome-source reference-guided
--ref_annotation /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.gff.gz
--sample_sheet /Users/kamegalan/analisis/sample_sheet.csv
--out_dir output_3 -profile standard

Workflow Execution - CLI Execution Profile

standard (default)

What happened?

I am running the analysis comparing infected and non infected cells. Just two groups, in triplicate.

Relevant log output

N E X T F L O W  ~  version 23.10.1
Launching `https://github.com/epi2me-labs/wf-transcriptomes` [clever_lavoisier] DSL2 - revision: 999fb4e44a [master]

WARN: Found unexpected parameters:
* --transcriptome-source: reference-guided
- Ignore this warning: params.schema_ignore_params = "transcriptome-source" 


||||||||||   _____ ____ ___ ____  __  __ _____      _       _
||||||||||  | ____|  _ \_ _|___ \|  \/  | ____|    | | __ _| |__  ___
|||||       |  _| | |_) | |  __) | |\/| |  _| _____| |/ _` | '_ \/ __|
|||||       | |___|  __/| | / __/| |  | | |__|_____| | (_| | |_) \__ \
||||||||||  |_____|_|  |___|_____|_|  |_|_____|    |_|\__,_|_.__/|___/
||||||||||  wf-transcriptomes v1.1.1-g999fb4e
--------------------------------------------------------------------------------
Core Nextflow options
  revision       : master
  runName        : clever_lavoisier
  containerEngine: docker
  container      : [withLabel:isoforms:ontresearch/wf-transcriptomes:shae7c9f184996a384e99be68e790f0612f0c732867, withLabel:wf_common:ontresearch/wf-common:sha1c5febff9f75143710826498b093d9769a5edbb9]
  launchDir      : /Users/kamegalan
  workDir        : /Users/kamegalan/work
  projectDir     : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes
  userName       : kamegalan
  profile        : standard
  configFiles    : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes/nextflow.config

Input Options
  fastq          : /Users/kamegalan/analisis/reads_2
  ref_genome     : /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.fna.gz
  ref_annotation : /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.gff.gz

Output Options
  out_dir        : output_3

Sample Options
  sample_sheet   : /Users/kamegalan/analisis/sample_sheet.csv

Differential Expression Options
  de_analysis    : true

!! Only displaying parameters that differ from the pipeline defaults !!
--------------------------------------------------------------------------------
If you use epi2me-labs/wf-transcriptomes for your analysis please cite:

* The nf-core framework
  https://doi.org/10.1038/s41587-020-0439-x


--------------------------------------------------------------------------------
This is epi2me-labs/wf-transcriptomes v1.1.1-g999fb4e.
--------------------------------------------------------------------------------
Searching input for [.fastq, .fastq.gz, .fq, .fq.gz] files.
executor >  local (112)
[bb/31d090] process > validate_sample_sheet                                              [100%] 1 of 1 ✔
[f9/657130] process > fastcat (6)                                                        [100%] 6 of 6 ✔
[4d/cc18a4] process > pipeline:decompress_ref                                            [100%] 1 of 1 ✔
[d1/76043f] process > pipeline:decompress_annotation                                     [100%] 1 of 1 ✔
[e9/6556b0] process > pipeline:preprocess_ref_annotation                                 [100%] 1 of 1 ✔
[e6/3f7ab2] process > pipeline:collectFastqIngressResultsInDir (6)                       [100%] 6 of 6 ✔
[e8/c92474] process > pipeline:getVersions                                               [100%] 1 of 1 ✔
[f7/b0e8c4] process > pipeline:getParams                                                 [100%] 1 of 1 ✔
[55/e49485] process > pipeline:preprocess_reads (6)                                      [100%] 6 of 6 ✔
[a1/46e504] process > pipeline:build_minimap_index                                       [100%] 1 of 1 ✔
[0a/528687] process > pipeline:reference_assembly:map_reads (4)                          [100%] 6 of 6 ✔
[12/b38f59] process > pipeline:split_bam (6)                                             [100%] 6 of 6 ✔
[8f/1c2387] process > pipeline:assemble_transcripts (6)                                  [100%] 6 of 6 ✔
[09/167877] process > pipeline:merge_gff_bundles (5)                                     [100%] 6 of 6 ✔
[e7/a6aba9] process > pipeline:run_gffcompare (1)                                        [100%] 6 of 6 ✔
[fa/fde525] process > pipeline:get_transcriptome (2)                                     [100%] 6 of 6 ✔
executor >  local (112)
[bb/31d090] process > validate_sample_sheet                                              [100%] 1 of 1 ✔
[f9/657130] process > fastcat (6)                                                        [100%] 6 of 6 ✔
[4d/cc18a4] process > pipeline:decompress_ref                                            [100%] 1 of 1 ✔
[d1/76043f] process > pipeline:decompress_annotation                                     [100%] 1 of 1 ✔
[e9/6556b0] process > pipeline:preprocess_ref_annotation                                 [100%] 1 of 1 ✔
[e6/3f7ab2] process > pipeline:collectFastqIngressResultsInDir (6)                       [100%] 6 of 6 ✔
[e8/c92474] process > pipeline:getVersions                                               [100%] 1 of 1 ✔
[f7/b0e8c4] process > pipeline:getParams                                                 [100%] 1 of 1 ✔
[55/e49485] process > pipeline:preprocess_reads (6)                                      [100%] 6 of 6 ✔
[a1/46e504] process > pipeline:build_minimap_index                                       [100%] 1 of 1 ✔
[0a/528687] process > pipeline:reference_assembly:map_reads (4)                          [100%] 6 of 6 ✔
[12/b38f59] process > pipeline:split_bam (6)                                             [100%] 6 of 6 ✔
[8f/1c2387] process > pipeline:assemble_transcripts (6)                                  [100%] 6 of 6 ✔
[09/167877] process > pipeline:merge_gff_bundles (5)                                     [100%] 6 of 6 ✔
[e7/a6aba9] process > pipeline:run_gffcompare (1)                                        [100%] 6 of 6 ✔
[fa/fde525] process > pipeline:get_transcriptome (2)                                     [100%] 6 of 6 ✔
executor >  local (112)
[bb/31d090] process > validate_sample_sheet                                              [100%] 1 of 1 ✔
[f9/657130] process > fastcat (6)                                                        [100%] 6 of 6 ✔
[4d/cc18a4] process > pipeline:decompress_ref                                            [100%] 1 of 1 ✔
[d1/76043f] process > pipeline:decompress_annotation                                     [100%] 1 of 1 ✔
[e9/6556b0] process > pipeline:preprocess_ref_annotation                                 [100%] 1 of 1 ✔
[e6/3f7ab2] process > pipeline:collectFastqIngressResultsInDir (6)                       [100%] 6 of 6 ✔
[e8/c92474] process > pipeline:getVersions                                               [100%] 1 of 1 ✔
[f7/b0e8c4] process > pipeline:getParams                                                 [100%] 1 of 1 ✔
[55/e49485] process > pipeline:preprocess_reads (6)                                      [100%] 6 of 6 ✔
[a1/46e504] process > pipeline:build_minimap_index                                       [100%] 1 of 1 ✔
[0a/528687] process > pipeline:reference_assembly:map_reads (4)                          [100%] 6 of 6 ✔
[12/b38f59] process > pipeline:split_bam (6)                                             [100%] 6 of 6 ✔
[8f/1c2387] process > pipeline:assemble_transcripts (6)                                  [100%] 6 of 6 ✔
[09/167877] process > pipeline:merge_gff_bundles (5)                                     [100%] 6 of 6 ✔
[e7/a6aba9] process > pipeline:run_gffcompare (1)                                        [100%] 6 of 6 ✔
[fa/fde525] process > pipeline:get_transcriptome (2)                                     [100%] 6 of 6 ✔
[88/588aa0] process > pipeline:merge_transcriptomes                                      [100%] 1 of 1 ✔
[3d/620e45] process > pipeline:differential_expression:checkSampleSheetCondition         [100%] 1 of 1 ✔
[9d/a41a73] process > pipeline:differential_expression:build_minimap_index_transcriptome [100%] 1 of 1, failed: 1 ✘
[-        ] process > pipeline:differential_expression:map_transcriptome                 -
[-        ] process > pipeline:differential_expression:count_transcripts                 -
[-        ] process > pipeline:differential_expression:mergeCounts                       -
[-        ] process > pipeline:differential_expression:mergeTPM                          -
[-        ] process > pipeline:differential_expression:deAnalysis                        -
[-        ] process > pipeline:differential_expression:plotResults                       -
[-        ] process > pipeline:makeReport                                                -
[ac/50fd5f] process > output (43)                                                        [ 87%] 48 of 55
ERROR ~ Error executing process > 'pipeline:differential_expression:build_minimap_index_transcriptome'

Caused by:
  Process `pipeline:differential_expression:build_minimap_index_transcriptome` terminated with an error exit status (137)

Command executed:

  minimap2 -t "4" -k14  -I 1000G -d "genome_index.mmi" "final_non_redundant_transcriptome.fasta"

Command exit status:
  137

Command output:
  (empty)

Command error:
  .command.sh: line 2:    33 Killed                  minimap2 -t "4" -k14 -I 1000G -d "genome_index.mmi" "final_non_redundant_transcriptome.fasta"

Work dir:
  /Users/kamegalan/work/9d/a41a734b64ab3f64888ce8f2cfa7dd

Tip: view the complete command output by changing to the process work dir and entering the command `cat .command.out`

 -- Check '.nextflow.log' file for details

Application activity log entry

No response

Were you able to successfully run the latest version of the workflow with the demo data?

yes

Other demo data information

./nextflow run epi2me-labs/wf-transcriptomes \
--fastq  differential_expression/differential_expression_fastq \
--de_analysis --ref_genome differential_expression/hg38_chr20.fa \
--transcriptome-source reference-guided \
--ref_annotation differential_expression/gencode.v22.annotation.chr20.gtf \
--direct_rna --minimap2_index_opts '-k 15'  --sample_sheet differential_expression/sample_sheet.csv \
--jaffal_refBase differential_expression/chr20/ --jaffal_genome hg38_chr20 --jaffal_annotation genCode22 \
-profile standard
N E X T F L O W  ~  version 23.10.1
Launching `https://github.com/epi2me-labs/wf-transcriptomes` [shrivelled_neumann] DSL2 - revision: 999fb4e44a [master]

WARN: Found unexpected parameters:
* --transcriptome-source: reference-guided
- Ignore this warning: params.schema_ignore_params = "transcriptome-source" 


||||||||||   _____ ____ ___ ____  __  __ _____      _       _
||||||||||  | ____|  _ \_ _|___ \|  \/  | ____|    | | __ _| |__  ___
|||||       |  _| | |_) | |  __) | |\/| |  _| _____| |/ _` | '_ \/ __|
|||||       | |___|  __/| | / __/| |  | | |__|_____| | (_| | |_) \__ \
||||||||||  |_____|_|  |___|_____|_|  |_|_____|    |_|\__,_|_.__/|___/
||||||||||  wf-transcriptomes v1.1.1-g999fb4e
--------------------------------------------------------------------------------
Core Nextflow options
  revision           : master
  runName            : shrivelled_neumann
  containerEngine    : docker
  container          : [withLabel:isoforms:ontresearch/wf-transcriptomes:shae7c9f184996a384e99be68e790f0612f0c732867, withLabel:wf_common:ontresearch/wf-common:sha1c5febff9f75143710826498b093d9769a5edbb9]
  launchDir          : /Users/kamegalan
  workDir            : /Users/kamegalan/work
  projectDir         : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes
  userName           : kamegalan
  profile            : standard
  configFiles        : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes/nextflow.config

Input Options
  fastq              : differential_expression/differential_expression_fastq
  ref_genome         : differential_expression/hg38_chr20.fa
  ref_annotation     : differential_expression/gencode.v22.annotation.chr20.gtf
  direct_rna         : true

Sample Options
  sample_sheet       : differential_expression/sample_sheet.csv

Options for reference-based workflow
  minimap2_index_opts: -k 15

Gene Fusion Detection Options
  jaffal_refBase     : differential_expression/chr20/
  jaffal_genome      : hg38_chr20

Differential Expression Options
  de_analysis        : true

!! Only displaying parameters that differ from the pipeline defaults !!
--------------------------------------------------------------------------------
If you use epi2me-labs/wf-transcriptomes for your analysis please cite:

* The nf-core framework
  https://doi.org/10.1038/s41587-020-0439-x


--------------------------------------------------------------------------------
This is epi2me-labs/wf-transcriptomes v1.1.1-g999fb4e.
--------------------------------------------------------------------------------
Searching input for [.fastq, .fastq.gz, .fq, .fq.gz] files.
executor >  local (152)
[0d/89edc4] process > validate_sample_sheet                                                  [100%] 1 of 1 ✔
[90/1e6e8f] process > fastcat (6)                                                            [100%] 6 of 6 ✔
[b5/90fe4f] process > pipeline:preprocess_ref_annotation                                     [100%] 1 of 1 ✔
[37/a125b8] process > pipeline:collectFastqIngressResultsInDir (6)                           [100%] 6 of 6 ✔
[8f/90b36d] process > pipeline:getVersions                                                   [100%] 1 of 1 ✔
[68/a427ca] process > pipeline:getParams                                                     [100%] 1 of 1 ✔
[a5/d481d7] process > pipeline:build_minimap_index (1)                                       [100%] 1 of 1 ✔
[e4/52e015] process > pipeline:reference_assembly:map_reads (6)                              [100%] 6 of 6 ✔
[c3/442967] process > pipeline:split_bam (6)                                                 [100%] 6 of 6 ✔
[63/cfb2af] process > pipeline:assemble_transcripts (6)                                      [100%] 6 of 6 ✔
[e7/443ea8] process > pipeline:merge_gff_bundles (4)                                         [100%] 6 of 6 ✔
[cd/de18c0] process > pipeline:run_gffcompare (6)                                            [100%] 6 of 6 ✔
[ae/fef7cc] process > pipeline:get_transcriptome (6)                                         [100%] 6 of 6 ✔
[36/e20698] process > pipeline:gene_fusions:jaffal (6)                                       [100%] 6 of 6 ✔
[c9/6640d6] process > pipeline:merge_transcriptomes (1)                                      [100%] 1 of 1 ✔
[1e/5b322a] process > pipeline:differential_expression:checkSampleSheetCondition             [100%] 1 of 1 ✔
[31/be1b41] process > pipeline:differential_expression:build_minimap_index_transcriptome (1) [100%] 1 of 1 ✔
[92/582b7a] process > pipeline:differential_expression:map_transcriptome (5)                 [100%] 6 of 6 ✔
[12/d6dd4f] process > pipeline:differential_expression:count_transcripts (6)                 [100%] 6 of 6 ✔
[75/1c0f63] process > pipeline:differential_expression:mergeCounts                           [100%] 1 of 1 ✔
[6c/8bba1e] process > pipeline:differential_expression:mergeTPM                              [100%] 1 of 1 ✔
[d0/0756ff] process > pipeline:differential_expression:deAnalysis (1)                        [100%] 1 of 1 ✔
[c5/e85538] process > pipeline:differential_expression:plotResults (1)                       [100%] 1 of 1 ✔
[94/445e59] process > pipeline:makeReport (1)                                                [100%] 1 of 1 ✔
[89/ed45cd] process > output (73)                                                            [100%] 73 of 73 ✔
Completed at: 03-Apr-2024 16:01:54
Duration    : 7m 14s
CPU hours   : 0.5
Succeeded   : 152
@kamegh
Copy link
Author

kamegh commented Apr 5, 2024

I fixed the problem increasing the memory in a config file as in other issues.
Nevertheless, I got another error.


CLI command run

./nextflow run epi2me-labs/wf-transcriptomes
--fastq /Users/kamegalan/analisis/reads_2
--de_analysis --ref_genome /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.fna.gz
--transcriptome-source reference-guided
--ref_annotation /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.gff.gz
--sample_sheet /Users/kamegalan/analisis/sample_sheet.csv
--out_dir output_4 -profile standard -c /Users/kamegalan/analisis/mem.config


Log output

N E X T F L O W ~ version 23.10.1
Launching https://github.com/epi2me-labs/wf-transcriptomes [maniac_turing] DSL2 - revision: 999fb4e [master]

WARN: Found unexpected parameters:
--transcriptome-source: reference-guided

  • Ignore this warning: params.schema_ignore_params = "transcriptome-source"

|||||||||| _____ ____ ___ ____ __ __ _____ _ _
|||||||||| | | _ _ | | / | | | | __ | | ___
||||| | | | |) | | __) | |/| | | _| |/ ` | ' / |
||||| | |
| /| | / /| | | | ||
| | (
| | |
) _

|||||||||| |_____|
| |
||| ||| ||_,|./|__/
|||||||||| wf-transcriptomes v1.1.1-g999fb4e

Core Nextflow options
revision : master
runName : maniac_turing
containerEngine: docker
container : [withLabel:isoforms:ontresearch/wf-transcriptomes:shae7c9f184996a384e99be68e790f0612f0c732867, withLabel:wf_common:ontresearch/wf-common:sha1c5febff9f75143710826498b093d9769a5edbb9]
launchDir : /Users/kamegalan
workDir : /Users/kamegalan/work
projectDir : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes
userName : kamegalan
profile : standard
configFiles : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes/nextflow.config, /Users/kamegalan/analisis/mem.config

Input Options
fastq : /Users/kamegalan/analisis/reads_2
ref_genome : /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.fna.gz
ref_annotation : /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.gff.gz

Output Options
out_dir : output_4

Sample Options
sample_sheet : /Users/kamegalan/analisis/sample_sheet.csv

Differential Expression Options
de_analysis : true

! Only displaying parameters that differ from the pipeline defaults !

If you use epi2me-labs/wf-transcriptomes for your analysis please cite:

The nf-core framework
https://doi.org/10.1038/s41587-020-0439-x

This is epi2me-labs/wf-transcriptomes v1.1.1-g999fb4e.

Searching input for [.fastq, .fastq.gz, .fq, .fq.gz] files.
executor > local (127)
[fa/b23244] process > validate_sample_sheet [100%] 1 of 1 ✔
[90/bc3d5e] process > fastcat (6) [100%] 6 of 6 ✔
[38/aaec94] process > pipeline:decompress_ref [100%] 1 of 1 ✔
[e3/9bdef8] process > pipeline:decompress_annotation [100%] 1 of 1 ✔
[bd/2732db] process > pipeline:preprocess_ref_annotation [100%] 1 of 1 ✔
[a5/94452e] process > pipeline:collectFastqIngressResultsInDir (6) [100%] 6 of 6 ✔
[f1/b84ab8] process > pipeline:getVersions [100%] 1 of 1 ✔
[6e/499929] process > pipeline:getParams [100%] 1 of 1 ✔
[47/b5d987] process > pipeline:preprocess_reads (6) [100%] 6 of 6 ✔
[9e/e51c2a] process > pipeline:build_minimap_index [100%] 1 of 1 ✔
[7e/0751da] process > pipeline:reference_assembly:map_reads (6) [100%] 6 of 6 ✔
[c0/fb5648] process > pipeline:split_bam (5) [100%] 6 of 6 ✔
[00/cc0a0c] process > pipeline:assemble_transcripts (6) [100%] 6 of 6 ✔
[c4/36b7fb] process > pipeline:merge_gff_bundles (4) [100%] 6 of 6 ✔
[71/957d29] process > pipeline:run_gffcompare (5) [100%] 6 of 6 ✔
[ab/1b79e0] process > pipeline:get_transcriptome (2) [100%] 6 of 6 ✔
[b2/461f9a] process > pipeline:merge_transcriptomes [100%] 1 of 1 ✔
[21/f51053] process > pipeline:differential_expression:checkSampleSheetCondition [100%] 1 of 1 ✔
[61/cbeaf3] process > pipeline:differential_expression:build_minimap_index_transcriptome [100%] 1 of 1 ✔
[77/81af30] process > pipeline:differential_expression:map_transcriptome (1) [100%] 6 of 6 ✔
[06/91f1d0] process > pipeline:differential_expression:count_transcripts (6) [100%] 6 of 6 ✔
[51/a0b994] process > pipeline:differential_expression:mergeCounts [100%] 1 of 1 ✔
[1f/297a00] process > pipeline:differential_expression:mergeTPM [100%] 1 of 1 ✔
[cb/ffa3a0] process > pipeline:differential_expression:deAnalysis [ 0%] 0 of 1
[- ] process > pipeline:differential_expression:plotResults -
[- ] process > pipeline:makeReport -
[52/193458] process > output (44) [100%] 48 of 48

ERROR ~ Error executing process > 'pipeline:differential_expression:deAnalysis'

Caused by:
Process pipeline:differential_expression:deAnalysis terminated with an error exit status (1)

Command executed:

mkdir merged
mkdir de_analysis
de_analysis.R annotation.gtf 3 1 10 3

Command exit status:
1

executor > local (127)
[fa/b23244] process > validate_sample_sheet [100%] 1 of 1 ✔
[90/bc3d5e] process > fastcat (6) [100%] 6 of 6 ✔
[38/aaec94] process > pipeline:decompress_ref [100%] 1 of 1 ✔
[e3/9bdef8] process > pipeline:decompress_annotation [100%] 1 of 1 ✔
[bd/2732db] process > pipeline:preprocess_ref_annotation [100%] 1 of 1 ✔
[a5/94452e] process > pipeline:collectFastqIngressResultsInDir (6) [100%] 6 of 6 ✔
[f1/b84ab8] process > pipeline:getVersions [100%] 1 of 1 ✔
[6e/499929] process > pipeline:getParams [100%] 1 of 1 ✔
[47/b5d987] process > pipeline:preprocess_reads (6) [100%] 6 of 6 ✔
[9e/e51c2a] process > pipeline:build_minimap_index [100%] 1 of 1 ✔
[7e/0751da] process > pipeline:reference_assembly:map_reads (6) [100%] 6 of 6 ✔
[c0/fb5648] process > pipeline:split_bam (5) [100%] 6 of 6 ✔
[00/cc0a0c] process > pipeline:assemble_transcripts (6) [100%] 6 of 6 ✔
[c4/36b7fb] process > pipeline:merge_gff_bundles (4) [100%] 6 of 6 ✔
[71/957d29] process > pipeline:run_gffcompare (5) [100%] 6 of 6 ✔
[ab/1b79e0] process > pipeline:get_transcriptome (2) [100%] 6 of 6 ✔
[b2/461f9a] process > pipeline:merge_transcriptomes [100%] 1 of 1 ✔
[21/f51053] process > pipeline:differential_expression:checkSampleSheetCondition [100%] 1 of 1 ✔
[61/cbeaf3] process > pipeline:differential_expression:build_minimap_index_transcriptome [100%] 1 of 1 ✔
[77/81af30] process > pipeline:differential_expression:map_transcriptome (1) [100%] 6 of 6 ✔
[06/91f1d0] process > pipeline:differential_expression:count_transcripts (6) [100%] 6 of 6 ✔
[51/a0b994] process > pipeline:differential_expression:mergeCounts [100%] 1 of 1 ✔
[1f/297a00] process > pipeline:differential_expression:mergeTPM [100%] 1 of 1 ✔
[cb/ffa3a0] process > pipeline:differential_expression:deAnalysis [100%] 1 of 1, failed: 1 ✘
[- ] process > pipeline:differential_expression:plotResults -
[- ] process > pipeline:makeReport -
[52/193458] process > output (44) [100%] 48 of 48
ERROR ~ Error executing process > 'pipeline:differential_expression:deAnalysis'

Caused by:
Process pipeline:differential_expression:deAnalysis terminated with an error exit status (1)

Command executed:

mkdir merged
mkdir de_analysis
de_analysis.R annotation.gtf 3 1 10 3

Command exit status:
1
executor > local (127)
[fa/b23244] process > validate_sample_sheet [100%] 1 of 1 ✔
[90/bc3d5e] process > fastcat (6) [100%] 6 of 6 ✔
[38/aaec94] process > pipeline:decompress_ref [100%] 1 of 1 ✔
[e3/9bdef8] process > pipeline:decompress_annotation [100%] 1 of 1 ✔
[bd/2732db] process > pipeline:preprocess_ref_annotation [100%] 1 of 1 ✔
[a5/94452e] process > pipeline:collectFastqIngressResultsInDir (6) [100%] 6 of 6 ✔
[f1/b84ab8] process > pipeline:getVersions [100%] 1 of 1 ✔
[6e/499929] process > pipeline:getParams [100%] 1 of 1 ✔
[47/b5d987] process > pipeline:preprocess_reads (6) [100%] 6 of 6 ✔
[9e/e51c2a] process > pipeline:build_minimap_index [100%] 1 of 1 ✔
[7e/0751da] process > pipeline:reference_assembly:map_reads (6) [100%] 6 of 6 ✔
[c0/fb5648] process > pipeline:split_bam (5) [100%] 6 of 6 ✔
[00/cc0a0c] process > pipeline:assemble_transcripts (6) [100%] 6 of 6 ✔
[c4/36b7fb] process > pipeline:merge_gff_bundles (4) [100%] 6 of 6 ✔
[71/957d29] process > pipeline:run_gffcompare (5) [100%] 6 of 6 ✔
[ab/1b79e0] process > pipeline:get_transcriptome (2) [100%] 6 of 6 ✔
[b2/461f9a] process > pipeline:merge_transcriptomes [100%] 1 of 1 ✔
[21/f51053] process > pipeline:differential_expression:checkSampleSheetCondition [100%] 1 of 1 ✔
[61/cbeaf3] process > pipeline:differential_expression:build_minimap_index_transcriptome [100%] 1 of 1 ✔
[77/81af30] process > pipeline:differential_expression:map_transcriptome (1) [100%] 6 of 6 ✔
[06/91f1d0] process > pipeline:differential_expression:count_transcripts (6) [100%] 6 of 6 ✔
[51/a0b994] process > pipeline:differential_expression:mergeCounts [100%] 1 of 1 ✔
[1f/297a00] process > pipeline:differential_expression:mergeTPM [100%] 1 of 1 ✔
[cb/ffa3a0] process > pipeline:differential_expression:deAnalysis [100%] 1 of 1, failed: 1 ✘
[- ] process > pipeline:differential_expression:plotResults -
[- ] process > pipeline:makeReport [ 0%] 0 of 1
[52/193458] process > output (44) [100%] 48 of 48
ERROR ~ Error executing process > 'pipeline:differential_expression:deAnalysis'

Caused by:
Process pipeline:differential_expression:deAnalysis terminated with an error exit status (1)

Command executed:

mkdir merged
mkdir de_analysis
de_analysis.R annotation.gtf 3 1 10 3

Command exit status:
1
executor > local (127)
[fa/b23244] process > validate_sample_sheet [100%] 1 of 1 ✔
[90/bc3d5e] process > fastcat (6) [100%] 6 of 6 ✔
[38/aaec94] process > pipeline:decompress_ref [100%] 1 of 1 ✔
[e3/9bdef8] process > pipeline:decompress_annotation [100%] 1 of 1 ✔
[bd/2732db] process > pipeline:preprocess_ref_annotation [100%] 1 of 1 ✔
[a5/94452e] process > pipeline:collectFastqIngressResultsInDir (6) [100%] 6 of 6 ✔
[f1/b84ab8] process > pipeline:getVersions [100%] 1 of 1 ✔
[6e/499929] process > pipeline:getParams [100%] 1 of 1 ✔
[47/b5d987] process > pipeline:preprocess_reads (6) [100%] 6 of 6 ✔
[9e/e51c2a] process > pipeline:build_minimap_index [100%] 1 of 1 ✔
[7e/0751da] process > pipeline:reference_assembly:map_reads (6) [100%] 6 of 6 ✔
[c0/fb5648] process > pipeline:split_bam (5) [100%] 6 of 6 ✔
[00/cc0a0c] process > pipeline:assemble_transcripts (6) [100%] 6 of 6 ✔
[c4/36b7fb] process > pipeline:merge_gff_bundles (4) [100%] 6 of 6 ✔
[71/957d29] process > pipeline:run_gffcompare (5) [100%] 6 of 6 ✔
[ab/1b79e0] process > pipeline:get_transcriptome (2) [100%] 6 of 6 ✔
[b2/461f9a] process > pipeline:merge_transcriptomes [100%] 1 of 1 ✔
[21/f51053] process > pipeline:differential_expression:checkSampleSheetCondition [100%] 1 of 1 ✔
[61/cbeaf3] process > pipeline:differential_expression:build_minimap_index_transcriptome [100%] 1 of 1 ✔
[77/81af30] process > pipeline:differential_expression:map_transcriptome (1) [100%] 6 of 6 ✔
[06/91f1d0] process > pipeline:differential_expression:count_transcripts (6) [100%] 6 of 6 ✔
[51/a0b994] process > pipeline:differential_expression:mergeCounts [100%] 1 of 1 ✔
[1f/297a00] process > pipeline:differential_expression:mergeTPM [100%] 1 of 1 ✔
[cb/ffa3a0] process > pipeline:differential_expression:deAnalysis [100%] 1 of 1, failed: 1 ✘
[- ] process > pipeline:differential_expression:plotResults -
[- ] process > pipeline:makeReport [ 0%] 0 of 1
[52/193458] process > output (44) [100%] 48 of 48
ERROR ~ Error executing process > 'pipeline:differential_expression:deAnalysis'

Caused by:
Process pipeline:differential_expression:deAnalysis terminated with an error exit status (1)

Command executed:

mkdir merged
mkdir de_analysis
de_analysis.R annotation.gtf 3 1 10 3

Command exit status:
1

Command output:
Loading counts, conditions and parameters.
Checking annotation file type.
Annotation file type is gtf.
Checking annotation file for presence of transcript_id versions.
Annotation file transcript_ids include versions.
Loading annotation database.
Filtering counts using DRIMSeq.

Command error:
Loading counts, conditions and parameters.
Checking annotation file type.
Annotation file type is gtf.
Checking annotation file for presence of transcript_id versions.
Annotation file transcript_ids include versions.
Loading annotation database.
Import genomic features from the file as a GRanges object ... OK
Prepare the 'metadata' data frame ... OK
Make the TxDb object ... OK
Warning messages:
1: In for (i in seq_along(specs)) { :
closing unused connection 3 (annotation.gtf)
2: In for (i in seq_along(defined)) { :
closing unused connection 4 (annotation.gtf)
'select()' returned 1:many mapping between keys and columns
Filtering counts using DRIMSeq.
Error in dmDSdata(counts = counts, samples = coldata) :
all(samples$sample_id %in% colnames(counts)) is not TRUE
Calls: dmDSdata -> stopifnot
Execution halted

Work dir:
/Users/kamegalan/work/cb/ffa3a03f7f7a7e164d6ce7a469d6be

Tip: when you have fixed the problem you can continue the execution adding the option -resume to the run command line

-- Check '.nextflow.log' file for details

@kocinajaltin
Copy link

Hi there,

I have had the exact same issue with the same error:

minimap2 -t "4" -k14 -I 1000G -d "genome_index.mmi" "final_non_redundant_transcriptome.fasta"

The PC I'm using has 8 cores, and 64GB of RAM. I increased the WSL2 allocated RAM to around 54GB and I changed the nextflow config file from 8GB to 54GB.

I am still getting the same error message, what would you recommend I do?
Is there a way around it?

kamegh what did you set the config file to?

Thanks for the help.

@kamegh
Copy link
Author

kamegh commented Apr 5, 2024

Hi @kocinajaltin,

The config file contains this:

process {
    withName:build_minimap_index_transcriptome {
        memory = 32.GB
    }
}

@kocinajaltin
Copy link

Thanks for the help, @kamegh.

However, I am a complete novice with these systems.

I have created the file as instructed but then when I run the epi2me program, and use the configuration tab in the nextflow configuration to run -c mem.config, I get an error.

I have tried to add the file into every section of the epi2me folder. It just keeps throwing an error.

So,

  1. Is it because I'm using WSL2
  2. Using the app and not running it through Ubuntu directly?
  3. I haven't saved the file in the correct place?
  4. I shouldn't be using the configuration section in the app to run the mem.config file

Apologies if these are all basic questions

Thanks again in advance.

@sarahjeeeze
Copy link
Contributor

@kocinajaltin is the error you are are getting the same as above? 137? or different?

@sarahjeeeze
Copy link
Contributor

@kamegh It looks like for some reason the samples in the sample sheet are not present in the counts tsv, would you mind sharing the sample sheet you are using? also just checking is this direct RNA or cDNA you are using?

@kocinajaltin
Copy link

kocinajaltin commented Apr 9, 2024

Morning @sarahjeeeze,

Thanks for your reply.

Yes it's the same error exit status 137.

Altin

@kamegh
Copy link
Author

kamegh commented Apr 9, 2024

@sarahjeeeze

Sure, here is the sample sheet and I'm using cDNA.
sample_sheet.csv

Thanks for the help.

@sarahjeeeze
Copy link
Contributor

Hi, sorry for the late reply. Currently unfortunately i think the aliases can't be a number - Could you possible include some letters for now and see if that works? - We have an update coming that will fix this issue.

@kamegh
Copy link
Author

kamegh commented May 28, 2024

Dear @sarahjeeeze,
I've tried with the new sample sheet excluding the numbers.
It seemed to work but gave this error.

ERROR ~ Index 11 out of bounds for length 10

-- Check '.nextflow.log' file for details
WARN: Killing running tasks (1)

The code was as follows../nextflow run epi2me-labs/wf-transcriptomes --fastq /Users/kamegalan/analisis/reads_2 --de_analysis --ref_genome /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.fna.gz --transcriptome-source reference-guided --ref_annotation /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.gff.gz --sample_sheet /Users/kamegalan/analisis/sample_sheet.csv --out_dir output_4 -profile standard -c /Users/kamegalan/analisis/mem.config

This is the output.
Nextflow 24.04.1 is available - Please consider updating your version to it
N E X T F L O W ~ version 23.10.1
Launching https://github.com/epi2me-labs/wf-transcriptomes [special_morse] DSL2 - revision: 999fb4e [master]

WARN: Found unexpected parameters:

  • --transcriptome-source: reference-guided
  • Ignore this warning: params.schema_ignore_params = "transcriptome-source"

|||||||||| _____ ____ ___ ____ __ __ _____ _ _
|||||||||| | | _ _ | | / | | | | __ | | ___
||||| | | | |) | | __) | |/| | | _| |/ ` | ' / |
||||| | |
| /| | / /| | | | ||
| | (
| | |
) _

|||||||||| |_____|
| |
||| ||| ||_,|./|__/
|||||||||| wf-transcriptomes v1.1.1-g999fb4e

Core Nextflow options
revision : master
runName : special_morse
containerEngine: docker
container : [withLabel:isoforms:ontresearch/wf-transcriptomes:shae7c9f184996a384e99be68e790f0612f0c732867, withLabel:wf_common:ontresearch/wf-common:sha1c5febff9f75143710826498b093d9769a5edbb9]
launchDir : /Users/kamegalan
workDir : /Users/kamegalan/work
projectDir : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes
userName : kamegalan
profile : standard
configFiles : /Users/kamegalan/.nextflow/assets/epi2me-labs/wf-transcriptomes/nextflow.config, /Users/kamegalan/analisis/mem.config

Input Options
fastq : /Users/kamegalan/analisis/reads_2
ref_genome : /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.fna.gz
ref_annotation : /Users/kamegalan/analisis/referencias/GRCh38_latest_genomic.gff.gz

Output Options
out_dir : output_4

Sample Options
sample_sheet : /Users/kamegalan/analisis/sample_sheet.csv

Differential Expression Options
de_analysis : true

Only displaying parameters that differ from the pipeline defaults !!

If you use epi2me-labs/wf-transcriptomes for your analysis please cite:

This is epi2me-labs/wf-transcriptomes v1.1.1-g999fb4e.

Searching input for [.fastq, .fastq.gz, .fq, .fq.gz] files.
executor > local (128)
[fb/7779ce] process > validate_sample_sheet [100%] 1 of 1 ✔
[3a/b69961] process > fastcat (6) [100%] 6 of 6 ✔
[78/3bd5c7] process > pipeline:decompress_ref [100%] 1 of 1 ✔
[7d/ba38e6] process > pipeline:decompress_annotation [100%] 1 of 1 ✔
[4d/52fd60] process > pipeline:preprocess_ref_annotation [100%] 1 of 1 ✔
[b0/b7ae12] process > pipeline:collectFastqIngressResultsInDir (6) [100%] 6 of 6 ✔
[58/562b6d] process > pipeline:getVersions [100%] 1 of 1 ✔
[23/d4ac77] process > pipeline:getParams [100%] 1 of 1 ✔
[49/d8d2ee] process > pipeline:preprocess_reads (6) [100%] 6 of 6 ✔
[95/a0f0f6] process > pipeline:build_minimap_index [100%] 1 of 1 ✔
[cc/ca76e1] process > pipeline:reference_assembly:map_reads (3) [100%] 6 of 6 ✔
[42/2f2e95] process > pipeline:split_bam (6) [100%] 6 of 6 ✔
[5c/8a7f5f] process > pipeline:assemble_transcripts (6) [100%] 6 of 6 ✔
[ea/f2d724] process > pipeline:merge_gff_bundles (2) [100%] 6 of 6 ✔
[67/d4c6fd] process > pipeline:run_gffcompare (4) [100%] 6 of 6 ✔
[ef/066dcf] process > pipeline:get_transcriptome (6) [100%] 6 of 6 ✔
[a6/bfbfe7] process > pipeline:merge_transcriptomes [100%] 1 of 1 ✔
[3b/80b288] process > pipeline:differential_expression:checkSampleSheetCondition [100%] 1 of 1 ✔
[6c/cd59ca] process > pipeline:differential_expression:build_minimap_index_transcriptome [100%] 1 of 1 ✔
[d0/e035ef] process > pipeline:differential_expression:map_transcriptome (4) [100%] 6 of 6 ✔
[c6/6a5efa] process > pipeline:differential_expression:count_transcripts (6) [100%] 6 of 6 ✔
[00/3a7dab] process > pipeline:differential_expression:mergeCounts [100%] 1 of 1 ✔
[a7/5f301e] process > pipeline:differential_expression:mergeTPM [100%] 1 of 1 ✔
[75/2b9791] process > pipeline:differential_expression:deAnalysis [100%] 1 of 1 ✔
[22/e16960] process > pipeline:differential_expression:plotResults [ 0%] 0 of 1
[- ] process > pipeline:makeReport -
[5f/565395] process > output (47) [100%] 48 of 48
ERROR ~ Index 11 out of bounds for length 10

-- Check '.nextflow.log' file for details
WARN: Killing running tasks (1)

Best.

@nrhorner
Copy link
Contributor

nrhorner commented Jun 3, 2024

Hi @kamegh Could you reply and attach the .nextflow.log please?

@kamegh
Copy link
Author

kamegh commented Jun 3, 2024

Hi @nrhorner ,

Here is the .nextflow.log file.
.nextflow.log

Best

@jh4yd
Copy link

jh4yd commented Jun 24, 2024

Hi, I'm wondering whether you find a solution for the issue.
It looks like we have encountered the same problem.
The nextflow.log is attached here. nextflow.log
Really appreciate your help.

@kamegh
Copy link
Author

kamegh commented Jun 24, 2024

Hi, I'm wondering whether you find a solution for the issue. It looks like we have encountered the same problem. The nextflow.log is attached here. nextflow.log Really appreciate your help.

Not yet. I'm still waiting for an answer.

@marcos-perezg
Copy link

I´ll be back here soon to check if there is a solution for this issue. Unfortunately, I'm getting the same error when running the wf-transcriptomes pipeline. @sarahjeeeze @nrhorner

@jh4yd
Copy link

jh4yd commented Jul 11, 2024

Hi, I'm wondering whether you find a solution for the issue. It looks like we have encountered the same problem. The nextflow.log is attached here. nextflow.log Really appreciate your help.

Not yet. I'm still waiting for an answer.

I think I have a solution. in the file of differential_expression.nf, line 125, change to
minimap2 -t ${task.cpus} ${params.minimap2_index_opts} -I 1000G -d "genome_index.mmi" ${reference}
I think the quotation marks cause the error.

@sarahjeeeze
Copy link
Contributor

Hi, thanks for this feedback, we have not seen this but will investigate - are you running this on ARM?

@jh4yd
Copy link

jh4yd commented Jul 17, 2024

Yes, we were running it on MacBook Pro, M3 chip

@sarahjeeeze
Copy link
Contributor

sarahjeeeze commented Jul 26, 2024

I was able to recreate the error 137 - you need to use the full genome as the ref_genome instead of the primary assembly so Homo_sapiens.GRCh38.dna.alt.fa.gz instead of Homo_sapiens.GRCh38.dna.primary_assembly.fa. Let me know if this solves it. This is also true for the out of index error.

Sorry for the delay, i only just got round to looking in to it.

@jh4yd
Copy link

jh4yd commented Jul 30, 2024

I was able to recreate the error 137 - you need to use the full genome as the ref_genome instead of the primary assembly so Homo_sapiens.GRCh38.dna.alt.fa.gz instead of Homo_sapiens.GRCh38.dna.primary_assembly.fa. Let me know if this solves it. This is also true for the out of index error.

Sorry for the delay, i only just got round to looking in to it.

Thank you! I will try it again later today. Will keep you posted.
BTW, do you know the difference between these two files? Why do you use Homo_sapiens.GRCh38.dna.alt.fa.gz?

@sarahjeeeze
Copy link
Contributor

Hi, sorry it has been a while - in this case the references in the full genome match with the references in the annotation file provided. Where as the primary assembly uses a different format so the workflow is unable to reconcile them. I am unsure if this is also the case for ensemble or gencode datasets.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

6 participants