-
Notifications
You must be signed in to change notification settings - Fork 72
Open
Labels
Description
Installation Type
Docker
pVACtools Version / Docker Image
griffithlab-pvactools-6.0.1.img
Python Version
NA
Operating System
NA
Describe the bug
Hello, I'm having an issue getting PVAC to finish running as part of my nextflow workflow. I keep getting this error. I've removed NetMHCcons and set the -d parameter to a lower number since another similar issue was able to resolve that way but unfortunately the error persists. One interesting thing is that the PVACseq run seems to be using a crazy amount of memory. When I use seff to look at my job's statistics, the PVAC job that requests 128GB is using 300-400GB. I feel like this may be why it's crashing? I sort of wonder if something is going wrong somewhere to use that much memory in the first place or if that's expected?
How to reproduce this bug (this is in nextflow so it's runnning singularity exec pvacseq run .... under the hood)
pvacseq run \
$somatic_vcf \
${tumor_meta.sample_name} \
\$(head $hla_pvac_input -n 1) \
BigMHC_EL BigMHC_IM DeepImmuno MHCflurry MHCflurryEL MHCnuggetsI MHCnuggetsII NNalign NetMHC NetMHCIIpan NetMHCIIpanEL NetMHCpan NetMHCpanEL PickPocket SMM SMMPMBEC SMMalign \
"${somatic_meta.somatic_name}_pvacseq" \
-e1 8,9,10,11 \
-e2 12,13,14,15,16,17,18 \
--normal-sample-name ${normal_meta.sample_name} \
--phased-proximal-variants-vcf $phased_vcf \
--iedb-install-directory /opt/iedb \
--pass-only \
-d 100 \
-t $task.cpusWhole Nextflow Process:
process PVACSEQ {
cpus 16
memory "128GB"
container "griffithlab/pvactools:6.0.1"
scratch true
clusterOptions '--gres=scratch:750G'
publishDir "${params.outdir}/pvactools/", mode: "copy"
input:
tuple val(somatic_meta), path(somatic_vcf), path(somatic_vcf_index)
tuple val(phased_meta), path(phased_vcf), path(phased_vcf_index)
tuple val(tumor_meta), path(tumor_reads), path(tumor_reads_index)
tuple val(normal_meta), path(normal_reads), path(normal_reads_index)
path(hla_pvac_input)
output:
path("${somatic_meta.somatic_name}_pvacseq"), emit: pvacseq_dir
script:
"""
pvacseq run \
$somatic_vcf \
${tumor_meta.sample_name} \
\$(head $hla_pvac_input -n 1) \
BigMHC_EL BigMHC_IM DeepImmuno MHCflurry MHCflurryEL MHCnuggetsI MHCnuggetsII NNalign NetMHC NetMHCIIpan NetMHCIIpanEL NetMHCpan NetMHCpanEL PickPocket SMM SMMPMBEC SMMalign \
"${somatic_meta.somatic_name}_pvacseq" \
-e1 8,9,10,11 \
-e2 12,13,14,15,16,17,18 \
--normal-sample-name ${normal_meta.sample_name} \
--phased-proximal-variants-vcf $phased_vcf \
--iedb-install-directory /opt/iedb \
--pass-only \
-d 100 \
-t $task.cpus
"""
}
Input files
No response
Log output
Making binding predictions on Allele HLA-A*02:01 and Epitope Length 10 with Method BigMHC_IM - File /scratch/hwismer/945341/nxf.vO4ulZL477/IPIMEL575_B1_V_T1_pvacseq/MHC_Class_I/tmp/IPIMEL575_T1.BigMHC_IM.HLA-A*02:01.10.tsv_1001-1052
Leaving parallel region (59)...
Process 59 done. Shutting down.
Leaving parallel region (47)...
Process 47 done. Shutting down.
Leaving parallel region (60)...
Process 60 done. Shutting down.
Leaving parallel region (49)...
Process 49 done. Shutting down.
Making binding predictions on Allele HLA-A*02:01 and Epitope Length 10 with Method NetMHCpanEL - File /scratch/hwismer/945341/nxf.vO4ulZL477/IPIMEL575_B1_V_T1_pvacseq/MHC_Class_I/tmp/IPIMEL575_T1.netmhcpan_el.HLA-A*02:01.10.tsv_1-200 - Completed
Making binding predictions on Allele HLA-A*02:01 and Epitope Length 10 with Method PickPocket - File /scratch/hwismer/945341/nxf.vO4ulZL477/IPIMEL575_B1_V_T1_pvacseq/MHC_Class_I/tmp/IPIMEL575_T1.pickpocket.HLA-A*02:01.10.tsv_1-200
Leaving parallel region (67)...
Process 67 done. Shutting down.
Leaving parallel region (50)...
Process 50 done. Shutting down.
Leaving parallel region (66)...
Process 66 done. Shutting down.
Leaving parallel region (16)...
Waiting for process 47...
Waiting for process 48...
Leaving parallel region (55)...
Process 55 done. Shutting down.
Leaving parallel region (58)...
Process 58 done. Shutting down.
Leaving parallel region (53)...
Process 53 done. Shutting down.
Leaving parallel region (62)...
Process 62 done. Shutting down.
Leaving parallel region (48)...
Process 48 done. Shutting down.
Waiting for process 49...
Waiting for process 50...
Waiting for process 53...
Waiting for process 55...
Waiting for process 58...
Waiting for process 59...
Waiting for process 60...
Waiting for process 62...
Waiting for process 66...
Waiting for process 67...
Waiting for process 69...
Leaving parallel region (69)...
Process 69 done. Shutting down.
Waiting for process 72...
Waiting for process 74...
An exception occured in thread 8: (<class 'TypeError'>, a bytes-like object is required, not 'NoneType').
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/pvactools/lib/pipeline.py", line 368, in call_iedb
pvactools.lib.call_iedb.main(arguments)
File "/usr/local/lib/python3.11/site-packages/pvactools/lib/call_iedb.py", line 53, in main
tmp_output_filehandle.write(response_text)
TypeError: a bytes-like object is required, not 'NoneType'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/pvacseq", line 8, in <module>
sys.exit(main())
^^^^^^
File "/usr/local/lib/python3.11/site-packages/pvactools/tools/pvacseq/main.py", line 157, in main
args[0].func.main(args[1])
File "/usr/local/lib/python3.11/site-packages/pvactools/tools/pvacseq/run.py", line 156, in main
pipeline.execute()
File "/usr/local/lib/python3.11/site-packages/pvactools/lib/pipeline.py", line 472, in execute
self.call_iedb(chunks)
File "/usr/local/lib/python3.11/site-packages/pvactools/lib/pipeline.py", line 360, in call_iedb
with pymp.Parallel(self.n_threads) as p:
File "/usr/local/lib/python3.11/site-packages/pymp/__init__.py", line 148, in __exit__
raise exc_t(exc_val)
TypeError: a bytes-like object is required, not 'NoneType'
Job ID: 945341
Cluster: c4
User/Group: hwismer/cluster
State: FAILED (exit code 1)
Nodes: 1
Cores per node: 16
CPU Utilized: 16:16:53
CPU Efficiency: 92.58% of 17:35:12 core-walltime
Job Wall-clock time: 01:05:57
Memory Utilized: 316.55 GB
Memory Efficiency: 123.65% of 256.00 GB
Output files
No response