#29 open
john.mccallum (at plantandfood)

Improve Moa error logging for ruff jobs

Reported by john.mccallum (at plantandfood) | May 25th, 2011 @ 01:08 AM | in v1.1

[cfljam@pgenome 15.BLASTX_USDA_GH32]$ pwd /data/moa/onion/70.CG_marker_design/40.CHO/GH32/15.BLASTX_USDA_GH32 [cfljam@pgenome 15.BLASTX_USDA_GH32]$ moa show db /data/moa/db/uniprot/10.uniprot.trembl/uniprot_trembl
eval 1e-10
gff_blasthit F
gff_source BLAST
input ../12.retrieve_USDA_GH32/.fasta
nohits 50
nothreads 2
outgff gff/
.gff
output out/*.out
postcommand
precommand
program blastx
project
title Blast against Trembl PLants
[cfljam@pgenome 15.BLASTX_USDA_GH32]$ ls -l .. total 16
drwxrwxr-x 2 cfljam users 4096 May 24 13:27 00.raw_data_motifs
drwxrwxr-x 3 cfljam users 4096 May 25 12:51 11.fuzztran
drwxrwxr-x 3 cfljam users 4096 May 25 13:00 12.retrieve_USDA_GH32
drwxrwxr-x 5 cfljam users 4096 May 25 13:06 15.BLASTX_USDA_GH32
[cfljam@pgenome 15.BLASTX_USDA_GH32]$ ls -la total 20
drwxrwxr-x 5 cfljam users 4096 May 25 13:06 .
drwxrwxr-x 6 cfljam users 4096 May 25 13:02 ..
drwxrwxr-x 2 cfljam users 4096 May 25 13:06 gff
drwxrwxr-x 4 cfljam users 4096 May 25 13:07 .moa
drwxrwxr-x 2 cfljam users 4096 May 25 13:06 out
[cfljam@pgenome 15.BLASTX_USDA_GH32]$moa run

  File "/opt/moa10/lib/python/moa/backend/ruff.py", line 381, in executor
    raise ruffus.JobSignalledBreak
JobSignalledBreak:

Warning: Encountered a run error?
Traceback (most recent call last):
File "/opt/moa10/bin/moa", line 318, in

run_1()

File "/opt/moa10/bin/moa", line 292, in run_1

run_2()

File "/opt/moa10/bin/moa", line 246, in run_2

run_3(wd)

File "/opt/moa10/bin/moa", line 201, in run_3

silent = sysConf.options.silent)

File "/opt/moa10/lib/python/moa/job.py", line 250, in execute

execNow, verbose = verbose, silent=silent)

File "/opt/moa10/lib/python/moa/backend/ruff.py", line 241, in execute

logger = ruffus.black_hole_logger,

File "build/bdist.linux-x86_64/egg/ruffus/task.py", line 2680, in pipeline_run ruffus.ruffus_exceptions.RethrownJobError:

Exceptions running jobs for

'def moa.backend.ruff.executor(...):'

Original exception:

Exception [#1](/projects/73665/tickets/1 "Ticket #1")
ruffus.ruffus_exceptions.JobSignalledBreak(


    ):
for moa.backend.ruff.executor.Job = [[[../12.retrieve_USDA_GH32/5225.singletons_GH32.fasta, uniprot_trembl]] -> [gff/5225.singletons_GH32.gff, out/5225.singletons_GH32.out], #!/bin/bash -e
    blastall -i ../12.retrieve_USDA_GH32/5225.singletons_GH32.fasta -p blastx \
            -e 1e-10 -m 7 -a 2 -d /data/moa/db/uniprot/10.uniprot.trembl/uniprot_trembl \
            -b 50 -v  50 -o out/5225.singletons_GH32.out

    cat out/5225.singletons_GH32.out | blast2gff -b F  \
        -s BLAST -d query > gff/5225.singletons_GH32.gff, {'program': 'blastx', 'postcommand': '', 'wd': '/data/moa/onion/70.CG_marker_design/40.CHO/GH32/15.BLASTX_USDA_GH32', 'precommand': '', 'db': '/data/moa/db/uniprot/10.uniprot.trembl/uniprot_trembl', 'job': <moa.job.Job object at 0x10facf50>, 'nothreads': '2', 'eval': '1e-10', 'input': '../12.retrieve_USDA_GH32/5225.singletons_GH32.fasta', 'outgff': 'gff/5225.singletons_GH32.gff', 'silent': None, 'default_command': 'run', 'moa_filesets': ['input', 'db', 'outgff', 'output'], 'title': 'Blast against Trembl PLants', 'project': '', 'gff_source': 'BLAST', 'nohits': '50', 'gff_blasthit': 'F', 'output': 'out/5225.singletons_GH32.out'}]

Traceback (most recent call last):
  File "build/bdist.linux-x86_64/egg/ruffus/task.py", line 517, in run_pooled_job_without_exceptions
    return_value =  job_wrapper(param, user_defined_work_func, register_cleanup, touch_files_only)
  File "build/bdist.linux-x86_64/egg/ruffus/task.py", line 447, in job_wrapper_io_files
    ret_val = user_defined_work_func(*param)
  File "/opt/moa10/lib/python/moa/backend/ruff.py", line 381, in executor
    raise ruffus.JobSignalledBreak
JobSignalledBreak:

Comments and changes to this ticket

  • MF

    MF May 31st, 2011 @ 09:11 PM

    • Tag set to moa ruff log
    • State changed from “new” to “open”
    • Title changed from “BLAST=BOOM!!@@#” to “Improve Moa error logging for ruff jobs”

    John, is this one still valid, or was it solved by changing your python version??

    whatever the case is - we need to do something about how moa/ruffus shows it's errors...

    cheers
    M

  • john.mccallum (at plantandfood)

    john.mccallum (at plantandfood) May 31st, 2011 @ 09:16 PM

    Yes I think solved

    -----Original Message----- From: Lighthouse [mailto:no-reply@lighthouseapp.com]
    Sent: Wednesday, June 01, 2011 9:11 AM
    To: John McCallum
    Subject: [Moa #29] Improve Moa error logging for ruff jobs

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.

New-ticket Create new ticket

Create your profile

Help contribute to this project by taking a few moments to create your personal profile. Create your profile »

lightweight workflows for bioinformatics

Shared Ticket Bins

People watching this ticket

Referenced by

Pages