Parallelizing Biostrings::pairwiseAlignment locally with multicore::mclapply problems?
1
0
Entering edit mode
@steve-lianoglou-2771
Last seen 19 months ago
United States
Hi, I see that pairwiseAlignment can be ||-ized using Rmpi, but I wrote a simple wrapper to use multicore since I'm using one machine anyway[*]. Let's try this in the simplest possible way and assume I have `pattern` and `subject` XStringSets that I want to align against eachother and `mc.cores` is the number of cores I want to use: split.idx <- sort(seq_along(pattern) %% mc.cores) mc.output <- multicore:::mclapply(1:mc.cores - 1L, function(idx) { pairwiseAlignment(pattern[take], subject[take], ...) }) Then collect results in a similar fashion to `mpi.collate.pairwiseAlignment` Anyway, I'm getting these warnings in each ||-ized loop like so: select: Interrupted system call All google hits of this warning seem to suggest a problem w/ each process accessing a shared resource -- in particular a database connection, but that can't be the case here. Before I sink the next X arbitrary-time-units into this, I'm just curious if anybody knows what might be raising this warning? [*] to be honest, I'm a bit lazy to wade through the particulars of setting Rmpi/slaves locally to just use the builtin mpi.* functions -- if someone has a reference to a handy tutorial that summarizes what's required to use Rmpi to ||-ize stuff locally (on os x ;-), it'd be greatly appreciated. Abridged sessionInfo(): R version 2.15.0 (2012-03-30) Platform: x86_64-apple-darwin9.8.0/x86_64 (64-bit) other attached packages: Rmpi_0.5-9 Biostrings_2.25.1 Thanks, -steve -- Steve Lianoglou Graduate Student: Computational Systems Biology ?| Memorial Sloan-Kettering Cancer Center ?| Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
Cancer Cancer • 1.0k views
ADD COMMENT
0
Entering edit mode
@steve-lianoglou-2771
Last seen 19 months ago
United States
Sorry, I included the wrong package info from sessionInfo: > R version 2.15.0 (2012-03-30) > Platform: x86_64-apple-darwin9.8.0/x86_64 (64-bit) > > other attached packages: > Rmpi_0.5-9 > Biostrings_2.25.1 Rmpi isn't really relevant and should have included: multicore_0.1-7 -- Steve Lianoglou Graduate Student: Computational Systems Biology ?| Memorial Sloan-Kettering Cancer Center ?| Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
ADD COMMENT
0
Entering edit mode
Aaaaannd ... please ignore this thread. I just restarted an R session w/ only my data, Biostrings, and multicore loaded and this warning is now gone. Still not sure how that warning was being emitted, but sometimes ignorance is bliss. -steve On Tue, Apr 17, 2012 at 12:02 PM, Steve Lianoglou <mailinglist.honeypot at="" gmail.com=""> wrote: > Sorry, I included the wrong package info from sessionInfo: > >> R version 2.15.0 (2012-03-30) >> Platform: x86_64-apple-darwin9.8.0/x86_64 (64-bit) >> >> other attached packages: >> Rmpi_0.5-9 >> Biostrings_2.25.1 > > Rmpi isn't really relevant and should have included: > > multicore_0.1-7 > > > -- > Steve Lianoglou > Graduate Student: Computational Systems Biology > ?| Memorial Sloan-Kettering Cancer Center > ?| Weill Medical College of Cornell University > Contact Info: http://cbio.mskcc.org/~lianos/contact -- Steve Lianoglou Graduate Student: Computational Systems Biology ?| Memorial Sloan-Kettering Cancer Center ?| Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
ADD REPLY
0
Entering edit mode
On 04/17/2012 09:10 AM, Steve Lianoglou wrote: > Aaaaannd ... please ignore this thread. > > I just restarted an R session w/ only my data, Biostrings, and > multicore loaded and this warning is now gone. > > Still not sure how that warning was being emitted, but sometimes > ignorance is bliss. better to use parallel (included with R) than multicore (presumably legacy, as it's functionality has been folded in to parallel). Martin > > -steve > > On Tue, Apr 17, 2012 at 12:02 PM, Steve Lianoglou > <mailinglist.honeypot at="" gmail.com=""> wrote: >> Sorry, I included the wrong package info from sessionInfo: >> >>> R version 2.15.0 (2012-03-30) >>> Platform: x86_64-apple-darwin9.8.0/x86_64 (64-bit) >>> >>> other attached packages: >>> Rmpi_0.5-9 >>> Biostrings_2.25.1 >> >> Rmpi isn't really relevant and should have included: >> >> multicore_0.1-7 >> >> >> -- >> Steve Lianoglou >> Graduate Student: Computational Systems Biology >> | Memorial Sloan-Kettering Cancer Center >> | Weill Medical College of Cornell University >> Contact Info: http://cbio.mskcc.org/~lianos/contact > > > -- Computational Biology Fred Hutchinson Cancer Research Center 1100 Fairview Ave. N. PO Box 19024 Seattle, WA 98109 Location: M1-B861 Telephone: 206 667-2793
ADD REPLY

Login before adding your answer.

Traffic: 659 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6