Query
1
0
Entering edit mode
@austin-tanney-562
Last seen 10.3 years ago
Hi Folks, Do any of you have any experience doing data analysis on computer grids? We're looking into doing some supervised clustering on large numbers of samples and obviously this is going to require a lot of processing power and, more importantly, memory. I was thinking of setting up a grid of our PC's in order to utilise the processors/memory of multiple machines to facilitate this. Any feedback would be appreciated Cheers Austin Dr. Austin Tanney Senior Scientist Arragen Ltd. E-mail: Austin.Tanney@Arragen.com Phone: +44 283839 5750 Fax: +44 283839 8676 Mobile: +44 7968 013939
Clustering Clustering • 719 views
ADD COMMENT
0
Entering edit mode
A.J. Rossini ▴ 810
@aj-rossini-209
Last seen 10.3 years ago
grids or clusters? They aren't quite the same. We've done some cluster work, but it's preliminary. You'd have to rewrite (or start fresh) to handle the relocation of data, adjusting locally for network speed. My group and others have developed basic infrastructure for doing this, but it isn't clear how to do it correctly in general. "Tanney, Austin" <austin.tanney@arragen.com> writes: > Hi Folks, > > Do any of you have any experience doing data analysis on computer > grids? We're looking into doing some supervised clustering on large > numbers of samples and obviously this is going to require a lot of > processing power and, more importantly, memory. I was thinking of > setting up a grid of our PC's in order to utilise the > processors/memory of multiple machines to facilitate this. > > Any feedback would be appreciated > > Cheers > > Austin > > > Dr. Austin Tanney Senior Scientist Arragen Ltd. > > E-mail: Austin.Tanney@Arragen.com Phone: +44 283839 5750 Fax: +44 > 283839 8676 Mobile: +44 7968 013939 > > _______________________________________________ Bioconductor mailing > list Bioconductor@stat.math.ethz.ch > https://www.stat.math.ethz.ch/mailman/listinfo/bioconductor > -- Anthony Rossini Research Associate Professor rossini@u.washington.edu http://www.analytics.washington.edu/ Biomedical and Health Informatics University of Washington Biostatistics, SCHARP/HVTN Fred Hutchinson Cancer Research Center UW (Tu/Th/F): 206-616-7630 FAX=206-543-3461 | Voicemail is unreliable FHCRC (M/W): 206-667-7025 FAX=206-667-4812 | use Email CONFIDENTIALITY NOTICE: This e-mail message and any attachme...{{dropped}}
ADD COMMENT

Login before adding your answer.

Traffic: 509 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6