startup options
1
0
Entering edit mode
@kasper-daniel-hansen-2979
Last seen 18 months ago
United States
When we load say IRanges, it takes a while. I seem to recall it has something to do with memory allocation or something, and that there is (or used to be) a startup option to R where you could increase the relevant memory and thereby decrease startup time (including loading of "standard" packages). I seem to recall Martin Morgan posting about it. Does this ring any bells? Best, Kasper
IRanges IRanges • 1.1k views
ADD COMMENT
0
Entering edit mode
@benilton-carvalho-1375
Last seen 4.7 years ago
Brazil/Campinas/UNICAMP
--max-mem-size and --max-vsize are the only items that I can remember... but, AFAIR, they're Windows-exclusive... 2013/3/13 Kasper Daniel Hansen <kasperdanielhansen at="" gmail.com="">: > When we load say IRanges, it takes a while. I seem to recall it has > something to do with memory allocation or something, and that there is > (or used to be) a startup option to R where you could increase the > relevant memory and thereby decrease startup time (including loading > of "standard" packages). I seem to recall Martin Morgan posting about > it. > > Does this ring any bells? > > Best, > Kasper > > _______________________________________________ > Bioconductor mailing list > Bioconductor at r-project.org > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor
ADD COMMENT
0
Entering edit mode
Hej Kasper, Benilton! This is from a previous post from Martin (titled SummarizedExperiments from September 5 2012): As a miscellaneous 'tip', when working with large data I find it useful to start R with --min-vsize=2048M --min-nsize=20M. These are documented in RShowDoc("R-intro") as 'for expert use only' and influence how much memory R allocates for vectors ('vsize'; vsize can be very large) and for S-expressions ('nsize' 50000000) and help get up to large memory allocations without innumerable garbage collections. Of course having big memory is of primary importance. These are not OS specific as far as I know. Cheers, Nico --------------------------------------------------------------- Nicolas Delhomme Genome Biology Computational Support European Molecular Biology Laboratory Tel: +49 6221 387 8310 Email: nicolas.delhomme at embl.de Meyerhofstrasse 1 - Postfach 10.2209 69102 Heidelberg, Germany --------------------------------------------------------------- On Mar 13, 2013, at 3:35 PM, Benilton Carvalho wrote: > --max-mem-size and --max-vsize are the only items that I can > remember... but, AFAIR, they're Windows-exclusive... > > 2013/3/13 Kasper Daniel Hansen <kasperdanielhansen at="" gmail.com="">: >> When we load say IRanges, it takes a while. I seem to recall it has >> something to do with memory allocation or something, and that there is >> (or used to be) a startup option to R where you could increase the >> relevant memory and thereby decrease startup time (including loading >> of "standard" packages). I seem to recall Martin Morgan posting about >> it. >> >> Does this ring any bells? >> >> Best, >> Kasper >> >> _______________________________________________ >> Bioconductor mailing list >> Bioconductor at r-project.org >> https://stat.ethz.ch/mailman/listinfo/bioconductor >> Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor > > _______________________________________________ > Bioconductor mailing list > Bioconductor at r-project.org > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor
ADD REPLY
0
Entering edit mode
Also in R-devel under ?Memory there is How much time R spends in the garbage collector will depend on these initial settings and on the trade-off the memory manager makes, when memory fills up, between collecting garbage to free up unused memory and growing these areas. The strategy used for growth can be specified by setting the environment variable 'R_GC_MEM_GROW' to an integer value between 0 and 3. This variable is read at start-up. Higher values grow the heap more aggressively, thus reducing garbage collection time but using more memory. and I would be interested in experiences with adjustments to this value in real work flows. Martin On 03/13/2013 08:07 AM, Nicolas Delhomme wrote: > Hej Kasper, Benilton! > > This is from a previous post from Martin (titled SummarizedExperiments from September 5 2012): > > As a miscellaneous 'tip', when working with large data I find it useful to start R with --min-vsize=2048M --min-nsize=20M. These are documented in RShowDoc("R-intro") as 'for expert use only' and influence how much memory R allocates for vectors ('vsize'; vsize can be very large) and for S-expressions ('nsize' 50000000) and help get up to large memory allocations without innumerable garbage collections. Of course having big memory is of primary importance. > > These are not OS specific as far as I know. > > Cheers, > > Nico > > --------------------------------------------------------------- > Nicolas Delhomme > > Genome Biology Computational Support > > European Molecular Biology Laboratory > > Tel: +49 6221 387 8310 > Email: nicolas.delhomme at embl.de > Meyerhofstrasse 1 - Postfach 10.2209 > 69102 Heidelberg, Germany > --------------------------------------------------------------- > > > > > > On Mar 13, 2013, at 3:35 PM, Benilton Carvalho wrote: > >> --max-mem-size and --max-vsize are the only items that I can >> remember... but, AFAIR, they're Windows-exclusive... >> >> 2013/3/13 Kasper Daniel Hansen <kasperdanielhansen at="" gmail.com="">: >>> When we load say IRanges, it takes a while. I seem to recall it has >>> something to do with memory allocation or something, and that there is >>> (or used to be) a startup option to R where you could increase the >>> relevant memory and thereby decrease startup time (including loading >>> of "standard" packages). I seem to recall Martin Morgan posting about >>> it. >>> >>> Does this ring any bells? >>> >>> Best, >>> Kasper >>> >>> _______________________________________________ >>> Bioconductor mailing list >>> Bioconductor at r-project.org >>> https://stat.ethz.ch/mailman/listinfo/bioconductor >>> Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor >> >> _______________________________________________ >> Bioconductor mailing list >> Bioconductor at r-project.org >> https://stat.ethz.ch/mailman/listinfo/bioconductor >> Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor > > _______________________________________________ > Bioconductor mailing list > Bioconductor at r-project.org > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor > -- Computational Biology / Fred Hutchinson Cancer Research Center 1100 Fairview Ave. N. PO Box 19024 Seattle, WA 98109 Location: Arnold Building M1 B861 Phone: (206) 667-2793
ADD REPLY

Login before adding your answer.

Traffic: 833 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6