Puzzled about limma and PAM results validity
1
0
Entering edit mode
@giulio-di-giovanni-950
Last seen 10.2 years ago
Hi all, sorry if I write such a "not strictly technical" question to this mailing list. Even if not linked to the programming, maybe somebody would be so nice to comment on my issue. On a dataset I performed a simple DE analysis between two groups through limma (eBayes and topTable). The histogram of the p-values are quite nice, showing a good number DE genes: around 400 with adj p-vals ranging from 0.01 to 0.05. Not extremely highly sign. but still.... The highest FC is around 1.5. I also ran SAM and I got almost the same results. Am I correct interpreting in a general way like there many "small" significative differences? On the same data I also ran a Predictive Analysis through PAM. By minimizing the CV errors I can select around 70 genes, ALL of them are also present at the top positions into the list obtained with the DE analysis. The only thing that while I don't find it surprising but still puzzles me, is the high level of the errors. The confusion matrix gives me a level of misclassification error of 0.1 and 0.6 for the two classes, and an overall error of 0.3 Please, can somebody help me comment on this? Do the error levels of the PAM analysis invalidate in some way the results obtained with the two DE methods? Or simply due to the small quantitative differences the Predictive analysis is not able to clearly classify the selected genes? Or maybe something else? Thanks a lot in advance, any help will be appreciated, Giulio. [[alternative HTML version deleted]]
limma limma • 918 views
ADD COMMENT
0
Entering edit mode
@giulio-di-giovanni-950
Last seen 10.2 years ago
Mhhh, it seems that maybe I wasn't clear, or my previous it passed unnoticed. Please allow me to repost it (see below this email). In short: Quite clearly small differentiate genes with Differential Expression. Same results, same genes with PAM, but high CV errors! Is it PAM """failing""", by overestimating the errors (because of the small, even if significative, differences)? Any clues about why I get on one side high misclassification errors for the same genes that on the other side are nicely and clearly differentially expressed? Sorry for the repost, it is the first and last time, Best Giulio > From: perimessaggini@hotmail.com > To: bioconductor@stat.math.ethz.ch > Date: Fri, 24 Sep 2010 14:55:39 +0000 > Subject: [BioC] Puzzled about limma and PAM results validity > > > > Hi all, sorry if I write such a "not strictly technical" question to this mailing list. Even if not linked to the programming, maybe somebody would be so nice to comment on my issue. > > On a dataset I performed a simple DE analysis between two groups through limma (eBayes and topTable). The histogram of the p-values are quite nice, showing a good number DE genes: around 400 with adj p-vals ranging from 0.01 to 0.05. Not extremely highly sign. but still.... The highest FC is around 1.5. I also ran SAM and I got almost the same results. > Am I correct interpreting in a general way like there many "small" significative differences? > > On the same data I also ran a Predictive Analysis through PAM. By minimizing the CV errors I can select around 70 genes, ALL of them are also present at the top positions into the list obtained with the DE analysis. > The only thing that while I don't find it surprising but still puzzles me, is the high level of the errors. The confusion matrix gives me a level of misclassification error of 0.1 and 0.6 for the two classes, and an overall error of 0.3 > > Please, can somebody help me comment on this? Do the error levels of the PAM analysis invalidate in some way the results obtained with the two DE methods? Or simply due to the small quantitative differences the Predictive analysis is not able to clearly classify the selected genes? Or maybe something else? > > Thanks a lot in advance, > > any help will be appreciated, > > Giulio. > > > > [[alternative HTML version deleted]] > > _______________________________________________ > Bioconductor mailing list > Bioconductor@stat.math.ethz.ch > https://stat.ethz.ch/mailman/listinfo/bioconductor > Search the archives: http://news.gmane.org/gmane.science.biology.informatics.conductor [[alternative HTML version deleted]]
ADD COMMENT
0
Entering edit mode
Hi Giulio, On Sat, Sep 25, 2010 at 8:21 AM, Giulio Di Giovanni <perimessaggini at="" hotmail.com=""> wrote: > > Mhhh, it seems that maybe I wasn't clear, or my previous it passed unnoticed. Please allow me to repost it (see below this email). > In short: Quite clearly small differentiate genes with Differential Expression. Same results, same genes with PAM, but high CV errors! Is it PAM """failing""", by overestimating the errors (because of the small, even if significative, differences)? Any clues about why I get on one side high misclassification errors for the same genes that on the other side are nicely and clearly differentially expressed? I'm not sure that your PAM classification result has anything to do with the validity of the genes that are differentially expressed. It probably just means that PAM isn't well suited to your problem. There are likely many reasons for that. -steve -- Steve Lianoglou Graduate Student: Computational Systems Biology ?| Memorial Sloan-Kettering Cancer Center ?| Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
ADD REPLY
0
Entering edit mode
I should also add that I'd do more "mundane" things to check on the quality of your data (see: arrayQualityMetrics, as a start) in order to get more (or less) confidence in your results from limma. On Sat, Sep 25, 2010 at 4:44 PM, Steve Lianoglou <mailinglist.honeypot at="" gmail.com=""> wrote: > Hi Giulio, > > On Sat, Sep 25, 2010 at 8:21 AM, Giulio Di Giovanni > <perimessaggini at="" hotmail.com=""> wrote: >> >> Mhhh, it seems that maybe I wasn't clear, or my previous it passed unnoticed. Please allow me to repost it (see below this email). >> In short: Quite clearly small differentiate genes with Differential Expression. Same results, same genes with PAM, but high CV errors! Is it PAM """failing""", by overestimating the errors (because of the small, even if significative, differences)? Any clues about why I get on one side high misclassification errors for the same genes that on the other side are nicely and clearly differentially expressed? > > I'm not sure that your PAM classification result has anything to do > with the validity of the genes that are differentially expressed. > > It probably just means that PAM isn't well suited to your problem. > There are likely many reasons for that. > > -steve > > -- > Steve Lianoglou > Graduate Student: Computational Systems Biology > ?| Memorial Sloan-Kettering Cancer Center > ?| Weill Medical College of Cornell University > Contact Info: http://cbio.mskcc.org/~lianos/contact > -- Steve Lianoglou Graduate Student: Computational Systems Biology ?| Memorial Sloan-Kettering Cancer Center ?| Weill Medical College of Cornell University Contact Info: http://cbio.mskcc.org/~lianos/contact
ADD REPLY

Login before adding your answer.

Traffic: 718 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6