The AstroStat Slog » Peter Freeman http://groundtruth.info/AstroStat/slog Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 09 Sep 2011 17:05:33 +0000 http://wordpress.org/?v=2.9 en hourly 1 All your bias are belong to us http://groundtruth.info/AstroStat/slog/2007/astroph-07054199/ http://groundtruth.info/AstroStat/slog/2007/astroph-07054199/#comments Mon, 04 Jun 2007 21:42:38 +0000 vlk http://groundtruth.info/AstroStat/slog/2007/astroph-07054199/ Leccardi & Molendi (2007) have a paper in A&A (astro-ph/0705.4199) discussing the biases in parameter estimation when spectral fitting is confronted with low counts data. Not surprisingly, they find that the bias is higher for lower counts, for standard chisq compared to C-stat, for grouped data compared to ungrouped. Peter Freeman talked about something like this at the 2003 X-ray Astronomy School at Wallops Island (pdf1, pdf2), and no doubt part of the problem also has to do with the (un)reliability of the fitting process when the chisq surface gets complicated.

Anyway, they propose an empirical method to reduce the bias by computing the probability distribution functions (pdfs) for various simulations, and then averaging the pdfs in groups of 3. Seems to work, for reasons that escape me completely.

[Update: links to Peter's slides corrected]

]]> http://groundtruth.info/AstroStat/slog/2007/astroph-07054199/feed/ 1