<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>The AstroStat Slog &#187; Equation of the Week</title>
	<atom:link href="http://groundtruth.info/AstroStat/slog/tag/equation-of-the-week/feed/" rel="self" type="application/rss+xml" />
	<link>http://groundtruth.info/AstroStat/slog</link>
	<description>Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders</description>
	<lastBuildDate>Fri, 09 Sep 2011 17:05:33 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Blackbody Radiation [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-blackbody/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-blackbody/#comments</comments>
		<pubDate>Wed, 27 Aug 2008 17:00:22 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Astro]]></category>
		<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Physics]]></category>
		<category><![CDATA[Spectral]]></category>
		<category><![CDATA[blackbody]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=507</guid>
		<description><![CDATA[Like spherical cows, true blackbodies do not exist.  Not because &#8220;black objects are dark, duh&#8221;, as I&#8217;ve heard many people mistakenly say &#8212; black here simply refers to the property of the object where no wavelength is preferentially absorbed or emitted, and all the energy input to it is converted into radiation.  There [...]]]></description>
			<content:encoded><![CDATA[<p>Like <a href="http://en.wikipedia.org/wiki/Spherical_cow">spherical cows</a>, true blackbodies do not exist.  Not because &#8220;black objects are dark, duh&#8221;, as I&#8217;ve heard many people mistakenly say &#8212; black here simply refers to the property of the object where no wavelength is preferentially absorbed or emitted, and all the energy input to it is converted into radiation.  There are many famous astrophysical cases which are very good approximations to perfect blackbodies &#8212; the 2.73K microwave background radiation left over from the early Universe, for instance.  Even the Sun is a good example.  So it is often used to model the emission from various objects.<span id="more-507"></span></p>
<p>The blackbody spectrum is<br />
$$B_{\nu}(T) = \frac{2 h \nu^3}{c^2} \frac{1}{e^{h \nu / k_B T} &#8211; 1} ~~ {\rm [erg~s^{-1}~cm^{-2}~Hz^{-1}~sr^{-1}]} \,,$$<br />
where &#957; is the frequency in [Hz], <em>h</em> is Planck&#8217;s constant, <em>c</em> is the speed of light in vacuum, and <em>k<sub>B</sub></em> is Boltzmann&#8217;s constant.  The spectrum is interesting in many ways.  Its shape is characterized by only one parameter, the radiation temperature <em>T</em>.  A spectrum with a higher <em>T</em> is greater in intensity at all frequencies compared to one with a lower <em>T</em>, and the integral over all frequencies is <em>&#963; T<sup>4</sup></em>, where $$\sigma \equiv \frac{2\pi^5k_B^4}{15 c^2 h^3}$$ is the Stefan-Boltzmann constant.  Other than that, the normalization is detached, so to speak, from <em>T</em>, and differences in source luminosities are entirely attributable to differences in emission surface area.</p>
<p>The general shape of a blackbody spectrum is like a rising parabola at low &#957; (which led to much hand-wringing in the late 19th century about the Ultraviolet Catastrophe) and an exponential drop at high &#957;, with a well-defined peak in between.  The frequency at which the spectrum peaks is dependent on the temperature, with<br />
$$\nu_{\rm max} = 2.82 \frac{k_B T}{h}$$,<br />
or equivalently,<br />
$$ \lambda_{\rm max} = \frac{2.9\cdot10^4}{T} ~~ {\rm[\AA]} \,,$$<br />
where <em>T</em> is in [degK].</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-blackbody/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Magnitude [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-magnitude/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-magnitude/#comments</comments>
		<pubDate>Wed, 20 Aug 2008 17:00:34 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Astro]]></category>
		<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Optical]]></category>
		<category><![CDATA[B-V]]></category>
		<category><![CDATA[color]]></category>
		<category><![CDATA[colour]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[magnitude]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=447</guid>
		<description><![CDATA[I still remember my first class as a new grad student.  As a cocky Physics graduate, I was quite sure I knew plenty of astronomy.  Astro 301, class 1, and it took all of 20 minutes of talk about stellar magnitudes to put that notion to permanent rest.  So, for the sake [...]]]></description>
			<content:encoded><![CDATA[<p>I still remember my first class as a new grad student.  As a cocky Physics graduate, I was quite sure I knew plenty of astronomy.  Astro 301, class 1, and it took all of 20 minutes of talk about stellar magnitudes to put that notion to permanent rest.  So, for the sake of our stats colleagues, here&#8217;s a brief primer on one of the basic building blocks of astronomy. <span id="more-447"></span></p>
<p>For historical reasons, astronomers measure the brightness of celestial objects in rank order.  The smaller the rank number, aka magnitude, the brighter the object.  Thus, a star of the first magnitude is much brighter than a star of the sixth magnitude, and it would take exceptionally good eyes and a very dark sky to see a star of the seventh magnitude.   Now, it turns out that the human eye perceives brightness on a log scale, so magnitudes are numerically similar to <em>log</em>(brightness).  And because they are a ranking list, it is always with reference to a standard.  After some rough calibration to match human perception to true brightness of stars in the night sky, we have a formal definition for magnitude,<br />
$$m = &#8211; \frac{5}{2}\log_{10}\left(\frac{f_{object}}{f_{standard}}\right) \,,$$<br />
where <em>f<sub>object</sub></em> is the flux from the object and <em>f<sub>standard</sub></em> is the flux from a fiducial standard.  In the optical bands, the bright star Vega (&#945; Lyrae) has been adopted as the standard, and has magnitudes of 0 in all optical filters.  (Well, not exactly because Vega is not constant enough, and as a practical matter there is nowadays a hierarchy of photometric standard stars that are accessible at different parts of the sky.)  Note that we can also write this in terms of the intrinsic luminosity <em>L<sub>object</sub></em> of the object and the distance <em>d</em> to it,<br />
$$m = &#8211; \frac{5}{2}\log_{10}\left(\frac{L_{object}}{4 \pi d^2}\frac{1}{f_{standard}}\right) \,.$$</p>
<p>Because astronomical objects are located at a vast variety of distances, it is useful to define an intrinsic magnitude of the object, independent of the distance.  Thus, in contrast to the <em>apparent</em> magnitude <em>m</em>, which is the brightness at Earth, an <em>absolute</em> magnitude is defined as the brightness that would be perceived if the object were 10 parsecs away,<br />
$$M \equiv m|_{d={\rm 10~pc}} = m &#8211; \frac{5}{2}\log_{10}\left(\frac{d^2}{{\rm (10~pc)}^2}\right) \equiv m &#8211; 5\log_{10}d + 5$$<br />
where <em>d</em> is the distance to the object in <strong>[parsec]</strong>, and the squared term is of course because of the inverse square law.</p>
<p>There are other issues such as interstellar absorption, cosmological corrections, extent of the source, etc., but let&#8217;s not complicate it too much right away.</p>
<p>Colors are differences in the magnitudes in different passbands.  For instance, if the apparent magnitude in the blue filter is <em>m<sub>B</sub></em> and in the green filter is <em>m<sub>V</sub></em> (V for &#8220;visual&#8221;), the color is <em>m<sub>B</sub>-m<sub>V</sub></em> and is usually referred to as &#8220;B-V&#8221; color.  It is the difference in magnitudes, and is related to the log ratio of the intensities.</p>
<p>For an excellent description of what is involved in the <u>measurement</u> of magnitudes and colors, see <a href="http://www.starstryder.com/2007/10/16/making-photometric-data-fit-in-a-standard-system-using-excel/">this article on analyzing photometric data</a>  by <a href="http://www.starstryder.com/">Star Stryder</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-magnitude/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Differential Emission Measure [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-dem/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-dem/#comments</comments>
		<pubDate>Wed, 13 Aug 2008 17:00:13 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Astro]]></category>
		<category><![CDATA[High-Energy]]></category>
		<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Spectral]]></category>
		<category><![CDATA[Stars]]></category>
		<category><![CDATA[X-ray]]></category>
		<category><![CDATA[DEM]]></category>
		<category><![CDATA[Differential Emission Measure]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[stellar coronae]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=421</guid>
		<description><![CDATA[Differential Emission Measures (DEMs) are a summary of the temperature structure of the outer atmospheres (aka coronae) of stars, and are usually derived from a select subset of line fluxes.  They are notoriously difficult to estimate.  Very few algorithms even bother to calculate error envelopes on them.  They are also subject to [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://groundtruth.info/AstroStat/slog/2008/errordance/">Differential Emission Measures (DEMs)</a> are a summary of the temperature structure of the outer atmospheres (aka coronae) of stars, and are usually derived from a select subset of line fluxes.  They are notoriously difficult to estimate.  Very few algorithms even bother to calculate error envelopes on them.  They are also subject to numerous systematic uncertainties which can play havoc with proper interpretation.  But they are nevertheless extremely useful since they allow changes in coronal structures to be easily discerned, and observations with one instrument can be used to derive these DEMs and these can then be used to predict what is observable with some other instrument.<span id="more-421"></span></p>
<p>The flux at Earth due to <a href="http://groundtruth.info/AstroStat/slog/2008/eotw-line-emission/">an atomic transition <em>u &#8211;&gt; l</em></a> from a volume element <em>&#948;V</em> at a location <em>&#636;</em>,</p>
<blockquote><p><strong>I<sub>ul</sub>(&#636;) = (1/4 &#960;) (1/d(&#636;)<sup>2</sup>) A(Z,&#636;) G<sub>ul</sub>(n<sub>e</sub>(&#636;),T<sub>e</sub>(&#636;)) n<sub>e</sub>(&#636;)<sup>2</sup> &#948;V(&#636;) </strong>,</p></blockquote>
<p>where <em>n<sub>e</sub></em> is the electron density and <em>T<sub>e</sub></em> is the temperature of the plasma, <em>A(Z,&#636;)</em> are the abundance of element <em>Z</em>, <em>G<sub>ul</sub>(n<sub>e</sub>,T<sub>e</sub>)</em> is the atomic emissivity for the transition, and <em>d</em> is the distance to the source.</p>
<p>We can combine the flux from all the points in the field of view that arise from plasma at the same temperature,</p>
<blockquote><p><strong>I<sub>ul</sub>(T<sub>e</sub>) = (1/4 &#960;) &#8721;<sub>&#636;|T</sub><sub>e</sub>  (1/d(&#636;)<sup>2</sup>) A(Z,&#636;) G<sub>ul</sub>(n<sub>e</sub>(&#636;),T<sub>e</sub>) n<sub>e</sub><sup>2</sup>&#948;V(&#636;) </strong>.</p></blockquote>
<p>Assuming that <em>A(Z,&#636;), n<sub>e</sub>(&#636;)</em> do not vary over the points in the summation,</p>
<blockquote><p><strong>I<sub>ul</sub>(T<sub>e</sub>) &#8776; (1 / 4 &#960; d<sup>2</sup>) G<sub>ul</sub>(n<sub>e</sub>,T<sub>e</sub>) A(Z) n<sub>e</sub><sup>2</sup> (&#916;V / &#916;log T<sub>e</sub>) &#916;log T<sub>e</sub> </strong>,</p></blockquote>
<p>and hence the total line flux due to emission at all temperatures,</p>
<blockquote><p><strong><br />
I<sub>ul</sub> = &#8721;<sub>T</sub><sub>e</sub> (1 / 4 &#960; d<sup>2</sup>) A(Z) G<sub>ul</sub>(n<sub>e</sub>,T<sub>e</sub>) DEM(T<sub>e</sub>) &#916;logT<sub>e</sub><br />
</strong></p></blockquote>
<p>The quantity</p>
<blockquote><p><strong>DEM(T<sub>e</sub>) = n<sub>e</sub><sup>2</sup> (&#916;V / &#916;log T<sub>e</sub>) </strong></p></blockquote>
<p>is called the Differential Emission Measure and is a very useful summary of the temperature structure of stellar coronae.  It is typically reported in units of <strong>[cm<sup>-3</sup>]</strong> (or <strong>[cm<sup>-5</sup>]</strong> if <em>&#916;V</em> is written out as <em>area*&#916;h</em>).  Sometimes it is defined as <em>n<sub>e</sub><sup>2</sup>(&#916;V/&#916;T)</em> and has units <strong>[cm<sup>-3</sup>K<sup>-1</sup>]</strong>.</p>
<p>The expression for the line flux is an instance of <a href="http://en.wikipedia.org/wiki/Fredholm_integral_equation#Equation_of_the_first_kind">Fredholm&#8217;s Equation of the First Kind</a> and the <em>DEM(T<sub>e</sub>)</em> solution is thus unstable and subject to high-frequency oscillations.  There is a whole industry that has grown up trying to <a href="http://hea-www.harvard.edu/AstroStat/#soft">derive DEMs</a> from often highly unreliable datasets.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-dem/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>I Like Eq</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/i-like-eq/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/i-like-eq/#comments</comments>
		<pubDate>Wed, 13 Aug 2008 16:59:54 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Languages]]></category>
		<category><![CDATA[Meta]]></category>
		<category><![CDATA[Quotes]]></category>
		<category><![CDATA[1989]]></category>
		<category><![CDATA[David Mermin]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[formatting]]></category>
		<category><![CDATA[Physics Today]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=379</guid>
		<description><![CDATA[I grew up in an environment that glamourized mathematical equations.  Equations adorned a text like jewelry, set there to dazzle, and often to outshine the text that they were to illuminate.  Needless to say, anything I wrote was dense, opaque, and didn&#8217;t communicate what it set out to.  It was not until [...]]]></description>
			<content:encoded><![CDATA[<p>I grew up in an environment that glamourized mathematical equations.  Equations adorned a text like jewelry, set there to dazzle, and often to outshine the text that they were to illuminate.  Needless to say, anything I wrote was dense, opaque, and didn&#8217;t communicate what it set out to.  It was not until I saw a Reference Frame essay by David Mermin on how to write equations (<a href="http://adsabs.harvard.edu/abs/1989PhT....42j...9M">1989, Physics Today, 42, p9</a>) that I realized that equations should be treated as part of the text.  You should be able to <em>read</em> them.  David Mermin set out 3 rules for writing out equations, which I&#8217;ve tried to follow diligently (if not always successfully) since then.<span id="more-379"></span></p>
<ol>
<li> Number or label all displayed equations (Fisher&#8217;s Rule):<br />
<blockquote><p>The most common violation of Fisher&#8217;s rule is the misguided practice of numbering only those displayed equations to which the text subsequently refers back. &#8230; it is necessary to state emphatically that Fisher&#8217;s rule is for the benefit not of the author, but the reader.<br />
For although you, dear author, may have no need to refer in your text to the equations you therefore left unnumbered, it is presumptuous to assume the same disposition in your readers.  And although you may well have acquired the solipsistic habit of writing under the assumption that you will have no readers at all, you are wrong.</p></blockquote>
</li>
<li> When referring to an equation within the text, identify it by a phrase as well as a number (aka the Good Samaritan Rule):<br />
<blockquote><p>A Good Samaritan is compassionate and helpful to one in distress, and there is nothing more distressing than having to hunt your way back in a manuscript in search of Eq. (2.47), not because your subsequent progress requires you to inspect it in detail, but merely to find out what it is <em>about</em> so you may know the principles that go int othe construction of Eq. (7.38).</p></blockquote>
</li>
<li> Punctuate the equation (aka the Math is Prose Rule):<br />
<blockquote><p>The equations you display are embedded in your prose and constitute an inseparable part of it.</p></blockquote>
<blockquote><p>Regardless &#8230; of how to parse the equation internally, certain things are clear to anyone who understands the equation and the prose in which it is embedded.</p></blockquote>
<blockquote><p>We punctuate equations because they are a form of prose (they can, after all, be read aloud as a sequence of words) and are therefore subject to the same rules as any other prose. &#8230; punctuation makes them easier to read and often clarifies the discussion in which they occur.  &#8230; viewing an equation not as a grammatically irrelevant blob, but as a part of the text &#8230; can only improve the fluency and grace of one&#8217;s expository mathematical prose.</p></blockquote>
</li>
</ol>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/i-like-eq/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Background Subtraction, the Sequel [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-bkgsubtract-poisson/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-bkgsubtract-poisson/#comments</comments>
		<pubDate>Wed, 06 Aug 2008 17:00:39 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Astro]]></category>
		<category><![CDATA[Bayesian]]></category>
		<category><![CDATA[Data Processing]]></category>
		<category><![CDATA[High-Energy]]></category>
		<category><![CDATA[Imaging]]></category>
		<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Stat]]></category>
		<category><![CDATA[background]]></category>
		<category><![CDATA[background marginalization]]></category>
		<category><![CDATA[background subtraction]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=407</guid>
		<description><![CDATA[As mentioned before, background subtraction plays a big role in astrophysical analyses.  For a variety of reasons, it is not a good idea to subtract out background counts from source counts, especially in the low-counts Poisson regime.  What Bayesians recommend instead is to set up a model for the intensity of the source [...]]]></description>
			<content:encoded><![CDATA[<p>As mentioned before, <a href="http://groundtruth.info/AstroStat/slog/2008/eotw-background-subtraction/">background subtraction</a> plays a big role in astrophysical analyses.  For a variety of reasons, it is not a good idea to subtract out background counts from source counts, especially in the low-counts Poisson regime.  What Bayesians recommend instead is to set up a model for the intensity of the source and the background and to infer these intensities given the data. <span id="more-407"></span></p>
<p>For instance, suppose <a href="http://groundtruth.info/AstroStat/slog/2008/eotw-background-subtraction/">as before</a>, that <em>C</em> counts are observed in a region of the image that overlaps a putative source, and <em>B</em> counts in an adjacent, non-overlapping region that is mostly devoid of the source and which is <em>r</em> times larger in area and exposure than the source region.  Further suppose that a fraction <em>f</em> of the source falls in the so-called source region (typically, <em>f</em>~0.9) and a fraction <em>g</em> falls in the background region (we strive to make <em>g</em>~0).  Then the observed counts can be written as Poisson realizations of intensities,</p>
<blockquote><p><strong>C = Poisson(&#966;<sub>S</sub>) &#8801; Poisson(f &#173; &#952;<sub>S</sub> + &#952;<sub>B</sub>)</strong> , and<strong><br />
B = Poisson(&#966;<sub>B</sub>) &#8801; Poisson(g &#173; &#952;<sub>S</sub> + r &#173; &#952;<sub>B</sub>)</strong> ,</p></blockquote>
<p>where the subscripts denote the model intensities in the source (<em>S</em>) or background (<em>B</em>) regions.</p>
<p>The joint probability distribution of the model intensities,</p>
<blockquote><p><strong>p(&#966;<sub>S</sub> &#966;<sub>B</sub> | C B) d&#966;<sub>S</sub> d&#966;<sub>B</sub></strong></p></blockquote>
<p>can be rewritten in terms of the interesting parameters by transforming the variables,</p>
<blockquote><p><strong> &#8801; p(&#952;<sub>S</sub> &#952;<sub>B</sub> | C B)  J(&#966;<sub>S</sub> &#966;<sub>B</sub> ; &#952;<sub>S</sub> &#952;<sub>B</sub>) d &#952;<sub>S</sub> d &#952;<sub>B</sub></strong></p></blockquote>
<p>where <em>J(&#966;<sub>S</sub> &#966;<sub>B</sub> ; &#952;<sub>S</sub> &#952;<sub>B</sub>)</em> is the Jacobian of the coordinate transformation, and thus</p>
<blockquote><p><strong> = p(&#952;<sub>S</sub> &#952;<sub>B</sub> | C B) (r &#173; f &#8211; g) d &#952;<sub>S</sub> d &#952;<sub>B</sub></strong> .</p></blockquote>
<p>The posterior probability distribution of the source intensity, <em>&#952;<sub>S</sub></em>, can be derived by marginalizing this over the background intensity parameter, <em>&#952;<sub>B</sub></em>.  A number of people have done this calculation in the case <em>f=1,g=0</em> (e.g., <a href="http://www.astro.cornell.edu/staff/loredo/bayes/promise.pdf">Loredo 1992</a>, SCMA II, p275; see also <a href="http://adsabs.harvard.edu/abs/2001ApJ...548..224V">van Dyk et al. 2001</a>, ApJ 584, 224).  The general case is slightly more convoluted, but is still a straightforward calculation (<a href="http://hea-www.harvard.edu/AstroStat/HEAD2008/#0302">Kashyap et al. 2008</a>, AAS-HEAD 9, 03.02); but more on that another time.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-bkgsubtract-poisson/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>keV vs keV [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-kev-kev/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-kev-kev/#comments</comments>
		<pubDate>Wed, 30 Jul 2008 17:00:20 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Astro]]></category>
		<category><![CDATA[High-Energy]]></category>
		<category><![CDATA[Jargon]]></category>
		<category><![CDATA[X-ray]]></category>
		<category><![CDATA[Angstrom]]></category>
		<category><![CDATA[Boltzmann]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[erg]]></category>
		<category><![CDATA[Kelvin]]></category>
		<category><![CDATA[keV]]></category>
		<category><![CDATA[Planck]]></category>
		<category><![CDATA[temperature]]></category>
		<category><![CDATA[units]]></category>
		<category><![CDATA[wavelength]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=360</guid>
		<description><![CDATA[I have noticed that our statistician collaborators are often confused by our units.  (Not a surprise; I, too, am constantly confused by our units.)  One of the biggest culprits is the unit of energy, [keV],  which is 1000 electron Volts, for the energy acquired by an electron when it falls through an [...]]]></description>
			<content:encoded><![CDATA[<p>I have noticed that our statistician collaborators are often confused by our units.  (Not a surprise; I, too, am constantly confused by our units.)  One of the biggest culprits is the unit of energy, [keV], <span id="more-360"></span> which is 1000 electron Volts, for the energy acquired by an electron when it falls through an electric potential of 1 Volt:</p>
<blockquote><p><strong>1 [eV] &#8801; 1.6021892 &#183; 10<sup>-19</sup> [Joule] &#8801; 1.6021892 &#183; 10<sup>-12</sup> [erg]</strong> .</p></blockquote>
<p>The confusion is because the same units are used to denote two separate quantities which happen to have similar magnitudes for a commonly encountered spectral model, Bremsstrahlung emission.</p>
<ol>
<li> the frequency &#957;, or wavelength &#955;, of a photon: As Planck discovered, the energy of a photon is directly related to the frequency &#957;,<br />
<blockquote><p><strong> E = h &#183; &#957; &#8801; h &#183; c / &#955; </strong> ,</p></blockquote>
<p>where h=6.6261760 &#183; 10<sup>-27</sup> [erg s] is <a href="http://en.wikipedia.org/wiki/Planck's_constant">Planck&#8217;s constant</a> and c=2.9979246 &#183; 10<sup>10</sup> [cm s<sup>-1</sup>] is the speed of light in vaccum.  When &#955; is given in [&Aring;ngstr&ouml;m] &#8801; 10<sup>-8</sup> [cm], we can convert it as</p>
<blockquote><p><strong> [keV] = 12.398521 / [&Aring;] </strong> ,</p></blockquote>
<p>which is an extraordinarily useful thing to know in high-energy astrophysics.</li>
<li> the temperature <em>T</em> of a gas or plasma: Here we look to thermodynamics, which relates the kinetic energy of random motion of particles in a gas to a gross property, the temperature of the gas,<br />
<blockquote><p><strong> E = k<sub>B</sub> &#183; T </strong> ,</p></blockquote>
<p>where k<sub>B</sub> = 1.3806620 &#183; 10<sup>-16</sup> [erg K<sup>-1</sup>] is <a href="http://en.wikipedia.org/wiki/Boltzmann_constant">Boltzmann&#8217;s constant</a>.  Then, a temperature in degrees Kelvin can be written in units of keV by converting it with the formula</p>
<blockquote><p><strong> [keV] = 8.6173468 &#183; 10<sup>-8</sup> &#183; [K] &#8801; 0.086173468 &#183; [MK] </strong> .</p></blockquote>
</li>
</ol>
<p>It is tempting to put the two together and interpret a temperature as a photon energy.  This is possible for the aforementioned Bremsstrahlung radiation, where plasma at a temperature <em>T</em> produces a spectrum of photons distributed as <em>e<sup>-h &#957; / k<sub>B</sub> T</sup></em> and it is possible to tie the temperature to the photon energy at the point where the numerator and denominator have the same numerical value.  For example, a 1 keV (temperature) Bremsstrahlung spectrum extends out to 1 keV (photon energy).  X-ray Astronomers use this as shorthand all the time, and it confuses the hell out of everybody else.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-kev-kev/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>The Banff Challenge [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-banff-challenge/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-banff-challenge/#comments</comments>
		<pubDate>Wed, 23 Jul 2008 17:00:48 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Physics]]></category>
		<category><![CDATA[Stat]]></category>
		<category><![CDATA[Banff Challenge]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[Higgs Boson]]></category>
		<category><![CDATA[LHC]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=357</guid>
		<description><![CDATA[With the LHC coming on line anon, it is appropriate to highlight the Banff Challenge, which was designed as a way to figure out how to place bounds on the mass of the Higgs boson.  The equations that were to be solved are quite general, and are in fact the first attempt that I [...]]]></description>
			<content:encoded><![CDATA[<p>With the LHC coming on line anon, it is appropriate to highlight the <a href="http://newton.hep.upenn.edu/~heinrich/birs/">Banff Challenge</a>, which was designed as a way to figure out how to place bounds on the mass of the Higgs boson.  The equations that were to be solved are quite general, and are in fact the first attempt that I know of where calibration data are directly and explicitly included in the analysis.<span id="more-357"></span></p>
<p>The observables are counts <em>N</em>, <em>Y</em>, and <em>Z</em>, with</p>
<blockquote><p><strong>N ~ Pois(&#949; &#955;<sub>S</sub> + &#955;<sub>B</sub>) </strong>,<strong><br />
Y ~ Pois(&#961; &#955;<sub>B</sub>) </strong>,<strong><br />
Z ~ Pois(&#949; &#965;)</strong> ,</p></blockquote>
<p>where &#955;<sub>S</sub> is the parameter of interest (in this case, the mass of the Higgs boson, but could be the intensity of a source), &#955;<sub>B</sub> is the parameter that describes the background, &#949; is the efficiency, or the effective area, of the detector, and &#965; is a calibrator source with a known intensity.</p>
<p>The challenge was (is) to infer the maximum likelihood estimate of and the bounds on &#955;<sub>S</sub>, given the observed data, <em>{N, Y, Z}</em>.  In other words, to compute </p>
<blockquote><p><strong>p(&#955;<sub>S</sub>|N,Y,Z)</strong> .</p></blockquote>
<p>It may look like an easy problem, but it isn&#8217;t!</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-banff-challenge/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>chi-square distribution [Eqn]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-chisq-distribution/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-chisq-distribution/#comments</comments>
		<pubDate>Wed, 16 Jul 2008 17:00:16 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Stat]]></category>
		<category><![CDATA[chi-sq]]></category>
		<category><![CDATA[chisq]]></category>
		<category><![CDATA[chisquared]]></category>
		<category><![CDATA[distribution]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[gamma]]></category>
		<category><![CDATA[incomplete gamma]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=342</guid>
		<description><![CDATA[The &#935;2 distribution plays an incredibly important role in astronomical data analysis, but it is pretty much a black box to most astronomers.  How many people know, for instance, that its form is exactly the same as the &#947; distribution?  A &#935;2 distribution with &#957; degrees of freedom is 
p(z&#124;&#957;) = (1/&#915;(&#957;/2)) (1/2)&#957;/2 [...]]]></description>
			<content:encoded><![CDATA[<p>The <a href="http://en.wikipedia.org/wiki/Chi-square_distribution">&#935;<sup>2</sup> distribution</a> plays an incredibly important role in astronomical data analysis, but it is pretty much a black box to most astronomers.  How many people know, for instance, that its form is exactly the same as the <a href="http://groundtruth.info/AstroStat/slog/2008/eotw-gamma-function/">&#947; distribution</a>?  A &#935;<sup>2</sup> distribution with &#957; degrees of freedom is </p>
<blockquote><p><strong>p(z|&#957;) = (1/&#915;(&#957;/2)) (1/2)<sup>&#957;/2</sup> z<sup>&#957;/2-1</sup> e<sup>-z/2</sup> &#8801; &#947;(z;&#957;/2,1/2)</strong> , where <strong>z=&#935;<sup>2</sup>.</strong></p></blockquote>
<p><span id="more-342"></span></p>
<p>Its more familiar usage is in the cumulative form, which is just the <a href="http://en.wikipedia.org/wiki/Incomplete_Gamma_function">incomplete gamma function</a>.  This is where you count off how much area is enclosed in [0,&#935;<sup>2</sup>) to tell at what point the 68%, 95%, etc., thresholds are met.  For example, for <em>&#957;=1</em>, </p>
<blockquote><p><strong><font size="+2">&#8747;<sub><font size="-2">0</font></sub><sup><font size="-2">Z</font></sup></font> dx p(&#935;<sup>2</sup>|&#957;=1) = 0.68 </strong>when<strong> Z=1.</strong></p></blockquote>
<p>This is the origin of the <em>&#916;&#935;<sup>2</sup>=1</em> method to determine error bars on best-fit parameters.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-chisq-distribution/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Kaplan-Meier Estimator (Equation of the Week)</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-kaplan-meier/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-kaplan-meier/#comments</comments>
		<pubDate>Wed, 09 Jul 2008 17:00:54 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Frequentist]]></category>
		<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Methods]]></category>
		<category><![CDATA[Stat]]></category>
		<category><![CDATA[censored]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[Feigelson]]></category>
		<category><![CDATA[Isobe]]></category>
		<category><![CDATA[Kaplan-Meier]]></category>
		<category><![CDATA[maximum likelihood]]></category>
		<category><![CDATA[Nelson]]></category>
		<category><![CDATA[Schmitt]]></category>
		<category><![CDATA[survival analysis]]></category>
		<category><![CDATA[upper limit]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=356</guid>
		<description><![CDATA[The Kaplan-Meier (K-M) estimator is the non-parametric maximum likelihood estimator of the survival probability of items in a sample.  &#8220;Survival&#8221; here is a historical holdover because this method was first developed to estimate patient survival chances in medicine, but in general it can be thought of as a form of cumulative probability.  It [...]]]></description>
			<content:encoded><![CDATA[<p>The <a href="http://www.itl.nist.gov/div898/handbook/apr/section2/apr215.htm">Kaplan-Meier (K-M) estimator</a> is the non-parametric maximum likelihood estimator of the survival probability of items in a sample.  &#8220;Survival&#8221; here is a historical holdover because this method was first developed to estimate patient survival chances in medicine, but in general it can be thought of as a form of cumulative probability.  It is of great importance in astronomy because so much of our data are limited and this estimator provides an excellent way to estimate the fraction of objects that may be below (or above) certain flux levels.  The application of K-M to astronomy was explored in depth in the mid-80&#8217;s by Jurgen Schmitt (<a href="http://adsabs.harvard.edu/abs/1985ApJ...293..178S">1985, ApJ, 293, 178</a>), Feigelson &amp; Nelson (<a href="http://adsabs.harvard.edu/abs/1985ApJ...293..192F">1985, ApJ 293, 192</a>), and Isobe, Feigelson, &amp; Nelson (<a href="http://adsabs.harvard.edu/abs/1986ApJ...306..490I">1986, ApJ 306, 490</a>).  <strong>[</strong>See also Hyunsook's <a href="http://groundtruth.info/AstroStat/slog/2008/survival-analysis-a-primer/">primer</a>.<strong>]</strong>  It has been coded up and is available for use as part of the <a href="http://astrostatistics.psu.edu/statcodes/sc_censor.html">ASURV</a> package.<span id="more-356"></span></p>
<p>Consider a simple case where you have <em>N</em> observations of the luminosities of a source.  Let us say that all <em>N</em> sources have been detected and their luminosities are estimated to be <em>L<sub>i</sub>, i=1..N</em>, and that they are ordered such that <em>L<sub>i</sub> &lt; L<sub>i+1</sub></em>  Then, it is easy to see that the fraction of sources above each <em>L<sub>i</sub></em> can be written as the sequence</p>
<blockquote><p><strong>{ N-1, N-2, N-3, &#8230; 2, 1, 0}/N</strong></p></blockquote>
<p>The K-M estimator is a generalized form that describes this sequence, and is written as a product.  The probability that an object in the sample has luminosity greater than <em>L<sub>k</sub></em> is</p>
<blockquote><p><strong>S(L&gt;L<sub>1</sub>) = (N-1)/N<br />
S(L&gt;L<sub>2</sub>) = (N-1)/N * ((N-1)-1)/(N-1) = (N-1)/N * (N-2)/(N-1) = (N-2)/N<br />
S(L&gt;L<sub>3</sub>) = (N-1)/N * ((N-1)-1)/(N-1) * ((N-2)-1)/(N-2) = (N-3)/N<br />
&#8230;<br />
S(L&gt;L<sub>k</sub>) = &#928;<sub>i=1..k</sub> (n<sub>i</sub>-1)/n<sub>i</sub> = (N-k)/N<br />
</strong></p></blockquote>
<p>where <em>n<sub>k</sub></em> are the number of objects still remaining at luminosity level <em>L &#8805; L<sub>k</sub></em>, and at each stage one object is decremented to account for the drop in the sample size.</p>
<p>Now that was for the case when all the objects are detected.  But now suppose some are not, and only upper limits to their luminosities are available.  A specific value of <em>L</em> cannot be assigned to these objects, and the only thing we can say is that they will &#8220;drop out&#8221; of the set at some stage.  In other words, the sample will be &#8220;censored&#8221;.  The K-M estimator is easily altered to account for this, by changing the decrement in each term of the product to include the censored points.  Thus, the general K-M estimator is</p>
<blockquote><p><strong>S(L&gt;L<sub>k</sub>) = &#928;<sub>i=1..k</sub> (n<sub>i</sub>-c<sub>i</sub>)/n<sub>i</sub></strong></p></blockquote>
<p>where <em>c<sub>i</sub></em> are the number of objects that drop out between <em>L<sub>i-1</sub></em> and <em>L<sub>i</sub></em>.</p>
<p>Note that the K-M estimator is a maximum likelihood estimator of the cumulative probability (actually one minus the cumulative probability as it is usually understood), and uncertainties on it must be estimated via Monte Carlo or bootstrap techniques <strong>[</strong>or not.. <a href="http://groundtruth.info/AstroStat/slog/2008/eotw-kaplan-meier/#comment-282">see below</a><strong>]</strong>.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-kaplan-meier/feed/</wfw:commentRss>
		<slash:comments>13</slash:comments>
		</item>
		<item>
		<title>Poisson Likelihood [Equation of the Week]</title>
		<link>http://groundtruth.info/AstroStat/slog/2008/eotw-poisson-likelihood/</link>
		<comments>http://groundtruth.info/AstroStat/slog/2008/eotw-poisson-likelihood/#comments</comments>
		<pubDate>Wed, 02 Jul 2008 17:00:32 +0000</pubDate>
		<dc:creator>vlk</dc:creator>
				<category><![CDATA[Jargon]]></category>
		<category><![CDATA[Stat]]></category>
		<category><![CDATA[binomial]]></category>
		<category><![CDATA[counting]]></category>
		<category><![CDATA[EotW]]></category>
		<category><![CDATA[Equation]]></category>
		<category><![CDATA[Equation of the Week]]></category>
		<category><![CDATA[Poisson]]></category>
		<category><![CDATA[Poisson Likelihood]]></category>

		<guid isPermaLink="false">http://groundtruth.info/AstroStat/slog/?p=333</guid>
		<description><![CDATA[Astrophysics, especially high-energy astrophysics, is all about counting photons.  And this, it is said, naturally leads to all our data being generated by a Poisson process.  True enough, but most astronomers don&#8217;t know exactly how it works out, so this derivation is for them.
Suppose N counts are randomly placed in an interval of [...]]]></description>
			<content:encoded><![CDATA[<p>Astrophysics, especially high-energy astrophysics, is all about counting photons.  And this, it is said, naturally leads to all our data being generated by a Poisson process.  True enough, but most astronomers don&#8217;t know exactly how it works out, so this derivation is for them.<span id="more-333"></span></p>
<p>Suppose <em>N</em> counts are randomly placed in an interval of duration <em>&#964;</em> without any preference for appearing in any particular portion of <em>&#964;</em>.  i.e., the distribution is uniform.  The counting rate <em>R = N/&#964;</em>.  We can now ask, what is the probability of finding <em>k</em> counts in an infinitesimal interval <em>&#948;t</em> within <em>&#964;</em>?</p>
<p>First, consider the probability that one count, placed randomly, will fall inside <em>&#948;t</em>,<br />
<strong><br />
<blockquote>
&#961; = &#948;t/&#964; &#8801; R&#948;t/N &#8801; &#957;/N
</p></blockquote>
<p></strong><br />
where <em>&#957; = R &#948;t</em> represents the expected counts intensity in the interval <em>&#948;t</em>.  When <em>N</em> counts are scattered over <em>&#964;</em>, the probability that <em>k</em> of them will fall inside <em>&#948;t</em> is described with a binomial distribution,<br />
<strong><br />
<blockquote>
p(k|&#961;,N) = <sup>N</sup>C<sub>k</sub> &#961;<sup>k</sup> (1-&#961;)<sup>N-k</sup>
</p></blockquote>
<p></strong><br />
as the product of the probability of finding <em>k</em> events inside <em>&#948;t</em> and the probability of finding the remaining events outside, summed over all the possible distinct ways that <em>k</em> events can be chosen out of <em>N</em>.  Expanding the expression and rearranging,<br />
<strong><br />
<blockquote>
= N!/{(N-k)!k!} (R &#948;t/N)<sup>k</sup> (1-(R &#948;t/N))<sup>N-k</sup><br />
<br />
= N!/{(N-k)!k!} (&#957;<sup>k</sup>/N<sup>k</sup>) (1-(&#957;/N))<sup>N-k</sup><br />
<br />
= N!/{(N-k)!N<sup>k</sup>} (&#957;<sup>k</sup>/k!) (1-(&#957;/N))<sup>N</sup> (1-(&#957;/N))<sup>-k</sup>
</p></blockquote>
<p></strong><br />
Note that as <em>N,&#964; &#8212;&gt; &#8734;</em> (while keeping <em>R</em> fixed),<br />
<strong><br />
<blockquote>
N!/{(N-k)!N<sup>k</sup>} , (1-(&#957;/N))<sup>-k</sup> &#8212;&gt; 1<br />
(1-(&#957;/N))<sup>N</sup> &#8212;&gt; e<sup>-&#957;</sup>
</p></blockquote>
<p></strong><br />
and the expression reduces to<br />
<strong><br />
<blockquote>
p(k|&#957;) = (&#957;<sup>k</sup>/k!) e<sup>-&#957;</sup>
</p></blockquote>
<p></strong><br />
which is the familiar (in a manner of speaking) expression for the Poisson likelihood.</p>
]]></content:encoded>
			<wfw:commentRss>http://groundtruth.info/AstroStat/slog/2008/eotw-poisson-likelihood/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

