Archive for the ‘Astro’ Category.
Aug 25th, 2009| 09:19 pm | Posted by hlee
Kriging is the first thing that one learns from a spatial statistics course. If an astronomer sees its definition and application, almost every astronomer will say, “Oh, I know this! It is like the 2pt correlation function!!” At least this was my first impression when I first met kriging.
There are three distinctive subjects in spatial statistics: geostatistics, lattice data analysis, and spatial point pattern analysis. Because of the resemblance between the spatial distribution of observations in coordinates and the notion of spatially random points, spatial statistics in astronomy has leaned more toward the spatial point pattern analysis than the other subjects. In other fields from immunology to forestry to geology whose data are associated spatial coordinates of underlying geometric structures or whose data were sampled from lattices, observations depend on these spatial structures and scientists enjoy various applications from geostatistics and lattice data analysis. Particularly, kriging is the fundamental notion in geostatistics whose application is found many fields. Continue reading ‘[MADS] Kriging’ »
Tags:
BLUP,
book,
books,
CMB,
Cressie,
Diggle,
geostatistics,
hierarchical model,
kriging,
MADS,
point pattern analysis,
sparse,
spatial statistics,
Stein,
WMAP Category:
Astro,
Imaging,
Jargon,
Methods,
Stat,
arXiv |
Comment
Aug 22nd, 2009| 10:11 pm | Posted by chasc
This is a special session at the January 2010 meeting of the AAS. It is scheduled for the afternoon of Thursday, Jan 7, 2-3:30pm.
Abstracts are due Sep 17.
Meeting Justification
We propose to highlight the growing use of ‘non-parametric’ techniques to distill meaningful science from today’s astronomical data. Challenges range from Kuiper objects to cosmology. We have chosen just a few ‘teaching’ examples from this lively interdisciplinary area.
Continue reading ‘Beyond simple models-New methods for complex data’ »
Tags:
2010,
215,
AAS,
AAS 215,
astroinformatics,
astrostatistics,
complex data,
January,
Methods,
special session,
Washington Category:
Astro,
News,
Stat |
Comment
Aug 12th, 2009| 06:03 pm | Posted by hlee
Statistical Resampling Methods are rather unfamiliar among astronomers. Bootstrapping can be an exception but I felt like it’s still unrepresented. Seeing an recent review paper on cross validation from [arXiv] which describes basic notions in theoretical statistics, I couldn’t resist mentioning it here. Cross validation has been used in various statistical fields such as classification, density estimation, model selection, regression, to name a few. Continue reading ‘[ArXiv] Cross Validation’ »
Tags:
ADS,
cross-validation,
machine learning,
Model Selection,
n-fold Category:
Astro,
Bayesian,
Cross-Cultural,
Data Processing,
Frequentist,
Jargon,
Methods,
Quotes,
Stat,
arXiv |
Comment
Jul 29th, 2009| 01:02 am | Posted by hlee
Speaking of XAtlas from my previous post I tried another visualization tool called Parallel Coordinates on these Capella observations and two stars with multiple observations (AL Lac and IM Peg). As discussed in [MADS] Chernoff face, full description of the catalog is found from XAtlas website. The reason for choosing these stars is that among low mass stars, next to Capella (I showed 16), IM PEG (HD 21648, 8 times), and AR Lac (although different phases, 6 times) are most frequently observed. I was curious about which variation, within (statistical variation) and between (Capella, IM Peg, AL Lac), is dominant. How would they look like from the parametric space of High Resolution Grating Spectroscopy from Chandra? Continue reading ‘[MADS] Parallel Coordinates’ »
Tags:
Classification,
clustering,
display,
EDA,
eye catcher,
GGobi,
Inselberg,
parallel coordinates,
visualization Category:
Algorithms,
Cross-Cultural,
Data Processing,
High-Energy,
Jargon,
Methods,
Spectral,
X-ray,
arXiv |
1 Comment
Jul 27th, 2009| 06:09 am | Posted by hlee
I’m getting behind these days because of chasing too many rabbits. One of those rabbits is hunting online lectures useful for everyone. Prof. Feynman’s lectures have great reputations but they have been hard to come by. I once listened to a pirate version of his lecture tape with horrible sound quality. Thanks to Bill Gates and Microsoft Research, although it is a belated news, I’m very delighted to say “Feynman lectures are online.” Continue reading ‘News and related stories’ »
Jul 12th, 2009| 07:33 pm | Posted by hlee
An email was forwarded with questions related to the data sets found in “Be an INTEGRAL astronomer”. Among the sets, the following scatter plot is based on the Crab data.
Continue reading ‘different views’ »
Tags:
ANOVA,
block design,
crab nebula,
F-test,
gaussinity,
integral,
light curve Category:
Astro,
Cross-Cultural,
High-Energy,
Jargon,
Objects,
Uncertainty,
gamma-ray |
Comment
Jul 12th, 2009| 07:21 pm | Posted by hlee
Approximately for a decade, there have been journals dedicated to bioinformatics. On the other hand, there is none in astronomy although astronomers have a long history of comprising a huge volume of catalogs and data archives. Prof. Bickel’s comment during his plenary lecture at the IMS-APRM particularly on sparse matrix and philosophical issues on choosing principal components led me to wonder why astronomers do not discuss astroinformatics. Continue reading ‘Astroinformatics’ »
Tags:
astroinformatics,
bioinformatics,
catalog,
dimension reduction,
journals,
penalize,
regularization,
sparse matrix,
variable selection Category:
Astro,
Cross-Cultural,
Data Processing,
Imaging,
Jargon,
Stat |
1 Comment
Jul 4th, 2009| 12:59 am | Posted by hlee
I was reading the June 2009 IMS bulletin on my way to Korea for the 1st IMS-APRM meeting. Then, I was in half shock and in half sadness. Something unlike than the Drake equation had happened. Continue reading ‘worse than the Drake eq.’ »
Tags:
bump hunting,
chain rule,
computational geometry,
Drake eq.,
IJ Good,
K Worsley,
obituary,
spectral analysis Category:
Astro,
Cross-Cultural,
Jargon,
Spectral,
Stat |
Comment
Jun 11th, 2009| 03:52 pm | Posted by hlee
I was at the SUSY 09 public lecture given by a Nobel laureate, Frank Wilczek of QCD (quantum chromodynamics). As far as I know SUSY is the abbreviation of SUperSYmetricity in particle physics. Finding such antimatter(? I’m afraid I read “Angels and Demons” too quickly) will explain the unification theory among electromagnetic, weak, and strong forces and even the gravitation according to the speaker’s graph. I’ll not go into the details of particle physics and the standard model. The reason is too obvious.
Instead, I’d like to show this image from wikipedia and to discuss my related questions.
Continue reading ‘how to trace?’ »
Tags:
cliche,
collion,
identifiability,
identification,
irony,
LHC,
Power,
reconstruction,
source detection,
subparticle,
supersymmetry,
SUSY,
TRACE,
type I error,
Type II error,
uncertainty principle,
unification,
youtube Category:
Cross-Cultural,
Data Processing,
High-Energy,
Misc,
Quotes,
Uncertainty |
Comment
Jun 2nd, 2009| 03:03 am | Posted by hlee
Even though I traced the astronomers’ casual usage of the null hypothesis probability in a fashion of reporting outputs from data analysis packages of their choice, there were still some curious cases of the null hypothesis probability that I couldn’t solve. They are quite mysterious to me. Sometimes too much creativity harms the original intention. Here are some examples. Continue reading ‘Curious Cases of the Null Hypothesis Probability’ »
Tags:
cases,
chi-sq,
curious,
degree of freedom,
dof,
F-test,
goodness-of-fit test,
Model Selection,
null hypothesis probability,
p-value,
reduced chi-sq Category:
Astro,
Cross-Cultural,
Fitting,
Methods,
Uncertainty,
arXiv |
3 Comments
May 21st, 2009| 05:55 pm | Posted by hlee
Among billion objects in our Galaxy, outside the Earth, our Sun drags most attention from astronomers. These astronomers go by solar physicists, who enjoy the most abundant data including 400 year long sunspot counts. Their joy is not only originated from the fascinating, active, and unpredictable characteristics of the Sun but also attributed to its influence on our daily lives. Related to the latter, sometimes studying the conditions on the Sun is called space weather forecast. Continue reading ‘space weather’ »
Tags:
classifier,
forecast,
logistic regression,
machine learning,
predictor,
response,
space weather,
Sun,
sunspot,
SVM,
test data,
training data,
weather Category:
Astro,
Cross-Cultural,
Data Processing,
Imaging,
Jargon,
Stars,
Stat,
arXiv |
Comment
May 7th, 2009| 02:22 pm | Posted by hlee
Almost 100 years ago, A.S. Eddington stated in his book Stellar Movements (1914) that
…in calculating the mean error of a series of observations it is preferable to use the simple mean residual irrespective of sign rather than the mean square residual
Such eminent astronomer said already least absolute deviation over chi-square, if I match simple mean residual and mean square residual to relevant methodologies, in order. Continue reading ‘a century ago’ »
Tags:
chi-square minimization,
Eddington,
inference,
LAD,
Laplace,
mse,
PyMC,
Python,
R.A.Fisher,
utility function Category:
Astro,
Cross-Cultural,
Quotes,
Stat,
Uncertainty |
Comment
May 7th, 2009| 11:14 am | Posted by hlee
One of [ArXiv] papers from yesterday whose title might drag lots of attentions from astronomers. Furthermore, it’s a short paper.
[arxiv:math.CO:0905.0483] by Harmany, Marcia, and Willet.
Continue reading ‘[ArXiv] Sparse Poisson Intensity Reconstruction Algorithms’ »
Tags:
compressed sensing,
decomposition,
EM algorithm,
intensity,
MPLE,
multiscale,
penalty,
Poisson,
Poisson Intensity,
Sparcity,
wavelet Category:
Algorithms,
Astro,
Cross-Cultural,
Data Processing,
High-Energy,
Imaging,
Jargon,
arXiv |
Comment
Apr 22nd, 2009| 02:02 pm | Posted by hlee
I was reading Lehmann’s memoir on his friends and colleagues who influence a great deal on establishing his career. I’m happy to know that his meeting Landau, Courant, and Evans led him to be a statistician; otherwise, we, including astronomers, would have had very different textbooks and statistical thinking would have been different. On the other hand, I was surprised to know that he chose statistics over physics due to his experience from Cambridge (UK). I thought becoming a physicist is more preferred than becoming a statistician during the first half of the 20th century. At least I felt that way, probably it’s because more general science books in physics and physics related historic events were well exposed so that I became to think that physicists are more cooler than other type scientists. Continue reading ‘[Book] The Physicists’ »
Tags:
book,
Durrenmatt,
E. L. Lehmann,
Heisenberg,
physicists,
statistician,
uncertainty principle Category:
Cross-Cultural,
Misc,
Physics,
Quotes,
Stat,
Uncertainty |
Comment
Apr 2nd, 2009| 12:00 pm | Posted by hlee
I cannot remember when I first met Chernoff face but it hooked me up instantly. I always hoped for confronting multivariate data from astronomy applicable to this charming EDA method. Then, somewhat such eager faded, without realizing what’s happening. Tragically, this was mainly due to my absent mind. Continue reading ‘[MADS] Chernoff face’ »
Tags:
calibration,
Capella,
Chandra,
Chernoff face,
EDA,
line ratios,
MADS,
XAtlas Category:
Algorithms,
Astro,
Cross-Cultural,
Data Processing,
Jargon,
Methods,
Misc,
News,
Quotes,
Spectral,
Stars,
X-ray,
arXiv |
2 Comments