Sep 16th, 2008| 03:20 pm | Posted by hlee
A nice book by Christopher Bishop.
While I was reading abstracts and papers from astro-ph, I saw many applications of algorithms from pattern recognition and machine learning (PRML). The frequency will increase as large scale survey projects numerate, where recommending a good textbook or a reference in the field seems timely. Continue reading ‘[Book] pattern recognition and machine learning’ »
Tags:
Bishop,
catalog,
machine learning,
pattern recognition,
PCML,
SPS,
survey Category:
Algorithms,
Astro,
Cross-Cultural,
Data Processing,
Jargon |
Comment
May 5th, 2008| 03:08 am | Posted by hlee
Since I learned Hubble’s tuning fork[] for the first time, I wanted to do classification (semi-supervised learning seems more suitable) galaxies based on their features (colors and spectra), instead of labor intensive human eye classification. Ironically, at that time I didn’t know there is a field of computer science called machine learning nor statistics which do such studies. Upon switching to statistics with a hope of understanding statistical packages implemented in IRAF and IDL, and learning better the contents of Numerical Recipes and Bevington’s book, the ignorance was not the enemy, but the accessibility of data was. Continue reading ‘[ArXiv] 5th week, Apr. 2008’ »
Tags:
ANN,
automation,
Classification,
correlation function,
denoising,
FFT,
gravitational wave,
lensing,
LISA,
machine learning,
missing data,
mock data,
morphology,
PCA,
power spectrum,
robust,
SDSS,
spectrum,
sunspots,
wavelet,
zoo Category:
Galaxies,
Imaging,
MCMC,
Physics,
Spectral,
arXiv |
Comment
Apr 27th, 2008| 11:29 am | Posted by hlee
The last paper in the list discusses MCMC for time series analysis, applied to sunspot data. There are six additional papers about statistics and data analysis from the week. Continue reading ‘[ArXiv] 4th week, Apr. 2008’ »
Tags:
clusters,
CMB,
GALEX,
gravitaional waves,
lensing,
LF,
LMC,
machine learning,
maximum likelihood,
priors,
probability,
SDSS,
stellar populations,
sunspot,
time series Category:
MCMC,
arXiv |
Comment
Jan 30th, 2008| 02:33 am | Posted by hlee
Astronomers have developed their ways of processing signals almost independent to but sometimes collaboratively with engineers, although the fundamental of signal processing is same: extracting information. Doubtlessly, these two parallel roads of astronomers’ and engineers’ have been pointing opposite directions: one toward the sky and the other to the earth. Nevertheless, without an intensive argument, we could say that somewhat statistics has played the medium of signal processing for both scientists and engineers. This particular issue of IEEE signal processing magazine may shed lights for astronomers interested in signal processing and statistics outside the astronomical society.
IEEE Signal Processing Magazine Jul. 2007 Vol 24 Issue 4: Bootstrap methods in signal processing
This link will show the table of contents and provide links to articles; however, the access to papers requires IEEE Xplore subscription via libraries or individual IEEE memberships). Here, I’d like to attempt to introduce some articles and tutorials.
Continue reading ‘Signal Processing and Bootstrap’ »
Tags:
bootstrap,
compressive sensing,
confidence interval,
GLM,
IEEE,
jacknife,
machine learning,
multitaper estimate,
particle filter,
signal processing,
statistical inference,
Tutorial,
wavelet Category:
Algorithms,
Bayesian,
Cross-Cultural,
Fitting,
Frequentist,
MC,
MCMC,
Methods,
Misc,
Spectral,
Stat,
Uncertainty,
arXiv |
Comment
Jan 3rd, 2008| 02:44 pm | Posted by hlee
I found this website a while ago but haven’t checked until now. They are quite useful by its contents (even pages of the lecture notes are properly flipped for you while the lecture is given). Increasing popularity of machine learning among astronomers will find more use of such lectures. If you have time to learn machine learning and other related subjects, please visit http://videolectures.net/. Specifically classified links to interesting subjects are found by your click. Continue reading ‘On-line Machine Learning Lectures and Notes’ »
Jul 25th, 2007| 02:28 am | Posted by hlee
Since I began to subscribe arxiv/astro-ph abstracts, from an astrostatistical point of view, one of the most frequent topics has been photometric redshifts. This photometric redshift has been a popular topic as the catalog of remote photometric object observation multiplies its volume and sky survey projects in multiple bands lead to virtual observatories (VO - will discuss in the later posting). Just searching by photometric redshifts in google scholar and arxiv.org provides more than 2000 articles since 2000.
Continue reading ‘Photometric Redshifts’ »
Tags:
cosmology,
distance estimation,
Lutz-Kelker bias,
machine learning,
Malmquist bias,
Photometric Redshift,
spectrum,
survey,
VO Category:
Algorithms,
Data Processing,
Galaxies,
Stat,
arXiv |
Comment
Jul 2nd, 2007| 06:07 pm | Posted by hlee
From arXiv/astro-ph:0706.4484
Spectroscopic Surveys: Present by Yip. C. overviews recent spectroscopic sky surveys and spectral analysis techniques toward Virtual Observatories (VO). In addition that spectroscopic redshift measures increase like Moore’s law, the surveys tend to go deeper and aim completeness. Mainly elliptical galaxy formation has been studied due to more abundance compared to spirals and the galactic bimodality in color-color or color-magnitude diagrams is the result of the gas-rich mergers by blue mergers forming the red sequence. Principal component analysis has incorporated ratios of emission line-strengths for classifying Type-II AGN and star forming galaxies. Lyα identifies high z quasars and other spectral patterns over z reveal the history of the early universe and the characteristics of quasars. Also, the recent discovery of 10 satellites to the Milky Way is mentioned.
Continue reading ‘[ArXiv] Spectroscopic Survey, June 29, 2007’ »
Tags:
bimodality,
chi-square minimization,
Classification,
CMD,
Estimation,
machine learning,
massive data,
model based,
PCA,
spectral analysis,
spectroscopic,
survey,
VO Category:
Astro,
Bayesian,
Data Processing,
Fitting,
Frequentist,
Methods,
Spectral,
arXiv |
Comment
Mar 2nd, 2007| 11:21 am | Posted by hlee
Leo Breiman (1928-2005) was one of the most dominant statisticians from the 20th century. He was well known for his textbook in probability theory as well as his contributions to the machine learning, such as CART (Classification and Regression Tree), bagging (bootstrap aggregation), and Random Forest. He was the founding father of statistical machine learning. His works can be found from http://www.stat.berkeley.edu/~breiman/
An excerpt from “A Conversation with Leo Breiman,” from Statistical Science, by Richard Olshen (2001), 16(2), pp. 184–198, casts a second thought on the direction of statistical researches:
Continue reading ‘An excerpt from “A Conversation with Leo Breiman”’ »