In this paper, we develop a Monte Carlo approach for hidden Markov model (HMM) order estimation-finding the underlying number of states in a hidden Markov model. We compare predictions and true observations using classification rates, correlations, and ROC curves as statistical estimators. Tests are run on both artificail data in a controlled experiment and on real-world data sets--Abstract.