A novel adaptive spectral method has been recently developed to numerically solve partial differential equations (PDEs) in unbounded domains. To achieve accuracy and improve efficiency, the method relies on the dynamic adjustment of three key tunable parameters: the scaling factor, a displacement of the basis functions, and the spectral expansion order. In this paper, we perform the first numerical analysis of the adaptive spectral method using generalized Hermite functions in both one- and multi-dimensional problems. Our analysis reveals why adaptive spectral methods work well when a “frequency indicator” of the numerical solution is controlled. We then investigate how the implementation of the adaptive spectral methods affects numerical results, thereby providing guidelines for the proper tuning of parameters. Finally, we further improve performance by extending the adaptive methods to allow bidirectional basis function translation, and the prospect of carrying out similar numerical analysis to solving PDEs arising from realistic difficult-to-solve unbounded models with adaptive spectral methods is also briefly discussed.