arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Artificial Intelligence

G.: Applying the Hidden Markov Model methodology for unsupervised learning of temporal data

Cen Li, Gautam Biswas

See on the map

Abstract

The Hidden Markov Modeling (HMM) methodology has been successfully employed in the modeling and analysis of sequence data, for example, continuous speech recognition in the temporal domain and anal-ysis of protein structures in the sequencing domain. However, these domains assume that the model struc-ture has been provided by human experts. In a num-ber of other domains, such as physiology, economics, and social sciences, model structures of dynamic phe-nomena are not not readily available. In this context, this paper develops a clustering methodology to au-tomatically partition temporal data into homogeneous groups, and to construct HMM models for each group. when the model structure is unknown. Our method-ology makes two new contributions to data clustering using HMM models. First, an explicit HMM model size selection procedure is incorporated into the clus-tering process, i.e., the sizes of the individual HMMs are dynamically determined for each cluster. This im-proves the interpretability of cluster models, and the quality of the final clustering partition results. Second, a partition selection method is developed to ensure an objective, data-driven selection of the number of clus-ters in the partition. The result is a heuristic sequential search control algorithm that is computationally feasi-ble. Experiments with artificially generated data show that the HMM model size selection algorithm is effec-tive in re-discovering the structure of the generating HMMs, and the HMM clustering with model size se-lection significantly outperforms HMM clustering using uniform HMM model sizes for re-discovering clustering partition structures. Experiments with real world eco-logical data show interesting results.

More like this