arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sumith Matharage

10 papers · 2009–2015

2009: 12010: 22011: 12012: 12013: 32014: 12015: 1
2009peak 3 in 20132015

Frequent co-authors

Papers

showing 1–10 of 10 RSS

A scalable and dynamic self-organizing map for clustering large volumes of text data

Sumith Matharage, Hiran Ganegedara, Damminda Alahakoon

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

Self Organizing Map (SOM) and Growing Self Organizing Map (GSOM) are widely used techniques for text mining. Mining large text data sets is significantly processor intensive [1]. Recently Fast Growing Self Organizing Map (FastGSOM) was proposed an improvement to the GSOM for clustering text data more efficiently [2]. For text corpuses with thousands of documents, the time requirement could still be a bottleneck with high turnaround times for the analysis process. We propose a new scalable parallel algorithm for text analysis using FastGSOM which can harness the power of parallel and distributed computing for efficient analysis of large scale text datasets. We demonstrate that the proposed algorithm has similar or better accuracy compared to GSOM and is several orders more efficient when operating in parallel.

A sequence based dynamic SOM model for text clustering

Upuli Gunasinghe, Sumith Matharage, Damminda Alahakoon

Artificial Intelligence · Deakin Research Online (Deakin University) · · cited 5× · DOI ↗ · more like this ·

Text clustering can be considered as a four step process consisting of feature extraction, text representation, document clustering and cluster interpretation. Most text clustering models consider text as an unordered collection of words. However the semantics of text would be better captured if word sequences are taken into account. In this paper we propose a sequence based text clustering model where four novel sequence based components are introduced in each of the four steps in the text clustering process. Experiments conducted on the Reuters dataset and Sydney Morning Herald (SMH) news archives demonstrate the advantage of the proposed sequence based model, in terms of capturing context with semantics, accuracy and speed, compared to clustering of documents based on single words and n-gram based models.

Improving the Decision Value of Hierarchical Text Clustering Using Term Overlap Detection

Nilupulee Nathawitharana, Damminda Alahakoon, Sumith Matharage

Artificial Intelligence · AJIS. Australasian journal of information systems/AJIS. Australian journal of information systems/Australian journal of information systems · · cited 3× · DOI ↗ · more like this ·

Humans are used to expressing themselves with written language and language provides a medium with which we can describe our experiences in detail incorporating individuality. Even though documents provide a rich source of information, it becomes very difficult to identify, extract, summarize and search when vast amounts of documents are collected especially over time. Document clustering is a technique that has been widely used to group documents based on similarity of content represented by the words used. Once key groups are identified further drill down into sub-groupings is facilitated by the use of hierarchical clustering. Clustering and hierarchical clustering are very useful when applied to numerical and categorical data and cluster accuracy and purity measures exist to evaluate the outcomes of a clustering exercise. Although the same measures have been applied to text…

Enhancing GSOM text clustering with Latent Semantic Analysis

Sumith Matharage, Damminda Alahakoon

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

Growing Self Organizing Map (GSOM) has proven benefits in text clustering. Latent Semantic Analysis (LSA) also has been used in text clustering to capture the latent concepts from text. This paper presents a novel combination of GSOM and LSA to improve text clustering results compared to using GSOM on its own. LSA is an inherently global algorithm that looks at trends and patterns globally and GSOM is a nearest neighborhood based algorithm which looks at local patterns. Combination of these two can be used to discover both the global and local patterns. In the proposed model, initial text corpus is converted into its vector space representation using the traditional Term Frequency - Inverse Document Frequency (TF-IDF) technique. Then the Singular Value Decomposition (SVD) followed by Frobenius norm is applied on the resulting high dimensional vector to come up with a new vector with an…

Analysing Stillbirth Data Using Dynamic Self Organizing Maps

Sumith Matharage, Oshadi Alahakoon, Damminda Alahakoon +6 more

Artificial Intelligence · Deakin Research Online (Deakin University) · · cited 2× · DOI ↗ · more like this ·

Even with the presence of modern obstetric care, stillbirth rate seems to stay stagnant or has even risen slightly in countries such as England and has become a significant public health concern [1]. In the light of current medical research, maternal risk factors such as diabetes and hypertensive disease were identified as possible risk factors and are taken into consideration in antenatal care. However, medical practitioners and researchers suspect possible relationships between trends in maternal demographics, antenatal care and pregnancy information of current stillbirth in consideration [2]. Although medical data and knowledge is available appropriate computing techniques to analyze the data may lead to identification of high risk groups. In this paper we use an unsupervised clustering technique called Growing Self organizing Map (GSOM) to analyse the stillbirth data and present…

Growing Self Organizing Map with an Imposed Binary Search Tree for discovering temporal input patterns

Sumith Matharage, Upuli Gunasinghe, Damminda Alahakoon

Artificial Intelligence · Deakin Research Online (Deakin University) · · cited 2× · DOI ↗ · more like this ·

In this paper the Binary Search Tree Imposed Growing Self Organizing Map (BSTGSOM) is presented as an extended version of the Growing Self Organizing Map (GSOM), which has proven advantages in knowledge discovery applications. A Binary Search Tree imposed on the GSOM is mainly used to investigate the dynamic perspectives of the GSOM based on the inputs and these generated temporal patterns are stored to further analyze the behavior of the GSOM based on the input sequence. Also, the performance advantages are discussed and compared with that of the original GSOM.

Growing Self Organising Map based Exploratory Analysis of Text Data

Sumith Matharage And Damminda Alahakoon

Artificial Intelligence · Zenodo (CERN European Organization for Nuclear Research) · · cited 1× · DOI ↗ · more like this ·

Textual data plays an important role in the modern world. The possibilities of applying data mining techniques to uncover hidden information present in large volumes of text collections is immense. The Growing Self Organizing Map (GSOM) is a highly successful member of the Self Organising Map family and has been used as a clustering and visualisation tool across wide range of disciplines to discover hidden patterns present in the data. A comprehensive analysis of the GSOM's capabilities as a text clustering and visualisation tool has so far not been published. These functionalities, namely map visualisation capabilities, automatic cluster identification and hierarchical clustering capabilities are presented in this paper and are further demonstrated with experiments on a benchmark text corpus.

Growing Self Organising Map Based Exploratory Analysis Of Text Data

Sumith Matharage, Damminda Alahakoon

Artificial Intelligence · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

Textual data plays an important role in the modern<br> world. The possibilities of applying data mining techniques to<br> uncover hidden information present in large volumes of text<br> collections is immense. The Growing Self Organizing Map (GSOM)<br> is a highly successful member of the Self Organising Map family<br> and has been used as a clustering and visualisation tool across wide<br> range of disciplines to discover hidden patterns present in the data.<br> A comprehensive analysis of the GSOM’s capabilities as a text<br> clustering and visualisation tool has so far not been published. These<br> functionalities, namely map visualisation capabilities, automatic<br> cluster identification and hierarchical clustering capabilities are<br> presented in this paper and are further demonstrated with experiments<br> on a benchmark text corpus.

Feature overlap-based dynamic self organizing model for hierarchical text clustering

Nilupulee Nathawitharana, Sumith Matharage, Damminda Alahakoon

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

In text document clustering documents are represented as feature vectors where features can be either words or phrases. Documents can belong to different topics when categorized by humans; however it is noted that obtaining one to one mapping between the features and the topics is almost impossible since the same features can and will be used in documents in different topics. Such common features results in overlap in text clustering, and as such traditional cluster purity measures may not be practical or meaningful. In this paper new methodology and algorithm is introduced which considers the feature overlap between the clusters when clustering text documents. Hierarchical clustering facilitated by the Growing Self-Organizing Map (GSOM) is used together with the calculated feature overlap to check the possibility of obtaining clusters with minimum feature overlap. We also present the…

txtKnot

Darshana Jayasinghe, Sam Hettiarachchi, Samith Abeywickrama +4 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Living in the modern technology dependent world, we heavily rely on electronically stored data and information, to come up with sound and timely decisions. Considering the entire information technology world, there exists an unimaginable volume of data which contains a lot of information which is relevant to various kinds of fields. But the problem emerges when we are interested to find out about a particular subject. This is due to its scattered nature of relevant and non-relevant data. Therefore it is fair to say that there exists a critical need for a system which could create an ordered structure that provides a way of modeling the underlying relationships of data elements which will ultimately result in a much easier process of decision making. txtKnot is all about solving the above problem by generating a meaningful hierarchy of concepts from a set of unsorted text documents, thus…