arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sandhya Harikumar

27 papers · 2013–2024

2013: 22014: 22015: 32016: 42017: 22018: 22019: 22020: 12021: 12022: 32023: 12024: 4
2013peak 4 in 20162024

Frequent co-authors

Papers

showing 1–25 of 27 RSS

K-Medoid Clustering for Heterogeneous DataSets

Sandhya Harikumar, Surya PV

Artificial Intelligence · Procedia Computer Science · · cited 77× · DOI ↗ · more like this ·

Recent years have explored various clustering strategies to partition datasets comprising of heterogeneous domains or types such as categorical, numerical and binary. Clustering algorithms seek to identify homogeneous groups of objects based on the values of their attributes. These algorithms either assume the attributes to be of homogeneous types or are converted into homogeneous types. However, datasets with heterogeneous data types are common in real life applications, which if converted, can lead to loss of information. This paper proposes a new similarity measure in the form of triplet to find the distance between two data objects with heterogeneous attribute types. A new k-medoid type of clustering algorithm is proposed by leveraging the similarity measure in the form of a vector. The proposed k-medoid type of clustering algorithm is compared with traditional clustering…

Apriori algorithm for association rule mining in high dimensional data

Sandhya Harikumar, Divya Usha Dilipkumar

Information Systems · · cited 31× · DOI ↗ · more like this ·

Apriori is one of the best algorithms for learning association rules. Due to the explosion of data, the storage and retrieval mechanisms in various database paradigms have revolutionized the technologies and methodologies used in the architecture. As a result, the database is not only utilized for mere information retrieval but also to infer the analytical aspect of data. Therefore it is essential to find association rules from high dimensional data because the correlation amongst the attributes can help in gaining deeper insight into the data and help in decision making, recommendations as well as reorganizing the data for effective retrieval. The traditional Apriori algorithm is computationally expensive and infeasible with high dimensional datasets. Hence we propose a variant of Apriori algorithm using the concept of QR decomposition for reducing the dimensions thereby reducing the…

Real time Face Detection and Optimal Face Mapping for Online Classes

M.C.P. Archana, CK Nitish, Sandhya Harikumar

Computer Vision and Pattern Recognition · Journal of Physics Conference Series · · cited 19× · DOI ↗ · more like this ·

Abstract The main objective of this paper is to provide a web-based tool for identifying faces in a real-time environment, such as Online Classes. Face recognition in real-time is now a fascinating field with an ever-increasing challenge such as light variations, occlusion, variation in facial expressions, etc. During the current pandemic scenario of COVID-19, the demand for online classrooms has rapidly increased. This has escalated the need for a real-time, economic, simple, and convenient way to track the attendance of the students in a live classroom. This paper addresses the aforementioned issue by proposing a real-time online attendance system. Two alternative face recognition algorithms are perceived in order to develop the tool for realtime face detection and recognition with improved accuracy. The algorithms adopted are Local Binary Pattern Histogram(LBPH) and Convolutional…

Logistic regression within DBMS

Jackson Isaac, Sandhya Harikumar

Information Systems · · cited 15× · DOI ↗ · more like this ·

The context of this paper is to come up with an analytical query model for data categorization within DBMS. DBMS being the asset for most of the organizations, classification can help in getting better insight and control over the data. Conventionally, classification algorithms like logistic regression, KNN, etc. are applied after exporting the data out of DBMS, using non DBMS tools like R, matrix packages, generic data mining programs or large scale systems like Hadoop and Spark. However, this leads to I/O overhead since the data within DBMS is updated quite frequently and usually cannot be accommodated in the main memory. This paper proposes an alternative strategy, based on SQL and UDFs, to integrate the logistic regression for data categorization as well as prediction query processing within DBMS. A comparison of SQL with user defined functions (UDFs) as well as with statistical…

Interactive Map Using Data Visualization and Machine Learning

Sandhya Harikumar, Viveka Mannam, Chiranjeeb Mahanta +2 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

This project aims to build a smart map, named VAWMap (Violence Against Women Map), that displays the intensity of various crimes against women across the states and districts of India in efforts to inspire action to combat this prevalent violence. The data set to be depicted on the map consists of the number of victims of rape, dowry deaths, kidnapping, cruelty by husbands, insult to modesty, and assault for each district of every state in India through the years between 2001-2013. Depicted states and their respective districts include Rajasthan, Punjab, and Haryana. Two algorithms, QR Decomposition with Column Pivoting and the Projected Clustering Algorithm, are leveraged to reveal prominent crimes and their locations-effectively yielding certain hot spot crime areas of North India. Two novel strategies to depict the intricate statistics obtained from these ML algorithms are proposed…

Hybridized fragmentation of very large databases using clustering

Sandhya Harikumar, Raji Ramachandran

Signal Processing · · cited 12× · DOI ↗ · more like this ·

Due to the ever growing needs of managing huge volume of data, together with the desire for consistent, scalable, reliable and efficient retrieval of information, an intelligent mechanism to design the storage structure for distributing the databases has become inevitable. The two critical facets of distributed databases are data fragmentation and allocation. Existing fragmentation techniques are based on the frequency and type of the queries as well as the statistics of the empirical data. However, very limited work is done to fragment the data based on the pattern of the tuples and the attributes responsible for such patterns. This paper presents a unique approach towards hybridized fragmentation, by applying subspace clustering algorithm, to come up with a set of fragments which partitions the data with respect to tuples as well as attributes. Projected clustering is the one that…

Information retrieval and processing system for news articles in English

Gnana Venkata Naga Sai Kalyan Karumudi, Rohit Sathyajit, Sandhya Harikumar

Information Systems · · cited 9× · DOI ↗ · more like this ·

The importance of news media is unquestionable. These news media contain a great amount of information hidden along the lines of the articles. For analytics, extracting information and organizing the information to draw out conclusion is very important. The objective of our work is to focus on designing a tool to extract details from English news articles and present it to the user, in an organized manner. A predefined set of websites are crawled and the details are stored. The details extracted by the tool are named entities such as location, person, and organization mentioned in the news, news summary and important keywords pertaining to each news article. We also equip the tool with an efficient search engine, along with database indexing for faster information retrieval.

A depth-based nearest neighbor algorithm for high-dimensional data classification

Sandhya Harikumar, Akhil ARAVINDAKSHAN SAVITHRI, Ramachandra Kaimal

Artificial Intelligence · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · · cited 8× · DOI ↗ · more like this ·

Nearest neighbor algorithms like k-nearest neighbors (kNN) are fundamental supervised learning techniques to classify a query instance based on class labels of its neighbors. However, quite often, huge volumes of datasets are not fully labeled and the unknown probability distribution of the instances may be uneven. Moreover, kNN suffers from challenges like curse of dimensionality, setting the optimal number of neighbors, and scalability for high-dimensional data. To overcome these challenges, we propose an improvised approach of classification via depth representation of subspace clusters formed from high-dimensional data. We offer a consistent and principled approach to dynamically choose the nearest neighbors for classification of a query point by i) identifying structures and distributions of data; ii) extracting relevant features, and iii) deriving an optimum value of k depending…

Semi supervised approach towards subspace clustering

Sandhya Harikumar, A. Akhil

Artificial Intelligence · Journal of Intelligent & Fuzzy Systems · · cited 6× · DOI ↗ · more like this ·

High-dimensional data analysis is quite inevitable due to emerging technologies in various domains such as finance, healthcare, genomics and signal processing. Though data sets generated in these domains are high-dimensional, intrinsic dimensions that provide meaningful information are often much smaller. Conventionally, unsupervised clustering methods known as subspace clustering are utilized for finding clusters in different subspaces of high dimensional data, by identifying relevant features, irrespective of labels associated with each instance. Available label information, if incorporated in clustering algorithm, can bias the algorithm towards solutions more consistent with our knowledge, leading to improved cluster quality. Therefore, an Information Gain based Semi-supervised- subspace Clustering (IGSC) is proposed that identifies a subset of important attributes based on the known…

Implementation of projected clustering based on SQL queries and UDFs in relational databases

Sandhya Harikumar, H. Haripriya, M. R. Kaimal

Artificial Intelligence · Research Explorer (The University of Manchester) · · cited 6× · DOI ↗ · more like this ·

Projected clustering is one of the clustering approaches that determine the clusters in the subspaces of high dimensional data. Although it is possible to efficiently cluster a very large data set outside a relational database, the time and effort to export and import it can be significant. In commercial RDBMSs, there is no SQL query available for any type of subspace clustering, which is more suitable for large databases with high dimensions and large number of records. Integrating clustering with a relational DBMS using SQL is an important and challenging problem in todays world of Big Data. Projected clustering has the ability to find the closely correlated dimensions and find clusters in the corresponding subspaces. We have designed an SQL version of projected clustering which helps to get the clusters of the records in the database using a single SQL statement which in itself calls…

Top 100 highly cited sustainability researchers

Raghu Raman, Hiran H. Lathabai, Anand Patwardhan +2 more

Education · Heliyon · · cited 5× · DOI ↗ · more like this ·

The announcement of the UN Sustainable Development Goals (SDGs) provided a fresh direction to sustainability research that spans different disciplines. Consequently, scholarly databases made available the mapping of research publications to different SDGs, unleashing many opportunities for analysis. In this work, the top 100 Highly Cited Sustainability Researchers (HCSRs) and information related to them, such as the institutions they belong to, the type of these institutions, the geographical diversity of these researchers, and gender representation patterns, are analyzed. Also, from their publications, their publication pattern, including (i) the least and most researched SDGs, (ii) their Open Access publishing pattern, (iii) their collaboration pattern (iv) the pattern of their research impact, are analyzed. The most sought thematic areas of their research, top journals in which they…

Semantic integration of heterogeneous relational schemas using multiple L1 linear regression and SVD

Sandhya Harikumar, R. Reethima, M. R. Kaimal

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

The challenge of semantic integration of heterogeneous databases is one of the critical areas of interest due to scalability of data and the need to share the existing data as the technology advances. The schema level heterogeneity of the relations is the major issue for such integration. Though various approaches of schema analysis, transformation and integration have been explored, sometimes those become too general to solve the problem especially when the data is very high-dimensional and the schema information is unavailable or inadequate. In this paper, a method to integrate heterogeneous relational schema at instance-level is proposed, rather than the schema level. A global schema is designed consisting of the integration of most relevant attributes of different relational schema of a particular domain. In order to find the significant attributes, multiple linear regressions based…

High-Dimensional Projected Clustering for Learner Competency Analysis in Medical Training Programs

Sandhya Harikumar, C. S. Jayamohan Pillai, V. Vani Chithra +4 more

Education · IEEE Access · · cited 4× · DOI ↗ · more like this ·

Technology-enhanced learning (TEL) has been employed in healthcare systems to deliver case-based practical knowledge and prognostic assessments for healthcare professionals. Each medical specialty requires a unique set of skills, knowledge, and experience to ensure optimal patient care, necessitating the identification and assignment of the best medical professionals. We propose a recommendation system that facilitates the selection and assembly of top medical professionals for life-threatening cases on the basis of assessments conducted on a TEL platform for critical care skills. The key contribution of this work is the process of forming a team of the most qualified medical professionals for a critical care case. The system helps learners refine their skills by identifying areas that need improvement and providing timely assistance to struggling learners. A variant of content-based…

Semantic Representation of Documents Based on Matrix Decomposition

C Baladevi, Sandhya Harikumar

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

This paper addresses an important problem of semantic representation of documents for information retrieval in a data integration system. Quite often search query on documents seek relevant information. Conventional methods of feature extraction do not capture relevance but rather focus on term matching for query processing. Challenges of semantic representation of documents lie in identification of important features. Most of the techniques for identifying important features, transform original data to a different space. This gives a sparse matrix which is computationally expensive. So we come up with an alternative approach based on CUR matrix decomposition. This technique finds important documents and important terms in order to improvise the query processing. Experimentation results prove the efficacy of this approach on five data sets.

Efficient attribute selection strategies for association rule mining in high dimensional data

M. Ramachandran Kaimal, Sandhya Harikumar, Divya Usha Dilipkumar

Information Systems · International Journal of Computational Science and Engineering · · cited 4× · DOI ↗ · more like this ·

This paper presents a new computational approach to discover interesting relations between variables, called association rules, in large and high dimensional datasets. State-of-the-art techniques are computationally expensive due to reasons like high dimensions, generation of huge number of candidate sets and multiple database scans. In general, most of the enormous discovered patterns are obvious, redundant or uninteresting to the user. So the context of this paper is to improve apriori algorithm to find association rules pertaining to only important attributes from high dimensional data. We employ an information theoretic method together with the concept of QR decomposition to represent the data in its proper substructure form without losing its semantics, by identifying significant attributes. Experiment on real datasets and comparison with the existing technique reveals that the…

Efficient attribute selection strategies for association rule mining in high dimensional data

Sandhya Harikumar, Divya Usha Dilipkumar, M. Ramachandran Kaimal

Information Systems · International Journal of Computational Science and Engineering · · cited 4× · DOI ↗ · more like this ·

This paper presents a new computational approach to discover interesting relations between variables, called association rules, in large and high dimensional datasets. State-of-the-art techniques are computationally expensive due to reasons like high dimensions, generation of huge number of candidate sets and multiple database scans. In general, most of the enormous discovered patterns are obvious, redundant or uninteresting to the user. So the context of this paper is to improve apriori algorithm to find association rules pertaining to only important attributes from high dimensional data. We employ an information theoretic method together with the concept of QR decomposition to represent the data in its proper substructure form without losing its semantics, by identifying significant attributes. Experiment on real datasets and comparison with the existing technique reveals that the…

An adaptive distributed approach of a self organizing map model for document clustering using ring topology

M Ajeissh, Sandhya Harikumar

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

Document clustering aims at grouping the documents that are coherent internally with substantial difference amongst different groups. Due to huge availability of documents, the clustering face scalability and accuracy issues. Moreover, there is a dearth for a tool that performs clustering of such voluminous data efficiently. Conventional models focus either on fully centralized or fully distributed approach for document clustering. Hence, this paper proposes a novel approach to perform document clustering by modifying the conventional Self Organizing Map (SOM). The contribution of this work is threefold. The first is a distributed approach to pre-process the documents; the second being an adaptive bottom-up approach towards document clustering and the third being a neighbourhood model suitable for Ring Topology for document clustering. Experimentation on real datasets and comparison…

Time series models for web service activity prediction

Kambhampati Mukta, Sandhya Harikumar

Information Systems · International Journal of Computational Science and Engineering · · cited 2× · DOI ↗ · more like this ·

Web service providers have to be very vigilant in offering their services to their clients and ensure that there are no glitches. In this research, we propose a method for anticipating the load of user activities at various intervals of time that can help in identifying the best time for maintaining the various software upgrades. Machine learning approach for predicting the user traffic is leveraged based on various time series analysis techniques and long short-term memory (LSTM). Further, we provide a graphical visualisation of user traffic at regular intervals and notify the stakeholders if the traffic is more than the threshold. The contribution of the work lies in embedding time series analysis with good visualisation for real-time monitoring, querying the traffic condition, and predictive analysis. The results are validated using the evaluation metric mean absolute percentage…

Comparing the Effectiveness of Data Visualization Techniques for Discovering Disease Relationships in a Complex Network Dataset

S Sanjana, Sarang Dileep, R. Karthick Manoj +2 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

In this study, we compare various data visualization methods for exploring a complicated network dataset containing details on illnesses, symptoms, and safety measures. The dataset was obtained from Kaggle and split into train and test subsets at a 4:1 ratio. It has 269 nodes and 483 edges. To evaluate the network data, we used Neo4j and Gephi, two data visualization tools. The dataset was queried and visually analyzed using Neo4j, and graphical representations of the network were produced using Gephi. We tested the potency of different visualization methods for finding patterns and correlations in the data, including force-directed layouts, node-link diagrams, and matrix views. Moreover, Neo4j's querying capabilities allowed us to analyze sub-networks and their connections in greater detail. Overall, our study shows the value of using a variety of visualization methods to have a deeper…

An augmented semantic search tool for multilingual news analytics

Sandhya Harikumar, Rohit Sathyajit, Gnana Venkata Naga Sai Kalyan Karumudi

Information Systems · Journal of Intelligent & Fuzzy Systems · · cited 2× · DOI ↗ · more like this ·

News feeds generate colossal amount of data consisting of important information hidden in the intricacies. State of the art methods are still at infancy in providing a very generic and publicly available solution to skim through the important information in the news from various sources and an ability to search using specific keywords in different languages. This paper focuses on designing a tool to extract semantic details from news articles published through various internet sources in various languages. The semantic information is stored within DBMS for ease of organizing and retrieving the data. Further, a querying facility to search through entire articles based on the keyword or date-based search is also proposed to view the crisp content. The news articles in English, and two Indian languages - Hindi and Malayalam are considered for experimentation. The proposed strategy consists…

Learning from YouTube Videos using Drona Extension

Anirudh Chidambaranathan, Hariharan Krishnamoorthy, Chimakurthi N Sai Pavan Manikanta Chandu +2 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

There has been a boom in the use of online resources for education since the onset of the COVID-19 pandemic. Educational videos are an important part of these online resources and are very helpful to students. However, there are various issues related to the use of educational videos such as losing focus, lack of feedback to students, and taking notes manually while watching. The primary objective of this work is to design and develop an intelligent browser action chrome extension that generates smart notes and quizzes from educational YouTube videos. The extension will serve anyone learning from YouTube by providing a dynamic platform to grasp the content and assess themselves.

SQL-MapReduce hybrid approach towards distributed projected clustering

Sandhya Harikumar, M. Shyju, M. R. Kaimal

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Clustering high dimensional data is a major challenge in data mining due to the existence of inherent complexity and sparsity of the data. Projected clustering is one of the clustering approaches that determine the clusters in the subspaces of such high dimensional data. However, projected clustering within DBMS is quite computationally expensive in time and space complexity, when the volume of records is in terms of terabytes, petabytes and more. This expensive computation becomes a hurdle especially when the data clustering on transactional data is used as a preprocessing step for other tasks such as frequent decision making, efficient indexing, compression, etc. Hence, parallelizing and distributing expensive data clustering tasks becomes attractive in terms of speed-up of computation and the increased amount of memory available in a computing cluster. Inorder to achieve this, we…

Matrix Factorization For Augmented Deep Learning Model Generation

P. A. Nived, Sandhya Harikumar, Aditya Anil

Computer Vision and Pattern Recognition · Procedia Computer Science · · cited 1× · DOI ↗ · more like this ·

This paper aims to address two significant challenges of Deep Learning(DL) model generation, high computational cost involved during the training phase and data interpretability from high dimensional data. The computational cost is curbed using centralized as well as distributed matrix factorization technique known as CUR decomposition. CUR decomposition has the advantage of reducing the dimensions of the dataset without data transformation and minimal information loss. Though Singular Value De-composition(SVD) is the best matrix decomposition technique with least reconstruction error, it transforms the data and hence the original data cannot be interpreted from the decomposed matrices while applying DL technique. So CUR decomposition is leveraged to reduce the number of features in high-dimensional data while preserving the essential information. Extensive experimental analysis is…

A Knowledge Graph Approach towards Re-structuring of Scientific Articles

Nikhitha Mani, Sandhya Harikumar

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

With expedition of huge number of research articles published in each domain, retrieval of relevant articles based on researcher's interest and requirement have become challenging. Further, there are circumstances where a researcher may not get the specific information sought after, regardless of whether it is there in the document collection. This is since the article in database is structured only based on title and citation data while the conceptual information and algorithms described inside an article are disregarded. In this work, we propose a useful methodology for re-structuring documents in the database by considering the document as a whole and representing the keywords and key-phrases extracted from the article data using Knowledge Graphs. Clustering of nodes of graph segregate articles into different domains and sub-domains. Knowledge graph is further explored to identify…

MapReduce model for k-medoid clustering

Sandhya Harikumar, Shabana Shamsuddin Thaha

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Distributed and Parallel computing are best alternatives for scalable clustering of huge amount of data with moderate to high dimensions, together with improved speed up. In this paper we address the problem of k-medoid clustering using MapReduce framework for distributed computing on commodity machines to evaluate its efficacy. There are mainly two issues to be tackled. The first one is, how to distribute the data for efficient clustering and the second one is, how to minimize the I/O and network cost among the machines. So, the main contributions of this paper are : (a)A map reduce methodology for distributed k-medoid clustering; (b) Reduction in the overall execution time and the overhead of data movement from one site to another leading to sub linear scaleup and speedup. This approach proves to be efficient, as the local clustering can be carried out independently from each other.…