arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Iti Mathur

56 papers · 2010–2023

2010: 12011: 12012: 62013: 162014: 62015: 42016: 92017: 12018: 32019: 12020: 42021: 12022: 12023: 2
2010peak 16 in 20132023

Frequent co-authors

Papers

showing 1–25 of 56 RSS

HMM Based POS Tagger for Hindi

Nisheeth Joshi, Hemant Darbari, Iti Mathur

Artificial Intelligence · · cited 60× · DOI ↗ · more like this ·

Part of Speech tagging in Indian Languages is still an open problem. We still lack a clear approach in implementing a POS tagger for Indian Languages. In this paper we describe our efforts to build a Hidden Markov Model based Part of Speech Tagger. We have used IL POS tag set for the development of this tagger. We have achieved the accuracy of 92%.

Rule Based Transliteration Scheme for English to Punjabi

Deepti Bhalla, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 48× · arXiv ↗ · more like this ·

Machine Transliteration has come out to be an emerging and a very important research area in the field of machine translation. Transliteration basically aims to preserve the phonological structure of words. Proper transliteration of name entities plays a very significant role in improving the quality of machine translation. In this paper we are doing machine transliteration for English-Punjabi language pair using rule based approach. We have constructed some rules for syllabification. Syllabification is the process to extract or separate the syllable from the words. In this we are calculating the probabilities for name entities (Proper names and location). For those words which do not come under the category of name entities, separate probabilities are being calculated by using relative frequency through a statistical machine translation toolkit known as MOSES. Using these probabilities…

Development of Marathi Part of Speech Tagger Using Statistical Approach

Jyoti Singh, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 47× · arXiv ↗ · more like this ·

Part-of-speech (POS) tagging is a process of assigning the words in a text corresponding to a particular part of speech. A fundamental version of POS tagging is the identification of words as nouns, verbs, adjectives etc. For processing natural languages, Part of Speech tagging is a prominent tool. It is one of the simplest as well as most constant and statistical model for many NLP applications. POS Tagging is an initial stage of linguistics, text analysis like information retrieval, machine translator, text to speech synthesis, information extraction etc. In POS Tagging we assign a Part of Speech tag to each word in a sentence and literature. Various approaches have been proposed to implement POS taggers. In this paper we present a Marathi part of speech tagger. It is morphologically rich language. Marathi is spoken by the native people of Maharashtra. The general approach used for…

Part of Speech Tagging of Marathi Text Using Trigram Method

Jyoti Singh, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 29× · arXiv ↗ · more like this ·

In this paper we present a Marathi part of speech tagger. It is a morphologically rich language. It is spoken by the native people of Maharashtra. The general approach used for development of tagger is statistical using trigram Method. The main concept of trigram is to explore the most likely POS for a token based on given information of previous two tags by calculating probabilities to determine which is the best sequence of a tag. In this paper we show the development of the tagger. Moreover we have also shown the evaluation done.

A Lightweight Stemmer for Gujarati

Juhi Ameta, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 26× · arXiv ↗ · more like this ·

Gujarati is a resource poor language with almost no language processing tools being available. In this paper we have shown an implementation of a rule based stemmer of Gujarati. We have shown the creation of rules for stemming and the richness in morphology that Gujarati possesses. We have also evaluated our results by verifying it with a human expert.

Rule Based Stemmer in Urdu

Vaishali Gupta, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 25× · arXiv ↗ · more like this ·

Urdu is a combination of several languages like Arabic, Hindi, English, Turkish, Sanskrit etc. It has a complex and rich morphology. This is the reason why not much work has been done in Urdu language processing. Stemming is used to convert a word into its respective root form. In stemming, we separate the suffix and prefix from the word. It is useful in search engines, natural language processing and word processing, spell checkers, word parsing, word frequency and count studies. This paper presents a rule based stemmer for Urdu. The stemmer that we have discussed here is used in information retrieval. We have also evaluated our results by verifying it with a human expert.

Improving the quality of Gujarati-Hindi Machine Translation through part-of-speech tagging and stemmer-assisted transliteration

Juhi Ameta, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 23× · arXiv ↗ · more like this ·

Machine Translation for Indian languages is an emerging research area. Transliteration is one such module that we design while designing a translation system. Transliteration means mapping of source language text into the target language. Simple mapping decreases the efficiency of overall translation system. We propose the use of stemming and part-of-speech tagging for transliteration. The effectiveness of translation can be improved if we use part-of-speech tagging and stemming assisted transliteration.We have shown that much of the content in Gujarati gets transliterated while being processed for translation to Hindi language.

Design of a Rule Based Hindi Lemmatizer

Snigdha Paul, Mini Tandon, Nisheeth Joshi +1 more

Artificial Intelligence · · cited 19× · DOI ↗ · more like this ·

Stemming is the process of clipping off the affixes from the input word to obtain the respective root word, but it is not necessary that stemming provide us the genuine and meaningful root word. To overcome this problem we come up with a solution-Lemmatizer. It is the process by which we crave out the lemma from the given word and can also add additional rules to make the clipped word a proper stem. In this paper we have created an inflectional lemmatizer which generates the rules for extracting the suffixes and also added rules for generating a proper meaningful root word.

Design & development of rule based inflectional and derivational Urdu stemmer ‘Usal’

Vaishali Gupta, Nisheeth Joshi, Iti Mathur

Artificial Intelligence · · cited 18× · DOI ↗ · more like this ·

Urdu is a morphologically rich language that means Urdu words having different variant form of words. In Natural Language Processing, morphology plays an important role. Morphology means study of word structure. In this paper, we focused on Urdu language and developed inflectional and derivational rule based Urdu stemmer. Stemming is a branch of morphology. In general, we can say that Stemming is a process of extracting `root' word from its actual word and separate the affixes. Through this simple rule based stemming algorithm, raised the problem of under-stemming and over-stemming. To reduce the problem of under-stemming, we have used longest suffix stripping algorithm and to reduce the problem of over-stemming, we have created database of exception words and stop-words.

HEVAL: Yet Another Human Evaluation Metric

Nisheeth Joshi, Iti Mathur, Hemant Darbari +1 more

cs.CL · · cited 16× · arXiv ↗ · more like this ·

Machine translation evaluation is a very important activity in machine translation development. Automatic evaluation metrics proposed in literature are inadequate as they require one or more human reference translations to compare them with output produced by machine translation. This does not always give accurate results as a text can have several different translations. Human evaluation metrics, on the other hand, lacks inter-annotator agreement and repeatability. In this paper we have proposed a new human evaluation metric which addresses these issues. Moreover this metric also provides solid grounds for making sound assumptions on the quality of the text produced by a machine translation.

Development of a Hindi Lemmatizer

Snigdha Paul, Nisheeth Joshi, Iti Mathur

cs.CL · · cited 16× · arXiv ↗ · more like this ·

We live in a translingual society, in order to communicate with people from different parts of the world we need to have an expertise in their respective languages. Learning all these languages is not at all possible; therefore we need a mechanism which can do this task for us. Machine translators have emerged as a tool which can perform this task. In order to develop a machine translator we need to develop several different rules. The very first module that comes in machine translation pipeline is morphological analysis. Stemming and lemmatization comes under morphological analysis. In this paper we have created a lemmatizer which generates rules for removing the affixes along with the addition of rules for creating a proper root word.

Evaluating student performance using fuzzy inference system in fuzzy ITS

Pooja Asopa, Sneha Asopa, Nisheeth Joshi +1 more

Artificial Intelligence · · cited 14× · DOI ↗ · more like this ·

The concept of intelligent agents has emerged from artificial intelligence and cognitive science. These intelligent agents can act as tutors and support students for problem solving in various domains. Agents which are based on the concept of fuzzy logic are termed as fuzzy agents. They can be used in modeling the uncertain behavior of various complex problems and also for predicting the uncertainty level of the students. Systems which have immense capabilities to provide its learners with step-by-step instructions as per their own learning status using computer based instructions are called Intelligent Tutoring System (ITS). The ITS system which has fuzzy characteristics can be called as fuzzy ITS. In this paper, the fuzzy inference system is developed and evaluated in MATLAB for fuzzy ITS which will help students in enhancing their learning skills.

Shiva: A Framework for Graph Based Ontology Matching

Iti Mathur, Nisheeth Joshi, Hemant Darbari +1 more

cs.AI · · cited 14× · arXiv ↗ · more like this ·

Since long, corporations are looking for knowledge sources which can provide structured description of data and can focus on meaning and shared understanding. Structures which can facilitate open world assumptions and can be flexible enough to incorporate and recognize more than one name for an entity. A source whose major purpose is to facilitate human communication and interoperability. Clearly, databases fail to provide these features and ontologies have emerged as an alternative choice, but corporations working on same domain tend to make different ontologies. The problem occurs when they want to share their data/knowledge. Thus we need tools to merge ontologies into one. This task is termed as ontology matching. This is an emerging area and still we have to go a long way in having an ideal matcher which can produce good results. In this paper we have shown a framework to matching…

Classifier-Based Text Simplification for Improved Machine Translation

Shruti Tyagi, Deepti Chopra, Iti Mathur +1 more

cs.CL · · cited 11× · arXiv ↗ · more like this ·

Machine Translation is one of the research fields of Computational Linguistics. The objective of many MT Researchers is to develop an MT System that produce good quality and high accuracy output translations and which also covers maximum language pairs. As internet and Globalization is increasing day by day, we need a way that improves the quality of translation. For this reason, we have developed a Classifier based Text Simplification Model for English-Hindi Machine Translation Systems. We have used support vector machines and Naïve Bayes Classifier to develop this model. We have also evaluated the performance of these classifiers.

Information Retrieval Ranking Using Machine Learning Techniques

Shweta Pandey, Iti Mathur, Nisheeth Joshi

Information Systems · · cited 9× · DOI ↗ · more like this ·

Information retrieval is the research area in which many researcher have been done and many are still going on. The rapidly growing web pages make it very crucial to search up to date documents. In continuation of research works on learning to rank, this research focuses on implication of machine learning techniques for IR ranking. SVM, PSO and hybrid of both are the main techniques implemented for IR ranking. In case of SVM, selecting appropriate parameters is difficult, but it gives potential solutions for the ranking. One of the optimization methods i.e. PSO is easy to implement and has global search capability. Thus to find the fitness function to optimize the ranking of document retrieval Hybrid SVM-PSO model is proposed.After the comparative study it has been calculated that the ranking parameters gives best result for RankSVM-PSO over RankPSO and RankSVM. The result has been…

POS tagger for Urdu using Stochastic approaches

Vaishali Gupta, Nisheeth Joshi, Iti Mathur

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

Part-of-Speech tagging is a problem of Natural language processing. It is a process of labeling an accurate part of speech for each word of a given corpus sentence. There are various approaches like rule based, stochastic and hybrid that are mainly used for automatic tagging. In this paper, we shall discuss stochastic approaches for part of speech tagging of Urdu language. To develop the Urdu POS tagger, a new draft version of Urdu POS tagset is used which is designed by TDIL. Using this tagset, the CRF and HMM based part-of-speech taggers are developed for Urdu. These tagger achieved 83.37% and 81.07% accuracy respectively.

Domain Ontology Development for Communicable Diseases

Iti Mathur, Hemant Darbari, Nisheeth Joshi

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

Web has become the very first resource to search for any kind of information. With the emergence of semantic web, our search queries have started generating more informed results. Ontologies are at the core of any semantic web application. They help in rapid development of distributed systems by providing information on the fly. This key feature of distribution and sharing of information has made ontologies as a new knowledge representation mechanism. A mechanism which is strongly backed by a sound inference system. In this paper, we shall discuss the development, verification and validation of an ontology in a health domain.

Improving Translation Quality By Using Ensemble Approach

Deepti Chopra, Nisheeth Joshi, Iti Mathur

Artificial Intelligence · Engineering Technology & Applied Science Research · · cited 8× · DOI ↗ · more like this ·

Machine translation (MT) has been a topic of great research during the last sixty years, but, improving its quality is still considered an open problem. In the current paper, we will discuss improvements in MT quality by the use of the ensemble approach. We performed MT from English to Hindi using 6 MT different engines described in this paper. We found that the quality of MT is improved by using a combination of various approaches as compared to the simple baseline approach for performing MT from source to target text.

Design of English-Hindi Translation Memory for Efficient Translation

Nisheeth Joshi, Iti Mathur

cs.CL · · cited 8× · arXiv ↗ · more like this ·

Developing parallel corpora is an important and a difficult activity for Machine Translation. This requires manual annotation by Human Translators. Translating same text again is a useless activity. There are tools available to implement this for European Languages, but no such tool is available for Indian Languages. In this paper we present a tool for Indian Languages which not only provides automatic translations of the previously available translation but also provides multiple translations, in cases where a sentence has multiple translations, in ranked list of suggestive translations for a sentence. Moreover this tool also lets translators have global and local saving options of their work, so that they may share it with others, which further lightens the task.

Input Scheme for Hindi Using Phonetic Mapping

Nisheeth Joshi, Iti Mathur

cs.CL · · cited 8× · arXiv ↗ · more like this ·

Written Communication on Computers requires knowledge of writing text for the desired language using Computer. Mostly people do not use any other language besides English. This creates a barrier. To resolve this issue we have developed a scheme to input text in Hindi using phonetic mapping scheme. Using this scheme we generate intermediate code strings and match them with pronunciations of input text. Our system show significant success over other input systems available.

Frequency based predictive input system for Hindi

Nisheeth Joshi, Iti Mathur, Shruti Mathur

Artificial Intelligence · · cited 8× · DOI ↗ · more like this ·

In this paper we discuss a novel approach to input text in Hindi. Since almost all Computer users are acquainted with English and are unfamiliar of using Hindi onto the same, it creates a problem when one is required to draft a document in Hindi. We have developed a tool which addresses this problem. A user can input text in Romanized Hindi which is converted in Hindi.

Rule based chunker for Hindi

Sneha Asopa, Pooja Asopa, Iti Mathur +1 more

Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

In this research paper, a rule based chunker is developed and evaluated. For the development of the chunker, handcrafted linguistic rules for mainly noun, adverb, verb, adjective phrases and conjuncts were generated. Indian Languages Chunk Tagset is used for annotations. In order to evaluate, 500 sentences of Hindi language tagged by HMM tagger were considered and given as an input to our chunker. Precision, Recall and F-Measure for the system were calculated and found to be 79.68, 69.36 and 74.16 respectively.

Improving Quality of Machine Translation Using Text Rewriting

Deepti Chopra, Nisheeth Joshi, Iti Mathur

Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

Machine Translation may be defined as the task of transformation of source text from one language to another. In the following paper, we have discussed the improvement in quality of Machine Translation (MT) using Source text Rewriting. We have performed English to Hindi translation on our MT system and also translation of rewritten English text to Hindi and then compared their performances and evaluated MT system based on 11 features sets as well as using automatic evaluation metrics such as BLEU, METEOR and F-Measure. We found that the performance of MT improved by using Text Rewriting approach.

Comparison of classifier based approach with baseline approach for English-Hindi text simplification

Shruti Tyagi, Deepti Chopra, Iti Mathur +1 more

Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

Text Simplification is the combination of Lexical Simplification and Syntactic Simplification. In this paper, we have compared baseline approach of Text Simplification with classifier based approach of Text Simplification in improving the quality of English-Hindi Machine Translation. We have compared both approaches using Human Judgment and using Automatic measures BLEU, F-measure and Meteor.