arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Clement Yu

107 papers · 1973–2024

1973: 11974: 11975: 11976: 01977: 11978: 01979: 01980: 01981: 01982: 11983: 11984: 21985: 11986: 11987: 01988: 01989: 11990: 21991: 21992: 11993: 01994: 11995: 11996: 21997: 11998: 11999: 42000: 62001: 52002: 32003: 32004: 52005: 22006: 102007: 102008: 102009: 52010: 32011: 42012: 22013: 32014: 32015: 42016: 22017: 02018: 02019: 02020: 02021: 02022: 02023: 02024: 1
1973peak 10 in 20062024

Frequent co-authors

Papers

showing 1–25 of 107 RSS

Effective keyword search in relational databases

Fang Liu, Clement Yu, Weiyi Meng +1 more

Signal Processing · · cited 357× · DOI ↗ · more like this ·

With the amount of available text data in relational databases growing rapidly, the need for ordinary users to search such information is dramatically increasing. Even though the major RDBMSs have provided full-text search capabilities, they still require users to have knowledge of the database schemas and use a structured query language to search information. This search model is complicated for most ordinary users. Inspired by the big success of information retrieval (IR) style keyword search on the web, keyword search in relational databases has recently emerged as a new research topic. The differences between text databases and relational databases result in three new challenges: (1) Answers needed by users are not limited to individual tuples, but results assembled from joining tuples from multiple tables are used to form answers in the form of tuple trees. (2) A single score for…

Fully automatic wrapper generation for search engines

Hongkun Zhao, Weiyi Meng, Zonghuan Wu +2 more

Information Systems · · cited 295× · DOI ↗ · more like this ·

When a query is submitted to a search engine, the search engine returns a dynamically generated result page containing the result records, each of which usually consists of a link to and/or snippet of a retrieved Web page. In addition, such a result page often also contains information irrelevant to the query, such as information related to the hosting site of the search engine and advertisements. In this paper, we present a technique for automatically producing wrappers that can be used to extract search result records from dynamically generated result pages returned by search engines. Automatic search result record extraction is very important for many applications that need to interact with search engines such as automatic construction and maintenance of metasearch engines and deep Web crawling. The novel aspect of the proposed technique is that it utilizes both the visual content…

An interactive clustering-based approach to integrating source query interfaces on the deep Web

Wensheng Wu, Clement Yu, AnHai Doan +1 more

Information Systems · · cited 275× · DOI ↗ · more like this ·

An increasing number of data sources now become available on the Web, but often their contents are only accessible through query interfaces. For a domain of interest, there often exist many such sources with varied coverage or querying capabilities. As an important step to the integration of these sources, we consider the integration of their query interfaces. More specifically, we focus on the crucial step of the integration: accurately matching the interfaces. While the integration of query interfaces has received more attentions recently, current approaches are not sufficiently general: (a) they all model interfaces with flat schemas; (b) most of them only consider 1:1 mappings of fields over the interfaces; (c) they all perform the integration in a blackbox-like fashion and the whole process has to be restarted from scratch if anything goes wrong; and (d) they often require…

Personalized web search by mapping user queries to categories

Fang Liu, Clement Yu, Weiyi Meng

Artificial Intelligence · · cited 239× · DOI ↗ · more like this ·

Current web search engines are built to serve all users, independent of the needs of any individual user. Personalization of web search is to carry out retrieval for each user incorporating his/her interests. We propose a novel technique to map a user query to a set of categories, which represent the user's search intention. This set of categories can serve as a context to disambiguate the words in the user's query. A user profile and a general profile are learned from the user's search history and a category hierarchy respectively. These two profiles are combined to map a user query into a set of categories. Several learning and combining algorithms are evaluated and found to be effective. Among the algorithms to learn a user profile, we choose the Rocchio-based method for its simplicity, efficiency and its ability to be adaptive. Experimental results indicate that our technique to…

An effective approach to document retrieval via utilizing WordNet and recognizing phrases

Shuang Liu, Fang Liu, Clement Yu +1 more

Artificial Intelligence · · cited 238× · DOI ↗ · more like this ·

Noun phrases in queries are identified and classified into four types: proper names, dictionary phrases, simple phrases and complex phrases. A document has a phrase if all content words in the phrase are within a window of a certain size. The window sizes for different types of phrases are different and are determined using a decision tree. Phrases are more important than individual terms. Consequently, documents in response to a query are ranked with matching phrases given a higher priority. We utilize WordNet to disambiguate word senses of query terms. Whenever the sense of a query term is determined, its synonyms, hyponyms, words from its definition and its compound words are considered for possible additions to the query. Experimental results show that our approach yields between 23% and 31% improvements over the best-known results on the TREC 9, 10 and 12 collections for short…

The effect of negation on sentiment analysis and retrieval effectiveness

Lifeng Jia, Clement Yu, Weiyi Meng

Artificial Intelligence · · cited 209× · DOI ↗ · more like this ·

We investigate the problem of determining the polarity of sentiments when one or more occurrences of a negation term such as "not" appear in a sentence. The concept of the scope of a negation term is introduced. By using a parse tree and typed dependencies generated by a parser and special rules proposed by us, we provide a procedure to identify the scope of each negation term. Experimental results show that the identification of the scope of negation improves both the accuracy of sentiment analysis and the retrieval effectiveness of opinion retrieval.

Opinion retrieval from blogs

Wei Zhang, Clement Yu, Weiyi Meng

Artificial Intelligence · · cited 148× · DOI ↗ · more like this ·

Opinion retrieval is a document retrieval process, which requires documents to be retrieved and ranked according to their opinions about a query topic. A relevant document must satisfy two criteria: relevant to the query topic, and contains opinions about the query, no matter if they are positive or negative. In this paper, we describe an opinion retrieval algorithm. It has a traditional information retrieval (IR) component to find topic relevant documents from a document set, an opinion classification component to find documents having opinions from the results of the IR step, and a component to rank the documents based on their relevance to the query, and their degrees of having opinions about the query. We implemented the algorithm as a working system and tested it using TREC 2006 Blog Track data in automatic title-only runs. Our result showed 28% to 32% improvements in MAP score…

Construction of a sentimental word dictionary

Eduard Dragut, Clement Yu, Prasad Sistla +1 more

Artificial Intelligence · · cited 89× · DOI ↗ · more like this ·

The Web has plenty of reviews, comments and reports about products, services, government policies, institutions, etc. The opinions expressed in these reviews influence how people regard these entities. For example, a product with consistently good reviews is likely to sell well, while a product with numerous bad reviews is likely to sell poorly. Our aim is to build a sentimental word dictionary, which is larger than existing sentimental word dictionaries and has high accuracy. We introduce rules for deduction, which take words with known polarities as input and produce synsets (a set of synonyms with a definition) with polarities. The synsets with deduced polarities can then be used to further deduce the polarities of other words. Experimental results show that for a given sentimental word dictionary with D words, approximately an additional 50 % of D words with polarities can be…

On the construction of effective vocabularies for information retrieval

Gerard Salton, Clement Yu

Artificial Intelligence · ACM SIGIR Forum · · cited 87× · DOI ↗ · more like this ·

Natural language query formulations exhibit advantages over artificial language statements since they permit the user to approach the retrieval environment without prior training and without using intermediaries. To obtain adequate retrieval output, it is however necessary to emphasize the good terms and to deemphasize the bad ones. The usefulness of the terms in a natural language vocabulary is first characterized in terms of their frequency distribution over the documents of a collection. The construction of "good" natural language vocabularies is then described, and methods are given for improving the vocabulary by transforming terms that operate poorly for retrieval purposes into better ones.

Reasoning About Spatial Relationships in Picture Retrieval Systems

A. Prasad Sistla, Clement Yu, Rami J. Haddad

Signal Processing · Very Large Data Bases · · cited 78× · OpenAlex ↗ · more like this ·

In this paper, we consider various spatial re-lationships that are of general interest in pic-torial database systems. We present a set of rules that allow us to deduce new relationship-s from a given set of relationships. A deduc-tive mechanism using these rules can be used in query processing systems that retrieve pic-tures by content. The given set of rules are shown to be sound, i.e. the deductions are logically correct. The rules are also shown to be complete for three dimensional systems, i.e. every relationship which is implied by a given consistent set of relationships F is deducible from F using the given rules. In addition, we show that the given set of rules is incomplete for two dimensional systems.

A hierarchical approach to model web query interfaces for web source integration

Eduard Dragut, Thomas Kabisch, Clement Yu +1 more

Information Systems · Proceedings of the VLDB Endowment · · cited 74× · DOI ↗ · more like this ·

Much data in the Web is hidden behind Web query interfaces. In most cases the only means to "surface" the content of a Web database is by formulating complex queries on such interfaces. Applications such as Deep Web crawling and Web database integration require an automatic usage of these interfaces. Therefore, an important problem to be addressed is the automatic extraction of query interfaces into an appropriate model. We hypothesize the existence of a set of domain-independent "commonsense design rules" that guides the creation of Web query interfaces. These rules transform query interfaces into schema trees. In this paper we describe a Web query interface extraction algorithm, which combines HTML tokens and the geometric layout of these tokens within a Web page. Tokens are classified into several classes out of which the most significant ones are text tokens and field tokens. A tree…

Determining Text Databases to Search in the Internet

Weiyi Meng, King-Lup Liu, Clement Yu +3 more

Artificial Intelligence · Very Large Data Bases · · cited 72× · OpenAlex ↗ · more like this ·

Text data in the Internet can be partitioned into many databases naturally. Efficient retrieval of desired data can be achieved if we can accurately predict the usefulness of each database, because with such information, we only need to retrieve potentially useful documents from useful databases. In this paper, we propose two new methods for estimating the usefulness of text databases. For a given query, the usefulness of a text database in this paper is defined to be the number of documents in the database that are sufficiently similar to the query. Such a usefulness measure enables naive-users to make informed decision about which databases to search. We also consider the collection fusion problem. Because local databases may employ similarity functions that are different from that used by the global database, the threshold used by a local database to determine whether a document is…

Word sense disambiguation in queries

Shuang Liu, Clement Yu, Weiyi Meng

Artificial Intelligence · · cited 71× · DOI ↗ · more like this ·

This paper presents a new approach to determine the senses of words in queries by using WordNet. In our approach, noun phrases in a query are determined first. For each word in the query, information associated with it, including its synonyms, hyponyms, hypernyms, definitions of its synonyms and hyponyms, and its domains, can be used for word sense disambiguation. By comparing these pieces of information associated with the words which form a phrase, it may be possible to assign senses to these words. If the above disambiguation fails, then other query words, if exist, are used, by going through exactly the same process. If the sense of a query word cannot be determined in this manner, then a guess of the sense of the word is made, if the guess has at least 50% chance of being correct. If no sense of the word has 50% or higher chance of being used, then we apply a Web search to assist…

Automatic extraction of dynamic record sections from search engine result pages

Hongkun Zhao, Weiyi Meng, Clement Yu

Information Systems · Very Large Data Bases · · cited 65× · DOI ↗ · more like this ·

A search engine returned result page may contain search results that are organized into multiple dynamically generated sections in response to a user query. Furthermore, such a result page often also contains information irrelevant to the query, such as information related to the hosting site of the search engine. In this paper, we present a method to automatically generate wrappers for extracting search result records from all dynamic sections on result pages returned by search engines. This method has the following novel features: (1) it aims to explicitly identify all dynamic sections, including those that are not seen on sample result pages used to generate the wrapper, and (2) it addresses the issue of correctly differentiating sections and records. Experimental results indicate that this method is very promising. Automatic search result record extraction is critical for…

Stop word and related problems in web interface integration

Eduard Dragut, Fang Fang, Prasad Sistla +2 more

Artificial Intelligence · Proceedings of the VLDB Endowment · · cited 64× · DOI ↗ · more like this ·

The goal of recent research projects on integrating Web databases has been to enable uniform access to the large amount of data behind query interfaces. Among the tasks addressed are: source discovery, query interface extraction, schema matching, etc. There are also a number of tasks that are commonly ignored or assumed to be apriori solved either manually or by some oracle. These tasks include (1) finding the set of stop words and (2) handling occurrences of "semantic enrichment words" within labels. These two subproblems have a direct impact on determining the synonymy and hyponymy relationships between labels. In (1), a word like "from" is a stop word in general but it is a content word in domains such as Airline and Real Estate. We formulate the stop word problem , prove its complexity and provide an approximation algorithm. In (2), we study the impact of words like AND and OR on…

Discovering the representative of a search engine

King-Lup Liu, Adrain Santoso, Clement Yu +1 more

Information Systems · · cited 61× · DOI ↗ · more like this ·

Given a large number of search engines on the Internet, it is difficult for a person to determine which search engines could serve his/her information needs. A common solution is to construct a metasearch engine on top of the search engines. Upon receiving a user query, the metasearch engine sends it to those underlying search engines which are likely to return the desired documents for the query. The selection algorithm used by a metasearch engine to determine whether a search engine should be sent the query typically makes the decision based on the search-engine representative, which contains characteristic information about the database of a search engine. However, an underlying search engine may not be willing to provide the needed information to the metasearch engine. This paper shows that the needed information can be estimated from an uncooperative search engine with good…

Annotating Search Results from Web Databases

Yiyao Lu, Hai He, Hongkun Zhao +2 more

Information Systems · IEEE Transactions on Knowledge and Data Engineering · · cited 59× · DOI ↗ · more like this ·

An increasing number of databases have become web accessible through HTML form-based search interfaces. The data units returned from the underlying database are usually encoded into the result pages dynamically for human browsing. For the encoded data units to be machine processable, which is essential for many applications such as deep web data collection and Internet comparison shopping, they need to be extracted out and assigned meaningful labels. In this paper, we present an automatic annotation approach that first aligns the data units on a result page into different groups such that the data in the same group have the same semantic. Then, for each group we annotate it from different aspects and aggregate the different annotations to predict a final annotation label for it. An annotation wrapper for the search site is automatically constructed and can be used to annotate new result…

Improve the effectiveness of the opinion retrieval and opinion polarity classification

Wei Zhang, Lifeng Jia, Clement Yu +1 more

Artificial Intelligence · · cited 59× · DOI ↗ · more like this ·

Opinion retrieval is a document retrieving and ranking process. A relevant document must be relevant to the query and contain opinions toward the query. Opinion polarity classification is an extension of opinion retrieval. It classifies the retrieved document as positive, negative or mixed, according to the overall polarity of the query relevant opinions in the document. This paper (1) proposes several new techniques that help improve the effectiveness of an existing opinion retrieval system; (2) presents a novel two-stage model to solve the opinion polarity classification problem. In this model, every query relevant opinionated sentence in a document retrieved by our opinion retrieval system is classified as positive or negative respectively by a SVM classifier. Then a second classifier determines the overall opinion polarity of the document. Experimental results show that both the…

Annotating Structured Data of the Deep Web

Yiyao Lu, Hai He, Hongkun Zhao +2 more

Information Systems · · cited 56× · DOI ↗ · more like this ·

An increasing number of databases have become Web accessible through HTML form-based search interfaces. The data units returned from the underlying database are usually encoded into the result pages dynamically for human browsing. For the encoded data units to be machine processable, which is essential for many applications such as deep Web data collection and comparison shopping, they need to be extracted out and assigned meaningful labels. In this paper, we present a multi-annotator approach that first aligns the data units into different groups such that the data in the same group have the same semantics. Then for each group, we annotate it from different aspects and aggregate the different annotations to predict a final annotation label. An annotation wrapper for the search site is automatically constructed and can be used to annotate new result pages from the same site. Our…

Towards a highly-scalable and effective metasearch engine

Zonghuan Wu, Weiyi Meng, Clement Yu +1 more

Information Systems · · cited 54× · DOI ↗ · more like this ·

A metasearch engine is a system that supports unified access to multiple local search engines. Database selection is one of the main challenges in building a large-scale metasearch engine. The problem is to efficiently and accurately determine a small number of potentially useful local search engines to invoke for each user query. In order to enable accurate selection, metadata that reflect the contents of each search engine need to be collected and used. In this paper, we propose a highly scalable and accurate database selection method. This method has several novel features. First, the metadata for representing the contents of all search engines are organized into a single integrated representative, instead of one for each search engine by all existing approaches. Such a representative yields both computation efficiency and storage efficiency. Second, our selection method is based on…

UIC at TREC 2008 Blog Track

Lifeng Jia, Clement Yu, Wei Zhang

Artificial Intelligence · Text REtrieval Conference · · cited 52× · OpenAlex ↗ · more like this ·

Our opinion retrieval system has four steps. In the first step, documents which are deemed relevant by the system with respect to the query are retrieved, without taking into consideration whether the documents are opinionative or not. In the second step, the abbreviations of query concepts in documents are recognized. This helps in identifying whether an opinion is in the vicinity of a query concept (which can be an abbreviation) in a document. The third step of opinion identification is designed for recognizing query-relevant opinions within the documents. In the forth step, for each query, all retrieved opinionated documents are ranked by various methods which take into account IR scores, opinion scores and the number of concepts in query. For the polarity subtask, the opinionative documents are classified into positive, negative and mixed types by two classifiers. Since TREC 2008…

Estimating the usefulness of search engines

Weiyi Meng, King-Lup Liu, Clement Yu +2 more

Information Systems · · cited 52× · DOI ↗ · more like this ·

In this paper, we present a statistical method to estimate the usefulness of a search engine for any given query. The estimates can be used by a metasearch engine to choose local search engines to invoke. For a given query, the usefulness of a search engine in this paper is defined to be a combination of the number of documents in the search engine that are sufficiently similar to the query and the average similarity of these documents. Experimental results indicate that the proposed estimation method is quite accurate.

T-verifier: Verifying truthfulness of fact statements

Xian Li, Weiyi Meng, Clement Yu

Artificial Intelligence · · cited 49× · DOI ↗ · more like this ·

The Web has become the most popular place for people to acquire information. Unfortunately, it is widely recognized that the Web contains a significant amount of untruthful information. As a result, good tools are needed to help Web users determine the truthfulness of certain information. In this paper, we propose a two-step method that aims to determine whether a given statement is truthful, and if it is not, find out the truthful statement most related to the given statement. In the first step, we try to find a small number of alternative statements of the same topic as the given statement and make sure that one of these statements is truthful. In the second step, we identify the truthful statement from the given statement and the alternative statements. Both steps heavily rely on analysing various features extracted from the search results returned by a popular search engine for…

Polarity Consistency Checking for Sentiment Dictionaries

Eduard Dragut, Hong Wang, Clement Yu +2 more

Artificial Intelligence · Purdue e-Pubs (Purdue University System) · · cited 45× · OpenAlex ↗ · more like this ·

Polarity classification of words is important for applications such as Opinion Mining and Sentiment Analysis. A number of sentiment word/sense dictionaries have been manually or (semi)automatically constructed. The dictionaries have substantial inaccuracies. Besides obvious instances, where the same word appears with different polarities in different dictionaries, the dictionaries exhibit complex cases, which cannot be detected by mere manual inspection. We introduce the concept of polarity consistency of words/senses in sentiment dictionaries in this paper. We show that the consistency problem is NP-complete. We reduce the polarity consistency problem to the satisfiability problem and utilize a fast SAT solver to detect inconsistencies in a sentiment dictionary. We perform experiments on four sentiment dictionaries and WordNet. 1