Author

Pascal Soucy

4 papers · 2001–2005

2001peak 2 in 20012005

Frequent co-authors

Guy W. Mineau 4

Papers

showing 1–4 of 4 RSS

Beyond TFIDF weighting for text categorization in the vector space model

Pascal Soucy, Guy W. Mineau

Artificial Intelligence · International Joint Conference on Artificial Intelligence · 30 Jul 2005 · cited 232× · OpenAlex ↗ · more like this ·

KNN and SVM are two machine learning approaches to Text Categorization (TC) based on the Vector Space Model. In this model, borrowed from Information Retrieval, documents are represented as a vector where each component is associated with a particular word from the vocabulary. Traditionally, each component value is assigned using the information retrieval TFIDF measure. While this weighting method seems very appropriate for IR, it is not clear that it is the best choice for TC problems. Actually, this weighting method does not leverage the information implicitly contained in the categorization task to represent documents. In this paper, we introduce a new weighting method based on statistical estimation of the importance of a word for a specific categorization problem. This method also has the benefit to make feature selection implicit, since useless features for the categorization…

A simple KNN algorithm for text categorization

Pascal Soucy, Guy W. Mineau

Artificial Intelligence · 14 Nov 2002 · cited 225× · DOI ↗ · more like this ·

Text categorization (also called text classification) is the process of identifying the class to which a text document belongs. This paper proposes to use a simple non-weighted features KNN algorithm for text categorization. We propose to use a feature selection method that finds the relevant features for the learning task at hand using feature interaction (based on word interdependencies). This will allow us to reduce considerably the number Of selected features from which to learn, making our KNN algorithm applicable in contexts where both the volume of documents and the size of the vocabulary are high, like with the World Wide Web. Therefore, the KNN algorithm that we propose becomes efficient for classifying text documents in that context (in terms of its predictability and interpretability), as is demonstrated. Its simplicity (WRT its implementation and fine-tuning) becomes its…

A simple feature selection method for text classification

Pascal Soucy, Guy W. Mineau

Artificial Intelligence · International Joint Conference on Artificial Intelligence · 4 Aug 2001 · cited 26× · OpenAlex ↗ · more like this ·

In text classification most techniques use bag-of-words to represent documents. The main problem is to identify what words are best suited to classify the documents in such a way as to discriminate between them. Feature selection techniques are then needed to identify these words. The feature selection method presented in this paper is rather simple and computationally efficient. It combines a well known feature selection criterion, the information gain, and a new algorithm that selects and adds a feature to a bag-of-words if it does not occur too often with the features already in a small set composed of the best features selected so far for their high information gain. In brief, it tries to avoid considering features whose discrimination capability is sufficiently covered by already selected features, reducing in size the set of the features used to characterize the document set. This…

A Simple K" Algorithm for Text Categorization

Pascal Soucy, Guy W. Mineau

Artificial Intelligence · 2001 · cited 2× · OpenAlex ↗ · more like this ·

Text categorization (also called text class$cation) is the process of identihing the class to which a text document belongs. This paper proposes to use a simple nonweighted features KNN algorithm for text categorization. We propose to use a feature selection method that finds the relevant features for the learning task at hand using feature interaction (based on word interdependencies). This will allow us to reduce considerabb the number of selected ,features from which to learn, making our KNN algorithm applicable in contexts where both the volume of documents and the size of the vocabulary are high, like with the World Wide Web. Therefore. the K algorithm that we propose becomes efficient for classifiing text documents in that context (in terms of its predictability and interpretability), as will be demonstrated. Its simplicity (w.r. t. its implementation and fine-tuning) becomes its…