A new approach to conceptual document indexing

Barresi, S; Nefti-Meziani, S; Rezgui, Y

Abstract

This paper presents a new conceptual indexing technique intended to overcome the major problems resulting from the use of Term Frequency (TF) based approaches. To resolve the semantic problems related to TF approaches, the proposed technique disambiguates the words contained in a document and creates a list of super ordinates based on an external knowledge source. In order to reduce the dimension of the document vector, the final set of index values is created by extracting a set of common concepts, shared by multiple related words, from the list of hypernyms. Subsequently, a weight is assigned to each concept index by considering its position in the knowledge source's hierarchical tree (i.e. distance from the substituted words) and its number of occurrences. By applying the proposed technique, we were able to disambiguate words within different contexts, extrapolate concepts from documents, assigning appropriate normalised weights, and significantly reduce the vector dimension.

Citation

Barresi, S., Nefti-Meziani, S., & Rezgui, Y. (2007, February). A new approach to conceptual document indexing. Presented at Eighth International Conference on Intelligent Text Processing and Computational Linguistics, Special Session (CICLing 2007), Mexico City, Mexico

• Presentation Conference Type: Other
• Conference Name: Eighth International Conference on Intelligent Text Processing and Computational Linguistics, Special Session (CICLing 2007)
• Conference Location: Mexico City, Mexico
• Start Date: Feb 18, 2007
• End Date: Feb 24, 2007
• Publication Date: Jan 1, 2007
• Deposit Date: Jan 8, 2009
• Publisher URL: http://dx.doi.org/10.1109/ENC.2009.50
• Related Public URLs: http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=5452232
• Additional Information: Event Type : Conference; Funders : Conference Publishing Services of IEEE Computer Society