Joint Distance and Information Content Word Similarity Measure
Measuring semantic similarity between words is very important to many applications related to information retrieval and natural language processing. In the paper, we have discovered that word similarity metrics suffer from the drawback of obtaining equal similarities of two words, if they have the s...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Book Chapter |
| Language: | en |
| Published: |
Springer Berlin Heidelberg
2014
|
| Subjects: | |
| Online Access: | http://ir.unimas.my/id/eprint/8458/1/Joint%20Distance.pdf http://ir.unimas.my/id/eprint/8458/ http://www.researchgate.net/publication/268520347_Joint_Distance_and_Information_Content_Word_Similarity_Measure |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Measuring semantic similarity between words is very important to many applications related to information retrieval and natural language processing. In the paper, we have discovered that word similarity metrics suffer from the drawback of obtaining equal similarities of two words, if they have the same path and depth values in WordNet. Likewise information content methods which depend on word probability of a corpus tend to posture the same drawback. This paper proposes a new hybrid semantic similarity to overcome the drawbacks by exploiting advantages of Li and Lin methods. On a benchmark set of human judgments on Miller Charles and Rubenstein Goodenough data sets, the proposed approach outperforms existing methods in distance and information content based methods. |
|---|