Development of a genetic-based hierarchical agglomerative clustering technique for parallel clustering of bilingual corpora based on reduced terms

In this project, we report on our work on applying Hierarchical Agglomerative Clustering (HAC) to a large corpus of documents where each appears both in Malay and English. We cluster these documents for each language and compare the results both with respect to the content of clusters produced. On t...

Full description

Saved in:
Bibliographic Details
Main Authors: Rayner Alfred, Jason Teo, Chung, Seng Kheau
Format: Research Report
Language:en
Published: Universiti Malaysia Sabah 2010
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/24737/1/Development%20of%20genetic-based%20hierarchical.pdf
https://eprints.ums.edu.my/id/eprint/24737/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this project, we report on our work on applying Hierarchical Agglomerative Clustering (HAC) to a large corpus of documents where each appears both in Malay and English. We cluster these documents for each language and compare the results both with respect to the content of clusters produced. On the data available, the results of clustering one language resemble the other, provided the number of clusters required is relatively small. Further? we study the effects of changing the method used to compute the inter-clusters distance that includes single link, complete link and average link distance between clusters. Finally, we describe an experiment employing a genetic algorithm to fine-tune the individual term weights in order to reproduce more closely a predefined set of clusters.