Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
The increasing amount of multimodal data such as text documents, annotated images and web pages have necessitated the development of effective techniques for their manipulation. The ineffectiveness of low-level image and textual features is one of the main issues as these features are commonly insuf...
Saved in:
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | en |
| Published: |
2012
|
| Subjects: | |
| Online Access: | http://eprints.usm.my/41342/1/AHMAD_ADEL_AHMAD_ABU_SHAREHA.pdf http://eprints.usm.my/41342/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1834502283731140608 |
|---|---|
| author | Shareha, Ahmad Adel Ahmad Abu |
| author_facet | Shareha, Ahmad Adel Ahmad Abu |
| author_sort | Shareha, Ahmad Adel Ahmad Abu |
| building | Hamzah Sendut Library |
| collection | Institutional Repository |
| content_provider | Universiti Sains Malaysia |
| content_source | USM Institutional Repository |
| continent | Asia |
| country | Malaysia |
| description | The increasing amount of multimodal data such as text documents, annotated images and web pages have necessitated the development of effective techniques for their manipulation. The ineffectiveness of low-level image and textual features is one of the main issues as these features are commonly insufficient for effective data manipulation. Therefore, obtaining sufficient and significant information from the multimodal data, and then further using this information in the proper manner is penultimate in data manipulation tasks. This thesis proposes a multimodal semantics integration (MSI) process to extract and integrate the semantics from the image and text modalities, and to use these semantics for manipulation tasks. The proposed process firstly extracts a textual representation from the textual and image modalities, followed by mapping the representation to concepts in a condensed knowledge source using a semantic-based alignment sub-process. |
| format | Thesis |
| id | my.usm.eprints.41342 |
| institution | Universiti Sains Malaysia |
| language | en |
| publishDate | 2012 |
| record_format | eprints |
| spelling | my.usm.eprints.41342 http://eprints.usm.my/41342/ Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation Shareha, Ahmad Adel Ahmad Abu QA75.5-76.95 Electronic computers. Computer science The increasing amount of multimodal data such as text documents, annotated images and web pages have necessitated the development of effective techniques for their manipulation. The ineffectiveness of low-level image and textual features is one of the main issues as these features are commonly insufficient for effective data manipulation. Therefore, obtaining sufficient and significant information from the multimodal data, and then further using this information in the proper manner is penultimate in data manipulation tasks. This thesis proposes a multimodal semantics integration (MSI) process to extract and integrate the semantics from the image and text modalities, and to use these semantics for manipulation tasks. The proposed process firstly extracts a textual representation from the textual and image modalities, followed by mapping the representation to concepts in a condensed knowledge source using a semantic-based alignment sub-process. 2012-03 Thesis NonPeerReviewed application/pdf en http://eprints.usm.my/41342/1/AHMAD_ADEL_AHMAD_ABU_SHAREHA.pdf Shareha, Ahmad Adel Ahmad Abu (2012) Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation. PhD thesis, Universiti Sains Malaysia. |
| spellingShingle | QA75.5-76.95 Electronic computers. Computer science Shareha, Ahmad Adel Ahmad Abu Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation |
| title | Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation |
| title_full | Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation |
| title_fullStr | Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation |
| title_full_unstemmed | Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation |
| title_short | Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation |
| title_sort | multimodal semantics integration using ontologies enhanced by ontology extraction and cross modality disambiguation |
| topic | QA75.5-76.95 Electronic computers. Computer science |
| url | http://eprints.usm.my/41342/1/AHMAD_ADEL_AHMAD_ABU_SHAREHA.pdf http://eprints.usm.my/41342/ |
| url_provider | http://eprints.usm.my/ |