Using textual and structural context for searching Multimedia Elements. (25th October 2010)

• Record Type: Journal Article
• Authors: Torjmen, Mouna; Pinel-Sauvagnat, Karen; Boughanem, Mohand
• Is Part Of: International journal of business intelligence and data mining. Volume 5:Number 4(2010)
• Page Start: 323
• Page End: 352
• Publication Date: 2010-10-25
• Subjects: XML documents -- context-based multimedia retrieval -- hierarchical structures -- multimedia elements -- textual contexts -- structural contexts -- image retrieval -- multimedia objects -- implicit use -- explicit use -- experimental evaluation -- INEX -- MultimediaFragments Tasks -- fragments -- vocabulary relations -- query -- queries -- object representation -- effectiveness -- XML streams -- querying -- extensible markup language -- data mining -- business intelligence; 006.312
• Languages: English
• ISSNs: 1743-8187

Abstract

We investigate in this paper the use of XML structure in multimedia retrieval, particularly in context-based image retrieval. We propose two methods to represent multimedia objects: the first one is based on an implicit use of textual and structural context of multimedia objects, whereas the second one is based on an explicit use of both sources. Experimental evaluation is carried out using the INEX MultimediaFragments Task 2006 and 2007. We show that there is a strong vocabulary relation between the query and the multimedia object representation, and that using XML structure improves significantly the effectiveness of multimedia retrieval.