An Iterative Decoding Algorithm for Fusion of Multimodal Information. (30th December 2007)
- Record Type:
- Journal Article
- Title:
- An Iterative Decoding Algorithm for Fusion of Multimodal Information. (30th December 2007)
- Main Title:
- An Iterative Decoding Algorithm for Fusion of Multimodal Information
- Authors:
- Shivappa Shivappa, Shankar T. Shankar T.
Rao Rao, Bhaskar D. Bhaskar D.
Trivedi Trivedi, Mohan M. Mohan M. - Other Names:
- Pauwels Pauwels Eric Eric Academic Editor.
- Abstract:
- Abstract : Human activity analysis in an intelligent space is typically based on multimodal informational cues. Use of multiple modalities gives us a lot of advantages. But information fusion from different sources is a problem that has to be addressed. In this paper, we propose an iterative algorithm to fuse information from multimodal sources. We draw inspiration from the theory of turbo codes. We draw an analogy between the redundant parity bits of the constituent codes of a turbo code and the information from different sensors in a multimodal system. A hidden Markov model is used to model the sequence of observations of individual modalities. The decoded state likelihoods from one modality are used as additional information in decoding the states of the other modalities. This procedure is repeated until a certain convergence criterion is met. The resulting iterative algorithm is shown to have lower error rates than the individual models alone. The algorithm is then applied to a real-world problem of speech segmentation using audio and visual cues.
- Is Part Of:
- EURASIP journal on advances in signal processing. Volume 2008(2008)
- Journal:
- EURASIP journal on advances in signal processing
- Issue:
- Volume 2008(2008)
- Issue Display:
- Volume 2008, Issue 2008 (2008)
- Year:
- 2008
- Volume:
- 2008
- Issue:
- 2008
- Issue Sort Value:
- 2008-2008-2008-0000
- Page Start:
- Page End:
- Publication Date:
- 2007-12-30
- Subjects:
- Signal processing -- Periodicals
Traitement du signal
Signal processing
Periodicals
621.3822 - Journal URLs:
- https://asp-eurasipjournals.springeropen.com/ ↗
http://link.springer.com/ ↗
http://www.hindawi.com/journals/asp/ ↗ - DOI:
- 10.1155/2008/478396 ↗
- Languages:
- English
- ISSNs:
- 1687-6172
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 11246.xml