1st Edition
Multimedia Ontology Representation and Applications
The result of more than 15 years of collective research, Multimedia Ontology: Representation and Applications provides a theoretical foundation for understanding the nature of media data and the principles involved in its interpretation. The book presents a unified approach to recent advances in multimedia and explains how a multimedia ontology can fill the semantic gap between concepts and the media world. It relays real-life examples of implementations in different domains to illustrate how this gap can be filled.
The book contains information that helps with building semantic, content-based search and retrieval engines and also with developing vertical application-specific search applications. It guides you in designing multimedia tools that aid in logical and conceptual organization of large amounts of multimedia data. As a practical demonstration, it showcases multimedia applications in cultural heritage preservation efforts and the creation of virtual museums.
The book describes the limitations of existing ontology techniques in semantic multimedia data processing, as well as some open problems in the representations and applications of multimedia ontology. As an antidote, it introduces new ontology representation and reasoning schemes that overcome these limitations. The long, compiled efforts reflected in Multimedia Ontology: Representation and Applications are a signpost for new achievements and developments in efficiency and accessibility in the field.
Introduction
The Multimedia Wave
Semantic Multimedia Web: Bridging the Semantic Gap
Multimedia Web Ontology Language
Organization of the Book
Ontology and the Semantic Web
Introduction
Evolution of the Semantic Web
Semantic Web Technologies
What is an Ontology
Formal Ontology Definition
Ontology Representation
Conclusions
Characterizing Multimedia Semantics
Introduction
A First Look at Multimedia Semantics
Percepts, Concepts, Knowledge and Expressions
Representing Multimedia Semantics
Semantic Web Technologies and Multimedia
Conclusions
Ontology Representations for Multimedia
Introduction
An Overview of MPEG-7 and MPEG-21
MPEG-7 Ontologies
Using MPEG-7 Ontology for Applications
Multimedia Concept Modeling
Ontology Applications
Conclusions
Multimedia Web Ontology Language
Introduction
Perceptual Modeling of Domains
An Overview of the Multimedia Web Ontology Language
MOWL: Concepts, Media Observables and Media Relations
MOWL: Spatio-temporal Constructs for Complex Events
MOWL Language Constructs
The Observation Model
MOWL Inferencing Framework
Reasoning Modes with Bayesian Network and MOWL
Conclusions
Modeling the Semantics of Multimedia Content
Introduction
Data Driven Learning for Multimedia Semantics Extraction
Media Features for Semantic Modeling
Semantic Classification of Multimedia Content
Use of Ontology for Semantic Classification
Conclusions
Learning Multimedia Ontology
Introduction
State of the Art in Ontology Learning
Learning an Ontology from Multimedia Data
Ontology-based Management of Multimedia Resources
Application of Multimedia Ontology Learning
Concluding Remarks
Applications Exploiting Multimedia Semantics
Introduction
Multimedia Retrieval and Classification
Recommendation of Media-rich Commodities
Information Integration from Open Resources
Conclusion
Distributed Multimedia Applications
Introduction
Challenges for Web-scale Multimedia Data Access
Architectures for Distributed Multimedia Data Processing
Peer-to-Peer Architecture
Multi-agent Architecture for Distributed Multimedia Systems
Ontology Alignment
Knowledge-based Access to Massively Distributed Multimedia
Conclusion
Application of Multimedia Ontology in Heritage Preservation
Introduction
Preserving the Intangible Heritage of Indian Classical Dance
Intellectual Journey: Space-Time Traversal Using an Ontology
Cross-modal Query and Retrieval
Conclusion
Open Problems and Future Directions
Knowledge and Human Society
Knowledge Organization and Formal Representation
The Perceptual World and MOWL
The Big Debate: Data Driven vs. Knowledge Driven Approaches
Looking Forward: Convergence Between Knowledge-based and Data
Appendices
A: MOWL Schema in Notation
B: MOWL Syntax Structural Specification
C: Examples of WSDL Specification for Media Pattern Detectors
Biography
Santanu Chaudhury did his BTech (1984) in Electronics and Electrical Communication Engineering and PhD (1989) in Computer Science and Engineering from Indian Institute of Technology (IIT), Kharagpur, India. Currently, he is a professor in the Department of Electrical Engineering at IIT Delhi. He was also Dean, Undergraduate Studies at IIT Delhi. He was awarded INSA medal for young scientists in 1993. He is a fellow of Indian National Academy of Engineering and National Academy of Sciences, India. He is also a fellow of the International Association of Pattern Recognition. His research interests are in the areas of Computer Vision, Artificial Intelligence and Multimedia Systems. He has published more than 150 papers in international journals and conference proceedings. He has been on the programme committee of a number of international conferences, including ICCV, ACCV, ICPR, ICVGIP, and PReMI.
Anupama Mallik did her BSc (1986) in Physics and Masters in Computer Applications (1989) from Delhi University, and PhD (2012) in Electrical Engineering from the Indian Institute of Technology (IIT), Delhi. Her PhD thesis dealt with ontology based exploration of multimedia contents. She is associated with Multimedia research group of the Electrical Engineering Department, IIT Delhi and has worked as a Research Scientist in projects sponsored by the Department of Science and Technology, Government of India. Her current research interests include Semantic web based applications, multimedia ontology, ontology applications in Internet of Things, and in cultural heritage preservation. She is a visiting faculty at the Indraprastha Institute of Information Technology, Delhi (IIIT-D). She is a member of the ACM.
Hiranmay Ghosh is a principal scientist with TCS Innovation Labs Delhi and leads its multimedia research track. He received his PhD from IIT, Delhi and his BTech and BSc degrees from the University of Calcutta. His current research interests include multimedia systems, knowledge representation and reasoning, semantic web, intelligent agents, cognitive models and robotics. He is an adjunct faculty member of the Electrical Engineering Department of IIT, Delhi and is associated with its multimedia research group. He is a member of the academic advisory committee of IIT, Ropar. He is a senior member of the Institute of Electrical and Electronics Engineers (IEEE), and a member of ACM and IUPRAI.