Real-time processing of media streams: a case for event-based interaction

V.S.W. Eide1,2, F. Eliassen1,2, O. Lysne1,2, O.-C. Granmo1,2
1Department of Informatics, University of Oslo, Oslo, Norway
2Simula Research Laboratory, Norway

Tóm tắt

There are many challenges in devising solutions for online content processing of live networked multimedia sessions. These include the computational complexity of feature extraction and high-level concept recognition, the massive amount of data to be analyzed under real-time requirements and the intricate correspondence between low-level features and high-level concepts. Our approach to these challenges is a distributed architecture consisting of interacting components encapsulating feature extraction and concept classifier algorithms. The purpose of the framework is to simplify the development of applications for the domain of on-line multimedia content processing. In this paper we focus on the architecture of the framework and argue that it fits well to the publish/subscribe interaction paradigm, leading to an event-based interaction model. Furthermore, we analyze different aspects of the application domain in more depth, such as requirements for scalability, reconfiguration, migration, event notification selection, filtering, and ordering. The main contribution of this paper is, that we for each aspect show how a suitable event notification service may satisfy the corresponding requirements. We also describe parts of a framework prototype. In particular we report on how the event notification service used satisfies the identified requirements.

Từ khóa

#Streaming media #Computer aided software engineering #Feature extraction #Computer architecture #Prototypes #Computational complexity #Data analysis #Scalability #Filtering #Data mining

Tài liệu tham khảo

10.1145/217279.215315 10.1109/90.392384 nakamura, 1992, Parallel Feature Extraction System With Multiagents-PAFE, 11th IAPR International Conference on Pattern Recognition (ICPR), 2, 371 2000, Object Management Group Inc. CORBA services, Notification Service Specification v1 0 2001, Object Management Group Inc. CORBA services, Event Service Specification v1 1 olsen, 2001, Component Framework for Distributed Media Journaling ott, 2000, The Message Bus: A Platform for Component-based Conferencing Applications, Proceedings on the CSCW2000 Workshop on Component-based groupware ott, 2001, A message bus for local coordination, Internet Draft draft-ietf-mmusic-mbus-04 txt qian, 1997, Extending OMG Event Service for Integrating Distributed Multimedia Components, Proceedings of the Fourth International Conference on Intelligence in Services and Networks Como Italy 10.1109/DOA.2001.954088 0, Distributed Media Journaling) project 10.1145/500141.500153 glass, 1999, Voyager - the universal orb, Object 10.1109/DOA.2001.954093 10.1109/ICPR.2000.905296 granmo, 2002, realtime Hyphothesis Driven Feature Extraction on Parallel Processing Architectures, Proceedings of the 2002 Special Session on Parallel and Distributed Multimedia Processing & Retrieval (PDMPR 2002) 10.1145/343477.343622 10.1109/65.819167 kutscher, 2001, The Message Bus: Guidelines for Application Profile Writers, Internet Draft draft-ietf-mmusic-mbus-guidelines-00 txt schulzrinne, 1996, RTP: A Transport Protocol for Realtime Applications, RFC 1889 1999, Java Media Framework, API Guide