Video search and indexing with reinforcement agent for interactive multimedia services

Transactions on Embedded Computing Systems - Tập 12 Số 2 - Trang 1-16 - 2013
Anand Paul1, Bowei Chen2, Karunanithi Bharanitharan3, Jhing-Fa Wang2
1Kyungpook National University, South Korea
2National Cheng Kung University, Taiwan
3Feng Chia University, Taiwan

Tóm tắt

In this study, we present a video search and indexing system based on the state support vector (SVM) network, video graph, and reinforcement agent for recognizing and organizing video events. In order to enhance the recognition performance of the state SVM network, two innovative techniques are presented: state transition correction and transition quality estimation. The classification results are also merged into the video indexing graph, which facilitates the search speed. A reinforcement algorithm with an efficient scheduling scheme significantly reduces both the power consumption and time. The experimental results show the proposed state SVM network was able to achieve a precision rate as high as 83.83% and the query results of the indexing graph reached 80% accuracy. The experiments also demonstrate the performance and feasibility of our system.

Từ khóa


Tài liệu tham khảo

10.1145/280756.280881

10.1109/43.766730

10.1109/TMM.2008.2009703

10.1109/ICASSP.2009.4959988

Chung E., 1999, Proceedings of the International Conference on Computer-Aided Design.

10.1145/307418.307456

Costa Ribeiro C. H. 2002. A tutorial on reinforcement learning techniques. Department of Theory of Computation Technological Institute of Aeronautics São Jos e dos Campos Brazil. Costa Ribeiro C. H. 2002. A tutorial on reinforcement learning techniques. Department of Theory of Computation Technological Institute of Aeronautics São Jos e dos Campos Brazil.

10.1109/TSP.2004.831018

Golding R. Bosch P. and Wilkes J. 1996. Idleness is not sloth: HP Laboratories Tech. Rep. HPL-96--140. Golding R. Bosch P. and Wilkes J. 1996. Idleness is not sloth: HP Laboratories Tech. Rep. HPL-96--140.

Huang X. Acero A. and Hon H.-W. 2001. Spoken Language Processing: A Guide to Theory Algorithm and System Development. Prentice-Hall New York NY. Huang X. Acero A. and Hon H.-W. 2001. Spoken Language Processing: A Guide to Theory Algorithm and System Development. Prentice-Hall New York NY.

10.1109/TMM.2006.876289

Irani S., Proceedings of the Design Automation and Test Conference Europe (DATE02)

10.1109/TMM.2010.2066960

10.1145/343647.343688

10.1145/301177.301518

Paul A. Jiang Y. C. and Wang J. F. 2010. Computation aware scheme for visual signal processing J. Softw. Paul A. Jiang Y. C. and Wang J. F. 2010. Computation aware scheme for visual signal processing J. Softw.

10.1109/TC.2005.66

Shih E. Bahl V. and Sinclair M. 2003. Reducing energy consumption of Wireless Mobile Devices Using a Secondary Low-Power Channel MIT Laboratory for Computer Science March. Shih E. Bahl V. and Sinclair M. 2003. Reducing energy consumption of Wireless Mobile Devices Using a Secondary Low-Power Channel MIT Laboratory for Computer Science March.

Shukla S., Proceedings of IEEE Workshop on High Level Design Validation and Test (HLDVT 01)

Simunic T., 1999, Proceedings of the International Symposium on System Synthesis, 18

Simunic T. Benini L. and de Micheli G. 2000. Power management of laptop hard disk. Design Automation and Test in Europe p. 736. Simunic T. Benini L. and de Micheli G. 2000. Power management of laptop hard disk. Design Automation and Test in Europe p. 736.

Srinivasan P., Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, 1--8.

Sutton R. S. and Barto A. G. 1998. Reinforcement learning -- An introduction MITPress Cambridge MA. Sutton R. S. and Barto A. G. 1998. Reinforcement learning -- An introduction MITPress Cambridge MA.

10.1109/ISM.2008.47

10.1109/TMM.2008.921853

10.1016/j.patrec.2004.01.005

10.1109/TCSVT.2005.856903

Zhong L., Proceedings of the IEEE International Conference on VLSI Design.

10.1109/TMC.2006.167