Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding
Loading...
Date
2012
Authors
Nükhet ÖZBEK
Journal Title
Journal ISSN
Volume Title
Publisher
Open Access Color
OpenAIRE Downloads
OpenAIRE Views
Abstract
The concept of quality layers (QLs) has been adopted in the scalable video coding standard to enable optimal rate adaptation of precoded video in the rate-distortion sense. QLs were previously extended to stereo and multiple-view scalable video for efficient transport of 3DTV over the Internet. However it is not possible to use the QL method in applications that require real-time encoding since the priority determination process assumes the availability of the whole video sequence. In this work a trellis-based online rate adaptation is proposed for real-time scalable stereo video coding with a delay of 1 group of pictures (GoP). The delay can be controlled by selection of the GoP size according to the application such as 16 frames for live broadcast or 8 or 4 frames for videoconferencing. In addition the joint optimization of layer extraction for scalable multiview coded stereo video is also proposed. It is assumed that the encoder/extractor is aware of the available dynamic network bandwidth in order to perform rate-distortion optimized medium-grain fidelity scalability layer selection for each GoP. Experimental results show that the performance of the proposed online method is very close to that of QLs that would require the whole video sequence.
Description
Keywords
Mühendislik- Elektrik ve Elektronik-Bilgisayar Bilimleri- Teori ve Metotlar
Fields of Science
Citation
[1] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG ISO/IEC ITU-T Rec. H.264: Advanced Video Coding for Generic Audiovisual Services 2003.[2] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG Text of ISO/IEC 14496-10:2005/FDAM 3 Scalable Video Coding Lausanne N9197 2007.[3] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG Text of ISO/IEC 14496-10:2008/FDAM 1 Multiview Video Coding 2008.[4] Joint Video Team of ISO-IEC MPEG & ITU-T VCEG Text of ISO/IEC 14496-4:2001/PDAM 19 Reference Software for SVC N9195 2007.[5] JSVM Software Manual JSVM 9.17 2009 available at cvs://garcon.ient.rwthi- aachen.de:/cvs./jvt.[6] H. Kirchhoffer D. Marpe H. Schwarz T. Wiegand “A low-complexity approach for increasing the granularity of packet-based fidelity scalability in scalable video coding” Picture Coding Symposium Lisbon 2007.[7] I. Amonou N. Cammas S. Kervadec S. Pateux “Optimized rate-distortion extraction with quality layers in the scalable extension of H.264/AVC” IEEE Transactions on Circuits and Systems for Video Technology Vol. 17 pp. 1186-1193 2007.[8] P. Merkle A. Smolic K. M¨uller T. Wiegand “Efficient prediction structures for multi-view video coding” IEEE Transactions on Circuits and Systems for Video Technology Vol. 17 pp. 1461-1472 2007.[9] N. Ozbek A.M. Tekalp “Scalable multi-view video coding for interactive 3DTV” IEEE International Conference on Multimedia & Expo Toronto pp. 213-216 2006.[10] N. Ozbek A.M. Tekalp “Unequal inter-view rate allocation using scalable stereo video coding and an objective stereo video quality measure” IEEE International Conference on Multimedia & Expo Hannover pp. 1113-1116 2008.[11] N. Ozbek A.M. Tekalp “Rate-visual-distortion optimized extraction with quality layers for scalable coding of stereo videos” IEEE International Conference on Image Processing San Diego pp. 2104-2107 2008.[12] N. Ozbek A.M. Tekalp “Quality layers in scalable multi-view video coding” IEEE International Conference on Multimedia & Expo New York pp. 185-188 2009.[13] A. Ortega K. Ramchandran M. Vetterli “Optimal trellis-based buffered compression and fast approximations” IEEE Transactions on Image Processing Vol. 3 pp. 26-40 1994.[14] G.M. Schuster A.K. Katsaggelos “A video compression scheme with optimal bit allocation among segmentation motion and residual error” IEEE Transactions on Image Processing Vol. 6 pp. 1487-1502 1997.[15] M. Luttrell J. Wen J.D. Villasenor “Trellis-based R-D optimal quantization in H.263+” IEEE Transactions on Image Processing Vol. 9 pp. 1431-1434 2000.[16] Z. Li G.M. Schuster A. Katsaggelos B. Gandhi “MINMAX optimal video summarization” IEEE Transactions on Circuits and Systems for Video Technology Vol. 15 pp. 1245-1256 2005.[17] T.C. Thang J.W. Kang J.J. Yoo Y.M. Ro “Optimal multi-layer adaptation of SVC video over heterogeneous environments” Advances in Multimedia 2008. doi: 10.1145/1280940.1281006.[18] M. Handley S. Floyd J. Padhye J. Widmer “TCP friendly rate control (TFRC)” Internet Engineering Task Force RFC 3448 2003.[19] G.D. Forney “The Viterbi algorithm” Proceedings of the IEEE Vol. 61 pp. 268-278 1973.[20] K. Ramchandran A. Ortega M. Vetterli “Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders” IEEE Transactions on Image Processing Vol. 3 pp. 533-545 1994.[21] ITU-T “End-user multimedia QoS categories” Recommendation G.1010 2001.[22] D.V. Meegan L.B. Stelmach W.J. Tam “Unequal weighting of monocular inputs in binocular combination: implications for the compression of stereoscopic imagery” Journal of Experimental Psychology: Applied Vol. 7 pp. 143-153 2001.[23] L.M.J. Meesters W.A. IJsselstejn P.J.H. Seuntiens “A survey of perceptual evaluations and requirements of threedimensional TV” IEEE Transactions on Circuits and Systems for Video Technology Vol. 14 pp. 381-391 2004.
WoS Q
Scopus Q
Source
Volume
Issue
Start Page
End Page
Collections
