Journal of Applied Research in Electrical Engineering

Current Issue

By Issue

By Author

By Subject

Author Index

Keyword Index

About Journal

Aims and Scope

Editorial Board

Publication Ethics

Indexing and Abstracting

Related Links

FAQ

Peer Review Process

News

Review Guide

Publons Membership Guide

Smart AI-based Video Encoding for Fixed Background Video Streaming Applications

Document Type : Research article

Authors

1 Department of Electrical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran

2 School of Automotive Engineering, Iran University of Science and Technology, Tehran, Iran

3 Department of Computer Engineering, Iran University of Science and Technology, Tehran, Iran

4 Department of Computer Science and Electronic Engineering, University of Essex, Essex, UK

Abstract

This paper is an extension of our previous research on presenting a novel Gaussian Mixture-based (MOG2) Video Coding for CCTVs. The aim of this paper is to optimize the MOG2 algorithm used for foreground-background separation in video streaming. In fact, our previous study showed that traditional video encoding with the help of MOG2 has a negative effect on visual quality. Therefore, this study is our main motivation for improving visual quality by combining the previously proposed algorithm and color optimization method to achieve better visual quality. In this regard, we introduce Artificial Intelligence (AI) video encoding using Color Clustering (CC), which is used before the MOG2 process to optimize color and make a less noisy mask. The results of our experiments show that with this method the visual quality is significantly increased, while the latency remains almost the same. Consequently, instead of using morphological transformation which has been used in our past study, CC achieves better results such that PSNR and SSIM values have been shown to rise by approximately 1dB and 1 unit respectively.

Highlights

  • Introducing new caching technology by separation of foreground and background video, based on moving and fixed objects
  • Detection of moving objects using Gaussian Mixture-based (MOG2) analysis by creating a mask and multiplying the masks into the whole part of the video by arithmetic operations to separate foreground from the background video
  • Optimization of MOG2 process by using color segmentation analysis namely Color Clustering (CC)
  • Reduction of almost 1/2 in I-frame transmission by using morphological transformation and MOG2 transmission (MT+MOG2) and 1/3 by using CC+MOG2 method
  • Improving the visual quality of transmission by CC+MOG2 transmission method by investigation of Peak Signal to Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) methods

Keywords

Main Subjects

References
[1] S. Arora, K. Bhatia, and V. Amit, “Storage optimization of video surveillance from CCTV camera,” in 2016 2nd International Conference on Next Generation Computing Technologies (NGCT), 2016, pp. 710-713.
[2] S. Vítek, M. Klíma, and L. Krasula, “Video compression technique impact on efficiency of person identification in CCTV systems,” in 2014 International Carnahan Conference on Security Technology (ICCST), 2014, pp. 1-5.
[3] G. Harikrishnan, “Role of CCTV in business organization: A case study,” International Journal of Commerce, Business and Management, vol. 3, no. 3, pp. 466-470, 2014.
[4] V.Carli, “Assessing CCTV as an effective safety and management tool for crime-solving, prevention and reduction,” Montreal, 2008. [Online]. Available: https://policycommons.net/artifacts/1217708/assessing-cctv-as-an-effective-safety-and-mangement-tool-for-crime-solving-prevention-and-reduction/1770796
[5] B. Goold, “Public area surveillance and police work: The impact of CCTV on police behaviour and autonomy,” Journal of Surveillance and Society, vol. 1, no. 2, pp. 191-203, 2003.
[6] B. C. Welsh, and D.P. Farrington, “Effects of closed circuit television surveillance in reducing crime,” Campbell Systematic Reviews, vol. 4, no. 1, pp. 1-73, 2008.
[7] B. Srilaya, LV. Kumar, and LNP. Boggavarapu, “Surveillance using video analytics,” in Proc. of Int. Conf. on Computational Intelligence and Information Technology, 2013.
[8] Kumar, M. B. Punith, and P. S. Puttaswamy, “Video to frame conversion of TV news video by using MATLAB,” International Journal of Advance Research in Science and Engineering, vol. 3, no.3, pp. 95-101, 2014.
[9] D. R. Zaghar, and TE. Abdulabbas, “A Compression Algorithm for Video Surveillance System,” International Journal of Computer Applications, vol. 118, no.24, pp. 19-22, 2015.
[10] CCTV Services (Jan. 6, 2023). Unlimited Video Storage. [Online]. Available: http://www.cctvservices.net/unlimited-video-storage/   
[11] S. Arora, K. Bhatia, and V. Amit, “Storage optimization of video surveillance from CCTV camera,” in 2016 2nd International Conference on Next Generation Computing Technologies (NGCT), 2016, pp. 710-713.
[12] C. Held, J. Krumm, P. Markel, and R. P. Schenke, “Intelligent Video Surveillance,” Computer, vol. 45, no. 3, pp. 83-84, 2012.
[13] F. Lv, J. Kang, R. Nevatia, I. Cohen, and G. Medioni, “Automatic tracking and labeling of human activities in a video sequence,” in Proc. the 6th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS04), 2004.
[14] P. C. Ribeiro, J. Santos-Victor, and P. Lisboa, “Human activity recognition from video: Modeling feature selection and classification architecture,” in International Workshop on Human Activity Recognition and Modeling, pp. 61-70, 2005.
[15] L. Ma, H. Qi, S. Zhu, and S. Ma, “A fast background model based surveillance video coding in HEVC,” in IEEE Visual Communications and Image Processing Conference, Valletta, pp. 237-240, 2014.
[16] X. Zhang, T. Huang, Y. Tian, and W. Gao, “Background-modeling-based adaptive prediction for surveillance video coding,” IEEE Transactions on Image Processing, vol. 23, no. 2, pp. 769-784, 2014.
[17] S. Guo, Y. Wang, Y. Tian, P. Xing, and W. Gao, “Quality-progressive coding for high bit-rate background frames on surveillance videos,” in 2015 IEEE International Symposium on Circuits and Systems, 2015, pp. 2764-2767.
[18] Y. Tian, J. Yan, S Dong, and T. Huang, “PA-Search: predicting units adaptive motion search for surveillance video coding,” Computer Vision and Image Understanding, vol. 170, pp. 14-27, 2018.
[19] H. Kim, and H. Lee, “A low-power surveillance video coding system with early background subtraction and adaptive frame memory compression,” IEEE Transactions on Consumer Electronics, vol. 63, no. 4, pp. 359-367, 2017.
[20] H. Li, W. Ding, Y. Shi, and W. Yin, “A double background based coding scheme for surveillance videos,” in Data Compression Conference, Snowbird, UT, 2018, pp. 420-420.
[21] J. Celine and S. A. A, “Face Recognition in CCTV Systems,” in 2019 International Conference on Smart Systems and Inventive Technology (ICSSIT), 2019, pp. 111-116.
[22] M. T. Bhatti, M. G. Khan, M. Aslam, and M. J. Fiaz, “Weapon Detection in Real-Time CCTV Videos Using Deep Learning,” IEEE Access, vol. 9, pp. 34366-34382, 2021.
[23] S. Powale, A. Dhanawade, S. Bagwe, S. Kawale, N. L. Chutke, and S. Chavan, “Person identification in low resolution CCTV footage using deep learning,” in 2020 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN), 2020, pp. 236-240.
[24] Computer Vision Group, School of Electronic Engineering and Computer Science, Queen Mary University of London. (Jan. 6, 2023). TinyFace: Face Recognition in Native Low-resolution Imagery. [Online]. Available: https://qmul-tinyface.github.io/
[25] M. S. Pillai, G. Chaudhary, M. Khari, and R. G. Crespo, “Real-time image enhancement for an automatic automobile accident detection through CCTV using deep learning”, Soft Computing, vol. 25, no. 18, pp. 11929-11940, 2021.
[26] R. Ullah et al., “A real-time framework for human face detection and recognition in CCTV images,” Mathematical Problems in Engineering, article 3276704, 2022.
[27] Pan, S.-H., S.-C.J.S. Wang, and Materials, “Identifying vehicles dynamically on freeway CCTV images through the Yolo deep learning model,” Sensors and Materials, vol. 33, no. 5, pp. 1517-1530, 2021.
[28] M. Ghafari, A. Amirkhani, E. Rashno, S. Ghanbariet, “Novel gaussian mixture-based video coding for fixed background video streaming,” in 2022 12th Iranian/Second International Conference on Machine Vision and Image Processing (MVIP), Ahvaz, Iran, 2022.
[29] G. Matczak, and P. Mazurek, “Comparative Monte Carlo Analysis of Background Estimation Algorithms for Unmanned Aerial Vehicle Detection,” Remote Sensing, vol. 13, no. 5, 2021.
[30] Kaggle. (Jan. 6, 2023). Highway Traffic Videos Dataset. [Online]. Available: https://www.kaggle.com/aryashah2k/highway-traffic-videos-dataset
Journal of Applied Research in Electrical Engineering
Volume 2, Issue 1
Winter and Spring 2023
January 2023
Pages 37-44
Files
History
  • Receive Date: 14 March 2022
  • Revise Date: 28 June 2022
  • Accept Date: 06 August 2022
Share
How to cite
Statistics