Cloud-based scalable object detection and classification in video streams

Journal article


Yaseen, M., Anjum, Ashiq, Rana, Omer and Hill, Richard 2017. Cloud-based scalable object detection and classification in video streams. Future Generation Computer Systems. https://doi.org/10.1016/j.future.2017.02.003
AuthorsYaseen, M., Anjum, Ashiq, Rana, Omer and Hill, Richard
Abstract

Due to the recent advances in cameras, cell phones and camcorders, particularly the resolution at which they can record an image/video, large amounts of data are generated daily. This video data is often so large that manually inspecting it for useful content can be time consuming and error prone, thereby it requires automated analysis to extract useful information and metadata. Existing video analysis systems lack automation, scalability and operate under a supervised learning domain, requiring substantial amounts of labelled data and training time. We present a cloud-based, automated video analysis system to process large numbers of video streams, where the underlying infrastructure is able to scale based on the number and size of the stream(s) being considered. The system automates the video analysis process and reduces manual intervention. An operator using this system only specifies which object of interest is to be located from the video streams. Video streams are then automatically fetched from the cloud storage and analysed in an unsupervised way. The proposed system was able to locate and classify an object of interest from one month of recorded video streams comprising 175 GB in size on a 15 node cloud in 6.52 h. The GPU powered infrastructure took 3 h to accomplish the same task. Occupancy of GPU resources in cloud is optimized and data transfer between CPU and GPU is minimized to achieve high performance. The scalability of the system is demonstrated along with a classification accuracy of 95%.

KeywordsUnsupervised object classification; Cloud computing; High performance video analytics; Graphics processing units (GPU)
Year2017
JournalFuture Generation Computer Systems
PublisherElsevier
ISSN0167739X
Digital Object Identifier (DOI)https://doi.org/10.1016/j.future.2017.02.003
Web address (URL)http://hdl.handle.net/10545/621599
hdl:10545/621599
Publication dates07 Feb 2017
Publication process dates
Deposited10 May 2017, 13:40
Accepted04 Feb 2017
Rights

Archived with thanks to Future Generation Computer Systems

ContributorsUniversity of Derby and Cardiff University
File
File Access Level
Open
File
Permalink -

https://repository.derby.ac.uk/item/93q8z/cloud-based-scalable-object-detection-and-classification-in-video-streams

Download files

  • 50
    total views
  • 3
    total downloads
  • 2
    views this month
  • 0
    downloads this month

Export as

Related outputs

Embedded Data Imputation for Environmental Intelligent Sensing: A Case Study
Erhan, Laura, Di Mauro, Mario, Anjum, Ashiq, Bagdasar, Ovidiu, Song, Wei and Liotta, Antonio 2021. Embedded Data Imputation for Environmental Intelligent Sensing: A Case Study. Sensors. 21 (23), p. 7774. https://doi.org/10.3390/s21237774
A unified graph model based on molecular data binning for disease subtyping
Hassan Zada, M., Yuan, B, Khan, W., Anjum, A., Reiff-Marganiec, S. and Saleem, R. 2022. A unified graph model based on molecular data binning for disease subtyping. Journal of Biomedical Informatics. pp. 1-24. https://doi.org/10.1016/j.jbi.2022.104187
Large-scale Data Integration Using Graph Probabilistic Dependencies (GPDs)
Zada, Muhammad Sadiq Hassan, Yuan, Bo, Anjum, Ashiq, Azad, Muhammad Ajmal, Khan, Wajahat Ali and Reiff-Marganiec, Stephan 2020. Large-scale Data Integration Using Graph Probabilistic Dependencies (GPDs). IEEE. https://doi.org/10.1109/bdcat50828.2020.00028
Explaining probabilistic Artificial Intelligence (AI) models by discretizing Deep Neural Networks
Saleem, Rabia, Yuan, Bo, Kurugollu, Fatih and Anjum, Ashiq 2020. Explaining probabilistic Artificial Intelligence (AI) models by discretizing Deep Neural Networks. IEEE. https://doi.org/10.1109/ucc48980.2020.00070
Intelligent price alert system for digital assets - cryptocurrencies
Chhem, Sronglong, Anjum, Ashiq and Arshad, Bilal 2019. Intelligent price alert system for digital assets - cryptocurrencies. ACM Press. https://doi.org/10.1145/3368235.3368874
Congestion prediction for smart sustainable cities using IoT and machine learning approaches
Majumdar, Sharmila, Subhani, Moeez M., Roullier, Benjamin, Anjum, Ashiq and Zhu, Rongbo 2020. Congestion prediction for smart sustainable cities using IoT and machine learning approaches. Sustainable Cities and Society. 64, p. 102500. https://doi.org/10.1016/j.scs.2020.102500
A deep reinforcement learning based homeostatic system for unmanned position control
Manning, Warren, Anjum, Ashiq, Bower, Craig and Dassanayake, Priyanthi 2019. A deep reinforcement learning based homeostatic system for unmanned position control. Association for Computing Machinery.
Intelligent data fusion algorithm based on hybrid delay-aware adaptive clustering in wireless sensor networks
Liu, Xiaozhu, Zhu, Rongbo, Anjum, Ashiq, Wang, Jun, Zhang, Hao and Ma, Maode 2019. Intelligent data fusion algorithm based on hybrid delay-aware adaptive clustering in wireless sensor networks. Future Generation Computer Systems. 104, pp. 1-14. https://doi.org/10.1016/j.future.2019.10.001
Fog computing-based approximate spatial keyword queries with numeric attributes in IoV
Li, Yanhong, Zhu, Rongbo, Mao, Shiwen and Anjum, Ashiq 2020. Fog computing-based approximate spatial keyword queries with numeric attributes in IoV. IEEE Internet of Things. https://doi.org/10.1109/jiot.2020.2965730
A cascade learning approach for automated detection of locomotive speed sensor using imbalanced data in ITS
Li, Bo, Zhou, Sisi, Cheng, Lifang, Zhu, Rongbo, Hu, Tao, Anjum, Ashiq, He, Zheng and Zou, Yongkai 2019. A cascade learning approach for automated detection of locomotive speed sensor using imbalanced data in ITS. IEEE Access. 7, pp. 90851-90862. https://doi.org/10.1109/access.2019.2928224
Exploring network embedding for efficient message routing in opportunistic mobile social networks
Yuan, Bo, Anjum, Ashiq, Panneerselvam, J. and Liu, Lu 2020. Exploring network embedding for efficient message routing in opportunistic mobile social networks. IEEE. https://doi.org/10.1109/ICDMW.2019.00077
Graph data modelling for genomic variants
Anjum, Ashiq and Aizad, Sanna 2019. Graph data modelling for genomic variants.
Multiclass disease predictions based on integrated clinical and genomics datasets
Anjum, Ashiq and Subhani, Moeez 2019. Multiclass disease predictions based on integrated clinical and genomics datasets. IARIA.
Improved Kalman filter based differentially private streaming data release in cognitive computing.
Wang, Jun, Luo, Jing, Liu, Xiaozhu, Li, Yongkai, Liu, Shubo, Zhu, Rongbo and Anjum, Ashiq 2019. Improved Kalman filter based differentially private streaming data release in cognitive computing. Future Generation Computer Systems. https://doi.org/10.1016/j.future.2019.03.050
Intelligent augmented keyword search on spatial entities in real-life internet of vehicles
Li, Yanhong, Wang, Meng, Du, Xiaokun, Feng, Yuhe, Luo, Changyin, Tian, Shasha, Anjum, Ashiq and Zhu, Rongbo 2018. Intelligent augmented keyword search on spatial entities in real-life internet of vehicles. Future Generation Computer Systems. 94, pp. 697-711. https://doi.org/10.1016/j.future.2018.12.051
Language model-based automatic prefix abbreviation expansion method for biomedical big data analysis
Anjum, Ashiq 2019. Language model-based automatic prefix abbreviation expansion method for biomedical big data analysis. Future Generation Computer Systems. https://doi.org/10.1016/j.future.2019.01.016
Machine-learning-based side-channel evaluation of elliptic-curve cryptographic FPGA processor.
Mukhtar, Naila, Mehrabi, Mohamad, Kong, Yinan and Anjum, Ashiq 2018. Machine-learning-based side-channel evaluation of elliptic-curve cryptographic FPGA processor. Applied Sciences. 9 (1), p. 64. https://doi.org/10.3390/app9010064
Providing traceability for neuroimaging analyses.
McClatchey, Richard, Branson, Andrew, Anjum, Ashiq, Bloodsworth, Peter, Habib, Irfan, Munir, Kamran, Shamdasani, Jetendr and Soomro, Kamran 2013. Providing traceability for neuroimaging analyses. International Journal of Medical Informatics.
CMS workflow execution using intelligent job scheduling and data access strategies.
Hasham, Khawar, Delgado Peris, Antonio, Anjum, Ashiq, Evans, Dave, Gowdy, Stephen, Hernandez, José M., Huedo, Eduardo, Hufnagel, Dirk, van Lingen, Frank, McClatchey, Richard and Metson, Simon 2011. CMS workflow execution using intelligent job scheduling and data access strategies. IEEE Transactions on Nuclear Science. https://doi.org/10.1109/TNS.2011.2146276
Context-aware service utilisation in the clouds and energy conservation.
Kiani, Saad Liaquat, Anjum, Ashiq, Antonopoulos, Nick and Knappmeyer, Michael 2012. Context-aware service utilisation in the clouds and energy conservation. Journal of Ambient Intelligence and Humanized Computing. https://doi.org/10.1007/s12652-012-0131-1
Exploiting in-memory systems for gnomic data analysis.
Shah, Zeeshan Ali, El-Kalioby, Mohamed, Faquih, Tariq, Shokrof, Moustafa, Subhani, Shazia, Alnakhli, Yasser, Aljafar, Hussain, Anjum, Ashiq and Abouelhoda, Mohamed 2018. Exploiting in-memory systems for gnomic data analysis. Springer. https://doi.org/10.1007/978-3-319-78723-7_35
Cloud-based video analytics using convolutional neural networks.
Yaseen, M., Anjum, Ashiq, Farid, Mohsen and Antonopoulos, Nick 2018. Cloud-based video analytics using convolutional neural networks. Software Practice and Experience. https://doi.org/10.1002/spe.2636
Deep learning hyper-parameter optimization for video analytics in clouds.
Yaseen, M., Anjum, Ashiq, Rana, Omer and Antonopoulos, Nikolaos 2018. Deep learning hyper-parameter optimization for video analytics in clouds. IEEE Transactions on Systems, Man, and Cybernetics. https://doi.org/10.1109/TSMC.2018.2840341
Edge enhanced deep learning system for large-scale video stream analytics.
Ali, Muhammad, Anjum, Ashiq, Yaseen, M. Usman, Zamani, A. Reza, Balouek-Thomert, Daniel, Rana, Omer and Parashar, Manish 2018. Edge enhanced deep learning system for large-scale video stream analytics. IEEE. https://doi.org/10.1109/CFEC.2018.8358733
Representing variant calling format as directed acyclic graphs to enable the use of cloud computing for efficient and cost effective genome analysis
Aizad, Sanna, Anjum, Ashiq and Sakellariou, Rizos 2017. Representing variant calling format as directed acyclic graphs to enable the use of cloud computing for efficient and cost effective genome analysis. IEEE. https://doi.org/10.1109/CCGRID.2017.116
Blockchain standards for compliance and trust
Anjum, Ashiq, Sporny, Manu and Sill, Alan 2017. Blockchain standards for compliance and trust. IEEE Cloud Computing. https://doi.org/10.1109/MCC.2017.3791019
Big data analytics in healthcare: A cloud based framework for generating insights
Anjum, Ashiq, Aizad, Sanna, Arshad, Bilal, Subhani, Moeez, Davies-Tagg, Dominic, Abdullah, Tariq and Antonopoulos, Nikolaos 2017. Big data analytics in healthcare: A cloud based framework for generating insights. in: Springer.
Clinical and genomics data integration using meta-dimensional approach
Subhani, Moeez, Anjum, Ashiq, Koop, Andreas and Antonopoulos, Nikolaos 2016. Clinical and genomics data integration using meta-dimensional approach. Association for Computing Machinery. https://doi.org/10.1145/2996890.3007896
Deadline constrained video analysis via in-transit computational environments
Zamani, Ali Reza, Zou, Mengsong, Diaz-Montes, Javier, Petri, Ioan, Rana, Omer, Anjum, Ashiq and Parashar, Manish 2017. Deadline constrained video analysis via in-transit computational environments. IEEE Transactions on Services Computing. https://doi.org/10.1109/TSC.2017.2653116
Data Intensive and Network Aware (DIANA) grid scheduling
McClatchey, Richard, Anjum, Ashiq, Stockinger, Heinz, Ali, Arshad, Willers, Ian and Thomas, Michael 2007. Data Intensive and Network Aware (DIANA) grid scheduling. Journal of Grid Computing. https://doi.org/10.1007/s10723-006-9059-z
Intelligent grid enabled services for neuroimaging analysis
McClatchey, Richard, Habib, Irfan, Anjum, Ashiq, Munir, Kamran, Branson, Andrew, Bloodsworth, Peter and Kiani, Saad Liaquat 2013. Intelligent grid enabled services for neuroimaging analysis. Neurocomputing. https://doi.org/10.1016/j.neucom.2013.01.042
Modeling and analysis of a deep learning pipeline for cloud based video analytics.
Yaseen, M., Anjum, Ashiq and Antonopoulos, Nikolaos 2017. Modeling and analysis of a deep learning pipeline for cloud based video analytics. https://doi.org/10.1145/3148055.3148081
Traffic monitoring using video analytics in clouds
Abdullah, Tariq, Anjum, Ashiq, Tariq, M. Fahim, Baltaci, Yusuf and Antonopoulos, Nikolaos 2014. Traffic monitoring using video analytics in clouds. IEEE. https://doi.org/10.1109/UCC.2014.12
Big-Data analytics and cloud computing: Theory, algorithms and applications
Hill, Richard, Trovati, Marcello, Liu, Lu, Anjum, Ashiq and Zhu, Shao Ying 2015. Big-Data analytics and cloud computing: Theory, algorithms and applications. Springer.
On the structure of periodic complex Horadam orbits
Bagdasar, Ovidiu, Larcombe, Peter J. and Anjum, Ashiq 2016. On the structure of periodic complex Horadam orbits. Carpathian Journal of Mathematics..
A cloud resource management model for the creation and orchestration of social communities
Ikram, Ahsan, Anjum, Ashiq and Bessis, Nik 2015. A cloud resource management model for the creation and orchestration of social communities. Simulation Modelling Practice and Theory. https://doi.org/10.1016/j.simpat.2014.05.003
Federated broker system for pervasive context provisioning
Kiani, Saad Liaquat, Anjum, Ashiq, Knappmeyer, Michael, Bessis, Nik and Antonopoulos, Nikolaos 2013. Federated broker system for pervasive context provisioning. Journal of Systems and Software. https://doi.org/10.1016/j.jss.2012.11.050
Adapting scientific workflow structures using multi-objective optimization strategies
Habib, Irfan, Anjum, Ashiq, Mcclatchey, Richard and Rana, Omer 2013. Adapting scientific workflow structures using multi-objective optimization strategies. ACM Transactions on Autonomous and Adaptive Systems. https://doi.org/10.1145/2451248.2451252
Video stream analysis in clouds: An object detection and classification framework for high performance video analytics
Anjum, Ashiq, Abdullah, Tariq, Tariq, M. Fahim, Baltaci, Yusuf and Antonopoulos, Nikolaos 2016. Video stream analysis in clouds: An object detection and classification framework for high performance video analytics. IEEE Transactions on Cloud Computing. https://doi.org/10.1109/TCC.2016.2517653
Towards cloud based big data analytics for smart future cities
Khan, Zaheer, Anjum, Ashiq, Tahir, Muhammad Atif and Soomro, Kamran Ahmed 2015. Towards cloud based big data analytics for smart future cities. Journal of Cloud Computing. https://doi.org/10.1186/s13677-015-0026-8
Spatial frequency based video stream analysis for object classification and recognition in clouds
Yaseen, M., Anjum, Ashiq and Antonopoulos, Nikolaos 2016. Spatial frequency based video stream analysis for object classification and recognition in clouds. IEEE.
High performance video processing in cloud data centres
Yaseen, M., Zafar, Muhammad Sarim, Anjum, Ashiq and Hill, Richard 2016. High performance video processing in cloud data centres. IEEE. https://doi.org/10.1109/SOSE.2016.56
An Inter-Cloud Meta-Scheduling (ICMS) simulation framework: architecture and evaluation
Sotiriadis, Stelios, Bessis, Nik, Anjum, Ashiq and Buyya, Rajkumar 2015. An Inter-Cloud Meta-Scheduling (ICMS) simulation framework: architecture and evaluation. IEEE Transactions on Services Computing. https://doi.org/10.1109/TSC.2015.2399312
Glueing grids and clouds together: a service-oriented approach
Anjum, Ashiq, Hill, Richard, McClatchey, Richard, Bessis, Nik and Branson, Andrew 2012. Glueing grids and clouds together: a service-oriented approach. International Journal of Web and Grid Services. https://doi.org/10.1504/IJWGS.2012.049169
Energy conservation in mobile devices and applications: a case for context parsing, processing and distribution in clouds
Kiani, Saad Liaquat, Anjum, Ashiq, Bessis, Nik, Hill, Richard and Knappmeyer, Michael 2013. Energy conservation in mobile devices and applications: a case for context parsing, processing and distribution in clouds. Mobile Information Systems.
Approaching the Internet of things (IoT): a modelling, analysis and abstraction framework
Ikram, Ahsan, Anjum, Ashiq, Hill, Richard, Antonopoulos, Nikolaos, Liu, Lu and Sotiriadis, Stelios 2013. Approaching the Internet of things (IoT): a modelling, analysis and abstraction framework. Concurrency and Computation: Practice and Experience. https://doi.org/10.1002/cpe.3131
Performance simulation of a context provisioning middleware based on empirical measurements
Reetz, Eike Steffen, Knappmeyer, Michael, Kiani, Saad Liaquat, Anjum, Ashiq, Bessis, Nik and Tönjes, Ralf 2012. Performance simulation of a context provisioning middleware based on empirical measurements. https://doi.org/10.1016/j.simpat.2012.03.002
Dot-base62x: building a compact and user-friendly text representation scheme of ipv6 addresses for cloud computing
Liu, Zhenxing, Liu, Lu, Hardy, J., Anjum, Ashiq, Hill, Richard and Antonopoulos, Nikolaos 2012. Dot-base62x: building a compact and user-friendly text representation scheme of ipv6 addresses for cloud computing. Journal of Cloud Computing: Advances, Systems and Applications. https://doi.org/10.1186/2192-113X-1-3