Crowd Behavior Analysis and Prediction using the Feature Fusion Framework

Authors

  • Manu Yadakere Murthygowda Adichunchanagiri University. BGS Institute of Technology, Department of Research and Development (R&D). Karnataka, India Author https://orcid.org/0000-0002-0308-2668
  • Ravikumar Guralamata Krishnegowda Adichunchanagiri University. BGS Institute of Technology, Department of Research and Development (R&D). Karnataka, India. Author https://orcid.org/0000-0002-0171-4609
  • Shashikala Salekoppalu Venkataramu Adichunchanagiri University. BGS Institute of Technology, Department Of Computer Science and Engineering (CS&E). Karnataka, India Author https://orcid.org/0000-0003-4543-0824

DOI:

https://doi.org/10.56294/saludcyt2022251

Keywords:

Crowd Behaviour Analysis, Multi-level Feature Fusion and Surveillance

Abstract

The increasing number of people is a major cause of disasters that occur due to overcrowding. The gatherings of crowds in public places are a source of panic, which results in disaster. An analytical study was performed on crowd management. This is highly essential for the design of a well-planned public space, the possibility of surveillance in every area, and transportation systems. The disasters that occur due to uncontrollable crowd behaviour involve loss of property, fatalities, or casualties. To avoid this, the crowd's behaviour was analysed. A MFF (multi-level feature fusion) framework was designed in this paper to predict behaviour.  The first level of multi-level feature fusion employs motion and appearance, the second level employs spatial connections, and the third level employs temporal features. The combination of these characteristics aids in the exploitation of crowd behaviour.  Furthermore, MFF was evaluated considering the web dataset, considering accuracy, precision, and recall as parameters. Comparative analysis was carried out with various existing methodologies with an accuracy of above 99 %.

References

1. Helbing D, Mukerji P. Crowd disasters as systemic failures: Analysis of the love parade disaster. EPJ Data Sci. 2012;1(1):7. http://doi.org/10.1140/epjds7.

2. Shao J, Loy CC, Kang K, Wang X. Slicing convolutional neural network for crowd video understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2016 Jun 26-30; Las Vegas, NV, USA. IEEE; 2016. p. 5620-5628. http://doi.org/10.1109/CVPR.2016.606.

3. Wang Q, Chen M, Nie F, Li X. Detecting coherent groups in crowd scenes by multiview clustering. IEEE Trans Pattern Anal Mach Intell. 2020;42(1):46-58. http://doi.org/10.1109/TPAMI.2018.2875002.

4. Deng C, Kang X, Zhu Z, Wu S. Behavior recognition based on category subspace in crowded videos. IEEE Access. 2020;8:222599-222610. http://doi.org/10.1109/ACCESS.2020.3043412.

5. Aljaloud AS, Ullah H. IA-SSLM: Irregularity-Aware Semi-Supervised Deep Learning Model for Analyzing Unusual Events in Crowds. IEEE Access. 2021;9:73327-73334. http://doi.org/10.1109/ACCESS.2021.3081050.

6. Direkoglu C. Abnormal crowd behavior detection using motion information images and convolutional neural networks. IEEE Access. 2020;8:80408-80416. http://doi.org/10.1109/ACCESS.2020.2990355.

7. Xu M, Li C, Lv P, Chen W, Deng Z, Zhou B, Manocha D. Emotion-based crowd simulation model based on physical strength consumption for emergency scenarios. IEEE Trans Intell Transp Syst. 2020;1-15. http://doi.org/10.1109/TITS.2020.3000607.

8. Zhu F, Wang X, Yu N. Crowd tracking with dynamic evolution of group structures. In: Proceedings of the European Conference on Computer Vision (ECCV); 2014 Sep 6-12; Zurich, Switzerland. Springer; 2014. p. 139-154.

9. Güler MS, Department of Information Systems. Automated crowd behavior analysis for video surveillance applications [master's thesis]. Istanbul, Turkey: Bogazici University; 2012. p. 73.

10. Zhou Y, Lau BPL, Koh Z, Yuen C, Ng BKK. Understanding Crowd Behaviors in a Social Event by Passive WiFi Sensing and Data Mining. IEEE Internet of Things Journal. 2020;7(5):4442-4454. http://doi.org/10.1109/JIOT.2020.2972062.

11. Aljaloud AS, Ullah H. IA-SSLM: Irregularity-Aware Semi-Supervised Deep Learning Model for Analyzing Unusual Events in Crowds. IEEE Access. 2021;9:73327-73334. http://doi.org/10.1109/ACCESS.2021.3081050.

12. Fradi H, Luvison B, Pham QC. Crowd Behavior Analysis Using Local Mid-Level Visual Descriptors. IEEE Transactions on Circuits and Systems for Video Technology. 2017;27(3):589-602.

13. Zagoruyko S, Komodakis N. Wide residual networks. arXiv preprint arXiv:1605.07146. 2016. https://doi.org/10.48550/arXiv.1605.07146.

14. Varghese E, Thampi SM, Berretti S. A Psychologically Inspired Fuzzy Cognitive Deep Learning Framework to Predict Crowd Behavior. IEEE Transactions on Affective Computing. http://doi.org/10.1109/TAFFC.2020.2987021.

15. Mondal S, Roy A, Mandal S. A supervised trajectory anomaly detection using velocity and path deviation. In: Proceedings of International Conference on Frontiers in Computing and Systems. Springer; 2021. p. 777-784.

Downloads

Published

2022-12-31

How to Cite

1.
Murthygowda MY, Guralamata Krishnegowda R, Salekoppalu Venkataramu S. Crowd Behavior Analysis and Prediction using the Feature Fusion Framework. Salud, Ciencia y Tecnología [Internet]. 2022 Dec. 31 [cited 2024 Nov. 21];2:251. Available from: https://sct.ageditor.ar/index.php/sct/article/view/45