damage assessment in military operations using deep learning and image processing

Document Type : Persian Original Article

Authors

1 researcher, institute for the study of war, command and staff university

2 researcher ,Institute for the Study of War, command and staff university

Abstract

Object detection plays an important role in the analysis of images of battle scenes, especially damage assessment. In this article, machine vision techniques along with deep learning and digital image processing are used to achieve a powerful method with maximum speed and accuracy to detect objects on the battlefield and also estimate the damage. To object detection, the features and parameters of images are extracted by convolutional neural networks and used in neural network learning. The structural similarity criteria, mean square error, and threshold method were used to assess the damage and to measure the similarity and changes in the images which received before and after military operations. Finally, for validating the method, samples of the battle scenes images have been investigated, and object detection and damage assessment has been executed on them.

Keywords


  • L. Poole and A. K. Mackworth, “Artificial intelligence: Foundations of computational agents,” Cambridge University Press, vol. 9780521519, 2010.
  • دژ پسند, فرهاد, و حمیدرضا رئوفی، “اقتصاد ایران در دوران جنگ تحمیلی.” فصلنامه تخصصی مطالعات دفاع مقدس، صفحه 150-147، 1387.
  • P. Papageorgiou and M. Oren, “A general framework for object detection,” Comput Vision, IEEE Int. Conf, vol. 0, no. pp. 555-562, 1998.
  • Cortes, V.Vapnik, “Support Vector Networks,” Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
  • Torralba, A. Oliva, and W. T. Freeman, “Object recognition by scene alignment,” J. Vis, vol. 3, pp. 196–204, 2010.
  • Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” IEEE Trans. Pattern Anal. Mach. Intell, vol. 39, no. 6, pp. 1440-1448, 2017.
  • Liu et al., “SSD: Single shot multibox detector,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 9905 LNCS, pp. 21-37, 2016.
  • De-yun, Z. Li-na, Z. Kai, and Z. Kun, “Battle damage assessment with change detection of SAR images,” Control Conf. (CCC), 34th Chinese,  pp. 193–197, 2015.
  • Chen-han and H. Jian, “The application of Bayesian network in battle damage assessment,” Softw. Eng. Serv. Sci, pp. 529-532, 2014.
  • Paul, “Probability models for battle damage assessment (simple shoot-look-shoot and beyond),” Reports and Technical Reports, Monterey, California, pp. 1-26, 1997.
  • K. Mehraa, “Automatic Battle Damage Assessment based on Laser Radar Imagery,”  vol. 3707, no., pp. 210-221, 1999.
  • Lecun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based learning applied to document recognition," in Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998
  • Rawat, W. and Wang, Z., “Deep convolutional neural networks for image classification: A comprehensive review”. Neural computation, 29(9), pp.2352–2449, 2017.
  • Krizhevsky, I. Sutskever, and H. Geoffrey E, “ImageNet Classification with Deep Convolutional Neural Networks,” Adv. Neural Inf. Process, Syst. 25, pp. 1-9, 2012.
  • Szegedy, S. Reed, P. Sermanet, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-12, 2014.
  • Howard et al., “MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications,” Computer Vision and Pattern Recognition, pp. 1-9, 2017.
  • Lin TY. et al. “Microsoft COCO: Common Objects in Context. “In: Fleet D., Pajdla T., Schiele B., Tuytelaars T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8693, 2014.
  • Goodfellow, Ian; Bengio, Yoshua; Courville, Aaron, "6.2.2.3 Softmax Units for Multinoulli Output Distributions". Deep Learning. MIT Press. pp. 180–184. ISBN 978-0-26203561-3. 2016.
  • Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process,  vol. 13, no. 4, pp. 600-612, 2004.