Semantic segmentation of UAV aerial videos using convolutional neural networks

S. Girisha, M. M. Manohara Pai, Ujjwal Verma, Radhika M. Pai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Semantic segmentation of complex aerial videos enables a better understanding of scene and context. This enhances the performance of automated video processing techniques like anomaly detection, object detection, event detection and other applications. But, there is a limited study of semantic segmentation in aerial videos due to non-availability of the relevant dataset. To address this, an aerial video dataset is captured using DJI Phantom 3 professional drone and is annotated manually. In addition, the proposed research work investigates the performance of semantic segmentation algorithms for aerial videos implemented using Fully Convolution Networks (FCN) and U-net architectures. In this study, two classes (greenery, road) are considered for semantic segmentation. It is observed that both architectures perform competitively on the aerial videos of Unmanned Aerial Vehicle (UAV) with a pixel accuracy of 89.7% and 87.31% respectively.

Original languageEnglish
Title of host publicationProceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages21-27
Number of pages7
ISBN (Electronic)9781728114880
DOIs
Publication statusPublished - 06-2019
Event2nd IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019 - Cagliari, Sardinia, Italy
Duration: 03-06-201905-06-2019

Publication series

NameProceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019

Conference

Conference2nd IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019
CountryItaly
CityCagliari, Sardinia
Period03-06-1905-06-19

Fingerprint

Unmanned aerial vehicles (UAV)
Semantics
Antennas
Neural networks
Convolution
Pixels
Segmentation
Processing

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Information Systems and Management

Cite this

Girisha, S., Manohara Pai, M. M., Verma, U., & Pai, R. M. (2019). Semantic segmentation of UAV aerial videos using convolutional neural networks. In Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019 (pp. 21-27). [8791701] (Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AIKE.2019.00012
Girisha, S. ; Manohara Pai, M. M. ; Verma, Ujjwal ; Pai, Radhika M. / Semantic segmentation of UAV aerial videos using convolutional neural networks. Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 21-27 (Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019).
@inproceedings{8b29b3bf4c4641339fe33eb9f6dfdbfb,
title = "Semantic segmentation of UAV aerial videos using convolutional neural networks",
abstract = "Semantic segmentation of complex aerial videos enables a better understanding of scene and context. This enhances the performance of automated video processing techniques like anomaly detection, object detection, event detection and other applications. But, there is a limited study of semantic segmentation in aerial videos due to non-availability of the relevant dataset. To address this, an aerial video dataset is captured using DJI Phantom 3 professional drone and is annotated manually. In addition, the proposed research work investigates the performance of semantic segmentation algorithms for aerial videos implemented using Fully Convolution Networks (FCN) and U-net architectures. In this study, two classes (greenery, road) are considered for semantic segmentation. It is observed that both architectures perform competitively on the aerial videos of Unmanned Aerial Vehicle (UAV) with a pixel accuracy of 89.7{\%} and 87.31{\%} respectively.",
author = "S. Girisha and {Manohara Pai}, {M. M.} and Ujjwal Verma and Pai, {Radhika M.}",
year = "2019",
month = "6",
doi = "10.1109/AIKE.2019.00012",
language = "English",
series = "Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "21--27",
booktitle = "Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019",
address = "United States",

}

Girisha, S, Manohara Pai, MM, Verma, U & Pai, RM 2019, Semantic segmentation of UAV aerial videos using convolutional neural networks. in Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019., 8791701, Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019, Institute of Electrical and Electronics Engineers Inc., pp. 21-27, 2nd IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019, Cagliari, Sardinia, Italy, 03-06-19. https://doi.org/10.1109/AIKE.2019.00012

Semantic segmentation of UAV aerial videos using convolutional neural networks. / Girisha, S.; Manohara Pai, M. M.; Verma, Ujjwal; Pai, Radhika M.

Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 21-27 8791701 (Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Semantic segmentation of UAV aerial videos using convolutional neural networks

AU - Girisha, S.

AU - Manohara Pai, M. M.

AU - Verma, Ujjwal

AU - Pai, Radhika M.

PY - 2019/6

Y1 - 2019/6

N2 - Semantic segmentation of complex aerial videos enables a better understanding of scene and context. This enhances the performance of automated video processing techniques like anomaly detection, object detection, event detection and other applications. But, there is a limited study of semantic segmentation in aerial videos due to non-availability of the relevant dataset. To address this, an aerial video dataset is captured using DJI Phantom 3 professional drone and is annotated manually. In addition, the proposed research work investigates the performance of semantic segmentation algorithms for aerial videos implemented using Fully Convolution Networks (FCN) and U-net architectures. In this study, two classes (greenery, road) are considered for semantic segmentation. It is observed that both architectures perform competitively on the aerial videos of Unmanned Aerial Vehicle (UAV) with a pixel accuracy of 89.7% and 87.31% respectively.

AB - Semantic segmentation of complex aerial videos enables a better understanding of scene and context. This enhances the performance of automated video processing techniques like anomaly detection, object detection, event detection and other applications. But, there is a limited study of semantic segmentation in aerial videos due to non-availability of the relevant dataset. To address this, an aerial video dataset is captured using DJI Phantom 3 professional drone and is annotated manually. In addition, the proposed research work investigates the performance of semantic segmentation algorithms for aerial videos implemented using Fully Convolution Networks (FCN) and U-net architectures. In this study, two classes (greenery, road) are considered for semantic segmentation. It is observed that both architectures perform competitively on the aerial videos of Unmanned Aerial Vehicle (UAV) with a pixel accuracy of 89.7% and 87.31% respectively.

UR - http://www.scopus.com/inward/record.url?scp=85071441967&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071441967&partnerID=8YFLogxK

U2 - 10.1109/AIKE.2019.00012

DO - 10.1109/AIKE.2019.00012

M3 - Conference contribution

AN - SCOPUS:85071441967

T3 - Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019

SP - 21

EP - 27

BT - Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Girisha S, Manohara Pai MM, Verma U, Pai RM. Semantic segmentation of UAV aerial videos using convolutional neural networks. In Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 21-27. 8791701. (Proceedings - IEEE 2nd International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2019). https://doi.org/10.1109/AIKE.2019.00012