A MULTI-SCALE CONTENT-INSENSITIVE FUSION CNN FOR SOURCE SOCIAL NETWORK IDENTIFICATION

Manisha, Chang Tsun Li, Karunakar A. Kotegar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Identification of source social networks of images based on the traces left on images by such platforms is a crucial task in image forensics. The existing techniques provide successful solutions to such a problem. However, we show that the state-of-the-art techniques are adversely affected due to the leaking side-channel information from scene details that convolutional neural networks (CNNs) are prone to exploit. Thus, highly correlated scene details in the training and test sets lead to overestimation of the performance. To address this problem, we develop a data-driven system by parallelizing three CNNs having kernels with different sizes that benefit from learning more relevant forensic traces making the model less susceptible to scene content. The experimental results achieved by the proposed model either trained on images with or without scene overlap show that there is no influence of scene content in the feature learning of the proposed method.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Image Processing, ICIP 2022 - Proceedings
PublisherIEEE Computer Society
Pages2981-2985
Number of pages5
ISBN (Electronic)9781665496209
DOIs
Publication statusPublished - 2022
Event29th IEEE International Conference on Image Processing, ICIP 2022 - Bordeaux, France
Duration: 16-10-202219-10-2022

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference29th IEEE International Conference on Image Processing, ICIP 2022
Country/TerritoryFrance
CityBordeaux
Period16-10-2219-10-22

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'A MULTI-SCALE CONTENT-INSENSITIVE FUSION CNN FOR SOURCE SOCIAL NETWORK IDENTIFICATION'. Together they form a unique fingerprint.

Cite this