TY - GEN
T1 - A MULTI-SCALE CONTENT-INSENSITIVE FUSION CNN FOR SOURCE SOCIAL NETWORK IDENTIFICATION
AU - Manisha,
AU - Li, Chang Tsun
AU - Kotegar, Karunakar A.
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Identification of source social networks of images based on the traces left on images by such platforms is a crucial task in image forensics. The existing techniques provide successful solutions to such a problem. However, we show that the state-of-the-art techniques are adversely affected due to the leaking side-channel information from scene details that convolutional neural networks (CNNs) are prone to exploit. Thus, highly correlated scene details in the training and test sets lead to overestimation of the performance. To address this problem, we develop a data-driven system by parallelizing three CNNs having kernels with different sizes that benefit from learning more relevant forensic traces making the model less susceptible to scene content. The experimental results achieved by the proposed model either trained on images with or without scene overlap show that there is no influence of scene content in the feature learning of the proposed method.
AB - Identification of source social networks of images based on the traces left on images by such platforms is a crucial task in image forensics. The existing techniques provide successful solutions to such a problem. However, we show that the state-of-the-art techniques are adversely affected due to the leaking side-channel information from scene details that convolutional neural networks (CNNs) are prone to exploit. Thus, highly correlated scene details in the training and test sets lead to overestimation of the performance. To address this problem, we develop a data-driven system by parallelizing three CNNs having kernels with different sizes that benefit from learning more relevant forensic traces making the model less susceptible to scene content. The experimental results achieved by the proposed model either trained on images with or without scene overlap show that there is no influence of scene content in the feature learning of the proposed method.
UR - http://www.scopus.com/inward/record.url?scp=85146643145&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85146643145&partnerID=8YFLogxK
U2 - 10.1109/ICIP46576.2022.9897711
DO - 10.1109/ICIP46576.2022.9897711
M3 - Conference contribution
AN - SCOPUS:85146643145
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 2981
EP - 2985
BT - 2022 IEEE International Conference on Image Processing, ICIP 2022 - Proceedings
PB - IEEE Computer Society
T2 - 29th IEEE International Conference on Image Processing, ICIP 2022
Y2 - 16 October 2022 through 19 October 2022
ER -