Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning

Stuti Jindal, Sanjay Singh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

Images are the easiest medium through which people can express their emotions on social networking sites. Social media users are increasingly using images and videos to express their opinions and share their experiences. Sentiment analysis of such large scale visual content can help better extract user sentiments toward events or topics, such as those in image tweets, so that prediction of sentiment from visual content is complementary to textual sentiment analysis. Significant progress has been made with this technology, however, there is little research focus on the picture sentiments. In this work, an image sentiment prediction framework is built with Convolutional Neural Networks (CNN). Specifically, this framework is pretrained on a large scale data for object recognition to further perform transfer learning. Extensive experiments were conducted on manually labeled Flickr image dataset. To make use of such labeled data, we employ a progressive strategy of domain specific fine tuning of the deep network. The results show that the proposed CNN training can achieve better performance in image sentiment analysis than competing networks.

Original languageEnglish
Title of host publicationProceedings - IEEE International Conference on Information Processing, ICIP 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages447-451
Number of pages5
ISBN (Electronic)9781467377584
DOIs
Publication statusPublished - 10-06-2016
Event2015 IEEE International Conference on Information Processing, ICIP 2015 - Pune, Maharashtra, India
Duration: 16-12-201519-12-2015

Conference

Conference2015 IEEE International Conference on Information Processing, ICIP 2015
CountryIndia
CityPune, Maharashtra
Period16-12-1519-12-15

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing

Fingerprint Dive into the research topics of 'Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning'. Together they form a unique fingerprint.

  • Cite this

    Jindal, S., & Singh, S. (2016). Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning. In Proceedings - IEEE International Conference on Information Processing, ICIP 2015 (pp. 447-451). [7489424] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INFOP.2015.7489424