Similarity measurement for describe user images in social media

author

Abstract:

Online social networks like Instagram are places for communication. Also, these media produce rich metadata which are useful for further analysis in many fields including health and cognitive science. Many researchers are using these metadata like hashtags, images, etc. to detect patterns of user activities. However, there are several serious ambiguities like how much reliable are these information. In this paper, we attempt to answer two main questions. Firstly, are image hashtags directly related to image concepts?  Can image concepts being predicted using machine learning models? The results of our analysis based on 105000 images on Instagram show that user hashtags are hardly related to image concepts (only 10%of test cases). Second contribution of this paper is showing the suggested pre-trained model predicate image concepts much better (more than 50% of test cases) than user hashtags. Therefore, it is strongly recommended to social media researchers not to rely only on the user hashtags as a label of images or as a signal of information for their study. Alternatively, they can use machine learning methods line deep convolutional neural network model to describe images to extract more related contents. As a proof of concept, some results on food images are studied. We use few similarity measurements to compare result of human and deep convolutional neural network.  These analysis is important because food is an important society health field.

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

Characterizing User Connections in Social Media through User-Shared Images

Billions of user images, which are shared on social media, can be widely accessible by others due to their sharing nature. Using machine-generated labels to annotate those images is a reliable for user connections discovery on social networks. The machine-generated labels are obtained from encoded vectors using up-to-date image processing and computer vision techniques, such as convolution neur...

full text

Similarity Measurement Between Images

Experimental results of applying two similarity measurements, Euclidean distance and chord distanc, to test a set of six Brodatz’s textures are reported. Experiments show that in addition to feature extraction, A similarity measurement between images should be simultaneously considered, We also review some other similarity measurements.

full text

NLE@MediaEval'17: Combining Cross-Media Similarity and Embeddings for Retrieving Diverse Social Images

In this working note we briefly describe the methods we used in the MediaEval17, Retrieving Diverse Social Images Task and give details on the submitted runs.

full text

Unsupervised Sentiment Analysis for Social Media Images

Recently text-based sentiment prediction has been extensively studied, while image-centric sentiment analysis receives much less attention. In this paper, we study the problem of understanding human sentiments from large-scale social media images, considering both visual content and contextual information, such as comments on the images, captions, etc. The challenge of this problem lies in the ...

full text

Semantics of User Interaction in Social Media

In ubiquitous and social web applications, there are different user traces, for example, produced explicitly by “tweeting” via twitter or implicitly, when the corresponding activities are logged within the application’s internal databases and log files. For each of these systems, the sets of user interactions can be mapped to a network, with links between users according to their observed inter...

full text

User-Generated Content in Social Media

This report documents the program and the outcomes of Dagstuhl Seminar 17301 “User-Generated Content in Social Media”. Social media have a profound impact on individuals, businesses, and society. As users post vast amounts of text and multimedia content every minute, the analysis of this user generated content (UGC) can offer insights to individual and societal concerns and could be beneficial ...

full text

My Resources

Save resource for easier access later

Save to my library Already added to my library

{@ msg_add @}


Journal title

volume 8  issue 1

pages  291- 299

publication date 2017-06-12

By following a journal you will be notified via email when a new issue of this journal is published.

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023