c-SNE: Emotion-based Deep Cross-modal Retrieval by using Stochastic Neighbor Embedding

Cross-modal retrieval based on subjective information aims to enable flexible media retrieval services, such as allowing users to specify, for example, a text or/and an image to search audio clips. The resulting audio clips should have an impression similar to the specified text/image. Existing methods focus on building cross-media cross-modal relationships using objective information from …

Large-scale Estimation of People’s Moods using Web Search Queries and Mobile Sensor Data

Focusing on the emotional state which is closely related to the rationality states, we constructed machine learning models to estimate the emotional state (mood score) from the user’s search keywords by combining (1) values obtained from various sensors on smartphones, (2) self-reported subjective data obtained through the Experience Sampling Method (ESM), and (3) search keywords …

Estimation of Personality Traits using News Browsing Logs

Although the number of articles published on news portal sites has been increasing in recent years, there is a growing demand for appropriate news recommendations to improve the user experience. In this paper, we focus on user’s personality traits and propose a method to estimate personality traits only from news browsing logs collected from actual …

Attention Management: AI Estimates Optimal Timing for Push Notifications

In today’s ubiquitous computing environment where users carry, manipulate, and interact with an increasing number of networked devices, applications and web services, human attention is the new bottleneck in computing. It is therefore important to minimize a user’s mental effort due to notifications, especially in situations where users are mobile and using multiple wearable and …

Detecting Emotional Eating with Mobile Computing

Eating behavior influenced by stress and emotional changes is called emotional eating. The reasons of emotional eating are autonomic nervous system and hormone imbalance due to stress and lifestyle disturbance. Therefore, it is possible to predict the occurrence of emotional eating by continuously observing and analyzing the activity level of the autonomic nervous system and …