c-SNE: Emotion-based Deep Cross-modal Retrieval by using Stochastic Neighbor Embedding

Cross-modal retrieval based on subjective information aims to enable flexible media retrieval services, such as allowing users to specify, for example, a text or/and an image to search audio clips. The resulting audio clips should have an impression similar to the specified text/image. Existing methods focus on building cross-media cross-modal relationships using objective information from …

Large-scale Estimation of People’s Moods using Web Search Queries and Mobile Sensor Data

Focusing on the emotional state which is closely related to the rationality states, we constructed machine learning models to estimate the emotional state (mood score) from the user’s search keywords by combining (1) values obtained from various sensors on smartphones, (2) self-reported subjective data obtained through the Experience Sampling Method (ESM), and (3) search keywords …