c-SNE: Emotion-based Deep Cross-modal Retrieval by using Stochastic Neighbor Embedding

Cross-modal retrieval based on subjective information aims to enable flexible media retrieval services, such as allowing users to specify, for example, a text or/and an image to search audio clips. The resulting audio clips should have an impression similar to the specified text/image. Existing methods focus on building cross-media cross-modal relationships using objective information from …

Self-Control Methods for SNS Use Using Discomfort Caused by Reduced Usability

With the spread of social networking services, excessive use of these services has become a problem. It is also known as SNS addictions and cause various adverse physical and mental health effects. Restricting the use of SNS has become a very difficult task because various reward systems incorporated in SNS and the high convenience of …

Large-scale Estimation of People’s Moods using Web Search Queries and Mobile Sensor Data

Focusing on the emotional state which is closely related to the rationality states, we constructed machine learning models to estimate the emotional state (mood score) from the user’s search keywords by combining (1) values obtained from various sensors on smartphones, (2) self-reported subjective data obtained through the Experience Sampling Method (ESM), and (3) search keywords …

Estimation of Personality Traits using News Browsing Logs

Although the number of articles published on news portal sites has been increasing in recent years, there is a growing demand for appropriate news recommendations to improve the user experience. In this paper, we focus on user’s personality traits and propose a method to estimate personality traits only from news browsing logs collected from actual …

Attention Management: AI Estimates Optimal Timing for Push Notifications

In today’s ubiquitous computing environment where users carry, manipulate, and interact with an increasing number of networked devices, applications and web services, human attention is the new bottleneck in computing. It is therefore important to minimize a user’s mental effort due to notifications, especially in situations where users are mobile and using multiple wearable and …

Detecting Emotional Eating with Mobile Computing

Eating behavior influenced by stress and emotional changes is called emotional eating. The reasons of emotional eating are autonomic nervous system and hormone imbalance due to stress and lifestyle disturbance. Therefore, it is possible to predict the occurrence of emotional eating by continuously observing and analyzing the activity level of the autonomic nervous system and …

SmileWave: Investigating the Occurrence of Selfie-based Emotional Contagion over Social Network

Happiness is obviously one of the most fundamental essence that affects many aspects of our lives.Past research found that happiness of one person affect that of other people. What occurs under this propagation of emotion is called “emotional contagion”, a phenomenon wherein through perception, people experience the same emotion expressed by someone when communicating with …

SFC GO: A system to Support Building Connections between Students in Online Physical Education Classes

Due to the spread of COVID-19, all classes in the spring semester of 2020 at Keio University, including physical education (PE), was held online. Even though “Physical Education 1” which all first year student have to take, is generally an opportunity for classmates to communicate with each other through physical exercise. Therefore it was necessary …

Research Subject 1: Interaction of Awareness

Nakazawa Group There are moments when people need information. For example, when an action is needed to escape a crisis, or when an action is needed to maintain health, or when an action to have fun. People may or may not know that such behaviors exist. To address these issues, researchers specializing in information systems, …