Alcohol addiction can lead to health and social problems. It can also affect people’s emotions. Emotion plays a key role in human communications. It is important to recognize the people’s emotions at the court and infer the association between the people’s emotions and the alcohol addiction. However, it is challenging to recognize people’s emotions efficiently in the courtroom. Furthermore, to the best of our knowledge, no existing work is about the association between alcohol addiction and people’s emotions at court. In this paper, we propose a deep learning framework for predicting people’s emotions based on sound perception, named ResCNN-SER. The proposed model combines several neural network-based components to extract the features of the speech signals and predict the emotions. The evaluation shows that the proposed model performs better than existing methods. By applying ResCNN-SER for emotion recognition based on people’s voices at court, we infer the association between alcohol addiction and the defendant’s emotion at court. Based on the sound source data from 54 trial records, we found that the defendants with alcohol addiction tend to get angry or fearful more easily at court comparing with defendants without alcohol addiction.