Advance trend in research is emotion recognition. Emotion is nothing but a strong feeling deriving from one's circumstances, mood, or relationships with others. Research has been done on emotion recognition from face, images, speech, audio, video, text etc. using machine learning approach. Here showing various types of algorithm, tools and techniques are being used for recognition of emotion through various aspects. Machine learning algorithms are mostly used in the process of emotion recognition. Deep learning algorithm is an advanced machine learning approach used in research field of emotion recognition. In this paper we are discussing various deep learning algorithms used for emotion recognition from various aspects of human. © 2017 IEEE.