In this paper, we have done an assessment to evaluate the efficiency of different feature descriptor algorithms like Local Binary Pattern (LBP), Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF) and Oriented FAST and Rotated BRIEF (ORB) on gender classification problem. The evaluation is done with and without using the feature descriptors and the results are compared to get a better understanding of the algorithms. Experiments are carried out on CAS-PEAL FRONTAL database. © 2019 IEEE.