Today’s world requires maximum computing speed. The progress that the CPU has achieved over the past 2 decades, though tremendous, has now reached a point of stagnation. To overcome this, a new highly parallel and multithreading processor optimized for high degree of computation was introduced, which was named as the Graphics Processing Unit (GPU) by NVIDIA or the Visual Processing Unit (VPU). A Graphics Processing Unit (GPU) is a single-chip processor primarily used to manage and boost the performance of video and graphics. This paper talks about the reasons for choosing GPU to accelerate the computation. This paper also states where GPU will work more efficiently than the CPU