A real-time object tracking approach is important in video surveillance. Security and surveillance systemare main problem’s which disturbs the industry, shops, hospitals and other places. The proposed algorithm is entirelybased on color concept of an object. It simple and robust method which is effective in video surveillance system. Hue,saturation and value property based on features are used to track the object in real time. We implemented the proposedalgorithm on Raspberry Pi board using OpenCV on Linux background. It is a novel and efficient object trackingmethod which solve the tracking problems and removed the drift problem.