This paper presents a novel technique for colour image annotation based on neural networks and fuzzy logic. Neural network is proposed for classifying the images based on their contents and fuzzy logic is proposed for interpreting the content of an image in terms of natural language. One of the main aspects of this research is to avoid re-training of the neural networks by training the content of the image. Neural network is not trained on database of images; therefore image can be added or deleted from image database without affecting the training. The proposed hybrid technique is tested on real world colour image dataset and promising results are obtained. © 2012 IEEE.