Multimodal Visual Search using CBIR system on Mobile Device

Abstract: In this paper, it describe the content based image retrieval system based on three major types of visual information color, texture and shape, and their distances to the origin in a three dimensional space for the retrieval. It also describes a multimodal interactive image search system using mobile devices. This system useful for users who already have pictures in their minds but have no precise descriptions or names to address them. By describing it using speech and then refining the recognized query by interactively composing a visual query using exemplary images, the user can easily find the desired images through a few natural multimodal interactions with their mobile device.

Keywords: Multimodal visual search, interactive search, mobile device, Image Retrieval, Color Histogram.