Method and Apparatus for Image Annotation and Multimodal Image Retrieval

Description:

Novel method improves content-Based Image Retrieval (CBIR) using probabilistic semantic model 

 

Background:

Efficient access to multimedia database content requires the ability to search and organize multimedia information. In one form of traditional image retrieval, users have to provide examples of images that they are looking for. Similar images are found based on the match of image features. Here we discuss a method to improve image annotation and retrieval

 

 

 Technology Overview:  

The technology is based on a probabilistic semantic model in which visual features and textual words are connected via a hidden layer, which constitutes the semantic concepts to be discovered to explicitly exploit the synergy between the two modalities. The association of visual features and textual words is determined in a Bayesian framework such that the confidence of the association can be provided. In the proposed probabilistic model, a hidden concept layer which connects the visual feature and the word layer is discovered by fitting a generative model to the training image and annotation words. An Expectation-Maximization (EM) based iterative learning procedure is developed to determine the conditional probabilities of the visual features and the textual words given a hidden concept class. Based on the discovered hidden concept layer and the corresponding conditional probabilities, the image annotation and the text-to-image retrieval are performed using the Bayesian framework. 

 

https://binghamton.technologypublisher.com/files/sites/rb209.jpg

https://pixabay.com/illustrations/hand-magnifying-glass-earth-globe-1248053/

 

 Advantages:  

  • Much better image retrieval performance
  • Better image annotation performance

 

 

Intellectual Property Summary:

U.S. 7,814,040

U.S. 8,204,842

U.S. 9,280,562

 

Additional Information:  

Inventor profile 

 

Patent Information:
For Information, Contact:
Scott Moser
Binghamton University
smoser@binghamton.edu
Inventors:
Ruofei Zhang
Zhongfei Zhang
Keywords:
#SUNYresearch
Technologies
© 2024. All Rights Reserved. Powered by Inteum