Search Photos on Facebook, A new way describing photo contents and hit search.
News: Facebook AI updates now allow you to search any photo from Facebook by just describing its content and hit search. Usually if we are looking for some data on Facebook like user profile, pages or groups; we have to type a search query to match data for getting required results. This is different than searching the photos in which you are tagged or pictures that are labeled. Many times users forget to label a photo or add a description and it becomes difficult for them to search later. With Facebook’s new AI search, users just have to describe the contents of the photo e.g, “black shirt”, “water park” or “walking to..” etc., Facebook will identify the picture matching with your entered description.
“We’ve pushed computer vision to the next stage with the goal of understanding images at the pixel level. This helps our systems do things like recognize what’s in an image, what type of scene it is, if it’s a well-known landmark, and so on. This, in turn, helps us better describe photos for the visually impaired and provide better search results for posts with images and videos.More than 200 visual models have been trained and deployed on Lumos by dozens of teams, for purposes such as objectionable-content detection, spam fighting, and automatic image captioning. The applications are wide-reaching, with everyone from our Connectivity Labs to Search to the Accessibility team using the technology.”
How Facebook is achieving this?
Lumos a Facebook’s platform that is specially designed for image and video content reading. When photos are uploaded, this platform not only stores them on Facebook but also memorize their contents with deep machine learning and image understanding algorithm e.g, where the photo was taken, what are people doing in that, what colors etc. This is mainly helpful reading visual appearance of contents.
Explaining more, Facebook said; This beginning of visual search and may bring more like this for video content in coming years.