The camera in the mobile app and browser “Yandex” received a new mode “Text”, which allows you to recognize the words in the frame.
The user is enough point the camera at any text – it can be saved, copied, sent to a messenger or to a Yandex search. 47 languages are supported.
Neural networks are used for recognition. One of them finds areas with text characters, and the second one recognizes them by analyzing the context: letter styles, neighbors, and words. A similar technology is used for text recognition in the “Translation” mode.
Such technologies help to search for goods, translate text, scan documents and recognize objects. The feature is already available on iOS and Android.