Posted by Thomas Ezan – Sr Developer Relation Engineer (@lethargicpanda)
We’re excited to announce Gaze Hyperlink because the winner of the Greatest Android App for our Gemini API Developer Competitors!
This modern app demonstrates the potential of the Gemini API in offering a communication system for people with Amyotrophic lateral sclerosis (ALS) who develop extreme motor and verbal disabilities, enabling them to kind sentences with solely their eyes.
About Gaze Hyperlink
Gaze Hyperlink makes use of Google’s Gemini 1.5 Flash mannequin to foretell the consumer’s meant sentence based mostly on a couple of key phrases and the context of the dialog.
For instance if the context is “Is the room temperature okay?” and the consumer replies “sizzling AC two” the app will leverage Gemini to generate the total sentence “I’m sizzling, are you able to flip the AC down by two levels?”.
The Gaze Hyperlink staff took benefit of Gemini 1.5 Flash multilingual capabilities to let the app generate sentences in English, Spanish and Chinese language, the three languages at present supported by the app.
We have been actually impressed by the Gaze Hyperlink app. The staff used the Gemini API mixed with ML Package Face Detection to empower people with ALS offering them with a robust communication system that’s each accessible and inexpensive.
With Gemini 1.5 Flash at present supporting 38 languages, it’s potential for Gaze Hyperlink so as to add assist for extra languages sooner or later. As well as, the mannequin’s multimodal talents may allow the staff to reinforce the consumer expertise by integrating picture, audio and video to enhance the context of the dialog.
Construct with the Gemini API
The results of the mixing of the Gemini API in Gaze Hyperlink is inspiring. In case you are engaged on an Android app at the moment, we encourage you to be taught in regards to the Gemini API capabilities to see how one can efficiently add generative AI to your app and delight your customers.
To get began, go to the Android AI documentation!