AI POWER IN EYE
Soundhound is giving AI the power of eye sight.An industry leader in voice assistants, SoundHound AI, is now evaluating its technology. Imagine asking your automobile, “What’s that building over there?” as you pass a landmark and receiving an immediate response without taking out your phone. SoundHound AI is developing that. SoundHound’s new system, Vision AI, integrates sound and vision to provide a more intelligent and organic way to engage with technology. The goal is to imitate human behavior, which involves more than just listening; it also involves observing the gestures and eye movements of others.
SoundHound aims to improve the cumbersome and frequently annoying experience we have with many of today’s smart products by introducing this same contextual expertise to AI. The startup is focusing on real-world applications where this combination of senses might have a significant impact, such as on a factory floor, in your next car, or at the drive-thru of a restaurant. “At SoundHound, we think the future of AI isn’t just multimodal—it’s deeply integrated, responsive, and built for real-world impact,” stated Keyvan Mohajer, CEO of SoundHound AI. “With Vision AI, we’re expanding our leadership in voice and conversational AI to reimagine how people engage with business-provided and utilized goods and services.”
Read also
How does it operate, then? Vision AI combines the company’s voice technology, which is already quite good at comprehending natural speech, with a live video feed. In a way that a basic voice assistant could never, the system is able to understand the user’s genuine purpose by simultaneously processing what it sees and hears. Imagine a mechanic with smart glasses who can ask for instructions just by looking at an engine part. They can get immediate visual and audible help without ever having to put down their equipment. A staff member might obtain a real-time inventory count at a store by simply gazing at the shelves.
Making sure the audio and visual components are precisely synchronized is one of the main technological challenges in developing such a system. The appearance of a spontaneous discourse would be destroyed by any delay. “With Vision AI, we are combining visual recognition and conversational intelligence into a single, synchronized flow,” said Pranav Singh, VP of Engineering at SoundHound AI. In order to provide quicker, more organic user experiences that span across surfaces from kiosks to embedded devices, every frame, every utterance, and every purpose are understood within the same ecosystem.