Mercedes-Benz is further leveraging the power of artificial intelligence (AI) to expand the capabilities of its MBUX Voice Assistant with a new general knowledge function1. Using AI, the MBUX Voice Assistant can now provide up-to-date answers to knowledge-based questions by initiating a Microsoft Bing search. It then creates natural language responses using ChatGPT through Microsoft Azure OpenAI Service. Last year, Mercedes-Benz was one of the first automakers to introduce ChatGPT as a U.S. beta program and is now bringing this functionality into series production vehicles for the first time.

With this feature, customers can ask a wide variety of general knowledge questions – from pop culture to geography, science, health and history – and freely converse about the chosen topic to get more information. The intelligent system is also ‘context-aware.’ This means it can respond to follow-up requests for additional information, even if the speaker uses vague wording. For example, the question could be: “How many Grammy awards has a certain artist won?” After receiving the answer, the user could add: “When was the first?” and the system would respond correctly as it already understands the background. Customers can still use the MBUX Voice Assistant for queries on a broad range of everyday topics, such as the weather, stocks, news and sports.

“By adding an AI-driven knowledge feature to our MBUX Voice Assistant, we are making it even easier for customers to connect with their vehicle in an entertaining and rewarding way. Our unique AI software seamlessly interacts with ChatGPT and Bing through Microsoft Azure OpenAI Service to deliver information like never before. This is another proof point on our journey towards the hyper-personalized in-car user experience.”

– Markus Schäfer, Member of the Board of Management of Mercedes-Benz Group AG, Chief Technology Officer, Development & Procurement

Customers enjoy a seamless experience as the new function is directly integrated into their vehicle’s MBUX Voice Assistant. Just like before, passengers can activate the assistant by simply saying “Hey Mercedes.” Alternatively, they can press the speech button on the steering wheel to activate the assistant. To maximize the functionality, the dialogue history is stored for up to one hour, allowing the user to ask follow-up questions. Starting today, the new function will be available as a free update to over three million vehicles globally with the MBUX infotainment system2. It will initially be offered in three languages: German, British English and American English. Users from other markets can change their system language to try out the feature.

Sophisticated AI ensures data privacy at all times
With this new feature, Mercedes-Benz is tapping into the power of Azure OpenAI Service’s leading generative AI models backed by the enterprise-grade security, privacy and reliability capabilities of the Azure cloud platform. Mercedes-Benz retains complete control over the IT processes in the background. All voice command data collected is stored in the Mercedes-Benz Intelligent Cloud, where it is anonymized and analyzed.

To mitigate the risk of customers accessing toxic, harmful or illegal content, Mercedes-Benz has implemented a risk assessment tool to evaluate system responses and identify best practices to reduce the possibility of harmful responses.