Luxury vehicle company Mercedes in collaboration with Grammy award winning musician and entrepreneur Will.i.am recently introduced MBUX Sound Drive, a new feature that uses sensors and software to link music to driving. The technology uses software that allows music to react to the way the car is being driven, creating a harmonious relationship between motion and melody turning the car into a virtual musical instrument.
Describing it as tricky, Mercedes says it uses musical tracks that match regular actions like recuperation, acceleration, steering, and braking. “The driver now is the composer and the car is the instrument. Imagine being able to create and commute where the vehicle is not just an instrument, but an entire orchestra.” said Will.i.am.
Just the Beginning
At CES 2024, many automobile companies showcased the look of the next generation of vehicles. Imagine personalised playlists syncing with your mood, interactive stories unfolding as you drive, and an AI companion crafting the perfect travel atmosphere. All of this is now possible.
Volkswagen recently integrated ChatGPT within its infotainment system. The chatbot will be available across VW’s lineup, including Tiguan, Passat, and Golf, as well as the automaker’s ID family of electric vehicles.
The German car maker said that the voice assistant offers a multitude of new capabilities, such as controlling the infotainment, navigation, and air conditioning, or answering general knowledge questions.
Volkswagen is not alone, at CES 2024, Mercedes-Benz also unveiled MBUX Virtual Assistant. Based on MB.OS, it introduces a new customer interaction experience with natural and empathetic responses, featuring four distinct emotions.
Last year, Mercedes-Benz announced that it is beta-testing ChatGPT as a voice assistant in its cars. The company said drivers will be able engage the chatbot in a variety of conversations, asking “for details about their destination, to suggest a new dinner recipe, or to answer a complex question” — all “while keeping their hands on the wheel and eyes on the road.”
Similarly, BMW has partnered with Amazon to introduce new LLM powered Alexa in its cars. BWW said that these new capabilities provide a more natural way of getting to know your new car and allow it to take select actions on your behalf.
Instead of digging through your car manual, you can ask BMW’s assistant for things like recommendations on different BMW drive modes and then have the assistant activate your chosen mode. “Nobody really likes to read the manual, so it’s very convenient when you can simply ask the car anything you’d like,” said Simon Euringer, head of BMW Intelligent Personal Assistant.
“You can also ask for instructions on how car features work—like the parking assistance system—and hear explanations in easy-to-understand terms through the BMW assistant’s customised voice.”
Search giant Google also introduced new features for Android Auto at CES. Electric vehicles compatible with Android Auto will now share real-time battery information with Google Maps, initially rolling out to the Ford Mustang Mach-E and F-150 Lightning in the coming months, with others to follow. Last year, General Motors partnered with Google to bring conversational AI technology into millions of GM vehicles.
Interestingly, Google hasn’t yet come up with a generative AI product for automobiles yet. However, it announced that the Chrome browser is beginning to roll out in beta to select Polestar and Volvo cars, with availability in more cars later this year. This will enable users to do some shopping or access saved bookmarks to stay occupied while parked.
Looking ahead, the automotive industry is on the brink of another breakthrough. Soon you would be able to directly pay through your cars. To reduce the complexity of paying for services, Qualcomm is working with J.P. Morgan to design an in-vehicle wallet that simplifies the payment experience. This will enable drivers to pay for streaming content, EV charging, parking, or drive-thru meals directly with the car.
