After Amazon revealed its plans for a generative AI version of Alexa, concerns about user privacy have surfaced. With the rollout of Alexa+ for Amazon Echo devices expected in the coming weeks, clarity is emerging regarding the privacy trade-offs users must consider to optimize the functionality of the AI voice assistant and avoid compromising features on their existing devices.
In a recent communication to customers, Amazon informed Echo users that the option to process Alexa requests locally—thereby preventing voice recordings from being sent to Amazon’s cloud—will no longer be available. Users who had previously activated the “Do Not Send Voice Recordings” setting on their Echo will find that, starting March 28, every spoken command directed at Alexa will automatically be sent to Amazon and processed through their cloud services.
In an attempt to justify this change, Amazon noted in the email: “As we continue to enhance Alexa’s features with generative AI capabilities that rely on the processing power of Amazon’s secure cloud, we have decided to discontinue support for this feature.”
One of the key highlights of Alexa+ is its improved ability to recognize individual speakers, known as Alexa Voice ID. To facilitate this feature, Amazon is eliminating a privacy-centric option for all Echo users, regardless of whether they are interested in the subscription-based upgrade or desire to utilize Alexa+ without its voice recognition capabilities.
Nonetheless, there are numerous reasons why individuals may hesitate to allow Amazon access to recordings of their interactions with the device. The very notion of a corporate giant having the ability to listen to personal requests made within one’s home can be unsettling.
Furthermore, Amazon’s past mismanagement of Alexa voice recordings raises additional concerns. In 2023, the company agreed to a $25 million settlement for storing recordings of children’s interactions with Alexa indefinitely. Adults also were not adequately informed of Amazon’s policy to retain Alexa recordings unless explicitly opted out until 2019, five years post-launch of the first Echo device.
If those factors aren’t enough to prompt caution about sharing voice recordings with Amazon, it’s worth noting that the company has permitted its employees to listen to Alexa voice recordings. In 2019, Bloomberg reported that Amazon workers would analyze as many as 1,000 audio samples during their nine-hour shifts, with the company stating that this practice helps train its speech recognition and natural language understanding systems.
Other users might be wary of trusting Amazon with their voice recordings due to concerns stemming from previous criminal trials using Alexa voice data and a 2023 settlement in which Amazon was accused of allowing “thousands of employees and contractors to view video recordings of customers’ private spaces” from Ring cameras, according to the Federal Trade Commission.
Save Recordings or Lose Functionality
In an effort to address these concerns proactively, Amazon indicated in its email today that by default, it will erase users’ voice recordings after processing. Nevertheless, those who have set their Echo devices to “Don’t save recordings” will have the Voice ID feature on their existing devices disabled. This feature enables Alexa to manage user-specific calendar events, reminders, music, and more. Previously, Amazon noted that “if you opt not to save any voice recordings, Voice ID may not be functional.” As of March 28, users who choose not to permit Amazon to store their voice recordings will face non-operational Voice ID.
Amazon’s email states:
Amazon is presenting Echo users with two challenging choices: either grant Amazon access to recordings of all their interactions with Alexa or stop using the Echo altogether; opt to allow Amazon to keep voice recordings and potentially have employees listen to them or lose access to advancements and features integral to the next generation of Alexa.
However, Amazon is investing heavily in ensuring that Alexa+ can rescue the voice assistant from financial struggles. The company has assured customers that the free version of Alexa will remain available, but Alexa+ is seen as Amazon’s last resort for making Alexa viable and profitable. Thus, prioritizing any measures that encourage users to pay for Alexa seems to override other user preferences, including privacy.
This article originally appeared on Ars Technica.
