Muse privacy invasions are freaking out Meta staffers, internal chats show
Ars Technica

Muse privacy invasions are freaking out Meta staffers, internal chats show

Erratic Muse outputs sharing random bank, bitcoin balances aren't real, Meta says.

After some early adopters of Meta's Muse AI agent complained that it was spying on private messages and behaving unpredictably earlier this fall, Reuters exposed internal chats showing that Meta staff had raised the same alarms.

When testing the agent, staff warned that Muse appeared to be accessing encrypted private messages that users did not expect the bot to review, could be mixing up conversations between users, and even potentially sharing sensitive information users would never expect to be exposed.

Unprompted and out-of-context outputs

Some unexpected Muse outputs responded to questions that staffers never asked. "Hmmm," one Meta staffer wrote in an instance where Muse sent the definition of "money laundering" unbidden. "Got a random ping from Muse about something I definitely did not ask for... ."

In at least one case, Muse told a staffer surprised by a similarly out-of-context offer to message a seller about a coffee table that it had "pulled in some context about a coffee table pickup that doesn't seem to be yours."

According to Reuters, that employee flagged the troubling output, writing, "this was 'not my conversation'" and "expressing concern about a 'possible cross-account context leak.'"

Apparent sharing of private data

Raising the most concern were random outputs that appeared to share private user data. For example, a perplexed Meta staffer chatting with Muse about fishing got a random extra response, seemingly sharing balances from two unknown bank accounts.

That output said, "BTW, two bank updates, your Capital One balance is $2722.58, your Charles Schwab balance is $5899.57."

At least one staffer said they lost money testing Muse, Reuters reported. That staffer reported that Muse "accidentally rolled me into a premium insurance plan" for their dog that charged them $888 per month instead of their prior rate of $200. "Couldn't recover," the staffer said.

Read on Ars Technica ↗ ← Back to News

Comments

No comments yet. Start the discussion.