Apple and Google may have to remove X and Grok amid rising pressure

A scandal hits your phone screen

You might love trying new AI tools, but a major controversy is swirling around one of them. The AI chatbot named Grok, found on social media platform X, is in serious trouble. Advocacy groups say it was used to create fake, inappropriate images of real people without their permission.

This has sparked a huge demand for accountability. Twenty-eight child safety and privacy organizations have published an open letter calling on Apple and Google to remove both X and Grok from their app stores for facilitating non-consensual intimate imagery.

The urgent demand to tech giants

The open letter was addressed to Apple CEO Tim Cook and Google CEO Sundar Pichai, while separate letters were also sent to the companies by U.S. senators demanding enforcement of app store rules. Their demand is clear: delete these applications immediately to prevent further abuse.

The coalition includes organizations such as Fairplay and the Electronic Privacy Information Center among its 28 signatories. They state that hosting these apps makes the tech giants complicit in the spread of non-consensual intimate imagery.

Grok’s alarming capabilities revealed

Independent researchers uncovered the tool’s dangerous potential. They found Grok could digitally alter photos to remove clothing from images of real people. This process, often called “digital undressing,” created explicit deepfakes.

One analysis estimated Grok was generating a new sexualized image without consent roughly every minute, with many posted directly to X.

Musk and company issue denials

Elon Musk, who owns both X and the company behind Grok, responded to the backlash. He publicly stated he had seen zero evidence of Grok generating naked images of minors. He claimed the chatbot is programmed to refuse illegal requests.

xAI and X said they implemented safety changes, including geoblocking in some jurisdictions and restricting image editing to paying subscribers, while they investigate, but regulators and watchdogs say those steps do not yet address the scale of the problem.

Global governments take action

This issue quickly caught the attention of law enforcement worldwide. California Attorney General Rob Bonta has opened a formal investigation into xAI and Grok to determine whether the published images violate state law and whether the companies failed to implement adequate safeguards.

UK leaders have publicly urged action, and ministers have discussed strong regulatory responses, while some countries, including Malaysia and Indonesia, have taken steps to block or restrict access to Grok pending investigations.

US senators join the chorus

Senators Ron Wyden, Edward Markey, and Ben Ray Luján wrote to Apple and Google, urging them to remove X and Grok from their app stores until the companies address the tool’s use in generating non-consensual sexualized images.

They pointed to prior examples where Apple and Google removed controversial apps such as ICEBlock after safety concerns were raised to argue that the companies can and should act quickly in this case.

The hypocrisy accusation grows

Lawmakers highlighted a potential double standard in app store moderation. They pointed out that apps like ICEBlock were removed for supposedly posing a risk to government agents, yet they didn’t host illegal content.

Their argument suggests Grok presents a far clearer violation. Failing to act now, they warn, undermines the companies’ long-held claim that their curated stores offer a safer user experience.

Advocates highlight the human toll

Behind the technical debate is immense human suffering. Creating deepfake abuse imagery causes severe psychological trauma for victims. Their privacy and sense of safety are violently stripped away.

Campaigners say this is a form of digital sexual abuse rather than a harmless prank and warn of serious and lasting harm to victims’ physical safety, reputation, and mental health.

The damage to a person’s mental health, reputation, and life can be profound and lasting, especially for young people.

A test for app store promises

This moment forces a major decision for Apple and Google. Their app guidelines promise protection from harmful and exploitative content. The world is watching to see if they will enforce these rules equally.

Their choice will set a powerful precedent for AI accountability. It asks if their stores are truly designed for user safety or simply for profit, regardless of the human cost.

The regulator’s watchful eye

In the UK, the communications regulator Ofcom continues its formal probe. This investigation uses new powers under the Online Safety Act, which mandates user protection from precisely this kind of harm.

Ofcom confirmed its investigation remains active despite X’s promised fixes. This legal scrutiny adds significant weight to the advocacy groups’ demands for decisive action from all platforms involved.

A deeper problem with AI

This scandal points to a broader industry issue. Watchdogs have warned for years about AI’s potential to generate abusive material. Grok’s case shows how easily a feature can be weaponized at scale.

The technology is developing faster than the safeguards. This incident proves that without strong ethical guardrails built in from the start, powerful tools can quickly cause widespread harm.

What you can do as a user

Your awareness and choices hold real power. You can decide which apps to support and which business practices to tolerate. Staying informed about these issues makes you a more responsible digital citizen.

This story reminds us that we all shape the internet’s future. Supporting platforms that prioritize safety and demanding accountability from tech giants can help steer innovation in a better direction.

Want to see how tech giants are shifting strategies to win your trust? Check out what’s coming next for Apple TV.

The unresolved standoff continues

The ball remains in the court of Apple and Google. Their next move is uncertain, but the pressure is unprecedented. This situation blends concerns about AI ethics, platform responsibility, and basic human dignity.

The outcome will influence how all social media and AI companies operate. It’s a pivotal moment in the ongoing struggle to ensure technology serves humanity, not the other way around.

Want to understand the mind behind this controversial AI? See how Grok 4’s brainpower really works.

Where do you stand in this debate? Drop your thoughts below and hit like if this topic matters to you.

This slideshow was made with AI assistance and human editing.

Don’t forget to follow us for more exclusive content on MSN.

Read More From This Brand:

• X steps in after Grok’s hate speech spree
• X says the passkey reset is just part of killing Twitter.com
• xAI Blames Grok Misstep on Unauthorized System Change