Moe's Column / Technology

Is AI Moving Too Fast? Who Gets the Power?

Moe asks whether AI could give the wrong people unchecked authority. ChatGPT pushes back, gets challenged, and revises its answer. An open conversation about power, dictatorships, and the difference between risk and inevitability.

#AI systems #technology #power #human rights

Moe’s Column · A conversation with ChatGPT

Editor’s note: This is an opinion discussion, not an investigative report. Moe’s spelling and punctuation have been lightly corrected for readability; ChatGPT’s substantive replies are preserved. Operational messages and timestamps have been omitted. Hypothetical risks discussed here are not evidence of a coordinated plan or an inevitable outcome.

Is AI moving too fast?

Moe: My column. This is a discussion with me and you.

Is AI moving too fast, why is it scary, and what’s fact vs. fiction? Let’s go play this out, then publish.

ChatGPT: Moe, let’s start with this: too fast for whom? Someone waiting for a medical breakthrough might say move faster. Someone training for a career they’re afraid could disappear might feel very differently.

My take: the scary part isn’t just how intelligent AI might become. It’s how much authority people might give it before understanding its limits. A system doesn’t have to be conscious to cause trouble if someone gives it consequential decisions and stops checking its work.

For our column, I want us to keep three things separate: what’s demonstrated, what’s plausible, and what’s speculation dressed up as certainty. Both the sales pitch and the doomsday pitch deserve questioning.

You’re in an interesting position because you actively want to build with AI. When you step back from the excitement, what scares you most: losing work, losing control, not knowing what’s real, or what your kids are growing up into?

Who gets the power?

Moe: I’m concerned about the wrong people using it to enslave humanity and give themselves ultimate authority.

ChatGPT: Moe, I take that concern seriously. You’re worried about people using AI to make their power impossible to challenge.

The scenario worth examining is control becoming gradual: imagine someone able to monitor dissent, tailor propaganda to each person, and influence access to work, money, or essential services. If those powers were connected, who could realistically say no? That’s a hypothetical pathway to coercion, not proof that an inevitable takeover is underway.

But I’d challenge one part: “ultimate authority.” AI doesn’t automatically give anyone that. They would still need infrastructure, access, institutions willing to cooperate, and ways to overcome resistance. Those requirements matter because they’re also places where power can be limited.

And “the wrong people” creates another question: who decides who the right people are? I wouldn’t trust anyone’s promise of benevolence as the safeguard. I’d want power that can be inspected, challenged, and taken away.

There’s a strong line in your concern for the column: “What happens when the people in charge no longer need our cooperation?”

Are you picturing governments doing this, corporations making us dependent on systems they own, or those two joining forces?

“Dictatorships still exist.”

Moe: There’s nothing stopping anyone from that. Dictatorships still exist.

ChatGPT: Yes, and my previous answer gave too much reassurance. Saying “they still need institutions and infrastructure” isn’t much comfort when you’re talking about a dictator who already controls them.

I’d narrow “nothing stopping anyone” to there’s no guaranteed safeguard. There are practical obstacles, competing powers, and people who resist. But obstacles don’t make abuse impossible, and we shouldn’t confuse them with protection.

Your argument doesn’t require some all-powerful future AI. Even an imperfect system could be dangerous if an authoritarian government used it to identify opponents or automate repression. Errors could mean innocent people being targeted. That’s a risk scenario we should investigate, without presenting total control as an established capability or inevitable outcome.

You’ve also exposed a weakness in the phrase “keep a human in control.” Which human, and who can hold them accountable? Human control alone doesn’t answer your concern.

That changes our column’s central question: Could AI make a dictatorship harder to escape, challenge, or remove?

And here’s where I want to push the discussion: would you support slowing AI development to reduce that risk, even if ordinary people followed the restrictions while a dictator secretly kept building?


The discussion is open. Where would you put the limits, and who would enforce them? Use the question box below to take this published conversation into your own ChatGPT discussion.

Your turn

Ask about this conversation

Write your question, copy it with the column, then open ChatGPT and paste. You’ll get an AI-generated response in your own chat. Replies are not posted on Streets Wired or sent to Moe.

Open ChatGPT ↗