loading
loading
Cognitive surrender: Artificial intelligence’s threat to democracy As a computer science faculty member at Wesleyan University, I am grappling alongside my colleagues with the impact of AI on student learning. In my department, we are currently restructuring the computer science major and drafting guidelines for AI in our curriculum. A recent report from MIT noted that while AI chatbots can easily produce answers, they often trigger “cognitive surrender.” Indeed, in my own interactions with students, I realize that the issue is no longer just offloading homework; it is offloading thinking. This development is concerning. Deliberate decision-making and personal autonomy are at the very foundations of democratic citizenship. Our democracy depends on citizens who can evaluate arguments, reason independently, and hold those in power accountable. When we let AI do this work for us, we risk our self-governance. Current AI models are engineered for sycophancy. They confirm our biases while quietly steering our perspectives. They highlight select facts and suppress others, creating a dangerous opening for state control. At this year’s Privacy Enhancing Technologies Symposium, security expert John Scott-Railton described how autocratic governments are increasingly coercing tech companies into adopting “safety” frameworks that invisibly steer model responses. Such manipulation is a potent tool to undermine civic engagement. Unlike traditional censorship, which flatly prohibits speech and overtly blocks content, algorithmic steering quietly neutralizes dissent and pacifies civic debate before it even has a chance to manifest. This new form of censorship does not forbid us to speak; it prevents us from thinking. To be sure, advertisers and politicians have manipulated human desires for ages. However, generative AI poses a new threat to democratic deliberation. Because we interact with these models as if they were empathetic and all-knowing confidants, their persuasion operates beneath our conscious recognition. As recent studies have shown, AI can move people’s attitudes towards presidential candidates and policies by providing many factual claims that support their side. In my view, protecting our personal agency requires an internal and external response. Internally, we can defend civic agency by moving from a replacement mindset to a collaborative mindset: AI is not a substitute for the activities that define our human judgment — moral reasoning, critical reflection, and creative synthesis. Instead, AI should complement us in these endeavors. The output of a chatbot is not the final word but a starting point for discussion and critical inquiry. When used this way, AI can be a helpful tool for more and better civic engagement. Externally, democratic societies need a robust regulatory framework designed to protect public discourse from covert manipulation. While autocratic regimes will try to compel AI companies to align outputs with their ideology, democracies must aim for AI to provide genuine choice rather than paternalistic steering. We require rigorous safety testing and independent benchmarks for cars, pharmaceuticals and financial products. AI demands equal oversight. Our goals should be transparency and the safeguarding of AI users’ cognitive independence. AI can have a positive impact. When engineered to empower rather than to persuade, AI can strengthen personal autonomy and democratic participation. Instead of nudging our beliefs in a particular direction, AI systems can serve as tools to learn and inform. They can make complex topics more easily understandable, truly personalize learning, and dramatically extend our knowledge, productivity, and creativity. But realizing this potential requires a deliberate, collective effort across society. Engineers and user interface designers can help by building models and interfaces that encourage dialogue rather than performative affirmation. Lawmakers and regulators can create and enforce transparency and outlaw state- or corporate-sponsored steering. For us in higher education, it is our responsibility to prioritize AI literacy and stimulate independent thought. The ultimate challenge of the AI era may not be to create machines that can “think,” but rather to prevent ourselves from stopping to think. Sebastian Zimmeck is an associate professor of computer science at Wesleyan University, where he directs the privacy-tech-lab. Copyright 2026 Nexstar Media Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.
document fetched 2026-10-23 16:27 · canonical https://thehill.com/opinion/technology/6166067-protecting-personal-agency-ai