Are We Repeating Past Mistakes with Inflated AI Startup Valuations?

Unpacking the Claim: Why AI Can’t Automate Science Completely

Update Why AI Can't Fully Automate Scientific Discovery The advancement of artificial intelligence (AI) has sparked keen interest across various domains, including science. As AI systems become increasingly integrated into research environments, the question arises: can AI truly replace scientists? A philosopher raises compelling points about the limitations of AI in automating science, arguing that while these technologies can assist, they cannot stand alone in the scientific endeavor. The Genesis Mission and Current Achievements The Genesis Mission, announced by the Trump administration in late 2025, aims to build AI agents that utilize federal scientific datasets to test new hypotheses and automate workflows. Despite some achievements, such as the AI model AlphaFold's ability to predict protein structures, these systems remain deeply reliant on human oversight. AlphaFold's developers won the 2024 Nobel Prize in Chemistry, highlighting its significant contributions to biology and drug design. However, as noted by experts, AlphaFold does not generate new knowledge independently; it only enhances our ability to analyze existing data efficiently. This dependency highlights a critical point: AI lacks the commonsense reasoning that human scientists rely on for genuine breakthrough innovation. Human Oversight: A Non-Negotiable Requirement AI systems operate based on the information and parameters set by human designers. Their functioning is constrained by the datasets they are trained on, which must represent the real-world accurately. Without human insights to guide AI’s understanding of the scientific landscape, breakthroughs become mere data processing feats devoid of the innovative spark that characterizes human-led science. For instance, while AI can identify correlations within vast datasets, it often struggles to formulate realistic experimental recommendations due to its inability to apply commonsense reasoning. This gap between human intuition and AI logic highlights the need for scientists to remain at the helm of scientific discovery. AI should be viewed as a highly advanced tool rather than an independent researcher. Beyond Algorithms: The Uniquely Human Aspects of Science Science is not merely a sequence of calculations or experimental procedures; it is a distinctly human enterprise grounded in creativity, intuition, and shared values. The process of scientific discovery relies heavily on collaboration, debate, and the collective advancement of knowledge across generations. For example, the double-helix structure of DNA was proposed long before technological verification was possible, demonstrating that scientific concepts often evolve through prolonged intellectual discourse rather than through isolated computational analysis. Philosophers argue that the legitimacy of scientific endeavours emerges from human experience, values, and goals. In this sense, AI lacks the capacity to engage with the social dimensions of research, rendering it unable to replicate the cooperative spirit of scientific endeavors. Incorporating AI: A Co-Pilot for Human Scientists While AI can enhance productivity in scientific research, its role should be that of a co-pilot rather than a captain. AI-driven systems can automate tedious tasks and process large datasets at unprecedented speeds, allowing human scientists to focus on critical thought and innovation. For instance, AI can generate multiple hypothetical scenarios for drug discovery, yet the refinement and selection of these hypotheses must always reside with human researchers. This partnership is essential for preserving the integrity of scientific inquiry. As the philosopher Emily Sullivan highlights, AI tools need strong empirical links to existing scientific knowledge to be successful. In essence, the combination of AI processing power and human insight can yield substantial advancements in science—but with a clear understanding of the limitations inherent to AI. Future Predictions: Where AI and Science Intersect Experts predict that AI tools will increasingly facilitate scientific workflows, accelerating the pace of research. However, significant challenges still exist that prevent AI from fully taking over the scientific process. Issues, such as biases in data and algorithms and the potential for de-skilling among human scientists, point to the vital need for a balanced interplay between AI and human input. Collaboration among scientists with diverse perspectives will also play a crucial role in shaping the future of AI in research. Encouraging a broad range of voices will help ensure that AI technologies develop in ways that do not reinforce existing biases within the scientific community. Final Thoughts: Embracing AI Within Human Constraints Every advancement in human knowledge through science has come through dedicated effort and collaboration. AI, despite its advanced capabilities, cannot replicate the uniquely human qualities that foster true scientific inquiry. As we navigate the future of research in an AI-enhanced world, maintaining that human element will be essential to ensuring that scientific integrity and creativity remain at the forefront of discovery.