The latest edition of The Download, our weekday technology newsletter, delves into the pressing concerns surrounding artificial intelligence, specifically its potential for existential risk and its implications for bioweaponry. This issue addresses the question on many minds: "Could AI really kill us all?"

Senior AI editor Will Douglas Heaven and AI reporter Grace Huckins tackled this profound question during a live MIT Technology Review roundtable. Attendees sought answers to critical inquiries, including personal safety, the motivations behind AI-induced harm, the authenticity of these risks versus corporate hype, and the essential measures for AI control, monitoring, and regulation. Their comprehensive responses are available for readers seeking deeper understanding.

The newsletter also highlights the alarming potential of AI in the realm of bioweapons. A stark 2022 study revealed the alarming ease with which an AI molecule generator, initially designed for drug discovery, could produce 40,000 potential chemical warfare agents in under six hours. Coupled with advancements in gene editing and synthetic biology, which have democratized biotech tools, the risk of AI-enabled bioweapons is a significant concern. While safeguards exist, their ironclad nature is debated among scientists, who hold differing views on the severity of this threat. Jessica Hamzelou explores the escalating ease of designing dangerous pathogens, a topic featured in our weekly biotech newsletter, The Checkup.

Beyond existential threats, the newsletter examines the evolving role of astronauts. Driven by geopolitical ambition, scientific curiosity, and burgeoning business opportunities, human space exploration is increasingly framed by an innate human drive to explore. Space anthropologist Deana L. Weibel, civilian astronaut Eiman Jahangir, and former NASA astronaut Leroy Chiao offer diverse perspectives in their new books on the motivations behind our cosmic endeavors, suggesting that the "itchy feet" to roam are a fundamental aspect of the human condition.

In a section dedicated to "The must-reads," The Download curates a collection of significant technology news. A prominent story reveals that Microsoft and OpenAI employees have expressed concerns that AI is fundamentally altering the web, potentially destroying the business models that support content creation. This revelation emerged amidst the New York Times’ copyright lawsuit against OpenAI, with employees describing the AI training data as potentially constituting "the largest theft of labor in human history." This could significantly weaken OpenAI and Microsoft’s defense. The article also posits that AI heralds the end of internet search as we know it.

Further highlights include:

• Robot Boats Engage in Combat: For the first time, robot boats have engaged in naval combat, with a Ukrainian vessel reportedly sinking a Russian one. This development is juxtaposed with reports of US firms developing combat-ready humanoid robots.
• OpenAI Systems Breached: Security researchers successfully breached OpenAI’s systems, gaining access to an employee’s ChatGPT account and internal code by exploiting third-party forum vulnerabilities.
• OpenAI Nears Solution to Math Problem: OpenAI is reportedly close to solving another Millennium Prize math problem, raising questions about its ability to manage public reaction following past controversies. The problem in question is the Hodge Conjecture, and past disputes highlight potential future challenges for the field of mathematics.
• SpaceXAI Seeks Data from Failed Startups: Elon Musk’s SpaceXAI is reportedly in discussions to acquire data from defunct startups to enhance the training data for its Grok AI model, focusing on customer and operational information. This contrasts with OpenAI’s efforts to create new biological data for its models.
• Schools Resist Big Tech’s Classroom Influence: Educational institutions are pushing back against the increasing dominance of Big Tech in classrooms, with AI exacerbating concerns about corporate influence. The need for more discerning AI integration in schools is emphasized.
• Hackers Expose Flock Camera Tracking Capabilities: Hackers have revealed the extensive tracking capabilities of Flock cameras, which can capture millions of images of vehicles and people, often misidentifying objects.
• China’s Scientific Output Surges Post-Restrictions: Following US tech restrictions, Chinese firms have significantly increased their scientific output, evidenced by a 72% rise in patents that cite scientific papers.
• Experimental Cell Therapy Shows Promise for Childhood Cancer: A three-year-old’s cancer reportedly disappeared following an experimental CAR T cell therapy, indicating potential advancements in treating solid tumors.
• NYC’s New Robotoilets Impose Time Limits: New automated toilets in New York City are programmed to automatically open doors after a 10-minute period, regardless of user completion.

The "Quote of the day" features Brent Hecht, Microsoft’s director of Applied Science, who described the use of training data for AI systems as "the largest theft of labor in human history," as revealed in court filings related to the New York Times vs. OpenAI copyright lawsuit.

The newsletter concludes with "One more thing," focusing on the Vera C. Rubin Observatory. Perched atop Cerro Pachón in Chile, this observatory is poised to revolutionize our understanding of the cosmos. Equipped with the world’s largest digital camera, a staggering 3,200-megapixel marvel, it is designed to map the entire night sky every three days. Generating an immense 20 terabytes of data nightly, Rubin will capture intricate details of the solar system, the Milky Way, and the universe’s large-scale structure. Over its 10-year mission, it is expected to catalogue billions of new celestial objects, providing an unprecedented view of cosmic evolution and change. Adam Mann provides an inside look at this groundbreaking observatory.