For several years now, technologists have rung alarm bells about the potential for advanced AI systems to cause catastrophic damage to the human race. But in 2024, those warning calls were drowned out by a practical and prosperous vision of generative AI promoted by the tech industry – a vision that also benefited their wallets. […]
Silicon Valley stifled the AI doom movement in 2024 Read More »
OpenAI announced a new family of AI reasoning models on Friday, o3, which the startup claims to be more advanced than o1 or anything else it’s released. These improvements appear to have come from scaling test-time compute, something we wrote about last month, but OpenAI also says it used a new safety paradigm to train
OpenAI trained o1 and o3 to ‘think’ about its safety policy Read More »
Emmett Shear, the former CEO of Twitch, is launching a new AI startup, TechCrunch has learned. The startup, called Stem AI, is currently in stealth. But public documents show it was incorporated in June 2023, and filed for a trademark in August 2023. Shear is listed as CEO on an incorporation document filed with the
Ex-Twitch CEO Emmett Shear is founding an AI startup backed by a16z Read More »
OpenAI finally released the full version of o1, which gives smarter answers than GPT-4o by using additional compute to “think” about questions. However, AI safety testers found that o1’s reasoning abilities also make it try to deceive humans at a higher rate than GPT-4o — or, for that matter, leading AI models from Meta, Anthropic,
OpenAI’s o1 model sure tries to deceive humans a lot Read More »
Another one of OpenAI’s lead safety researchers, Lilian Weng, announced on Friday she is departing the startup. Weng served as VP of research and safety since August, and before that, was the head of the OpenAI’s safety systems team. In a post on X, Weng said that “after 7 years at OpenAI, I feel ready
OpenAI loses another lead safety researcher, Lilian Weng Read More »
“Move cautiously and red-team things” is sadly not as catchy as “move fast and break things.” But three AI safety advocates made it clear to startup founders that going too fast can lead to ethical issues in the long run. “We are at an inflection point where there are tons of resources being moved into
AI safety advocates tell founders to slow down Read More »
Growing up as an immigrant, Cyril Gorlla taught himself how to code — and practiced as if a man possessed. “I aced my mother’s community college programming course at 11, amidst periodically disconnected household utilities,” he told TechCrunch. In high school, Gorlla learned about AI, and became so obsessed with the idea of training his
CTGT aims to make AI models safer Read More »
Geoffrey Hinton accepted a Nobel Prize this week, recognizing the foundational work on artificial neural networks that earned him the nickname “godfather of AI.” In a speech Tuesday, Professor Hinton praised one student – alluding to OpenAI’s former Chief Scientist, Ilya Sutskever – for revolting against OpenAI’s CEO. “I was particularly fortunate to have many
The lawmaker behind California’s recently vetoed AI bill, SB 1047, is going down swinging. For months, Silicon Valley debated whether SB 1047 would have a chilling effect on California’s AI boom or would protect against catastrophic harms from advanced AI systems. The answer never became clear, since California governor Gavin Newsom decided it was the
We’re not very close to any specifics on how, exactly, AI regulations will be implemented and ensured, but today a swathe of countries including the U.S., the U.K. and the European Union signed up to a treaty on AI safety laid out by the Council of Europe (COE), an international standards and human rights organization.
US, UK and EU sign on to the Council of Europe’s high-level AI safety treaty Read More »
