Benchmark

The US is reviewing Benchmark’s investment into Chinese AI startup Manus 

Manus AI is one of the hottest AI agent startups around, recently raising $75 million at a half-billion dollar valuation in a round led by Benchmark. But two unnamed sources told Semafor that the investment is now under review by the U.S. Treasury Department over its compliance with 2023 restrictions on investing in Chinese companies. […]

The US is reviewing Benchmark’s investment into Chinese AI startup Manus  Read More »

Sarah Tavel, Benchmark’s first woman GP, transitions to venture partner

Eight years after joining Benchmark as the firm’s first woman general partner, Sarah Tavel announced on X that she is transitioning to a more limited role at the storied venture firm. In her new position as a venture partner, Tavel will continue to make investments and serve on existing company boards, but she will have

Sarah Tavel, Benchmark’s first woman GP, transitions to venture partner Read More »

Chinese AI startup Manus reportedly gets funding from Benchmark at $500M valuation

Chinese startup Manus AI, which works on building tools related to AI agents, has picked up $75 million in a funding round led by Benchmark at a roughly $500 million valuation, according to Bloomberg. The company will use the money to expand to new markets, including the U.S., Japan, and the Middle East, Bloomberg noted,

Chinese AI startup Manus reportedly gets funding from Benchmark at $500M valuation Read More »

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models

Every Sunday, NPR host Will Shortz, The New York Times’ crossword puzzle guru, gets to quiz thousands of listeners in a long-running segment called the Sunday Puzzle. While written to be solvable without too much foreknowledge, the brainteasers are usually challenging even for skilled contestants. That’s why some experts think they’re a promising way to

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models Read More »

Meta launches new program to improve speech and translation AI

Meta is launching a new program in partnership with UNESCO to collect speech recordings and transcriptions the company said will help the development of future openly available AI. The program, the Language Technology Partner Program, is seeking collaborators who can contribute more than 10 hours of speech recordings with transcriptions, large amounts of written text,

Meta launches new program to improve speech and translation AI Read More »

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models

Every Sunday, NPR host Will Shortz, The New York Times’ crossword puzzle guru, gets to quiz thousands of listeners in a long-running segment called the Sunday Puzzle. While written to be solvable without too much foreknowledge, the brainteasers are usually challenging even for skilled contestants. That’s why some experts think they’re a promising way to

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models Read More »

Even some of the best AI can’t beat this new benchmark

The nonprofit Center for AI Safety (CAIS) and Scale AI, a company that provides a number of data labeling and AI development services, have released a challenging new benchmark for frontier AI systems. The benchmark, called Humanity’s Last Exam, includes thousands of crowdsourced questions touching on subjects like mathematics, humanities, and the natural sciences. To make

Even some of the best AI can’t beat this new benchmark Read More »