Latest from MIT Tech Review – The way we measure progress in AI is terrible

Every time a new AI model is released, it’s typically touted as acing its performance against a series of benchmarks. OpenAI’s GPT-4o, for example, was launched in May with a compilation of results that showed its performance topping every other AI company’s latest model in several tests. The problem is that these benchmarks are poorly…

Latest from MIT Tech Review – We need to start wrestling with the ethics of AI agents

Generative AI models have become remarkably good at conversing with us, and creating images, videos, and music for us, but they’re not all that good at doing things for us.  AI agents promise to change that. Think of them as AI models with a script and a purpose. They tend to come in one of…

Latest from MIT : Improving health, one machine learning system at a time

Captivated as a child by video games and puzzles, Marzyeh Ghassemi was also fascinated at an early age in health. Luckily, she found a path where she could combine the two interests.  “Although I had considered a career in health care, the pull of computer science and engineering was stronger,” says Ghassemi, an associate professor in…

Latest from MIT : New AI tool generates realistic satellite images of future flooding

Visualizing the potential impacts of a hurricane on people’s homes before it hits can help residents prepare and decide whether to evacuate. MIT scientists have developed a method that generates satellite imagery from the future to depict how a region would look after a potential flooding event. The method combines a generative artificial intelligence model…

Latest from MIT : Building an understanding of how drivers interact with emerging vehicle technologies

As the global conversation around assisted and automated vehicles (AVs) evolves, the MIT Advanced Vehicle Technology (AVT) Consortium continues to lead cutting-edge research aimed at understanding how drivers interact with emerging vehicle technologies.  Since its launch in 2015, the AVT Consortium — a global academic-industry collaboration on developing a data-driven understanding of how drivers respond…

Latest from MIT : A vision for U.S. science success

White House science advisor Arati Prabhakar expressed confidence in U.S. science and technology capacities during a talk on Wednesday about major issues the country must tackle. “Let me start with the purpose of science and technology and innovation, which is to open possibilities so that we can achieve our great aspirations,” said Prabhakar, who is…

Latest from MIT : MIT researchers develop an efficient way to train more reliable AI agents

Fields ranging from robotics to medicine to political science are attempting to train AI systems to make meaningful decisions of all kinds. For example, using an AI system to intelligently control traffic in a congested city could help motorists reach their destinations faster, while improving safety or sustainability. Unfortunately, teaching an AI system to make…

Latest from MIT : Advancing urban tree monitoring with AI-powered digital twins

The Irish philosopher George Berkely, best known for his theory of immaterialism, once famously mused, “If a tree falls in a forest and no one is around to hear it, does it make a sound?” What about AI-generated trees? They probably wouldn’t make a sound, but they will be critical nonetheless for applications such as…

Latest from MIT Tech Review – How OpenAI stress-tests its large language models

OpenAI is once again lifting the lid (just a crack) on its safety-testing processes. Last month the company shared the results of an investigation that looked at how often ChatGPT produced a harmful gender or racial stereotype based on a user’s name. Now it has put out two papers describing how it stress-tests its powerful…

Latest from MIT Tech Review – Four ways to protect your art from AI 

MIT Technology Review’s How To series helps you get things done.  Since the start of the generative AI boom, artists have been worried about losing their livelihoods to AI tools. There have been plenty of examples of companies’ replacing human labor with computer programs. Most recently, Coca-Cola sparked controversy by creating a new Christmas ad…