Posted by Junfeng He, Senior Research Scientist, and Kai Kohlhoff, Staff Research Scientist, Google Research People have the remarkable ability to take in a tremendous amount of information (estimated to be ~1010 bits/s entering the retina) and selectively attend to a few task-relevant and interesting regions for further processing (e.g., memory, comprehension, action). Modeling human…
A few months ago, I wrote about some experiments with prime numbers. I generated a 16-digit non-prime number by multiplying two 8-digit prime numbers, and asked ChatGPT (using GPT -3.5) whether the larger number was prime. It answered correctly that the number was non-prime, but when it told me the number’s prime factors, it was clearly wrong….
This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here. This week I’ve been thinking a lot about the human labor behind fancy AI models. The secret to making AI chatbots sound smart and spew less toxic nonsense is to use a…
After decades of research and development, mostly confined to academia and projects in large organizations, artificial intelligence (AI) and machine learning (ML) are advancing into every corner of the modern enterprise, from chatbots to tractors, and financial markets to medical research. But companies are struggling to move from individual use cases to organization-wide adoption for…
In the film “Top Gun: Maverick,” Maverick, played by Tom Cruise, is charged with training young pilots to complete a seemingly impossible mission — to fly their jets deep into a rocky canyon, staying so low to the ground they cannot be detected by radar, then rapidly climb out of the canyon at an extreme…
Three Spanish MIT postdocs, Luis Antonio Benítez, Carolina Cuesta-Lazaro, and Fernando Romero López, were chosen by the Department of Physics as the first cohort of Mauricio and Carlota Botton Foundation Fellows. This year’s recipients are provided with a one-year stipend and a research fund to pursue their research interests; they will visit the Botton Foundation…
Posted by Su Wang and Ceslee Montgormery, Research Engineers, Google Research In the last few years, text-to-image generation research has seen an explosion of breakthroughs (notably, Imagen, Parti, DALL-E 2, etc.) that have naturally permeated into related topics. In particular, text-guided image editing (TGIE) is a practical task that involves editing generated and photographed visuals…
There has been a remarkable surge in the use of algorithms and artificial intelligence to address a wide range of problems and challenges. While their adoption, particularly with the rise of AI, is reshaping nearly every industry sector, discipline, and area of research, such innovations often expose unexpected consequences that involve new norms, new expectations,…
Huge libraries of drug compounds may hold potential treatments for a variety of diseases, such as cancer or heart disease. Ideally, scientists would like to experimentally test each of these compounds against all possible targets, but doing that kind of screen is prohibitively time-consuming. In recent years, researchers have begun using computational methods to screen…
Socrates once said: “It is not the size of a thing, but the quality that truly matters. For it is in the nature of substance, not its volume, that true value is found.” Does size always matter for large language models (LLMs)? In a technological landscape bedazzled by LLMs taking center stage, a team of…