Upon looking at photographs and drawing on their past experiences, humans can often perceive depth in pictures that are, themselves, perfectly flat. However, getting computers to do the same thing has proved quite challenging. The problem is difficult for several reasons, one being that information is inevitably lost when a scene that takes place in…
Upon looking at photographs and drawing on their past experiences, humans can often perceive depth in pictures that are, themselves, perfectly flat. However, getting computers to do the same thing has proved quite challenging. The problem is difficult for several reasons, one being that information is inevitably lost when a scene that takes place in…
Many of us easily recognize emotions expressed in others’ faces. A smile may mean happiness, while a frown may indicate anger. Autistic people often have a more difficult time with this task. It’s unclear why. But new research, published June 15 in The Journal of Neuroscience, sheds light on the inner workings of the brain…
Posted by Laura Downs and Anthony Francis, Software Engineers, Robotics at Google Many recent advances in computer vision and robotics rely on deep learning, but training deep learning models requires a wide variety of data to generalize to new scenarios. Historically, deep learning for computer vision has relied on datasets with millions of items that…
Imagine a more sustainable future, where cellphones, smartwatches, and other wearable devices don’t have to be shelved or discarded for a newer model. Instead, they could be upgraded with the latest sensors and processors that would snap onto a device’s internal chip — like LEGO bricks incorporated into an existing build. Such reconfigurable chipware could…
Posted by Basil Mustafa, Research Software Engineer and Carlos Riquelme, Research Scientist, Google Research, Brain team Sparse models stand out among the most promising approaches for the future of deep learning. Instead of every part of a model processing every input (“dense” modeling), sparse models employing conditional computation learn to route individual inputs to different…
From their early days at MIT, and even before, Emma Liu ’22, MNG ’22, Yo-whan “John” Kim ’22, MNG ’22, and Clemente Ocejo ’21, MNG ’22 knew they wanted to perform computational research and explore artificial intelligence and machine learning. “Since high school, I’ve been into deep learning and was involved in projects,” says Kim,…
Collin M. Stultz, the Nina T. and Robert H. Rubin Professor in Medical Engineering and Science at MIT, has been named co-director of the Harvard-MIT Program in Health Sciences and Technology (HST), and associate director of MIT’s Institute for Medical Engineering and Science (IMES), effective June 1. IMES is HST’s home at MIT. Stultz is…
Posted by Paul Hongsuck Seo and Arsha Nagrani, Research Scientists, Google Research, Perception Team Multimodal video captioning systems utilize both the video frames and speech to generate natural language descriptions (captions) of videos. Such systems are stepping stones towards the longstanding goal of building multimodal conversational systems that effortlessly communicate with users while perceiving environments…
Artificial intelligence (AI) has the vast potential to offer innovations to improve every facet of society, from legacy engineering systems to healthcare to creative processes in arts and entertainment. In Hollywood, for example, studios are using AI to surface and measure bias in scripts—the very tools producers and writers need to create more equitable and…