Released in July 2016, Pokemon Go soon became the most popular game in mobile phones. It uses augmented reality (AR) to superimpose a virtual Pokemon like Pikachu on top of your camera’s viewfinder. However, in traditional AR, there is no interaction between the virtual Pokemon and the real background. Researchers from MIT have developed "Interactive Dynamic Video", a technology that allows the background to interact with Pokemon and virtual forces. It analyzes video clips to find vibration patterns at different frequencies, which represent distinct ways that an object can move. These patterns are used to simulate an interactive video by predicting how these objects will move in new situations. Please visit http://interactivedynamicvideo.com/ for more detailed information.

Interactive Dynamic Video.

Pokemon GO and Interactive Dynamic Video.

Courtesy of the researchers.