What is Runway's approach to using machine learning for the programmable generation of content, as opposed to editing existing content?

This is a fascinating topic, so much is happening at the intersection of machine learning and video and we are only scratching the surface of what’s going to be possible. I think we're not far from being able to completely generate a film. When I say generate I mean generating every actor, every score, b-rolls, every sound effect, every voice, every visual effect, and every scene in a full-length film. The rise of neural rendering, among other techniques, will enable a new class of filmmaking and video-making possibilities. In a similar way to what happened with the CGI revolution in the early 90s. 

Every once in a while there’s a new technology that transforms a field in ways that were unthinkable or hard to predict. I believe we are in the early stages of a transformation in storytelling driven by neural methods for video and image synthesis. In addition to generative content, machine learning techniques are helping automate every part of the editing process. Quick wins like editing video using text, removing objects from videos, and rotoscoping in seconds are now possible. The mix of automation and generative content is truly fascinating and will equip the next generation of creators with a unique toolbox of expressive tools. Something previously unavailable to past generations of artists and filmmakers.