This software can recognise unseen events in YouTube videos

The researchers are set to present the new method at the Computer Vision and Pattern Recognition (CVPR 2016) conference.

Published: 24th June 2016 05:43 PM  |   Last Updated: 24th June 2016 05:43 PM   |  A+A-


BEIJING: Using deep learning techniques, a group of researchers has trained a computer to recognise events in videos on YouTube -- even the ones the software has never seen before like riding a horse, baking cookies or eating at a restaurant.

Researchers from Disney Research and Shanghai's Fudan University used both scene and object features from the video and enabled link between these visual elements and each type of event to be automatically determined by a machine-learning architecture known as neural network.

"Notably, this approach not only works better than other methods in recognising events in videos, but is significantly better at identifying events that the computer programme has never or rarely encountered previously," said Leonid Sigal, senior research scientist at Disney Research. 

Automated techniques are essential for indexing, searching and analysing the incredible amount of video being created and uploaded daily to the Internet.

"With multiple hours of video being uploaded to YouTube every second, there is no way to describe all of that content manually. If we don't know what's in all those videos, we can't find things we need and much of the videos' potential value is lost," noted Jessica Hodgins, vice president at Disney Research.

When presented with an event that it has not previously encountered, the model can identify objects and scenes that it already has associated with similar events to help it classify the new event.

The researchers are set to present the new method at the Computer Vision and Pattern Recognition (CVPR 2016) conference in Las Vegas on June 26.

Stay up to date on all the latest Tech news with The New Indian Express App. Download now
(Get the news that matters from New Indian Express on WhatsApp. Click this link and hit 'Click to Subscribe'. Follow the instructions after that.)


Disclaimer : We respect your thoughts and views! But we need to be judicious while moderating your comments. All the comments will be moderated by the editorial. Abstain from posting comments that are obscene, defamatory or inflammatory, and do not indulge in personal attacks. Try to avoid outside hyperlinks inside the comment. Help us delete comments that do not follow these guidelines.

The views expressed in comments published on are those of the comment writers alone. They do not represent the views or opinions of or its staff, nor do they represent the views or opinions of The New Indian Express Group, or any entity of, or affiliated with, The New Indian Express Group. reserves the right to take any or all comments down at any time.

flipboard facebook twitter whatsapp