New software can recognise unseen events in YouTube videos

New software can recognise unseen events in YouTube videos

Scientists have developed a computer software that can recognise events in YouTubevideos, even those that it has not previously seen.

The new approach uses both scene and object features from the video and enables associations between these visual elements and each type of event to be automatically determined and weighted by a machine-learning architecture known as a neural network.

The approach not only works better than other methods in recognising events in videos, but is significantly better at identifying events that that the computer programme has never or rarely encountered previously, said Leonid Sigal, senior research scientist at Disney Research.

These events can include such things as riding a horse, baking cookies or eating at a restaurant.

“Automated techniques are essential for indexing, searching and analysing the incredible amount of video being created and uploaded daily to the Internet,” said Jessica Hodgins, vice president at Disney Research.

“With multiple hours of video being uploaded to YouTube every second, there’s no way to describe all of that content manually,” Hodgins said. Read more.

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s