YouTube adds automatic description of audio effects




The YouTube video sharing platform, which is owned by Google, has launched its new audio effects captioning system, which can automatically identify and describe the audio effects of music, sound and laughter in video clips. The company promised to add more capabilities in the coming stages with its training of detection algorithms.

Since 2009, YouTube has used algorithms to illustrate speech within the video automatically, and over the past eight years has tried to make billions of existing videos more user-friendly for deaf or hearing impaired users.

The feature has improved significantly over time, unlike what it was in the beginning, according to a blog published by Google on its website for developers, the advantage is closer than ever to human error rates.

The addition is small but is important for accessibility features of the video sharing platform on the Internet. The ability to spell out sound effects is a difficult task. According to Google engineers, this task could only be achieved through the development over the past two years of automated learning techniques.

The problem is not so much about the ability of computers to detect and classify things. Products like Google, for example, have image detection capabilities, but the problem is that there is no important sound effects database that can be used when training a capable neural network On detection and identification.

The group decided to focus on music, sound and laughter initially because it adds an important meaning to the dialogue within the video for people with hearing loss or hearing difficulties. YouTube has a specialized intelligence algorithm for audio effects after processing thousands of hours of video clips.

The company noted that future updates may include the possibility of adding categories and other common sound patterns such as ringing, barking and clicking, which may represent certain problems for example with the ringing sound, the company needs to be able to determine whether the ringing ringing alarm or ring the doorbell Or ringing the phone.


In: A Technology & Gadgets Asked By: [22034 Red Star Level]

Answer this Question

You must be Logged In to post an Answer.

Not a member yet? Sign Up Now »