You’re not alone if you’ve ever thought it’s challenging to “un-train” YouTube’s algorithm from proposing a particular kind of video after it starts showing up in your recommendations. In fact, getting YouTube to comprehend your preferences correctly can be even harder than you think. The fact that YouTube’s in-app controls, like the “dislike” button, are mainly ineffectual as a tool for regulating suggested content, according to recent study by Mozilla, is a significant problem. These buttons “avoid less than half of unwelcome algorithmic recommendations,” the research claims.
Researchers at Mozilla used data gathered from RegretsReporter, its browser extension that allows people to “donate” their recommendations data for use in studies like this one. In all, the report relied on millions of recommended videos, as well as anecdotal reports from thousands of people.
Mozilla tested the effectiveness of four different controls: the thumbs down “dislike” button, “not interested,” “don’t recommend channel” and “remove from watch history.” The researchers found that these had varying degrees of effectiveness, but that the overall impact was “small and inadequate.”
Of the four controls, the most effective was “don’t recommend from channel,” which prevented 43 percent of unwanted recommendations, while “not interested” was the least effective and only prevented about 11 percent of unwanted suggestions. The “dislike” button was nearly the same at 12 percent, and “remove from watch history” weeded out about 29 percent.
In their report, Mozilla’s researchers noted the great lengths study participants said they would sometimes go to in order to prevent unwanted recommendations, such as watching videos while logged out or while connected to a VPN. The researchers say the study highlights the need for YouTube to better explain its controls to users, and to give people more proactive ways of defining what they want to see.
“The way that YouTube and a lot of platforms operate is they rely a lot of passive data collection in order to infer what your preferences are,” says Becca Ricks, a senior researcher at Mozilla who co-authored the report. “But it’s a little bit of a paternalistic way to operate where you’re kind of making choices on behalf of people. You could be asking people what they want to be doing on the platform versus just watching what they’re doing.”
Mozilla’s research comes amid increased calls for major platforms to make their algorithms more transparent. In the United States, lawmakers have proposed bills to scale back “opaque” recommendation algorithms and to hold companies accountable for algorithmic bias. The European Union is even farther ahead. The recently passed Digital Services Act will require platforms to explain how recommendation algorithms work and open them to outside researchers.
