World Association of Newspapers and News Publishers

Tests show Alphabet’s comment-ranking tool mistakes neutral comments as offensive

World News Publishing Focus

World News Publishing Focus
Your Guide to the Changing Media Landscape

Tests show Alphabet’s comment-ranking tool mistakes neutral comments as offensive

Created by Jigsaw, Alphabet’s internal incubator, Perspective was launched earlier this year to help moderate online comments based on their offensiveness. But Engadget discovered that the results of the tool can be extremely questionable, as it ranks neutral sentences such as “I am a gay black woman” as highly offensive.

The problem most likely results from the fact that Perspective’s algorithm looked at existing online comments and deducted that words such as “gay” and “black” often exist alongside offensive comments. But the software is seemingly incapable of making a difference between offensive words and meaning on a sentence level, and concentrates on the former rather than the latter.

The discovery highlights the need for transparency when dealing with algorithms that rank and moderate content. Recently it was discovered that Facebook has in some cases been overzealous in identifying content as “hateful”, seemingly because it was posted by black users.

The New York Times has partnered with Jigsaw in the creation of Perspective, allowing the system’s algorithm to look into and learn from the publisher’s online comment archives.


Teemu Henriksson's picture

Teemu Henriksson


2017-09-05 12:54

Author information

The news publishing industry is experiencing transformation at an ever-growing pace, with new policy issues arising as the landscape changes.

We will be examining policy discussions that will define the news publishing environment of the future, the key topics being internet governance, privacy and copyright. Click here to learn more about our work.

WAN-IFRA Media Policy team and experts.

© 2020 WAN-IFRA - World Association of News Publishers

Footer Navigation