Tech

EXCLUSIVE: Documents Detailing Google’s ‘News Blacklist’ Show Manual Manipulation Of Special Search Results

REUTERS/Jim Young

J. Arthur Bloom Deputy Editor
Font Size:

Google does manipulate its search results manually, contrary to the company’s official denials, documents obtained exclusively by The Daily Caller indicate.

Two official policies dubbed the “misrepresentation policy” and the “good neighbor policy” inform the company’s “XPA news blacklist,” which is maintained by Google’s Trust & Safety team. “T&S will be in charge of updating the blacklist as when there is a demand,” reads one of the documents shared with The Daily Caller.

“The deceptive_news domain blacklist is going to be used by many search features to filter problematic sites that violate the good neighbor and misrepresentation policies,” the policy document says. (RELATED: Meet The Five Google Staffers Who Circulated The Petition To Drop Kay Coles James)

That document reads that it was, “approved by gomes@, nayak@, haahr@ as of 8/13/2018.” Ben Gomes is Google’s head of search, who reports directly to CEO Sundar Pichai. Pandu Nayak is a Google Fellow, and Paul Haahr is a software engineer, whose bio on Google’s internal network Moma indicates that he is also involved in, “fringe ranking: not showing fake news, hate speech, conspiracy theories, or science/medical/history denial unless we’re sure that’s what the user wants.”

“The purpose of the blacklist will be to bar the sites from surfacing in any Search feature or news product. It will not cause a demotion in the organic search results or de-index them altogether,” reads the policy document obtained by the Caller. What that means is that targeted sites will not be removed from the “ten blue links” portion of search results, but the blacklist applies to most of the other search features, like “top news,” “videos” or the various sidebars that are returned as search results.

Google CEO Sundar Pichai speaks on-stage during the annual Game Developers Conference at Moscone Center in San Francisco, California on March 19, 2019. (Photo by Josh Edelson / AFP / Getty Images)

In a section of the memo entitled “Eligibility for GNP [Good Neighbor Policy] enforcement,” the types of search results impacted by the policy are described:

“If your product shows any of the following, Misrep and GNP would apply to your PA.

  • Shows content from users and news publishers (percieved 3P voice). Ex: UGC, News corpus, etc.
  • Outputs single answers (perceived to come from the open web). Ex: Web answers, Video answers, etc.
  • Shows content owned, licensed, or edited by Google (perceived to come directly from Google). Ex: Knowledge panels, News summaries, Oneboxes, Munin carousels, etc.”

The “ten blue links” may not be impacted by the blacklist, but virtually every other kind of Google search result is. While hard numbers are not available for how much traffic is directed through the 10 links versus the other search blocks, since the latter appear so high on the results page, the impact could be significant. (RELATED: Applause At Google’s All-Hands Meeting As Company Drops Heritage Foundation President)

“Focus on the user,” said a source at Google who described the program to the Caller. “Users need to trust any content that Google shows them, whether it’s the 10 blue links or other special search results.”

BERLIN, GERMANY – JANUARY 22: Workers push a Google sign from the stage before the festive opening of the Berlin representation of Google Germany on January 22, 2019 in Berlin, Germany. The official opening will take place tonight with Berlin Mayor Michael Muller. (Photo by Carsten Koall/Getty Images)

Sundar Pichai testified before the House Judiciary Committee on Dec. 11 of last year. Democratic California Rep. Zoe Lofgren asked why a search for the term “idiot” returned a photo of President Trump. In response, Pichai said, “This is working at scale, we don’t manually intervene on any particular search result.”

A memo about the deceptive news blacklist was also obtained by the Caller, showing its last edit as Dec. 3, 2018, a week before Pichai’s congressional testimony. This document, which describes the process by which a site can be blacklisted for deceptive news, clearly shows that there is a manual component:

“The beginning of the workflow starts when a website is placed on a watchlist which is used for monitoring of sites to determine if they violate the Good Neighbor Policy. This watchlist is maintained and stored by Ares with access restricted to policy & enforcement specialists working on the Good Neighbor Policy. Access to the listing can also be shared at the discretion of pcounsel and legal investigations on a need to know basis to enforce or enrich the policy violations. The investigation of the watchlist is done in the tool Athena, the Ares manual review tool, and intakes signals from Search, Webspan, and Ares in order to complete reviews. … Once a domain is determined to be violating the misrepresentation policy or the Good Neighbor Policy, such patterns are then added to deceptive_news_blacklist_domains.txt by the Trust & Safety team.”

The document indicates that there is, among other things, a “manual review tool” involved in maintaining the blacklist.

On the blacklist are a number of conservative sites, including Gateway Pundit, Matt Walsh’s blog, Gary North’s blog “teapartyeconomist.com,” Caroline Glick’s website, Conservative Tribune, a property of The Western Journal and the website of the American Spectator.

“You can’t trust the human judgment of Google’s Trust and Safety team,” said the source at Google with knowledge of their practices.

Requests for comment from Google’s press team have gone unreturned as of publication time.

Update: A Google spokesperson provided the following statement to the Daily Caller after this story was published: “We do not manually determine the order of any search result, nor do our algorithms or policies attempt to make any judgement on the political leanings of a website. Our Google News inclusion policies are publicly available online. They provide guidelines on content and behaviors for matters like sponsored content, deceptive practices, and more. Sites that do not adhere to these policies are not eligible to appear on news surfaces or in information boxes in Search. These policies do not impact the way these sites appear in organic blue-link Google Search results.”

Follow J. Arthur Bloom on Twitter

PREMIUM ARTICLE: Subscribe To Keep Reading

Sign up

By subscribing you agree to our Terms of Use

You're signed up!

Sign up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!

Sign up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!

Sign Up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!
BENEFITS READERS PASS PATRIOTS FOUNDERS
Daily and Breaking Newsletters
Daily Caller Shows
Ad Free Experience
Exclusive Articles
Custom Newsletters
Editor Daily Rundown
Behind The Scenes Coverage
Award Winning Documentaries
Patriot War Room
Patriot Live Chat
Exclusive Events
Gold Membership Card
Tucker Mug

What does Founders Club include?

Tucker Mug and Membership Card
Founders

Readers,

Instead of sucking up to the political and corporate powers that dominate America, The Daily Caller is fighting for you — our readers. We humbly ask you to consider joining us in this fight.

Now that millions of readers are rejecting the increasingly biased and even corrupt corporate media and joining us daily, there are powerful forces lined up to stop us: the old guard of the news media hopes to marginalize us; the big corporate ad agencies want to deprive us of revenue and put us out of business; senators threaten to have our reporters arrested for asking simple questions; the big tech platforms want to limit our ability to communicate with you; and the political party establishments feel threatened by our independence.

We don't complain -- we can't stand complainers -- but we do call it how we see it. We have a fight on our hands, and it's intense. We need your help to smash through the big tech, big media and big government blockade.

We're the insurgent outsiders for a reason: our deep-dive investigations hold the powerful to account. Our original videos undermine their narratives on a daily basis. Even our insistence on having fun infuriates them -- because we won’t bend the knee to political correctness.

One reason we stand apart is because we are not afraid to say we love America. We love her with every fiber of our being, and we think she's worth saving from today’s craziness.

Help us save her.

A second reason we stand out is the sheer number of honest responsible reporters we have helped train. We have trained so many solid reporters that they now hold prominent positions at publications across the political spectrum. Hear a rare reasonable voice at a place like CNN? There’s a good chance they were trained at Daily Caller. Same goes for the numerous Daily Caller alumni dominating the news coverage at outlets such as Fox News, Newsmax, Daily Wire and many others.

Simply put, America needs solid reporters fighting to tell the truth or we will never have honest elections or a fair system. We are working tirelessly to make that happen and we are making a difference.

Since 2010, The Daily Caller has grown immensely. We're in the halls of Congress. We're in the Oval Office. And we're in up to 20 million homes every single month. That's 20 million Americans like you who are impossible to ignore.

We can overcome the forces lined up against all of us. This is an important mission but we can’t do it unless you — the everyday Americans forgotten by the establishment — have our back.

Please consider becoming a Daily Caller Patriot today, and help us keep doing work that holds politicians, corporations and other leaders accountable. Help us thumb our noses at political correctness. Help us train a new generation of news reporters who will actually tell the truth. And help us remind Americans everywhere that there are millions of us who remain clear-eyed about our country's greatness.

In return for membership, Daily Caller Patriots will be able to read The Daily Caller without any of the ads that we have long used to support our mission. We know the ads drive you crazy. They drive us crazy too. But we need revenue to keep the fight going. If you join us, we will cut out the ads for you and put every Lincoln-headed cent we earn into amplifying our voice, training even more solid reporters, and giving you the ad-free experience and lightning fast website you deserve.

Patriots will also be eligible for Patriots Only content, newsletters, chats and live events with our reporters and editors. It's simple: welcome us into your lives, and we'll welcome you into ours.

We can save America together.

Become a Daily Caller Patriot today.

Signature

Neil Patel