Monday, August 26th, 2013

The Next Google: It's Like Google, But For Search

It is no longer appropriate for search to be under the thumb of private industry. It's a critical part of the national infrastructure. So if I were a real pinko, I'd be advocating for the nationalization of Google, à la Chavez—but I'm not a real pinko. Besides, the American people have already bought and paid for an ideal alternative to Google. That's right: we have the means in hand to create a public, ad-free, totally fair and reasonably transparent search engine with a legal mandate to operate in the public interest, and most of the work is already done. We have also a huge staff of engineers to conclude what little remains on the development and deployment side.

Who are these American heroes, soon to be accepting the thanks of a grateful nation? Why, our fellow citizens, the software engineers and tech gurus and endless numbers of contractors of the NSA! Why don't they make themselves useful and stop spying on everyone and instead, use all that computing power and archived information to make us a fair, fast, ad-free search engine?

They have a copy of the whole Internet, soon to be housed in their giant bunker in Utah!

It is already, apparently, equipped with the latest in search technology! It's probably already better than Google.

Others make their case against Google on antitrust laws. It's not illegal to have a monopoly. According to U.S. courts, it's just not your fault that everybody loves your product! What's illegal is using that power to do bad things, like suppress your own competition. This is why there are ongoing government investigations into Google's anti-competitive business practices in the U.S., in Canada and in Europe.

Probes like these have so far tended to focus on Google's preferential treatment of its own services over those of its competitors in Google search results. Which amounts to ignoring the elephant in the room: Google, with its 67% share of U.S. search traffic (sounds low, tbh), has a potential influence far beyond the industries in which it operates formally. At the moment, Google can legally use its power to make or break any business, or any politician, publication, or public figure it chooses, for any old reason it wants, provided that reason doesn't fall foul of antitrust laws.

For instance, let's suppose one of Google co-founder Sergey Brin's friends were to open a new cafe in Mountain View: there is no legal proscription whatsoever against Google's vaulting the Friends o' Brin Cafe to the top of results on searches for "best cafe Mountain View." Or even "best cafe."

A close reading of Google's ten "Core Principles" appears to suggest, but not quite guarantee, that Google won't simply grant preferential treatment at its own discretion. The fact is, however, that it's entirely up to them. Given the understandably secret nature of Google's algorithms and other techniques for determining search results, it would be impossible to say whether or not this is in fact already happening.

Already companies live or die at the hands of Google. Any update to the Google Panda search ranking algorithm has rippling effects through the Internet. One thing that seems to be the case: older sites, with thousands of internal links and a deep history on the Internet, seem to be constantly downgraded. That's bad news for some non-spam media companies that in part live off search traffic. Google results, in general, overweight newness. It is becoming more and more impossible to find relevant results older than three months.

As well, Google will tell you that active engagement with their product Google+ will be "beneficial" to any publisher as a whole, including in search. Publishers now ignore Google+ at their peril, whether it is relevant to their business or not.

But let's take the real case of, the "privately-held personal genetics company" whose CEO, Anne Wojcicki, is married to Sergey Brin. According to recent SEC filings, Google invested approximately $1.5 million in the company's Series D round, and Google leases office space to the company. Here's the current results for a search on the phrase "genetic testing":

23andMe is the first paid result; the first result appearing below Wikipedia and the National Institute of Health is also 23andMe. If Ms. Wojcicki has privileged access to the inside scoop on how Google's search rankings work (if!), or if Google merely wants to shoot her company's links to the top of relevant searches, would that even contravene existing anti-trust laws?

Nope, according to James Grimmelmann, Professor of Law and Director of the Intellectual Property Program at the University of Maryland:

There is not any obvious law that this kind of favoritism would violate. It does favor one genetic testing company at the expense of another, but you're right that this doesn't directly suppress competition among search engines. I have seen arguments that this kind of favoritism is an antitrust issue, but the lack of direct injury to a competitor, and fact that Google is not itself competing in genetic testing, make that argument extremely tenuous. The argument is stronger for something like maps or social networking features, but there, Google can point to the obvious benefits to consumers of having a single integrated set of results.

In this article draft, I give a detailed analysis of whether one of the other testing companies could sue on the theory that Google is falsely claiming that it's less relevant than 23andme. That's a hard, though not completely impossible, case to make because the meaning of "relevant" is deeply ambiguous.

The final possibility would be an enforcement action by the FTC for deceiving consumers. If 23andme were owned by Google, a disclaimer would probably suffice to satisfy the FTC. It's a little different where the connection is more attenuated. But because they're primarily policing for hidden marketing, a clear disclosure of the relationship would be likely to satisfy them.

The potential for shenanigans is also problematic in view of Google's cozy relationships with its VCs who, being invested in businesses other than Google, are liable to have a strong incentive to throw their weight around in Google's search results. As matters stand right now, it would be perfectly legal for them to do so, and nearly impossible to detect.

A number of Google's liabilities with respect to fairness are ably illustrated in "Can Google Be Trusted?," a grimly amusing little slideshow from, a group of businesses and organizations "fostering and defending competition in online and mobile search." (Hilariously, the group counts the much-sued monopolist Microsoft among its members.)

I asked Brewster Kahle of the Internet Archive and the Wayback Machine some questions on this.

Would it be illegal for Google to disfavor competitors in their search results? Are they required to be impartial and if so, by what laws? What about blacklisting in search results for other reasons?

Maybe antitrust like they are getting hit for in Europe.

What do you think about the secret nature of the algorithm Google uses to produce the results? What do you think about the SEO world, these days?

It is not great. That company is becoming both the navigation and the publisher, which will make for conflicts of interest.

It would be great to let a hundred Googles bloom—but it is difficult to match them in search. They are on a roll.

But we don't need a hundred Googles. Just one free, fair, intelligent and comprehensive one. All we need to do is permanently erase all the emails, phone calls and private correspondence illegally obtained by the NSA and then make their search technology and WWW archive available to the rest of us. We already own the information and the software and are paying the salaries of these engineers. It's been entirely funded, after all, with insanity-making amounts of your tax dollars.

Maria Bustillos is a journalist and critic in Los Angeles.

16 Comments / Post A Comment

deepomega (#1,720)

I dunno, given how often the NSA accidentally retrieved phone numbers from the wrong COUNTRY, seems like their search algorithm could use more polishing.

Anarcissie (#3,748)

@deepomega — Yes, I certainly would not count on the NSA for search functions. They could, of course, use Google's, having already stolen them.

SidAndFinancy (#4,328)

What next — music on Music Television?

1599935088@twitter (#247,517)

@SidAndFinancy Good one..

Adam_CabinetMaker (#247,513)

I'm not sure I would be interested in giving the NSA more authority over the internet. I don't agree that Google should give preferential treatment either but asking the government to control another portion of the internet is just asking for trouble. Just my 2 cents, for what it's worth.

63664906@twitter (#247,515)

It is obvious that Google is partial to their properties (such as youtube) but I think they need to be monitored by the FTC so that when they list their terms of service they also abide by them. Its clear that if a small website violates their TOS they are punished.If Google,youtube or any of their own sites does this nothing happens to that site.

1599935088@twitter (#247,517)

I don't want the gov't any closer to me than they already are. I don't trust the NSA, CIA, etc.. this makes them NFG for me.

BassBoat (#247,523)

right, let's let our government get involved in the internet. They can't add 2+2 correctly without an overrun. Trust me on this one, Google will fall from grace like all companies that do not address the concerns of their customers. See Sears, Woolworth, Packard, Kodak, A&P, and 100's of others for examples. Believe in the free market and you will prosper. It will take years but I would rather have google doing the net than the government anytime.

scrooge (#2,697)

@BassBoat Believe in the free market and you will prosper???? Did you notice the financial crash, by any chance? Bailed out by the government? The government which created the internet? Maybe you were "Gone Fishing" at the time?

rxantos (#247,577)

You are wrong. The problem is not capitalism.

Is the mixture of government and corporations (aka fascism) that created globalization (the next logical step for fascism).

Globalization in turn condensed capital on few corporations.

If government did not bailed out the banks, then they would have being forced to sell their properties or to make deals with the people that where faulting on their mortgates. Lowering the price to own a home.

Your so called government sold you out for the best bidder a long time ago. Thats the problem.

gigli (#247,524)

First of all, the idea is very centralized, anyone who doesn't live in the USA, will not see a "national search" they will see a USA controlled search, and believe me, no one wants that, in fact because of the NSA a lot of people is searching for services not based on the USA.

1770721@twitter (#247,526)

Oh yeah, b/c government-backed institutions NEVER play favorites or abuse their monopolies!

570303239@twitter (#247,537)

WTF. Governments,Managing who, what,where,and why,Your politician is a messenger boy/girl for the technocrats of Multi-corporations, Banking institutions that control a Fiat Currency of a delusionary economy, backed by your cheap labour and tax enslavement for the Multi-Corporation and the esteem monopoly money printing company. "The Federal Reserve Banking System" time to wake up for what is coming down the line for:

570303239@twitter (#247,537)


If you have not notice the google logo, check out the big O's and see who's keeping tabs on us in the name of safety. from the BOGEY-MAN?

T.P. (#247,556)

"They have a copy of the whole Internet, soon to be housed in their giant bunker in Utah!"

First off – you don't "copy" the "internet". The Internet is nothing more than a bunch of routers connecting computers together allowing them to communicate. You might "copy" (or "archive" as it is more appropriately called) the World Wide Web, and you might archive all of the communications going on across the Internet, such as: who went where on the web; who submitted what on what web site's form; who sent who what email; who voice chatted with who, and what was their conversation. These are things you can "copy" – they are the data that the internet carries (in many cases for just brief moments.)

Now lets move to the the next line:
"It is already, apparently, equipped with the latest in search technology! It's probably already better than Google."

It is absurd to think they designed a better search algorithm than Google's. They won't even have the same goals. The NSA is going to be looking for very specific things in the data – they're not designing an algorithm to find the most relevant web pages for a given search term – they're designing algorithms to find hidden communications between terrorist cells (and other nefarious activities.) And that's what they need to keep doing.

Add to all of that the fact that this is the NSA we're talking about – not exactly known for being the sharing types! I can't help but laugh at the thought of them being responsible for a public search engine. I doubt many would trust it. Can you imagine the articles on all the blogs, conspiracy and otherwise?

I'm not saying there isn't a need to keep an eye on Google's practices, the fact they can so easily have an effect on one companies future is scary, but lets look to realistic solutions – not NSA sponsored search engines.


P.S. I couldn't find a single document online that made the same claim as you – that the NSA had made a copy of the internet. I did find this very interesting fact (from March 2013:) "In just 60 seconds, nearly 640 terabytes of IP data is transferred across the globe." So to keep an archive of the data flowing across the internet, one would need .87 Exabytes – for one day – or 320 Exabytes for a year's worth (and that doesn't account for the exponential growth of the internet – every day you'd need a little more…)

To put that in perspective for everyone, a single Byte can hold 8 characters of text (in most languages.)
1 Exabyte ~= 1,000,000,000,000,000,000 bytes
(that's 10 to the power of 18)


rxantos (#247,577)

Since the NSA already controls google. Your argument is moot.

Post a Comment