Is Google Beatable by Re-inventing Search?

Posted by | search engines | No Comments

Powerset have a demo out and its interesting, technically proficient and built by a solid team, but winning requires questioning the premise: is better search a problem and is it solved by changing the way people are currently used to searching to the the way people naturally speak?

Google is a long term threat to Microsoft’s hegemony not by having built a better OS, but by owning Search. The web shifted the landscape of technology and a a once niche application, dominated by companies like Verity: full text search, became the ‘command line of the web’. Since Microsoft had always owned the command line, this made web search a strategic threat.

Powerset has some very bright people like Barney Pell behind it, and who am I to challenge it, but I have a nagging doubt, which is to do with my years spent in architecture rather than technology. In architecture the first thing you do is question the brief: if someone asks you for a building with a sloping facade, you ask why and you may have a good reason for doing something differently. If someone asks you for a better search engine, you would ask why. Here is my asking why.

If the value in building a better search engine is to beat Google, perhaps Google can only be beaten when something other than a search engine becomes a starting point for the web. It doesn’t take a stretch of the imagination to see that if Facebook became a truly monopolistic social network it would be a strategic threat to Google. If building a better search engine is the way to beat Google then Powerset is on the right track.

Is the way to build a better search engine based on the ability to answer questions the way they are spoken? If so, then natural language technology is the right approach and Powerset is on the right track. A few years ago this would definitely be the case, but these days, the ergonomics of the web have evolved in tandem with Google. People don’t tend to type question into search engines, but type a few salient words. This may not be the most elegant practice, but it is the de facto standard behavior and to try and change it might be like trying to change the QWERTY keyboard for a more rational one.

Assuming that there is a better search practice than currently used, how does Powerset stack up when natural language queries are typed into it. This would require very thorough testing, but I’ll give on example: ‘who was churchills father’ [sic]. Both sites return the correct answer, but Powerset requires adding an apostrophe: churchill’s, not a big deal for them to fix but a perfect example of how a simple grammatical rule dealt with by query parsing can sometimes get forgotten in the attempt to index perfectly.

Lastly, intelligent indexing comes at a cost – it may be slower to query, and it is definitely slower to index. Quick response time has always been a priority for search – and Powerset can possibly match. But the biggest change on in search in this second phase of the web, has been the rise of ubiquitous, news style (e.g. weblog) publishing systems and the importance of search by date. AltaVista’s last throw of PR success against Google was their news search which was pounded after 911, before Google News, let alone weblog search existed. Fast updates require fast indexing.

I wish Powerset every success, and think that this will come when something else is thrown into their mix.

Crossing the Chasm Jumps the Shark

Posted by | software design | No Comments

Leigh Himel sensibly questions whether Crossing the Chasm is still relevant Not only are many technology products part of a mature market where design is a premium over features (expensive hifis have few features and sound good and these days iPods are like this), but Leigh suggests that people themselves as technology buyers are maturing which changes the marketplace overall.

I’d go one step further: crossing the chasm was and still is pseudo-scientific nonsense. Nonsense, because it takes something that is true but ultimately dull (the ubiquitous bell curve) and slices it into a shape that is practically impossible to translate to any mathematical model of real events and which has no empirical evidence of existence anywhere, anyway.

Crossing the Chasm works as a meme the way self help books, therapy, diet pills or creationism do – it provides a too good to be true gimmick explanation for the way things are that appeals to people who want the truth to be convenient, and easily memorizable rather than understandable and based on evidence.

To be fair, the original book was less pernicious because it was more qualitative than subsequent interpretation. But that’s to say its harmless, in the way that homeopathic water is more harmless than blood letting. Neither are provably effective.

One thing is for sure, the Internet has created a landscape for reliable, realtime, quantitative analysis of marketing, and with it the marketing landscape itself is maturing.

I bequeath to you all my dung

Posted by | business | No Comments

The Guardian today has a good article on why Origins.net’s latest genealogical database is a particular gem, putting online a particularly rich set of English wills from 1470 to 1856. The wills show just what people left to each other, hundreds of years ago, including a Mrs Adowne who was fulfilled when her dying tenant, Robert Sherlocke, granted her “all the soil and dung that I have”.

Article here.

The wills can be accessed by subscription, here.

Does Social Networking Kill Search?

Posted by | Uncategorized | 2 Comments

Despite the attention grabbing headline, this article raises a simple and fair point that search brings results base upon links from people you don’t know, whereas Social Network search could return results your friends like.

There are actually three rather than two possible models on the Internet:

The Curations model: experts recommend.
The Search model: the crowd recommends.
The Social Network model: friends recommend.

Each will have its place and will be based upon the economics and availability of people producing the content people are looking for.

For example the Yellow Pages market will possibly fragment:

1. Curations: Zagats expert or Weblog writing key influencer model will work for high end restaurants and items you see in fashion magazines etc. (1 Zagats review of Nobu beats 100 Pizza eating teenage reviewers).

2. A Social Network will work for where trust is required (I’d rather trust my friends over a celebrity to recommend a Baby Minder).

3. The Search model for things like commodities based on price, such as where to buy Vacuum Cleaner (my friends might not know the best deal).

There will be overlap between the services and the types of things that they are useful for, but all three will survive as separate entities.

Overheard – MacBook Air ad.

Posted by | diary | One Comment

No idea of the source of this. Perhaps its some kind of Apple ad making fun of the PC guy, more likely a Stephen Colbert spoof Someone from an ad agency or production company was on the phone, in our lobby, talking about an Air ad and it sounded pretty amusing:

“…so we were going to run the ad, Stephen wanted us to run the ad where he takes a MacBook air out of a manila envelope, writes an email on it, puts it back in the envelope and mails the Air to the email recipient – because thats how he thinks email works on the Air.”

The Top 25 Most Valuable Blogs – and the least valuable list of them

Posted by | Uncategorized | No Comments

This list of the supposed 25 most valuable blogs aint worth a dime.

1. I know the actual numbers for a few of these properties, they are very different.

2. The list is note even close to complete – where are Treehugger, Popsugar etc. etc.

3. Alexa rank is largely irrelevant for these sites.

4. The multiple of CPM naively assumes all ad inventory is sold, this is never the case.

5. A five minute search will get you traffic numbers that are wildly different (remember the traffic numbers don’t tend to be secret because thats what publishers have to reveal to get advertisers). Drudge report under 10M page views per month? Absolutely clueless. This is out by a colossal factor of 50! Gawker actually publishes the live traffic stats through a third party and these are tracked in the same way as Quantcast so of course they are the same.

6. The operating margins are out by 30 – 40% for the properties I know.

In short, this list is put together by someone who does not know what a blog is, what the top blogs are, how they sell ads or what it costs to run them. In terms of making an effort to find out what he does not know, he has traffic stats that are less than 2% accurate for some, when the actual figures are published on the web by multiple verifiable sources and searchable within 10 seconds. If this were a high school project, it would be embarrassing.

Nice to see that our sites at Curations would come in the top 15 and our operating margins are higher than any here – even if they are wildly out.

Bebo vs Sharethis

Posted by | Uncategorized | One Comment

Widgets, like the name suggests, are little things, not fully fledged services – they are the shareware of web and may have eyeballs worth as little as PKZip (remember that): Zip! Caveat Investor: very few widgets should be companies.

What is the connection between Bebo, who were acquired for $850M today and Sharethis who have just raised a Series B of $15M from DFJ?

The connection is that Sharethis’ page views, which justify such a high valuation for a widget, are worth less than the sub 50c CPM for social networks that is already spooking the ad driven online ecosystem.

Sharethis’ series B will be based on the idea that they can fold in ads to the widget, rather like Feedburner did with RSS. But the ad opportunity, the value ad, and the switching cost are not the same as Feedburner, and the reach is nothing like the ginormous number that might have critical value.

This is a bubble that will collapse soon. Why? Because if you believe the hype, then the little pagecounter widgets you put at the bottom of a page are worth more than the page, Sitemeter would be worth a billion.

Sitemeter is not worth the same as Bebo. A widget on a page is worth less than the page itself and people can switch widgets.

Brooklyn Schools Look Like Prisons

Posted by | Uncategorized | 2 Comments

photo.jpg

Everyone goes on about how great it is with kids, to live in Park Slope, Brooklyn. Its a district that is awash with strollers and of-the-moment wine bars, and people making an effort to say why its better than living in a shoe box in Manhattan. Which if it has to be said, raises suspicion, since almost anything is better than living in a shoe box.

But the amazing thing is that the primary thing people think about with urban kids is schools. People fight to get their kids into the schools in Park Slope, which is gobstoppingly amazing, considering what they look like.

This is the local elementary school – which looks like a Northern Irish. prison, before the ceasefire, with a sarcastic multi colored sign by Banksy.

Why Google May Have a Problem

Posted by | Uncategorized | No Comments

Henry Blodget Spells out the Google problem that people have been ignoring, brilliantly.

Until recently everyone seemed to blithely assume that Google is immune to an ad spending pullback because its ads are performance based.

Wrong. Blodget points out the 800lb gorilla in the room, via an ad industry source. Google makes its money selling CPC ads not CPA ads.

If the average amount spent per click drops, because people spend less, then the value per click drops and therefore so does the CPC revenue.

Swarm Democracy – Wikileaks is down, but not for the reasons you think

Posted by | Uncategorized | No Comments

A California court order takes Wikileaks down, over a juicy story linking a venerable Swiss bank to money laundering – something that the bank possibly has no idea is a perfect web conspiracy meme.

This makes everyone who has never heard of Wikileaks now know about its existence and at the time of this post, the site, stripped of its domain name, available at its skeletal Swedish IP: http://88.80.13.160/wiki/Wikileaks is now down – not because the court demands it, but because it cannot handle the traffic.

Thanks to the court order, Wikileaks is here to stay, because of the will of the majority, not the powerful or vocal.

In the same way, Wikipedia is refusing to take down pictures of Mohammed and Scientologists have, for the first time, failed to carry through with threats to sue, over leaked videos of Tom Cruise.

However trivial or small scale these examples may seem at the moment, like someone refusing to move on a bus, my bet is that this is a genuine phenomenon with far reaching implications. These actions represent the will of the majority, independent of legal loopholes, swarm democracy with direct rather than elected representation. The middle man of the parliament, congress, assembly or court has been removed. The Internet is redefining the role of many middle men, from music industry executives to realtors, but this is the top of the pile.

It will be interesting to see if it remains benign, swarm democracy rather than mob rule, but if you buy the democracy schtick, then you have to allow it to be tested.

Ingroup and outgroup thinking

Posted by | Uncategorized | No Comments

A lot of chatter about this article in Scientific American which discusses research that shows the area of the brain involved with prejudice and the success of focusing on similarity to reduce it.

How Harvard students perceive rednecks: The neural basis for prejudice Blogs Scientific American Community

This is a subject I am fascinated by, if I had to pick a single criterion to judge people by it wouldn’t be how nice they are, but how nice they are to people who are not part of their tribe.

I have noticed, for example, that people who belong to very strong social or cultural groups are more friendly than average if you belong to that group, or if you accept the mores of that group. The same people are less friendly if you don’t belong or go along, and most intransigent when it comes to personal compromise in order to eliminate personal differences between groups.

This can be anything from what team you support, skin color, religion, nationality or taste.

In other words, a civilized society depends not on the people who are currently the most civilized, but those who are most willing to accept change, as social or cultural groupings change, split or coalesce.

Inevitably this means reasonable people rather than faithful people.