The real issues with "human" anything... speed and bias

As I have thought about human search over the past days, for me it boils down to two main factors as to why it won't be able to compete with a machine. I thought it might be beneficial to share the reasons and what the feedback is like. I will use the latest released human search, Mahalo, in my examples.

Reason #1 - Speed

The simple truth is that a human cannot do something as fast as a computer. We may be able to do "something" better than a machine, but certainly not as a fast. I just read an article about the NYSE and how more and more of the traders on the floor have been fired. Why? Because while they believe that they can get a better deal for their customers, the machines just process the information quicker. And in today's stock market, quicker is better.

Let's look at the topic from the human search POV using the latest human search engine Mahalo. I checked Google's hot trends page for June 1 as checking today provides little on Mahalo as the humans have not caught up with it yet. I picked Katherine Heigl from the list as she had a page on Mahalo. Here is her page on Google Hot Trends and on Mahalo.

The Mahalo page is a directory for links about KH not something that will share current news. The Google page is actually very well crafted allowing the viewer to see what's hot with Katherine across the web from blogs, to news, etc. And just like on Mahalo, you can discuss the actress on Google Groups.

Now to be fair, Mahalo did create a page quickly when the NYC JFK terrorist scare was in the news last week. But how quickly can they do this worldwide? Will Jason be able to afford paying people to sit at a terminal looking for the hot topic and continuously updating it the same way Google, Technorati, etc do?

When I post content on Cn, it immediately is available via a search on Technorati. Is it like that with any human search? Even if I post something in the "top 10k" terms, will it be there? I doubt it.

Competing with Google, Yahoo, Ask and the others on speed won't work.

Reason #2 - Bias

This is a big issue to me. When Jason sits in an interview and says that Mahalo will index the "Top 10,000 searches" that is a fib. What he means to say is, "We will create pages for the Top 10,000 searches, anything else we feel like it and our friends."

This is not just with Mahalo but with anything that is 1-many from a human standpoint. When I ask a friend what is the best flavor of ice cream at Carvel, I expect bias. But I don't expect it from a search service. I expect everyone to be on a level playing field.

I think eventually bias might hurt Jason's site if it gets larger in popularity. How does one determine who gets a page. Will people claim issues of race, ethnic, religion etc? How does someone who runs a human-powered site protect against these type of issues?

Let me illustrate an example: Check the technology page on Mahalo. Look at the names that are there that you can clearly say are outside of the top 10k searches. People such as: C.K. Sample III, Om Malik, Nick Denton, Jason Calacanis, Doc Searls, Jeff Jarvis. Are these people really in the top 10k? No. I doubt it. But they have a page. Why? Because they are in the "know"? So what does a site such as CenterNetworks do to get a page? There is no way to request a page be created. And since I am not friends with Jason, the odds of ever having a page is unlikely.

If Jason asked me for my suggestion, it would be simple. Stick to the Top 10k searches and nothing more. If your name is not in there, don't create a page. Otherwise eventually you will be called out for playing favorites which will make a huge dent in your credibility.

Machines don't have bias (unless they are programmed to). Everyone has an equal chance of making it to the top.

Please note that while I discuss Mahalo in the examples above, there are other human search engines as well. I applaud Jason's efforts in promoting the heck out of Mahalo.

AddThis
Forward
RSS Feed
COMMENTS - Add New Comment
Submitted by Jason on June 6, 2007 - 4:45pm.

Mahalo for the solid feedback.

1. Regarding the breaking news stuff give us a little time. We're just building out our staff and our pace--and the publics pace at contributing to the pages--will increase by the end of the year. Right now you're looking at 5% of Mahalo.

2.Regarding the bias we didn't just do "friends of Jason" we did folks like Nick Denton as well. We basically did a bunch of bloggers and podcasters of note (think the Technorati 300). So, just because I'm a blogger and know Dave Winer, Doc, Jeff Jarvis, and Om Malik don't assume it is bias--those guys are GIANTS in the blogging world. We could be remiss if didn't do them!

That being said, if you think there are bloggers of note (i.e. folks who have been blogging for a long time with large audiences) that we've missed please request their pages and we will do them ASAP.

Mahalo for helping Mahalo.com get a little better every day!

Jason

Submitted by centernetworks on June 6, 2007 - 7:36pm.

Thanks for replying Jason. Let me break down your points a bit...

1. Regarding the breaking news stuff give us a little time. We're just building out our staff and our pace--and the publics pace at contributing to the pages--will increase by the end of the year. Right now you're looking at 5% of Mahalo.

  • I know you are Alpha, I saw your 100x Alpha post. It really wouldn't matter though if you have 10, 100, or every outsourcer in the world, the news moves too quickly. And so what is your employee doing? Going to Google/T'rati/etc to find the news and bring it back? There is still a lag there. How often are pages updated?

2.Regarding the bias we didn't just do "friends of Jason" we did folks like Nick Denton as well. We basically did a bunch of bloggers and podcasters of note (think the Technorati 300). So, just because I'm a blogger and know Dave Winer, Doc, Jeff Jarvis, and Om Malik don't assume it is bias--those guys are GIANTS in the blogging world. We could be remiss if didn't do them!

  • I should have placed a vegas bet that you would say that Denton is not a friend. He is a frienemy and it's important to keep them satisfied as well. Unfortunately, I don't fully buy your reasoning and I believe these pages were created for three main reasons and your reason which might be a 4th reason:
    1. You want them to write about your service and knowing a page is there for them, can help that.
    2. You attend many conferences and it's critical that you can walk up to these "GIANTS" and say that you want to show them their page.
    3. I will go along with your Top 300 bloggers. Though is it all of the 300? Just curious. If so, that would help me get into your camp.
    I can't blame you for doing it, though I disagree with it because of the bias. So you are admitting I guess that it's not the Top 10K searches, it's just what I suggested, Top 10k Plus anyone else you "deem worthy" - which is the bias. And again, I can't blame you for doing so. You would have earned tons of credits with me had you not created a page about yourself before it was the appropriate time to do so.
  • In addition, when I speak about bias, will we always see "friend" links in the top 7? Do sites you are/were affiliated with get bonus treatment? Again, I don't see this in Google. (I am not saying that you do this now, just would like to understand the company policy.)

That being said, if you think there are bloggers of note (i.e. folks who have been blogging for a long time with large audiences) that we've missed please request their pages and we will do them ASAP.

  • Sure, CenterNetworks could use a page. But there is no form for submissions, only for links on a page.

I am trying to provide you with some constructive feedback from someone who has been in the biz as long as you have and has seen bias/favoritism hurt other sites over the years.

Submitted by SEO Mash on June 6, 2007 - 4:57pm.

Very insightful article as always Allen. You do a fantastic job covering search and search related topics.

Personally I don't see Mahalo being ground breaking in the least. How is this better than Wikipedia which has a full description of the topic and relevant external links? More pleasing on the eye for sure, but that is about it.

Submitted by centernetworks on June 6, 2007 - 7:23pm.

Thanks for the kind words SEO Mash, I appreciate it!

What I wonder is if Mahalo would have any coverage at all if the "name" of Jason wasn't behind it. Same thing with Truemors, would anyone care if Guy wasn't behind it? Interesting question to ponder.

Submitted by SEO Mash on June 6, 2007 - 9:42pm.

With search being all the rage these days I believe that Mahalo would have received some press (as an alternative to the "big guys") without Jason's name being attached to it. Certainly the fanfare would have been far less though.

Truemors on the otherhand? That would have been completely DOA without Guy's backing.

It is no different that Tom Cruise being associated with a movie or Madonna with a new album. Even if the work does not have the legs to stand on its own, because it is associated with a known entity people will flock to it.

Submitted by centernetworks on June 6, 2007 - 10:30pm.

I agree with your statements completely. Would anyone else have been able to get Kevin Rose to put his app on the frontpage? Nope.

The question is whether celebrity can help the app for the long-run. Jason is getting interviewed by people that you or I would never be asked by, the question is whether anyone will care in the long run.

To me, I haven't really heard Jason say anything that made me believe he is an expert frankly. In fact, for him to make the statements he did at SES Chicago (all that I have recorded) and then create a search engine himself, makes me really start to question more.

Become a sponsor

SPONSORS

AdRevenue08
Clicky Web Analytics
Web 2.0 Expo Berlin 2008

PARTNERS

read centernetworks anywhere!
Advertise here

OTHER STUFF