Google’s New Competitor: 1 Geek

By Steve Poland   •   April 3, 2009

Aside from all the marketing problems of having the next Google and getting people to use it (not to mention the huge pool of advertisers Google has w/AdWords; nor to mention all the filtering of spam webpages that exist out there), in the past couple of days, some really neat services have released that will allow any single programmer to build their own Google at minimal cost. I’m really excited by this.

Hadoop is an open-source program that Yahoo, Wikia Search (R.I.P.), Facebook, Powerset (MSFT acquired for $100mm and likely is relaunching this technology w/$100mm of new branding, code named ‘Kumo‘ at the moment) and others use to process/index tons of webpages on the Internet. Amazon.com just announced Amazon Elastic MapReduce, basically allowing anyone to easily do web-scale data processing (Hadoop was actually inspired/based on Amazon’s MapReduce).

Next, a startup called 80legs got to strut their stuff at the Web 2.0 Expo in SF. 80legs allows anyone to easily crawl the web quickly — up to 2 billion pages a day (there’s over a trillion on the web).

No longer does one need to invest a boatload of money for a 1000 servers to handle Hadoop (only to find-out they can’t pull off the next Google competitor).




Related posts:

  1. Google Acquiring Digg – Rumor Valleywag is reporting Google is digging around to acquire Digg. A few months ago I felt the best acquirer would be CNET — I wasn’t thinking of the bigger picture. I was thinking Digg/CNET would...
  2. IDEA #77 – Social Search Engine (take on Google) Another idea for NYC Startup Weekend this weekend… The Idea: Social Search Engine [take on Google!] (fb app / browser plugin / toolbar) The Concept: Take-on Google with a social search application. Users do a...
  3. VIDMETER: Still Early, A Competitor Should Launch I’m fascinated by Vidmeter and feel there is so much potential for that site. I was checking out their widget, which displays the top 10 videos — but it’s either an IFRAME or in javascript…...
  4. Attn: Google AdSense Employee – I need help If someone works at Google, can you help me get my AdSense account to work. I had AdSense pre-google account roll-over, and I never switched it over to my Google Account. Anyhow, the automated support...
  5. My Guest Post on Shoemoney: Gaming Google AdWords I did a guest post over on Shoemoney’s blog yesterday — “Gaming Google AdWords with Google redirects“. SHARETHIS.addEntry({ title: "Google’s New Competitor: 1 Geek", url: "http://blog.stevepoland.com/googles-new-competitor-1-geek/" });...

Related posts brought to you by Yet Another Related Posts Plugin.

Comments

3 Responses to “Google’s New Competitor: 1 Geek”

  1. MyAvatars 0.2 Robert on April 3rd, 2009 9:00 pm (perm link)

    Actually, Hadoop was based on Google’s MapReduce, not Amazon. Amazon’s is just a reconfigured EC2 server with Hadoop.

  2. MyAvatars 0.2 Gabriel Weinberg on April 23rd, 2009 3:01 pm (perm link)

    Hi, I’m doing exactly what you describe, i.e. I’m one geek attempting to build the next Google. It’s called Duck Duck Go: http://duckduckgo.com/. Would love your feedback and would happy to answer any questions if you want to do a review/profile :) . Some more info is at http://duckduckgo.com/press.html & http://duckduckgo.com/about.html

    Gabriel Weinberg
    Duck Duck Go Founder

  3. MyAvatars 0.2 George Port on August 18th, 2009 3:17 am (perm link)

    Sounds good Gabriel, i’ll take a look at it

Got something to say?





*
To prove you're a person (not a spam script), type the security word shown in the picture. Click on the picture to hear an audio file of the word.
Click to hear an audio file of the anti-spam word