Comments on: Sorting a Petabyte http://thenoisychannel.com/2008/11/22/sorting-a-petabyte/ Mon, 21 May 2012 05:21:00 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: jeremy http://thenoisychannel.com/2008/11/22/sorting-a-petabyte/comment-page-1/#comment-902 jeremy Sun, 23 Nov 2008 02:59:01 +0000 http://thenoisychannel.com/?p=839#comment-902 <i>Google may be reactionary when it comes to information seeking approaches, but they are at the cutting edge of systems research. </i> Totally agree. In fact, one of my coworkers is fond of saying that when we look back at Google in 30 years, the lasting legacy, how we remember them and how they will have contributed overall to the field of computing, will not be their information retrieval advances. It will be their systems advances. Google may be reactionary when it comes to information seeking approaches, but they are at the cutting edge of systems research.

Totally agree. In fact, one of my coworkers is fond of saying that when we look back at Google in 30 years, the lasting legacy, how we remember them and how they will have contributed overall to the field of computing, will not be their information retrieval advances. It will be their systems advances.

]]> By: Jason Adams http://thenoisychannel.com/2008/11/22/sorting-a-petabyte/comment-page-1/#comment-891 Jason Adams Sat, 22 Nov 2008 07:14:23 +0000 http://thenoisychannel.com/?p=839#comment-891 That's a good way of thinking about it. Petascale computing should be measured in operations per kilowatt hour (or pick your favorite unit of power consumption). That forces the issue to be a combination of system architecture and algorithm design, as it should be. That’s a good way of thinking about it. Petascale computing should be measured in operations per kilowatt hour (or pick your favorite unit of power consumption). That forces the issue to be a combination of system architecture and algorithm design, as it should be.

]]> By: Daniel Tunkelang http://thenoisychannel.com/2008/11/22/sorting-a-petabyte/comment-page-1/#comment-889 Daniel Tunkelang Sat, 22 Nov 2008 05:01:14 +0000 http://thenoisychannel.com/?p=839#comment-889 Given that Google's energy consumption represents a significant cost for their daily operations, I have to imagine they've work on the energy efficiency of MapReduce. And I also suspect they are funding this work at UC Berkeley: http://www.eecs.berkeley.edu/Research/Projects/Data/105613.html Given that Google’s energy consumption represents a significant cost for their daily operations, I have to imagine they’ve work on the energy efficiency of MapReduce. And I also suspect they are funding this work at UC Berkeley: http://www.eecs.berkeley.edu/Research/Projects/Data/105613.html

]]> By: Daniel Lemire http://thenoisychannel.com/2008/11/22/sorting-a-petabyte/comment-page-1/#comment-888 Daniel Lemire Sat, 22 Nov 2008 04:56:46 +0000 http://thenoisychannel.com/?p=839#comment-888 The problem with MapReduce, as far as I can see, is that it is not necessarily power efficient. That's like saying that if I put twelve V8 engines in my car, it will run faster. Big deal. I want to go fast, and save on gas. The problem with MapReduce, as far as I can see, is that it is not necessarily power efficient.

That’s like saying that if I put twelve V8 engines in my car, it will run faster. Big deal.

I want to go fast, and save on gas.

]]>