Categories
General

Journalism Is Not Like Craigslist

In response to a meeting sponsored by the Newspaper Association of America about “Models to Monetize Content” (i.e., how to charge for online news), Scott Rosenberg writes that charging for articles could hobble the future of journalism.

His main argument is an appeal to analogy: the classifieds business:

In at least one area, the newspaper web sites of the 90s didn’t give away the store…But the greatest success of all came in the unlikely form of Craigslist, a community-based enterprise led by a shy programmer who offered classifieds not as a profit-making enterprise but (in all but a tiny subset of categories) as a free service. As a result, newspapers’ classified businesses today have been devastated.

It’s a sobering point: staying the course is not always the best strategy, and Craigslist is certainly a case study in disruptive innovation. As a user, I find the Craiglist user experience awful. But it turns out that price (to sellers) often trumps user experience–though I would note that, at least in New York City, many people still pay to have their apartments listed in the New York Times real estate section.

But journalism is very different from the classifieds market. Classifieds are the the canonical example of a peer-to-peer business. You hardly need to consider a quasi-altruistic endeavor like Craigslist–consider what eBay did to the classifieds market by reducing its friction. Sellers and buyers are naturally incented to participate, so it’s just a matter of supplying the right infrastructure and then taking enough of a cut to sustain that infrastructure and, in the case of eBay or other for-profit market places, a bit more than that to make a profit.

I’d like to see someone explain how free online journalism is supposed to work that way. Sure, there are content producers and consumers, but these roles aren’t quite like sellers and buyers if a world where no one pays for content. Of course the status quo is the ad-supported model, where what is being sold for money is the readers’ attention, rather than the content itself. But the advocates of this model might want to remember that free, ad-supported print media has existed far longer than the internet. I believe the technical term for such a publications is “rags”. Not exactly “change” I can believe in.

I’m realistic that it will be very hard for newspapers to put the free content genie back in the bottle. But I cringe when I hear pontification against their even trying to do so. I think they belatedly recognize their mistake, and are desperately trying for a do-over.

Categories
Uncategorized

Page’s Law? Try Wirth’s Law. Or Gates’s.

I hesitate to cite Valleywag as a news source, but I did read there that Sergey Brin is crediting fellow Google co-founder Larry Page with “Page’s Law“, the assertion that software gets twice as slow every 18 months, and thus outpaces Moore’s law.

Fortunately for Page, he is already assured of a solid entry in the history books. Because Page’s Law sounds suspiciously like Wirth’s law, pronounced by computer science titan Niklaus Wirth in 1995: “Software is getting slower more rapidly than hardware becomes faster.” In fact, the more precise version cited by Page is known as Gates’s law–though I don’t think Bill Gates want to take credit for it.

Categories
General

Waiting for the Big Bing

Everyone is talking about Bing today–well, everyone who isn’t too busy watching Google do the Wave. If you haven’t been paying attention, Microsoft is about to spend $100M to market an upgrade of its web search engine, rebranding it from Live to Bing (by way of Kumo).

I’m reserving judgment about it until I have a chance to play with it myself–and I assume I’ll have to wait until next week just like everyone else (unless any kind insider cares to offer me a sneak preview). But it is interesting to see how Microsoft is positioning Bing as a “decision engine” rather than a search engine, with messaging at least mildly suggestive of HCIR. At least according to their marketing, their focus is on organizing results, simplifying tasks, and supporting decision making.

I personally can’t help noticing how the messaging looks familiar–and they even name-check a very familiar customer in their marketing video. But it’s probably just a coincidence. 🙂

In any case, Google also claims to organize the world’s information–and it’s even starting to offer users limited query refinement capabilities. If Microsoft is going to make headway on this round, I suspect they’ll have to deliver a significantly better experience than Google at the task level for at least a couple of common tasks. The areas they tout in their marketing are travel, health, and shopping. It certainly wouldn’t be hard for Microsoft to beat Google on all three–note the overlap with areas where Google isn’t good enough. But it remains to be seen if they will.

Categories
Uncategorized

2009 Enterprise Search Sourcebook

Enterprise Search Sourcebook 2009

I just noticed that the 2009 edition of the Enterprise Search Sourcebook is now available. Published by Information Today, it’s a nice way to survey the landscape. Of course, it goes without saying that you to take vendor claims with a grain of salt, but you have to start somewhere!

Of course, if you’re interested in learning more about enterprise search, be sure to check out the program for the SIGIR 2009 Industry Track–particularly the two panels: one comprised of leading industry analysts, and the other of senior technologists from the top three enterprise search vendors. Yes, I’m biased: I’m organizing it. 🙂

Categories
General

Topsy: Tippling the Stream of Conversations

Cited as “amazing” by the master of hype, TechCrunch’s Mike Arrington, it’s…Topsy: “The first index is based exclusively on Twitter statuses and the wonderful people who write them.” Apparently they have been in stealth mode for three years!

I’ve only played around with it a little, but I think I have a feel for the quality. It’s hardly amazing (sorry, Mike), but it’s not embarassingly bad either–especially if they really are only relying on Twitter rather than crawling and indexing the web. If that is the case, then they have certainly made the case that it is possible to build a serviceable search engine using only the social stream, and that is an impressive proof point.

Moreover, Topsy is taking an approach that Google (and web search engines in general), neglect at their peril: treating people as first-class objects. For example, a search for exploratory search returns a list of Twitter users, many of which should be familiar to readers here. They also have pages associated with Twitter users, like this one.

I see Topsy as a very early proof of concept–I can’t imagine anyone relying on it in its present form. But it does deserve a look. Forget all the hoopla about “real-time” search. As far as I can tell, that obsession is a sideshow compared to the real value of Twitter and other social media tools, which is to make search as much about people as about content.

Categories
General

NYT Appoints a “Social Media Editor”

What’s a social media editor? I have no idea, but the New York Times now has one! As reported in ReadWriteWeb, paidContent.org, and of course Valleywag, the paper of record has appointed Jennifer Preston, former editor of the regional sections, as its first social media editor.

I agree with Marshall Kirkpatrick at ReadWriteWeb that

We would love to see Preston fill a role similar to what Mathew Ingram does at the Toronto Globe and Mail, Canada’s largest daily paper. Ingram’s position is “Communities Editor” but he interfaces with social media activities both on and off of the paper’s site.

I think of Ingram more as a blogger than an editor, but in any case he’s certainly a credible voice in the brave new world of social media, and the New York Times would do well to have such a person on its staff.

It’s not as if the Times has been sitting on its hands–check out their APIs and their Open blog. But these efforts seem driven more by their technologists than by the editorial side of the house. My sense at Times Open was that the editors are still scared that any change could dilute their brand equity.

I’ve taken the apparently controversial stance that the New York Times should seek ways to monetize community. A hopefully less controversial assertion is that the paper needs to expose the value of that community. Few papers have the sort of brand-name writers that can act as attention magnets in a highly competitive attention economy, sucking in readers from Facebook, Twitter, the blogosphere, and the web as a whole. Of course, the management has to allow those writers to do so, which may be tough for an old guard used to assuring quality through control.

Still, I’m hopeful that the New York Times is taking a step in the right direction. I know nothing about Preston, or about the Times’s intentions beyond what’s been published in the articles I cited. Nonetheless, the gray lady seems to understand that now is the time to learn new tricks.

Categories
General

News, Search Experience, and Value

I’ve been known to spar with Jeff Jarvis about Google’s role in the present and future of journalism, but I readily admit I’m something of an amateur. Thus I’m delighted to see a thoughtful post from Josh Young, a more serious and informed media junkie, entitled “Not by Links Alone“. In it, he does a great job of explaining the main opposing positions in the debate over whether Google is good or bad for journalism.

Jarvis offers his own summary of the post:

He’s saying that Google is causing news to be reshaped so it can be found, now that it has been unbundled from the products we used to have no choice but to buy: our newspapers. He says that news is an “experience good” we can’t really know until we taste it. He says we need a new experience of news and it ain’t Google.

Jarvis further suggests that he adds value to the post by adding a “search-engine-and-browsing-friendly summary”, i.e., a lede to make the article SEO friendly. Without a doubt Jarvis does encourage readers to find the article, since citation (and a link) from a prominent blogger is a boon to traffic. I’m less persuaded that this has anything to do with SEO.

Regardless, I’d like to except what I see as the main point of the post, it’s summary of the perspective of news executives:

Google’s approach to the Web can’t reproduce the important connection the news once had with readers. Google just doesn’t fit layered, subtle, multi-dimensional products—experience goods—like articles of serious journalism. Because news is an experience good, we need really good recommendations about whether we’re going to enjoy it. And the Google-centered link economy just won’t do. It doesn’t add quite enough value.

Because, as Jarvis said a few years ago (and as Josh cites in his post), Google commodifies everything (my bad for not citing him here). Needless to say, I agree with Josh that:

What we need is a search experience that let’s us discover the news in ways that fit why we actually care about it. We need a search experience built around concretely identifiable sources and writers. We need a search experience built around our friends and, lest we dwell too snugly in our own comfort zones, other expert readers we trust.

It is that need that motivates much of my work at Endeca, particularly in working with media organizations like the Financial Times, the Guardian, and WebMD. Yes, we live in the present and can’t neglect the importance of SEO in a Google-dominated world, I’m much more excited about adding value through a user-centered search experience than about helping sites compete in a zero-sum game. Google’s good or evil notwithstanding, I don’t want Google to be the gatekeeper for the world’s information.

Categories
Uncategorized

NSF Report on Information Seeking Support Systems

Long-time readers may recall that I participated last year in an NSF Information Seeking Support Systems Workshop at the University of North Carolina, organized by Gary Marchionini and Ryen White. Some of the output of that workshop recently surfaced in a special issue of IEEE Computer. It’s a great issue, and I recommend it to those who have access to it either in print or online form (through the IEEE digital library).

But I know that many readers here do not have ready access to this material. Hence, I am delighted to announce that the workshop report is now available for free online. It’s a great introduction to the concerns occupying HCIR researchers.

Of course, if you’d like to meet some of these people face-to-face, I recommend you participate in HCIR ’09 this October. The deadline for position papers is August 24th. I hope to see you there!

Categories
Uncategorized

Book. Is. Done.

I couldn’t think of a better way to start a holiday weekend than by uploading the revised chapters of my faceted search book to the publisher. It was the first–and hopefully last–time that I have hand-edited pdf files (download a trial version of Acrobat here if you’re jealous). Barring some unforeseen event, the publishers will incorporate these last edits and then make the book available in hard-copy and electronic format in a few weeks!

I’d to thank everyone who helped me put the book together. I’m grateful to Candy Schwartz (the Co-Editor of Library & Information Science Research–how cool is that?) for her thorough feedback, as well to the the veritable army of voluntary reviewers who offered great suggestions to improve both the content and style of the book: Omar Alonso, Pete Bell, Amitava Biswas, Blade Kotelly, Sol Lederman (who also wrote a review based on the draft), Milan Merhar, Jennifer Novosad, XiaoGuang Qi, Brett Randall, Dusan Rnic, and Joshua Young. I hope I haven’t missed anyone!

And of course I am grateful for the support of my family and co-workers. Hopefully they will be glad to have me back among the ranks of the living.

Categories
Uncategorized

Data.gov

When I first heard that Vivek Kundra was on the short list to be the CTO of the United States, I was very excited about the possibility that he would implement information sharing at a national level like he had in DC. Today I’m happy to read that that the Federal CIO Council has launched Data.gov:

The purpose of Data.gov is to increase public access to high value, machine readable datasets generated by the Executive Branch of the Federal Government. Although the initial launch of Data.gov provides a limited portion of the rich variety of Federal datasets presently available, we invite you to actively participate in shaping the future of Data.gov by suggesting additional datasets and site enhancements to provide seamless access and use of your Federal data.

OK, so it’s still in beta, but I’m still gratified to see this step toward government transparency. And what a boon to information retrieval researchers looking for public data sets!