The Noisy Channel

 

Faceted Search for the Web: A Grand Challenge?

November 18th, 2008 · 12 Comments · General

At the HCIR workshop last month, one of the posters was from Microsoft researchers Jaime Teevan, Susan Dumais, and Zachary Gutt, entitled “Challenges for Supporting Faceted Search in Large, Heterogeneous Corpora like the Web“.

From the abstract:

Those [challenges] that we have identified stem from the fact that such datasets are 1) very large, making it difficult to assign quality meta-data to every document and to retrieve the full set of results and associated metadata at query time, and 2) heterogeneous, making it difficult to apply the same metadata to every result or every query.

Drilling further into their position paper reveals three challenges:

  • A lack of good, automatically generated metadata.
  • Uncertainty as to which facets will be most valuable for particular information needs.
  • The cost of dynamically computing facet distributions for result sets.

While these are all serious challenges, I feel that the position paper overstates them. Not all of the metadata needs to be generated automatically, and in any case there are lots of opporutnities to crowd-source metadata creation. Facet selection is more challenging, but the work we’ve done at Endeca on query clarification suggest that this problem is tractable. Finally, the computational challenge strikes me as an artifact of today’s ranked retrieval systems for web search, which are a bad fit for what is essentially a set retrieval problem.

I’m not saying that this problem isn’t hard. In fact, I think that the authors neglect the biggest challenge, which is the adversarial nature of web search. Arguably this problem is an implicit (but unstated) aspect of the metadata problem–there will be too much of an incentive to game it.

Nonetheless, I think the time is ripe to consider faceted search approaches for large, heterogeneous corpora like the web. And perhaps we can work around the adversarial model while we’re at it. But that’s the subject for another post.

12 responses so far ↓

  • 1 Yahoo BOSS, Now With Key Terms | The Noisy Channel // Nov 18, 2008 at 8:11 pm

    […] RSS   ← Faceted Search for the Web: A Grand Challenge? […]

  • 2 Jonathan // Nov 27, 2008 at 9:04 am

    We’ve been thinking about this problem of heterogenous documents for faceted search for a bit now, only with respect to filesystem search, rather than web. It’s pretty cool that they cited me, but they didn’t use this paper, which would have been more relevant.

  • 3 Daniel Tunkelang // Nov 27, 2008 at 10:30 am

    Jonathan, thanks for posting the reference; I’m sorry I didn’t think to include it in the post myself. And I forgot that you are working with Ethan–please tell him I said hi!

    And I agree that the problems of heterogeneity in file systems are comparable to those for the web. In fact, the file system case is harder in practice, as we see in the challenges of enterprise search vs. web search. Which makes me all the happier to see you and your colleagues offering constructive suggestions rather than just bailing on the problem.

  • 4 Max L. Wilson // Dec 5, 2008 at 8:50 am

    I haven’t read that paper yet (i’ve been laying pretty low for a bit working on my thesis). did it cite Bill Kules work on SERVICE (http://www.cs.umd.edu/hcil/categorizedoverview/)? He had been working on faceted representations of web search. What i’ve seen though, including Exalead, its very hard to get past simple things like document type and domain suffix etc. The faceted approach that EBay put across their fairly broad set of content is to narrow down a particular domain before then showing domain-centric facets etc. It is an interesting topic though.

  • 5 Daniel Tunkelang // Dec 6, 2008 at 11:25 pm

    We often take a similar approach at Endeca to what you describe at eBay. But I’ll be the first to admit that the web is more than a site with a “fairly broad set of content”.

    But I agree that Exalead’s facets (at least from my experience with their public web search engine – http://www.exalead.fr/search) seem a bit superficial. And I’ve seen clever use of resources like Wikipedia (e.g., by Duck Duck Go) to offer meaningful interaction to users based on aspects of the results.

    So, while I concede that faceted search for the web is hard, I think it’s possible–and that we could do a lot better today.

  • 6 Warming Up To Cuil | The Noisy Channel // Apr 1, 2009 at 8:57 pm

    […] Microsoft will try too, with Jan Pedersen and Stefan Weitz tilting Kumo-emblazoned banners at the grand challenges cited by their co-workers. These are early efforts, but they are […]

  • 7 T2: Judgment Day for Twine? | The Noisy Channel // Sep 19, 2009 at 12:43 pm

    […] that’s been driving Bing, Freebase, not to mention smaller efforts like Kosmix. It’s hard, to be sure. But, as Sarah Lacy tells us, startups are supposed to be changing the world–and […]

  • 8 T2: Judgment Day for Twine? | The Noisy Channel // Sep 19, 2009 at 12:43 pm

    […] that’s been driving Bing, Freebase, not to mention smaller efforts like Kosmix. It’s hard, to be sure. But, as Sarah Lacy tells us, startups are supposed to be changing the world–and […]

  • 9 T2: Judgment Day for Twine? | The Noisy Channel // Sep 19, 2009 at 12:43 pm

    […] that’s been driving Bing, Freebase, not to mention smaller efforts like Kosmix. It’s hard, to be sure. But, as Sarah Lacy tells us, startups are supposed to be changing the world–and […]

  • 10 Search User Interfaces and Data Quality | The Noisy Channel // Dec 3, 2009 at 2:12 am

    […] On one hand, consider two search engines whose interfaces are designed to support exploratory search: Cuil and Kosmix. Sometimes they’re great, e.g., [michael jackson] on Cuil and [iraq] on Kosmix. But look what can happen for queries that are further out in the tail, e.g. [faceted search] on Cuil [real time search] on Kosmix. Yes, the kinds of queries I make. I don’t mean to knock these guys–they’re trying, and their efforts are admirable. Moreover, both generally return respectable search results on the first pages (in Kosmix’s case, through federation). But the search refinements can be way off, and that undermine the overall experience. I strongly suspect that the problem is one of data quality, along the lines of what others have argued. […]

  • 11 Faceted Web Search? // Dec 27, 2009 at 5:18 pm

    […] from Microsoft say it’s very challenging. Google is trying, but there’s a long way to go. And Eric Iverson just wrote me to describe […]

  • 12 Exploring Nuggetize // Aug 15, 2010 at 7:12 pm

    […] Overall it is a slick interface, and it’s nice seeing the various ideas Mohan and his colleagues put together. There’s certainly room for improvement–particularly in the quality of the categories, which sometimes feel like victims of polysemy. Open-domain information extraction is hard! Some would even call it a grand challenge. […]

Clicky Web Analytics