An Engineer And A Lawyer Walk Into A Bar
Tuesday, April 1st, 2008Feel like you could use a good joke? How about one custom-crafted to suit your exact taste of humor?
A team at the University of California at Berkeley has been running a collaborative filtering system for recommending jokes. It’s called Jester, and is currently at version 4.0 in its evolution. The idea behind Jester is to recommend jokes to the user based on their ratings of previous jokes. The system can begin recommending anecdotes once the user rates a training set of 8 jokes. Apparently my tastes make for textbook cases of classification, for I found the jokes served up by Jester to be spot on hilarious, right after the initial set. A significant portion of the content in the database has been in wide circulation, so chances are you have read them before - the system might eventually be expanded to allow user submission of content. Content-based filtering, which is a form of collaborative filtering, has become one of the central mechanisms behind pioneering current-generation applications on the Web today.
Jester uses an algorithm called Eigentaste 5.0, which dynamically adapts the order in which items are recommended. The basic filtering algorithm uses universal queries to apply real-value user ratings on a common set of items. Those familiar with Principal Component Analysis (PCA) will recognize the techniques applied to the dense subset of the ratings matrix. PCA helps reduce multidimensional data sets to lower dimensions for analysis.
The dataset used by Jester has been made freely available for research use, while the framework is also being used to develop new predictive applications.
Finally, here’s one of the anecdotes served by Jester that had me smiling:
A group of managers were given the assignment to measure the height of a flagpole. So they go out to the flagpole with ladders and tape measures, and they’re falling off the ladders, dropping the tape measures–the whole thing is just a mess. An engineer comes along and sees what they’re trying to do, walks over, pulls the flagpole out of the ground, lays it flat, measures it from end to end, gives the measurement to one of the managers and walks away.
After the engineer has gone, one manager turns to another and laughs. “Isn’t that just like an engineer? We’re looking for the height and he gives us the length.”

I just signed up for 





