DocBug

Science fiction author Larry Niven once described a world where people would instantly teleport to places where something interesting was happening, causing what he called “Flash Crowds.” Now the LA Times reports that movie makers are seeing the opposite problem: instant communication means that if the audience doesn’t like your movie on opening-night Friday, by Saturday you’ll have yourself a flash void:

“Today, there is just no hope of recovering your marketing costs if the film doesn’t connect with the audience, because the reaction is so quick — you are dead immediately,” said Bob Berney, head of Newmarket Films, which distributed “Whale Rider,” a well-received, low-budget New Zealand picture that grossed $12.8 million and has endured through the summer. “Conversely, if the film is there, then the business is there.”

Two things are going on here. The first is just that word-of-mouth is getting faster, which we already knew. That means that the old strategy of hyping a bad movie so everyone sees it before the reviews come out won’t work much longer. The more important point, though, is that movie companies are seeing their carefully crafted ad campaigns overwhelmed by the buzz created by everyone’s texting, emailing and blogging. The shift in power cuts both ways: audience-pleasers like Bend It Like Beckham thrive on almost buzz alone, while The Hulk was killed by buzz based partially on pirated pre-release copies, in spite of a huge marketing campaign.

Studios (and producers in general) will learn one of two lessons from this trend. Either they’ll decide they need to manipulate buzz by wooing mavens and carefully controlling how information is released, or, just possibly, they’ll follow the advice of Oren Aviv, Disney’s marketing chief: “Make a good movie and you win. Make a crappy movie and you lose.”

References

• High-Tech Word of Mouth Maims Movies in a Flash (Lorenza Muñoz, LA Times, 17 August 2003)
• ‘Bend It,’ like ‘Greek Wedding,’ is starting off strong (Andy Seiler, USA Today, 14 April 2003)
• Texting blamed for summer movie flops (Andrew Gumbel, The Independent, 18 August 2003)
• Flight of the Horse (Larry Niven, collection of stories where Flash Crowds is described, 1971)

What do ESP and Artificial Intelligence have in common? The ESP Game, a new game (and AI research project) recently discussed at IJCAI by CMU researcher Luis von Ahn.

Many AI researchers believe that the biggest barrier to creating human-like intelligence is that humans know millions of simple everyday facts. This ordinary knowledge ranges from knowing what a horse looks like to a simple fact like “people buy food in restaurants.” In the past, AI researchers would spend years painstakingly entering such information into huge databases, but now a new crop of researchers are leveraging the millions of Netizens who have nothing better to do than answer stupid questions all day to build these databases quickly and for free. One such site is the OpenMind Initiative (hosted by my own Ricoh Innovations), which is primarily being used by the MIT Media Lab to collect Common Sense Knowledge.

The latest foray into this space is the ESP Game. When you log into the game you are paired randomly with another player on the Net. Both you and your partner are shown the same 15 random images from the Web, one at a time. Your job is to type in as many words to describe the image as possible, with the goal of matching a word your partner has entered. When you agree on a word, you both get points and move on to the next image. Usually I don’t care for Web-based games, but I have to admit the game is compelling.

The real goal of the system is to generate a huge database of human-quality keywords for all the images on the Net. The task is huge: Google’s Image Search has already indexed over 425 Million images by using the text that surrounds the image’s hyperlink. But numbers are on Ahn’s side: if only 5000 people were to play the game throughout the day, all 425 Million images would receive at least one label in a single month. Given that many game sites get over 10,000 players in a day, a few months is probably all Ahn needs to fill out the whole database.

I’m probably the last on the block to have heard about this, but Scott McCloud, the author of Understanding Comics, has finally come out with an online comic available for a micropayment of 25 cents. Or rather, he came out with it over a month ago, but I just found out about it today. As you might expect from Scott, he’s put the new medium (Macromedia Flash in this case) to good use without losing the fundamental comic-book feel. It was a quarter well-spent, especially since I could download the content to my computer and feel like I actually got something I can call “my copy.”

Payments are made through BitPass, a new startup out of Stanford that allows you to open an account with as little as three dollars and a credit card or PayPal account. The whole process was quick and painless, as is the payment process itself. There’s not too much content you can purchase through BitPass yet, but it looks like they’re building up a solid content base as they go through their beta-testing. Content providers seem to still be figuring out how the market will play out for different kinds of media: models range from the donation cups that are already common with PayPal, to purchase-and-download, to a “30 reads in 90 days” pay-per-view kind of model.

And now just in case I wasn’t quite the last person on the Internet to have heard about this, you know too.

Here are a few free Mac programs I’ve recently come across that make it easy to exercise your rights to fair use. Which is to say, these are programs that allow you to backup, timeshift, spaceshift, or quote digital media that you have bought and paid for but that the Content Cartel would rather you not be able to manipulate. Windows users will have to find their own equivalents (they’re bound to be out there) or just break down and buy a Mac.

• DVDbackup: A program that copies a DVD to disk. It can also change or remove region codes, remove the Macrovision Analog Protection System that prevents copying DVD movies to video tapes, and decrypt the Content Scrambling System (CSS) that prevents copying of commercial DVD content to another digital storage media. Simple drag-and-drop interface. Freeware. Note that some uses of this program may be illegal in the U.S. or any other country that has granted legal protection to any business model that can be encoded in digital rights management technology.
• OpenShiva: Convert a VOB (DVD video) file to MPEG-4 with AAC audio codecs. This will reduce the size of a full-length feature film from about 4.7 Gigabytes to only 1 Gigabyte without substantial loss in quality. Simple interface, and lots of options including cropping and scaling of the final output. Open source (GPL). Note that for commercial DVDs you will need to use something like DVDbackup to decode the CSS encryption first.
• WireTap 1.0.0: This program goes right to the sound drivers and records any audio playing on your Mac. This includes sound snippets from DVD movies, games, iChatAV conversations, or Internet radio. Free product provided by Ambrosia Software, the people who make the SnapzProX video/screen capture software.

There are some interesting rumors floating around about Kaltix, a stealth start-up out of the Stanford WebBase Project. This is the same group that created the PageRank algorithm that was later spun out as a little start-up called Google. As you might expect with a company in stealth mode we’re still long on speculation and short on facts, but it looks like their main technology is a faster way to compute PageRank, the algorithm used by Google to rank hits from a search based on the Web’s link structure.

This is interesting because it would allow Google (or any other search engine) to quickly recalculate personalized indexes for each and every user. After seeding a personal index with my bookmarks file, Google would know that when I for “Jaguar” I’m probably interested in the latest version of Apple’s OS, not the car or the cat. The CNET article has a good overview, but Jeffrey Heer’s blog has a nice perspective as a researcher who happens to be housemates with one of the Kaltix founders.

There are a lot of question-marks still, and I’m not yet convinced that Kaltix’s technology is the crown jewels that Heer or the CNET article claim it is. Speedy indexing is necessary for large-scale personalized search, but you still need to create a profile from something. The real question will be whether a search engine can generate a personal profile that helps disambiguate the searches people make in actual use. Add to this the need to keep personal information like browser history from being transmitted to outside companies and you have a tall order. I’m not saying these problems can’t be solved, but as far as I know they haven’t been solved yet. I expect Kaltix will get bought by one of the big search companies, but it will still be several years before we see personalized search running on any large (non-intranet) scale.

References

• Searching for the personal touch (Stefanie Olsen, CNET, 11 August 2003)
• Search (and destroy) (Jeffrey Heer, Heerforceone, 15 July 2003)
• The Stanford WebBase Project

A couple stories have come up the last two days that highlight how the way the law and business determines identity isn’t keeping up with technology. One story is about identity theft and the other about computer security violations, but both have a common thread: technology has made it so our common-sense assumptions about how to tell someone’s identity no longer work.

The first is a lengthy Washington Post article about identity theft. The driving story is about Michael Berry, whose identity was stolen by an ex-con who proceeded to rack up debt and eventually commit murder all while living under Berry’s name. Around this driving story the article gives a good analysis of just how incredibly easy and common this kind of identity theft is today.

It used to be that identifying someone was a long-term and high-touch operation. You’d get paychecks from a local business, deposit checks at the local bank branch, and write checks to the local grocery store. Over time all these entities would get to know you and your identity would become firmly entrenched in the system. Now that society is more mobile that system doesn’t work, and we’re finding that the replacement system of asking for social security numbers or mother’s maiden name doesn’t work too well either. Currently banks have to eat any monetary losses that come from identity-theft fraud, but do not currently have to take responsibility for damage caused to a person’s credit rating or reputation (as a recently upheld by the South Carolina Supreme Court). That means that, as the law stands now, the economic incentives encourage more convenience and less security than would be the case if banks had to take the total cost of identity theft into account.

The second story is from yesterday’s New York Times, who reported that a British man was exonerated of child pornography charges after his computer was found to have been infected by nearly a dozen Trojan-horse programs. Mr. Green, who has lost custody of his daughter and spent nine days in prison and three months in a “bail hostel” due to charges, has all along claimed that his computer was infected and that it even dialed into the Internet when no one was home.

In this case the question is whether Green is responsible for the material on his own computer. Not long ago if a crime was committed in a particular house then the perpetrator could only be one of a handful of people. For these data crimes, the person actually downloading porn onto Green’s computer could have been literally anyone in the world. Similar arguments have been made about open Wi-Fi access points and “zombie” computers that are used as launching pads for attacks on other sites on the Net. As the Times article points out, there are two issues here. One is that bad guys could use such security problems as a defense, the other is that it really is a valid defense:

“The scary thing is not that the defense might work,” said Mark Rasch, a former federal computer crime prosecutor. “The scary thing is that the defense might be right,” and that hijacked computers could be turned to an evil purpose without an owner’s knowledge or consent.

The general problem is that our old common sense ideas of identity no longer hold, or can’t be applied in our hyper-convenient and mobile society. I’m not necessarily in control of my own networked computer. I’m not the only person who knows the last four digits of my SSN. And the person handling my application has almost certainly never seen me before, and that’s no cause for alarm. Perhaps technology will come to the rescue in the form of biometrics that can prevent identity theft while still preventing governmental abuses. Perhaps regulation will come to the rescue in terms of systems to challenge faulty information, and by insuring that those who are responsible for security have the incentive to maintain it. Probably a combination of these will be required, but in the mean time I expect the problem to get worse before it gets better.

References

• Identity Crisis (Robert O’Harrow Jr., The Washington Post Magazine, 10 August 2003)
• Acquitted Man Says Virus Put Pornography on Computer (John Schwartz, New York Times, 11 August 2003)
• South Carolina High Court Hands Down Major Identity Theft Decision (Shannon P. Duffy, The Legal Intelligencer, 12 August 2003)
• Of ‘Zombie’ Computers and DDoS Attacks: The Security Liability (Dorsey Morrow, SC Infosec, 3 April 2002)

Eugene Volokh has an interesting post about guided voting over at the Volokh Conspiracy (also discussed at Edward Felten’s Freedom to Tinker).

Guided voting already exists in basic form. I’m knowledgeable about a few political issues, but when it comes to local candidates or ballot initiatives outside my area of expertise I rely on party affiliation or endorsements from friends or organizations I trust to “tell” me how to vote.

Prof. Volokh’s point is that, like it or not, Internet voting will lead to a much greater role for guided voting. Today’s ballots have a candidate’s party affiliation printed on the ballot, but if I want to know how, say, the National Organization of Women feels about a candidate I need to do my homework in advance and bring a cheat sheet. Volokh paints a future where I could go to a trusted third-party site, say suggestedvote.com, and check off the organizations I would like to guide my vote. The website would then produce a suggested ballot that aggregates all the recommendations of the organizations I picked, possibly weighing organizations differently in case they conflict on a particular issue. Then with a single keystroke my suggested ballot could be filed. The advantage of such a system, so the argument goes, is that the influence currently held by our two main political parties would be diluted and the political process would become more diverse.

While I like the idea in principle, I think there are two improvements that could be made to Prof. Volokh’s scenario:

First, there is no reason to have a third-party gatekeeper such as suggestedvote.com. More general and egalitarian would be for election boards to publish a standard XML ballot and then any interested party could publish their own itemized recommendations. I would be able to subscribe to recommendations from now.org, aclu.org, or even volokh.com just like I currently subscribe to RSS feeds to read several blogs at once. Of course, a site like suggestedvote.com could still offer to host RSS or similar recommendation feeds for anyone who doesn’t have their own website.

Second, I am quite frightened by the concept of one-click voting. Behavioral psychologists have repeatedly shown that people will tend to do what an interface makes easy to do (see The Adaptive Decision Maker for a nice analysis). This is why there are heated debates about things like motor-voter registration and whether voting booths should allow a single lever to cast all votes for a single party, policies that would be no-brainers if changing the convenience of voting didn’t also change who votes and for what. Given that any change we make will affect how people act, I want the system to encourage thoughtful individual contributions to our democracy, not a constituency of sheep.

This is not to say there should be no voting guides at all, but rather that people should still be forced to actually see and touch every ballot measure, even if it is only to find and check the their favorite party nominee. Each ballot measure and candidate would be accompanied by labels representing endorsements by each guide the voter has chosen, possibly with links from the endorsement to a short argument explaining the group’s reasoning. Rather than follow an automatically aggregated recommendation, voters would judge for themselves who to follow on each individual issue. Voters might even choose guides from organizations with whom they explicitly disagree, either to vote against their measures or to see opposing viewpoints. This system would not be that much more inconvenient than the one-click voting Prof. Volokh suggests, but would insure individual voter involvement while still giving the main advantages of voting guides.

References

• Guided Voting (Eugene Volokh, The Volokh Conspiracy, 5 August 2003)
• Guided Voting (Edward Felten, Freedom to Tinker, 7 August 2003)
• The Adaptive Decision Maker (Payne, Bettman & Johnson, Cambridge University Press, 1993)

Mark Glaser at Online Journalism Review has an interesting look at Howard Dean’s Blog For America campaign blog. Glaser’s main point: Dean’s blog is building support and a sense of connection to his campaign, even though almost all the entries are from his campaign staff rather than Dean himself. As Dan Gillmor puts it, the official Dean blog is a campaign document, not a candidate document.

The article raises the question of how blogs (and by extension, the Web) is best used in political campaign. For Dean, blogforamerica.com is a tool for organizing grassroots support. It lets supporters know what they can do to help, and more importantly it keeps them informed about the bigger picture of how the campaign is moving. Dick Morris even goes so far as to declare grass-roots Internet organization as the new replacement for television ads. But as Glaser points out, you don’t get the feeling of being in Dean’s head like you would if he were writing his own daily entries. In fact, you get a better sense of Dean’s thought process from the posts he made as a guest blogger at Lawrence Lessig’s site than from his own blog.

Certainly there’s nothing wrong with how Dean is using his blog, and his success so far has shown (yet again) just how powerful the Net can be for grass-roots organization. But I can also see why people would wish for more personal contact through his blog as well. Like email, blogs are an informal and even intimate medium, better suited to throwing out ideas that are from the heart, or at least from the hip, than to well-rehearsed campaign speeches. It gives everyday voters a seat on the campaign bus, where they can discuss the issues in detail and watch as positions become fully formed. One of the problems with politics, especially around campaign season, is that everything is so well crafted that you can never hear the doubts and alternatives that had to be considered in crafting the final message. This was brought home to me after 9/11 when, for a period of about three months, it seemed like the curtains had been lifted and politicians were all thinking out loud.

The next question in my mind is how this sort of medium can be used once a candidate is elected. Dean has commented that he might have a White House blog if he’s elected, and of course already the White House publishes Press Secretary briefings on the Net. Perhaps the White House blog could become the 21st century’s fireside chat?

References

• Dean’s Blog Builds Support Despite a Lack of Personal Input (Mark Glaser, Online Journalism Review, 6 August 2003)
• Blog for America
• Dean Campaign Blog Isn’t Candidate Blog (Dan Gillmor, 6 August 2003)
• Dean’s Internet Revolution (Dick Morris, FrontPageMagazine.com, 6 August 2003)
• From Burlington (Dean’s comment on a White House blog) (Howard Dean, Blog For America, 16 July 2003)
• White House Press Briefings