The Daily

Posts Tagged ‘Turing Test’

Bad Connection

June 17, 2014 | by

Living with the Turing test.

800px-IBM_Electronic_Data_Processing_Machine_-_GPN-2000-001881

Researchers from the National Advisory Committee for Aeronautics (NACA) using an IBM type 704 electronic data processing machine in 1957. Photo: Wikimedia Commons

As of last week, the Turing test has—allegedly—been passed. In 1950, Alan Turing famously predicted that in the early twenty-first century, computer programs capable of sending and receiving text messages would be able to fool human judges into mistaking them for humans 30 percent of the time, and that we would come to “speak of machines thinking without expecting to be contradicted.” Two weekends ago, at a Turing test competition held at the Royal Society in London, a piece of so-called “chatbot” software called “Eugene Goostman” crossed that mark, fooling ten of the thirty human judges who spoke with it.

The official press release described this as a “milestone in computing history”—a “historic event.” Was it? We should not, of course, take a press release’s word for it. (Said release describes the winning chatbot program as a “supercomputer,” a head-scratching conflation of hardware with software.)

The release says this is the first time a computer program has scored above 30 percent in an “unrestricted” Turing test. This appears to be plausibly true. We don’t have access to the transcripts of these conversations—the organizers declined my request—but we know that the persona adopted by the winning chatbot (“Eugene Goostman”) was that of a thirteen-year-old, non-native-speaking foreigner. The Turing tests of the 1990s were restricted by topics, with the judge’s questions limited to a single domain. Here, the place of those constraints has been taken by restricted fluency: both linguistic and cultural. From correspondence with the contest organizers, I learned that the human judges were themselves chosen to include children and nonnative speakers. So we might fairly argue about what, for a Turing test, truly counts. These questions are deeper than they seem. Read More »

3 COMMENTS

Eugene Goostman Is Not What He Seems, and Other News

June 9, 2014 | by

computer-chatbot-eugene-goostman-passes-the-turing-test-in-london

This boy is a machine. A screenshot from a test conducted by the Royal Society of London.

  • “In 1919 John Middleton Murry was appointed editor of the London literary magazine The Athenaeum. Shortly afterward, in a rare case of felicitous nepotism, he hired his wife Katherine Mansfield to be its fiction reviewer … from her very first column she’s frank about the terrible ephemerality of most fiction, and the trap both reviewers and readers can fall into by hitching themselves to a brand new novel’s rapidly dying star … Mansfield openly wonders why anyone should bother with new novels at all.”
  • Eugene Goostman, a computer program masquerading as a thirteen-year-old Ukrainian boy, has become the first artificial intelligence to pass the Turing Test: in five-minute text conversations, it fooled more than 30 percent of humans into thinking it was a person.
  • Why did a beluga whale named Noc try to emulate human speech? “He sounds, on first hearing, at least, less like a person talking than a delirious drunk humming an atonal tune through a tissue-covered comb … But the science behind Noc’s mimicry and its apparent motives reveals something far more urgent and haunting: the spectral outpourings of a young white whale calling to us across both time and the vast linguistic divide between humans and the other animals.”
  • And while we’re discussing animals, “What kind of a person looks upon the world’s largest land animal—a beast that mourns its dead and lives to retirement age and can distinguish the voice of its enemies—and instead of saying ‘Wow!’ says something like ‘Where's my gun?’” Wells Tower reports from one of the last elephant hunts in Botswana.
  • The most transgressive song of 1909: “If we listen closely to ‘I Love, I Love, I Love My Wife—But Oh! You Kid!’ we may hear a surprising lesson: that the culture-quaking shocks, the salaciousness and transgression we associate with blues and jazz and rock and hip-hop, first arrived in American pop many years earlier.”

NO COMMENTS