We tend to think that there are certain categories of jobs that can't be replaced by machines, yet. Something like a college teacher, for example. Jill Watson performed as teaching assistant for several students of the Georgia Institute for Technology. The thing students didn't realize is that she wasn't a real person. The experiment lasted five months during which Jill's task was to help students, by answering their questions online. Her responses were so credible and elaborate, that they didn't doubt her identity.
The creator of this test is Ashok Goel, professor in Computing at the same institute. He implemented the artificial intelligent teaching assistant, but she wasn't always this smart. “Initially her answers weren’t good enough because she would get stuck on keywords” said Lalith Polepeddi, a graduate student who helped build Jill. "For example, a student asked about organizing a meet-up to go over video lessons with others, and Jill gave an answer referencing a textbook that could supplement the video lessons - same keywords - but different context. So we learned from mistakes like this one, and gradually made Jill smarter".
As soon as the A.I. replied correctly to 97% of student inquiries it was included with the regular teaching assistants. When Goel told his students that Jill Watson wasn't a human being the class' response was uniformly positive, and most of them were really surprised. The reaction to this experiment was strong, with someone questioning the ethics of it. "The world is full of online classes, and they're plagued with low retention rates" Goel said. "One of the main reasons many students drop out is because they don't receive enough teaching support. We created Jill as a way to provide faster answers and feedback".