A few years ago, I broke my wrist in a snowboarding accident and hired an assistant to help me type, in a setup which gave me a simulation of near-perfect speech recognition:
If I don’t look up from the screen, I can pretend he’s not there and that I have the world’s most powerful voice recognition engine. So I have a sneak peek into what computers will be like when voice recognition works really well. … It is fun to try technology years before it exists. I wonder if there are other things we can simulate like this?
Today I learned that in the field of human-computer interaction, this type of simulation is known as a Wizard of Oz experiment.
Some people apparently call it “Flintstoning.”
So, the question stands.
What else can we simulate with a man behind the curtain?
Posted on 24 March 2009
- Leave a comment
- Subscribe with Google Reader
- Follow me on Twitter
Did you like this article?
-
One other thing you can do when a man behind the curtain like this is poor man’s DRS! Watch the VM’s being load balanced while you sit back and relax (while the assistant is clicking his a** off)
-
The things that are at the forefront of what humans can do better than computers, but ideally would be done by computers…
- Determine the context of a conversation. This has huge implications not only for voice recognition in general (huge), but device interaction. If a device in my home/work can figure out I’m talking about an task it may be a part of, it can adjust itself accordingly so as to speed up the ramp up time of interaction should I decide to use it, or just isolate orders to one device at a time, such as searching my cable box for a show, and not my DVR.
- Seeing eye dog. I foresee a _very_ good system coming for people who need to navigate city streets without sight.
- Intelligent news alerts. I foresee the intelligence for news alerts ramping up greatly. A child could currently do a better job of forwarding me stories from feeds better than the algorithms I have used. If my mobile phone position is near a weather front that’s about to hit me in 20 minutes, guess what, I want to know about it.
That’s all for now. If you want more, ask.
Taylor
-
Face Recognition. And not just organic pattern recognition, but specifically human facial feature pattern matching. The human brain has evolved astoundingly advanced capability at recognizing people.
Similarly, auditory significance scanning. When you are in a crowded room full of chatter, if someone says your name, you’re immediately able to break out of the “box” you were in and detect it, even though you were effectively ignoring the noise of the room before. The psychology behind how that works is, again, extremely complex, but humans are very good at it. Imagine being in a noisy crowded room and having a computer listen to all the conversations it can hear at once, showing you what you missed, and indicating what was interesting.
-
Your post reminds me of “Amazon Mechanical Turk”, which is subtitled “Artificial Artificial Intelligence”.
https://www.mturk.com/
http://en.wikipedia.org/wiki/Amazon_Mechanical_Turk -
I’ve also heard this referred to as a pnambic demo. (“Pay No Attention to the Man Behind the Curtain”)
IMHO, “Flintstoning” should only be used to refer to setups in which the backend is implemented by wisecracking prehistoric animals.
-
I know of in-car assistance systems that are prototyped using a “hidden driver in the back seat” that can overwrite the test driver action (that believes to be driving a super smart car).
-
You might enjoy this talk: http://video.google.com/videoplay?docid=-8246463980976635143
“Google TechTalks July 26, 2006 Luis von Ahn is an assistant professor in the Computer Science Department at Carnegie Mellon University, where he also received his Ph.D. in 2005. Previously, Luis obtained a B.S. in mathematics from Duke University in 2000. He is the recipient of a Microsoft Research Fellowship. ABSTRACT Tasks like image recognition are trivial for humans, but continue to challenge even the most sophisticated computer programs. This talk introduces a paradigm for utilizing human processing power to solve problems that computers cannot yet solve.”
-
Jamin – Luis von Ahn is doing incredible work! I also really enjoy his blog (“Luis von Blog”).
-
You can do everything with this method!
“Helle, I’m Ranhjid and your private automated kernel test suite – in my spare time I sell flowers … BTW wanna buy a rose? … kernel tests has been started!”
-
I think I remember there something from the past. Didn’t a company that is well known for selling “vapoware”, decided to show how they PDA OS was working with copy and paste, etc. to outrun PalmOS using a prepared Videotape that was shown on the big screen while the guy in front was moving the PDA pen on a blank PDA screen.
I think it is described in a book with the name: “Barbarians Led by Bill Gates”
-
This concept echoes what the original Mechanical Turk, and the modern version were trying to achieve. Of course, in today’s version, we basically ARE the man behind the curtain.
-
Mechanical Turk is a great example of this in action, but I assume you’re looking for cool live action things.
In general, any organized team of people is going to form some sort of super-”application” (like an assembly line). When I’ve had to do my own mini-publishing for newsletters, conference packets, and even individualized paperwork I’ve had a group of people organized to perform page collation, binding, etc. It was very machine like, with procedures for exceptions and all. For example, if a page was defective or misprinted, the person who spotted it would call out “defect” and everyone would adjust their station accordingly. This made a lot of sense, especially when packet pages had to be exactly matched with another individual packet page (for individualized paperwork).
It was a fun experiment in Artificial Artificial Intelligence. I’ve also conducted similar projects on a LAN, which involved a kind of peer to peer dynamic updating system. We had a variety of topics to research and produce brief dossiers on, so we had a beefed up IRC chat and an updating procedure so that everyone could individually research the subject with minimal redundancy and stylistic clash.
-
Here’s an example:
Before the company grew relatively flush from investors’ cash and hundreds of thousands of customers on more than 5,000 campuses, it had to resort to creative bootstrapping.
Chegg began renting books before it owned any, so when an order came in, its employees would surf the Web to find a cheap copy. They would buy the book using Mr. Rashid’s American Express card and have it shipped to the student. Eventually, Chegg automated the system.
http://www.nytimes.com/2009/07/05/business/05ping.html?_r=1&ref=business
13 comments