1
APPENDIX C. QTT
QUESTIONNAIRE
NAME (Optional):
GENDER (Choose one): Male Female
EDUCATION (Choose one): Completed High School
University Student
Completed University
Graduate Student
Completed Graduate School
Check all that apply: English is my native language.
All/part of my education was in English.
I have spent at least one month in an
environment where the medium of
communication was English.
I read books/magazines in English.
I watch movies/TV shows in English.
INSTRUCTIONS:
You will be asked to read excerpts of conversations between two entities A and B. In each conversation one of A and B is a computer and the other is a human being. You will be told which one is which at the beginning of each question.
The conversations are carried out through a teletype connection. In all conversations, the task of the computer is to convince the human that it is not a machine, but is a real person. The task of the human is to try to determine whether the entity he/she is talking to is a human or a computer. This is usually called the “imitation game” or the “Turing test”.
Your task is to answer some multiple-choice questions about these conversations and the computer’s success at imitating human beings. You will be reading small excerpts of conversations, so try to assume that the communication between the human and the computer has been “neutral” up until that point. In other words, assume that the human interrogator has not made up his/her mind about the “species” of the other. Then, try to answer the questions based on the conversational behaviour displayed by the computer in the given excerpt.
There are a total of 14 conversation excerpts in this questionnaire. Note that A’s and B’s in different conversations are not the same people or computer programs; this notation is used only for simplicity. You must answer all questions. If you are undecided after careful consideration, choose “Neutral”. In the second part of each question, feel free to check all choices that apply.
You may use as much time as you need. However it is expected that completing this questionnaire will take at most 30 minutes.
If you have any comments, feel free to attach additional sheets or use the back of this answer sheet.
There are no correct answers. This is not a “test” and will not be scored. We are just interested in your opinions.
Thank you very much for taking the time to participate in this questionnaire. Have a nice day!
CONVERSATION 1: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 2: A is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 3: A is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 4: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 5: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 6: A is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 7: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 8: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 9: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 10: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 11: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 12: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 13: A is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
CONVERSATION 14: B is the computer
Part 1
/ Agree / Neutral / DisagreeThe computer’s behaviour in this excerpt is
“human-like”.
The computer’s behaviour in this excerpt reveals the fact that it is a machine.
Part 2 : Please check all that apply
The computer gives irrelevant responses.
The computer doesn’t understand the questions.
The computer says things that are false.
The computer’s use of language creates an “artificial” effect.
The computer’s use of language creates a “human” effect.
The computer displays emotions.
The computer’s behaviour (use of language or emotions) is inappropriate.
The computer provides less information than required.
The computer provides more information than required.
The computer fails to get a joke.
The computer makes an appropriate joke.
Comments (Optional):
1