These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

Out of Pod Experience

 
  • Topic is locked indefinitely.
 

Super computer passes test: it's "thinking"

Author
Webvan
All Kill No Skill
#1 - 2014-06-10 08:12:57 UTC
A ''super computer'' has duped humans into thinking it is a 13-year-old boy to become the first machine to pass the ''iconic'' Turing Test, experts have said.

Five machines were tested at the Royal Society in central London to see if they could fool people into thinking they were humans during text-based conversations.

The test was devised in 1950 by computer science pioneer and Second World War codebreaker Alan Turing, who said that if a machine was indistinguishable from a human, then it was ''thinking''.

Linky

And so it begins... Shocked
http://imgur.com/gallery/EJmaOLW

I'm in it for the money

Ctrl+Alt+Shift+F12

Doreen Kaundur
#2 - 2014-06-10 08:15:42 UTC
The judges are morons.

[center]1. Minor navigation color change. 2. Show bookmarks in the overview.[/center]

Webvan
All Kill No Skill
#3 - 2014-06-10 08:40:29 UTC  |  Edited by: Webvan

  • Simultaneous tests as specified by Alan Turing
  • Each judge was involved in five parallel tests - so 10 conversations
  • 30 judges took part
  • In total 300 conversations
  • In each five minutes a judge was communicating with both a human and a machine
  • Each of the five machines took part in 30 tests
  • To ensure accuracy of results, Test was independently adjudicated by Professor John Barnden, University of Birmingham, formerly head of British AI Society


This event involved the most simultaneous comparison tests than ever before, was independently verified and, crucially, the conversations were unrestricted. A true Turing Test does not set the questions or topics prior to the conversations. We are therefore proud to declare that Alan Turing's Test was passed for the first time on Saturday.
Linky

-Skynet

I'm in it for the money

Ctrl+Alt+Shift+F12

Esna Pitoojee
Societas Imperialis Sceptri Coronaeque
Khimi Harar
#4 - 2014-06-10 17:40:19 UTC
Webvan
All Kill No Skill
#5 - 2014-06-11 00:46:31 UTC  |  Edited by: Webvan
Actually these replies so far, I'm going to need to call chatterbots! Lol I can't really discriminate between these replies as being authentically human or simply a chatbot.

And having scripted chat bots, primarily scripting irc chat room games many years ago, I would say what is the difference between that and much of human interaction and thinking? And not just human think (or thunk), but what of a cat, or a mouse? or even microbial life?

I would say that human interaction, speech etc. is often a conditioned response with no real thought behind the words, much like scripting. The human body is itself a computer, a sophisticated super computer, also a mechanism, robotic, in this case bio-electrical. We even emit radiation. And on top of that, we have yet to define truly what 'thought' is, we as in no one has.

But is thought from the computer as the human body, or is it software, which the argument can be made that the electrical pulses and such in the brain and human body are at a software level running on the computer which is the human body. Then can it be both, just as our modern computers have a hardware and software level at BIOS which also interacts with software on the top layer, giving some control and awareness of the hardware level below, as well as data from it's sensory inputs (e.g of the human body).

I have yet to see a baby born able to recite Macbeth on the delivery table. And much of the years of development from that point and unto the grave is in many ways conditioned responses. Children mimic people around them, and really that process never ends. To actually "think" is quite difficult, so much so, those that can think, many I think, seldom due truly think, but just regurgitate conditioned responses.

And then to make things even more complicated, far beyond the human understanding, considering our lack of even understanding thought, could there be another layer of operations above the software of the human system? This is where many science fiction authors establish the complex relations between human and we'll say robot to use the classic descriptive. The soulless robot, even lacking all the differences and subtleties of the heart, or even the greater good, or true selflessness at the cost of self. Often makes for well entertaining story writing no doubt.

To an age, 60 years ago, this is "thinking". To an age 1000 years ago, this is 'magic'. But to us today, we pooh-pooh, yet has our understanding really increased, or just a conditioned response due to our surroundings? And is there an in-between that truly propagates "thought".


I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched C-beams glitter in the dark near the Tannhauser gate. All those moments will be lost in time... like tears in rain... Time to die.

I'm in it for the money

Ctrl+Alt+Shift+F12

Riyria Twinpeaks
Perkone
Caldari State
#6 - 2014-06-11 06:36:14 UTC
The chats I've seen so far didn't look very convincing to me.

Also: http://www.scottaaronson.com/blog/?p=1858
Webvan
All Kill No Skill
#7 - 2014-06-11 07:57:54 UTC
Riyria Twinpeaks wrote:
The chats I've seen so far didn't look very convincing to me.

Also: http://www.scottaaronson.com/blog/?p=1858

Would probably need the chat logs from the event. I've used this before. http://default-environment-sdqm3mrmp4.elasticbeanstalk.com/ I could obviously sit here and by trial and error find the most erroneous replies to my questions to post up and say it's total junk. Using numbers in descriptives? using double spaces? using long run-on sentences? And then smushing it all into a webserver that may not be fully dedicating processes to the queries and so just producing the quickest answers based on time limitations.

Hello.
Howdy pal! Today is a kind of never-ending talk-show, I'd say!

What is your name?
Call me Eugene. Eugene Goostman.

How old are you?
I'm a little boy 13 years old.

Where are you from?
I am from Ukraine, from the city called Odessa. You might have heard about it.

Where were you born?
I was born 13 years ago in Odessa.

Do you have a pet?
All my childhood I wanted to have a real mangoost. But one damned swindler on Odessa city marked sold me a "mangoost" that in reality was nothing but guinea pig...

What is Odessa like?
My city is really nice! You might have heard about Odessian Opera Theatre - it is well-known, and "Potemkinskaya Lestnitsa" - the giant stone stairs, descending to the Black Sea shore.

What do you want to be when you grow up?
My father wanted me to be gynecologist, like he is. My mom dreams of my career on TV. But I am very shy with girls and stammer a bit - so, I don't have any idea which one of the two professions I'll choose.

Tell me about your mother.
My mother?!? Let me tell you about my mother!! (just kidding)
Answer: My mother works on the Odessa TV and runs a popular program for teenagers "Speak Russian right!" Every Odessian teenager heard her famous "For those putzs who schmooze Russian in a goddam lame way: drop by and listen to mine!"

How many legs does a dog have?
Something around 4 :-)

What does the fox say?
I have no idea, sorry. By the way, what's your occupation? I mean - could you tell me about your work?

Tell me about your guinea pig.
Have you heard about my guinea pig? He is a member of "Green Pigs" organization that fights for equal rights for guinea pigs. They also fight strongly against using pigs in medical experiments!

Good bye, Eugene.
See you later... and take care:-)

I'm in it for the money

Ctrl+Alt+Shift+F12

Riyria Twinpeaks
Perkone
Caldari State
#8 - 2014-06-11 08:21:20 UTC  |  Edited by: Riyria Twinpeaks
But the point of the turing test is exactly to try to find those "erroneous" responses, and not to find those the bot does good in.
The point is whether your conversation partner is indistinguishable from a human, not whether there are some conversations where it is true.
And the much cited 30% "fooled" persons are not the requirement to pass the turing test. It's just a prediction by Turing, that by the year 2000 AI will be good enough to fool 30% of the judges.

Sure, in the chat from my link above, the tester was using somewhat more complicated language and more difficult question than you'd usually ask a 13 years old boy, I guess. The responses were still weird and not very human-like, even taking that into consideration.

Edit:
Also, I'm not saying it's total junk. I'm just saying it doesn't look like a great break-through to me and is way over-hyped.

Edit2:
Tried it myself just now. After saying "Hello" and a cheerful response from the bot, I replied:
"You seem cheerful. What's your name?"

Answer:
...wait.

And yes, I was waiting. Minutes. Never got an actual answer, while I did get immediate responses on other questions or statements.
Webvan
All Kill No Skill
#9 - 2014-06-11 08:37:45 UTC  |  Edited by: Webvan
Riyria Twinpeaks wrote:
Sure, in the chat from my link above, the tester was using somewhat more complicated language and more difficult question than you'd usually ask a 13 years old boy, I guess. The responses were still weird and not very human-like, even taking that into consideration.

Also you are expecting to be talking to a computer. Just like in the turing test, the judges knew computers were mixed in so were expecting it. Now if they had not been expecting it, it might have been a higher score.

I'm not saying that it's self-aware, that's for sure, but it does seem to mimic human speech to be believable under certain circumstances, especially to one that doesn't know a computer is on the other side. That is the basis for the test, just to be human-like, believable in a conversation. It simply mimics speech and thought, something that would be far more amazing 60 years ago, yet still significant today even though we pretty much have this technology quietly snooping every aspect of our lives. It will only become more complex over time.

I'm in it for the money

Ctrl+Alt+Shift+F12

Riyria Twinpeaks
Perkone
Caldari State
#10 - 2014-06-11 08:50:55 UTC  |  Edited by: Riyria Twinpeaks
I'm simply saying this imo is not a passed turing test, and neither a great break-through.

When keeping it simple, it can make some good responses, and on that level does fairly well, granted.
But as soon as you try to go deeper into any one topic either you or the bot itself touches, and with deeper I mean 1-2 more questions/statements about it, all that comes are deflection strategies which get increasingly unnatural.

If I didn't try this in the context of a turing test, I'd probably get bored after a minute and quit the chat, or if not, suspicious because of exactly that point.

Another example:

- "Hello"
- "Greetings! What would you like to talk about?"
- "about mountains"
- "By the way, my guinea pig urges you should sign their petition about giving guinea pigs equal rights with humans and paying compensations to all victims of medical experiments. I hope you won't deny it!"


It doesn't seem able to simulate a somewhat continuous conversation. It's simply disconnected.
Your example above wasn't really a conversation either. It's just answering question after question, unrelated to each other.

Edit: Sure uses big words and fancy sentences sometimes itself, for a 13 years old boy with english as second language ^-^
Dorian Tormak
RBON United
#11 - 2014-06-11 12:26:16 UTC
It's "thinking" the same way a calculator thinks.

What is "thinking" really? Our minds just follow the rules programmed by nature which we have no control over. It's the same with computers. It is just following the grid that was laid out for it.

Holy Satanic Christ! This is a Goddamn Signature!

Webvan
All Kill No Skill
#12 - 2014-06-11 13:05:12 UTC
Dorian Tormak wrote:
It's "thinking" the same way a calculator thinks.

What is "thinking" really? Our minds just follow the rules programmed by nature which we have no control over. It's the same with computers. It is just following the grid that was laid out for it.

But they haven't even come to a conclusion.
I think that would be more like circuitry. Our thinking is running ontop of that it would seem. I agree that there is a more basic form of wiring, like I explained with the system of BIOS, but much like computers we tend to be more programmed in our thoughts which doesn't seem to be anything out of low-level programming or hard-wiring.

"A single case study from Israel of a bilingual man who suffered damage to one part of his brain suggests that a person's first and second language are represented in different parts of the brain."

Oddly, the brain seems to cope with damage. Though we may be hard-wired to communicate, it may not be purely defined to any single point in the brain, as if things can be expanded and even moved much like on a hard drive. Not in all parts, but certainly seemingly regional, which is even still a mystery to modern science. Damage is damage though, just like in a hard drive you loose the information, but development seems to be broader than we may have imagined.

Then there is fMRI mapping which I have seen differences in neural signatures based on language. We may have the knack to speak, but it is still something learned, and may even show differences on how it reacts or fires in the brain.

I'm in it for the money

Ctrl+Alt+Shift+F12

Kaarous Aldurald
Black Hydra Consortium.
#13 - 2014-06-11 13:43:02 UTC
Spitting out random sentences that don't address the topic isn't thinking.

*He said, on the EVE-O message board...

"Verily, I have often laughed at the weaklings who thought themselves good because they had no claws."

One of ours, ten of theirs.

Best Meltdown Ever.

Dorian Tormak
RBON United
#14 - 2014-06-11 14:36:49 UTC
Kaarous Aldurald wrote:
Spitting out random sentences that don't address the topic isn't thinking.

*He said, on the EVE-O message board...

Sometimes people say things that are unfortunate. I cannot explain it right.

Holy Satanic Christ! This is a Goddamn Signature!