These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

Player Features and Ideas Discussion

 
  • Topic is locked indefinitely.
12Next page
 

how to give npc's intelligent behaviour, a plea for neural networks

Author
klomp
The Regency
The Monarchy
#1 - 2013-10-22 02:15:35 UTC  |  Edited by: klomp
Since 1943 man tries to simulate brains to learn their MO. That research gave rise to the study of "artificial neural networks"

These days we find neural networks in everyday applications( cryptography , pattern recognition, automation, machine control,...)

Simulated neural networks( software ) can be used in machine learning. It is also extensively used to simulate simple lifeforms, which evolve their neural nets by natural selection, interaction and incentive learning.


My proposal is to give rogue drones simple neural nets, or give the entire hive one neural net.


why?

it will create an ever changing enemy, that evolves over time, which forces capsuleers to adapt tacticts again and again.
it gives researchers a perfect simulated environment to study neural networks, swarm behavior, autopiloting neural nets,...
it fits in the story,


how?

incentive learning: create hunting behaviour : drones need to wreck capsuleers ships for replication**
sensory input: simplified and different from capsuleers:

- drones can see capsuleer ships and drones as objects at a certain distance and angles.
it can "lock" on the objects position and warp on grid.

if a capsuleership is being "locked for warp" The pilot will be notified of a drone getting a lock by some sound in his cockpit

-drones can see other drones too:
if a drone sends a signal trough the solar system ( aka being attacked or found some food ) other drones can react

advantages

- no extensive programming required to create dumb repetitive ai
- actually no programming at all, except the neural net itself: the framework -program running the AI *
- the network learns by the inputs it gets in his environment. In the beginning drones will be dumb but smarten up
- may be a formidable enemy in 3 years ( patching can expand the neural network of offspring)
- please ccp and fellow capsuleers atleast look into neural networks and ask yourself, how could this interact but also what are the dangers*** of neural nets in MMORPGs


sry for the wall of text


http://en.wikipedia.org/wiki/Artificial_neural_network
http://www.youtube.com/watch?v=Rm71Fsp0LCY
http://www.youtube.com/watch?v=g0ZnrzTfFIQ

* edit: you can simply find the classes Neural Network in java, python, mathlab,.., create an object, specify netsize, learning method, input ,outputs , interconnection scheme ,...
and let it run

** our incentive to kill drones will be their loot that ccp can make a key material. fluctuations in drone and capsuleer behaviour will influence price.

*** neural networks allready prove to be very efficient traders, routeplanners, pattern recognizers IRL , and could be used also as exploit . On the other hand: would be cool to use the test server as a server to test neural nets: its a perfect test bed.




TL;DR: simulated neural networks can give rogue drones a very adaptive , intelligent, (lifelike) behaviour.
HardRockLife
Diabolically Sexy Eureka-Secret Science R Us
#2 - 2013-10-22 02:38:33 UTC
I approve, I love the thought of a smart npc group
Kal'el Nirukhi
Spartan Industries
#3 - 2013-10-22 03:02:15 UTC  |  Edited by: Kal'el Nirukhi
Shocked howmuch bandwidth / cpu would this require from the server/ client?
klomp
The Regency
The Monarchy
#4 - 2013-10-22 03:16:01 UTC  |  Edited by: klomp
Kal'el Nirukhi wrote:
Shocked howmuch bandwidth / cpu would this require from the server/ client?


to run all drones in new eden as single simple neural nets,
or to run 1 neural net that controls the hive would require the same bandwidth as a 1/10 of what a player uses per drone, since it needs way less input ( no image, sound, only coordinates of drones and pilots)

as for the neural net, the thinking of all drones in new eden, it could be run by a normal pc.

edit: those are estimations, since i dont know howmany drones there are in new Eden ;) lets say 1k drones with 20 neurons or 1 hive with 20k neurons would create a very lifelike system. but half the amount would do the trick already .
fruitflies have 100k neurons
klomp
The Regency
The Monarchy
#5 - 2013-10-22 03:44:47 UTC  |  Edited by: klomp
deleted
Alvatore DiMarco
Capricious Endeavours Ltd
#6 - 2013-10-22 04:26:12 UTC
I wonder if this would affect rogue drones in missions as well.

Over time, they could become nearly impossible to defeat. On the other hand, at least one NPC group would finally start acting kind of like they should be.
HardRockLife
Diabolically Sexy Eureka-Secret Science R Us
#7 - 2013-10-22 12:55:41 UTC
Kal'el Nirukhi wrote:
Shocked howmuch bandwidth / cpu would this require from the server/ client?

Very little, I have a project I want to do that turns an Arduino R3 into a color reader (basically place object and it tells you the color, hopefully I can get it to hex values for the exact shade) and it will need basic training to recognize what full colors are.
But from what I see its very difficult to create but very easy to modify.
Sort of like how creating the computer is a longstanding thing, but changing parts occurs on a 2 year basis
Debora Tsung
Perkone
Caldari State
#8 - 2013-10-22 13:05:47 UTC
That would be awesome. Shocked

Stupidity should be a bannable offense.

Fighting back is more fun than not.

Sticky: AFK Cloaking Thread It's not pretty, but it's there.

hmskrecik
TransMine Group
Gluten Free Cartel
#9 - 2013-10-22 13:59:50 UTC
So, 70 years after the business started the only thing which can be said today about artificial intelligence is that it is artificial.

If anything, it says that it is a bit more difficult than plucking neural net sim into game engine and watch things happen. Yeah, pattern recognition works to some degree but behavior is quite another cup of tea. If it was such easy, all shooter games would employ it but we still see NPCs either stupid, scripted or cheating (or combination of any).

Also if it was learning from live game it would be also open to being gamed. Coordinated effort from large group of players done for long enough could teach the net some wrong patterns. While fun to watch for the sake of it, probably it's not what you would desire.

BTW, care to mention where exactly or how neural nets are being used in cryptography?
klomp
The Regency
The Monarchy
#10 - 2013-10-22 17:28:22 UTC
hmskrecik wrote:

BTW, care to mention where exactly or how neural nets are being used in cryptography?


f.e.
http://en.wikipedia.org/wiki/Neural_cryptography : train and synchronize a couple small 3 layered networks to certain inputs. their equal weights will be the key

its only being researched atm since it takes long to learn the weights to your system

i think it could be very fast decoded by another nn
Scatim Helicon
State War Academy
Caldari State
#11 - 2013-10-22 18:05:45 UTC
klomp wrote:
why?

it will create an ever changing enemy, that evolves over time, which forces capsuleers to adapt tacticts again and again.

This is exactly why most PvE players will oppose this to their last breath.

If it evolves and forces adaptation, how are they supposed to farm it over and over again whilst semi-afk?

Every time you post a WiS thread, Hilmar strangles a kitten.

Aglais
Ice-Storm
#12 - 2013-10-22 18:24:19 UTC
I would be absolutely fascinated to see NPCs that actually have some degree of intelligence appear more often in EVE.

This also gives CCP an incentive to massively boost the amount of cash or quality of drops coming from NPCs, I think.
Isis Dea
Society of Adrift Hope
#13 - 2013-10-22 18:55:56 UTC
Scatim Helicon wrote:
klomp wrote:
why?

it will create an ever changing enemy, that evolves over time, which forces capsuleers to adapt tacticts again and again.

This is exactly why most PvE players will oppose this to their last breath.

If it evolves and forces adaptation, how are they supposed to farm it over and over again whilst semi-afk?


I don't know. As a partial carebear, I strangely approve of this. It'll bring some respect to a pilot who can continue to adapt beyond the NPCs and even respect (in time) from PvPers observing the strides PvEers take to master fighting their foe.

And it wouldn't have to be that tough/crazy. I'm sure CCP would have limitations on the NPCs (such as reduced ability to vary outside their primary damage type).

More Character Customization :: Especially compared to what we had in 2003...

Katherine Raven
ALTA Industries
Intergalactic Conservation Movement
#14 - 2013-10-22 20:26:49 UTC
Then in a few years we have rogue drones camping the Jita undock and invading goonswarm.

That actually sounds like a ton of fun. Not kidding.
Bienator II
madmen of the skies
#15 - 2013-10-22 21:06:02 UTC
neural networks aren't very well suited to produce NPC AI. Black and White had a simplified version of neural networks and you didn'T even notice it. It could have been plain old behavior scripts and it would had worked just fine.

the first far cry had NPCs which changed strategies based on how you played the game. Basically all other games doing now the same since it works best, is maintainable and doesn't have high CPU load.

there are competitions from time to time where bots fight against bots, i don't remember seeing a neural network based bot outperforming classic algorithms - doesn't matter how long you let him fight to prepare the network.

just google robocode and read about how the best bots work, or quake bots etc.

(bot is here used as synonym for NPC AI)

how to fix eve: 1) remove ECM 2) rename dampeners to ECM 3) add new anti-drone ewar for caldari 4) give offgrid boosters ongrid combat value

Mara Rinn
Cosmic Goo Convertor
#16 - 2013-10-22 21:42:04 UTC
Rather than neural nets, perhaps NPC AI could be a thesis project for someone studying genetic algorithms.

Start off with the "thin client" that the devs use, on a standalone server. Eventually you'll be able to build AIs that turn regular L4 missions into piƱata-grinding-machines and mission runners will end up having to vary their tactics or (horror of horrors) bring friends just to beat the paper-thin, lightweight ships the NPCs are flying.
Quintessen
The Scope
Gallente Federation
#17 - 2013-10-23 03:03:25 UTC
Sorry, as a programmer I'm gonna just state that this isn't feasible -- at all. It just doesn't scale well and CCP would be spending massive resources to make this thing work. Ultimately it's their call, but if they decide not to do something understand it's because of the massive investment it would take without significant results.
hmskrecik
TransMine Group
Gluten Free Cartel
#18 - 2013-10-23 10:12:16 UTC
klomp wrote:
hmskrecik wrote:

BTW, care to mention where exactly or how neural nets are being used in cryptography?


f.e.
http://en.wikipedia.org/wiki/Neural_cryptography : train and synchronize a couple small 3 layered networks to certain inputs. their equal weights will be the key

Thanks.
Raijil Saavuj
Ministry of War
Amarr Empire
#19 - 2013-10-23 14:02:11 UTC
No, because Skynet.
Schmata Bastanold
In Boobiez We Trust
#20 - 2013-10-23 15:18:05 UTC
Before we will send our little rats to university for future overlordz maybe we should give them proper fittings first and teach about tracking, transversal, optimal/falloff and few other things players use against them. And don't forget to change that immune_to_ewar flag on their ships from "true" to "false", too.

Invalid signature format

12Next page