These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Feedback from the "Crowd Science in EVE Online" presentation ?

First post
Author
Rethe Henney
H's Center
#1 - 2015-03-22 19:34:02 UTC
Hi all,

A conference attract my attention during the 2015 FanFest, but I was not able to found info regarding it. Is it possible to know more about what was discuss and what are behind those "research" ?

Thanks,

//Rethe Henney


// From the Fanfest 2015 Schedule

Crowd Science in EVE Online
The EVE Team is working with the Swiss startup Massively Multiplayer Online Science (MMOS) and Reykjavik University on the potential of bringing real world science into the EVE game experience. Hear about how you can solve scientific problems in proteomics, malaria diagnosis or exoplanet research, and join the roundtable discussions to give us your feedback.

//
CCP FoxFour
C C P
C C P Alliance
#2 - 2015-03-23 13:40:18 UTC
Rethe Henney wrote:
Hi all,

A conference attract my attention during the 2015 FanFest, but I was not able to found info regarding it. Is it possible to know more about what was discuss and what are behind those "research" ?

Thanks,

//Rethe Henney


// From the Fanfest 2015 Schedule

Crowd Science in EVE Online
The EVE Team is working with the Swiss startup Massively Multiplayer Online Science (MMOS) and Reykjavik University on the potential of bringing real world science into the EVE game experience. Hear about how you can solve scientific problems in proteomics, malaria diagnosis or exoplanet research, and join the roundtable discussions to give us your feedback.

//


All of the presentations from FanFest should be uploaded to YouTube in a few days. :)

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.

Rethe Henney
H's Center
#3 - 2015-03-23 18:25:15 UTC
Excellent, thanks :)
Sophie Taimanin
MMOS
#4 - 2015-03-30 19:14:03 UTC
Bienator II
madmen of the skies
#5 - 2015-04-01 02:05:44 UTC  |  Edited by: Bienator II
so those are all problems which are difficult to solve for computers. Does it also mean that once a human went through the "minigame", it would be hard for a computer to rate the result?

Transforming it into a minigame would only work if a program can distinguish between a result from someone pressing random buttons and a result of someone who gave the best to solve the problem. Or do i miss something?

how to fix eve: 1) remove ECM 2) rename dampeners to ECM 3) add new anti-drone ewar for caldari 4) give offgrid boosters ongrid combat value

Sophie Taimanin
MMOS
#6 - 2015-04-01 09:42:13 UTC
Hey,

This is indeed an interesting issue. Actually it came up also at the roundtable talk at Fanfest after the presentation.

So first it is very important to see the motivations. We believe that the intrinsic motivation to help science is the basis of everything and all the other external motivators (as in-game rewards) can only add a layer on top of that.

But of course the system needs some kind of protection against bad results. First of all most of the citizen science projects work in a way that they aggregate the results of tens of users. There is some kind of majority voting system which decides the actual answer the citizens give to the problem. So if there is a small number of users who give wrong answers the wisdom of the crowd can balance that. (Again this works if the majority of the users wants to give a correct answer, and that goes back to motivation)

Apart from that we have a 'training set' which we partly use to train users but also to randomly check their quality of work. And when a collective answer is reached the individual answers can be reevaluated as well. So in the long run with random answers you are probably not getting too far. Except if you are very lucky Smile

Of course if every user would agree to give deliberately wrong answers, than the system wouldn't work. But we do believe that this is a topic where the altruistic nature of players shine and they will try to give their best to help these research projects.


Bienator II wrote:
so those are all problems which are difficult to solve for computers. Does it also mean that once a human went through the "minigame", it would be hard for a computer to rate the result?

Transforming it into a minigame would only work if a program can distinguish between a result from someone pressing random buttons and a result of someone who gave the best to solve the problem. Or do i miss something?

Samsara Toldya
Academy of Contradictory Behaviour
#7 - 2015-04-01 11:13:27 UTC  |  Edited by: Samsara Toldya
Bienator II wrote:
it would be hard for a computer to rate the result?


If multiple players get the same task and 9/10 come up with an equal result it should be pretty accurate.
If you want to have 10/10 you can give out this task at a later point.

Would I participate?
Sure. I think it's safe to say that most of us have lost a close friend or even family to cancer and that would be more then enough motivation for me to "play" this minigame while spacetrucking my freighter to Jita or mining or waiting for a ping or ...

When I first heard of it my initial thoughts were:
"Earth: cancer. New Eden: Joveian Disease"

I don't know CCPs plan for the Jove... but this minigame could offer a lot of gameplay for the roleplaying community.

Right now you have few possibilities to roleplay a scientist. A POS dedicated to search for radio signals... able to detect something like Caroline's Star... counting wormholes openin and closing like earthquakes, stuff like that just don't exist.

But we do have parts of a Jove body (teleportation gone wrong) which could be the source of the pictures this scientific project delivers.

Now "This is EVE" and only few players might do something without reward. How to avoid creating a new ISK faucet?

Just a random draft:
Playing the minigame will give you X Research Points once your results are confirmed. Once a week, once a month, as long as it takes.
Those Research Points can be redeemed into a tradeable... token... whatever.
You can choose to sell this token on the market (no / low NPC buyorders) or "activate" it. Activation will count the number of Research Points to your character, your corporation or your alliance.
Create a list like the bounty list where players/corps/alliances are ranked with their Research Points (all-time and on a monthly basis).

I'm pretty confident there are several scientific-roleplay-orientated players / corps happily buying them off the market to compete with each other - just because of :fame: or the chance to be featured on a Scope News report.

Some could roleplay the Research Points to their "de-minmatarification" studies, others would roleplay researching Drifters, next will "do scientific researches" for the Arek'jaalan project, ...

It feels like a win:win... players not interested in lore / roleplaying stuff could make ISK and players interested in lore / roleplaying would have something to "fight" each other.
Padre Aldan
Gemini Talon
The Curatores Veritatis Auxiliary
#8 - 2015-04-01 13:33:20 UTC  |  Edited by: Padre Aldan


To Sophie,

I offer my whole hearted support for you project and any other projects like this.

On a personal note, I have friends who have been struck down by various cancers and anything I can do. I also have an interest in the science in general and I am looking forward to whatever form these projects take.

So yes, count me in, Sophie Tainmanin, whatever you need.

Padre Aldan of Providence.
Bienator II
madmen of the skies
#9 - 2015-04-01 17:02:28 UTC
You have to keep in mind that the motivation for someone who joins the effort on a crowd science site is not the same as someone who is playing a spaceship game. If the minigame "find a crater" would give us benefits for planetary interaction or "find the bad cells" would do that for manufacturing, i can guarantee you that players will try to game the game without best intentions for science.

I would highly recommend to ad a safety mechanism to those minigames. Google combined for example text recognition problem with computer generated captcha. The user is shown two capcha segments. One is text scanned from a book, the other is computer generated. The user is supposed to recognize both and fill the right text into the box. However, google only knows the right answer from the computer generated part - if its wrong the captcha fails. The text book part is used to help convert scanned books into text. This only works because google assumes that most people who do the captcha don't know that half of it is actually not used for the human-or-bot check - the other half is "for science".

you could do the same in the minigames. Combine tasks where you already know the right answer too, with tasks you don't know the right answer. If a player tries to manipulate the game and fails at the task you know the answer to he would fail at the minigame.

Sophie Taimanin wrote:
Hey,

This is indeed an interesting issue. Actually it came up also at the roundtable talk at Fanfest after the presentation.

So first it is very important to see the motivations. We believe that the intrinsic motivation to help science is the basis of everything and all the other external motivators (as in-game rewards) can only add a layer on top of that.

But of course the system needs some kind of protection against bad results. First of all most of the citizen science projects work in a way that they aggregate the results of tens of users. There is some kind of majority voting system which decides the actual answer the citizens give to the problem. So if there is a small number of users who give wrong answers the wisdom of the crowd can balance that. (Again this works if the majority of the users wants to give a correct answer, and that goes back to motivation)

Apart from that we have a 'training set' which we partly use to train users but also to randomly check their quality of work. And when a collective answer is reached the individual answers can be reevaluated as well. So in the long run with random answers you are probably not getting too far. Except if you are very lucky Smile

Of course if every user would agree to give deliberately wrong answers, than the system wouldn't work. But we do believe that this is a topic where the altruistic nature of players shine and they will try to give their best to help these research projects.


Bienator II wrote:
so those are all problems which are difficult to solve for computers. Does it also mean that once a human went through the "minigame", it would be hard for a computer to rate the result?

Transforming it into a minigame would only work if a program can distinguish between a result from someone pressing random buttons and a result of someone who gave the best to solve the problem. Or do i miss something?


how to fix eve: 1) remove ECM 2) rename dampeners to ECM 3) add new anti-drone ewar for caldari 4) give offgrid boosters ongrid combat value

Bienator II
madmen of the skies
#10 - 2015-04-01 17:06:29 UTC
btw i fully support those efforts. But please be careful what you do.

how to fix eve: 1) remove ECM 2) rename dampeners to ECM 3) add new anti-drone ewar for caldari 4) give offgrid boosters ongrid combat value

Bagrat Skalski
Koinuun Kotei
#11 - 2015-05-11 22:41:25 UTC
It looked booring honestly, but better than mining. Maybe if they would involve ISK in it people would feel more inclined to do that? Or 5 Aurum for bonus round of ten perfectly matched pictures?