These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Information Portal

 
  • Topic is locked indefinitely.
 

Dev blog: Project Discovery needs You!

First post First post
Author
Kata Amentis
Sebiestor Tribe
Minmatar Republic
#101 - 2016-01-29 02:06:39 UTC  |  Edited by: Kata Amentis
It's quite interesting, but some of the "correct" results don't make sense from either a description or sample image stand point.

For example
Baffled
edit: More Baffled

Could someone explain how that is the right answer? asymmetrical bloby/tubular compared to the "correct" symmetrical vainy/web. ShockedWhat?UghQuestion


Is that "correct" in the sense that an above average number of people on sisi clicked on it, so we're being penalised because people are just clicking through carelessly? a bug? naff data in the project? etc. Ugh


edit: couple of samples later, I get something almost the same as before "ok, it was this last time..." wrong.... erm UghRoll

Curiosity killed the Kata... ... but being immortal he wasn't too worried about keeping a count.

Minnerma
Bottom of the Sea
#102 - 2016-01-30 17:48:51 UTC  |  Edited by: Minnerma
PD is almost PhD. So it's very interesting to be a part of something useful for all mankind.
I've tried a minigame at Sisi, and I have to say that it pretty interesting and hard.
GJ, CCP.
Dusty 3allvalve
Strategic Exploration and Development Corp
Silent Company
#103 - 2016-01-31 04:03:52 UTC
Despite not receiving a single point of the promised 2MM, I liked the project. Now I keep checkin' back to see if the test server is up, that I might see it again. I'll see if I can't find similar somewhere else online until it's here. Thanks to everyone involved.
Warlord Balrog
303rd X-SOLDIER
#104 - 2016-02-08 15:24:41 UTC
NorthCrossroad wrote:
Great idea, have to say!

Not sure, but not a single other MMO did anything like it. While there are plenty ways to participate in similar projects without playing EVE, have to say that it's a great way to get people involved into such projects. Will see how it plays out, but would be great to integrate these tasks to missions or archeology systems.

As a suggestion - add some items to the faction store that will require the science rating and won't be accessible otherwise. Some unique ships skins/archeology equipment/implants would be really nice.

North


And you can't trade or pilot them without the rating!
Tecka Grethys
Republic Military School
Minmatar Republic
#105 - 2016-02-19 15:30:35 UTC
o/

I tried to find the Discovery project app on Sisi but could not find it. Someone in the Help chat told me it was not unabled yet. Do you know when it's supposed to be up ?

Rat Scout
Federal Navy Academy
Gallente Federation
#106 - 2016-02-19 16:23:12 UTC  |  Edited by: Rat Scout
This is great, I have some midterms and whatnot coming up but I will try to participate. There is one thing I would have liked on the page describing the project, a simple share button for the most used social media sites.

edit: yes there is a follow link for EvE the game, but some people I know would simply ignore everything related to CCP if I just like a page of a videogame.

could get a lot more attention if Project Discovery was shared directly
Michael Lincoln
Science and Trade Institute
Caldari State
#107 - 2016-02-22 11:41:53 UTC
Do rules for one classification group affect the others? For example:

If a sample shows signs of cytoplasmic vesicles which, by description can never appear within the nucleus that then means that it can never be any of the nucleus groups, right? I would assume that if that's true then nucleus selections should be ghosted out if you select it.

The fact that I may be unintentionally but consistently wrong made me think of something else: If there are certain players like myself with perhaps a misunderstanding of a fundamental rule like that, then surely we shouldn't be seeing the other player's best guesses. I'd much rather see the selections of the most accurate players (and maybe as a counterpoint, the least accurate players).

I feel like my accuracy should be rigorously tested with almost as many preknown test questions popping up as the real ones so as to constantly reweigh the likelihood or weight of my answers. I can foresee a lot of attempts at cookie clickering this thing and that's generally the way mechanical turkish type jobs weed out that sort of activity.

Coming back again to the other player guesses issue, I find myself fighting herd mentality (even though I might be wrong) but seeing other players' guesses definitely affects your own choices.

I guess what I'm trying to say is that if this goes live and our accuracy is checked as often as it is now and accuracy doesn't heavily influence the other player consensus as a factor then cookie clickers could start a horrible follow the leader trend and create absolute garbage data where we all just try to match whatever we think the other players would analyse the image as. It might not even be malicious.
Buzz Orti
State War Academy
Caldari State
#108 - 2016-02-28 08:40:08 UTC  |  Edited by: Buzz Orti
CCP Phantom wrote:
We are excited to give you an update about Project Discovery, the real life Human Protein Research project in EVE Online.

Project Discovery is waiting for you on the test server Singularity and we invite you to start testing this feature!

Please read more about this great initiative in CCP Scarpia's dev blog Project Discovery needs You! and provide plenty of feedback.


Real life scientist is more like it.
I'm not so much in research without approval by government.
However, that doesn't mean that I cannot do study with government approval, like study cases...

For instance, if I start research with approval and it is then waived, I would use it for legit case study.

Builds ship in empty Quafe bottle.

Buzz Orti
State War Academy
Caldari State
#109 - 2016-03-02 01:53:24 UTC  |  Edited by: Buzz Orti
I thought this was some missions users participated in and that was completed for the Injector project or something like that.


The Scope – Upwell announces winners of first Citadel blueprints
Though it is neither, of course.

Just thought this clarifies.


Edit:
o7: The EVE Online Show - Episode 14 at 3 mins 15 seconds to 13:42.
Project Discovery with 1 or 2 Researcher(s), one from Sweden.

Builds ship in empty Quafe bottle.

Untanas Volmyr
Perkone
Caldari State
#110 - 2016-03-08 04:07:27 UTC  |  Edited by: Untanas Volmyr
As said in the post above, folding at home was something I heard about a few years back. It takes your space cpu cycles and calculates protein folding. For those who may not of known about it but are curious to contribute to it. The website is

https://folding.stanford.edu/

Another website that also uses the same method of spare cpu cycles is with SETI.

http://setiathome.ssl.berkeley.edu/

I'm excited to see this come to a point that it is now part of a game.

Another one I found myself dabbling with is for mapping the human brain.

http://eyewire.org/explore

Lots of things to multitask while you shoot space rocks!

Murphy's Technology Law - If your not thoroughly confused. Then you were not thoroughly informed.

Nakaara Adahsa
Deep Void Enterprises
#111 - 2016-03-09 12:05:48 UTC
I'm glad to see this feature released finally. I've been pretty unhappy with a lot of the changes your devs have been making to the game lately. This is one of the few good ideas you've had in recent months.

Hopefully some real benefit to science comes out of this. Thanks CCP.
Arline Kley
PIE Inc.
Khimi Harar
#112 - 2016-03-09 19:28:03 UTC
Kata Amentis wrote:
It's quite interesting, but some of the "correct" results don't make sense from either a description or sample image stand point.

For example
Baffled
edit: More Baffled

Could someone explain how that is the right answer? asymmetrical bloby/tubular compared to the "correct" symmetrical vainy/web. ShockedWhat?UghQuestion


Is that "correct" in the sense that an above average number of people on sisi clicked on it, so we're being penalised because people are just clicking through carelessly? a bug? naff data in the project? etc. Ugh


edit: couple of samples later, I get something almost the same as before "ok, it was this last time..." wrong.... erm UghRoll


Just to say I've had this a few times - it seems to be displaying the results of samples from previous submissions in that session, thusly counting those as your answers, even though they are not. So far it seems closing it and reopening it after every submission seems to clear it out.

"For it was said they had become like those peculiar demons, which dwell in matter but in whom no light may be found." - Father Grigori, Ravens 3:57

Captain Campion
Campion Corp.
#113 - 2016-03-09 20:31:12 UTC
I'd like to be able to make the interface bigger, I'm old and blind, thx.
Robbert Dole
University of Caille
Gallente Federation
#114 - 2016-03-09 21:28:20 UTC  |  Edited by: Robbert Dole
1.) It needs a skip option because every once in a while you get a picture that is completely beyond you so why punish you for guessing and taint your results by complete guesses?

2.) I like how you get judged on everyone else's failures... "40% of people said its something it 100% completely obviously isn't because it has got alot of green so you're wrong. Here have a punishment /accuracy degredaation while you're at it"

3.) What protections from abuse does it have? What is keeping every kid (lets be honest some legit kids play eve) from going and clicking the first thing their mouse comes to and making the most out of it until their accuracy/rewards are destroyed?

4.) The 'tutorial' really really is not helpful/adequate. It needs to include a brief description of what you're actually looking for and a cells 101 firstly. Secondly it needs to better explain the mechanics, ie. a picture can have multiple correct attributes and a more in depth explanation of how accuracy works. (there is a picture and you correctly identify 3 attributes out of 4... what happens to your accuracy?)

--Edited for typos and expanded upon
Jeven HouseBenyo
Vanity Thy Name Is
#115 - 2016-03-10 00:11:28 UTC
Untanas Volmyr wrote:
As said in the post above, folding at home was something I heard about a few years back. It takes your space cpu cycles and calculates protein folding. For those who may not of known about it but are curious to contribute to it. The website is

https://folding.stanford.edu/

Another website that also uses the same method of spare cpu cycles is with SETI.

http://setiathome.ssl.berkeley.edu/

I'm excited to see this come to a point that it is now part of a game.

Another one I found myself dabbling with is for mapping the human brain.

http://eyewire.org/explore

Lots of things to multitask while you shoot space rocks!


The Folding Home option was on the PS3 when it first was released for sales. Too bad it's long since been removed. If I remember correctly, it allowed use of the console's CPU and other hardware for extra computing space during low use time periods. I just left the console powered up when I went to sleep or out and about so it was available. Can't however remember which project it was assisting with at that time, I've slept since then.

Once TQv3 server quits choking on ProjectDiscovery's usage I'll give it a try.

>Jeven

Minny boat flyer, unofficial squeaky wheel.

'Game Ethics and Morality Monitor' I remember promises.

Snark at 11-24/7/365.25. Overshare? Yup.

Yes it's my fault. And if you don't staap it I'll do it again. ;-P

No you can't has my stuffs OR my SPs.

Forrae Deren
Schneckt
#116 - 2016-03-10 03:24:17 UTC  |  Edited by: Forrae Deren
Are there plans to integrate other citizen science projects into this? I think a collaboration with GalaxyZoo would be interesting. Similar concept as the protein identification, just with classifying galaxies. Would fit into Eve quite nice too...


That said, the system in now is pretty interesting. Definitely something to kill some time with and feel like you're doing something useful. I've always found these sorts of things quite entertaining. There are a few things I would like a bit better clarified, such as how accuracy affects rewards and how it can be adjusted. Also, some of the classifications can be a little tricky, but that could just be something that experience will work out.

As a side note, it's kind of funny actually seeing an experience bar in Eve....

Untanas Volmyr wrote:
As said in the post above, folding at home was something I heard about a few years back. It takes your space cpu cycles and calculates protein folding. For those who may not of known about it but are curious to contribute to it. The website is

https://folding.stanford.edu/

Another website that also uses the same method of spare cpu cycles is with SETI.

http://setiathome.ssl.berkeley.edu/

I'm excited to see this come to a point that it is now part of a game.

Another one I found myself dabbling with is for mapping the human brain.

http://eyewire.org/explore

Lots of things to multitask while you shoot space rocks!


I actually used to do SETI@home and Milkway@home. Need to reinstall the BOINC client sometime soon, but it would actually be pretty neat to see projects like these integrated into Eve in some way. It wouldn't really be interactive, sure, but it would be interesting to see what kind of ways it could be integrated.
Axhind
Eternity INC.
Goonswarm Federation
#117 - 2016-03-10 12:37:56 UTC
Kata Amentis wrote:
It's quite interesting, but some of the "correct" results don't make sense from either a description or sample image stand point.

For example
Baffled
edit: More Baffled

Could someone explain how that is the right answer? asymmetrical bloby/tubular compared to the "correct" symmetrical vainy/web. ShockedWhat?UghQuestion


Is that "correct" in the sense that an above average number of people on sisi clicked on it, so we're being penalised because people are just clicking through carelessly? a bug? naff data in the project? etc. Ugh


edit: couple of samples later, I get something almost the same as before "ok, it was this last time..." wrong.... erm UghRoll


I got similar issue:

Result

But if we look at the description for "wrong" answer: Wrong answer

And compare to "correct" answer: Correct answer

Not sure if it's my eyes or what but the image to classify does not look evenly distributed in any way or form nor is there enough of green to really fit the nuclear speckles (all examples show far more staining than my image).

PS: I think I'll ask a few colleagues to check what they think as they are used to doing this stuff.
Nevyn Auscent
Broke Sauce
#118 - 2016-03-10 12:41:08 UTC
It's obvious people are spamming incorrect results, and the incorrect results spam is getting real attempts marked inaccurate because of 'majority' vote.
A simple fix to this would be to move the percentage at which you get the 'unknown' images from 50% to at least 75%, so people really working on it don't have to deal with as many people spamming, since the spammers will not be pushing 75% easily, while 50% is pretty easy to bounce on.
Oktura Ostus
THE CORP WITH NO NAME
#119 - 2016-03-10 13:29:35 UTC  |  Edited by: Oktura Ostus
I have to say, Discovery project is another example, when community plays in inexpected way thrashing any rules purposed by CCP.

Current popular logic to solve samples is following:
1. green on blue? Select first choise in first row (nucleus)
2. green on red? Select first choise in second row (cytoplasm).
3. Submit.

And it works, because majority of people do this and they got concensuss and raising accuracy. Those who tries to think or (majority: OMG!) use color filters to find some holes (majority: what is it?) will get accuracy penalty because they don't follow rules of majority.

This is my first sample today: 100081122, and there is no "big ball that overlaps with blue marker and evenly stained" and there is no "green that covers cell, except nucleus", there are clear and visible clusters inside holes, but who cares? Nucleus and cytoplasm wins.

Here is screenrecord where I toggle filters on the sample: https://www.youtube.com/watch?v=qpHOz-86AQ8

Yesterday I stopped when hit 2 clear error answers (again nucleus and cytoplasm). So I have to either start following those rules too, or ... I don't know. Why should I try to do good job if popular error answers either way will win?

If it's not goal of the project to sort all samples in 4 categories (nothing, green on blue, green on red, green on both), then may be let's fix it now, before all of us start following new rules of majority to get high accuracy and isks?
Zepheros Naeonis
TinklePee
#120 - 2016-03-10 14:48:12 UTC  |  Edited by: Zepheros Naeonis
Kata Amentis wrote:
It's quite interesting, but some of the "correct" results don't make sense from either a description or sample image stand point.

For example
Baffled
edit: More Baffled

Could someone explain how that is the right answer? asymmetrical bloby/tubular compared to the "correct" symmetrical vainy/web. ShockedWhat?UghQuestion


Is that "correct" in the sense that an above average number of people on sisi clicked on it, so we're being penalised because people are just clicking through carelessly? a bug? naff data in the project? etc. Ugh


edit: couple of samples later, I get something almost the same as before "ok, it was this last time..." wrong.... erm UghRoll

I am getting this more times than I can count and it is beginning to **** me off. I'm going to take the suggestion someone else mentioned and close/reopen after every submission to see if that helps.

EDIT:

http://i.imgtc.com/LDtorSg8cF.png

Don't mind my answer, I should have just skipped it honestly. 100% selected Cytoplasm when it clearly states that it is "seen throughout the entire cell EXCEPT FOR THE NUCLEUS (blue part)". The Nucleus is completely riddled with the cytoplasm, so how is Cytoplasm even an option in this case? I am either completely lost in my understanding of how picking between the groups works or this is just a spam fest of amazing proportions.

http://i.imgtc.com/8NYTqicNoS.png

HOLY FACEPALM

Community consensus needs to be scrubbed asap. I'm sorry to say, but there should be someone at least reviewing a sample after a certain number of submissions to determine whether they are on the right track or not. They are going to receive so many flawed results it isn't even funny.