These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Information Portal

 
  • Topic is locked indefinitely.
 

Dev blog: Project Discovery needs You!

First post First post
Author
Sir HappyPants
Caldari Innovations and Research
#61 - 2016-01-22 23:55:54 UTC  |  Edited by: Sir HappyPants
I ctrl+F blind with no results, so apologies if this has been asked already.

Any chance of a colorblind mode? I'm one of the many men with colorblindness. Seeing the example pictures would make this exercise largely impossible for me without exporting the image to a color conversion program. I love the idea and the execution looks great, I would love to participate.

Thanks!
Member of the #TweetFleet   @thisurlnotfound
Fzhal
#62 - 2016-01-23 00:35:20 UTC
Sir HappyPants wrote:
I ctrl+F blind with no results, so apologies if this has been asked already.

Any chance of a colorblind mode? I'm one of the many men with colorblindness. Seeing the example pictures would make this exercise largely impossible for me without exporting the image to a color conversion program. I love the idea and the execution looks great, I would love to participate.

Thanks!

I've recently seen games with graphics options where you can select your vision type... Just sayin. ;)
Deleenda Asanari
Perkone
Caldari State
#63 - 2016-01-23 01:03:40 UTC
Dave Stark wrote:
just jumped on sisi to try it out.

not quite sure what i'm meant to be doing - not sure i care either, i'm getting isk/LP for randomly clicking.

in all seriousness though - the tutorial doesn't really explain much, you're asking me to match a random picture with little icons that don't look even remotely like it... and i'm pretty sure all this isk/lp i'm getting clicking randomly is going to add up faster than any kind of multiplier i get by taking my time to try and figure out which icon is meant to match the scribble on the left.

honestly - remove the isk/lp reward. i know you want to incentivize it, but seriously i'm getting isk/lp for clicking randomly and not caring about the fact that this is meant to be helping scientists. because i'm getting isk/lp for randomly clicking and submitting complete trash, that's what people will do.

"****, need some new sisters probes - better **** up some scientists results with crap for a couple of mins while i fly to the nearest LP store station".

"fleet's waiting to form? may as well **** up some scientists results with crap and get free isk while people get ready to leave."

genuinely - if this mini game thing is meant to be serious and help research, get rid of the reward. or, only award it to people who are above say, 70%, accuracy.

edit: isk reward seems to be 1k isk per 1% of accuracy. that means 100k isk per at 100% accuracy. not a great deal of isk, not much incentive to try and do it correctly vs spamming complete crap.
LP seems to be a bit more random, though.

edit2: just tried to do it properly and get my rating up. it seems that most of them could be 1 of like 3 or 4 choices i always seem to get it wrong. i'm bad at it. this further promotes my "spam **** answers" mentality since i may as well get **** rewards quickly than take my time and still get **** answers.





i totally agree with him :)

lower the rewards isk/lp maybe...

or just put a 2 minute or hell even 3 minute limit to pressing submit button to prevent spam...

try to make it bit harder to earn money compared to highsec *afk* mining. i know you want to give ppl something to motivate them but...


make some serious tutorials for it maybe with an actual doctor showing us and explains the reasoning behind his choices in mini game...

full screen is a must :)

hexagons may have least 2 example pictures to show more variety



as other rewards goes

make skins like red cross themed or even make just new ships just can be bought geneticist rank or something like that

and/or doctor/researcher/lab clothes of course :)


other than that i think its a great project hope it will somehow succeeds :)
Masao Kurata
Perkone
Caldari State
#64 - 2016-01-23 01:21:27 UTC  |  Edited by: Masao Kurata
Needs to come with a textbook, minimum 300 pages. My experience with it really makes me doubt that research actually showed that random people with no background in the subject can actually become even vaguely accurate based on feedback on a few known samples. I violently disagree with almost every classification and am completely baffled by how many of them could be right to the degree that I'm wondering if the database is presenting the images it thinks it is.

I don't really care if you want to give space money for this or how much as long as it's not like a trillion per hour.
helana Tsero
Science and Trade Institute
Caldari State
#65 - 2016-01-23 01:27:18 UTC  |  Edited by: helana Tsero
- Can give more detailed instructions.... Like a Guide for dummies or something.. cause I have no idea what characteristics im supposed to be matching... just a vague reference to green coloring in the tutorial... Am I supposed to find shapes similar to other pictures ? or work out some feature that they all have in common ? Is their supposed to be a pattern ?

- Need a video showing how to find a match.

- Need full screen !

- havent got to rewards section but yeah as others have said you need to prevent people from just random clicking and getting isk/lp.

"...ppl need to get out of caves and they will see something new.... thats where eve is placed... not in cave."  | zoonr-Korsairs |

Meanwhile Citadel release issues: "tried to bug report this and the bug report is bugged as well" | Rafeau |

Alruan Shadowborn
State War Academy
Caldari State
#66 - 2016-01-23 01:50:53 UTC
CCP RedDawn wrote:
Midori Tsu wrote:
What are the rewards going to be like? is it a baseline of say 500 lp that increases with the rating?


Currently, the amount of LP you gain is in direct correlation with your Accuracy Rating, with 500 SOE LP being the payout for a 100% score on a single sample.
So a 1% score will grant you 5 LP.

Please be aware however that these values and the overall rewards are not finalised and are subject to change before they appear on TQ. (Based on your feedback and our own observations during public testing of course)


At the moment it is based on your overall score, ie if i am at 52% accuracy i get 260 LP even if i get all of the types on a single sample correct

Some of the Samples in the initial set appear to be wrong as well, ie one of them had random green spot all over it, nuclei and all, and it had the correct answer specified as never having green spots on the nucleus

https://imgur.com/9z8ASLR
Sarrian Calda
Perkone
Caldari State
#67 - 2016-01-23 03:20:58 UTC
CCP RedDawn wrote:
Currently, the amount of LP you gain is in direct correlation with your Accuracy Rating, with 500 SOE LP being the payout for a 100% score on a single sample.
So a 1% score will grant you 5 LP.

Please be aware however that these values and the overall rewards are not finalised and are subject to change before they appear on TQ. (Based on your feedback and our own observations during public testing of course)


Perhaps a better way to control and give out rewards appropriately is to follow distributed computing projects like BOINC. You have the players match and identify samples, but you do not give out rewards immediately until the results are verified.

If it takes, say, 1,000,000 matches to have a verdict on the result of a sample, then show a counter to people to let them know this "sample" needs how many more matches to go. Those who participated in identifying samples for this particular sample will be rewarded according to a function of # of attempts * overall accuracy. More attempts + high accuracy > 1 attempt @ 100% accuracy.

There should also be a threshold to filter out spammers who simply just click. If the accuracy of a player's matching effort is below this threshold, he should be given a compulsory tutorial or further training before he can continue identifying more samples. Reward may be made very insignificant for these players to deter them from mindless clicking.

Perhaps can make a "lifetime accuracy" bragging rights indicator/medal for players to display.
Sean Crees
Sean's Safe Haven
#68 - 2016-01-23 08:23:46 UTC
This probably is one of the coolest things I've seen in any game, ever. Hopefully its not the last time something like this gets implemented. It would be really cool if all the missions we do in Eve are helping to further science in the RL.
Ergentii Juhar
Veria Ltd.
#69 - 2016-01-23 08:24:14 UTC
Some serious thoughts about this thing...

So, on biology research now there is a trend to replace research scientists with cheap untrained but massive labor?
This has happened again, when they changed the seti@home (searching for aliens, a completely non-revenue operation) client with another that computed various things for various projects.
I thought then, 'why should I give my resources for free to anyone's project? If they need processing power, let them buy it; medical companies have megabucks'.
This thing happens again, it seems, on another aspect of their expenditures. Human labor.

Remember, people: We are not helping humanity or doing science or research. We are just lowering the research costs for the medicine companies, by replacing proper research analysts with unskilled but massive labor (and also paid by us)!

We're paying our plexes so that they get more money!

CCP, stop acting as a job mediator! Trash this and, if you like, bring ads in the client for added revenue. I'll click them, if it'll make you happy.

In summary, there are certain ethical considerations that make this project completely wrong:

1. Replacing real workers, paid ones, with virtual ones that are not paid for their time (or worse - are paying themselves for it). That's doubly unethical, on both ends of the bargain.
2. This is not for the good of humanity or the progress of science. it is all for a shared profit between medical companies, that MMOScience company, and ccp. Saying the former, is misinformation. And as such, it's unethical, too.
3. Let's not forget, the actual ethics of the medical companies themselves. I think oil companies only can compete with them on this matter. Consider their pricing, their testing procedures (both on animals and humans), their research quality (and what they hide), and all the other stuff. I don't want to help them, in any way. It's only fair because they don't care about helping anyone, either.
4. What's next? Sweeping the streets for plexes? So that municipalities can fire the sweepers and save? I don't think any of this will come to any good.

Don't think I'm an extremist enviromental freak or lobbyist or whatever. I just think that all this 'volunteer' projects are just cost-reducing plans, increasing profits for some companies but reducing the actual gains (and jobs) for the community. If CCP doesn't want to be involved in the politics of the matter, let it abstain from these projects altogether.

Annia Aurel
J-CORP
Goonswarm Federation
#70 - 2016-01-23 08:33:31 UTC
This is plain awesome.

Would be great to be able to toggle each color on/off independently.
Some situations are not covered by the presets.
Tristan Agion
Royal Amarr Institute
Amarr Empire
#71 - 2016-01-23 10:45:34 UTC
I've tried this, in the hope that it could be something to do for example when mining. (I do not quite feel so morally obliged to help science because, well, I am a scientist... Smile )

Here's why I won't play this as it is now. Please feel free to correct me where I overlooked something, I played with this for only a short while...

1. The window apparently cannot be scaled up. I'm squinting at a less than postcard size interface. I see no reason why this could not be magnified to whatever size I'm comfortable with on my reasonably large screen.

2. The pictures / texts on the side, which are supposed to help feature selection are insufficient to misleading:

a. The descriptions are way too short, general and vague. We need proper instructions what to look for, and in particular how to differentiate it against other, similar looking cases.

b. There is a single example picture. We should have access to a dozen of examples that show the possible variety one might encounter. And sometimes these pictures are just misleading because of the lacking variety. For example, there is one with a cloud of green dots on black, but you can score correctly with the cloud of dots on say red filament. I got some "good" ticks for that. Later in the "crowd phase" I ended up being the only one ticking this. I'm not sure that I am right, of course, but I think people just got misled into thinking that the picture has to have a black background. Likewise there is colour variation, e.g., yellow instead of red filament etc.

3. The training phase with "worked examples" is way too short, and does not provide proper feedback. I was barely going over 50% by the time I got in the community phase. That gives one no confidence at all in what one is submitting. I think nobody should get into the communal scoring unless they can pass a say 70-80% threshold. And there is no real feedback, just "this was right, this was wrong, this is what you should have clicked" according to tick marks. We do not have anything like "no, this is not that, because it is not stretched our like this, see?" But this is really vital for learning (and could be automated to a large degree).

4. The community scoring phase seems like a good idea, but I found it entirely demotivating. The problem is that while I intellectually knew that I probably was doing about as well as before (so not very well, somewhat above 50%), psychologically seeing your mismatches with the community in percentage numbers just makes you feel bad. A result sheet covered in 0%-30% doesn't make me think "well, if there are a lot of people with only a 50% rate, then there will be a lot of scatter of error", it makes me think "wow, I suck". There's no positive feedback there unless one tries to chase the crowd percentage, which frankly I don't think is the point. (Basically I would not be training myself to identify the patterns, but to identify what the majority of people likes to identify, which is not the same at all unless it is a group of experts.)

It is at this point that I stopped after a few rounds, thinking "this is really useless". I think there really have to be changes in this phase, or I will not be playing this. We basically need "correct" feedback, even it is delayed. So have some expert score the communal ones, and when he or she gets around to one we have done, we get that as feedback. Not what other amateurs with likely similar bad hit rates of 50% are guessing.

So overall my comment would be: nice idea, bad UI and documentation, and the progression into communal scoring needs serious work. It's nor ready for TQ at all in my opinion.
Yadaryon Vondawn
Vicanthya
#72 - 2016-01-23 11:08:34 UTC  |  Edited by: Yadaryon Vondawn
Besides the scientific importance of the project it is also fun (after one has practiced a while) to do! On the Testserver CCP said that at the moment a selection of all the 13 million images is made instead of all of them. Which leads to some pretty rare formations!

I am rank 27 and now and have come across some very rare and pretty formations, like the Nuclear membrame

I will update this post if I come across some more 'shiny' and clear formations :)



Keep on rocking CCP

EDIT:
It seems ranks are also fixed now, including the badges
Bad Messenger
Rehabilitation Clinic
#73 - 2016-01-23 12:03:21 UTC
so we can pay sub and then we can work 'free' for some corp, best idea ever for someone.
Shegox Gabriel
Liga Freier Terraner
Northern Coalition.
#74 - 2016-01-23 12:20:13 UTC
Is there anything planned about CREST support for this?

It would be awesome to allow players to do this when they have real life spare/waiting time. Also it would allow for some a customizing of the pictures (red/green blindness and such things)


Kind Regards
Shegox Gabriel
Liga Freier Terraner
Northern Coalition.
#75 - 2016-01-23 12:26:09 UTC
Yadaryon Vondawn wrote:
Besides the scientific importance of the project it is also fun (after one has practiced a while) to do! On the Testserver CCP said that at the moment a selection of all the 13 million images is made instead of all of them. Which leads to some pretty rare formations!

I am rank 27 and now and have come across some very rare and pretty formations, like the Nuclear membrame

I will update this post if I come across some more 'shiny' and clear formations :)



Keep on rocking CCP

EDIT:
It seems ranks are also fixed now, including the badges



Is it right that you have about 150k SOE LP then ? So about 300-400mio ISK converted? How long does it take you ?
Mister Ripley
Ministry of War
Amarr Empire
#76 - 2016-01-23 12:28:18 UTC  |  Edited by: Mister Ripley

  • Can you please make the zoom area a little bit smaller than the actual image. It's kinda hard to zoom around at the corners and edges.
  • Selecting a filter and switching back to one you already have downloaded will suddenly change the active filter as soon as the previously selected filter image is downloaded.
Yadaryon Vondawn
Vicanthya
#77 - 2016-01-23 12:52:44 UTC
Shegox Gabriel wrote:

Is it right that you have about 150k SOE LP then ? So about 300-400mio ISK converted? How long does it take you ?


Indeed, I have 152K SoE LP at the moment along with 30M ISK (consisting of 12~ pages in my wallet...). I started yesterday after it came out. I had some trouble doing it at first because the tutorial does not quite cover it. And meanwhile we were discussing feedback SiSi and Morwen's stream with CCP Wonderboy. In the end I had about 50K LP

This morning I went ahead and did about 4 hours of Project Discovery netting me an additional 100K LP. Keep in mind that my pace this morning was way higher than yesterday. Still with some more practice I believe this can be upped a bit. With some side stuff like browsing the internet, forums and EVE posts I managed to complete a image every 1.6 minutes (giving 50K ISK and 250 LP). This gives an average of 25K SoE LP per hour alongside 5M ISK.

Converted at...lets take a 1:2.3 factor, that is 62.5M per hour.

Keep in mind that this can be done faster! Also if I had known what to do at the beginning my accuracy would have been higher which directly influences the payout. Currently this is not changed all that much because not to many people do it.
Tom Kavees
Ministry of War
Amarr Empire
#78 - 2016-01-23 13:13:47 UTC
I feel that the tutorial should be modified to more clearly say something along the lines of "You are assigning the image to one or more categories. Click on the category to indicate that you are 100% sure you see it anywhere in this image". Few slides with protips and/or common mistakes wouldn't hurt either.

Others have already mentioned some other possible improvements, like the UI being resizable and so on.

Awesome work, keep it up CCP! :)
Nana Skalski
Taisaanat Kotei
EDENCOM DEFENSIVE INITIATIVE
#79 - 2016-01-23 14:14:07 UTC  |  Edited by: Nana Skalski
Now read carefully because I will not repeat myself. I am completely new to this. My first run. From perspective of a lab monkey.

First of all its in "business" part of Neocom? I think it should be excluded to the Neocom menu "main" category.
Second, upon opening, I can see a window with this agent, but I can also do stuff behind this window. I should not be able to do that. Just make the stuff in the window behind show only when someone will click "Start Tutorial" button, just like when you want to repeat it with "Help", when this stuff is gone for a second, but the stuff should be showing after you click "Start Tutorial".

Next, The tutorial is not helping really much explaining what the hell you have to do.

1. "Look for formations of green coloring" ok found, but why only green? Why green is relevant and red for example not? Somebody knows? Please elaborate. Continue.

2. "Match the sample image with category." Category? What you mean by that?
You meen match emerging green pattern (shape) in sample with hexagonal block in which green pattern looks most similar? Ufff...
BUT: we categorize by green coloring only why? I clicked the one that was available and looked ok-ish.
I really feel like a lab monkey now... "Where put square peg? Oh you mean this square hole? Why dont you say so...
Sheesh, humans...Monkey see, monkey do."
Continue.

3. Nucleus (category?) "Pertains"..... I am bamboozled, is this a word in english? I had to look up in dictionary, ok it means "relates to", ok.

Nucleus Relates to staining inside the nucleus (colored blue)

What relates? Why the hell It is bothering me with blue now? Green coloring relates to blue part of the image? Green peg matching green hole in blue area??? I think so. Why dont you explain it thoroughly, Human? I cant click anything. But I should be caring about green only, I think? Continue.

4. Ok, I already selected this part. Its about red now, is red relevant in some way also? I suppose its the same like in previous category. Is green only relevant here also? I dont know why you mention red, but I think green is the way to go, because it was first mentioned we categorize with it. Continue.

5. Two categories more, I see they are completely unrelated to the sample, "The not identifiable is suspicious, looks like you really dont know what it is human? Looks like my monkey dandruff, but I am afraid its something nastier..." Continue.

6. After talking about colors, we can now choose the ones we want, it means we can get rid of red or blue. That means it is easier to distinguish in relation to nucleus and cytoplasm? Ok. I get it. Monkey see, monkey do.

7. Werified? Who will weryfy it? Are you going to give it to some other monkey? I want my bananas now!
8. My rank. As we know Monkeys are ranked. Does better rank means better bananas?
9. Accuracy rating. Mmmm more bananas... If I deserve it....
10. History ....I also had monkey ancestors, like you Human
11. Help Fortunately I can spam it so much as I want, to guess what it is all about.

12 the test!!! It looks like Vesicles hex, its too much green in the Cytoplasm hex. I am going with vesicles.

Wrong!!?
Must be the other one. Yeah its the one!

Ok, next one... OK!
Next, looks somewhat like cytoplasm but also membrane, I will mark two! WOW, perfect match, how is it posible? What If I choose only membrane?
Next: weak or uniform? I would say weak. Aaaaand.... nooo, Its uniform. But it was also weak! A TRAP!
Next, vasicles plus nucleoplasm, but the categories images are somewhat not matching 100%, nevermind...
Next: Nucleoplasm and plasma membrane.
Next: Microtubule center or centrosome? I will go with centrosome. WRONG! Must be those red microtubules, that would explain everything..

Hmmmm.... Are you serious? This 1000 points animation is tooooooo looooong. I have them in my bank account???

And again this stuff behind agent window....

Change the way category image zoom vanishes! When you take away mouse pointer from hex, it should vanish always, not sometimes.

I dont feel like a scientist now. Sad
I feel like a beta tester...
Nana Skalski
Taisaanat Kotei
EDENCOM DEFENSIVE INITIATIVE
#80 - 2016-01-23 15:12:58 UTC
And remove a reward completely when someone makes mistake. curently you can just click like crazy and you ill get the ridiculous amounts of SP..