These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE General Discussion

 
  • Topic is locked indefinitely.
 

Project Discovery and Button Mashers

First post
Author
Nevyn Auscent
Broke Sauce
#81 - 2016-03-10 22:02:46 UTC
One of the big ones that confuses me is when is it Nucleoplasm and when is it Nucleus. Since the two are mutually exclusive, but it's very unclear what defines them and you don't have Nucleoplasm in your dictionary.

Also there is an in game channel running for this under the name of "Project Discovery"
Verlyn
Kill'em all. Let Bob sort'em out.
Ushra'Khan
#82 - 2016-03-10 22:36:04 UTC
Ok one more question, does it have to be only one answer per picture or is selecting several matches at once a possibility also ?
Duke Killem
Doomheim
#83 - 2016-03-10 22:40:59 UTC
Verlyn wrote:
Ok one more question, does it have to be only one answer per picture or is selecting several matches at once a possibility also ?


Can be more than one, say what you see.... Hint, it's not always cytoplasms ;)
Axhind
Eternity INC.
Goonswarm Federation
#84 - 2016-03-10 22:53:11 UTC
Vincent Athena wrote:
Silvenin wrote:
Let's look at an example... (yes, click "example")

On the left side we have the image itself, at the top with all 3 colors visible, at the bottom with blue filtered out.
On the right side we have my answer (nucleoplasma) and the already accepted answer (nuclear specles).

Either I'm terribly wrong... or the majority of voters are.
If I'm wrong I would very much like to hear why.


Thats a tutorial image, and the accepted answer you are trying to match is that of a researcher, not a popular vote. Its not nucleoplasma because it's not sufficiently uniform.

The rewards for accuracy in the actual samples drop to zero when your accuracy drops low enough. I think what will happen: An actual researcher will check the results, find the real answer, and then the system automatically grades everyone. Those button mashers will get a low score and their reward for continued play will be zero. At that point, most will stop.


There is a reason why even researchers fight over this stuff and why using a computer actually is a better way as you can be far more objective.

The homogeneity is not very different from the examples given for nucleoplasm (especially if you look at the additional examples) and regular roundish nucleoli are clearly present.

Nuclear speckles are much more well defined points and none of the examples show such clear nucleoli holes.
Seven Koskanaiken
Shadow Legions.
SONS of BANE
#85 - 2016-03-11 02:05:17 UTC  |  Edited by: Seven Koskanaiken
It's because, on the slides that aren't handpicked tests, there is green crap all over the place all of the time.

Even if it's a slam dunk nucleus slide you look and, hey, there will be some green crap going for a walk in the red in that corner cell.

No wonder they haven't cured cancer yet.
Don Pera Saissore
#86 - 2016-03-11 04:36:03 UTC
HPA Darkfield Oramara wrote:
Duke Killem wrote:
So what happens when a large alliance decides to tell all it's members to use PD and ONLY choose cytoplasm for all results? I presume they get to the goodies faster.

In a game where people screw over each other is core gameplay for some PD doesn't really have the right audience!


Since we have some images that we already know the answer to, we will filter you out if you get too many of these totally wrong. That also applies if you select the same location over and over.


do you know the majority of the correct ansewrs? cos if you dont have the majority then the incorect answer could end up correct if combined with the farmers and the button mashers
Spc One
The Chodak
Void Alliance
#87 - 2016-03-11 05:13:06 UTC
Well i had same problem:

http://www.netsky.org/eve/WRONG.png

it should be correct answer, but it isn't ?
Roll
HPA Illuminator
H P A
C C P Alliance
#88 - 2016-03-11 06:46:28 UTC  |  Edited by: HPA Illuminator
Summary of my replies:

#78

Difficult to tell for sure what is is when red/blue is toggled on but it looks like cytoplasm or aggresome to me (really ugly cells though :'( ). I guess the blue marker could hide a nuclear staining, but very hesitant reg. that.

#79

What you see in the upper left corner is a cell undergoing mitosis = dividing. The DNA (blue) has been duplicated and densed up, and the next step will be for the copies to be separated (by the red microtubules) into the two daughter cells.

#81

Nucleus and nucleoplasm are really similar, and it can be difficult for us as well to distinguish between them. Nucleoplasm = everything in the nucleus except the nucleoli, so I'd actually say it's a more specific term than nucleus. In some cell types, it's extremely hard to find examples of nucleoplasm, it just won't show in either the green nor the blue channel (for us, it's somewhat easier as we'll be looking at the same protein in three different cell types at the same time during the evaluation, and if one of them shows nucleoplasm, we will look more carefully for it in the others).

#82

As many as you see! I think (if I remember correctly) that approx 60% of all proteins show multiple locations. Most common is 2-3, but there are cases (although rarer) where one can see 3-4. I would be *extremely* hesistant to label more than 6 (which should be extremely uncommon).

#84

Humans are still so much better than computers (unfortunately...). But we're working on it ^^

#86

We have looked at all images (well, as I think images are uploaded continously, this is not perfectly true, but we will have looked at >99% of the images) and labeled them according to what we think we see. We are interested in what you think though, and whether you can spot patterns that we have missed out on.

Reg. farmers and button mashers, it will be easy to filter out those (according to our image analysis/programmer expert HPA_Dichroic), we do have a subset of very well classified images that we can look at to see who are just clicking randomly.

#87

From that image I agree it looks negative. Is that one of the known examples, since it's says it should be periphery (cell junctions?)? If so, I'd like to check up on it, it could be weeeak CJ, but I can't tell from this image.
Nana Skalski
Taisaanat Kotei
EDENCOM DEFENSIVE INITIATIVE
#89 - 2016-03-11 06:56:52 UTC
HPA Illuminator
H P A
C C P Alliance
#90 - 2016-03-11 07:13:35 UTC
Nana Skalski wrote:
I have slightly more than 70% accuracy. I think I can be a scientist. Lol



Come join the dark side! Big smileBig smileBig smile (awww I'd like a thumbs up smiley!)
Ibutho Inkosi
Doomheim
#91 - 2016-03-11 09:30:19 UTC
I had actually become a scientist, but I found it's not as good at getting the girls as being a rock singer. So, I extracted all that science mumbo jumbo I learnt in collidge into an injector and sold it to a pot dealing BS student I know. Then, I took the money and bought a Gibson SG with a whammy bar and a Magnatone amp! I got a friend of mine who used to play with Metallica to show me the two chords he knows, and now I'm a STAR!!

As long as the tale of the hunt is told by the hunter, and not the lion, it will favor the hunter.

beakerax
Pator Tech School
#92 - 2016-03-11 11:03:41 UTC  |  Edited by: beakerax
HPA Darkfield Oramara wrote:
And from what we have seen from the test server, you are doing really good!

My accuracy rating was great on the test server, but on Tranquility I can't budge from 53%.

edit: it would be really nice if the example images also had an rgb filter.
HPA Illuminator
H P A
C C P Alliance
#93 - 2016-03-11 11:15:44 UTC
beakerax wrote:
HPA Darkfield Oramara wrote:
And from what we have seen from the test server, you are doing really good!

My accuracy rating was great on the test server, but on Tranquility I can't budge from 53%.

edit: it would be really nice if the example images also had an rgb filter.


Hehe i was trying it today and kudos to ppl who have the patient to keep playing! I think that most of the time I agreed with the choices ppl had made, or at least I understood why a certain choice was made. (i stopped playing at 60%)

Not the best option, but here you can look at reference images (NB that the overlap with the game isn't perfect, but I think it still might be of help). Usually 3-5 images per location and by clicking the HPAid on top of every image you can navigate to more images.

http://www.proteinatlas.org/learn/dictionary/cell
Sheldon d'Albion
#94 - 2016-03-11 11:26:42 UTC
So Discovery ... , quite a big challenge with really puzzling "tests"
I thought I could be good at that but unfortunatly some profond and obscur considerations prevent my accuracy to be better than 48% .
I was quite sure before submitting that I would get an incorrect match despise a really good odds
like this example http://imgur.com/JLX2vMj
It is still funny but don't know something missing ......
beakerax
Pator Tech School
#95 - 2016-03-11 11:41:24 UTC
HPA Illuminator wrote:
http://www.proteinatlas.org/learn/dictionary/cell

That does help, thank you!
Nevyn Auscent
Broke Sauce
#96 - 2016-03-11 11:41:44 UTC
Sheldon d'Albion wrote:
So Discovery ... , quite a big challenge with really puzzling "tests"
I thought I could be good at that but unfortunatly some profond and obscur considerations prevent my accuracy to be better than 48% .
I was quite sure before submitting that I would get an incorrect match despise a really good odds
like this example http://imgur.com/JLX2vMj
It is still funny but don't know something missing ......

When below 50% you normally only get 'Known' samples, and the known samples normally only have a single attribute. Once over 50% you'll get a larger mix. Personally this threshold of known slides only should be much higher in order to make for better results on the unknown/unlabelled ones that use group consensus since it ensures that people working on the unknown slides actually know what they are marking.

While the random clickers can be filtered out of the results, they are having a significant negative impact in game due to being present in large enough numbers to skew everyone else's accuracy rating, meaning people are often being called 'wrong' for marking an actually existing feature simply because a large enough portion of people spammed cytoplasm on everything.
HPA Illuminator
H P A
C C P Alliance
#97 - 2016-03-11 11:43:41 UTC
Sheldon d'Albion wrote:
So Discovery ... , quite a big challenge with really puzzling "tests"
I thought I could be good at that but unfortunatly some profond and obscur considerations prevent my accuracy to be better than 48% .
I was quite sure before submitting that I would get an incorrect match despise a really good odds
like this example http://imgur.com/JLX2vMj
It is still funny but don't know something missing ......


Agree that it looks like cell to cell variation but with green plus blue toggled on I can't say more than that. Do you have a green only view of it?
HPA Illuminator
H P A
C C P Alliance
#98 - 2016-03-11 11:49:31 UTC
Nevyn Auscent wrote:
Sheldon d'Albion wrote:
So Discovery ... , quite a big challenge with really puzzling "tests"
I thought I could be good at that but unfortunatly some profond and obscur considerations prevent my accuracy to be better than 48% .
I was quite sure before submitting that I would get an incorrect match despise a really good odds
like this example http://imgur.com/JLX2vMj
It is still funny but don't know something missing ......

When below 50% you normally only get 'Known' samples, and the known samples normally only have a single attribute. Once over 50% you'll get a larger mix. Personally this threshold of known slides only should be much higher in order to make for better results on the unknown/unlabelled ones that use group consensus since it ensures that people working on the unknown slides actually know what they are marking.

While the random clickers can be filtered out of the results, they are having a significant negative impact in game due to being present in large enough numbers to skew everyone else's accuracy rating, meaning people are often being called 'wrong' for marking an actually existing feature simply because a large enough portion of people spammed cytoplasm on everything.


Agree that it's annoying that you get "wrong" despite you know you're right (I feel the need to make an more extensive tutorial video really explaining the difference between golgi/mitochondria/vesicles and mtoc/aggresome which ppl seem to have problems with).

For the examples I looked at when playing I don't think the farming seemed to be that bad. I could in most cases really understand why one would choose those locations (but of course there were some where I was like "coooome on... How can you click nucleoplasm when it's clearly fibrillar center and nucleus" Cool)

Hopefully ppl who don't play it with intentions of being serious will quit soon.
beakerax
Pator Tech School
#99 - 2016-03-11 12:18:39 UTC
HPA Illuminator wrote:
Hopefully ppl who don't play it with intentions of being serious will quit soon.

I think the results have improved a bit already. The novelty factor was probably hurting this more than anything else.

I'm glad to see that you're taking the long view :)
HPA Illuminator
H P A
C C P Alliance
#100 - 2016-03-11 12:58:58 UTC
beakerax wrote:
HPA Illuminator wrote:
Hopefully ppl who don't play it with intentions of being serious will quit soon.

I think the results have improved a bit already. The novelty factor was probably hurting this more than anything else.

I'm glad to see that you're taking the long view :)


I'm (everyone in the group) are super excited over the interest for PD, and the crazy number of ppl that have been playing and helped classified the images. We never imagined this kind of turnout.

Also, glad to hear you think they've improved somewhat already, crossing fingers it'll continue that way! (I've been home sick since Wedn so today is the first day I've been able to try it - am now SO annoyed at being stuck at 60% since ages... wtf? Evil)