Test Server Feedback

First ^_^

need more examples to compare for the different options, to get a better impression of whether or not an option can actually apply. only one picture for the option doesn't suffice :/

also, regarding the history: it'd be nice to be able to actually see the approved result when it's in, so i can better learn what i did wrong.

and finally, it really needs a "no clue, next!" button. no rewards, just an option to not knowingly submit bad data :/


edit: almost forgot: needs to be resizable, and more zoom options. maybe also take the "overview" outside the zoom view, to provide more visible space

I'm finding lack of examples and lack of feed back to be making the whole experience feel like I should stop trying and just click on random stuff since it doesn't seem to affect my accuracy in any real fashion.

Would be nice if we got a much larger sample of confirmed in the earlier levels. Right now I feel as if I'm punching blind. I think I did it right but since I have no feedback about if I'm making the right decisions.
The % of other people that clicked the same as you is not a good indication in part because of small sample size but the few that confirmed samples that I've done I find that it seems to be something completely different to what the majority of people have ticked.

Can you confirm or not whether the results from Singularity will actually be used in the research project?

I ask because you come to us on the singularity server to essentially try to break things and work out the bugs. However, if we are breaking things in this case (by randomly clicking to see how close we can get with the least amount of work), that would be very bad for the intended goals.

If I am able to get a 40-50% just by randomly clicking in a short amount of time, you know it will happen on the main server.

My advise would be to set the payout structure to be something like this:

0-75% - 0 LP
75-80% - 10LP
80-85% - 50LP
85-90% - 150LP
90-95% - 250LP
96-99% - 450LP
100% - 500LP

While the actual ranges and payouts could be adjusted, I think you can see that this method rewards those who actually try and get good at this. This would help discourage people from randomly clicking and ruining SOE LP.

Most of the stuff is already said but I wanted to give my feedback nonetheless point by point:

• People could easily skew the average accuracy by just deciding that every image is a....negative for example. Take a look at this image. It is very clear to anyone that played this game for over 15 minutes that that is NOT a cytoplasm. Most likely it is a negative but 93% voted for cytoplasm anyway. This can be abused and needs to be taken a careful look at. Lower accuracy should (at the start) not be punishing but later on it needs to be, lest it be abused.
• Tie rewards to leveling up a rank. Like an additional LP reward or a special item like an implant, this will incentive people to play.
• Do not give SoE LP, this (if implemented correctly) will be the new favourite pasttime of everyone waiting for a fleet or something. The SoE LP market will be flooded right away. I think it is better to give CONCORD LP or heavily reduce the SoE payout and up the ISK payout
• Make the tutorial better and longer by giving more and more clear examples. Currently there are only a few images before one is thrown in. It took me some time before I got a clear understanding of how it worked and that was not thanks to the tutorial! The tutorial is the HOOK which will leer people in to this game. It has a huge potential RL impact and creates a pasttime activity. Making sure that people understand how to play it is imperative, I feel.
• Allow players to invite other players to the image they are working on, this creates more interactive play and it probably will form groups. People can help each other which creates bonds, friendships and more of that good stuff. For that matter: a common dedicated chatchannel might be in place.
• Resizable windows

For the rest I can say it is a very nice addition, one I will use very much enjoy and use. A little tweaking, especially to the tutorial and the accuracy/payout tie and bring it on :)

Add an Option to either adjust or mute the constant background sound that plays when the window is open.

Got to head out, but I will check this out later. This should be interesting :)

Okay so I spent a while on this actually TRYING to get the correct answer. It became clear that there was a disproportionate number of players purposely random clicking in order to see how far their could get. Some ideas from my experience so far:

1) The tutorial needs to be longer:
- Variations of the same formation type and to cover ALL of the options.
- Shouldn't be able to leave the tutorial until you've passed a threshold of accuracy.
- Given the length of the tutorial, a reasonable reward should be given at the end

2) A practice option:
- Rather than revisit the tutorial, include an option to practice against a database of samples which have already been solved.
- This wouldn't affect your accuracy rating.
- Reduce reward but enough to incentivize people to perfect the skill.

3) Higher accuracy threshold for payments
- To discourage people from RNG clicking to farm.
- Encourage people to use practice mode.

4) Restrict who affects the result:
- Only higher accuracy pilots count towards determining the answer to a sample.
- Lower accuracy pilots will still get same payout if correct, but will not contribute to determining if it's correct.
- The threshold could be the mean accuracy, adjusting later depending on number of false positives.
- Alternatively have people's accuracy count as an exponential multiplier i.e. their choices have more weight.

EDIT:
5) Group Play / Spectator (not that kind of group play!):
- Allow friends to team up to find the right answer.
- Submits if everyone agrees, else returns until they can't agree.
- Reward stays the same but split evenly than adjusted based on individual accuracy.
- Will help increase individual accuracy.
- And/or a spectator mode so you can be mentored by a friend.

EDIT 2:
6) Fishing out the abusers:
- Periodically give a Foreign Tissue Sample which has already been solved with a VERY high relative consensus.
- Use the results to determine those who are clearly randomly clicking.
- Give a time out from the "real" game if they're found to get too many wrong.
- Timed out players can still use the practice feature.
- Peer-review feature; high accuracy pilots have option to review the mistakes of the lowest accuracy pilots (anonymously).
- They can determine whether the wrong answer was a reasonable mistake or completely wrong.
- If a pilot's mistakes don't pass peer-review, they are timed out from the "real game" for X days.

The reward curve needs to be exponential instead of linear, otherwise it is easy to farm without caring about the results

those ones that are highlited were also in the image and you missed them


red X you picked wrong green check you picked right green outline you missed this