Test Server Feedback

Hi!

This is a post to give you guys a heads up that we just deployed the first version of a new testing framework to Singularity. As a result, it's possible that you will notice differences between your client behavior compared to other folks', or even differences between two of your characters if they happen to be on different accounts. Don't be alarmed!

If you aren't familiar with A/B testing, it's a strategy at that allows us to try variations in implementation simultaneously, which can be a very valuable data gathering tool.

For this pilot, the only feature affected is a new set of tool tips. The main goal currently is to simply validate our A/B implementation and so we are happy to let you know so you don't think something is broken .

Thanks for testing o/

log in... if your tooltips (for example on the neocom) are different from the ones you have on TQ, you have the new ones we are testing

I just checked, and you are not in the group with the new tooltips

A possible future thing may be a flag in crimewatch that says you're in group a (or b or c or whatever) with a brief description of the differences.

For those needing to create new characters/ or use an alt for testing to make sure we are able to test both or all versions could you tell us how you split the characters so we can create testing characters in the opposite group.

Is it random or split alphabetically this time?

Thanks. I'll take a look when i get home to see if my second account got lucky and is in the other group.

I must be blind and will play around with them my self but i cant find your mouse placement and the tool tips in most of those pics.

if you want to use this to get SiSi players' feedback on design changes (especially UI) it would help to let the players flip between the groups/designs at runtime

that way players could immediately compare the possibilities

maybe you could even plug a design survey and/or feedback form into the testing ui, attaching player's feedback to test metrics

I seem to be one of the chosen ones =P so here is some feedback
I think that the new tool tips waste too much space and maybe are a bit too large in general but mainly the space between lines of text and text and the border should be much smaller
https://www.dropbox.com/s/d566g1g0d8hmgqv/2014-03-28_19-59-09.png (red colored parts are just not needet)
https://www.dropbox.com/s/i0h6sy7v90hmdeo/2014-03-28_19-58-21.png
Edit: made a quick mockup to show what I think would look better (left is my edited version)
https://www.dropbox.com/s/dfuxcjrlxxzpzgz/2014-03-28_20-11-55%20edit.png


in some cases the text is broken over for only one word instead of making it just a little longer which wastes a lot of space
https://www.dropbox.com/s/5nmp3hv9pi8pl18/2014-03-28_19-54-42.png

and a bug
https://www.dropbox.com/s/1lsnl1oask3o16z/2014-03-28_19-53-59.png

EDIT: the shortcut here is missing its bound to default control
https://www.dropbox.com/s/w4pxiezzjoj0g5f/2014-03-28_20-40-58.png

EDIT: this feels very redundant since you can already show those things on overview
( its also a bit buggy )

I feel that there should be an option to only show tooltips when a key is pressed

To explain a bit more how this all works:

Right now we are testing three things on SiSi: We are testing the new tooltips, we are testing the A/B-testing framework, and we are making sure the old tooltips haven't regressed given the above development/changes. For this testing the users on SiSi were split 50/50 into the new tooltips and the old tooltips.

On TQ we will deploy this in at least three phases: First phase will be a "dark" deployment in which everyone but selected CCP devs will have the old tooltips. Second phase will be the experiment where a certain ratio of new players will get the new tooltips. Third phase will be a general rollout to all players (based on positive results from the experiment). It's during the third phase we will do the normal round of devblogs, etc.