These forums have been archived and are now read-only.

The new forums are live and can be found at https://forums.eveonline.com/

EVE Technology Lab

 
  • Topic is locked indefinitely.
 

Corp Assets xml endpoint cache time of 6 hours

First post
Author
Previous Topic Next Topic
Messenger Of Truth
Butlerian Crusade
#1 - 2015-04-10 10:36:35 UTC
I know that querying corporation assets is probably a massive database query in many cases. But 6 hours is a very long time between updates. It might not update during my entire play session. For example if materials are transported via contract, they don't show up in the corporation assets until up to 6 hours later.

What is the likelihood of this cache time being reduced a bit? A cache time of 1 or 2 hours would make a world of difference.

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
SJ Astralana
Syncore
#2 - 2015-04-10 20:58:01 UTC
This is a pain point for EPM subscribers as well. It's strange that we can hammer the market data every five minutes, yet have to wait for the length of a bible for assets, not to mention industry job history -- what the ... hell.

Hyperdrive your production business: Eve Production Manager

Ortho Loess
Escalated.
OnlyFleets.
#3 - 2015-04-11 19:46:24 UTC
SJ Astralana wrote:
This is a pain point for EPM subscribers as well. It's strange that we can hammer the market data every five minutes, yet have to wait for the length of a bible for assets, not to mention industry job history -- what the ... hell.


The reason that market orders get a nice short timer is that it's done through CREST.

If and when assets get put on CREST, we can expect a MUCH shorter cache timer, but don't expect much to change on the old API. It's been like this for years and we've never persuaded them to change it.

We can always try and persuade FoxFour though I suppose Big smile
CCP FoxFour
C C P
C C P Alliance
#4 - 2015-04-12 09:13:26 UTC
Assets, corp or personal, will NOT be getting a lower cache time. That is a really intensive procedure to run against our DP as the items table is incredibly large.

You can hit the market resource every 5 minutes because it's an entirely different kind of data. Aside from it being a completely different table in the DB that is a fraction of the size, it's data that tends to be loaded already and in the cache. If it isn't already loaded at least when you load it it's there for everyone that uses that market. Yea, the market data is completely different.

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.
Messenger Of Truth
Butlerian Crusade
#5 - 2015-04-12 13:16:02 UTC
Good to see you "working" on a Sunday there FoxFour!

I get what you're saying about database load, its kind of the answer I expected. There are lots of useful things that tools could do with a shorter cache time but not at the expense of ruining other parts of the game due to load.

Is there any way to partition corp asset requests so that they have less impact on the database? For example, would querying corp assets in a single system be less intensive than querying for all corp assets everywhere?

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
CCP FoxFour
C C P
C C P Alliance
#6 - 2015-04-12 18:05:19 UTC
Messenger Of Truth wrote:
Good to see you "working" on a Sunday there FoxFour!

I get what you're saying about database load, its kind of the answer I expected. There are lots of useful things that tools could do with a shorter cache time but not at the expense of ruining other parts of the game due to load.

Is there any way to partition corp asset requests so that they have less impact on the database? For example, would querying corp assets in a single system be less intensive than querying for all corp assets everywhere?


I will ask one of our DB programmers but I don't think so.

@CCP_FoxFour // Technical Designer // Team Tech Co

Third-party developer? Check out the official developers site for dev blogs, resources, and more.
Sentient Blade
Crisis Atmosphere
Coalition of the Unfortunate
#7 - 2015-04-12 20:52:44 UTC
CCP FoxFour wrote:
Messenger Of Truth wrote:
Good to see you "working" on a Sunday there FoxFour!

I get what you're saying about database load, its kind of the answer I expected. There are lots of useful things that tools could do with a shorter cache time but not at the expense of ruining other parts of the game due to load.

Is there any way to partition corp asset requests so that they have less impact on the database? For example, would querying corp assets in a single system be less intensive than querying for all corp assets everywhere?


I will ask one of our DB programmers but I don't think so.


For me personally, the benefits of faster querying of smaller elements are numerous. For example, I'd love to be able to query a specific hanger, the ID of which I would know well ahead of time, to be able to know which items I need to build for my industry.

It seems like being able to query a specific parent ID should be massively more efficient from a DB perspective than a global assets query, even if it's not recursive (assuming we can query cans etc using the same method if needs be).
Max Kolonko
Caldari Provisions
Caldari State
#8 - 2015-04-13 08:16:57 UTC
Same here, any way of quering small subset of assets with much shorter time would be wonderfull

Read and support: Don't mess with OUR WH's What is Your stance on WH stuff?
Ortho Loess
Escalated.
OnlyFleets.
#9 - 2015-04-13 16:30:34 UTC
Might be more doable with CREST, since that's much more tied into doing the same stuff already done in the client and getting contents of a certain hangar is definitely a common thing to do in the client...

I don't expect to see assets hit crest particularly soon though :(
Messenger Of Truth
Butlerian Crusade
#10 - 2015-04-15 20:35:37 UTC
You know what would be good - being able to subscribe to a corp hangar location, then receive notifications a la twitter every time something goes in or out like seems to happen on the industry screen... but...dreams are cheap...

Trade Hub Price Checker: stop.hammerti.me.uk/pricecheck

Visit "Haulers Channel" in game for all matters courier-related.

Structure name/system API: stop.hammerti.me.uk/api
Annah Sun-Scape
Temet Nosce Ex Astra
#11 - 2015-04-17 21:15:25 UTC
Messenger Of Truth wrote:
You know what would be good - being able to subscribe to a corp hangar location, then receive notifications a la twitter every time something goes in or out like seems to happen on the industry screen... but...dreams are cheap...


Yea I would love to have some kind of log at least.
Someone took/used or add something? Ok log it, and I will charge him for that - that's how corporations works.