System and method for providing a probabilistic order of tiles relative to a current section of a video that a user is viewing. A cache implementation uses this ordering to decide what tiles to evict from the cache, i.e. which tiles will probably not be accessed within a particular timeframe, but not when to evict (this is up to the cache implementation). A cache implementation can also use the prioritized list of the present embodiment to pre-fetch tiles.