Imagine a 1 on 1 (not teams) competition between AI bots, like the Google AI Challenge. The various bots are assigned an ELO rating based on the outcome of the various versus matches. The reason I specify AI bots as they can compete 24/7 without regard for player fatigue, geolocation, etc.
Given limited server resources only so many bouts can be run per day. I'm looking for a heuristic (or an optimal algorithm) to choose which two bots should compete next.
All the past competitions have been tracked. By this I mean that the algorithm has more to work with than just the ELO ratings.
The use cases I'm partitularly interested in:
- The competition has been pairing randomly for while and now I want to make intelligent pairing decision.
- The Elo rating have stabilized and a bot is updated.
- The Elo ratings have stabilized and new bot is introduced to the competition.
I need to clarify. I'm not looking for an algorithm that will provide fair matches. I'm looking for an algorithm that will find matches most likely to update the Elo ratings of the bots to their "true" ratings with the least number of matches.