How about removing all inactive players' times&ranks? Start with removing the ones who haven't been active in a year or so and have a low rank and see if it helps.