Quote:
Originally Posted by ldambrosa
Very curious to discover the details behind:
Historical Updates
• Updated historical DB to merge in more information
|
Basically, we've added the historical db to a proper database, merged in with the roster database.
Short term this actually means there may be some bugs as there's a lot to clean up given that we're talking about merging millions of lines and fields of data in hundreds of thousands of player records. We've done a ton of work cleaning this up, but there are surely some issues that remain.
But the process has already allowed us to clean up a lot of legacy data issues as part of the merger, and will allow us to properly fix any issues going forward, whereas this was extremely difficult before given the fact that the information was previously not really in a proper database.
We'll also much be able to much more easily do stuff like updating Negro league data, adding in additional data for new leagues, adding additional data points that will help us refine things like fielding ratings etc.
We haven't actually done any of that yet (other than a basic update to the fielding data and some of the algorithms there), as it's been a very intense nearly six month process just getting the basic merger done. But we'll definitely be in a much better place to be able to do this going forward now.