CSV Dumps in OOTP 2007

Comedian2004 · 03-19-2007, 03:30 PM

I am posting this here, since they have not opened the gate for the other forum yet. I will copy it over to it when it is open.

Let me start by explaining what a CSV dump is. The dump is a colleciton of files that are in CSV format, which lists different fields, with a comma or a semi-colon between them. You can change which character to use in the game setup. All of my programs do not care which one you use.

The dump simply creates all of the files based on the information at the time the dump is created. All of the information is available in the game, but as the years go by, the information is updated and the old information is not available anywhere in the game. An example would be a player's ratings. There is no way in the game to see what a player's power rating was 5 years ago, unless you are using the Almanac function. And even then, you are getting a scouts version of the ratings. The CSV allows you to see the actual ratings.

Major changes that I pushed for were some critical fields, like the current date of the simulation. I also strongly suggest that there be a way to do a monthly save and a yearly save for the CSV dumps. I will explain the monthly dump in another post.

1st, there is the standard dump. I suggest you use this before you exit the game. This will allow my programs and other programs to have the current information available about your league. The time it takes for the dump is not very long, but the more teams and leagues you have, the longer it will take. Also, the longer your season is, the longer it will take, so a 95 year old season will take much longer than a 2 year old season.

The yearly dump, you will want to configure it to not include every single field. This will save a lot of time with the dumps in the later years. I have a simple way of remembering which ones you do not need each month and I will explain why.

When you click on EDIT PROFILE for yearly dump, everything will be selected. Remove the check marks by and field that contains the following:

League_history, Team_history, career and also the cities and nations files.

The league history and the team history file contains the entire history of the league for that particular field. All of this information can be obtained from the normal complete CSV dump that you do before you exit the game. Repeating it in the yearly dump has no benefit to a programmer, like myself. It just slows down each season saving it. The cities and nations file do not change unless you have modified the cities or nations database file. Plus, the file contains so much data, no 3rd party program will want to use it.

For the nations and cities, they have two additional ways to save it, and that is to just save the cities and nations that are used in your season. I still do not recommend that you save it with that, unless the 3rd party program requires you to.

The files will be saved in the saved_game folder under a folder called DUMPS. Inside this folder will be the individual year folders. Inside each of these folders will be the dump files. You can open any of these with an Excel type program or even notepad.

The downside to save the yearly files is that it will take up more disk space. A historical season in 1991 that is 90 years old using a COMPLETE DUMP (without removing my recommendations) will be around 50-60 meg.

I suggest that you do the dumps, even if you are not currently using any 3rd party program. As if you play 50 years and then start using the dumps, the years without the dumps will not be able to be accessed by a 3rd party program.

If you have any questions, feel free to ask me.

Comedian2004 · 03-19-2007, 03:39 PM

Two programs I will have ready for release this weekend for 2007 are:

AULOGOWatchDog:

This program runs in the background and when the season ends and the yearly dump is done, it will automatically update all of your historical teams to have historically correct logos. This will happen automatically, even when you are autosimming multiple seasons. This will allow you to stop the program at anytime and the teams will all have correct logos. It will also allow the Almanac to have correct team logos (if you copy have the copy logos option on)

AUBoxScorePro

This is a pretty cool program. It requires a couple of options to be turned on, like the yearly dump and also to save all box scores and copy them to the Almanac. You run my program and you can quickly view any box score by looking at the Accomplishments. So, you click on the no-hitter button and you will see all of the no-hitters. Click on one and the box score will popup for you instantly. You can view no-hitters, 6 hit games, 3+ home runs, games with cycles, games where a player has a CEI and milestones, like a players 500th home run, plus when a major hitting streak has ended.

The program also allows you to add a recap to the box score that is 100 percent compatible with the recap option built into the game.

It also has an automate option that allows you to just simply click and it will automatically add all of the above events to the correct box scores.

It also has the ability to gather all of the box scores for a certaiin player. So, you can find all of the box scores for Pedro Martinez and then be able to copy them to a different folder.

I plan on adding a lot of nifty options to this program and I think this is going to be a smash hit program.

silvam14 · 03-20-2007, 09:52 AM

Thanks Larry! I've been following your recommendations since the advent of my latest league which is now 15 years old!

A question I have for you is this:

Since I have saved my CSV and report dumps for each season in 2006, will I be in any way able to import this into the almanac feature in 2007?

Thanks

Comedian2004 · 03-20-2007, 10:12 AM

A lot of the CSV dump files were changed this year. New fields added, some re-arranged, etc., so you can't really import them in. A third part program would choke on the different layouts if the program was designed to read the ones created with 2006.

However, I would save them, as maybe one day I can write a conversion utility for them.

Bobbert · 03-26-2007, 09:08 AM

Is there any reason why one would want to do monthly dumps instead of yearly if you don't consider the case where you want to do something with an ongoing season?

Comedian2004 · 03-26-2007, 09:57 AM

The monthly bonuses will not be used a whole lot, but it is very nice to have in there to be able to do.

The only real reason you would want to do monthly dumps is to follow a player's ratings from month to month. I have a tool we used for beta to see a player's ratings over his career. The task is time consuming to use, but I will release it later on.

As far as doing a monthly dump, no, I would not normally turn it on unless you wanted to track some month by month ratings or if a specific 3rd party recommended it.

With that said, the files that contain information that you would want to track are players.csv, players_fielding.csv, players_pitching, players_batting and players_values

03-19-2007, 03:30 PM	#1
Comedian2004 Hall Of Famer Join Date: Nov 2004 Location: In a house in Saint Cloud, Florida. Posts: 7,085	CSV Dumps in OOTP 2007 I am posting this here, since they have not opened the gate for the other forum yet. I will copy it over to it when it is open. Let me start by explaining what a CSV dump is. The dump is a colleciton of files that are in CSV format, which lists different fields, with a comma or a semi-colon between them. You can change which character to use in the game setup. All of my programs do not care which one you use. The dump simply creates all of the files based on the information at the time the dump is created. All of the information is available in the game, but as the years go by, the information is updated and the old information is not available anywhere in the game. An example would be a player's ratings. There is no way in the game to see what a player's power rating was 5 years ago, unless you are using the Almanac function. And even then, you are getting a scouts version of the ratings. The CSV allows you to see the actual ratings. Major changes that I pushed for were some critical fields, like the current date of the simulation. I also strongly suggest that there be a way to do a monthly save and a yearly save for the CSV dumps. I will explain the monthly dump in another post. 1st, there is the standard dump. I suggest you use this before you exit the game. This will allow my programs and other programs to have the current information available about your league. The time it takes for the dump is not very long, but the more teams and leagues you have, the longer it will take. Also, the longer your season is, the longer it will take, so a 95 year old season will take much longer than a 2 year old season. The yearly dump, you will want to configure it to not include every single field. This will save a lot of time with the dumps in the later years. I have a simple way of remembering which ones you do not need each month and I will explain why. When you click on EDIT PROFILE for yearly dump, everything will be selected. Remove the check marks by and field that contains the following: League_history, Team_history, career and also the cities and nations files. The league history and the team history file contains the entire history of the league for that particular field. All of this information can be obtained from the normal complete CSV dump that you do before you exit the game. Repeating it in the yearly dump has no benefit to a programmer, like myself. It just slows down each season saving it. The cities and nations file do not change unless you have modified the cities or nations database file. Plus, the file contains so much data, no 3rd party program will want to use it. For the nations and cities, they have two additional ways to save it, and that is to just save the cities and nations that are used in your season. I still do not recommend that you save it with that, unless the 3rd party program requires you to. The files will be saved in the saved_game folder under a folder called DUMPS. Inside this folder will be the individual year folders. Inside each of these folders will be the dump files. You can open any of these with an Excel type program or even notepad. The downside to save the yearly files is that it will take up more disk space. A historical season in 1991 that is 90 years old using a COMPLETE DUMP (without removing my recommendations) will be around 50-60 meg. I suggest that you do the dumps, even if you are not currently using any 3rd party program. As if you play 50 years and then start using the dumps, the years without the dumps will not be able to be accessed by a 3rd party program. If you have any questions, feel free to ask me. __________________ Like BLUES? Visit www.smokestacklightnin.com, you will LOVE it! New show every Monday!! New Blues HOF![/COLOR][/FONT]

03-19-2007, 03:39 PM	#2
Comedian2004 Hall Of Famer Join Date: Nov 2004 Location: In a house in Saint Cloud, Florida. Posts: 7,085	Two programs I will have ready for release this weekend for 2007 are: AULOGOWatchDog: This program runs in the background and when the season ends and the yearly dump is done, it will automatically update all of your historical teams to have historically correct logos. This will happen automatically, even when you are autosimming multiple seasons. This will allow you to stop the program at anytime and the teams will all have correct logos. It will also allow the Almanac to have correct team logos (if you copy have the copy logos option on) AUBoxScorePro This is a pretty cool program. It requires a couple of options to be turned on, like the yearly dump and also to save all box scores and copy them to the Almanac. You run my program and you can quickly view any box score by looking at the Accomplishments. So, you click on the no-hitter button and you will see all of the no-hitters. Click on one and the box score will popup for you instantly. You can view no-hitters, 6 hit games, 3+ home runs, games with cycles, games where a player has a CEI and milestones, like a players 500th home run, plus when a major hitting streak has ended. The program also allows you to add a recap to the box score that is 100 percent compatible with the recap option built into the game. It also has an automate option that allows you to just simply click and it will automatically add all of the above events to the correct box scores. It also has the ability to gather all of the box scores for a certaiin player. So, you can find all of the box scores for Pedro Martinez and then be able to copy them to a different folder. I plan on adding a lot of nifty options to this program and I think this is going to be a smash hit program. __________________ Like BLUES? Visit www.smokestacklightnin.com, you will LOVE it! New show every Monday!! New Blues HOF![/COLOR][/FONT]

03-20-2007, 09:52 AM	#3
silvam14 Hall Of Famer Join Date: Apr 2004 Location: Dedham, MA Posts: 9,925	Thanks Larry! I've been following your recommendations since the advent of my latest league which is now 15 years old! A question I have for you is this: Since I have saved my CSV and report dumps for each season in 2006, will I be in any way able to import this into the almanac feature in 2007? Thanks __________________ Senior "Nancy Boy" of the OOTP Boards _______________________________________________

03-26-2007, 09:08 AM	#5
Bobbert Minors (Triple A) Join Date: Sep 2006 Location: Linköping, Sweden Posts: 222	Is there any reason why one would want to do monthly dumps instead of yearly if you don't consider the case where you want to do something with an ongoing season? __________________

03-20-2007, 10:12 AM	#4
Comedian2004 Hall Of Famer Join Date: Nov 2004 Location: In a house in Saint Cloud, Florida. Posts: 7,085	A lot of the CSV dump files were changed this year. New fields added, some re-arranged, etc., so you can't really import them in. A third part program would choke on the different layouts if the program was designed to read the ones created with 2006. However, I would save them, as maybe one day I can write a conversion utility for them.

03-26-2007, 09:57 AM	#6
Comedian2004 Hall Of Famer Join Date: Nov 2004 Location: In a house in Saint Cloud, Florida. Posts: 7,085	The monthly bonuses will not be used a whole lot, but it is very nice to have in there to be able to do. The only real reason you would want to do monthly dumps is to follow a player's ratings from month to month. I have a tool we used for beta to see a player's ratings over his career. The task is time consuming to use, but I will release it later on. As far as doing a monthly dump, no, I would not normally turn it on unless you wanted to track some month by month ratings or if a specific 3rd party recommended it. With that said, the files that contain information that you would want to track are players.csv, players_fielding.csv, players_pitching, players_batting and players_values