DSDA command line application I made

I'm working on creating a Discord bot to get info from DSDA for the Doom speedrun Discord server linked in the pinned threads, so I made a Python class that extracts a lot of info from DSDA automatically. Since it wasn't much effort to do so, I also created a command line version of it for anyone not in the Discord server to use. Supported functionality by this application:
- Getting records from DSDA
- Returning some stats on players and wads (so some of the work from this thread is performed automatically :))
- Returning random wad and player pages
- Retrieving the last update date

The record getting functionality uses simple guesses I made for compatibility of each wad by parsing all wad pages and assuming the most used compatibility is the intended compatibility (unless it's mostly demos recorded with generic PrBoom or something with no complevels). The player stats functionality also does a somewhat smarter search, so it will find players by substrings. I also manually a compiled a list of player aliases I consider notable, so it will search for those too (meaning you could find Adam Hegyi's stats with "AdamH" or something). The stats that the application can return also extend beyond just total time and demo count.

You can use "help" after launching it to find the commands and, you'll need to run "sync" at first in order to get some info from DSDA cached for the commands to work. Here's some sample output for playerstats for my page:

Total demo count: 1477
Total demo time: 39:46:57
Longest demo: 02:13:26
Average demo time: 00:01:36
Total TAS demo count: 48
Average demos recorded per wad: 6
Number of distinct wads recorded for: 214
Maximum recorded wad: perdgate, 285 demos
Maximum recorded category: Pacifist, 322 demos

Here's a link to the source code, and a tentative link to a package containing an exe that should run in Windows for anyone who doesn't have Python. Suggestions for extra features/other improvements are welcome. :)

Edit: Updated links to new version with minor bugfix, thanks ClumsyDoomer.

Hell yeah.

Sounds good, I just hope it's not too much of a strain on the server and that Andy is okay with it. Sounds like you're accessing a lot of pages in a short time.

Memfis said:

Sounds good, I just hope it's not too much of a strain on the server and that Andy is okay with it. Sounds like you're accessing a lot of pages in a short time.

Yeah, I've been worrying about that too, but I think it should be fine? Except for a full sync, the rest of the commands shouldn't access too many pages. The only one that access a very large amount of pages is the full wad compatibility sync, and assuming the cache file generated by it is not deleted, all subsequent syncs should only access newly added DSDA wads.

Updated with new version that addresses some requests people had and some minor issues. Changelog:

I tested most of the functionality and it should work hopefully (too lazy for automatic tests). Download Source code

off topic:

people are worrying about Andy's server bills? Why does he even has bills? Why dont we donate for him and his server? Imo he should not have any costs for his awesome service additionally to the time he puts into it. I would donate right away, is there a way to donate for him?

on topic:

features what I always missed on doomedsda is that you cannot see the submission or creation date of the demos. you have to painstakingly download and unzip each submission to find out which run came first. Not sure if anyone else is interested in this, but listing demos chronologically in a list not with the lmp name, but an actual readable name like doom2.wad map01 playerXY submission date.
edit: if this feature would mean the program has to download each submission to check the date, then this would cause too much traffic I guess

termrork said:

on topic:

features what I always missed on doomedsda is that you cannot see the submission or creation date of the demos. you have to painstakingly download and unzip each submission to find out which run came first. Not sure if anyone else is interested in this, but listing demos chronologically in a list not with the lmp name, but an actual readable name like doom2.wad map01 playerXY submission date.
edit: if this feature would mean the program has to download each submission to check the date, then this would cause too much traffic I guess

These kind of things are going to natively be a part of dsda-r; if you have more requests feel free to toss them over here: https://www.doomworld.com/vb/post/1657372

Yeah, doing something that requires going to too many pages on DSDA or downloading demos is not in the scope of this project. I think DSDA would need to be revamped with things like an official API and natively implement much of what this bot does before that can be done.

I made a few more improvements and minor fixes to the client to version 0.3. v0.3 changelog below:

Full changelog in source code and exe zip files. Also, the Discord bot I mentioned in the OP is now running with this, so if you go to the Discord channel linked in the stickied threads, you can use this bot without having to run it in command line. :)

Download links:
Exe
Source code