Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
7hm

Map Database

Recommended Posts

Updated 4/22

 

I've been working on an excel spreadsheet that contains information about not only wads, but the maps within those wads. I wanted a way to be able to quickly load up maps by a particular author, or in a particular series. Thus began a pretty lengthy cataloguing process.  I've been kicking it around for the last couple years.  There are, as of this latest update, about 13k maps catalogued across 2k+ wads, made by ~1400 authors.  The excel spreadsheet has some basic search functionality if you want to find out who made what when, etc.

 

How to use the search:

Just type in whatever you want to the search box and it will filter based on that. It looks for inclusion, not exact matches. So doom would match to doom, doom 2, doom the way id did, etc. You can be more specific by using "" ie. "doom the way id did" would only find those maps.

You can use - to filter your results. ie ("ultimate doom" -romero) would result in all the ultimate doom maps that romero did not do.

You can use + to force a field. ie ("doom 2" + romero) would only result in the "doom 2" matches that romero is involved in.

You can use +/- with "", but you need to enclose the +/- inside the quotes. ie. "+doom 2"

 

Results show up in the "Results" tab.

How to use the results tab to create a batch loader:

 

The whole point of me doing this is that I use it to automatically generate a batch file to play wads.  If you want to read about that, view the below:


How this works:
1) Click the button in the "Main" tab to search for map criteria (implemented to check the map tab only, and far from perfect, see below) in order to generate a list of maps.

2) This list copied into a "results" tab, which you can then order or adjust as you like.

3) Press the "generate batch file" button on the main tab and that creates a list of batch files.

4) Copy into a text file and run as a batch. (Assuming you have correctly inputted your port path and skill level on the "main" tab.)

To run a series like the Odessa series, for example, you would search for all the Odessa maps, and the batch file will automatically load each wad appropriately and direct you to the correct map.)

...

Stuff about the batch file generator: I forgot to mention that the batch info that is generated works under the assumption that the batch file is in the parent folder, and that the parent folder contains all the wads. I have my own file structure for storing wads, but as I work through them to add them to this db, I copy the .wad file into a separate folder where I store the batch.

EDIT: An important assumption that is made with the batch files is that the wads are all stored in a single directory (at least the ones that you are referencing), AND that a sub-directory holds the ports.

In other words, to get this working I have copied out wads into a DoomWads folder, and inside of that folder have placed my port installs. You could also use shortcuts I think. So far if you include all the listed wads and the three source ports, the directory is about 4 gigs.


Things I'm still working on:

More maps / wads. There are obviously thousands more maps, if not wads, to go. I should also probably include vanilla / limit removing compatibility (as well as other source port specific stuff) - right now I basically just say "Boom / ZDoom / Doom" and lump limit removing and vanilla together.  I also don't distinguish which version of ZDoom or GZDoom is required (when that's appropriate, I guess graf says it shouldn't be required).

At some point I'll put this into an actual DB and then build a front end off of that, either some kind of launching program or some kind of web based thing. But that's a long way away.

Edited by 7hm

Share this post


Link to post

Maybe you are trying to do something different, but is your idea something like this? I think the "additional files" thing (file 2, file 3, etc.) were not taken into account (I really don't remember, but I won't read the whole thread again).

EDIT

Share this post


Link to post

Using Excel 2003. I had to install VBA, it seems to be working now. Good stuff.

Share this post


Link to post

^^^^^
Nice, good to hear it works.

Zed said:

Maybe you are trying to do something different, but is your idea something like this? I think the "additional files" thing (file 2, file 3, etc.) were not taken into account (I really don't remember, but I won't read the whole thread again).

EDIT


That was the impetus for me starting this (kind of), but what hobomaster has ended up with is a little different. The problem with any type of wad launcher that doesn't have its own db with wad info is that you can't scrape files for map metadata outside of the name (if that). That data has to be manually collected. There isn't a standard format for .txt files to store the data either, so it really does become a manual process. Where the data is readily available, I'm pretty quick doing it now at least. Ideally the data from this would eventually be implemented into an actual frontend (it's just a couple csvs after all), but that's way beyond my skillset.

edit:

I noticed some issues with the wad info having to do with compatibility, so I uploaded a new version. I've also got to add something for Doom64, forgot about that.

Share this post


Link to post

Double posting, but I uploaded a new version that fixes me not adding a -warp command to the batch file (oops), as well as bumps the maps up to over 3k (mostly classic series, also Tab).

Share this post


Link to post

And another update.

I added a quick batch loading front-end. The results of the batch tab include not only the map results, but also the code to run the front end. Pretty easy to use, you just copy and paste the results of that tab into a text file and run it as a .bat.

Here's a picture of an exciting batch file that has been generated through excel. (It's set up to automatically go to the next map, though it waits for you to ok playing it. That way you can re-do the map if you want, or go back to the main menu and pick a different map. Also recording isn't set up yet.)



Also more maps. Working through the old doomworld top 100, slowly, and trying to grab some of the megawads people have done recently as well.

(Dunno if this was even the right forum for this. In any case I do have a general request for help - it's going to take me an absurd amount of time to do the data collection for map info. If anyone wants to help, jump onboard. Also, if anyone can take that info and turn it into something nicer than a batch file front-end, please do.)

Share this post


Link to post

I'm still working on the vba component (I have a much better search system set up, but it isn't fully working yet, so I've left the original search stuff in for now), but in the meantime, I've uploaded a new version. Up to ~530 wads and ~4500 maps, and have started to run through the Cacowards. I thought I had a lot of Doom stuff downloaded (I do...) but there are still dozens of wads I'm missing from those lists, and I'm starting to hit more of the single map releases, so the data entry is slower. I'm finally closing in on (or have already) cataloging more maps than KMX E XII, although certainly not playing that many. :)

I also added a map log to the batch file - when you finish the map it will add to a log.txt file in the batch file directory that tracks the map you just completed (if you play continuous, it only tracks the first one of course, but it's good for pistol starting, which is a huge part of why I set this up in the first place). You can go into the log file and add notes if you want.

Share this post


Link to post

Big time necro of my own thread.

Not that there was a ton of interest in this, but I'm still kicking it about and adding new wads to it as I re-gain interest in doom. It seems to come in waves.

Up to 630 wads comprising just shy of 5400 individual maps. The next big push will be to get Memfis maps in here.

I've also tweaked the batch template so that the recording functionality works. It puts the recordings into a subfolder called Record, naming the file record_%current%_%rng% where %current% is the map number from the batch file and %rng% is a random number. I would highly recommend renaming these on an ongoing basis obviously, because they could absolutely overwrite if you don't do so.

New link: http://s000.tinyupload.com/index.php?file_id=01313990283184777582

Share this post


Link to post

A year later, another necro.

1329 wads catalogued, encompassing ~9500 maps.

Work from more than a thousand authors. The top 20 by # of maps is included here. Numbers aren't perfect, because not everything under the sun is catalogued, and in some cases maps are catalogued twice (such as with Valiant / Valiant: Vaccinated Edition, or speedmaps showing up in both speedmapping and individual collections).

Alias			Number of Maps
--------------------------------------
pcorf			301
TimeOfDeath		276
skillsaw		150
Eternal			138
Nicolas Monti		135
Memfis			115
valkriforce		110
Erik Alm		104
Kaiser			102
Kristian Aro		101
Cyb			101
Shadowman		100
Daniel			99
Jimmy			97
jazzmaster9		91
Joshy			87
Ribbiks			87
Obsidian		85
Datacore		82
The Ultimate DooMer	80
I'm working on converting this into a more structured DB, but meh. It's a slow process when I also use this to actually play maps.

Anyway the updated link is here: http://s000.tinyupload.com/index.php?file_id=38880200761099277648

Share this post


Link to post

Not quite another year since the last bump, but eh, this update is big enough to necro again.

 

Up to 13,079 maps in 2126 wads, representing the work of 1465 authors.  I'm finally starting to reach the point where most of the megawads have been catalogued, and what's left in that area is stuff of perhaps questionable value.  However, there are still an absolute ton of single map releases to go, especially as you go back into the mid 90s. My "to sort" folder has ~1500 wads in it, and I'm sure there's other stuff of value out there - plus every time someone releases something, of course.

 

Anyway if this interests anyone the updated link is here: http://s000.tinyupload.com/index.php?file_id=05030207161642675797

 

Share this post


Link to post

Another year(ish), another necro.  Another 300 odd wads and 1500 maps.  Trying to update with newly released projects but mostly just randomly adding stuff at this point.  I've made some aborted attempts at putting this into a form that could be usable by others, but without already having a setup to turn the DB results into easily playable batch files (which is how I actually use this thing) I generally stop because it feels too much like work.  That said, I envision something along the lines of the complete marvel reading project, but not sure I'll ever get there.

 

Anyway if anyone wants to kick at it, I've attached the spreadsheet in a zip.

 

And the updated author details of the top 20 I've catalogued are below.

Alias			Number of Maps
pcorf			361
TimeOfDeath		276
Daniel			206
Jimmy			188
skillsaw		153
Ribbiks			149
Eternal			147
valkriforce		144
Memfis			143
Nicolas Monti		135
Cyb			134
PinchySkree		130
Ruba			124
Obsidian		123
joe-ilya		121
alterworldruler		116
Sasha			115
cannonball		114
Shadowman		112
Erik Alm		109

 

DoomWads.zip

Share this post


Link to post

It's been 6 months so I'll update this thing again.  Up to 16k maps across 2645 wads.

 

Not much changed in terms of authors at the top from last time around, so I thought I'd just throw out some random numbers instead - from what I've catalogued, 26 authors have been credited on 100 or more maps, 76 have been credited 50 or more times, and 227 have been credited 20 or more times.  Right now I've got 1695 credited authors accounted for.  The "to sort" file on my hard drive still have like 2k wads though, so lots left to go.

DoomWads.zip

Share this post


Link to post

Five longest map names so far:


A.S.S. speedmapping masters presents: Kyoto Drafts Dramatic Spiral of Speedrunners Shitmaps (WOO side rmx) (Abyssal Speedmapping Sessions: Session 28)


Xyzzy tries to make a joke about the long and ridiculous names of speedmaps of the past but fails miserably (Abyssal Speedmapping Sessions: Session 34)


i am well and truly ashamed of this map and i hope you dont make it this far in the wad and if you did well fuck sorry (Abyssal Speedmapping Sessions: Session 34)


THE NAME OF THIS MAP WAS ORIGINALLY 'FUCK ORTHAGONAL LINES' BUT THEN I DECIDED I DIDN'T WANT THAT SORT OF COMMITMENT SO NOW THIS IS THE NAME OF THE MAP (DUMP Episode 2: Dump Harder)


you thought the map name in ASS34 was long haha well listen here sonny jim I was only getting warmed up because this map name is both lengthier and girthier and much better and this time im not even sorry hahaha hope you get burned by the archviles and maybe also splattered by cyberdemons and enjoy the music from crash bandicoot which is actually good ok bye (Abyssal Speedmapping Sessions: Session 37)

Share this post


Link to post

Speedmap names are generally great. 

 

One thing that surprises me is just how few duplicate map names there are. Obviously with one word names you get duplicates, but you’d think there’s be more with two and three word combos that just seem doomy. 

Share this post


Link to post

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×