

WadArchive
-
Content count
98 -
Joined
-
Last visited
Posts posted by WadArchive
-
-
Have a read of README.MD, it will tell you the structure files. You have the hash already (E27E8B77D94E3A4C6FAE0F0310D36F881484C951) so won't take forever. It will be in DATA/e2.zip
-
-
17 hours ago, smeghammer said:Are the other JSON metadata files available please (wads.json, filenames.json, readmes.json, additional.json and idgames.json)? Or are they included in some of the other ZIP files?
They are all there, have a look at the archive listing (the 'Show All' link).
I have also upload a CSV that lists all the WAD SHA1 hashes and the filenames: https://archive.org/download/wadarchive/wads-list.csv
-
Yes it is dump from mongodb, have a look at README.MD. Yea lumps.json is a biggie which is why I uploaded it compressed.
-
I have attached a list of all the sites that are scraped. Some may not longer exist or provide WADs anymore
1 minute ago, smeghammer said:It would be very useful if said text file(s) could map the UUID filename to the wad/map name. If that is structured, I can render that programmatically with a bit of AJAX and javascript.
If you are wanting a list from ID to map name then just parse wads.json. Being JSON it is easy to handle with javascript.
-
25 minutes ago, Doomkid said:Just tossing this out there - it would be helpful to have a .txt file with a simple listing of every single wad/pk3/pk7 that was ever on Wad-Archive, even better if paired with a SHA-1 for each. This way, the many files not on /idgames can at least be “confirmed to exist” when someone searches for it. (Wad-Archive seems to have by far the best SEO of all wad sites and could easily bring up any file even with a Google search).
A simple list of every site Wad-Archive scraped would be fantastic too. I know it hit most of the big ones, but it also checked a whole bunch of somewhat more obscure ones too which aren’t as well known. Would be awesome and would save so many hours to have that info!
I can generate a list of WADs and upload it when I get home from work. The SEO part was probably due to what my job was at the time, glad it was working haha.
As for the list of sites that are scraped, I could list them here but not sure if I will include it in the internet archive.
7 hours ago, Doomkid said:Sucks to see you go, dude. Thanks for years of help.
does this mean WadHosting will be going too?
Most likely
-
I have decided to shut down Wad Archive as I don't have time to dedicate to it anymore and just not motivated. I don't have an exact date/time yet but it is currently no longer updated.
Since I would rather not have the archive go to waste I have uploaded all the WADs, images and database data to the internet archive https://archive.org/details/wadarchive . The entire unpacked archive is around 1TB and is stored in a way that made it easier/faster for the server to use rather than for someone manually browsing the files. I won't be releasing the code for the website itself or the indexing code and I am not interested in allowing someone else to host it, feel free to create your own with the data. All the database files fit in the free tier at https://www.mongodb.com/atlas/database except for lumps.json.
-
I have roughy 84,000 wads on my site and that is almost at 1TB so good luck hosting 80,000,000 (if you can even find that many)
-
вады
in Doom General
1 hour ago, ReaperAA said:I only wish I knew who the owners of wad-archive are. This would be a good feature to add to the site.
If only there was a contact link on the website https://www.wad-archive.com/contact . I used to have a 'Megawad' section (>=15 maps) but when redesigning everything I didn't add it in. I might do it some day in the future
-
On 12/1/2021 at 6:39 AM, Faceman2000 said:According to WadArchive that would need a Boom-compatible port, which the official port is not.
The IWAD and source ports listed a generally guesses from different sources but mainly from @MTrop's library https://mtrop.github.io/DoomStruct/index.html (however the one I am using is probably out of date). It should be seen more as 'it should work on this but might work on source ports'. There is no way I am going over 90,000 WADs manually
-
I got a fair few:
Atari 2600
Atari 7200
Atari Lynx
Atari Lynx 2
Game Boy
Game Boy Pocket
Game Boy Colour
Game Boy Advanced
Sega SC-3000 (not really a game console as such)
Game Gear
Master System
Master System 2
Mega Drive 2
Mega CD 2
Sega 32x
Sega Saturn
Dreamcast
NES
Sharp Twin Famicom
Famicom Disk System
Super Nintendo
Super Famicom
Nintendo 64
Gamecube (with Gameboy Player)
Wii
Wii U
Xbox
Xbox 360
Playstation
Playstation 2
Playstation 3
Tempest Pong (SD-050 clone, in the process of repairing it)
Some of the above I have multiple of (eg minor variations like the Master System 2 with Alex Kidd or Sonic built in). Most of them were bought in an 'as-is' state and repaired/fixed. I would like to get a few more, especially consoles that didn't make it to this part of the world but it is hard to justify the prices now.
As for a games collection, I have a few for most of the systems above but they can pretty much have an everdrive/softmod to play any game. The only real game collection that I have is the Doom engine games
-
I have been playing the new mission pack the last few nights and really enjoying it. Just need to learn to save more, too used to checkpoints these days
-
I really need to get around to trying this as I have a 32x, Mega CD and the Mega Drive has the CCAM installed. If only there were more hours in day....
-
3 hours ago, Diabolución said:Alas, it looks like something has obviously gone nuts again, borrowing that expression of yours.
The missing filenames? I know there are some that for whatever reason I don't have the filenames anymore (lost in a database migration maybe?). So it defaults to the WAD hash. I am out of town right now so will have to have a look next week
-
21 minutes ago, northivanastan said:Gonna check that out; good thing I was already planning on an update!
I once again apologize for being so enveloped in Linux I forgot that NTFS doesn't support colons (facepalm).
It's cool to see this project is being followed by archivists!
I am most of the way through re-writing the indexing logic and I have checks in place for this. Just need to get off my butt and complete it
-
1 hour ago, Diabolución said:Off-topic and on-topic, at the same time...
@WadArchive: could you re-parse below out, please? For some reason, both uldupmid-rc1.wad (a4ee0e1d9733cf9442d9c06cf78a4c98b338ad15) and ultimidi-rc1.wad (9d5bbe58d0184cf40b303ba94f5f25b87302c564) were not added to the database.
I have added them manually. They weren't automatically added because the file 'midis\VICTOR STILES - Ammo Count: 00.mid' has a ':' in it and this is invalid on Windows/NTFS. The code that does the indexing is rather old and doesn't handle this well
-
-
-
On 3/20/2021 at 3:19 PM, Wadmodder Shalton said:I wish to see someone make a batch file or a frontend launcher that takes screenshots of the starting player points of these PWAD maps.
That is what I use for my site, I didn't take over 320,000 screenshots manually. It is easy enough to do, the tricky part is making sure you are using the correct IWAD and engine (and download the WAD if you don't have it locally).
Running it over the WADs from the shovelware discs would make it easier as they are likely to work on any engine these days.
-
3 hours ago, Devalaous said:Likely completely empty.
EDIT: referring to the USB 'disc'. The actual disc would contain just the ports fully patched.
The description says the 8GB USB will be empty https://limitedrungames.com/collections/neo-frontpage/products/limited-run-395-doom-the-classics-collection-collectors-edition-ps4
-
5 hours ago, Diabolución said:Off-topic: @WadArchive: could / would you add to your database the European PSN variants of both tnt.wad and plutonia.wad? They actually happen to differ slightly from the American release.
It is on my list of things to do
-
The video above by Vic is on real hardware. I have been meaning to test it out on my 32x but haven't had the time
-
-
Closing Wad Archive
in Doom General
Posted
Try reading the readme https://archive.org/download/wadarchive/README.MD