Spider Mastermind
Register | User Profile | Member List | F.A.Q | Privacy Policy | New Blog | Search Forums | Forums Home
Doomworld Forums : Powered by vBulletin version 2.2.5 Doomworld Forums > Classic Doom > WADs & Mods > Archive upload process changes
Pages (2): [1] 2 »  
Author
All times are GMT. The time now is 22:57. Post New Thread    Post A Reply
Ty Halderman
Essential Pillar of the Community


Posts: 294
Registered: 02-03


Hi all,

Just a note to inform you of changes in the way I am going to be handling uploads in the future (and recent past--effective 1 Sep 2013). I've modified the README.INCOMING etc. files on the archive but probably no one will notice that so this may make it easier for all of us.

If you upload a file to the archives, you will be asked to reply to an email. That email might end up in your SPAM folder (especially on overzealous GMail) so if you do upload something keep an eye out. It will usually get there within a day or so of the time you upload, and as part of that process your file will be moved out of Incoming temporarily.

Why all this, you ask? Or you didn't ask but I'll tell you anyway. It's slightly depressing but that's the way it goes.

I think quoting the email is probably the simplest way to tell you the rest:


Due to the large number of uploaded DOOM levels that are either junk from an invalid email account, or uploaded with someone else's name on it, I have had to resort to checking the validity of every upload via email.

If you uploaded one or more files in the last week, then you need to reply to this email with the name of the file or files. That will be enough to allow it in. If I either get a reply that you aren't the uploader, or no reply in 7 days, the file(s) will be rejected. They have meanwhile been moved to a folder underneath the incoming folder which you (and others) cannot see.

If you indeed uploaded several files at once, please identify them all in your response. I will only send one of these requests per uploader email address regardless of the number of files involved.

=-Ty Halderman, 3dgamers.com idgames administrator


The email will come from me at thldrmn@abydos.com.

=-Ty

Old Post 09-14-13 15:15 #
Ty Halderman is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Chris Hansen
(used to be c-cooper)


Posts: 645
Registered: 05-02


Great news! This is definitely a step in a the right direction! Thanks for your dedication and long time work with the archieves!

Old Post 09-14-13 15:34 #
Chris Hansen is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Memfis
Forum Spammer


Posts: 5711
Registered: 04-07


Yeah, I'm glad to see that Ty is finally doing something about all that junk. Thanks for that and for maintaining the archive in general! :)

Old Post 09-14-13 16:38 #
Memfis is online now Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
40oz
Forum Spammer


Posts: 6897
Registered: 08-07


Oh wow. That's a good bit of extra work tacked on to (what appears to be) the arduous task of maintaining the archive already. Right?

Not to imply that I think it's a bad idea or that there is a better solution, I just wouldn't want you to get overwhelmed. I value that archive a lot, you know! :)

Old Post 09-14-13 16:53 #
40oz is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Xaser
Forum Staple


Posts: 2636
Registered: 07-03


Is this all done manually on Ty's part? I can't imagine how frustrating that might be for him. :(

Anyhow, this is probably better than the alternative, but it does throw a monkey wrench into the already-difficult process of uploading to /idgames. I wonder if any folks would be willing to consider the idea of developing some sort of upload frontend for DW /idgames that's tied to forum accounts (similar to how t/nc does it) which folks can use as an alternative.

Old Post 09-14-13 17:20 #
Xaser is offline Profile || Blog || PM || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Ty Halderman
Essential Pillar of the Community


Posts: 294
Registered: 02-03


To be honest, I'd rather do this than have to deal with people overwriting others' files (the worst part) and I was still having to evaluate suspicious email addresses by sending a test message. This way even if the email is correct, but that's not who uploaded it, the original author's aware of what's going on and has to in effect approve of the upload.

It's semiautomated now; I have several scripts I run to shuffle files and such. I'll probably add more automation to it as time goes on but it still sometimes takes a human eye to look at things. Let's face it, I shouldn't reject "fred [at] gmail [dot] com" just because Fred wants to avoid bot harvesting of his address. And though I could code for that, I don't really get that many uploads.

There are some folks who upload frequently enough that I "know" them and won't go through all this every time (think rslxxxxx.zips in combos) but it helps keep me more actively involved too. I would sometimes end up with 7-10 days between logging on but now I tend to get on daily-ish so throughput is better for everyone.

And if anyone chooses to pre-empt all this by emailing me ahead of the upload that they're going to do so, that simplifies it more. Worst thing is that this doesn't keep the crap away; I'll just know that the uploader didn't lie about their email. But I've never used quality as a criterion for allowing something into the archive, as discussed elsewhere and as is obvious when you look through the files...

Old Post 09-14-13 17:46 #
Ty Halderman is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Obsidian
Forum Staple


Posts: 2636
Registered: 05-12


Just a quick question, would you be able to recruit someone to help you manage the archives? I dunno who you could ask, but I'm pretty sure maintaining an archive of this magnitude shouldn't be done by only just one person.

Old Post 09-14-13 23:11 #
Obsidian is online now Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
Ty Halderman
Essential Pillar of the Community


Posts: 294
Registered: 02-03



Obsidian said:
Just a quick question, would you be able to recruit someone to help you manage the archives? I dunno who you could ask, but I'm pretty sure maintaining an archive of this magnitude shouldn't be done by only just one person.


This one person's been doing it since 1998 and that was when there was an active Quake community too, so I think I'll be okay. Thanks for the thought though.

Old Post 09-15-13 00:21 #
Ty Halderman is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
gggmork
If you can make any sense of this post, congratulations


Posts: 2797
Registered: 06-07


How about people just attach wad files to their email. Avoiding hassling with "ftp", whatever that is, is the main reason I don't upload stuff since I've never used it before.

Old Post 09-15-13 02:01 #
gggmork is offline Profile || Blog || PM || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
GreyGhost
Why don't I have a custom title by now?!


Posts: 8760
Registered: 01-08


Good move, even if it's more labour intensive. I can live with the random crap but can't stand imposters.

Old Post 09-15-13 03:39 #
GreyGhost is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
Zed
Forum Regular


Posts: 934
Registered: 10-11


Mr. Ty Halderman, Doomworld Salutes You.

Old Post 09-15-13 17:22 #
Zed is offline Profile || Blog || PM || Search || Add Buddy IP || Edit/Delete || Quote
fraggle
Filled with the code of Doom


Posts: 7733
Registered: 07-00



Ty Halderman said:
This one person's been doing it since 1998
Ty, we so rarely hear much from you, thanks for all your work in continuing to maintain idgames all these years!

Old Post 10-06-13 22:56 #
fraggle is online now Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
TimeOfDeath
Forum Regular


Posts: 2734
Registered: 06-06


Yeah, /idgames is the coolest. I use it a lot!

Old Post 10-07-13 00:45 #
TimeOfDeath is offline Profile || Blog || PM || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
dobu gabu maru
Senior Member


Posts: 1144
Registered: 02-12


Thanks a buch Mr. Halderman, your continuous commitment is appreciated (`・ω・)ゞ

Old Post 10-07-13 01:13 #
dobu gabu maru is offline Profile || Blog || PM || Search || Add Buddy IP || Edit/Delete || Quote
pcorf
Senior Member


Posts: 1387
Registered: 06-05


This is great news for sure. Hopefully it will stop a lot more junk and spam wads from been uploaded.

I got that email yesterday after my Zone 300 upload and I replied to Ty. The good thing is he can add the final, fixed version to the archives. I uploaded the original release on Sep 23 but then uploaded the final version the other day.

Old Post 10-07-13 03:46 #
pcorf is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
GreyGhost
Why don't I have a custom title by now?!


Posts: 8760
Registered: 01-08



pcorf said:
Hopefully it will stop a lot more junk and spam wads from been uploaded.
Only if the uploader uses an invalid email address or attempts to pass the wad off as someone else's work.

Old Post 10-07-13 11:31 #
GreyGhost is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
pcorf
Senior Member


Posts: 1387
Registered: 06-05



GreyGhost said:
Only if the uploader uses an invalid email address or attempts to pass the wad off as someone else's work.


So yeah this is not the end of Carnevil and awful noises. But I get it, if somebody uploaded spam under my name then I would let Ty know.

Old Post 10-07-13 14:06 #
pcorf is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
j4rio
Forum Staple


Posts: 2638
Registered: 07-10


Great job on doing a ... well... a whole lot of nothing to prevent main idgames problems.

Old Post 10-07-13 23:40 #
j4rio is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
Dragonsbrethren
Senior Member


Posts: 2472
Registered: 03-09



j4rio said:
Great job on doing a ... well... a whole lot of nothing to prevent main idgames problems.

Yeah, because preventing wads from being overwritten and stopping impersonators isn't important.

Old Post 10-07-13 23:51 #
Dragonsbrethren is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
esselfortium
A Major Doomworld Concern


Posts: 6614
Registered: 01-02


There are definitely some other annoying abuses of the system still to solve, but this is a step in the right direction.

Old Post 10-07-13 23:55 #
esselfortium is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Jimmy
doesn't rhyme with MIDI :(


Posts: 1575
Registered: 04-06


Hey Ty, any idea what's up with the Plutonia MIDI Pack? I uploaded it and responded to your e-mail, but I don't see it with the new additions to the archive. Was it rejected?

__________________
Jimmy's YouTube Channel - All my recent stuff!
Jimmy's MIDI Powerhouse - More than 150 original MIDIs!
Jimmy's TwitchTV Stream! - Tune in for Doom and music!
Jimmy's Blog of Death - I make terrible posts here.

Old Post 10-08-13 15:47 #
Jimmy is offline Profile || Blog || PM || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
TimeOfDeath
Forum Regular


Posts: 2734
Registered: 06-06


Jimmy, it looks like it's on ftp://ftp.fu-berlin.de/pc/games/idgames/newstuff/, but just hasn't made it on the front page yet.

Old Post 10-08-13 16:02 #
TimeOfDeath is offline Profile || Blog || PM || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
j4rio
Forum Staple


Posts: 2638
Registered: 07-10



Dragonsbrethren said:

Yeah, because preventing wads from being overwritten and stopping impersonators isn't important.



It doesn't really make it much less of an anarchistic atrocity.

Old Post 10-08-13 16:47 #
j4rio is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
Pirx
Forum Regular


Posts: 780
Registered: 11-04


thanks a lot ty for your dedication in maintaining idgames which is a central hub for the doom community.

now for idiots overwriting other people's files... is that some kind of new shit now as every dumb kid has internet access? because i don't remember reading this earlier.

Old Post 10-08-13 21:43 #
Pirx is offline Profile || Blog || PM || Search || Add Buddy IP || Edit/Delete || Quote
Dragonsbrethren
Senior Member


Posts: 2472
Registered: 03-09



j4rio said:


It doesn't really make it much less of an anarchistic atrocity.


Are you talking about idiotic wads or idiotic comments on the frontend? The latter is entirely Doomworld's domain. What do you propose for the former? Any sort of quality control implementation is just asking for drama, anyone should be able to see that.

Ty, echoing everyone else's positive sentiments. Most of us appreciate the work you do maintaining the archive. I don't even want to think of how splintered the Doom community would be without it, how many wads would be lost.

Old Post 10-09-13 00:03 #
Dragonsbrethren is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Springy
Senior Member


Posts: 1357
Registered: 09-12


Just popping by too say thank you for doing a grand job over the years and answering queries I have had for the past month Ty!

Old Post 10-09-13 00:36 #
Springy is offline Profile || Blog || PM || Email || Search || Add Buddy IP || Edit/Delete || Quote
Ty Halderman
Essential Pillar of the Community


Posts: 294
Registered: 02-03


Hi all,

Matthewdoomer ran a successful test to whitelist my verification emails in Gmail, and as Gmail is the "worst offender" at thinking I'm an evil emailer, I wanted to share the steps with the rest of you in case it helps.

  1. Log onto your account in Gmail
  2. At the top you have a search bar. Click the (nearly invisible) down arrow by the blue magnifying glass.
  3. Be sure the Search box says All Mail or Spam (click to select a folder)
  4. In the From field, type @abydos.com or thldrmn@abydos.com
  5. Down in the lower right, click the link Create filter with this search >>
  6. Check the box [x] Never send it to Spam
    (can also apply a label, mark important, etc. if you want)
  7. Optionally click the "Also apply filter..." checkbox if available to apply to existing messages
  8. Click the blue Create filter button

Hope this helps a few folks.

BTW several recent uploaders have taken to emailing me right when they upload; that helps expedite the process considerably so thanks to those. And I'm not sure if I mentioned it anywhere but when I do get a verification and move files into the archive, I touch them to make their timestamp current to allow the most time in Newstuff even if it's been several days since the upload.

Old Post 11-02-13 14:00 #
Ty Halderman is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
Dragonsbrethren
Senior Member


Posts: 2472
Registered: 03-09


I actually had to follow those Gmail steps for my own Gmail account a year or two back because our forum's mailer over at Slick Productions sends things using my email address, and anything forum-related started ending up in my spam. I usually appreciate Gmail's spam filter, but it can definitely be overzealous when it comes to automated messages. Doubly so when those messages are coming from my account.

Anyway, set up the filter but I'll continue mailing you when I upload something. Thanks for the timestamp stuff (you touch our wads?!) too!

Old Post 11-02-13 21:42 #
Dragonsbrethren is offline Profile || Blog || PM || Email || Homepage || Search || Add Buddy IP || Edit/Delete || Quote
sector666
Junior Member


Posts: 148
Registered: 03-08



Ty Halderman said:
And if anyone chooses to pre-empt all this by emailing me ahead of the upload that they're going to do so, that simplifies it more.
It might be a bit late now but I'd put that in the email you send so more people know it.

There is one thing that's always confused me about the archive ever since I found it was allowed. As far as I'm aware maps that clear cut don't even have an exit are accepted (I'm not talking about boss death exits of course). I know quality control isn't a part of the archive, but I don't know what the point is of allowing something which doesn't have an exit.

Could someone enlighten me?

Edit: And I'd like to say thank you to Ty for all the countless time that's been spent and will continue to be spent on the archive. Dedication like yours is a rare thing indeed.

Last edited by sector666 on 11-03-13 at 16:33

Old Post 11-03-13 16:27 #
sector666 is offline Profile || Blog || PM || Search || Add Buddy IP || Edit/Delete || Quote
plums
Senior Member


Posts: 2011
Registered: 08-13


Not doing any quality control is not just a matter of principle. Checking to make sure levels have an exit would be a huge time commitment increase. Even with automated tools that could check for exit linedefs, there are all sorts of false-positive situations that could happen and so the rejects would need some kind of manual checking.

And to what end? The point of the archives is not to curate, but, well, to act as an archive.

Old Post 11-03-13 17:43 #
plums is offline Profile || Blog || PM || Search || Add Buddy IP || Edit/Delete || Quote
All times are GMT. The time now is 22:57. Post New Thread    Post A Reply
Pages (2): [1] 2 »  
Doomworld Forums : Powered by vBulletin version 2.2.5 Doomworld Forums > Classic Doom > WADs & Mods > Archive upload process changes

Show Printable Version | Email this Page | Subscribe to this Thread

 

Forum Rules:
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is OFF
vB code is ON
Smilies are OFF
[IMG] code is ON
 

< Contact Us - Doomworld >

Powered by: vBulletin Version 2.2.5
Copyright ©2000, 2001, Jelsoft Enterprises Limited.