Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
hidfan

[v 0 .95] Doom Neural Upscale 2X

Recommended Posts

Don't worry about alpha stuff, I think that would be the easiest thing to fix afterwards. Can't access googledrive here at the moment, but will try to check out some stuff once my VPN works.

Share this post


Link to post
19 hours ago, MrFlibble said:

I suspected that the images you posted are not simply a result of processing with NVIDIA's neural network and have been post-processed. Can you describe in detail what you did and with what tools?

 

 

I wrote the process in the first post :

-open the 8x files
-downsize 50% with bicubic interpolation to absorb some noise (especially from the PhotoHallucination files)
-then 50% with nearest neighbour for the pixel art effect

Maybe I added a "remove noise" filter in the 8X Photo enhanced version before downsizing, but I'm not sure (I should have written all that  :/)

pack them in a psd with this structure :
-Original Texture (upscaled 2X nearest neighbour) (with a mask, to let it override unwanted pixels in the upscaled results (too bright, too dark, new unwantedcolor (blue for instance)
-Nvidia Photo Hallucination 50%
-Nvidia Standard


For the alphas of sprites,
- upscale it in photoshop 4x or 8x with bicubic interpolation
- blur, contrast, blur, contrast, this will smooth the "stairs" and transform them into a curvy black and white pure mask. 
- downsize with nearest neighbour to the wanted resolution.
Then, I need to compare original mask and the new one, to add or remove pixels where needed.

 

Share this post


Link to post
On 10/19/2018 at 4:32 PM, hidfan said:

-Nvidia (8x) standard technique and "PhotoHallucination"" enhanced" (b suffix)

It appears that the PhotoHallucination scaling is the primary source of the extra pixel-ish detail in the textures (the "standard technique" actually looks pretty bland IMO). However it is my understanding that this kind of functionality is originally intended for adding extra imaginary detail to resized photographs (e.g. Let's Enhance boasts that neural network hallucinating will add missing details to a photo) and when applied to textures it produces something that looks like output of one of Photoshop's artistic filters — somewhere in between a pencil sketch and a crayon drawing (admittedly, it looks very cool). Have you actually considered alternatives to achieve a similar effect, perhaps without any neural network processing altogether?

Share this post


Link to post

really like the Nvidia upscales in the OP! Some of the wall textures look really impressive & realistic while still keeping that Doom-y feel to it. I'm hoping these upscales could be used in a future project!

Share this post


Link to post

If someone can create a wad that works with Gzdoom so we could see them in game, that'd be cool.

Share this post


Link to post

Wow, these looks fantastic. I've never liked Doom HD texture wads at all, but these are truly in another class.

Share this post


Link to post


Here is the less bugged PK3 I have achieved, it contains the zombie, the items, the face HUD, and all the textures/flats I did before, nothing new yet.
First feeling of the textures ingame, one year later : I don't like the noise, I already cleaned a lot of it, but there is still a lot of cleaning work needed.

However, if some textures on walls are working now, some still don't. ex : in Doom's E1M1 hangar, support2 is not scaled properly for instance, many many others are wrong.

I still need help to make the hires pak work :(

I've been told to change the names (I've found in slade, different namings in TEXTURE1), some patches are made from different textures (If I understand well this part), but I don't have textures corresponding to these to renamed patches.
For instance : BIGDOOR5 is made of WALL40_1 and WALL42_3. 
What is the Hires folder looking for? BIGDOOR5 ? WALL40_1 or both? some in textures, some in patches?

 

Share this post


Link to post
11 minutes ago, hidfan said:


Here is the less bugged PK3 I have achieved, it contains the zombie, the items, the face HUD, and all the textures/flats I did before, nothing new yet.
First feeling of the textures ingame, one year later : I don't like the noise, I already cleaned a lot of it, but there is still a lot of cleaning work needed.

However, if some textures on walls are working now, some still don't. ex : in Doom's E1M1 hangar, support2 is not scaled properly for instance, many many others are wrong.

I still need help to make the hires pak work :(

I've been told to change the names (I've found in slade, different namings in TEXTURE1), some patches are made from different textures (If I understand well this part), but I don't have textures corresponding to these to renamed patches.
For instance : BIGDOOR5 is made of WALL40_1 and WALL42_3. 
What is the Hires folder looking for? BIGDOOR5 ? WALL40_1 or both? some in textures, some in patches?

 

I might be wrong, but I don't think you can make hi-res textures out of patches.

Share this post


Link to post

I want to help with the pixel cleanup at least. Unfortunately I am also not really good at this .wad and TEXTURES stuff, because I am a newbie. :_( Do you need anything else? Can I buy you a beer? 

Share this post


Link to post

@hidfan Cut all files from Textures and Flats Directory in your pk3 and paste to Patches Directory.

For fast it works

Screenshot_Doom_20181022_203346.jpg.734ec11ee64315eb6295a6b559cf3968.jpg

Even transparent textures:

Screenshot_Doom_20181022_203526.jpg.f068ac7cca49049094de473f12f2b718.jpg

Edited by Teder

Share this post


Link to post

both methods  (patches or flats/textures) don't work actually (doom2 first map is always screwed)

 

3 hours ago, Empyre said:

I might be wrong, but I don't think you can make hi-res textures out of patches.


I tried to look into some doom HD textures paks to understand how they managed to make it work, but with no luck, a lot of things seemed to be embedded or hidden.

Share this post


Link to post

for doom1 E1M1, almost all textures work, excepted support2 .
for doom2 map01 it's almost 100% of textures
 

DoomUpscaleSupport2WrongScaling.jpg

Share this post


Link to post

@hidfanYou should use textures to rescale not patches. Thanks to that You got proper names. Hires paks contain textures, not patches. They got rescaled textures, not patches. Thanks to that they got properly named textures. In Slade You can do it like this, look:

 

Untitled-1.jpg.18a90eb74320c71c9f8e9e168aab8eee.jpg

Untitled-2.jpg.506cb06d64ef2fd5bbc060225e482384.jpg

I'll take a look for this support.

 

EDIT: for now I think is almost perfect. There are two support2.png files, both same name, but deleted one of them doesn't fix the problem.

 

EDIT2: Patches doesn't work properly. In entryway tekgren2 is not scaled.

 

EDIT3: no, many textures don't work proper. If You can batch rescale process, extract in Slade all textures as is shown on first picture above. 

 

 

Edited by Teder

Share this post


Link to post

Yes, this looks already quite amazing, imho. A little bit of pixel cleanup and BAM, there you go. One of the most awesome mods since SmoothDoom. Speaking of which, you'd use @Gifty 's SmoothDoom sprites, right? :p

Share this post


Link to post

@hidfan wow it looks fantastic! Details are better than I can imagine.

"If I understand Edit3 : HIRES folder is looking for the texture naming (ASHWALL2 instead of RW22_1)" - yes. Faster than rename patches to textures is build new batch from textures, because for example: support2 contains 6 patches, so it won't work if You just rename some patches.

Share this post


Link to post

Really wowed by what's possible with algorithmic assistance these days. This is the only upscaling project I've been impressed by as of late. 

Share this post


Link to post
4 hours ago, elend said:

Yes, this looks already quite amazing, imho. A little bit of pixel cleanup and BAM, there you go. One of the most awesome mods since SmoothDoom. Speaking of which, you'd use @Gifty 's SmoothDoom sprites, right? :p

Not Yet. As you can see, working with original files is already big/hard enough for my noob skills.
When I'll be more experimented, if I have enough energy and motivation left, and time,  I'll learn how smoothdoom works, and how to upscale it.
 

Share this post


Link to post

Smooth Doom has more animation frames than the original games. And it has alternative animations and such. It doesn't really matter how it works, if you take its resources and give them the Neuro-HD treatment then load them in a wad after Smooth Doom (in the load order) and see the changes.

Share this post


Link to post

Nice, thanks for the info VGA.
Yet, for maximum community compatibility I prefer
>SmoothDoom.wad
>>DoomUpscale.wad
>>>SmoothDoomUpscale.wad (only what has been added/changed in smoothdoom)
 

Share this post


Link to post

I know this project is still in its early stages and we're still sort of figuring out the basics, but I would be extraordinarily interested in collaborating on a Smoothed+Upscaled remaster of Doom. It would be a ton of work but I think it would potentially be an insanely cool project.

 

Even at this stage I'd love to pull some weight doing cleanup work on the upscales that you've already produced! 

Share this post


Link to post

Thanks Gifty, When I'll reach alpha stage, additional cleaning will be welcome.
I'm understanding more how the textures work now.
It's really sad  \Hires folder isn't working with patches, everything has to be remade. This system was probably created to lower pressure on texture production, and I can feel it.

I wanted to to a single wad upscale, for doom1 and doom2, but it seems I have to duplicate files. 
BRNPOIS is 64x128 in Doom1 and 128x128 in Doom2
Also sky names 1 2 3 are overlaping.
oh..I just discovered "TEXTURE2" in doom.wad ... and additional missing textures such as BROWNWEL  COMPHSO DOORHI GRAYDANG.
This is a bit messy and so depressing -_-
 

Share this post


Link to post

In Slade, you can save the textures made from patches as single images, which could then be upscaled by your methods.

Share this post


Link to post

Yes Empyre, I didn't know that the day I extracted the files, and I extracted patches instead of textures for doom2  (doom1 was ok but, I missed the texture2 part)
Nvidia's Tool process only 2 files at a time, and the max resolution it produces is 8192x8192, so I need to pack things into 1024x1024 atlases.
the 8k results can weight 80Mo, it's long to download and their naming is some kind of ugly 324GER745G3S3456473gsgrt.png 
It's not made for industrial production so I won't rebatch (and I already did too much pixel edits on the existing ones). 
I'll just sort and reorganize my mess and batch only what's needed.

 

Share this post


Link to post

@hidfan oh, that bad they can't be batched :( Best way for now is to build textures from Your upscaled patches, and rename them.

Share this post


Link to post

In the meantime, I was tinkering further with waifu2x and discovered an interesting thing.

 

There are two modes it can process images for scaling, RGB mode and Y channel mode. I would stick with RGB as this is the default thing and only accidentally used Y channel scaling once and didn't like it. However when I started trying out different combinations of settings for scaling the sprites, I found that using the Y channel can sometimes produce quite a difference.

 

Here's a set of Doom sprites I used above, processed with RGB scaling at 4x the original size, TTA set to 4 (edged softened with the xBRZ method):

xAOiJKe.png

And here's the same image processed with Y channel scaling:

IUnXw1i.png

Quite a difference eh? The only thing is that so far I haven't figured out a good way to extract the sprites from the background because Y channel mode does a huge deal of blurring around the edges unlike the RGB mode. It's also highly dependent on background colour because if black or white background is used the edges will be less pronounced:

Iso1gWS.png

Another thing to note is that waifu2x and waifu2x-caffe apparently use the same or very similar models for RGB scaling and different models for Y channel scaling, producing noticeably different results. The above images were created with waifu2x, so far they seem better.

Share this post


Link to post

@hidfan

 

This is just...unbelievable. The first image is the best IMO.

 

Is Smooth Doom compatibility still in the works?

Share this post


Link to post

@hidfan

 

Hmm, I actually think a tiny BIT of blurriness helps. I like it because it smooths it a bit but retains that pixelly look.

 

The fat layers on the lower Mancubus pictures look a bit too sharp imo, like sculpted details that haven't been finished yet.

 

Edited by DooM_RO

Share this post


Link to post
12 hours ago, DooM_RO said:

The fat layers on the lower Mancubus pictures look a bit too sharp imo, like sculpted details that haven't been finished yet.

I agree. They look like they painted on, rather than actual shadows.

Share this post


Link to post

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×