Deepdreaming Doom

Google recently released the source code for Deepdream, its algorithms for recognizing objects in images after it has been "trained" to spot them. In addition to its obvious uses, it can produce surreal results when fed images and asked to "find" things in them. What would Doom look like after all its graphics files were processed through Deepdream? Does anyone with Python experience feel like giving this a try?

Example of Deepdream before/after:

We have one of these threads in Everything Else.

Guess there's no reason for me not to share these now.




And bonus Quake screenshot of Shub-Niggurath:

It'd be a good source of surreal hell textures if you could make it look for eyes, skulls, and fangs, instead of eyes, dogs, and pagodas.

Fuckin Lol'd

Imagine a source port doing this. Say goodbye to your sanity.

"GOTTA GET A GRIP!"

I feel like the only response to some of these is an entire page of capital letter A's.

Also, dogs. Dogs everywhere.

Not as trippy, but still rather weird.

VGA said:

Imagine a source port doing this. Say goodbye to your sanity.

Individual frames take a long time to render (minutes). You can't really do this in real time. Though I have seen some cool non-realtime animations from people who automated the process.

LittleInferno said:

Not as trippy, but still rather weird.
[img]

I kinda want to use that for something.

Why does it always find at least one dog in each picture?

fabian said:

Why does it always find at least one dog in each picture?

AFAIK, dogs are overrepresented in image corpus used to train the neural network. Since the process boils down to repeatedly asking the NN to find features it recognises, then emphasise them, it tends to see more dogs, because that's what it's better at recognising. It's analogous to how humans see faces in everything— clouds, stains, burn marks, architecture, martian landscapes, etc.

Somehow cats aren't represented? Does neural network mean "database of pictures that have one similar characteristic?" Like a sentence that keeps popping up in written documents.

Yes, they've told different neural networks to recognize different patterns. One that's funny is the dumbbell network, which after looking at thousands of pictures of dumbbells, came to the conclusion that dumbbells often have arms growing out of them.

fraggle said:

Individual frames take a long time to render (minutes). You can't really do this in real time. Though I have seen some cool non-realtime animations from people who automated the process.

Today's "long time" is Tomorrow's instant :) If you had a second thread doing the processing without blocking the game, and an adaptive update algorithm (rip off MPEG or something), you could splice the post-processed stuff into the frame and just re-start when the view changes, or do it in chunks. You could even farm the second thread out.

geo said:

Does neural network mean "database of pictures that have one similar characteristic?" Like a sentence that keeps popping up in written documents.

Not exactly: https://en.wikipedia.org/wiki/Artificial_neural_network

fraggle said:

Individual frames take a long time to render (minutes). You can't really do this in real time. Though I have seen some cool non-realtime animations from people who automated the process.

It would be possible to batch-process all of Doom's graphics for a mod, though. There would probably be a lot of tiling errors but it would be fascinating nonetheless.

I'm just dropping in to say that this one is one of those things I didn't even realize I wanted to see, so of course someone did it, and I'm quite thankful.

I thoroughly believe deep dream is a great way to show anyone who has never tripped what your vision looks like at times...

In fact, here is a great video example..

http://devour.com/video/pizza-of-nightmares/


AND If you want to ruin your eyes... go check out the deep dream processed images of porn... my eyes just started to burn...

geo said:

Somehow cats aren't represented?

Uhmm...

Dog+Cat=No

Is anyone going to make a texture pack with all deepdreamed doom textures? :P

LittleInferno said:

Not as trippy, but still rather weird.

http://i.imgur.com/IYvJWdA.jpg

I FUCKING WANT THAT AS A POSTER

Im sorry but that demanded all caps

EDIT: Is there an "instant" deepdream thing anywhere?

How did you guys get yours so fast? I uploaded mine yesterday and the computer won't wake its lazy ass off.

I guess "a week" really must mean a week for me.

That would be Doge Doom.

The demons have brought their reality with them--it's Hell on Earth!!!

Is it possible to make it not see dogs? It's too boring when it's dogs all the time.

Mithran Denizen said:

http://d11cbnttr0b724.cloudfront.net/img_dreamed/80728.jpg

The demons have brought their reality with them--it's Hell on Earth!!!

The Cyberdemon's crotch... is a dog mouth O_o

A screenshot for a map I made for Freedoom, deepdreamed:


http://i.imgur.com/Y2d7OA4m.jpg?1 http://i.imgur.com/1tFal3Wm.jpg?1