Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
jute

Deepdreaming Doom

Recommended Posts

Google recently released the source code for Deepdream, its algorithms for recognizing objects in images after it has been "trained" to spot them. In addition to its obvious uses, it can produce surreal results when fed images and asked to "find" things in them. What would Doom look like after all its graphics files were processed through Deepdream? Does anyone with Python experience feel like giving this a try?

Example of Deepdream before/after:

Share this post


Link to post

We have one of these threads in Everything Else.

Share this post


Link to post

Guess there's no reason for me not to share these now.




And bonus Quake screenshot of Shub-Niggurath:

Share this post


Link to post

It'd be a good source of surreal hell textures if you could make it look for eyes, skulls, and fangs, instead of eyes, dogs, and pagodas.

Share this post


Link to post

Imagine a source port doing this. Say goodbye to your sanity.

Share this post


Link to post

I feel like the only response to some of these is an entire page of capital letter A's.

Also, dogs. Dogs everywhere.

Share this post


Link to post
VGA said:

Imagine a source port doing this. Say goodbye to your sanity.

Individual frames take a long time to render (minutes). You can't really do this in real time. Though I have seen some cool non-realtime animations from people who automated the process.

Share this post


Link to post
LittleInferno said:

Not as trippy, but still rather weird.
[img]


I kinda want to use that for something.

Share this post


Link to post
fabian said:

Why does it always find at least one dog in each picture?


AFAIK, dogs are overrepresented in image corpus used to train the neural network. Since the process boils down to repeatedly asking the NN to find features it recognises, then emphasise them, it tends to see more dogs, because that's what it's better at recognising. It's analogous to how humans see faces in everything— clouds, stains, burn marks, architecture, martian landscapes, etc.

Share this post


Link to post

Somehow cats aren't represented? Does neural network mean "database of pictures that have one similar characteristic?" Like a sentence that keeps popping up in written documents.

Share this post


Link to post

Yes, they've told different neural networks to recognize different patterns. One that's funny is the dumbbell network, which after looking at thousands of pictures of dumbbells, came to the conclusion that dumbbells often have arms growing out of them.

Share this post


Link to post
fraggle said:

Individual frames take a long time to render (minutes). You can't really do this in real time. Though I have seen some cool non-realtime animations from people who automated the process.


Today's "long time" is Tomorrow's instant :) If you had a second thread doing the processing without blocking the game, and an adaptive update algorithm (rip off MPEG or something), you could splice the post-processed stuff into the frame and just re-start when the view changes, or do it in chunks. You could even farm the second thread out.

Share this post


Link to post
fraggle said:

Individual frames take a long time to render (minutes). You can't really do this in real time. Though I have seen some cool non-realtime animations from people who automated the process.


It would be possible to batch-process all of Doom's graphics for a mod, though. There would probably be a lot of tiling errors but it would be fascinating nonetheless.

Share this post


Link to post

I'm just dropping in to say that this one is one of those things I didn't even realize I wanted to see, so of course someone did it, and I'm quite thankful.

Share this post


Link to post

I thoroughly believe deep dream is a great way to show anyone who has never tripped what your vision looks like at times...

In fact, here is a great video example..

http://devour.com/video/pizza-of-nightmares/


AND If you want to ruin your eyes... go check out the deep dream processed images of porn... my eyes just started to burn...

Share this post


Link to post

How did you guys get yours so fast? I uploaded mine yesterday and the computer won't wake its lazy ass off.

I guess "a week" really must mean a week for me.

Share this post


Link to post

Is it possible to make it not see dogs? It's too boring when it's dogs all the time.

Share this post


Link to post

Please sign in to comment

You will be able to leave a comment after signing in



Sign In Now
×