An amazing concept! I was fooling around with ChatGPT myself, asking it to describe E1M1 of Doom and kept getting descriptions that didn't come close to what E1M1 looked like. Correcting ChatGPT, it apologizing to me and proceeding to give me a different description of E1M1 that didn't match up as well. It made me think that it could be a cool idea to have ChatGPT describe a map and someone remaking it.
Someone pointed me to this topic. I still have to read through it and enjoy the screenshots, but looks like you're doing the AI Gods' work, people!