Doomworld Forums - 2011 wads - excel file to webpage help

Doomworld Forums : Powered by vBulletin version 2.2.5

Doomworld Forums > Classic Doom > WADs & Mods > 2011 wads - excel file to webpage help

Author

All times are GMT. The time now is 03:36.

TimeOfDeath
Forum Regular

Posts: 1488
Registered: 06-06

excel file: 2011stats.xlsx

I made an excel file from fullsort that has all released/updated wads from /idgames during 2011 (Dec10 2010 - Dec8 2011). There are 388 entries.

http://timeofdeath.wrvids.com/doom/2011stats.jpg

- Does someone want to make or know how to make a webpage out of the excel file?

- On the webpage, how do you make the column titles clickable, so that when you click them it sorts all the data by that column, ascending and descending?

- How do you make links from the data in the ID NUMBER column, so that you just press the number and it sends you to the /idgames page?

12-14-11 20:07 #

Profile || Blog || PM || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

Maes
I like big butts!

Posts: 8664
Registered: 07-06

Perhaps your best chance is to export the data into a Word document (as a table) and use the doc-to-html functionality therein. Although I think that there is an export-as-html option buried somewhere in Excel, too.

12-14-11 20:30 #

Profile || Blog || PM || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

ellmo
Custom Title

Posts: 1505
Registered: 04-03

For anyone who knows their way around Rails, Sinatra, PHP or Django, the best data format would undoubtedly be a CSV (comma separated values) file, which is a simple text file you can extract to from any half-decent spreadsheet program.

12-14-11 21:35 #

Profile || Blog || PM || Email || Search || Add Buddy

IP || Edit/Delete || Quote

Phml
Forum Staple

Posts: 2036
Registered: 06-09

Neat. Thanks for making this. Now to see if I missed anything worth checking this year...

12-14-11 21:45 #

Profile || Blog || PM || Search || Add Buddy

IP || Edit/Delete || Quote

Phobus
Senior Member

Posts: 1482
Registered: 10-06

I saw one .zip in there near the bottom claiming to be from August 2010, so that probably shouldn't be there. Also the ordering is a bit odd, as it goes from Jan-Dec 2011 and then jumps to Dec 31st 2010 and works backwards to the 8th or thereabouts.

12-15-11 08:24 #

Profile || Blog || PM || Email || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

TimeOfDeath
Forum Regular

Posts: 1488
Registered: 06-06

Fullsort lists wads that were released or updated. So that one wad from Aug2010 was updated in 2011 (I added it to the list anyway because there's no entry for it during it's original upload date, fullsort only lists the most recent update date). Maybe there could be an "update date" column too.

I started at Jan 1st and was going to do just 2011, but I didn't want to wait for the end of the year, so I did the "cacoward method" instead.

You can sort any column in excel with Data -> Sort.

12-15-11 18:01 #

Profile || Blog || PM || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

Bloodshedder
Spellchecker

Posts: 4571
Registered: 03-02

You could put it on Google Docs and share it.

12-15-11 18:38 #

Profile || Blog || PM || Email || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

Kappes Buur
Member

Posts: 497
Registered: 11-02

TimeOfDeath said:
- Does someone want to make or know how to make a webpage out of the excel file?

Load the spreadsheet into OpenOffice 3.3 (freeware) and save as an HTML file.

http://i.imgur.com/sZSnW.png

result : http://www.mediafire.com/?a8og6b6mh5uxtah

I don't have a current Microsoft Office, so I don't know from which version on this feature is available.

TimeOfDeath said:
- On the webpage, how do you make the column titles clickable, so that when you click them it sorts all the data by that column, ascending and descending?

I imagine that it could be done with some scripting, but I'm not up to that.

TimeOfDeath said:
- How do you make links from the data in the ID NUMBER column, so that you just press the number and it sends you to the /idgames page?

That can be done easily, but it's tedious and time consuming. Each link must be inserted manually.

12-16-11 14:06 #

Profile || Blog || Email || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

fraggle
Super Moderator

Posts: 6000
Registered: 07-00

I'm slightly confused as to the point of doing this. Am I to understand that you've gone to the effort of creating and maintaining this file by hand? The majority, if not all of this data, is already available through the idgames web interface and is extracted automatically from the files, so it should theoretically be trivial to export it to CSV format. Compare the spreadsheet with the /newstuff interface for example.

On a side note, does anyone else find it annoying that such thing as a "idgames ID number" even exists? The Doom wiki for example has a template that makes use of it. I really wish the idgames web interface could be switched to use the actual filenames of the files rather than just arbitrary numbers. It should be "http://www.doomworld.com/idgames/?path=utils/sound_edit/bsdmidi.zip" rather than "http://www.doomworld.com/idgames/?id=15233"

12-16-11 14:41 #

Profile || Blog || PM || Email || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

kb1
Junior Member

Posts: 167
Registered: 11-06

What is this "fullsort"?

12-16-11 16:21 #

Profile || Blog || PM || Search || Add Buddy

IP || Edit/Delete || Quote

Jonathan
I am not a leet hax0r :(

Posts: 668
Registered: 05-00

I've been playing around with some javascript stuff recently, and I had a couple of hours free yesterday, so here you go:

http://www.brillskills.com/doomdata/

Probably won't work right or perform well in older browsers. Use a recent version of Chrome or Firefox and you'll be fine.

12-17-11 12:00 #

Profile || Blog || PM || Email || Search || Add Buddy

IP || Edit/Delete || Quote

hex11
Senior Member

Posts: 1485
Registered: 09-09

http://chicago.sourceforge.net/xlhtml/

Edit: yeah, I don't like the "id" thing either, as it's not canonical (it doesn't exist on the FTP servers). A few months ago someone wanted to write a Doom shell that pulled ratings from the page, but he couldn't find an easy way to map the path to its id (which only exists in the doomworld database).

Last edited by hex11 on 12-17-11 at 13:15

12-17-11 13:00 #

Profile || Blog || PM || Search || Add Buddy

IP || Edit/Delete || Quote

GreyGhost
a ghost... only grey

Posts: 5703
Registered: 01-08

kb1 said:
What is this "fullsort"?

Fullsort is a chronologically sorted list of the archive's contents in a gzip archive, which (AFAIK) is updated daily.

12-17-11 13:38 #

Profile || Blog || PM || Email || Search || Add Buddy

IP || Edit/Delete || Quote

hex11
Senior Member

Posts: 1485
Registered: 09-09

LOL @ bottom of fullsort.gz:

1993/02/03 260606 historic/doom0_2.zip
1993/02/03 540 historic/doom0_2.txt
1991/12/03 5022 utils/graphics_edit/cmappov2.txt
1991/01/16 2097 levels/doom2/deathmatch/a-c/bull2.txt
1980/01/08 2018 levels/hexen/deathmatch/m-o/nexeh.txt
1980/01/03 3207 levels/doom2/deathmatch/v-z/wargames.txt

12-17-11 14:54 #

Profile || Blog || PM || Search || Add Buddy

IP || Edit/Delete || Quote

Phobus
Senior Member

Posts: 1482
Registered: 10-06

Doom - so good people were mapping for it 13 years before came out!

12-17-11 19:05 #

Profile || Blog || PM || Email || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

TimeOfDeath
Forum Regular

Posts: 1488
Registered: 06-06

Jonathan said:
http://www.brillskills.com/doomdata/

That's perfect, thanks a lot! Is it possible to add a "input date" and "input order" column as well? ("input date" would be useful for the rating/vote columns, "input order" would be useful for total number of entries)

fraggle said:
I'm slightly confused as to the point of doing this. Am I to understand that you've gone to the effort of creating and maintaining this file by hand? The majority, if not all of this data, is already available through the idgames web interface and is extracted automatically from the files, so it should theoretically be trivial to export it to CSV format.

Yes, I did it by hand. It would be much better if most of the data could be extracted automatically. Do you know how to do that?

I just thought it would be cool to have all of this year's wads on one page where it's easy to sort through multiple categories. Consider it the 2011 Participation Awards. :)

Bloodshedder - could this be hosted on doomworld when it's done?

12-18-11 18:05 #

Profile || Blog || PM || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

Grain of Salt
Member

Posts: 629
Registered: 12-10

Just idgames? :(

12-19-11 00:17 #

Profile || Blog || PM || Search || Add Buddy

IP || Edit/Delete || Quote

TimeOfDeath
Forum Regular

Posts: 1488
Registered: 06-06

What other archives did you have in mind? Pros about idgames are that it's big, easy to navigate, and I don't have to download any wad files to view data. Otherwise, it would take much longer to input by hand.

12-20-11 16:36 #

Profile || Blog || PM || Homepage || Search || Add Buddy

IP || Edit/Delete || Quote

Grain of Salt
Member

Posts: 629
Registered: 12-10

You're right. Objectively, idgames is the best choice. I was just sad because I don't have anything on there. Maybe I should actually upload something to idgames next year.

12-21-11 17:52 #

Profile || Blog || PM || Search || Add Buddy

IP || Edit/Delete || Quote

All times are GMT. The time now is 03:36.

Doomworld Forums > Classic Doom > WADs & Mods > 2011 wads - excel file to webpage help

Show Printable Version |

Email this Page |

Subscribe to this Thread

Forum Rules:

You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

HTML code is OFF
vB code is ON
Smilies are OFF
[IMG] code is ON

< Contact Us - Doomworld >