Old f4g posts for UO guilds on europa - Page 3

**Adam** · 12th July 2009, 05:15 PM

Quote:

Originally Posted by Tabbitha

Will you still make a UO Europa forum here also as suggested earlier ?
[ just in case it goes *poof* again ]

Which suggestion was that? I can't see any reference to a Europa forum? heh

Tabbitha · 12th July 2009, 07:28 PM

Quote:

Originally Posted by Adam

Which suggestion was that? I can't see any reference to a Europa forum? heh

Quote:

Originally Posted by Adam

Heh wow, that's awesome.
Wonder if it'd be possible to import it into a forum.

well ok a 'forum' then.Just assumed it would have an indication that it was Europa shard

**Adam** · 12th July 2009, 07:30 PM

Ohhh, heh
The problems I forsee however is that there's probably going to be duplicate content, I'm not exactly sure how the data was scraped and/or if a time/date period was set when scraping
So ideally it'll need to be imported into a blank/new forum seperate from UOF or F4G, to see what the data looks like, then go from there.

Tabbitha · 12th July 2009, 07:32 PM

Quote:

Originally Posted by Adam

Ohhh, heh
The problems I forsee however is that there's probably going to be duplicate content, I'm not exactly sure how the data was scraped and/or if a time/date period was set when scraping
So ideally it'll need to be imported into a blank/new forum seperate from UOF or F4G, to see what the data looks like, then go from there.

Ah right I understand

**Moturdrn** · 13th July 2009, 02:04 AM

Quote:

Originally Posted by Tabbitha

Moturdn will be made up to get it all back I am sure

Won't take much at all

Many thanks to Murad for compiling the cache data, and Adam for setting about restoring it.

If there's any help I can provide, please let me know

MMoudry · 13th July 2009, 03:42 AM

Quote:

Originally Posted by Adam

Ohhh, heh
The problems I forsee however is that there's probably going to be duplicate content, I'm not exactly sure how the data was scraped and/or if a time/date period was set when scraping

I started to scrap the google cache about 36 hours after the f4g forums were declared as lost.... At that time the f4g forums weren't refreshed in google cache since the site was flagged as 'down'. By the time I've finished scraping the data, only first posts were starting to appear on f4g and being pulled into the google cache. The duplicate content should be minimal (less than 0.2 %)

Murad

**Adam** · 13th July 2009, 07:40 AM

Cool, thanks Murad

Frost · 17th July 2009, 04:35 AM

*looks excited*
Sooooo? any news on this one?

I gonna cry if i can read the old KMK Forums

)

**Adam** · 17th July 2009, 10:21 AM

I doubt it'll be as straight forward as that Frost, heh

Update I had today was

Quote:

Actually I have. The "rescue" code is more than 600 lines long now. I haven't been able to carve off any one big chunk of time to work on this but have been plugging away a little bit each day since; what I discovered is that the Google cache data is not all that consistent; there are plenty of dupes; some data has very little metadata in it to rebuild, etc. There still are 28000 pages and of course many more posts within those pages which I can recover complete with the original forum, thread and linkage info. Formatted as vbCode so the posts can be shoved back into a new forum, I wrote a little HTML to vbCode parser to do it that.

Left to do - sort out an issue with the members being parsed - for some reason I'm not finding very many valid members meaning a name and a member ID - that's sort of critical to rebuilding the complete post history. If nothing else I can insert an "apparently written by" text line for those posts, but I hope to do better.

Whatever the outcome I'd like to wrap this up today (meaning very late tonight my time - Pacific TZ) the code will produce sql insert statements for posts, forums, threads and members. Some assembly will be required. I'd recommend that an empty forum be created; these "rescue" records be added as new tables within the empty forum database, and then some selective sql updates be done to copy data from the rescue tables to the actual forum tables. That way I don't have to make the data look exactly like vB or whatever forum you choose.

So hang tight just a little longer.

MMoudry · 17th July 2009, 11:53 AM

Quote:

There still are 28000 pages and of course many more posts within those pages which I can recover complete with the original forum, thread and linkage info

I hope he means that he has still 28k pages to do. If he means that only 28k pages are parsable then the data is in much worse shape than I hoped.

12th July 2009, 07:30 PM	#23
Adam Founder Join Date: Sep 2002 Posts: 9,118 Thanks: 81 Thanked 2,061 Times in 751 Posts Member's Picture Albums	Re: Old f4g posts for UO guilds on europa Ohhh, heh The problems I forsee however is that there's probably going to be duplicate content, I'm not exactly sure how the data was scraped and/or if a time/date period was set when scraping So ideally it'll need to be imported into a blank/new forum seperate from UOF or F4G, to see what the data looks like, then go from there. __________________

13th July 2009, 07:40 AM	#27
Adam Founder Join Date: Sep 2002 Posts: 9,118 Thanks: 81 Thanked 2,061 Times in 751 Posts Member's Picture Albums	Re: Old f4g posts for UO guilds on europa Cool, thanks Murad __________________

17th July 2009, 04:35 AM	#28
Frost Confused Knight of Kha! Remember Alana D'Vashy Join Date: Sep 2006 Posts: 441 Thanks: 14 Thanked 14 Times in 12 Posts Member's Picture Albums	Re: Old f4g posts for UO guilds on europa looks excited Sooooo? any news on this one? I gonna cry if i can read the old KMK Forums ) __________________ Signed Icerian Taglefar General of Kha / Mayor of Vesper Knights and Mages of Kha (KMK) \| VESPER - V -

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Europa Guilds	Oyst	UO General Discussion	1	15th November 2008 05:13 AM
List of RP Guilds on Europa.....anywhere?	Moz	Europa RP General	7	30th June 2008 07:47 AM
Europa Guilds	Full Circle	UO General Discussion	16	12th July 2007 10:34 AM
Guilds?	merth	UO General Discussion	8	28th November 2006 09:59 AM
Faction Guilds Can't Alliance with Non-Faction Guilds	Thradia	UO News	0	12th April 2006 10:24 AM