Forum: General Stuff
Topic: State of the forum
started by: GORDON

Posted by GORDON on May 15 2014,07:27
I have noticed this forum going slow lately.... has anyone else noticed?

Well, I just hit my domain control panel, and we are currently using 110 of 100 available mb.  We are 10% over allowed capacity.  Not sure why they let me go over... hope they aren't planning on billing me for it.

Anyway, we need to prune over 10% of the forum.  I don't LIKE purging all the older stuff.... but it is prolly the only way...

Suggestions?

Posted by TPRJones on May 15 2014,07:40
Is there a process in it that can do that sort of thing automagically with given criteria, or will someone need to delete a bunch of threads by hand?
Posted by GORDON on May 15 2014,07:41
I am pretty sure I can prune threads in batch jobs, (simplified) sql-style.

That really is theonly solution I can think of.

Posted by GORDON on May 15 2014,07:43
Going to run a backup, then prune everything older than... say... 8 years without a reply.   See what that does.
Posted by Leisher on May 15 2014,07:49
Probably safe to do 5 years.
Posted by TPRJones on May 15 2014,07:50
QUOTE
Then prune everything older than... say... 8 years without a reply.

That sort of thing was going to be my suggestion, yeah.

If we haven't talked about it in eight years what are the odds it will come up again?

Posted by GORDON on May 15 2014,07:51

(Leisher @ May 15 2014,10:49)
QUOTE
Probably safe to do 5 years.

I can do it forum by forum... I don't want to touch anything in Movies, but general and links, yeah, can prolly do 5.



Posted by GORDON on May 15 2014,08:06
Forum: General Stuff
Cutoff: 1825 days or older
Threads found: 1748

Deleting.....

Posted by Leisher on May 15 2014,08:07
I would suggest eliminating America II, Ultima Online, and League of the EVE of UO Galaxies.

Most of our political talk occurs in General and Internet anymore.

UO has rarely been posted in over the past few years, and honestly doesn't need to be separate from Games.

And there's no need for a private games section at this point. If we need it in the future, we can just create a new one.

Do you have the ability to see what forums eat the most space? Should we clean up the LJ thread?

Posted by TPRJones on May 15 2014,08:09
*gasp*

Not the LJ thread!!!

Posted by GORDON on May 15 2014,08:09
I should have bumped the oldest thread first, so we'd still have it.
Posted by GORDON on May 15 2014,08:12
Forum: Internet Links
Cutoff: 1825 days or older
Threads found: 4023

Deleting.....

Posted by GORDON on May 15 2014,08:29
According to the domain control panel, the database size has not been reduced at all.  It either isn't refreshed yet, or the data is still there.  

Hmmmm.

Posted by TheCatt on May 15 2014,08:33
NNNNNNOOOOOOOOOOOOOOOO

Sorry, I'm a hoarder.

Oh well.

Posted by GORDON on May 15 2014,08:48
Outta room.  No choice unless I wanted to host the thing somewhere else, and that sounds exhausting.  Also I don't have enough upstream bandwidth for that.
Posted by Malcolm on May 15 2014,08:52

(GORDON @ May 15 2014,10:48)
QUOTE
Outta room.  No choice unless I wanted to host the thing somewhere else, and that sounds exhausting.  Also I don't have enough upstream bandwidth for that.

You can't spit the files into a simple .csv (or something) format and turn the compression all the way up on 7-Zip?
Posted by TheCatt on May 15 2014,09:03
Yeah, if you just exported, I'd figure something out... eventually
Posted by GORDON on May 15 2014,09:07
It's an actual mysql dbase, not just text files.  Compressing data would be a lot of recoding.
Posted by TheCatt on May 15 2014,09:10
Right, just export the mysql DB, and I'll do something with it.
Posted by GORDON on May 15 2014,09:12
Well, that's already done.
Posted by GORDON on May 15 2014,14:54
Still reading 110 MB on the forum database.

I am concerned that using the "Prune" function merely did away with the thread pointers but left all the data.

Posted by TPRJones on May 15 2014,15:00
It sounds like it.

The only way to test that I can think of without knowing the details of the database structure would be to load up the backup and find some unique text fragments from threads that should have been deleted, then do a broad query on the current post-deletion database to see if that stuff is still out there.

Not that I have any particular recommendations of what to do once it's proved that's what is happening.

Posted by TheCatt on May 15 2014,15:09

(GORDON @ May 15 2014,17:54)
QUOTE
Still reading 110 MB on the forum database.

I am concerned that using the "Prune" function merely did away with the thread pointers but left all the data.

Quick, export the DB while the threads live!
Posted by GORDON on May 15 2014,15:22
I did an export right befor I pruned, in case I fucked something up.

Easiest thing to do might be to export now that I have pruned, wipe everything, and reload the forum from scratch, hoping that just the live threads get imported.  And that aint easy, that I recall.  It has been at least 5 years since the last forum reload.

Posted by GORDON on May 15 2014,15:29
Just went into database administration in the domain control panel... hitting the "optimize table" button in some of the big tables (like the one called ib_forum_posts) now has us down to 75MB.

So, mission accomplished, I reckon.

Posted by thibodeaux on May 15 2014,16:09
I don't about MySQL, but I know with postgresql, even though you "delete" a row, it's still there until a vacuum runs.
Posted by GORDON on May 15 2014,17:14
That's what I figgered.
Posted by GORDON on Jun. 10 2014,11:18
Anyone else hitting the occasional lag spike today?  Did anyone else see the forum as completely down earlier today?  I think my host is having troubles.

Or is it just me?

Posted by TheCatt on Jun. 10 2014,11:20
Yeah, it gave me a weird error earlier, and I've been having occasional lag spikes for a week or so.
Posted by Malcolm on Jun. 10 2014,11:21
Me, too.  Last night as well.
Posted by GORDON on Jun. 10 2014,11:34
I bought the domain for 10 years... about 9 years ago.  I don't even remember through what agency I am registered, and I know they changed how shit is done... used to be just one company selling domains.  How do I find out?
Posted by Malcolm on Jun. 10 2014,11:42
Domain Name: DTMAN.COM
Registrar: 1 1 INTERNET AG
Whois Server: whois.schlund.info
Referral URL: < http://1and1.com >
Name Server: NS57.1AND1.COM
Name Server: NS58.1AND1.COM
Status: ok
Updated Date: 11-nov-2013
Creation Date: 10-nov-1999
Expiration Date: 10-nov-2014

Posted by TPRJones on Jun. 10 2014,11:43
(repeated data snipped, Malcolm is faster)

I used to use 1AND1.com.  They were awful.

Even GoDaddy.com would be a better choice when you renew.



Posted by GORDON on Jun. 10 2014,11:44
Ah.............. I can renew right through the host?  I don't even remember the process.  I think I originally did it through networksolutions.com.
Posted by GORDON on Jun. 10 2014,11:46

(TPRJones @ Jun. 10 2014,14:43)
QUOTE
(repeated data snipped, Malcolm is faster)

I used to use 1AND1.com.  They were awful.

Even GoDaddy.com would be a better choice when you renew.

I used several hosts before 1and1, and they were all terribler than what we are on now... 1and1.  Been stable for many years, as far as I know.  Also, the reason I have forgotten all this shit is because it has been working without my needing to touch it for many years, allowing me to forget the mechanics of it all.
Posted by TPRJones on Jun. 10 2014,11:46
Oh, 1AND1 is the host as well?  Then ignore what i said about GoDaddy, you wouldn't want to host there.
Posted by TheCatt on Jun. 10 2014,11:50
I've been with 1and1 for several years, and their hosting has been great and stable for a pretty low cost.  They are expensive as a registrar (more than godaddy), but I've never had performance issues with them.
Posted by Malcolm on Jun. 11 2014,19:33
QUOTE
Our situation has not improved.

  - Henry Jones, Sr.

Posted by GORDON on Jun. 12 2014,04:25
Emailed tech support yesterday when the site had been down for 20 minutes.  Told them even if it was working when they read the ticket to check the server logs and it should show latency and downtime.

We will see.

Powered by Ikonboard 3.1.5 © 2006 Ikonboard