The boring life of Jerod Poore, Crazymeds' Chief Citizen Medical Expert.

Showing posts with label Crazy Meds site status. Show all posts
Showing posts with label Crazy Meds site status. Show all posts

Can't Things Work for one Day?

I don't know what happened. Everything was fine until the weekly jobs ran at four in the morning, then the entire site reverted to "Here's your brand new domain!" Everything is still there, but for some reason the http server is pointing to the default directory. None of the configuration files changed, and I've restarted httpd several times now. I've got a ticket in with lunarpages. It's just one fucking thing after another.

And we're back.

The rebuild is 95% complete. I've reopened the forum. It will be slow going until morning, but better than nothing, right? 

Offline Means Offline

Some bug in the forum software has allowed people to log onto the forum and read it while it was offline COMPLETELY DEFEATING THE PURPOSE OF TAKING IT OFFLINE TO SPEEDUP THE REBUILD!!!! THANKS LOADS, EVERYONE!!!

I've had to put in a hard restriction of the forum to my IP address.  Hence the 403 forbidden message.

No wonder the maintenance during some of the upgrades took for fucking ever.  That wasn't cache weirdness I was seeing in the online users list.  Those were people logged on when I said not to be logged on.

Forum & Blogs offline

The Crazy Talk forum and blogs are temporarily offline until the fucking rebuild/resync of the new RAID array is done.

The Wiki may go offline as well.


----
Update: at 61% rebuild/resync. Noticeably faster with forum offline. 

---------

Update: 78% complete.  Now I have to figure out if we're in the land of diminishing returns or not.  When it comes to keeping the forum offline.

What the FUCK?!?!


I don't know what the fuck is going on with #Crazymeds, and why it's taking forever for pages to load.  It could be one or more of:

The new ads on the forum 
Another disc drive problem
All the bruteforce attempts to hack the server we've been having lately

The upgrade is an unlikely cause as the problem is site-wide.  I'm having problems with telnet as well, but I see wiki pages OK, albeit slowly.  

I'm having lots of connectivity problems in general, as some sites are freezing, timing out, etc. and some aren't.  Lunarpages support pages aren't coming up, but others are.  gmail and G+ take forever to load.  Tumblr isn't showing up.   I can't connect to the ad server sites to temporarily disable the ads on the  forum from that end since I can't get to the forum admin page without timing out.

--------

UPDATE:

I was finally able to get a connection to the Lunarpages support site. It turns out that a second RAID array was needed, because the forum is getting so huge. It's taking a long-ass time to sync all 120G of the data. Hence everything being slow as molasses.

As of 4:00 PM Mountain still-not-on-daylight-insanity-Time (2300 GMT) The rebuild/resynchronization is at 55%. Expect the long-ass response times to last well into tomorrow. 

Crazymeds Down

Crazymeds is down.  Looks like a hardware failure.  I'll keep you posted.

--------

UPDATE:

OK, we're back up. There's a faulty drive.  A new one will be installed 1600 PST (2300 GMT) Friday 19 March.  Expect some more down time, but the guys at Lunarpages are really quick about swapping drives, so it won't be too long. 

------

That should read Thursday (AKA Today) 19 March.  I've been unstuck in time lately.

Updated: Crazymeds Is no longer Down

And now we're back up.  Yay!  I <3 lunarpages.




The entire Crazymeds site is currently down.  The problem appears to be at LunarPages, as their website is too swamped to let me open up a support ticket and the support lines, both toll-free and the real number behind it, are busy.  I can't even bring up nameserver info for Crazymeds, so something is hosed bigtime. 

Forum's back up.

We're back on the air.  Yay.

Forum down for emergency software upgrade.

We're off the air until I upgrade the software.  Sorry.

Pop Quiz! Forum Software Upgrade


We're back up.  Annoying bug still there.

-----------

I'll be doing a forum software upgrade today.  Sorry about the utter lack of notice, but, given my current spate of depression, I have no idea what I'll be up for on a day-to-day basis.

The usual parameters: starting noon Mountain time, 1800 GMT, and lasting as long as it takes. How much of the fix for the most annoying bug is IPB software and how much is system maintenance makes it difficult to tell how long this will take.

And we're back.

The Crazy Meds forum and blogs are back on the air after our planned software update.  Nothing seems broken so far.

New Content, more or less, and Software Update.

New content, of sorts.  I've finally put up the long-overdue page of: Definitions of Neurological, Psychiatric, Medical, and Miscellaneous Terms, Abbreviations, Acronyms & Initialisms used on Crazy Meds.  It is not a medical dictionary.  That is still in procrastination mode.

I'm also planning on doing a forum & blog software update this Sunday, 5 April 2013.  It should be business as usual - starting around noon Mountain time (18:00 GMT) and lasting as long as it takes.  An hour?  Two?  Less?  Hell if I know.  The rest of the site should not be affected.

Let the Upgrades Begin!

The forum, calendar & blog software upgrade has begun.  I don't expect this to take too long as far as these things go.

----------

We're back on the air, and there are all sorts of annoying little problems.  Quoted posts look funky, and various admin stuff isn't working like it used to.  That's what I get for being optimistic.

-----------

I'm trying to fix some of what's wrong, but it's not letting me.  I need to kick everyone off, as in stop trying to access the forum, but I'm still not able to get enough memory do any cache management. 

-------------

OK, looks like I need to open up a trouble ticket Monday.  We're back on the air, it's just that some posts will look funky.

Forum & Wiki Software Upgrades

I plan on upgrading the forum, blog, and calendar software Sunday, 13 January, 2013.  The upgrade should begin noonish Mountain Time (19:00 GMT), and end anywhere from two to five hours later.  I never can tell with these things.  As these aren't particularly major software changes, my money is on three hours.  The forum and blogs will be unavailable during that time.

Most of the changes in the upgrades are under the covers or behind the scenes, so you won't see them.  The most significant one, I think, is the Best Answer feature.  That's the sort of thing we've needed for a long-ass time.

Then one week later - Sunday, 20 January, 2013 - I won't be joining my fellow Caucasians in honoring the work and sacrifice of the Reverend Doctor Martin Luther King Jr. by skiing or snowboarding.  Instead I'll be updating the wiki software.  I don't think there will be any significant interruption in the availability of pages at any time during the process, but I'll have a better idea after I run the updates in a test environment.  


As always, you can check any or all of here, and Crazy Meds' Facebook and Google+ pages for status updates.

Forum Software Upgrade Complete

And we're back online.  Told you it wouldn't take long.

And we're back

The Crazy Talk forum is back up.  We'll see if the upgrades broke anything.

Forum Offline for Software Upgrade

The Crazy Meds forum and blogs will be temporarily down tomorrow, Sunday, Sunday, Sunday, 8 July 2012, around noonish Mountain time (1800, or thereabouts GMT) for a software upgrade. I have no idea how long it will take as I'll also be doing the usual purging of inactive user accounts and database maintenance before the install. There's also an upgrade to the server-side Tapatalk software for the mobile app.

This should affect the forum and blogs only, the rest of the site - i.e. the pages on medications - will be available.  At least that's the plan.

We're back

We're back on the air and qmail's email is arriving at gmail.

Temporary Downtime

Crazy Meds will be off the air for 10-20 minutes around noon Mountain time (1800 GMT) to implement the operating system patch that's supposed to take care of the problem with e-mail not being sent to gmail.

I'll be turning off the forum soon.

Sorry for the lack of notification, I just saw that the techs put in the patch.

Attention gmail users of the Crazy Meds forum

For anyone on the Crazy Talk forum who uses gmail - especially anyone who just registered - I've just noticed that you haven't getting any of the mail the forum has been sending you since 14 June or so.  gmail isn't sending it to your spam folders, it's all sitting in the mail queue on the Crazy Meds server.

I really don't know who the dumbasses are, as it involves Intertubes stuff I don't understand any more. In this case it's ipv6 vs. ipv4 and quad A MX records. So if you've got a gmail account you're not get your notifications of PMs, posts in topics you're following, etc. New members aren't getting validation e-mail.

I've opened a ticket with the domain host and they're looking into it.

I've also got close to 700 messages sitting in the queue waiting to be delivered to gmail. Now they're really going to think I'm a spammer once it's fixed and those all go out at once.  Messages sent out prior to 20 June have already been deleted from the queue by the mailer, so you won't be overwhelmed with notifications that are excessively out of date, just moderately out of date.

In the meantime I'm manually validating accounts of people with gmail addresses.  Until this is fixed it may take a day or two for your account to be fully activated.