rglondon | Entries tagged with server

At some point between 19:00 and 20:00 on the 24th nimbus the server that RGL runs on will be rebooted.

This should not take too long but RGL might not be there for a few minutes

kake

RGL is unavailable! Oh noes!

bob says: "The fact that I can't get to the remote administration console suggests that it's either a nuclear strike or a network failure at our hosting provider. And I suspect we would have noticed a nuclear strike."

So it's not a problem with RGL itself, and hopefully will be resolved soon.

Update: 7 minutes after I post this... it's back!

Re-update: And it's gone again, and back again, and... I think it's time to go to bed.

bob

This evening from 21:30 nimbus (the machine rgl is on) will be physically moving to a new datacentre. This means rgl will be down. Things should be back by 01:00. If not they should be back by the morning.

bob

A couple of hours ago I made RGL live again. Everything should be working if not leave a comment here or mail rgl-admins@randomness.org.uk. There is a slight problem with some characters being double encoded but apart from that its all good hopefully.

Current Mood: accomplished

bob

Well, I missed my self imposed deadline of getting RGL back last night.

I actually have the site up and running but not visible to the outside world yet. Things have been slightly complicated by changing from postgresql to mysql as the database backend. This is causing issues with some of our custom scripts which rely on the way postgresql works.

The change to mysql should hopefully stop the random downtimes we were seeing before.

Im now hoping to have things back by Tuesday.

kake

Good news re the ongoing server issues — bob will be racking (physically installing) a new server this afternoon. Full RGL service won't be back immediately, but he hopes to get that sorted out by Friday evening if not sooner.

In the meantime, the non-editable mirror at http://mirror.london.randomness.org.uk/ has full functionality (apart from editing, obviously), and all RGL URLs redirect to the appropriate page there.

bob

So at about midnight last night I finally got a read only mirror up and running on http://mirror.london.randomness.org.uk.
I would have announced this earlier but as

kake said I'm a bit busy at work currently. Sorry about the delay.

Now to make the main site redirect to the mirror instead of giving an error message.

Current Mood: ecstatic

bob

Having found a script with my hostname at rsync.net and then remembering my numeric user id I have restored and verified a backup of the database from yesterday morning. So the data is safe.

I hope to have a non-editable mirror running on an amazon ec2 instance up soon. Hopefully at some point this evening.

kake

As you may have noticed, RGL is currently down. This is because nebula, the server it runs on, is having problems, and unfortunately bob is in the middle of a very busy period at work so hasn't been able to sort it out yet. We're very sorry about this.

Hopefully the cause is simply that it's got overwhelmed by a DDOS or something similar (an attempt to bring a website down by sending it too many requests) and is sitting there spinning its gears not knowing what to do — rather than a disk failure which could lose us data. If it does turn out to be the latter, we have relatively recent offsite backups thanks to therealdrhyde, and I also have copies of all new pages added since the date of the most recent offsite backup.

Summary: No need to panic, very sorry for the downtime, will keep you updated as and when I have more news.

S	M	T	W	T	F	S
1	2	3	4	5	6	7
8	9	10	11	12	13	14
15	16	17	18	19	20	21
22	23	24	25	26	27	28
29	30	31

Randomness Guide to London

Entries tagged with server

Server Downtime Monday 24th June 19:00-20:00

Current downtime

Scheduled Downtime

Its back! back in black!

Almost there! stay on target!

New server news.

Mirror, Mirror on the wall...

Backups!

RGL downtime.

Profile

March 2020

Syndicate

Most Popular Tags

Page Summary

Style Credit

Expand Cut Tags