moving servers...

specs:

q8400 + 8GB RAM + 2x1.5TB HDD + 100mbit dedicated (like elis)

current server will be retired, may it rest in peace...

and for the curious, specs of current server:

e6550 + 2GB RAM + 2x 500GB + 1x 400GB + 100mbit shared

Wow, admin2. Thanks for your efforts to keep this site speedy. Much appreciated.

Which server is moving?

The main server is moving.

There should be no downtime...ideally.

New server will be online on Tue or Weds and sites will be slowly migrated to the new one.

i quite dont get it why a basically pure upload site/server needs so many resources in cpu and ram... bad programing?

sure it has some imageprocessing, but main reason for move should be bw and not bc a lack of power, right?

MDGeist said:
i quite dont get it why a basically pure upload site/server needs so many resources in cpu and ram... bad programing?

sure it has some imageprocessing, but main reason for move should be bw and not bc a lack of power, right?

I don't think the ruby app that is danbooru/moe scales that well. Plus dealing with 30-100 MB PNG files can take some CPU time for sure. I'm not sure how the image dupe check works or if it requires many cycles.

Searches with 3-4 or more tags can be somewhat intensive I think, and can't be cached. The server is constantly mirroring with elis and ranka. Every few hours the site cleans up the database.

And I believe there's a great deal of hits on the site fairly continuously.

But that all said, I think the key issue is what you mention, bandwidth. Whenever the mirrors go down, or there's an issue, shana (current server?) gets dirt slow, which I imagine has a lot to do with the 100 Mbit shared connection. The 100 Mbit dedicated that elis is on I find always to be fast, I've never gotten less than 800 KB/s off it really, but shana sometimes goes as slow as 2 KB/s.

My observations however might be due to elis never having the same load shana does, as shana is the main site which receives the uploads, mirrors, and serves until mirrored. Most people don't go back through the mirrored files as much as the new files (my assumption anyway).

Its for the bandwidth, shana mk. II will be just as fast as elis so things wont be bogged down if a mirror crashes or things break while images are mirrored.

The extra cpu will probably underused but I'm sure there's a way to make it used one way or another.

Lastly the current server is a year old, I like to move to new hardware every year to prevent hd failure, or other things that would happen after time passes.

Is this moving thing what caused Elis to stop responding?

admin2 said:
The extra cpu will probably underused but I'm sure there's a way to make it used one way or another.

Maybe compressing medium-quality (between 100MB png and 300k sample) JPGs?

Site access will be slow since there's roughly 600+gb being transferred to the new server...

moe is about 60% complete on transferring to new server, I think on Wed or Thu we will switch over, there will be a bit of downtime, probably about a hour at most.

If you see this it means you're on the new server

Well I'm back on. Had to edit my hosts file though.

Avatars have reverted BTW I'll have a look around and see if I can spot any other problems..

Only problem I can see is that every picture on the site is gone pretty much, except the stuff stored on this 'new' server.

Edit: And yeah, Avatars seems to revertred back like 2 months or so ?

MugiMugi said:
Only problem I can see is that every picture on the site is gone pretty much, except the stuff stored on this 'new' server.

I can only see the thumbnails at the moment. Probably still mirroring.

Can't see the thumbnail for http://moe.imouto.org/post/show/65085 (I need to be a bit more patient)

Uh.....Sorry, when I link to http://moe.imouto.org,
It said I need to update my dns, but I don't know how to,
so I just change http://moe.imouto.org into http://76.73.1.90
Then it shows some problems, first is I can't see any thumbnail, second is when I wanna see a pic, I change it
into 76.73.1.90/where it was, and it said there is no this pic.
What can I do now???

Radioactive said:
I can only see the thumbnails at the moment.

Same over here, thumbnails and old avatars are the only pictures displaying at the moment. Also had to edit the hosts file.

sorry at work...things will be fixed slowly

NeoJET said:
Uh.....Sorry, when I link to http://moe.imouto.org,
It said I need to update my dns, but I don't know how to,
so I just change http://moe.imouto.org into http://76.73.1.90
Then it shows some problems, first is I can't see any thumbnail, second is when I wanna see a pic, I change it
into 76.73.1.90/where it was, and it said there is no this pic.
What can I do now???

http://www.mvps.org/winhelp2002/hostsfaq.htm

avatars fixed...

Radioactive said:
http://www.mvps.org/winhelp2002/hostsfaq.htm

Sorry for my bad English, I can't clearly understand what
t says....
Could you just tell me what should I do? By the way,
I'm using firefox.
The only thing I know is the website tell us to download
the hosts file on their site, and cover the old one in our pc by it....

Just wait a few hours, it'll be working normally by tomorrow

admin2 said:
Just wait a few hours, it'll be working normally by tomorrow

But now which url should I use?
I'm using http://76.73.1.90 , but the other guys seem using
http://moe.imouto.org , I can't link the old one , it want me to update dns , I'm really confuse now....OTZ

http://moe.imouto.org should be working fine by tomorrow.

all fixed hopefully..

It's working smoothly now, I don't spot anything unusual. Thanks, admin2.

Not sure why, but every time I click for the original image size, I only recieve some text, and not the image.

Kyanges said:
Not sure why, but every time I click for the original image size, I only recieve some text, and not the image.

Your DNS aren't fully updated / your browser cache is messing with you.

The referer check just wasn't allowing links from the site via IP.

Shuugo said:
Your DNS aren't fully updated / your browser cache is messing with you.

I just looked up how to flush the DNS, and did that, and I also cleared my browser cache. The problem happens kind of randomly.

I'm subscribed to the RSS feeds, so I look up new images from Google Reader. For example, I clicked the latest entry for "Toradora!", which leads me to "http://76.73.1.90/post/show/65113", and when I click, "Original image", I receive text.

On the other hand, if I go back to the thumbnails(?) page, and click on the little star underneath, I actually get the proper image.

--------------------------------------------------------

Just tried something before I submitted this post, after I thought a bit about what Petopeto said. He's right, if I have moe.imouto in the address instead of the IP, everything works.

Does this mean I'll have to resubscribe all my RSS feeds? They all link to the IP instead.

EDIT: Gah, I just tried some of the other feeds, and even though some link with the IP, everything works there as well. I'm back to being confused over what the problem is.

EDIT2: Just tested things out a bit more. If I navigate to an image normally, everything works. However, if I subscribe to a feed, and go to it through Google Reader, I'm linked back to an address with the IP anyway, meaning the, "Original image" link doesn't work. However, some of the RSS entries to a different image still works, despite leading me to the IP address.