I just shut down image serving off the main server for now to speed it up, since it's nearly well broken anyway, but I'll have to turn it back on before it finishes (since I'm going to bed).

can sb explain the mirroring of this site a bit ?

what i understood is that theres 1 main servers from which 2 others rsync ... now if the main is stressed/lagging/ddosed this basically means all is slow...

so... what not make it possible that when you upload an image it gets saved on server a , b , or c at 33% , the backup rsync remains...

When you upload an image, it is put into a queue to sync it up with the other mirrors as soon as possible. However if many large images are uploaded at once or the queue fails, the length of the queue will grow.

Then you get what petopeto said.

petopeto said:
It's just a feedback loop when mirroring falls too far behind: everyone starts bashing on the main server to get unmirrored posts, which slows the mirroring down further...

petopeto said:
I just shut down image serving off the main server for now to speed it up, since it's nearly well broken anyway, but I'll have to turn it back on before it finishes (since I'm going to bed).

Ever thought of getting an additional admin for when you and admin2 are offline? Not sure who would have the necessary technical skills.

sheryl offline? I'm loading no thumbnails...

Im a bit new to this (infact very) and im trying to get to the IRC but a) i have no idea how to use an IRC and b) i have no idea how to get to it. can someone give me a step-by-step guide please.

also :( :( :( about the server issues

yeah, seems like sheryl is reaaalllly slow ;_;

Everything is still broken then?

Ramunelamune said:
yeah, seems like sheryl is reaaalllly slow ;_;

I just tried to download a scan from sheryl on my 20Mb broadband connection. It'll take 3 hours...

Extream slowliness ~18 hours a day, at this time its getting better.. atleast for a while.

Everything run smooth now just images from ranka.imouto.org run really really slow, about 20 mins for one 10+ mb.

longbowwing said:
Everything run smooth now just images from ranka.imouto.org run really really slow, about 20 mins for one 10+ mb.

Same here... half an hour now for a 33MB file, usually < 1 min. In FL, USA. Recent experience says it will die before finishing.

Ha! elis = 49 MB file in 12 seconds! BTW, both files, one from ranka (33 MB, never finishes) and one from elis (49 MB, instant) are next to each on other on page 24 currently, so mirroring should not be a factor? Started about 2 days ago for me in FL.

working on a solution....it should only impact people who are trying to mass download the site.

good thing i have rsync :D

notice any differences or is ranka still slow?

admin2 said:
notice any differences or is ranka still slow?

Nope. Banging 1.0-1.2MB/sec. Whatever you did was a good thing.

admin2 said:
notice any differences or is ranka still slow?

ranka is now fast, but elis is now being somewhat slow.

It is particularly bad at the moment...

That happens when mirroring dies overnight and there's a backlog of 100+ images to upload

admin2 said:
That happens when mirroring dies overnight and there's a backlog of 100+ images to upload

Ah...

everything is good now, thank you for the hard work

longbowwing said:
everything is good now, thank you for the hard work

Not yet. Sheryl is still as good as dead.

Sheryl is not supposed to be used as a mirror server to be honest but due to some problems with routing people start hammering on it when its not finished mirroring..

how much traffic is MOE pushing per month btw ?
> 10t ?

Well its 1tb a day...you do the math

admin2 said:
Well its 1tb a day...you do the math

Only 1TB per day combined over multiple 100Mbit servers? That is not very much at all, I would have thought it would be closer to 1.5-2TB+ on average.

I guess that means Moe still has a lot of room to grow with the current servers, or are you just getting hit really hard during peak time everyday?

We get a lot of traffic after popular releases (eg. Moeoh/Hime/Megami), and then it usually settles down for a while.

rsync on ranka broken or simply changed ? :|

It's turned off, since it was totally killing ranka...