Cellar cloud move

Undertoad • Nov 12, 2015 1:57 am
OK we are going to move into the cloud!

The actual Cellar will soon move into a virtual server, located in a data center in Newark, NJ.

You may not even notice when it happens

It's ready to go now, but such a scary thing. The actual change is, I close the current place, copy the database to the new place, change the DNS to point to the new place, and in an hour everybody is up and running in the new place.

I'm thinking Saturday afternoon Eastern time
DanaC • Nov 12, 2015 4:23 am
Will it be damp?
Griff • Nov 12, 2015 7:07 am
As damp as the cellar?
Sundae • Nov 12, 2015 7:37 am
Given the fog here for the last few weeks, I'll be right at home living in a cloud.
orthodoc • Nov 12, 2015 9:00 am
Security? (I know this is a stupid question and I apologize in advance - this is my anxiety talking)
glatt • Nov 12, 2015 9:13 am
I'm curious. How big is the Cellar? If it were to be archived, how much space would it take up?
monster • Nov 12, 2015 9:23 am
A cellar in the clouds. God's basement. Or the attic of The Beast
Undertoad • Nov 12, 2015 9:25 am
Security is identical on and off the cloud.

Insiders! If you want to see how fast your connection to it is, and I think it should be the same for everyone, you can go to www2.cellar.0rg which right now is a copy of the Cellar as it was last night. Don't log in or post, that is just a test.
Undertoad • Nov 12, 2015 9:39 am
Size: the code and all the IotDs take up about a gig. The messages and accounts take up 4 gigs.
glatt • Nov 12, 2015 9:42 am
Undertoad;945203 wrote:
If you want to see how fast your connection to it is, and I think it should be the same for everyone, you can go to www2.cellar.0rg which right now is a copy of the Cellar as it was last night.


Seems faster. I went to one of the image threads and it loaded instantly.
glatt • Nov 12, 2015 9:43 am
Undertoad;945204 wrote:
Size: the code and all the IotDs take up about a gig. The messages and accounts take up 4 gigs.


And attachments? They must take up a lot of space?

Edit: Actually, maybe not. "You are currently using 189.27 MB to store 2,648 uploaded attachments." I feel like I am a fairly heavy user of attachments here. So I can see my attachments fitting in that 4 GB.
Undertoad • Nov 12, 2015 9:58 am
I hope it is actually faster, that would be cool - if it is, it's the SSDs it will run on, not the Internets connection which should be about the same.

I mean here we are on the east coast, DC to Newark is Leeds to London... the ping to that server is like 15ms. It might as well be a local system at this point.

Uh sorry for all this techie-spk
Undertoad • Nov 12, 2015 10:02 am
But as long as we're lookin', if you comprende, you could ping cellar.org and then ping www2.cellar.org and tell me what you see. For me, cellar.org is around 28ms, www2 is like 18ms...

how to ping a website
glatt • Nov 12, 2015 10:13 am
[ATTACH]54121[/ATTACH]
lumberjim • Nov 12, 2015 11:06 am
mine's avg 26 vs 23. www2 is faster
DanaC • Nov 12, 2015 11:33 am
Are we on cloud 9?
fargon • Nov 12, 2015 1:35 pm
I am all ways on cloud 9.
Gravdigr • Nov 12, 2015 3:12 pm
I'm always overcast.
Zathris • Nov 12, 2015 4:29 pm
Undertoad;945172 wrote:
OK we are going to move into the cloud!


Why? #justcurious
Undertoad • Nov 12, 2015 5:09 pm
How to operate a server on the Internet? From the beginning, the usual way has been to buy a computer and put it in an expensive data center where you rent space.

Now, people set up a bunch of computers in the data center and they rent you time on them. It's a cheaper way to do it in a lot of cases; you own less of the infrastructure, but do you really need to? When we were doing a ton of traffic (when IotD was big and Facebook was small), we needed that, but now we don't. So we'll save money, save a little effort and apparently get a server that's avg 5ms faster to the net as well.

5 milliseconds here, 5 milliseconds there, it adds up

not really
Zathris • Nov 12, 2015 5:42 pm
:cool:
monster • Nov 12, 2015 6:04 pm
Access speed will be less nebulous which will be lightning the burden for thUndertoad. Plus the silver lining means Big Sarge won't need his tin foil hat.
lumberjim • Nov 12, 2015 6:10 pm
this is why no more tip jar then?
Undertoad • Nov 12, 2015 6:47 pm
Yes, the remaining costs are small enough so's I can handle them. If we ever come up with a project that needs money to do and makes sense for everyone, we could bring it back for that.
xoxoxoBruce • Nov 12, 2015 7:08 pm
Are smoking and pets allowed?
sexobon • Nov 12, 2015 7:24 pm
and will the Tag Cloud be called just Tag or Tag Cloud Cloud?
Gravdigr • Nov 13, 2015 2:15 pm
I prolly won't notice...

...I'm in the clouds most of the time anyway.:bong::beer:
monster • Nov 13, 2015 11:27 pm
You guys are clouding the issue. thUndertoad won't know weather there are questions to answer as he tries to maintain the Stratus quo.
Undertoad • Nov 14, 2015 3:54 pm
Please check in with any problem that you may be having.
sexobon • Nov 14, 2015 4:19 pm
ALL THE THREADS I STARTED ARE GONE!
Undertoad • Nov 14, 2015 4:36 pm
So, working as planned then.










:D
lumberjim • Nov 14, 2015 9:14 pm
Can we call this the Ascension of the Cellar?
sexobon • Nov 14, 2015 11:33 pm
I think we've just been transported.

[ATTACH]54170[/ATTACH]
Zathris • Nov 15, 2015 2:05 am
Undertoad;945468 wrote:
So, working as planned then.


It's all good @ my end.
Crimson Ghost • Nov 15, 2015 4:33 am
Newark?

Ok...
DanaC • Nov 15, 2015 5:39 am
sexobon;945510 wrote:
I think we've just been transported.

[ATTACH]54170[/ATTACH]


That's from the game! I had that game!
xoxoxoBruce • Nov 15, 2015 1:20 pm
Crimson Ghost;945523 wrote:
Newark?



Brilliant, terrorists would never pick Newark. :headshake
Zathris • Nov 15, 2015 3:00 pm
Crimson Ghost;945523 wrote:
Newark?

Ok...


Rly?
Gravdigr • Nov 15, 2015 3:00 pm
xoxoxoBruce;945540 wrote:
Brilliant, terrorists would never pick Newark. :headshake


Well, who would?

[size=1]Besides UT, I mean...[/size]
glatt • Nov 15, 2015 9:52 pm
One observation for me after the move:

Previously, in Tapatalk, I was unable to load the word association thread, but now I can.
Undertoad • Nov 15, 2015 9:58 pm
I don't know why that is but I'm pleased with the outcome

So far, there's only one issue I know of:

The cookies stopped working

I think a reboot might fix that, but people are online, a reboot takes like 3 minutes...
glatt • Nov 15, 2015 10:07 pm
So reboot.

(I'm going to bed now anyway.)
Undertoad • Nov 15, 2015 11:02 pm
It's not worth cookies. I'll get it next time
Undertoad • Nov 20, 2015 11:54 pm
Image

For the first time, it's possible to isolate and graph only Cellar-related internet traffic. The blue is stuff being uploaded. The first peak is the entire site and database being uploaded. The second one is just the database. The third is a small backup.

The green is people browsing and getting images and stuff. This first week of traffic shows that the estimates were about right. We can't fill the green part to the top, maybe to about the 2.0 line. Point is, we do have room to grow under this plan.

The first green bump: I had the Cellar answering not just to cellar.org, but also to the system's raw IP address. This caused Bing to decide it was an entirely new site on the Internets, and start collecting it and indexing it. That bump is the traffic that resulted. I figured out what was going on and shut it down.

Stuff like that happens; it's hard to tell whether someone is a web indexer, or is maliciously crushing your website. That bandwidth has to be paid for, too. Well in this case, it's not that bad. Fits under the plan. But it can be really bad.
lumberjim • Nov 21, 2015 1:02 am
Undertoad;945594 wrote:
It's not worth cookies. I'll get it next time

Know what has two thumbs and never reads the cookies anyway?

This guy.
classicman • Nov 25, 2015 8:05 pm
... what cookies? Did I mention the awesome oatmeal raisin cookies my son and I made?
xoxoxoBruce • Nov 25, 2015 8:09 pm
I just hit the eat a cookie button out of curiosity.
"People are worried about online porn on the Internet. It's the endless `Who's better--Kirk or Picard?' threads that *should* scare them."
- Jim Mullen, _Entertainment Weekly_
:haha:
Crimson Ghost • Nov 26, 2015 5:34 am
xoxoxoBruce;945540 wrote:
Brilliant, terrorists would never pick Newark. :headshake


You'll never notice the difference.
Undertoad • Nov 28, 2015 1:48 pm
Image

It looked like a denial-of-service attack last night.

This was 20 different IP addresses hitting every single link on the Cellar last night in various patterns. After two hours, the new cloud provider's bots noticed the spike and alerted me to it.

We had these attacks before, but after the move I hadn't blocked the IP addresses that are responsible for it. You can see how, at the end, it doesn't suddenly stop - it trails off. That's me, blocking various sets of addresses until I got them all.

This one three hour attack led to more bandwidth use than about 4 days of everyone just generally Cellarizing. It's not big deal because the capacity to handle it is built in.
Undertoad • Nov 28, 2015 1:53 pm
However, the good news is that the forum remained responsive, even as the system used all its resources to produce and deliver 200,000 Cellar hits over the space of two hours.

In comparison, during the 20:00 hour there were 3500 hits delivered...
glatt • Nov 28, 2015 1:55 pm
So you had to go in and fix it at 11PM last night? What a pain in the ass.

Thank you.
sexobon • Nov 28, 2015 1:57 pm
Is there something tangible to be gained by the attackers; or, is it just for shits and grins?
Undertoad • Nov 28, 2015 2:06 pm
Well, "go in" means I had to stop playing Rocket League and ssh to the server and figure it out. So that was a pain in the ass, but now, I consider it professional experience. Running Cellar servers has kept me fresh in certain areas of knowledge and it's been a real benefit at my new gig.

The whole move has been like that; it forces me to stay on my toes. In fact the whole Cellar lifetime has been like that, a hobby that pays back a little. It's rare I think. Playing bass has never helped me professionally. That I know of.
Undertoad • Nov 28, 2015 2:10 pm
As for why they do it - impossible to know! The attacks started a few months ago I think. We probably have enemies. Or maybe I do. Can't tell.

It's easy enough to create code that will harass a website by merely overloading it or confusing its logging. This sort of thing happens all the time.
xoxoxoBruce • Nov 28, 2015 2:59 pm
Probably somebody I pissed off.

Sharpened your pro skills? Your welcome. :haha:
Clodfobble • Nov 28, 2015 3:20 pm
Undertoad wrote:
We probably have enemies. Or maybe I do. Can't tell.


For some reason, the idea of Lamplighter secretly being a sophisticated technological anarchist running a darkened room full of hackers amuses me greatly.

But honestly, I would have thought DDoS attacks were always from overseas, and were basically practice runs for their attempts to bring down really big sites for ransom.
Undertoad • Nov 28, 2015 4:01 pm
These are coming from server co-location type places in the US. But it could just as easily be [strike]foreign[/strike] Asian to begin with, and proxied somehow through these other places, so you never know.
sexobon • Nov 28, 2015 4:49 pm
Well, it's probably not ISIS since Anonymous declared war on them. :right:
lumberjim • Nov 28, 2015 5:09 pm
I always think this thread title is the cellar. 'could' move