excell Posted August 12, 2008 Report Share Posted August 12, 2008 Few minutes of downtime at 11P, rebooting the server. What a GREAT last few days! Quote Link to comment Share on other sites More sharing options...
TimTaylor751647545500 Posted August 12, 2008 Report Share Posted August 12, 2008 Oh noes. Now I have to work Quote Link to comment Share on other sites More sharing options...
nurkvinny Posted August 12, 2008 Report Share Posted August 12, 2008 Porn it is then from 11:00 until 11:10. Gotchya, thanks for the heads up. Quote Link to comment Share on other sites More sharing options...
Guest Hal Posted August 12, 2008 Report Share Posted August 12, 2008 I'm sorry, I do not approve. Please reschedule. Quote Link to comment Share on other sites More sharing options...
Guest tbutera2112 Posted August 12, 2008 Report Share Posted August 12, 2008 http://i184.photobucket.com/albums/x155/infotechman/GAF/omg-do-not-want.jpg Quote Link to comment Share on other sites More sharing options...
TurboRust Posted August 12, 2008 Report Share Posted August 12, 2008 nooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo Quote Link to comment Share on other sites More sharing options...
Buck531 Posted August 12, 2008 Report Share Posted August 12, 2008 WTF do you think are going to do for 10 minutes? WTF mate? you need to reschedule this for 3 AM while I'm sleeping. Quote Link to comment Share on other sites More sharing options...
Guest tbutera2112 Posted August 12, 2008 Report Share Posted August 12, 2008 im going to bed when this place goes offline...my life will have no other meaning Quote Link to comment Share on other sites More sharing options...
Guest tbutera2112 Posted August 12, 2008 Report Share Posted August 12, 2008 11:02 and its back up already? weaksauce Quote Link to comment Share on other sites More sharing options...
87GT Posted August 12, 2008 Report Share Posted August 12, 2008 There is no down time. Quote Link to comment Share on other sites More sharing options...
excell Posted August 12, 2008 Author Report Share Posted August 12, 2008 All done. Quote Link to comment Share on other sites More sharing options...
TimTaylor751647545500 Posted August 12, 2008 Report Share Posted August 12, 2008 That 2 minutes of work was killer. Quote Link to comment Share on other sites More sharing options...
excell Posted August 13, 2008 Author Report Share Posted August 13, 2008 Gonna happen again some time after 11. I expect 10-15 minutes of down time. Quote Link to comment Share on other sites More sharing options...
Guest Hal Posted August 13, 2008 Report Share Posted August 13, 2008 Again Chris, I do not approve. Perhaps we can reschedule for a better day. Have your people call my people. Quote Link to comment Share on other sites More sharing options...
SRTurbo04 Posted August 13, 2008 Report Share Posted August 13, 2008 glad i missed the shut down last night but not 10minuites tonight.... shit i could watch porn but what woudl i do with the other 8 minuites? in all seriousness im trying to learn this comptuer crap what are you doing that needs cr to be shut down? Quote Link to comment Share on other sites More sharing options...
Guest tbutera2112 Posted August 13, 2008 Report Share Posted August 13, 2008 glad i missed the shut down last night but not 10minuites tonight.... shit i could watch porn but what woudl i do with the other 8 minuites? in all seriousness im trying to learn this comptuer crap what are you doing that needs cr to be shut down? start with the keyboard....learn that before trying to get technical Quote Link to comment Share on other sites More sharing options...
AJ Posted August 13, 2008 Report Share Posted August 13, 2008 start with the keyboard....learn that before trying to get technical fucking OWNED!!! Quote Link to comment Share on other sites More sharing options...
excell Posted August 13, 2008 Author Report Share Posted August 13, 2008 We've been having an issue with our firewall cluster (completely separate units, primary and secondary, for redundancy) holding onto connections after they're long dead. Imagine it like you have three phone lines at your business, you get a call on one line and the when the call is over, someone doesn't hang up the phone - the call is over, but the line remains open and you can't use it. Now this happens on all three lines and you cannot take any more calls in or out. That's essentially what's going on. Except we can support 25000 calls (connections) and something that is not easy to identify is holding them open. The issue initially surfaced on Thursday, when we had three hours of intermittent connectivity while we attempted to trace the exact source. We had another 15 minute outage yesterday after a troubleshooting step that should not have affected our services did (and I beat my senior engineer in his head for performing ANY steps during business hours). We've been taking the site down at 11P yesterday and today, and probably tomorrow to perform various troubleshooting steps. Last night, I took down the server CR lives on so I could make a few changes to an application that lives with CR on this server that I suspect is the culprit. Tonight we're taking down our services to force back over to our primary firewall for further testing. Did I explain that at least mostly clear enough? Quote Link to comment Share on other sites More sharing options...
Mr. Jones Posted August 13, 2008 Report Share Posted August 13, 2008 We've been having an issue with our firewall cluster (completely separate units, primary and secondary, for redundancy) holding onto connections after they're long dead. Imagine it like you have three phone lines at your business, you get a call on one line and the when the call is over, someone doesn't hang up the phone - the call is over, but the line remains open and you can't use it. Now this happens on all three lines and you cannot take any more calls in or out. That's essentially what's going on. Except we can support 25000 calls (connections) and something that is not easy to identify is holding them open. The issue initially surfaced on Thursday, when we had three hours of intermittent connectivity while we attempted to trace the exact source. We had another 15 minute outage yesterday after a troubleshooting step that should not have affected our services did (and I beat my senior engineer in his head for performing ANY steps during business hours). We've been taking the site down at 11P yesterday and today, and probably tomorrow to perform various troubleshooting steps. Last night, I took down the server CR lives on so I could make a few changes to an application that lives with CR on this server that I suspect is the culprit. Tonight we're taking down our services to force back over to our primary firewall for further testing. Did I explain that at least mostly clear enough? Sounds like you need more qualified engineers. Quote Link to comment Share on other sites More sharing options...
excell Posted August 13, 2008 Author Report Share Posted August 13, 2008 Having fun yet? Quote Link to comment Share on other sites More sharing options...
Mr. Jones Posted August 13, 2008 Report Share Posted August 13, 2008 Having fun yet? FIRED AGAIN Quote Link to comment Share on other sites More sharing options...
excell Posted August 13, 2008 Author Report Share Posted August 13, 2008 Sounds like you need more qualified engineers. In this case, I believe I need more qualified programmers. Quote Link to comment Share on other sites More sharing options...
Mr. Jones Posted August 13, 2008 Report Share Posted August 13, 2008 In this case, I believe I need more qualified programmers. Programmers? You guys are running open source / hacked together firewalls THERE ? Quote Link to comment Share on other sites More sharing options...
excell Posted August 13, 2008 Author Report Share Posted August 13, 2008 No, we're running a crappy application which I suspect is holding open connections. Quote Link to comment Share on other sites More sharing options...
Mr. Jones Posted August 13, 2008 Report Share Posted August 13, 2008 No, we're running a crappy application which I suspect is holding open connections. Oh, that makes more sense. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.