Amazon blames human error for cloud-service disruption

Started by walkstall, March 02, 2017, 07:36:54 PM

Previous topic - Next topic

walkstall

A politician thinks of the next election. A statesman, of the next generation.- James Freeman Clarke

Always remember "Feelings Aren't Facts."

Hoofer

The IT market is FLOODED with college educated idiots, who have migrated like lemmings to these data-centers... for $12hr jobs, most who couldn't get a low level clearance.

3 trips to one of them, 22hrs, to troubleshoot and "prove service good to the demark), ended with a smart mouth, 20-something, metro-sexual... no doubt a 2yr IT grad...  who just shoved uncleaned fibers into equipment ports.  Naturally, the problem has been "the provider needs to troubleshoot their gear."

The best thing that could have happened, finally did - live on a conference call, he got caught not cleaning fiber, and his companies' Network Support went nothing short of -crazy- on the phone.

For 3 weeks, this high-capacity, data-center's circuit has been bouncing & down, because this smart mouth punk didn't think cleaning fiber was important.  After he cleaned it properly, it came well into spec, and is passing traffic today.   That lesson *cost* over 2 years of his wages... just to "fix" - not including money was lost in down-time.  No, I'm not a jerk, I showed him how to properly clean, when I realized he didn't know...


I remind my kids, 'There will ALWAYS be a decent paying job, if you take the time to do it right.'

From what I'm seeing coming into these data-centers lately, I wouldn't upload ANYTHING to the "cloud" for safe-keeping, and certainly not ever assume "cloud computing" was cheap, reliable or fast.  (choose 2 of the 3...).
All animals are created equal; Some just take longer to cook.   Survival is keeping an eye on those around you...

taxed

#PureBlood #TrumpWon

Hoofer

These guys have no perspective of bandwidth vs customer service.

A T1 goes down, that's 1.544Meg - and the business is not-doing-business-at-all... end-of-the-world-as-they-know-it... they threaten to sue for lost business.
A 10Meg-100Meg pipe goes down, and they're perturbed... glad you're there, but at least you're not screamed & lectured for 5 min..
A 10Gig pipe is down for a month, yeah, that happens... I guess, usually something like cleaning fibers, occasionally an SFP/XFP fails.
A 100Gig pipe is down and nobody notices...  Yeah, the port was bouncing, CRC errors, dropping frames, and it's been down for a week, fibers weren't cleaned, the hot signal turned the manufacturing grease into tar, which ruined both fiber and SFP, beyond cleaning.  MEH.. it happens...

The SHTF is inversely proportional to the Bandwidth.   I simply do not understand.

Staffing seems to work the same way.
People who do the physical work on 10Gig-100Gig ... <$15hr.
People who work on T1 interfaces, >$30hr.

Maybe it's related to the difficulty of the job...  T1s actually require you know something to troubleshoot, testing can be a bear if it's a long circuit, lots of "hops" or segments.   
A 10Meg-100Meg complaint, latency or the customer is paying for 10Meg & getting 9.999999999Meg... (over-subscribing, meh, bites you in the butt everytime.)   
10Gig-100Gig, it's up-up or it's up-down or down-down... nobody measures bandwidth... I've seen stuff "pass" at 79% of rated capacity. (customer has no means of fully testing at that bandwidth).

...naturally, I like the big stuff, who wouldn't?... but like being paid like it's a T1.   The whole industry is being flooded with 2yr IT idiots who think like electricians.  (make the connection, and power flows).   They have ZERO understanding of what's going on, DWDM, framing, payload, error checking/correction, and mention DB anything, their eyes glaze over...  I dare not try to explain TDM or DWDM... They're totally clueless how a signal is generated, encapsulated, framed, transmitted, regenerated or received - unable to troubleshoot.
All animals are created equal; Some just take longer to cook.   Survival is keeping an eye on those around you...

taxed

I'm not entirely convinced about their explanation...  My spidey sense is tinglin'....  It is possible, but there's more to the story.  I don't believe that some tech made a boo-boo and took down the internets.
#PureBlood #TrumpWon

Solar

Quote from: taxed on March 06, 2017, 02:39:23 PM
I'm not entirely convinced about their explanation...  My spidey sense is tinglin'....  It is possible, but there's more to the story.  I don't believe that some tech made a boo-boo and took down the internets.
Official Trump Cult Member

#WWG1WGA

Q PATRIOT!!!