One of my readers sent me an interestingly sad story as a response to my importance of fundamentals rant. Here it is… enjoy ;)
2017-01-14: Updated with a different viewpoint
I've been at a new job for about 3 months now, in charge of the somewhat neglected network and am finally getting to the point where I ask my colleagues, "Does anyone know why I sometimes get a useless IP address from some other DHCP server on the Ethernet connection on my laptop here in the office?"
"Oh, yeah, that happens to other people sometimes." Followed by dead silence and no exhibited curiosity or desire to fix the problem.
A bit of time rummaging in forwarding tables and looking at DHCP traffic with tcpdump, and I found that someone decided that bridging the Ethernet and WiFi networks on a teeny computer in a conference room that's used to drive the big, mobile display would be a good idea. Have to ask him what problem he felt he was solving and why he has that much faith in spanning-tree.
To make things more interesting, there are multiple such mobile display workstations, and I rather suspect that if more than one of them is plugged into Ethernet at the same time, we depend very heavily on spanning-tree to keep our network running.
So in my opinion there’s another even more fundamental job attribute: a sense of curiosity about why odd and less than wonderful things are happening. That you should know how to interpret traffic in tcpdump/wireshark is right up there too.
And here's a sad view from another perspective (also kept anonymous for obvious reasons):
I know from experience, most (skilled) techs have a will to create elegant and working long-tem solutions. What is elegant is different from tech to tech, though.
In Germany there's a great deal of work consolidation happening for years. At least in IT. This means, whenever someone leaves the company for whatever reason, his work will be allotted to coworkers. This goes on until an boss-accepted equilibrium of work quality, backlog and employee-cost is reached. Complaints about too much work will be patiently listened to. The answers are usually, "you need to better organize yourself" or "delegate more". But you don't get more hands and heads to not only get the work done but get a chance to innovate though automation, which also lowers human-induced errors.
Since no one likes to be fired, people work like mad to keep up with the all-time present and pressing backlog by just trying to keep up with the demands. Perhaps as a challenge. The overloaded techs try to make the right compromises between more backlog vs. more botching (but at least can pretend to get things done) and so a fragile house of cards is built in months and years. I'm still awaiting what happens first: Big IT bangs everywhere when the cardhouses crash. Or companies will increasingly fast running out of knowledgeable employees because everyone suffers from psychological illnesses from such an environment.
Not every company enslaves their staff like that but a general direction is visible according to statistics from health insurance companies.
Here's another one from a LinkedIn comment:
A while ago, I needed to fill one slot within my team. Got lots of nice CVs, but only one guy out of 6 was able to explain me what is an ICMP Redirect. Some people who have configured one IP interface in the area 0 think they suddenly become OSPF experts.
Based on my experience:
- You cannot develop your skills in switching/routing if you don't look closer at the packet flows
- You cannot conclude something doesn't work if you don't know how it really works ;-)
- As I often repeat to my Engineers, a problem description starts with:
Notice the last question... It usually reflects the expertise of the Engineer who is escalating :-)
- What did you do?
- What did you see?
- What did you expect to see?
Finally, if you need even more depressing thoughts read this.