Ross Mason on Thursday, January 20, 2011

System Admins. R.I.P.?

33

The advent of the cloud has brought a wave of changes in IT from the way we provision servers to the applications we use. At MuleSoft Google Apps provides email and office productivity services, Salesforce provide us with sales, support and product tracking, Marketo provides our marketing automation services and Atlassian gives us issue tracking and development productivity tools. All of these applications are hosted by our services providers, so what does our trusty sys admin do? Well, we will always need application infrastructure right…


A couple of years ago building an application meant building the infrastructure to support the application. Typically this entailed installing a database, an app server and often a messaging server and email server. All tedious preamble for actually building an application. Now you have free access to these infrastructure pieces on the web – yay cloud!

Database

As NoSQL providers gain widespread adoption some are now offering hosted versions making it super easy to add storage capabilities to your weekend application. Typically NoSQL datastores are easy to set up, but now there are a few free hosted solutions, making it even easier to get started.

MongoHQ – fully featured document- based storage.  no fuss.

CouchOne – Hosted CouchDB.  Couch is pretty interesting as it has a mobile storage offering too.

Filesystem

The daddy of cloud infrastructure services, AWS have offered S3 for a few years, complete with zoning for more efficient data access, but there are others gaining popularity.

Cloud Files – from Rackspace, this service seems to be a very similar offering to Amazon S3.

Cloud Storage – from GoGrid offers mountable storage with a REST API.

Cloud Layer Storage – from SoftLayer offers simple storage for a variety of of clients and CDN support.

Also, there are options like DropBox and Box.net which are more consumer focused but have REST/SOAP APIs also.

Messaging

This category is set to get interesting this year. Amazon led the charge here with SQS (Simple Queue Service) . While SQS falls short for anyone coming with enterprise messaging expectations it is ok for casual messaging. Now there are more interesting options.

PubNub – super simple and super fast, is becoming the messaging service of choice for gaming, thanks to it’s impressive high throughput and low latency. It has huge potential outside of gaming too.

Amazon SNS – Amazon Simple Notification Service is a pub sub messaging system that compliments the AWS SQS service. Amazon SNS seems aimed at casual notifications that can be published over different channels such as email or HTTP.

Email

Postmark – is a really easy way to create virtual SMTP servers that have a simple REST API. The advantages of this may not seem obvious since you can set up a Gmail account and send mail till your hearts content. But postmark offers a REST API (anyone that has used JavaMail will appreciate this) as well as an SMTP interface and the service provides delivery monitoring (good for transactional processing) reverse DNS, whitelisting and more.

With all this infrastructure available to developers with a few clicks, I wonder what our system administrators will spend their time on?

*I have definitely missed some providers here.  Please add anything you think I should have covered in the comments.

Follow: @rossmason@mulejockey

No related posts.


33 Responses to “System Admins. R.I.P.?”

David Dossot January 20th, 2011, 4:01 pm

I’d like to add:

- Xeround, the up and coming MySQL in the clouds: http://xeround.com/
- Hoptoad, awesome error management console: http://hoptoadapp.com/
- Loggly, logging as a service: http://www.loggly.com/
- Scout, monitoring in the clouds: https://scoutapp.com/
- Twilio, awesome Saas for communicative applications: http://www.twilio.com/

Frank January 24th, 2011, 5:27 pm

The major ones to add would be services like Heroku, NodeJitsu, and AppHarbour.

anon January 24th, 2011, 5:36 pm

I wonder… who manages the Cloud? SYS ADMINS.

Ryan January 24th, 2011, 6:08 pm

I have to agree with anon. In certain situations you are correct, it only takes a few minutes to setup a fully functioning business. In some cases (with rightscale or similar) everything may be automated. I think most companies right now can’t use document databases (nosql), so you still have database maintenance t deal with. Also backup is much more then having yesterday’s server image.

Then there is the dns, the server monitoring, the daemon monitoring, I happen to have a VPN nightmare to deal with.

Our company currently doesn’t have a sys admin because we are on the cloud and have no servers. So what has ended up happening is I have to deal with all of the cloud system administration headaches.

Anonymous January 24th, 2011, 6:11 pm

sysadmins run all those services you are talking about… and the margins are huge

teadict January 24th, 2011, 6:23 pm

Exactly what anon said.

anon January 24th, 2011, 6:31 pm

lol, the sys admins will be waiting for all the cloud computing to migrate back in house (at great cost to the businesses) once it is realized how poor the current cloud technologies are.

just wait until amazon ec2 ip blocks are blackholed by all major isps due to the rampant abuse from their nets.

enjoy this bubble while it lasts.

aaron January 24th, 2011, 6:32 pm

this article has no grounds and makes no sense. you are a moron. first commenter is right. Who will manage your “cloud”? I sure hope you don’t manage anything. asshat.

Anonymous January 24th, 2011, 6:58 pm

I have to laugh, to think that most companies of any noticible size could get away with the list of things you have provided here is laughable, there is almost always glue script to hook between most infrastructure components.
As an example, what manages accounts between
Google Apps, Marketo, Sales Force and Atlassian….oh right manually…thats awesome for about 5 people.

I could go on and on about other aspects of how flawed this logic is but i wont.

In short cloud services have their place but its definitely not a replacement in most situations.

Art Taylor January 24th, 2011, 7:11 pm

We’re deploying a new outsourced infrastructure and finding that the system and network admin skill set is wanting. Every network related problem is being “bumped up to Cisco” and everything hardware related either takes our service vendor days/weeks/months to resolve, often via “change all the tires and see if the engine will start” methods, or we end up having to resolve it ourselves. Tasks that we’ve taken for granted before (firewalls between tiers, VPN setup, cluster interconnects, SAN configuration) seem to be extremely fault-prone and often result in outages elsewhere due to ham-handed change control and lack of professional responsibility.

I think the sysadmins _have_ died and moved on and we’re left, for the most part, with inadequate substitutes. I don’t know if it’s going to get worse or better. Someone has to do the work, as the abstractions are still very brittle. Unfortunately, while paying to make it SEP (Someone Else’s Problem), it bounces back to our application development and release engineering teams.

Martin January 24th, 2011, 7:12 pm

rsync.net is a great filesystem provider that ticks a lot of boxes: rsync-over-ssh “API”, geo-redundant, developer-friendly, clueful.

cereal_bars January 24th, 2011, 7:19 pm

As “anon” said: the sysadmin will manage the cloud. That’s my job right now :)

cheers! great post :)

Barry January 24th, 2011, 7:37 pm

You *could* send emails through Google Apps, but they have a rate limit, and it’s in the low hundreds per hour, so PostMark is a much better solution. And PostMark gives you feedback on bounces, etc.

Mongo January 24th, 2011, 8:10 pm

MongoDB requires a priest.

Kris January 24th, 2011, 8:26 pm

Any company that uses the cloud, to me, is stating they don’t care at all for the privacy and security of their customers information.

Ken Robertson January 24th, 2011, 9:08 pm

The definition of what sysadmins are doing is changing, but they won’t go away. You find more and more “devops” type roles.

They often become important when you reach the threshold where the convenient hosted services are no longer scalable in terms of cost or the lack of visibility. They are leaned upon for the knowledge of how what the app does impacts the system and the limits it can run up against.

One problem with some of these hosted services is the lockin you get from the convenience. I’d had to migrate out of several of these types of services and it is frustrating to undo the lockin they produce.

Ross Mason January 24th, 2011, 9:32 pm

Frank, I was saving the app platform for another post. But yes agree that less and less infrastructures needs to be managed in house

Anonymous January 24th, 2011, 9:33 pm

I think you have confused R.I.P. with outsourced.

Ross Mason January 24th, 2011, 9:41 pm

Kris, I assume you are against SalesForce then?

Ross Mason January 24th, 2011, 9:44 pm

Art and Ryan, good points. I can see one problem with cloud services is that you delay the need to get in house help for everything else and operate by shoving problems around without ownership

Brendan January 24th, 2011, 9:47 pm

I completely agree here Kris, most cloud type places pretty much have a ‘we take no responsibility’ clause in their terms and conditions.

Justin January 24th, 2011, 9:55 pm

I think the real thing working against the cloud is the stability of your connection to the outside world. If you’re in midtown Manhattan, you’d probably be fine. But where I’ve worked as a system admin, in suburban areas where the ISPs available are residential providers first-and-foremost and business customers are secondary, I don’t think our IT office nor the president of the company could trust the cloud at this point.

Could a company go all cloud at some point? Of course. But I’m not sure that infrastructure (and as others have said, integration) are fully there yet.

Anonymous January 24th, 2011, 9:59 pm

There’s always going to be asshole who puts up roadblocks and eats away at everyone’s productivity. Just look at what Amazon demonstrated with wikileaks.

The BOFH is far from dead.

Toby Champion January 24th, 2011, 10:55 pm

Typo: compliments should be complements.

SunnyKB January 24th, 2011, 11:05 pm

Cloud has helped sysadmins.. Samething can be said for software like Mule. With many frameworks integrating REST and other middleware components, why does one need software like Mule?

cyberbofh January 25th, 2011, 12:12 am

System Admins. R.I.P.?
Of course not, sysadmins are only evolving into something new and better.. cyberbofhs ! ;)
They will be more cyberspace oriented, but still sysadmins are needed, because who else will make it work?

Also, a lot of people forget that “the cloud” is _not_ holy grail of all IT solutions!

anonandonandon January 25th, 2011, 7:57 am

I’m a sysadmin using EC2 to deploy and support SaaS and PaaS solutions. The ‘cloud’ doesn’t eradicate the sysadmin- it is only evolving the set of tasks a sysadmin does.

anon January 25th, 2011, 10:04 am

Good luck letting your users solve latency/performance problems between all apps. I guess they’ll get used to “damn! the internet is slow today isn’t it? let’s have coffee and wait since we don’t have a sysadmin and the service provider guys are as clueless as us” kind of things.

anonlove January 25th, 2011, 10:13 am

You know what’s worse? The same clueness when it comes to complexity that this article expects users/companies to have… is probably being used withint by SaaS providers to choose other providers that they will outsource some pieces too. So if the service you hired from a given provider is slow today he’ll blame on another provider and show you how the contract provides no guarantees. It’s the same mentality over and over.

Ryan Miller January 27th, 2011, 3:36 pm

a) what everybody else said–I’m a devops sysadmin working for a big web company, and it’s painfully hard to hire, so I doubt the jobs are going anywhere.

b) Mongo: as a part-time mysql priest, I can tell you that sql and nosql both require sacrifices way beyond schema.

Jamie May 13th, 2011, 10:28 am

Also,

There’s no cloud access to a laptop sitting in an airplane. Though granted it’s getting better, and there are ways of getting stuff offline. It still depends entirely on being connected 24/7.

Jamie May 13th, 2011, 10:30 am

One more comment, perhaps the sysadmins aren’t managing “systems” anymore, they are managing integration, but then a system can be one machine, multiple machines, or an abstraction that means a bunch of moving parts. Administrating that system will never be dead.

Leave a Comment