Altaf Rupani, vice president of global strategic planning and architecture at Dow Jones, is on a mission to get the best out of new cloud computing architectures inside his company for all the usual reasons: reducing time to market on new apps and avoiding the capital cost of new hardware. In this interview, Rupani discusses his company’s private cloud roll out and the challenges it still faces working with service providers to get a hybrid cloud system up and running.
How long did it take to build your private cloud?
Rupani: About a year and half.
Why did you go this route versus tapping into readily available public cloud resources like Amazon Web Services?
Rupani: We don't use EC2 for business critical apps; the public cloud isn't ready for the enterprise, there needs to be more governance controls that cater to the enterprise.
Aren't these kinds of controls tough to build in a private cloud environment, too? Or can anybody at your company jump on your private cloud and provision services?
Rupani: Yes, you need to establish governance and rules and introduce rigor so that you are following role-based access controls, but this is easier to do today inside your own four walls.
Who has access to your private cloud?
Rupani: Developers, marketing folks, business analysts, people who are tech-savvy on the business side of the house… It is there for anyone that needs it.
Is there training involved, how do you get employees up and running, and what are the potential pitfalls?
Rupani: We have an on-boarding process; we enlighten and educate people on the portal. Otherwise you could shoot yourself in the foot if you let people on who don't know what they are doing. We leave it to the tech leads to spread the word. Otherwise you could have 400 virtual machines or 4,000 provisioned for 10 minutes of use.
What systems did you put in place to guard against that?
Rupani: You need to create an auto-approval process for certain groups of users. For example, developers can provision assets without as many hoops to jump through as other employees less familiar with the system. Our mobile development team can provision as many instances at a time as they need as this is a high priority job.
How large is your private cloud?
Rupani: All new instances are provisioned through our private cloud and we have 350 active instances, but this spikes up or down depending on workloads.
[He declined to say what percentage of Dow Jones' total server environment the private cloud represents, but it is likely less than 10% today.]
Do hardware choices, HP versus Dell for example, give you any advantage in your private cloud architecture?
Rupani: No. We use off-the-shelf hardware. Dell, HP, IBM -- it doesn't matter, we just need a service-level agreement (SLA) for response time, a de-dupe rate for storage etc… We created the framework for a resilient cloud first, then we picked vendors that met that criteria.
What software are you using for virtualization and automation?
Rupani: VMware and DynamicOps.
DynamicsOps is based on Microsoft technologies and uses the .NET framework. Does this mean you'll use Windows Azure for application development?
Rupani: I’m bound by NDAs. Get back to me in three months.
What applications are running in production on your private cloud today?
Rupani: Corporate applications, including back office stuff like SharePoint 2010, have been consolidated from five separate instances to one instance running on the private cloud. B2B apps on the cloud include DowJonesNews.com and our archive. B2C apps include WSJ.com, MarketWatch.com and Barron’s. All of these have some presence on the private cloud and are using it more and more.
What advantages have you seen so far?
Rupani: One of the biggest advantages is that we no longer need to spend so much money on transitional technology setups for new projects. It's a cost-avoidance strategy as we don't need net new assets. There's also a cost-efficiency advantage as we are getting better usage out of our existing servers. We tripled our average utilization to 35 to 40% per physical machine.
That still seems low. Why not 60 to 70% utilization?
Rupani: We leave headroom to account for peaks.
What about labor? Do you save costs there?
Rupani: Yes. Cloud instances are half the cost of physical instances including labor.
How many administrators maintain your private cloud?
Rupani: It's less than five.
What about hybrid cloud? Does that make sense for your company?
Rupani: We'd like to extend our internal private cloud to public cloud in a hybrid model, but we're still working on the SLAs and data residency mandates with public cloud providers to make that viable.
When will that happen?
Rupani: Before the end of the calendar year we'll be able to use hybrid; through APIs we will be able to plumb the providers' capacity behind our portal.
Give us an example of why that would be useful.
Rupani: Let's say there's an employee in Europe working on a big marketing launch, but there's no Dow Jones capacity there. The system will say here are the templates available for services and it's the same workflow and policies as internal services, but it launches on the public cloud. It federates with the enterprise.
What challenges have you faced in getting this hybrid model to work?
Rupani: When the provider is a black box it's not good; single sign-on and identity and access control is not easy to get done. The portal in the U.S. is just a façade; what you need is an access point for the consumer that is the shortest path, local to the U.K. if the person is in the U.K., not in the US. This requires bifurcation; directional DNS and load balancing that can intercept and redirect the user to the resource.
These are things that are common in serving Web pages today, but haven't been there for enterprise systems?
Are there other challenges with the hybrid model?
Rupani: Service providers had not envisaged the workflow we needed, so we are really pioneering this path; it takes a lot of trial and error.
Which service providers are you working with?
Rupani: I can’t say just yet. Get back to me in a few months, but it's the usual suspects.
How have your users responded to the private cloud?
Rupani: People are lining up to use it. The time-to-market for new apps is so much faster. Users are willing to pay more [for it] as they get their server before they come back from lunch instead of in three weeks. [That] is awesome from an application delivery standpoint.
What are your goals for the private cloud this year?
Rupani: To move more applications to it where appropriate and train all our users on it.
Jo Maitland is the Senior Executive Editor of SearchCloudComputing.com. Contact her at firstname.lastname@example.org.
Dig deeper on Building a hybrid cloud