Cloud Computing Info

Generate Your Keys

Now that you have chosen your instance, but before starting you actually start your instance, you need to generate your key pairs. The keypairs are SSH keypairs. A later post will explain SSH in greater detail but the keys come in a pair because there is both public and private components.

SSH is a Secure SHell. This is a command prompt like a DOS box or a telnet connection. However, unlike DOS and Telnet, it is very secure. The private key is the local machine’s secret password. The public key is shared to any host that the local machine will connect to.

Choose an AMI

Amazon, and Amazon clients, are providing a huge variation of machine images. The short story is that you can choose between MS-Windows, Linux and Sun Solaris for your OS. The real story is that it is a bit more complicated than that.

The real question is what applications do you plan to run and what expertise do you have on hand or plan to hire? A quick example is a database like MySQL. MySQL runs on various operating systems. If you have Windows expertise, you may want to stick with windows.

Choose Your Tool

When working with AWS, you have a choice of tools. You should try several tools and use the one that works best for your needs. Some tools are provided by Amazon and others are provided by third party developers. I cover seven tools in chapters that follow this one but that list is not a comprehensive list. It’s just the tools that I have used myself and that I know for a fact do work.

Some services are more programming tools that anything else. SQS is like that. It is a queuing service that you will plug into your applications.

AWS Security

Data Center Security

Amazon is a well known entity and works to provide an extremely secure environment for your applications ans your data. Amazon is pursuing Sabanes-Oxley certification (by an external auditing agency) and SAS-70 Type II certification.

Amazon does not broadcast the locations of their data centers and physical security is a top concern for them. They have military grade external protections. Physical access to Amazon data centers controlled by a two-factor authentication and only those Amazon employees with an actual need are ever given access.

Hardware access is provided only to those administrators who directly require it and they must use their own SSH keys to access bastion hosts (kind of like cloud overseers).

Sign Up For AWS

First things first, if you don’t have an Amazon.com account, go get one. If you do have one, you can use the one you already have. Amazon offers personal and corporate accounts. A person may have both accounts and can choose which to use when purchasing items.

It also may make sense that all employees have a business only account that uses their work email to log into the service. That way you never have an issue where purchases or billing can go to the wrong place.

Or, you may do like I have done in the past, put all expenses on a personal card and expense them back to the company.

Amazon DevPay

Amazon DevPay is an easy to use billing system for AWS developers. Build your cloud application, allow users to sign up and use your application and let Amazon bill them for you.

DevPay is “AWS-Aware” in that it ties into the billing of AWS services. Instead of a user having to sign up for AWS and be billed separately, you can add in the AWS costs to your costs and just bill the users directly.

DevPay is web based and uses Amazon Payments. The web interface allows you to register your application and set your pricing.

Using and Managing Amazon Web Services (AWS)

I personally believe that AWS is perfect for any development and testing environment. Regardless of how sensitive your data is, you can build your applications and test them in a cloud environment using bogus data.

For production environments, the choice is much harder. Does the country(ies) you operate in have strict privacy, or data on-shoring, laws that would be impact your applications? If you can easily offshore your applications, you can easily use cloud computing.

Does the area where you work have reliable infrastructure?

Mechanical Turk

Mechanical Turk is an odd service. It’s called an “on-demand workforce” or peopleware. For large tasks that need to be automated but also require human intelligence, Mechanical Turk is the tool.

One of the examples Amazon uses is if you have 1,000,000 (one million) images that need to be tagged and categorized, you can use Mechanical Turk to “hire” 10,000 employees. You get to pick what you will pay and only those “turks” who want the work will sign up.

Amazon picks up 10% (additive) to whatever you pay someone.

Amazon FWS

FWS is the Amazon Fulfillment Service.

CloudFront

Amazon CloudFront is Amazon’s Content Delivery Network (CDN). A CDN puts very large servers with high throughput at the edge of the network. That means that a CDN provider put cached data in multiple locations through out the network (internet). Requests for data are routed to a local server cache instead of the main server at a host. This improves performance, customer experience and possibly even costs (via lower bandwidth requirements).

An example would be a company that serves many pages to many users. Rather than have all of the pages stored in a central location and be accessed by many people all at once, the pages are distributed throughout the network and sit on many different servers.

Amazon Flexible Payments

Amazon Flexible Payments Service (FPS) is a set of web services that allow businesses or developers to bill users using the Amazon payment infrastructure (like a PayPal or Google Checkout). As a seller or a buyer, you can set limits on usage either globally or for specific senders and/or receivers. A gatekeeper component enforces the rules.

As a sender you can limit the number of transactions, transaction dates, dollar amounts, recipients and daily, weekly or monthly spending limits. Recipients can specify all of those and can specify allowable payment methods (credit card, bank transfer and amazon payments) and who pays the transaction fee.

One of the goals of FPS is to make micropayments effective and financially cost effective.

IBM offers a SaaS Specialty partner program that provides resources, technical enablement and marketing support to its partners. IBM also offers hardware, software and infrastructure technologies to help its Business Partners deliver secure and scaleable cloud services. In addition, Business Partners gain access to over 40 worldwide IBM Innovation Centers, providing them with technical support and expertise for helping them test, build and optimize cloud services based on open platforms.

Fortent is a global specialist in anti-money laundering and regulatory compliance. Since 1993 they have served 26 of the world’s 30 largest financial institutions.

InformationWeek has a good article, Behind The Storage Cloud. This article gives something of the plumbing behind the available storage in the cloud. Something they didn’t talk about in that article are the limitations I have been running into using the cloud.

For infrastructure providers like Google or Force.com, who are offering a PaaS (Platform as a Service), the storage is built into the application. If you chose them to develop your application, that works out fine. However, if you are looking for archiving or storage scaling (grow storage as you need it), it’s not so good.

Amazon offers a different kind of storage.