Archive

Archive for April, 2009

Using and Managing AWS – Part 2: Signup for AWS

April 30th, 2009 Lew No comments

Sign Up For AWS

First things first, if you don’t have an Amazon.com account, go get one. If you do have one, you can use the one you already have. Amazon offers personal and corporate accounts. A person may have both accounts and can choose which to use when purchasing items.

It also may make sense that all employees have a business only account that uses their work email to log into the service. That way you never have an issue where purchases or billing can go to the wrong place.

Or, you may do like I have done in the past, put all expenses on a personal card and expense them back to the company.

Click to continue reading “Using and Managing AWS – Part 2: Signup for AWS”

Amazon Web Services – Amazon DevPay

April 29th, 2009 Lew 2 comments

Amazon DevPay

Amazon DevPay is an easy to use billing system for AWS developers. Build your cloud application, allow users to sign up and use your application and let Amazon bill them for you.

DevPay is “AWS-Aware” in that it ties into the billing of AWS services. Instead of a user having to sign up for AWS and be billed separately, you can add in the AWS costs to your costs and just bill the users directly.

DevPay is web based and uses Amazon Payments. The web interface allows you to register your application and set your pricing.

Click to continue reading “Amazon Web Services – Amazon DevPay”

Using and Managing Amazon Web Services (AWS) – Part 1

April 28th, 2009 Lew No comments

Using and Managing Amazon Web Services (AWS)

I personally believe that AWS is perfect for any development and testing environment. Regardless of how sensitive your data is, you can build your applications and test them in a cloud environment using bogus data.

For production environments, the choice is much harder. Does the country(ies) you operate in have strict privacy, or data on-shoring, laws that would be impact your applications? If you can easily offshore your applications, you can easily use cloud computing.

Does the area where you work have reliable infrastructure?

Click to continue reading “Using and Managing Amazon Web Services (AWS) – Part 1″

Amazon Web Services – Mechanical Turk and Amazon FWS

April 24th, 2009 Lew No comments

Mechanical Turk

Mechanical Turk is an odd service. It’s called an “on-demand workforce” or peopleware. For large tasks that need to be automated but also require human intelligence, Mechanical Turk is the tool.

One of the examples Amazon uses is if you have 1,000,000 (one million) images that need to be tagged and categorized, you can use Mechanical Turk to “hire” 10,000 employees. You get to pick what you will pay and only those “turks” who want the work will sign up.

Amazon picks up 10% (additive) to whatever you pay someone.

Amazon FWS

FWS is the Amazon Fulfillment Service.

Click to continue reading “Amazon Web Services – Mechanical Turk and Amazon FWS”

Amazon Web Services – SimpleDB Overview

April 22nd, 2009 Lew 1 comment

SimpleDB

SimpleDB was Amazon’s first available (in beta) web service. It is a neat feature but it has its downsides. First, SimpleDB is not a relational database. It is a name/value key pair. For simple lookups, it is highly reliable and scalable. For anything more complicated, it falls apart.

SimpleDB is not ACID compliant and has not referential integrity. For that matter, it has not schemas, tables or relationships. Amazon says that it “eliminates the administrative burden of data modeling”. Some things make me say, “Hmmmmm.”

SimpleDB structures data somewhat like a spreadsheet. Think of columns across and values down.

Click to continue reading “Amazon Web Services – SimpleDB Overview”

Amazon Web Services – Amazon Flexible Payments

April 22nd, 2009 Lew No comments

Amazon Flexible Payments

Amazon Flexible Payments Service (FPS) is a set of web services that allow businesses or developers to bill users using the Amazon payment infrastructure (like a PayPal or Google Checkout). As a seller or a buyer, you can set limits on usage either globally or for specific senders and/or receivers. A gatekeeper component enforces the rules.

As a sender you can limit the number of transactions, transaction dates, dollar amounts, recipients and daily, weekly or monthly spending limits. Recipients can specify all of those and can specify allowable payment methods (credit card, bank transfer and amazon payments) and who pays the transaction fee.

One of the goals of FPS is to make micropayments effective and financially cost effective.

Click to continue reading “Amazon Web Services – Amazon Flexible Payments”

Amazon Web Services – CloudFront Overview

April 22nd, 2009 Lew 2 comments

CloudFront

Amazon CloudFront is Amazon’s Content Delivery Network (CDN). A CDN puts very large servers with high throughput at the edge of the network. That means that a CDN provider put cached data in multiple locations through out the network (internet). Requests for data are routed to a local server cache instead of the main server at a host. This improves performance, customer experience and possibly even costs (via lower bandwidth requirements).

An example would be a company that serves many pages to many users. Rather than have all of the pages stored in a central location and be accessed by many people all at once, the pages are distributed throughout the network and sit on many different servers.

Click to continue reading “Amazon Web Services – CloudFront Overview”

Amazon Web Services – Simple Queue Service (SQS) Overview

April 15th, 2009 Lew No comments

Simple Queue Service (SQS)

SQS is Amazon’s message queuing service. It works much like IBM’s MQ Series, JMS or Oracle AQ. Pop in a message and one or more recipients can pop it out. SQS is completely open so any internet connected computer can call a web service and add or remove a message.

Because SQS is API based, you can write an interface to it in the language of your choice. There are several free Java, Ruby and PHP interfaces available (that I know of) with more coming.

Click to continue reading “Amazon Web Services – Simple Queue Service (SQS) Overview”

Hey You! Get On My Cloud (for $20/month)!

April 10th, 2009 Lew No comments

I am a huge fan of Amazon EC2. It’s simple to use and very cheap. You can pick an existing machine image, fire it up and be on your way. If you add up the amount though, the cheapest machine image will cost you about $80 per month. How would you like to get something comparable (a developer style machine) for $20 per month?

Add in Rails, PHP, Java and even host based javascript support with SSH and SFTP access, root access and one button application deployment? All of this for about $0.65 per day? Yes, it’s true.

Click to continue reading “Hey You! Get On My Cloud (for $20/month)!”

Amazon Web Services EC2 – Part 6: Elastic Block Storage

April 8th, 2009 Lew No comments

Elastic Compute Cloud (EC2)

Elastic Block Storage (EBS)

For most of its life in beta, EC2 offered only two kinds of storage, AMI based transient storage and S3. The transient storage was mounted as a filesystem and S3 was used for backup. To save data during downtime for instances, data had to first be saved off to S3 and the instance brought down. When the instance was brought back up, data was restored from S3. It was a painful process.

Enter EBS, the Elastic Block Store.

Click to continue reading “Amazon Web Services EC2 – Part 6: Elastic Block Storage”

Amazon Web Services S3 – Part 3: Costs and SLA

April 6th, 2009 Lew No comments

Simple Storage Service (S3)

Cost

Storage is cheaper in the US than in Europe. If you are based in Europe, you may want to decide which is more important when getting or adding data: price or latency.

Storage

US per GB

Europe per GB

First 50TB/Month

$0.150

$0.180

Next 50TB/Month

$0.140

$0.170

Next 400TB/Month

$0.130

$0.160

Over 500TB/Month

$0.120

$0.150

Table 3: S3 Storage Costs

Data Transfer

US per GB

Europe per GB

Transfer Into S3

$0.100

$0.100

First 10TB Out of S3

$0.170

$0.170

Next 40TB Out of S3

$0.130

$0.130

Next 100TB Out of S3

$0.110

$0.110

Out over 150TB

$0.100

$0.100

Table 4: S3 Data Transfer Costs

Requests

US per 10000 Requests

Europe per 10000 Request

Put, Copy, List, Post

$0.01

$0.012

Delete (always free)

$0.00

$0.00

Get and all other requests

$0.01

$0.012

Table 5: S3 Request Costs

These prices are accurate as of the time of writing them.

Click to continue reading “Amazon Web Services S3 – Part 3: Costs and SLA”