{"id":2810,"date":"2018-07-11T21:21:35","date_gmt":"2018-07-11T21:21:35","guid":{"rendered":"http:\/\/blog.paranoidprofessor.com\/?p=2810"},"modified":"2018-07-29T08:28:46","modified_gmt":"2018-07-29T08:28:46","slug":"aws-s3-and-simple-notifications","status":"publish","type":"post","link":"https:\/\/blog.paranoidprofessor.com\/index.php\/2018\/07\/11\/aws-s3-and-simple-notifications\/","title":{"rendered":"AWS – S3 and Simple Notifications"},"content":{"rendered":"

Individual Amazon web services are actually quite amazing all on their own but they are really neat when you start to use them together.<\/p>\n

There probably isn’t anyone who in their life hasn’t had a sdcard or hard disk fill up who just needed a small bit of extra space to complete their action.\u00a0 Of course in that situation in the real world you have to stop what you are doing and free up (ie delete something) so you can continue.<\/p>\n

Amazon S3 doesn’t have that problem.\u00a0 If you have the budget, you can keep adding data to it until you are satisfied you are finished.\u00a0 Sure you have to keep on eye on the costs but that is a completely separate issue.<\/p>\n

However, it isn’t any one service that makes AWS so cool as much as how they all seem work together.\u00a0 One such example of that is the ability to send notifications based on some event that has occurred.\u00a0 This might be an event you setup to monitor your costs or it might be used as a trigger to an application.<\/p>\n

In my case, I am going to demonstrate an email notification going out if a file ends up in a S3 bucket.\u00a0 If you were some sort of picture site, this might instead be triggering a lambda function to create thumbnails or perhaps this information might be put into a queue for some other processing (or both).<\/p>\n

In my previous article,\u00a0AWS – Simple Notification Service,\u00a0I discussed everything that needs to be done in order to setup a Simple Notification Service topic but in this blog entry I will actually use put the AWS SNS to use.<\/p>\n

In addition to sending out messages, I will also add replication to a s3 bucket.\u00a0 This will provide a cool way to put data into one bucket and watch it being replicated to the second bucket.\u00a0 This replication is pretty much as the name says.\u00a0 If you add data to the source bucket, it will be added to the destination bucket but if you delete it from the source bucket it will also be deleted from the destination bucket.<\/p>\n

Replication<\/h2>\n

The replication is actually quite simple. The setup is essentially from where do you want to copy what, and where should it be placed.\u00a0 Replication setup is available from the management tab on the bucket.<\/p>\n

\"\"

source<\/p><\/div>\n

It is also possible, actually recommended that you check the checkbox to encrypt the objects that are replicated.<\/p>\n

\"\"

Destination<\/p><\/div>\n

The replicated box must be in another region.\u00a0 It is also possible to change the storage class in the destination.\u00a0 By selecting a class with a different type it may be possible to reduce the cost of the storage in this additional location.<\/p>\n

\"\"

Permissions<\/p><\/div>\n

I did not create this IAM rule, nor name myself – I had it created for me.\u00a0 This is necessary in order to allow the proper read and writing for these two S3 buckets.<\/p>\n

\"\"

Review<\/p><\/div>\n

Once the replication setup has been saved then new data that is saved or deleted from the source bucket will be replicated a short while later in the destination bucket.<\/p>\n

Notifications<\/h2>\n

The actual notifications on the S3 bucket are trivial to setup.\u00a0 Simply go to the properties of the bucket and setup an “event”.<\/p>\n

\"\"

Delete event setup<\/p><\/div>\n

It is possible to be notified depending on which type of action occurred, ranging from simple create or even just simple HTTP commands.<\/p>\n

However, it might not be quite that simple as it appears on first look.<\/p>\n

\"\"<\/p>\n

You might get an error if the permissions are not properly setup in the simple notification service.<\/p>\n

\"\"

Original notification setup<\/p><\/div>\n

 <\/p>\n

\"\"

Proper – notification setup<\/p><\/div>\n

Once you setup the proper permissions in the simple notification setup you can then create and save other rules as long as they do not overlap in functionality (ie two different types of create)<\/p>\n

\"\"

create event setup<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

Individual Amazon web services are actually quite amazing all on their own but they are really neat when you start to use them together. There probably isn’t anyone who in their life hasn’t had a sdcard or hard disk fill … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[95,90,85],"_links":{"self":[{"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/posts\/2810"}],"collection":[{"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/comments?post=2810"}],"version-history":[{"count":8,"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/posts\/2810\/revisions"}],"predecessor-version":[{"id":2832,"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/posts\/2810\/revisions\/2832"}],"wp:attachment":[{"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/media?parent=2810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/categories?post=2810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.paranoidprofessor.com\/index.php\/wp-json\/wp\/v2\/tags?post=2810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}