Posts/Projects

Let’s say you have a group of users that are sent notifications, every time a new user is added you likely need to reconfigure your alerts and add them. Thanks to the power of SNS all you need to do is create your SNS notification and then people simply subscribe to that SNS notification, it…

SQS FIFO, first in first out, is an alternative to the standard queue option. It ensures that messages are received in exactly the order they were sent in and supports exactly-once processing by automatically removing duplicates. You do get slightly lower throughput with 300 msg/s without batching and 300 msg/s with. The queue name must…

When a consumer pulls from the SQS queue by default there is a 30 second window where the message is invisible to all other consumers while this message is being processed to avoid duplicate requests, an API call is needed to extend this time from the consumer, you can change the default window time. Yes…

SQS is a powerful service that is one of AWS’s oldest offerings. It allows for you to decouple applications like I mentioned in my last post. In SQS you have your producers who create this data and send it into the queue and your consumers who request data from the queue. The queue can have…

I plan to go into more detail in my next few post in this post I would just like to give a broad explanation. In AWS inevitably your applications will likely talk to each out. With synchronous communication they talk directly to each other and with asynchronous there’s a queue between the two applications. If…

DataSync allows for you to sync data on-prem into S3, EFS, or FSx or from one AWS storage solution to another. The key takeaway being you have the ability to preserve file permissions and metadata for example in SMB and NFS. This replication is not continuous and occurs and schedule times, hourly, daily, etc. An…

The storage gateway is essentially how AWS is able to sync you cloud storage with your on-prem storage. There are multiple types of storage gateways. First off we have the S3 storage gateway, this allows you to access the gateway via SMB and NFS and it appears like a network drive the gateway itself communicates…

FSx is very similar to RDS the major difference being that it allows you to deploy and manage 3rd party file systems. These include NetApp On Tap, Windows File System, Lustre file system, and OpenZFS. Windows allows you to integrate AD into your file system and has daily backups to S3. It utilizes SMB and…

Yes you read that right, sending data physically in the mail. Let me elaborate, if you need to move several TB or even PB of data depending on the speed of your network that can take weeks, you may not have weeks. What the AWS snow family offers is the ability to send your data…

In a lot of cases you will have users accessing your application from all over the world, your application may only be deployed in Europe and users in India will have to go through several hops to get there. This is where Global Accelerator comes in. This service utilizes anycast IP, several edge locations all…