Setting up Inter Region AWS VPC Peering and Latency Tests

Most of our infrastructure and client facing services are in us-east-1 and we have lots of users connecting from different parts of the world including India. Of course there was a significant latency involved when users connect to US from other part of the world. And we wanted to test that, if a user from India connects to Mumbai region(faster handshake) and then that region uses VPC peering to us-east-1 to talk to other services. Here’s how it went:

Continue reading Setting up Inter Region AWS VPC Peering and Latency Tests

Resize EBS Root Volume of CentOS 6 AMI

So the other day I had to create a CentOS 6 AMI for HDP installation as it had Hue package available only for CentOS 6. I launched an instance with EBS attached of 10 GB with CentOS 6. Went on to create AMI out of it with EBS size of 100GB.

These all went good and I proceed with launching instances for HDP cluster (12 was the number of instances). Everything went good and installation was complete. Later only Ambari Server  started throwing warnings about disk space. Despite attaching a 100 GB EBS. Continue reading Resize EBS Root Volume of CentOS 6 AMI