Posts by Category

python

Debugging a Running Python Process

6 minute read

Only if it were as easy as installing debug symbols, attach the process with gdb and py-bt! So we have a python agent, which distributes files, running acros...

PyCon19 India: Let’s Hunt a Memory Leak

1 minute read

We faced a memory leak in production and I wrote about it in this blog post. A while back, I somewhere came across the open Call for Proposals for Pycon Indi...

Curious Case of Python 2 and Integers

6 minute read

In Detecting Memory Leak in Python, scenarios were shown where python does not release memory when we created a huge list and then explicitly deleted it. The...

Serverless Meets CI/CD

less than 1 minute read

I have been attending LSPE [Large Scale Production Engineering] Meetup for last two years. And for the last one, I decided to give it back to the community. ...

Detecting Memory Leak in Python

5 minute read

In production, a memory leak will not always bubble up. And there could be multiple reasons behind it. You may not be getting enough traffic. Frequent deploy...

TCP Fast Open: In Action with Python

3 minute read

Recently I was revisiting concepts of TCP protocol and that reminded me that there was also a thing called TCP Fast Open. Digging further on the same reveale...

Back to top ↑

AWS

Encrypt Existing AWS RDS : The GDPR Series

5 minute read

Last, and the most dreaded, comes the MySQL RDS. The most critical part of infrastructure which is responsible for auth, new sign-ups and other user related ...

Resize EBS Root Volume of CentOS 6 AMI

1 minute read

So the other day I had to create a CentOS 6 AMI for HDP installation as it had Hue package available only for CentOS 6. I launched an instance with EBS attac...

Back to top ↑

HBase

Upgrading Apache Phoenix in HDP Cluster

1 minute read

About new Hadoop cluster we set up, the phoenix version bundled with HDP distribution(4.7) had some bugs which would make it impossible to use to run BI quer...

Migrating OpenTSDB to Another HBase Cluster

2 minute read

As a part of migration from CDH cluster to HDP cluster, we also had to migrate OpenTSDB which was running on CDH cluster. There are many methods to copy/tran...

HBase Benchmarking

4 minute read

Currently I am working with new setup of Apache HBase cluster to query data using Phoenix  on top of HDP Distribution. After setting up cluster, the values f...

Back to top ↑

Linux

How to reconfigure Zynq-PL on-the-go?

less than 1 minute read

You would have wondered if i’s possible to reconfigure the PL part without any interruption while PS is running Linux. Well, i’s possible and as simple as,

Resize EBS Root Volume of CentOS 6 AMI

1 minute read

So the other day I had to create a CentOS 6 AMI for HDP installation as it had Hue package available only for CentOS 6. I launched an instance with EBS attac...

Debugging Stuck Process in Linux

2 minute read

The other day I faced a problem with monitoring setup and I found that the WebUI is not responding. I SSHed into server and checked if process is running. It...

Back to top ↑

FPGA

How to reconfigure Zynq-PL on-the-go?

less than 1 minute read

You would have wondered if i’s possible to reconfigure the PL part without any interruption while PS is running Linux. Well, i’s possible and as simple as,

Configure PS of PYNQ to work with SDK

14 minute read

Hi, If you’re an FPGA fan or someone who’s got PYNQ board for fun, you might be having a hard time making it run Vivado SDK projects. That’s because, the PY...

Back to top ↑

public speaking

PyCon19 India: Let’s Hunt a Memory Leak

1 minute read

We faced a memory leak in production and I wrote about it in this blog post. A while back, I somewhere came across the open Call for Proposals for Pycon Indi...

Serverless Meets CI/CD

less than 1 minute read

I have been attending LSPE [Large Scale Production Engineering] Meetup for last two years. And for the last one, I decided to give it back to the community. ...

Back to top ↑

Zynq

How to reconfigure Zynq-PL on-the-go?

less than 1 minute read

You would have wondered if i’s possible to reconfigure the PL part without any interruption while PS is running Linux. Well, i’s possible and as simple as,

Back to top ↑

HDP

Upgrading Apache Phoenix in HDP Cluster

1 minute read

About new Hadoop cluster we set up, the phoenix version bundled with HDP distribution(4.7) had some bugs which would make it impossible to use to run BI quer...

Back to top ↑

Networking

TCP Fast Open: In Action with Python

3 minute read

Recently I was revisiting concepts of TCP protocol and that reminded me that there was also a thing called TCP Fast Open. Digging further on the same reveale...

Back to top ↑

linux

Debugging a Running Python Process

6 minute read

Only if it were as easy as installing debug symbols, attach the process with gdb and py-bt! So we have a python agent, which distributes files, running acros...

Site Wide Memory Leak: An On-Call Story

3 minute read

This happened a while back, sometime in the year of 2017. I was on-call for the week and it was the weekend. Usually, things are quiet over the weekends but ...

Back to top ↑

aws

Serverless Meets CI/CD

less than 1 minute read

I have been attending LSPE [Large Scale Production Engineering] Meetup for last two years. And for the last one, I decided to give it back to the community. ...

Back to top ↑

golang

Golang Http Client and Compression

4 minute read

I had a very (seemingly) simple task. Verify my golang http client, talking with an ElasticSearch cluster, is compressing data on wire. Because in trials, th...

Back to top ↑