2017-12-15

You Know State Is NO Good

Every engineer learns this the hard way. You think the logic is solid, your tests are green, and your deployment goes smoothly. Looks all good, right? Then you have an outage. Not because the code is wrong, but because some tiny piece of state went rogue. A cache goes out of sync. A session refuses to expire. A queue forgets […]

In English 0 7 min read
2015-10-15

Local vs Production Debugging

I have been debugging this data workflow tool we built in house lately. It has an Angular UI and a Java backend, and it moves data between different systems like Postgres to Hive, Hive back to Postgres, Redshift, and a few other places. Debugging it locally is usually straightforward. I can run the job, watch the logs, and see where […]

In English 0 4 min read

Software Engineering Handbook

Categories

Designing Big Data Platforms

Recent Posts