at Scale
Hi, I'm Shaurya, and here I write about my adventures with data, machine learning and software engineering.
Need Help with Your Data Platform?
I help engineering-led companies design, fix, and scale production data systems that are reliable and cost-efficient. As a Principal Engineer at a leading fintech, I bring real-world experience in building large-scale data platforms with Kafka, Spark, Snowflake, and cloud-native tools. Whether you need a data architecture audit, platform optimization, or fractional senior support—I offer focused, outcome-driven consulting grounded in production reality.
Principal Engineer • Production Data Systems • Real-World Experience
From data lakes to business insights and machine learning, I've worked on a variety of projects solving complex problems for the companies I've worked for.
Data Engineering
I've worked on a variety of projects moving data from various sources to data warehouses and data lakes.
Backend Engineering
I have experience building scalable and reliable backend systems in various programming languages.
Real-time analytics
I've designed and implemented real-time data processing pipelines that deliver instant insights from streaming data sources. This is the area I want to explore and learn more about.
Machine Learning & ML Ops
With some background in machine learning, I've worked on projects that involved building, deploying, and monitoring machine learning models in production.
Miscellaneous
Papers, toy projects and fun stuff.