About Me

Principal Data Engineer & Consultant

Shaurya Profile

Connect with me

About Me

I'm Shaurya—a Principal Data Engineer with over 15 years of experience designing and operating production data systems at scale. I currently work at a leading fintech, where I architect large-scale streaming and analytics platforms under real-world constraints.

Throughout my career, I've built robust data infrastructure for companies like HelloFresh, SAP, Red Bull, and New Work— spanning event-driven architectures, real-time analytics pipelines, and cloud-native data platforms serving millions of events daily.

My deep expertise covers Kafka, Spark, Snowflake, BigQuery, Python, Java, Scala, and cloud platforms (AWS & GCP). I specialize in high-throughput real-time analytics, data architecture, and cost-efficient platform design.

I've contributed to open-source projects including Apache Hudi, Feast Feature Store, and Open Metadata, and have published research on natural language processing and machine learning.

Through Unskew Data, I bring the same principal-level rigor and hands-on execution to startups and fintechs that need senior expertise without building it all internally.

Specializations

Kafka & StreamingSpark & Batch ProcessingSnowflake & BigQueryReal-Time AnalyticsData ArchitectureCloud Cost OptimizationMLOps & Feature StoresData Platform Design
Companies
I've worked with

I've contributed to diverse and complex projects in startups as well as enterprises.

hellofresh
redbull
sap
voicemod
rakuten-tv
time2play
new-work