Strategic and visionary Engineering leader with 18+ years of experience defining enterprise data engineering roadmaps and leading high-performing teams in complex financial and government environments. Proven track record in fostering an AI-first mindset by delivery of scalable ML/AI platforms and real-time event-driven architectures. Adept at leading high-performing cross-functional teams, with expertise in driving Engineering Excellence through DevSecOps automation, observability, and robust governance frameworks.
Overview
19
19
years of professional experience
1
1
Certification
Work History
Engineering Director
Deloitte Australia
04.2022 - Current
Define and evolve enterprise data roadmaps to shape GenAI and ML strategies, identifying high-value use cases in healthcare and insurance.
Orchestrated the migration of Hadoop workloads to GCP for a large government organisation, improving performance and reducing operational cost by 30%.
Regional lead on Google Cloud technologies, building AI/ML and data platforms.
Spearheaded the development of an ML/AI platform for document processing and underwriting, reducing the decision time by 20 - 30% for a leading insurance provider.
Engineered a real-time event bus for data streaming (Debezium, CDC) to Snowflake for a large gaming organisation, transforming their real-time analytics capabilities.
Achieved $300K+ in cost savings through a data insights platform for a beverage company.
Drove cloud transformation by implementing governance frameworks and maturity roadmaps across cost, security, and compliance.
Contributed to the enhancement & the build of AWS Glue Integration for SAP through regular cadence with the AWS team.
Principal Data Architect
Intellify Pvt Ltd
09.2021 - Current
Spearheaded the migration from legacy systems to Snowflake and Databricks, vastly enhancing analytics capabilities and data onboarding processes.
Built a high-performing team of architects and engineers, reducing delivery time by 40%.
Embedded SRE best practices, including observability, incident response frameworks, and operational runbooks across hybrid deployments.
Collaborated with partners on tool evaluations, delivering value and optimal solutions.
Produced SOWs and RFP responses, successfully securing new business and expanding client relationships.
Solutions Architect
Hortonworks (Cloudera)
11.2017 - 09.2021
Enabled faster decision-making with 20% cost reduction in operations by streamlining data lakes using Apache NiFi, Spark, Kafka, and Hadoop.
Engineered the cybersecurity (OpenMSS) platform for a major telecom, capable of handling billions of events in a day. Reducing incident response time by 40%.
Open Banking - Designed and implemented a low-latency solution capable of handling billions of records, ensuring reliable access to critical data.
Cloud Engineer
Amazon Web Services
04.2016 - 11.2017
Regional SME on HBase - Led client engagements on HBASE; Designed and optimised HBase environments, ensuring high throughput and low latency for critical applications.
Mentored AWS teams on diagnostics and performance improvements, significantly reducing response times.
Lead Tech Architect
Amex Big Data Labs
05.2014 - 03.2016
Directed a 6-member engineering team in developing and operating a highly available Hadoop data platform, achieving 15% faster data processing and $80K yearly cost reduction.
Created an enterprise-grade Nagios monitoring framework for Hadoop clusters; the solution was formally documented and published in my book.
Spearheaded global MapR Hadoop architecture and operations, enabling efficient, scalable, and highly available big-data platforms.
Tech Lead
Yahoo
04.2010 - 10.2013
Implemented and automated the enterprise Web Analytics (YWA) platform spanning 1,500+ servers, integrating Hadoop clusters, load balancers, and Apache HTTPD, resulting in 20% faster processing SLAs and 8 hrs/week reduction in operational effort.
Partnered with Apache Hadoop engineering teams to test releases and deliver feedback that drove enhancements into upstream Apache Hadoop.
Championed organisation-wide automation improvements, increasing platform scalability and operational maturity.
Systems Engineer
J.P. Morgan and HP (Hewlett-Packard)
02.2007 - 03.2010
Automated DNS and DHCP workflows, improving configuration accuracy and reducing operational effort by 1 day/week while managing a mission-critical environment of 1,600 domains and 800 servers spanning DNS, DHCP, Bluecoat Proxy, and Cisco GSS for a major banking client.
Mastered complex technology stacks (VAX/Alpha/OpenVMS/Storage Controllers), initiated a successful buddy program, and developed customer engagement skills while supporting critical systems across various industries like Banking, air traffic control, and stock exchange.
Education
MTech - Computer Security & Computer forensics
IIM Bangalore
B. E - Electronics and Communication
RMIT University
undefined
Nagpur University
Skills
Data Mesh
Enterprise Roadmaps
Snowflake
Databricks
GCP
AWS
Multi-Cloud
Azure
Cloudera
Hortonworks
Kafka
Hadoop
CI/CD
GitHub Actions
Jenkins
Terraform
Ansible
SRE
Observability
MySQL
Postgres
HBase
Database storage internals
Optimisations
Nagios
Ganglia
Prometheus
Brocade
MSA Controllers
NetApp Filers
EMC Isilon
Alluxio
Kerberos
SASL
Encryption
IAM
RBAC
Firewalls
IDP integrations
Governance frameworks
Certification
Google Certified Professional Data Engineer
Google Certified Professional Architect
Red Hat Certified Architect (RHCA)
Google Certified Professional Network Engineer
AWS Certified Architect & Developer
Databricks Certified Data Engineer|Developer
Microsoft Certified Administrator (MCSA)
Brocade Certified Fibre Storage Engineer
Hortonworks|Cloudera|Mapr Hadoop Certified
Cisco Certified Network Engineer (CCNA)
Personal Information
Citizenship: Australian Citizen
Visa Status: Australian Citizen
Education And Publishing
EGMP, IIM Bangalore
MTech (I.T), Computer Security & Computer forensics, RMIT University
B.E, Electronics and Communication, Nagpur University
Author of technical documentation/books on enterprise monitoring frameworks, demonstrating deep technical authority.