Infosys Ltd
|Azure Data Engineer
Houston, TX, US
Summary
As an Azure Data Engineer at Infosys Ltd, Sreekar designs, develops, and supports scalable Azure Databricks data processing workflows, transforming high-volume Oil & Gas datasets into trusted, analytics-ready data for ExxonMobil Global Services.
Highlights
Designed and developed scalable Azure Databricks workflows leveraging PySpark, Spark SQL, Python, and Delta Lake to transform high-volume Oil & Gas datasets into trusted, analytics-ready data.
Led end-to-end data archiving for 12 enterprise business applications, ensuring preservation of trusted historical datasets for business and compliance needs.
Integrated diverse data from multiple enterprise systems (Oracle, SQL Server, SAP, APIs, cloud sources) into the Azure Modern Data Platform, applying robust source-to-target mappings and transformation rules.
Implemented Bronze/Raw-to-Curated data processing patterns with Azure Databricks and Delta Lake, ensuring data quality through schema validation, datatype standardization, key checks, and deduplication across data layers.
Ensured data accuracy and completeness by performing comprehensive data profiling and reconciliation, including row-count comparisons, duplicate/null detection, key validation, and business-rule testing.