SUMMARY

• Senior Data Engineer with around 15+ years of experience in building data - driven applications, enterprise data warehouse systems,
• Designing and implementing data pipelines for analytics applications in various industry domains like telecom and banking.
• Experienced in end-to-end delivery of Cloud, Big Data, and Enterprise Data Warehouse programs from solution design, development, implementation, and monitoring perspectives.
• Experience in designing, developing, and implementing data pipelines, data lakes, and data warehouses using relational databases, Snowflake and Databricks.
• Confidential ® Certified Advisory Project Manager, and Open Group® Certified Architect with strong background in relational databases, data warehousing, data modeling, and data management.
• Data pipelines design and implementation by leveraging services like Azure Databricks, PySpark, Azure Data Lake (ADLS Gen2), Azure Data Factory for data curation and transformation.
• Participation and contribution in Solution Design and Architecture for implementation of EDW, Cloud and Big data programs.
• Hands-on experience on project deliveries as outlined in the Scrum Agile framework using Jira for issues/tasks tracking, GitHub for version controlling / source code management and GitLab for source code management (SCM) and continuous integration (CI).
• Building prototype and proof of concepts in Databricks, SQL to assess the viability of the architecture and solution.
• Extensive working Experience with ETL (Extract Transform Load) tools and processes
• Extensive hands-on experience with relational Databases viz. Teradata, Oracle, and Netezza.
• Working understanding of Dimensional modeling and ETL tools like Confidential Infosphere DataStage.
• Hands-on experience on migration of applications from one database platform to another.
• Extensive experience in Operations, Administration and Maintenance of legacy Applications in Teradata, Oracle, and Netezza.
• Transparent communications about the status of the projects to the stakeholders, risks/issues identification/management/mitigation pertaining to the deliverables.

TECHNICAL SKILLS

• SQL
• Snowflake
• Azure Databricks
• Spark
• PySpark
• ETL
• Azure Data Factory
• Oracle
• Teradata
• Netezza
• IIAS ( Confidential Integrated System for Analytics)
• Neo4J
• Hortonworks Data Platform (HDP)
• Oracle Big data Appliance (Oracle BDA)
• Oracle BD SQL
• HDFS
• Hive
• UNIX shell scripting
• Confidential DataStage
• Jira
• Gitlab
• Project Management

PROFESSIONAL EXPERIENCE

Confidential

Data Engineer / ETL Architect

Responsibilities:

• Collaborate with EDAO application teams and architects to understand application requirements and architectural requirements respectively to design and build automation solution within the boundaries of defined architecture and tools.
• Development of project plan to implement ETL solution.
• Database and ETL Solution design
• Managing build phase to ensure requirements fulfillment adhering to architecture guidance.
• Developed and executed complex SQL queries for data analysis and reporting.
• Collaborated with the data modeling team to develop and review data models and metadata management solutions.

Environment: Control-M Automation API, Control-M, Snowflake, Confidential IGC (Infosphere Information Governance Catalog), DataStage

Lead Engineer

Confidential

Responsibilities:

• Contributing for the design and development of Universal Data Lake for group view (Data Federation Layer).
• Extract, Transform and Load data from source Systems to UDL using a combination of ETL tools.
• Development of end-to-end pipeline using a combination of ETL tools, Azure Data Factory, Azure Databricks for Maybank Group Risk Analytics applications to ensure availability of requisite data for Enterprise data warehouse applications and data science team.
• Working with Business Drivers, Business Owners and Product owners to understand the data need of the application and development of pipeline to make available requisite data.
• Working with Solution Architects to ensure viability of the architecture regarding pipeline development.
• Working with the Data management team to ensure timely development for the application data need; working with Business IT Owners and Business Drivers for the respective application to ensure timely execution of testing and the deployment of the application.

Environment: Oracle Big Data Appliance, Oracle BD SQL, Teradata, Databricks, Denodo, Azure ADF

Sr Data Engineer

Confidential

Responsibilities:

• EDW Data pipelines development and implementation
• Data provisioning for data scientist for ML model executions
• Development of pipelines, Linked services, Datasets using Azure Data Factory
• Data pipeline implementation using PySpark / ETL tools.
• Data Ingestion from heterogenous sources to various Azure Services like, Azure Data Lake, Azure blob Storage, Azure SQL DB), processing the data In Azure Databricks
• Leading data engineering team for development, acquisition and implementation of data sets using distributed technologies and tools like Databricks, Spark and as well traditional technologies
• Development, acquisition and implementation of data sets using tools like Databricks, Spark and ETL tools.
• Work with data modeler to review conceptual, logical and physical data models defining information requirements for data management and business intelligence purposes.
• Work closely with Technology SMEs across all Business Applications to design and implement the conceptual data model into a physical database
• Work with EDW admins and architect to define database architecture roadmap to support business and technical requirements, to assure reliability, availability, scalability, security and performance of EDW Systems.
• Functional and Technical Design reviews
• Reviews/ preparation of HLD and LLD
• Designing and development in databases like Teradata/Oracle/Netezza along with guiding the team for developing applications on technology platforms.
• Code reviews
• Confidential communication, Status meetings with Business Team, Risk analysis and Mitigation
• Design, Development and Implementation of workflows for various Confidential projects using Agile methodology by leveraging tools like Jira, GitHub, etc.

Environment: Spark SQL, Databricks, Azure Data Factory, Azure Synapse Analytics, Teradata, Confidential DataStage 9.1, Oracle 11G, Netezza 7, Confidential Cognos 10, Confidential BigInsights 3, Azure Cloud, PySpark, Azure Data Lake Gen2, Netezza

Solution Architect

Confidential

Responsibilities:

• Providing end-to-end solution for Network Performance management, activities ranging from Requirement gathering to testing and releasing the solution
• Interfacing with the Customer, Project Manager and solution integrators
• Responsible for Architecture, solution and Documentation for Implementers, Customer, Operations and Support
• Solution Manager for Bharti-Airtel Performance Management LCM (Life Cycle management)

Environment: Sybase IQ 15, ENIQ (Ericsson Network Performance Management tool), Sun Solaris

Technical Project Manager

Confidential

Responsibilities:

• Day to Day operations management
• 100% SLA adherence for meeting daily operational needs eg ETL jobs, daily dashboards.
• Various Daily and monthly Status reporting to Confidential management
• Ensuring timely resolution of all incidents
• Planning and Staffing the project

Environment: Teradata, UNIX Shell scripting

Project Manager

Confidential

Responsibilities:

• Prepare and maintain Project Plan. Execute project as per TechM BMS (Businsess Management System) processes and approved PP (Project Plan)
• Review of project receivables. Perform proactive risk management
• Establish the project organization and provide technical induction to all team members.
• Ensure that the resources are managed effectively and efficiently
• Monitor and report on project progress to management using status reports and PMR meetings
• Resolve or escalate all issues as per escalation plan
• Ensure acceptance of deliverables from the customer. Manage and facilitate communication related to the project with customer
• Liaise with support groups
• Submit project metrics to Quality Management Group (QMG). Participate in Audit Review meetings

Environment: Teradata, UNIX Shell scripting

System Analyst/Developer

Confidential

Responsibilities:

• Analysis of data requirements and translation of these requirements into dimensional data models.
• Writing program specifications, designing physical databases, and writing programs.
• Development and loading of master data and transaction data into the warehouse and failure resolution.
• Supporting of reporting stream's warehousing applications.

Environment: Oracle, UNIX Shell scripting