SUMMARY

• 8+ years of work experience in end to end implementation of Data Pipelines, Enterprise Data Warehouses, Operational Data Stores and Data Marts using a broad range of AWS Services, Cloud based Architecture, ETL, Reporting tools, Tableau, Database’s, Operating System’s, Scheduler’s And 2 years of Course work experience in developing individual Application projects.
• Software and Application development experience in Food & beverage Industry, Sports and Retail (Levy/E15), Banking, Asset & Wealth management, Investment, Finance (Northern Trust), Learning management ( Confidential ), Health Care domains (Astellas).
• Multifaceted Data Warehousing experience in Data Analysis, Design, Development and Testing of ETL, Data Modeling, Data Marts and Relational Database Management Systems.
• Hands on experience with Data migration from traditional database systems to Cloud based platforms.
• Proficient with S3, Athena, Glue, Cloud Formation, SNS and SQS and wide variety of AWS services, Python, PySpark, Pl/Sql, Sql and shell scripting programming.
• Masters and Bachelors in Computer Science Engineering.
• Java, UI, Configurations, Portlets and Web Application Development Experience.

TECHNICAL SKILLS

AWS: Services and Sources S3, Glue, AWS Cli, Data pipelines, Athena, Cloud Formation, Redshift, Cloud Watch, SQS, SNS, Airflow, Dynamo, Jupiter Notebook, ETL, Lambda, EC2, EMR, Docker.

ETL/Tools: Datastage v11.5, Informatica 9.1, SSIS, BI, Tableau, FastTrack, Metadata Analyzer, Database Mapping, Business Glossary, Information Analyzer, GitLab, Confluence, TFS, Jira.

Databases: Netezza, Oracle 10g/11/g/12c, SQL Server 2008 R2/2012/2014, Confidential DB2, MS Access, My Sql.

Schedulers: Control - M, Tidal, Zena, Tivoli Work Scheduler, Autosys, Job Scheduling/Monitoring.

Programming Languages: Java, C, Python, Sqsl, Pl/sql

Scripting: UNIX

Web Technologies: JSP, XML, XSL, HTML5, CSS3.

Expertise: Knowledge/Course work on AWS/Big data/Hadoop Hadoop, HDFS, Hive, Pig, Sqoop, Flume, Map Reduce, Horton Works, and Cloudera.

Methodologies: Scrum/Agile, SDLC, Waterfall.

PROFESSIONAL EXPERIENCE

Confidential

Responsibilities:

• Work on designing and developing data lakes from source to target end points.
• Develop, work and test on AWS big data services like S3, Glue, EC2, sage maker, dynamo, Redshift, Athena, Cloud Formation, Cloud Watch, SQS, SNS.
• Collaborate with reporting, analytics, and data science teams to understand data sources and develop AWS Cloud-based services, data pipelines and ETL programs.
• Experience with setting EMR Clusters, SNS, SQS, Cloud Formation Templates, Cloud Watch.
• Build efficient programs and test data flow with Spark, PySpark and Sql queries.
• Airflow and DAG's design using Python and bash scripting. AWS Glue transformations using spark functions.
• Experience on Python scripting and able to read and process Json data/ real time data.
• Created and worked on data logger requirements with business and provided the timelines and feedback.
• Automate the Code Development effort USING Generic jobs and shared contained for nearly 500 components.
• Work in a cross-disciplinary Agile team to develop, estimate, test, and maintain client applications, while collaborating with team members on product backlog grooming, sprint planning, execution, review, and retrospective.
• Work directly with business stakeholders to understand requirements and communicate progress.
• Participate in technical design meetings with business users, other developers and assist in defining the system overall architecture, data lakes and choosing technologies.
• Engage in software issues related to code quality, security, patterns and resolve on timely basis.
• Perform performance optimization and troubleshoot highly technical issues on own and with collaborate team efforts.
• Participate in back-end development practices, code reviews, tuning of code, improvements, balancing, usability and automation.
• Understand, provide solutions to clients and fix code defects, which are logged by business users. Make contributions to the product roadmap.
• Monitor file processing, SFTP servers, data pipeline performance and document infrastructure changes.

Confidential

Software Engineer Intern

Responsibilities:

• Learnt and explored the functionality of Web Application development and User Interface
• Achieved coding in SSIS data integration framework development involving ETL implementation, experienced basic and advanced transformation activities such as normalization, cleansing, aggregation, summarizing, and integration in complex ETL data.
• Involved in analysis and providing the test cases for data redundancy and integrating development across various environments using DataStage/SSIS/SSRS/DB2.
• Experience in Extracting, Transforming and Loading (ETL) data from Excel, Flat file, Oracle to MS SQL Server by using BCP utility, DTS and SSIS services. Expertise in enhancing and deploying the SSIS Packages from development server to production server.
• Excellent T-SQL development skills to write complex queries involving multiple tables, great ability to develop and maintain stored procedures, triggers, user defined functions.
• Knowledge on DB2 OLTP and OLAP databases in support of Product oriented architecture solutions.
• Extensively used Report Wizard, Report Builder and Report Manager for developing reports and deploying reports in SSRS.
• Expertise in report writing according to the business requirement in SSRS.
• Experience in Logical modeling using the Dimensional Modeling techniques such as Star Schema and Snow Flake Schema. Experience in creating multidimensional cubes using SSAS (SQL Server Analytical Services) and OLAP (Creating Cubes) including interfaces with BIDS.
• Monitored and Tuned MS SQL Server databases with tools like Index Tuning Wizard, SQL Profiler, and Windows Performance Monitor for optimal Performance.

Confidential

Software Engineer Intern

Responsibilities:

• Developed complex parallel and sequence jobs. Maintained data integrity at all data transformation levels. Handled Real time updates which are performed periodically.
• Responsible for all technical and system specifications documents for all ETL processes, performed unit testing on all developed components and developed Sequencer jobs, automation by Autosys and Unix scripts.
• Developed and migrated web application portals using Java, JSON (Spring Framework).
• Tested the Sequence jobs in all phases including system integrated testing and terminal testing. Provided test cases and handled the customer’s data across the job flow.
• Experience with Jira and TFS Version controller, Used Control-M scheduler and Autosys.
• Good Knowledge on Database, data and dimensional modelling concepts, ER Diagrams, fact-dimensional models and Normalization techniques.
• Experience in writing UNIX Shell scripts for file validations, automation of ETL process and job scheduling, monitoring using Autosys and director logs.