SUMMARY

• Over 15 years of IT experience in various technologies including Oracle, SQL Server, ETL, Data warehouse, Information security and Hadoop ecosystem, Spark, NoSQL, AWS ecosystem
• Knowledge of Hadoop architecture and components such as HDFS, YARN, Job Tracker, Task Tracker, NameNode, Data Node, Resource Manager, Node Manager and MapReduce.
• Experience on Apache Hadoop technologies Hadoop distributed file system (HDFS), MapReduce framework, YARN, Pig, Hive, Spark and Sqoop.
• Experience in designing applications on AWS Infrastructure.
• Thorough understanding of Hadoop Administration and Cluster Setup.
• Thorough understanding and exposure in all phases of System development lifecycle, from gathering requirements to testing, implementation, and support.
• Experienced in Analysis, Design, Development and Maintenance of various projects.
• Possesses exposure in reviewing & mapping the functional/business requirement documents and developing new applications
• Hands on experience in writing Batch Jobs, ETL jobs using SSIS and Apache Spark.
• Designing, Maintaining and Tuning SQL Server and Oracle Database Objects and Queries.
• Experience in taking requirement & preparing Functional & Design Specification
• Experience in writing Data extract/Load, File transfer, Archive & Batch Process script in Perl, Spark using Python.
• Experience in working collaboratively with Customers to resolve technical issues. This includes effective oral and written communication in the customer’s frame of reference
• Ability to work independently as well as collaboratively in team environment to contribute problem - solving strategies. At ease in interacting with people at all levels, able to work under pressure.
• Excellent interpersonal, analytical, communication and detail oriented organizational skills.

TECHNICAL SKILLS

Databases: Oracle, SQL Server, Sql Server Analysis Services, MongoDB.

AWS Ecosystem: Redshift, DynamoDB, Athena, QuickSight, ElasticSearch, VPC, Route53, EMR.

Hadoop Ecosystem: Administration, Architecture, Development, HDFS, MapReduce, Hive, Pig, Spark, Sqoop.

Languages: SQL, PL/SQL, Perl, Shell, JAVA, Python, Scala, R.

ETL Tools: Informatica Power center, SSIS, Spark.

Visualization Tools: Tableau, MS Power BI, AWS QuickSight.

Other Software: TOAD, SVN (Subversion versioning tool), Git, PL/SQL Developer, Visio, Eclipse, Data Science (Machine Learning using Python & R)

PROFESSIONAL EXPERIENCE

Data Engineer

Confidential, VA

Responsibilities:

• Performing data analytics on Pharmacy, DME and Inpatient claims data for ND and MO RAC.
• Analyze and Evaluate Existing Architecture and Design and Configure Network architectures on AWS Cloud.
• Installing configuration and maintenance Ec2 instances to host applications.
• Analyzing product requirements with the dev team, build cost effective, high available and scalable cloud infrastructure to house and secure the product.
• Setting up Hadoop Cluster and maintaining the cluster.
• Importing huge text files of medical claims into HDFS using Sqoop.
• Writing queries to process claims to prepare them for next level of analysis.
• Running analysis on prepared claims using Hive.
• Creating various data models to create different extracts for potential outliers.
• Developing various ETL extracts and processes in RAC Analytics in OLTP and OLAP Database.
• Studying requirement & preparing Detailed Functional Specifications & Design Specification
• Estimating work effort and work schedules for development and maintenance activities
• Coordinating with internal departments to provide associated deliverables required for the successful completion of development and maintenance assignments
• Analyze the data and provide fixes or suggestions to improve the performance
• Designing of the ERD (Entity Relationship Diagram)
• Writing ETL Scripts for generating various ETL Extracts
• Working with business analysts, development groups in analyzing business specifications.
• Preparation of Unit Test Cases
• Writing Stored Procedures in SQL Server.
• Mainly used SQL Server, SSIS to perform ETL work.

Data Integration Lead

Confidential, Richmond, VA

Responsibilities:

• Formed a team that successfully pushed for major changes to the product. These changes resulted in improved usability and three times faster performance
• Managed the group, which develops all product features. Planned the development schedule for two major releases. Heavily involved in recruitment and hiring.
• Developing various ETL extracts and processes in Rx application in OLTP Database.
• Interaction with client’s design authority team
• Studying requirement & preparing Detailed Functional Specifications & Design Specification
• Estimating work effort and work schedules for development and maintenance activities
• Coordinating with internal departments to provide associated deliverables required for the successful completion of development and maintenance assignments
• Analyze the data and provide fixes or suggestions to improve the performance
• Designing of the ERD (Entity Relationship Diagram)
• Perform QA and Code reviews
• Tuning Rx application and Long running ETL extracts for performance enhancements
• Writing ETL Scripts for generating various ETL Extracts
• Writing Perl Scripts for batch processes.
• Writing Data extract, Data Load, Automated File transfer, Archive, FTP & ZIP scripts in Perl.
• Working with business analysts, development groups in analyzing business specifications and in Working with other testers to resolve technical and end-user issues.
• Development of Pl/SQL Procedures, Functions and Packages for batch processing using TOAD & PL/SQL Developer
• Preparation of Unit Test Cases
• Monitor, tune and analyze db performance and allocate server resources to achieve optimum db performance.

Confidential, Roanoke, VA

Responsibilities:

• Study of requirement documents
• Preparation of Detailed Functional Specifications and Detailed Design Specification
• Development of Pl/SQL Procedures, Functions and Packages
• Used DBMS SQL for generating dynamic queries.
• Writing Perl Scripts for batch processes.
• Writing Process automation scripts in Perl.
• Preparation of Unit Test Cases
• Execution of Unit Test Cases, bug reporting and bug tracking
• Maintaining various versions of code using source code control system SVN

Senior Software Engineer

Confidential

Responsibilities:

• Study of requirement documents
• Designing of the ERD (Entity Relationship Diagram)
• Preparation of Detailed Functional Specifications and Detailed design Specification
• Enforcing Business Rules using Database Triggers
• Used External Tables for extensive reading of data from external files.
• Development of Pl/SQL Procedures, Functions and Packages
• Development of backend process in PL/SQL for batch processing
• Preparation of Unit Test Cases
• Execution of Unit Test Cases, bug reporting and bug tracking
• Writing Perl Scripts for batch processes.
• Installing, configuring, managing, monitoring and troubleshooting SQL Server.
• Designing and Creation of Database Tables, Indexes, Views.
• Interaction with testing team to resolve the issues
• Writing database triggers
• Writing database processes to process huge data volumes - BULK COLLECTION feature of PL/SQL was used.
• Tuning of SQL queries using explain plan
• Interacting with client to understand the requirements