PROFESSIONAL SUMMARY:

• Over 12 years of experience in IT industry working on different technologies with over 2 years of full stack development experience in Big Data distributed development using Play MVC Framework 2.0, Java, Scala 2.11.x and Apache Spark 2.x.
• Worked as a full stack developer in development of high performance business applications deployed in a distributed and scalable environments on Cloudera cluster and in Mesos DC/OS.
• Over 7 years of combined experience in designing and developing batch processing applications utilizing Apache Spark, other ETL tools like Microsoft SSIS and TSQL.
• 3+ years of UI development using technologies such as Play Framework 2.0, Scala, Slick, Java, .Net Web forms, C#, Javascript, HTML5 etc.
• 2 years of experience in functional programming using Scala 2.11.x in Play Framework 2.x and other big data technologies for development of high performance applications.
• Experience in deployment and monitoring of Spark 2.x jobs on Cloudera cluster for distributed computing.
• Good understanding of AWS for cloud computing and configuration with experience in setting Spark - submit configurations on Cloudera cluster for memory, cores, jars etc.
• Good understanding of REST/SOAP and web and Micro services architectures and Akka, with experience in implementing micro services (Lagom) which included defining Api methods and endpoints, deploying and calling services from web applications.
• Experience in deployment and monitoring of web applications on Docker and DC/OS cluster.
• Experience working with data standards such as JSON and good understanding of Parquet formats for storage.
• Good knowledge of data ingestion techniques, Hive tables, HiveQL, and NoSQL databases like HBase and Cassandra (CQL).
• Experience in testing using testing frameworks such as Scalatest, Junit etc.
• Experience in Linux shell scripting, editors (vi) and other utilities for scheduling services in Linux environment.
• Continuous integration experience in SBT.
• Experience in Git, Gitblit, Team Foundation Server, Vault etc.
• Experience in Agile model of development in environment using tools like Jira and TFS.
• Experienced in working directly with Product Owners/Subject Matter Experts to collect business requirements and translating them into data flows, for high performance analytical applications.
• Experience in leading both onshore and offshore ETL teams; conducted periodic team meetings for knowledge sharing and for coming up with coding standards and enforcing them.
• Industry domain experience in Healthcare/Pharmaceutical, Financial/Banking and Insurance, which includes experience working with industry standard file formats.
• Familiarity with EDI transactions and loading converted flat files for incoming and for creating outgoing transactions related files.
• Experience in creating and presenting data flows and data mapping specifications including flat file format, database table mappings and JSON format mappings.
• Experience in creating logical and physical data models in Data Warehouse, Data Integration and Operational Data Store (ODS) projects.
• Expertise in analyzing business requirements, identifying the source systems or Databases and creating Technical specifications for ETL design and development.
• Strong understanding of Bill Inmon and Ralph Kimball theories of data modeling for data warehouse projects.
• Experience in JDBC, Play Slick, and ODBC database connectivity technologies.
• Excellent Team player to work in conjunction with testers, developers and other team members in validation and testing complex scenarios and projects and in the maintenance of Quality Standards in Projects.

TECHNICAL SKILLS:

Big Data languages: Scala 2.11.x (functional programming), Java 7,8.

Big Data frameworks: Play 2.0 MVC and Spark 2.x

NoSQL databases: HBase, Hive(HiveQL), Cassandra(CQL)

Big Data Distribution: Cloudera. Dockers DC/OS

IDE’s: IntelliJ 2017 community edition, Eclipse, Visual Studio 2012.

Version Control: Gitblit, TFS.

Client side: JavaScript, HTML. CSS.

Database connectivity: JDBC, ODBC, ADO.net and others.

ETL Tools: Microsoft SSIS 2005/2008/2012 , IBM DataStage 7.x.

BI/Reporting Tools: SSRS 2008, 2012.

RDBMS: SQL Server 2008, 2008 R2, 2012, 2014, IBM Netezza, Oracle 8i/9i/10g, MS Access,.

Languages: Java, C#, .NET.

Database scripting: TSQL, PL/SQL, NZSQL etc.

Data Modeling: Erwin Data Modeler 4.1/7.2.

OS: MS-Windows 2003/2007, 2012,2014, Cent OS 7/Redhat Linux, BSD UNIX,

PROFESSIONAL EXPERIENCE:

Confidential

Big Data Application Developer/ IT Architect/ Application Specialist

• Involved in development of domain model for the duration of the projects.
• Developed multiple rules in Spark using Data Frames, Scala collections, SparkSQL and other methodologies to process data on local Spark context then tested code on cluster.
• Configured and deployed Spark jobs on Cloudera cluster using custom shell scripts.
• Implemented Play MVC controller Scala classes and methods for a variety of screens.
• Created backend repository methods in Scala Slick for data access and manipulation of objects.
• Created and published micro services using Lightbend Lagom for a variation of services of the application.
• Created Scala Play forms for accepting and validating user inputs on screen.
• Created java script functions for making Ajax calls to the server.
• Developed unit tests using Scalatest for each of unit of work that can be tested.’
• Led a team of ETL developers.
• Created and enforced ETL coding standards.
• Provided technical guidance when and where required to make sure that the developers meet project deadlines.
• Worked with product owners to gather user requirements and created architecture and design documents of the project.
• Conducted screening of developers before bringing them on board.
• Communicated with cross-functional team members to improve the development process and make the process more efficient.
• Assisted in third party audit of ETL process controls.
• Developed multiple in-house projects and customer project using Microsoft SSIS, SQL Server 2008/2012, IBM Netezza.
• Developed applications using C#(.Net) web forms etc.
• Gathered requirements and created design documents like data mappings data flows.
• Presented design documents to stakeholders and obtained signoff.
• Helped testers with the testing of the applications.
• Deployed and managed schedules of SQL Agent jobs.
• Kept everyone up to date on project progress.

Environment: Play Framework 2.x, Java, Scala 2.11.x, Apache Spark 2.x, SQL Server 2014, HBase, IntelliJ IDEA 2017 Community edition, Cloudera cluster, Dockers DC/OS cluster.Microsoft SQL Server 2005/2008/2008 R2/ 2014, SSIS, SSRS, C#, .Net, Oracle 10g, IBM Netezza PL/SQL, TOAD, DOORS, CA ERwin 7.x, MS-Word, Excel, Visio, Access.

Confidential, Phoenix, AZ

Data Analyst/ETL Developer

• Created data mappings and transformation/business rules for the data received from multiple vendors to a standard layout for landing the data on the Data Warehouse.
• Created ETL (Extract Transform and Load) specification documents for WK brand products/reports based on the business requirements.
• Developed Source to Target data mapping documents, inclusive of all the transformation and business rules, logical and physical column names, data types, volumetrics, data flow diagrams used for ETL design and development.
• Developed ETL processes using SQL Server Integration Services 2005 to based on the ETL specifications
• Created complex SQL queries to generate extracts/reports based on the Business Requirements using SQL joins, normalizations, aggregations, lookups, etc.
• Worked closely with analytical and reporting infrastructure teams to ensure operational and analytical data warehouses are able to support all business requirements.
• Performed data profiling and monitoring on a regular basis.
• Maintained the requirements using Telelogic DOORS.

Environment: Microsoft SQL Server 20002005, SSIS Oracle 10g, PL/SQL, TOAD, DOORS, CA ERwin 7.x, MS-Word, Excel, Visio, Access.

Confidential, Des Moines, IA

Data Analyst/ETL Developer

• Worked closely with Subject Matter Experts from the business to understand and document business needs for data.
• In concert with the Business Requirements Analyst, identified appropriate sources of data.
• Facilitated JAD sessions for requirements gathering and creating design with input from all the stakeholders involved.
• Helped create conceptual and logical Data Models based on the requirements gathered by Use cases and extracts inventory analysis.
• Extensively used SQL to write complex queries to extract the data from the source tables.
• Resolved subsequent issues to ensure ongoing correlation between data models and physical database.
• Documented the process and the data models in accordance to current methodologies and company standards.
• Created Source to Target (ETL) mapping documents which included the fields, data type, definitions from both source and target systems. A business/transformation rule was also documented based on the business requirement or formatting needs of data.
• Created Data Flow Diagram which depicts the flow of data from the source system to the target system.
• Documented the Service Level Agreement (SLA) to which both the sending and receiving parties agreed on.
• Created XML Schema Definition for interfacing between multiple systems.
• Created views to extract the data from OLTP systems.
• Created and maintained Object universes in the Business Objects for data extracted from multiple sources.
• Created artifact for defining the interfacing system environments which included source and target environments.
• Any dependencies, constraints which may have impact on the extract, any assumptions made while creating the document.

Environment: Oracle 9i, MS SQL Server 2000, PL/SQL, TOAD, Mainframe System (CICS), COBOL, Teradata, MS-Visio, Word, Excel, Access, Outlook, UNIX.

Confidential, Windsor, CT

Data Analyst/ETL Developer

• Created Data Mapping documents, which capture the source of data, any business rule to be applied to meet the internal customer needs of data.
• Writing ETL routines to extract data from the staging area, validate, transform using certain business rules and finally load the data warehouse.
• Studied and assessed the clients systems and business processes.
• Addressed all aspects of the claim processing lifecycle, starting from identifying a claim right up to closure.
• Researched the various steps in the lifecycle and then constructed the system in such a way that the riskier claims could be easily identified and monitored.

Environment: Ascential DataStage 7, Oracle 9i, SQL Server 2005, PHP, CA ERwin 4.1, UNIX.