SUMMARY

• Over 8+ year's experience in Data Analysis, Data Profiling, Data Integration, Migration, Data Governance and Metadata Management, Master Data Managementand Configuration Management.
• Experience in various phases of Software Development life cycle (Analysis, Requirements gathering, Designing) with expertise in documenting various requirementspecifications, functionalspecifications, Test Plans, Data Validation, Source to Target mappings, SQL Joins, Data cleansing.
• Extensive experience in Text Analytics, developing different Statistical Machine Learning, Data Mining solutions to various business problems and generating data visualizations using R, Python.
• Expertise in transforming business requirements into analytical models, designing algorithms, building models, developing data mining and reporting solutions that scale across amassive volume of structured and unstructured data.
• Documenting new data to help source to target mapping. Also updating the documentation for existing data assisting with data profiling to maintain data sanitation, validation.
• Experience in conducting Joint Application Development (JAD) sessions for requirements gathering, analysis, design and Rapid Application Development (RAD) sessions Experience working on Data quality tools Informatica IDQ (9.1), Informatica MDM (9.1).
• Collaborated with the lead Data Architect to model the Data warehouse in accordance with FSLDM subject areas, 3NF format, and Snowflake schema.
• Proficient in SAS/BASE, SAS EG, SAS/SQL, SAS MACRO, SAS/ACCES.
• Experience in end - to-end implementation of data warehouse project based on the SAS EG.
• Experience in extract data from adatabase such as DB2, Oracle, and SME-IM, MAD, M240 and UNIX server using SAS.
• Extensive knowledge of Hadoop eco-system technologies like Apache Pig, Apache Hive, Apache Sqoop, Storm, Kafka, Elastic Search, Redis, Flume and Apache HBase.
• Experienced in analyzing data using HiveQL and Pig Latin and custom MapReduce programs in Java.
• Experienced in writing Pig UDF and Hive UDF and UDAFs in the analysis of data.
• Extensive experience in Hive, Sqoop, Flume, Hue, and Oozie.
• Created practical predictive models with machine learning methods including Supervised (linear regression, logistic regression, decision tree, random forests, SVM etc.) and Unsupervised
• Knowledge in Business Intelligence tools like Business Objects, Cognos, Tableau,and OBIEE
• Experience with Teradata and big data as the target for data marts worked with BTEQ, Fast Load, and Multi-Load.
• Good knowledge in using all complex data types in Pig and MapReduce for handling the data and formatting it as required.
• Integration Architect & Data Scientist experience in Analytics, BigData, BPM, SOA, ETL and Cloud technologies.
• Built Coe competencies in the area of Analytics, SOA/EAI, ETL, and BPM.
• Experience in foundational machine learning models and concepts: regression, random forest, boosting, GBM, NNs, HMMs, CRFs, MRFs, deep learning.
• Experience in machine learning techniques and algorithms, such as k-NN, Naive Bayes, SVM, Decision Forests, etc.
• Good knowledge of Hadoop architecture and its components like HDFS, MapReduce, Job Tracker, Task Tracker, Name Node and Data Node.
• Collaborated with the lead Data Architect to model the Data warehouse in accordance with FSLDM subject areas, 3NF format, Snowflake schema.
• Working knowledge of DICOM and Problem Loan Management applications.
• Highly skilled in using Hadoop (pig and Hive) for basic analysis and extraction of data in the infrastructure to provide datasummarization.
• Highly skilled in using visualization tools like Tableau, ggplot2,and d3.js for creating dashboards.
• Skilled in System Analysis, E-R/Dimensional Data Modeling, DatabaseDesign and implementing RDBMS specific features.
• Worked with HBase which is a NoSQL, column-oriented database.
• Experienced in importing and exporting data from therelational database into HDFS using Sqoop.
• Mapping and tracing data from system to system in order to establish data hierarchy and lineage.
• Using Data Lineage and reverse engineering as a way to track back errors in data till the data source.
• Experience in designing starschema, Snowflakeschema for Data Warehouse, ODSarchitecture.
• Experience in designing stunning visualizations using Tableau software and publishing and presenting dashboards, Storyline on web and desktop platforms.
• Having good experience in NLP with Apache, Hadoop,and Python.
• Experience working with data modeling tools like Erwin, PowerDesigner, and ERStudio.

TECHNICAL SKILLS

Languages: T-SQL, PL/SQL, SQL, C, C++, XML, HTML, DHTML, HTTP, MATLAB, DAX, Python

Databases: SQL Server 2014/2012/2008/2005/2000 , MS-Access, Oracle 12c/11g/10g/9i and Teradata, big data, Hadoop

Bigdata Ecosystem: HDFS, PIG, MapReduce, HIVE, SQOOP, FLUME, HBase, Storm, Kafka, Elastic Search, Redis, Flume, Storm, Kafka, Elastic Search, Redis, Flume, Scoop.

Statistical Methods: Time Series, regression models, splines, confidence intervals, principal component analysis and Dimensionality Reduction, bootstrapping

BI Tools: Rsoft Power BI, Tableau, SSIS, SSRS, SSAS, Business Intelligence Development Studio (BIDS), Visual Studio, Crystal Reports, Informatica 6.1.

Database Design Tools and Data Modeling: MS Visio, ERWIN 4.5/4.0, Star Schema/Snowflake Schema modeling, Fact & Dimensions tables, physical & logical data modeling, Normalization and De-normalization techniques, Kimball &Inmon Methodologies

Big Data / Grid Technologies: Cassandra, Coherence, Mongo DB, Zookeeper, Titan, Elasticsearch, Storm, Kafka, Hadoop

Tools: and Utilities: SQL Server Management Studio, SQL Server Enterprise Manager, SQL Server Profiler, Import & Export Wizard, Visual Studio.Net, Microsoft Management Console, Visual Source Safe 6.0, DTS, Crystal Reports, Power Pivot, ProClarity, Microsoft Office, Excel Power Pivot, Excel Data Explorer, Tableau, JIRA,SparkMLlib.

PROFESSIONAL EXPERIENCE

Confidential, Denver, CO

Data Scientist

Responsibilities:

• As an Architect design conceptual, logical and physical models using Erwin and build datamarts using hybrid Inmon and Kimball DW methodologies.
• Worked closely with business, datagovernance, SMEs and vendors to define data requirements.
• Worked with data investigation, discovery and mapping tools to scan every single data record from many sources.
• Designed the prototype of the Data mart and documented possible outcome from it for end-user.
• Involved in business process modeling using UML
• Developed and maintained data dictionary to create metadata reports for technical and business purpose.
• Involved on Prediction model building, Machine Learning, Business process improvements, Visualization & Process implementation with R Programming and DeepSee
• Redesigned and developed SAS Applications with Netezza Database to the Netezza Applications reducing run time of Applications from 40 hours to 20 sec using PostgreSQL, nzsql, Aginity Workbench, SAS
• Created SQLtables with referential integrity and developed queries using SQL, SQL*PLUS, and PL/SQL.
• Formulated procedures for integration of R programming plans with data sources and delivery systems and R language was used for prediction.
• Implementing SparkMlib utilities such as including classification, regression, clustering, collaborative filtering and dimensionality reduction.
• Design, coding, unit testing of ETL package source marts and subject marts using Informatica ETL processes for Oracledatabase.
• Developed Statistical Analysis and Response Modeling for Analytical Database contributors (logistic regression).
• Used Pig and Hive in the analysis of data.
• Used all complex data types in Pig for handling data.
• Created/modified UDF and UDAFs for Hive whenever necessary.
• Developed various QlikView Data Models by extracting and using the data from various sources files, DB2, Excel, Flat Files and Bigdata.
• Participated in all phases of datamining; datacollection, datacleaning, developingmodels, validation, visualization and performed Gapanalysis. data manipulation and Aggregation from adifferent source using Nexus, Toad, BusinessObjects, PowerBI,and SmartView.
• Handled importing data from various data sources, performed transformations using Hive, Map Reduce, and loaded data into HDFS.
• Interaction with Business Analyst, SMEs, and other Data Architects to understand Business needs and functionality for various project solutions
• Researched, evaluated, architected, and deployed new tools, frameworks, and patterns to built sustainable Big Data platforms for the clients
• Identifying and executing process improvements, hands-on in various technologies such as Oracle, Informatica, BusinessObjects.
• Loaded and transformed large sets of structured, semi-structured and unstructured data.
• Supported Map Reduce Programs those are running in the cluster.
• Managed and reviewed Hadoop log files to identify issues when ajob fails.
• Designed both 3NF data models for ODS, OLTP systems and dimensional data models using Star and snowflake schemas.
• Developed Pig UDFs for preprocessing the data for analysis.
• Involved in writing shell scriptsfor scheduling and automation of tasks.

Environment: r9.0, Informatica 9.0, ODS, OLTP, Oracle 12c/11g, Hive, OLAP, DB2, Metadata, MS Excel, Mainframes MS Visio, Rational Rose, Requisite Pro., Hadoop, PL/SQL, SAS etc.

Confidential, Seattle, WA

Data Scientist

Responsibilities:

• Perform Data Profiling to learn about user behavior and merge data from multiple data sources.
• Implemented big data processing applications to collect, clean and normalization large volumes of open data using Hadoopecosystems such as PIG, HIVE, and HBase.
• Designing and developing various machine learning frameworks using Python, R, and Matlab.
• Integrate R into Micro Strategy to expose metrics determined by more sophisticated and detailed models than natively available in the tool.
• Worked on different data formats such as JSON, XML and performed machinelearningalgorithms in Python.
• Worked as Data Architects and IT Architects to understand the movement of data and its storage and ERStudio9.7
• Processed huge datasets (over billion data points, over 1 TB of datasets) for data association pairing and provided insights into meaningful data association and trends
• Developed cross-validation pipelines for testing the accuracy of predictions
• Enhanced statistical models (linear mixed models) for predicting the best products for commercialization using Machine Learning Linear regression models, KNN and K-means clustering algorithms
• Participated in all phases of datamining,datacollection, datacleaning, developingmodels, validation, visualization and performed Gapanalysis. data manipulation and Aggregation from adifferent source using Nexus, Toad, BusinessObjects, PowerBI, and SmartView.
• Independently coded new programs and designed Tables to load and test the program effectively for the given POC's using with Big Data/Hadoop.
• Develop documents and dashboards of predictions in Microstrategy and present it to the business intelligence team.
• Developed various QlikViewDataModels by extracting and using the data from various sources files, DB2, Excel, Flat Files and Bigdata.
• Good knowledge of HadoopArchitecture and various components such as HDFS, JobTracker, TaskTracker, NameNode, DataNode, SecondaryNameNode, and MapReduce concepts.
• As Architect delivered various complex OLAPdatabases/cubes, scorecards, dashboards and reports.
• Programmed a utility in Python that used multiple packages (scipy, numpy, pandas)
• Implemented Classification using supervised algorithms like LogisticRegression, Decisiontrees, KNN, NaiveBayes.
• Used Teradata15 utilities such as FastExport, MLOAD for handling various tasks data migration/ETL from OLTP Source Systems to OLAP Target Systems
• Handled importing data from various data sources, performed transformations using Hive, MapReduce, and loadeddata into HDFS.
• Collaborate with data engineers to implement ETL process, write and optimized SQL queries to perform data extraction from Cloud and merging from Oracle 12c.
• Collect unstructured data from MongoDB 3.3 and completed data aggregation.
• Perform data integrity checks, data cleaning, exploratory analysis and feature engineer using R 3.4.0.
• Conducted analysis of assessing customer consuming behaviors and discover thevalue of customers with RMF analysis; applied customer segmentation with clustering algorithms such as K-MeansClustering and Hierarchical Clustering.
• Work on outliers identification with box-plot, K-means clustering using Pandas, NumPy.
• Participate in features engineering such as feature intersection generating, feature normalize and Label encoding with Scikit-learn preprocessing.
• Use Python 3.0 (numPy, sciPy, pandas, sci-kit-learn, Seaborn, NLTK) and Spark 1.6 / 2.0 (PySpark, MLlib) to develop avariety of models and algorithms for analytic purposes.
• Analyze Data and Performed Data Preparation by applying thehistoricalmodel to the data set in AZUREML.
• Perform data visualization with Tableau 10 and generate dashboards to present the findings.
• Determine customer satisfaction and help enhance customer experience using NLP.
• Work on Text Analytics, NaïveBayes, Sentiment analysis, creating word clouds and retrieving data from Twitter and other social networking platforms.
• Use Git 2.6 to apply version control. Tracked changes in files and coordinated work on the files among multiple team members.

Environment: ER Studio 9.7, Tableau 9.03, AWS, Teradata 15, MDM, GIT, Unix, Python 3.5.2, MLlib, SAS, regression, logistic regression, QlikView.

Confidential - Reston, VA

Hadoop Developer

Responsibilities:

• Worked on Hadoop cluster scaling from 4 nodes in thedevelopment environment to 8 nodes in pre-production stage and up to 24 nodes in production.
• Involved in complete Implementation lifecycle, specialized in writing custom MapReduce, Pig and Hive programs.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Extensively used Hive/HQL or Hive queries to query or search for a particular string in Hive tables in HDFS.
• Possess good Linux and Hadoop System Administration skills, networking, shell scripting and familiarity with open source configuration management and deployment tools such as Chef.
• Worked with Puppet for application deployment
• Experience in developing customized UDF's in java to extend Hive and Pig Latin functionality.
• Created HBase tables to store various data formats of data coming from different sources.
• Use Maven to build and deploy code in Yarn cluster
• Good knowledge of building Apache spark applications using Scala.
• Developed several business services using Java RESTful web services using Spring MVC framework
• Managing and scheduling Jobs to remove the duplicate log data files in HDFS using Oozie.
• Used Apache Oozie for scheduling and managing the Hadoop Jobs. Knowledge ofHCatalog for Hadoop based storage management.
• Interaction with Business Analyst, SMEs, and other Data Architects to understand Business needs and functionality for various project solutions
• Identifying and executing process improvements, hands-on in various technologies such as Oracle, Informatica, BusinessObjects.
• Expert in creating and designing data ingest pipelines using technologies such as Spring Integration, Apache Storm-Kafka
• Used Flume extensively in gathering and moving log data files from Application Servers to a central location in Hadoop Distributed File System (HDFS).
• Implemented test scripts to support test driven development and continuous integration.
• Dumped the data from HDFS to MYSQL database and vice-versa using SQOOP
• Responsible to manage data coming from different sources.
• Experienced in Analyzing Cassandra database and compare it with other open-source NoSQL databases to find which one of them better suites the current requirements.
• Used File System check (FSCK) to check the health of files in HDFS.
• Developed the UNIX shell scripts for creating the reports from Hive data.
• Experienced in loading and transforming of large sets of structured, semi-structuredand unstructured data.
• Analyzed large amounts of data sets to determine theoptimal way to aggregate and report on it.
• Involved in the pilot of Hadoop cluster hosted on Confidential Web Services (AWS)
• Extensively used Sqoop to get data from RDBMS sources like Teradata and Netezza.
• Create a complete processing engine, based on Cloudera' s distribution
• Involved in collecting metrics for Hadoop clusters using Ganglia and Ambari.
• Extracted files from CouchDB, MongoDB through Sqoop and placed in HDFS for processed
• Spark Streaming collects this data from Kafka in near-real-time and performs necessary transformations and aggregation on the fly to build the common learner data model and persists the data in NoSQL store (HBase).
• Configured Kerberos for the clusters

Environment: AWS, ODS, OLTP, Oracle 11g, Hive, OLAP, DB2, Metadata, MS Excel, Cassandra,Mainframes MS Visio, Rational Rose, Requisite Pro, Hadoop, PL/SQL, Sqoop, Couch DB,MongoDBetc.

Confidential, Minneapolis MN

Hadoop Developer

Responsibilities:

• Involved in design and development phases of Software Development Life Cycle (SDLC) using Scrum methodology
• Developed data pipeline using Flume, Sqoop, Pig, and MapReduce to ingest customer behavioral data and purchase histories into HDFS for analysis
• Developed job flows in Oozie to automate the workflow for extraction of data from warehouses and weblogs
• Used Pig as ETL tool to do transformations, event joins, filter bot traffic and some pre-aggregations before storing the data onto HDFS
• Written Hive queries to parse the logs and structure them in tabular format to facilitate effective querying on the log data
• Installation, configuration, and administration experience in Big Data platforms Cloudera CDH, Hortonworks Ambari, Apache Hadoop on Redhat, and Centos as a data storage, retrieval, and processing systems
• Involved in creating Hive tables, loading with data and writing hive queries that will run internally in map-reduce way
• Used hive optimization techniques during joins and best practices in writing hive scripts.
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting
• Experienced in managing and reviewing the Hadoop log files
• Working with Apache Crunch library to write, test and run HADOOP MapReduce pipeline jobs
• Involved in joining and data aggregation using Apache Crunch.
• Used Pig as ETL tool to do Transformations, even joins and some pre-aggregations before storing the data onto HDFS
• Worked on Oozie workflow engine for job scheduling
• Developed custom implementation for Partner, Input / Output Formats, Record Reader and Writers
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting on the dashboard
• Loaded the aggregated data onto DB2 for reporting on the dashboard
• Project also involved building analytical reports using SQL server and Excel
• Monitoring and Debugging Hadoop jobs/Applications running in production
• Worked on Providing User support and application support on Hadoop Infrastructure
• Reviewing ETL application use cases before onboarding to Hadoop
• Worked on Evaluating, comparing different tools for test data management with Hadoop
• Helped and directed testing team to get up to speed on Hadoop Application testing
• Created ETL jobs to generate and distribute reports from MySQL database using Pentaho Data Integration
• Created ETL jobs using Pentaho Data Integration to handle the maintenance and processing of data

Environment: JDK1.6, RedHat Linux, HDFS, CDH 5.3, Impala, Mahout, Map-Reduce, Apache Crunch, Hive, Pig, Sqoop, SQL server, Flume, Spark, lambda, Zookeeper, Oozie, DB2, HBase, and Pentaho.

Confidential

Java Developer

Responsibilities:

• Involved in development of Staffing sub-modules like Staffing Override, Interview Override, Resume Upload
• Interacted with the User Group to gather requirements
• Developed application using Eclipse IDE.
• Created spring configuration files to define Handler mappings, Bean definitions, and developed Model classes for View Resolutions and DAO implementation classes extended from Hibernate DAO Support.
• Created Hibernate persistent and configuration files for ORM implementation.
• Developed views and controllers for client and manager modules using Spring MVC and Spring Core.
• Developed generic DAO tier for fetching the navigation items through the Legacy Intranet; connecting to the SQL server database and fetching data using Hibernate ORM Mappings.
• Designed the sub-modules based on the initial specifications defined by the user group
• Performed Analysis and development of Stateless Session Bean, Data Access object and Application Component for Screening and Short-listing module
• Involved in developing in all the tiers of J2EE application
• Configured JBoss Application Server and deployed the web components into the server
• Involved in debugging, testing and integration of the system
• Designed and implemented Java engine and API to perform direct calls from front-end JavaScript, AngularJS to server-side Java methods
• Extensively involved in the enhancements, troubleshooting, bug fixes and change requests for the Web Services, Worked on fixing bugs raised by the users
• Worked with Spring Restful Web Services to interact with the JPA Objects created using ORM tools
• Documented all the low-level design of the application.
• Developed JSP / Action servlet classes
• Applied J2EE design patterns such as MVC, Singleton, and Data Access Objects in the architecture
• Developing Hibernate XML Java object-to-database mapping documents
• Performed code reviews
• Used XSLT, XML, XSD, and JAXP for transforming request/responses to other formats.

Environment: Core Java, Spring, J2EE, Servlets, EJB, JSP, JMS, Java Swing, HTML, XML, Oracle 9i, JBoss, Hibernate, Restful web service, Eclipse, Unix.

Confidential

Java Developer

Responsibilities:

• Designed application by implementing JSF Framework based on MVC Architecture with EJB, Simple
• Java Beans as a Model, JSP, and JSF UI Components as View and Faces Servlet as a Controller.
• Core Java, highly concurrent Multithreaded coding for processing the port assignment data.
• Developed framework for data processing using Design patterns, Core Java, XML.
• Developed custom validators and converters in JSF.
• The used lightweight container of Spring Framework to provide architectural flexibility for inversion of thecontroller (IOC).
• Used Spring AOP for cross-cutting concerns and IOC for dependency injection.
• Developed JSF Component Library, including dynamic Menu components and Pagers.
• Wrote unit tests using JUnit framework and used Log4J framework for logging.
• Developed EJB components that were deployed on Web Sphere Application Server
• Developed PL/SQL procedures, Java and JavaScript code.
• Extensively worked on generating complex reports using Jasper reports.
• Actively involved in code reviews and in bug fixing.
• Applied CSS (Cascading Style Sheets) for entire site for standardization of the site.
• Coordinated and supported User acceptance testing. Coordinated meetings with vendors to define requirements and system interaction agreement documentation between client and vendor system.
• Document data quality and traceability documents for each source interface.
• Generate weekly and monthly asset inventory reports.

Environment: Web Sphere 6.0, RAD 6.0, SQL, JDBC, Java, EJB, Servlets, Java Server Faces (JSF), AJAX, Spring, ADF Components, JSP, jQuery, Hibernate, Toad, JNDI, LDAP, Clear Case, Rational Rose, PL/SQL, JavaScript, JMS, JUnit, Ant, Oracle 10g and Windows XP.