PROFESSIONAL SUMMARY:

• Fifteen years of experience in handling medium to large scale projects catering to the needs of the clients with standalone - client server platforms using Oracle Database, DB2, SQL Server, SybaseIQ, Terradata, Netazza.
• Proficient in all phases of system design, development, unit and integration testing, and implementation. Strong Experience in analysis, design and in customizing commercial applications and standard business aspects.
• Extensive knowledge of New technologies with changing time like SOA, Agile, Cloud Computing, Hadoop, Map/Reduce, Hive, Pig, Spark, Scala, Hortonworks, Cloudera, Azure, AWS, WebServices, XML, JSON.

TECHNICAL SKILLS:

Operating Systems: UNIX, Sun Solaris, RedHat, Windows10, IBM, Apple OS, Android

Programming Languages: Java, J2EE, EJB, Pro C, C/C++, COBOL, SQL, PL/SQL HTML & DHTML Databases Oracle, SybaseIQ, MySQL, TeraData, SQL Server, DB2, Netazza, Infobright

Scripting Languages: J2EE, STRUTS, Hibernate, Web 2.0, JAVA Script, Scala, JSON, XML

GUI Tools: Rapid SQL, SQL Designer, TOAD, Visual Basic 6.0, Control-M, BTEQ

ERP/CRM Tools: SAP BW/BI, FICO, SD, P2P, OTC, SalesForce, Siebel (SFA, CTI), PeopleSoft

Testing Tools: WinRunner, Test Director, LoadRunner, QTP, Rational Tools, ClearCase.

Application Servers: Websphere, WebLogic, Ajax, Hibernate, Tomcat, Apache, JBoss, OpenShift

Cloud Technologies: Microsoft Azure, Amazon Web Services (AWS), Cloudera, IBM Bluemix

Big Data Tools: Hadoop, Hive, Spark, Hbase, Map/Reduce, Datameer, Kafka, Kibana

NoSQL Data Tools: MongoDB, CouchDB, HDFS, Cloudera, Cassandra, Hortonworks

BI/Reporting Tools: IBM Cognos, MicroStrategy, Tableau, Datameer, Pentaho, Jaspersoft

ETL/Data Warehousing: Informatica PowerCenter, Datastage, Talend, OBIEE, SAS, SAP HANA

Other Tools: Share Point, Subversion(SVN), TeamFoundationServer(TFS), GIT/HUB

PROFESSIONAL EXPERIENCE:

Lead Developer and Sr Data Engineer

Confidential, Chicago IL

Responsibilities:

• Lead project kick off meetings, business requirement gathering with product managers, business sponsor. Maintain a good communication channel with the Project Managers, Business Analysts, Developing Teams.
• Experience in developing Multidimensional Data Model, designing logical and physical modeling, data warehouse architecture for EDW, ODS, OLTP, OLAP & MDM, Data Quality, analyzing user requirements.
• Building Dimensions and Facts like Portfolio, Assets, Trades, Securities, Transactional Fact, Holdings Daily Fact, Holdings Monthly Summary, Real Estates, Profit/Loss Details, Ledger Details, Date Dim etc.
• Leading Team of Developers, developing Architectural Design documents, Analysis of Source--Target systems, Writing scripts in JSON, XML, Parsing XML to load data in SQL Server and building XML and JSON files.
• Responsible for schema definitions and storing data in HDFS, HBase, Cloudera, Yarn, Apache sytesms. Created Unix Scripts, Multi threaded Process, Analytical Reports/ Dashboards using Datameer, Tableau.
• Developed Jobs to move data from Relational, Structured, Semi Structured, NoSQL databases to HDFS system processing data in Batch and live stream jobs and analyze data for Customer Portfolio, Holdings and Assets.
• Used Amazon Web Services S3, Redshift, DynamoDB Clustering and Monitoring Data flows, Developing Mapping, Data transforms, Supported RESTful API calls using XML, XSD for Micro Services, Cloud Apps.
• Designed, build and deploy extract-transform-load (ETL) mappings using Talend Parallel Process, Sequential Process, SQL, Stored Procedures, Hive, BigData Hadoop, tHDFS Connection, tHDFSInput, tHDFSOutput.
• Working with Team developing Architectural Design documents, Analysis of Source/Target systems, Writing scripts in Spark, Python, Java, Parsing data in AWS and building DataFrames, Avro, Parquet, JSON files.
• Defined Table Structures, ER Diagrams, Parameters Sets, Data Connections, Transform Logics/Condition for Sequential/Parallel Process with SQL, PL/SQL, Lookups, Filters, Joiners, Aggregators, SCD, CDC maps.
• Used SSIS, SSRS, SSAS, Data Integration Services for Business Rules, Address Cleaning with Melissa DQ, Tableau Reports for Daily Sales, Commision reports, Monthly Dashboards, Scorecards and DQ reports.
• Working with Team developing Architectural Design documents, Analysis of Source/Target systems, Writing scripts in Scala, Python, data in NoSQL DB like Cloudera and building Data Sets/Frames, Parquet/Avro files.
• Used ERWIN to create Physical/Logical Models, Canonical Data Model, OLAP DataMarts using Star Schema. Developed Filters, Calculations, Conditions, Bar/Pie, Grant, Heat, Graphs, Trends and Prompts, interactive/dynamic dashboards with drill down capability using NoSQL DB, Tableau Desktop and Cloud.
• Preparing details documents like business process flows, data flow diagrams, best practice guidelines describing project phases and tasks, deployment scenario for the successful implementation of the project in Production.

Environment: Hadoop HDFS, Map/Reduce, Hive, Hbase, Hue, Pig, Spark, Kafka scripts, Cloudera, XML, JSON, Microsoft SQL Server, Cloud DB, Talend, AWS Redshift, S3, Avro files, GIT/HUB, Linix.

Hadoop Data Engineer/ Lead Developer

Confidential, Chicago IL

Responsibilities:

• Customer and Financial Reports/Dashboards (CFRD) Project is to help business Analyze Customer Pattern of buying products and offering discounts to increase Revenue.
• Financial Reports/Dashboards help business and Directors monitor the Budget, Forecast the Revenue and Estimate the stock in Warehouse and Order new Products.
• Roles & Responsibilities includes developing Talend Jobs for Data Ingestion, extracting data from flat file, RDBMS to BigData HDFS, Data Ingesting, building Pipelines, Data Lakes, Amazon Web Services S3, Redshift, RDS.
• Created, Designed, build and deployed ETL jobs using Talend Parallel Process, Sequential Process, SQL, Stored Procedures, Hive, BigData Hadoop, tMap, tLogRow, tHDFS Connection, tHDFSInput, tHDFSOutput.
• Created Multi Dimensional Models in ERWIN, Designed Conceptual, Physical and logical Data Model. Developed Data Analytics and Visualization D3.js/Atscale Dashboard, pie charts, bar charts, histogram, Heat map and Box charts.
• Created Dimensions and Facts like Customer, Regions, Products, Product Item, Orders, Invoices, Sales facts and Dashboards with Tableau like Actual VS Forecasting, Current VS Prior Years, Sales Trends.

Sr Hadoop Engineer

Confidential, Arlington Heights IL

Responsibilities:

• Experienced working in a team environment providing technical leadership, business requirement gathering and specification creation and solving Data Quality and reporting problems of moderate to high complexity.
• Used Incremental/Last Updated Methodologies to extract data from Sales Force, legacy database, transforming into (ODS) and Enterprise Datawarehouse (EDW), MySQL, SQL Server Datamarts(Insights/Analytics).
• Developed Microsoft Azure Data Factories to move data within Cloud environment and from cloud to On Premises, Extract Load Transforming(ELT) data as per business requirement and maintain Data Quality.
• Developed Microsoft Azure Data Factory Pipelines, Data Lakes to move data within Cloud environment and from cloud to On Premises with AzCopy tool to Extract/ Load data required and Resolving Production Issues.
• Design, build and deploy ETL/ELT mappings, converting RDBMS data into JSON/XML files and building NoSQL models in Hadoop System and store data files in Couchbase with SQL, PL/SQL, Stored Procs, CDC.
• Architect, create and build efficient programs file Structures, Data Connections, Transform Logics for External Data with Hive, Hue, Hbase, Pig, Map/Reduce, Apache Kafka Streaming, Spark/Scala scripts.
• Used Couchbase DB to store data from Apache Stream/ Social Media data feeds for Developed Mapping, Data flows, Control Flows. Supported RESTful API calls using JSON/XML for Web Services in Cloud.
• Used Security with Ambari, PowerShell, Yarn Resouce Management, Data Integrator/Services, Melissa DQ and Tableau/QlikView Data Visualization with Avro files for Commision reports, Dashboards, Scorecards.
• Created and Developed Customers, Orders, Accounts, Marketing, Affiliates, Products, Restaurants, Sales Subject Areas. Working in Agile with DevOps, DBA, QA, Operational, Business and Sales/Marketing Teams.
• Design, build and deploy extract-transform-load (ETL) mappings using Talend Integration Studio, TAdmin Center, MDM, SQL, PL/SQL, Hive, tMap, tAgreegateRows, tSortRows, tHDFSInput, tHDFSOutput.
• Developed SOA Architect Design for ETL and Reporting to extract data from Legacy DB to Cloud database, transforming into stage area and into OLAP DB, Enterprise Datawarehouse (EDW), CRM(SalesForce).

Environment: Hadoop HDFS, Map/Reduce, Hive, Hbase, Hue, Pig, Spark, Cloudera, XML, JSON, MS SQL Server, SSIS, Azure Cloud DB, Talend DI, GIT/HUB, Couchbase, Tableau Analytics, Redhat Linix Scripts.

Hadoop Engineer

Confidential, Rosemount IL

Responsibilities:

• Analyze technical needs, Designs, requirements, and state of the client’s infrastructure design, integration, and operations with business analyst and ensure Functionalities, System Testing, User Acceptance Test, Migrations.
• Defined Table Structures, Souce/Target Mappings, Parametere Sets, Data Connections, Transform Logics/Condition for Sequential/Parallel Process with SQL, PL/SQL, Lookups, SCD, Change Data Capture.
• Developed Retail Logical Model(RLM) in Teradata with areas like STORE, ORGANIZATIONS, ADDRESS, PHONE, ITEM, SALES, ORDERS, HOUSEHOLD, CUSTOMERS, PROGRAMS, ACCOUNTS, REWARDS.
• Developed Data Migration jobs from SSIS to Informatica Power Centre and Teradata Database. Created Models in ERWIN for Conceptual, Physical and logical Data Model. Used BTQ/Tload/TPT/ Muliload tools.
• Experience in developing Migration rules with Talend Open Studio, Data Quality and Profiling, Multidimensional Data Model in Terradata for EDW & MDM, maintaining data quality and user requirements.
• Defined File/Tables Structures for Hadoop, Star Schema, Relation Diagrams, Data Connections, Transform Condition for Sequential/Parallel Process with Teradata, BTEQ, TPT, MLoad, TLoad and QlikView reports.
• Developed reports in Tableau/SSRS Dashboard, pie charts, bar charts, histogram, Heat map and Box charts. Administration for user permissions and Management console, Project setup. Used Tableau/Alteryx Analytical tool Installation, Setting Users, App Permission, Administration, help Alteryx/SAS team for Analytical reports

Environment: Talend Data Integration Studio, MDM, ESB, Manager, Data Quality Designer, Data Explorer SQL Server, Webservices, XML, JAVA, J2EE, Teradata, SVN, Visio, Erwin, Control-M, Windows/Unix

Data Architect/ Sr Lead ETL Developer

Confidential, Chicago IL

Responsibilities:

• Experienced working in a team environment providing technical leadership, business requirement gathering, specification creation, solving Data Quality, reporting problems, co-ordinating Offshore and Onshore Teams.
• Defined Table Structures, ER Diagrams, Parametere Sets, Data Connections, Transform Logics/Condition for Sequential/Parallel Process with SQL, PL/SQL, Lookups, Filters, Joiners, SCD, Change Data Capture.
• Created Physical and Logical Design for CAL database with tables for Valuation and Transaction details like VLN AC SUM, VLN SEC, VLN CURR, VRP AC SUM, VRP POSN, VRP PHYS HLDG, TRN HDR, XREF, TRN CASH, ASM CUST AC, ASM AC, CFI CUST, FM NTRES FUND etc.
• Developed Data Migration ETL/ELT jobs from Datastage to Talend DI including Parallel/Server, DataQuality, Routines, Shared Containers, Sequences using Stored Procedures, XML, XSD, Web APIs.
• Extracted Data from Salesforce CRM, Netezza, Mainframe DB2 server Action Tables and Base Tables with Before and After Images of Inserts, Updates, Deletes. Implemented Change Data Capture on Mainframe.
• Checked in and out Talend Open Studio Jobs into TFS and Sharepoint. Designed Solution Documents with VISIO. Import/Export Jobs, Sequences and Created Packages to migrate code from DEV to UAT to PROD.
• Developed reports with Business Objects, Webintelligence, Tableau Desktop, Analytics Dashboards using components for Alerts, Drill Downs, Bar charts, Heap map, Tree maps and report optimizing, and distributing.
• Created List reports, cross tab, KPI reports, Adhoc reports, Running Totals, Trends and drill through.

Environment: Talend Data Integration Studio, Designer, Administrator, BOBJ XI/4.0, Xcelsius, Windows