SUMMARY:

• Experienced Technical leader with 16+ years of experience in Industry. Currently focused on delivering solutions in the BigData area using Hadoop and it's ecosystem of products like HBase and Hive.
• Proficiency in wide range of programming languages (Python, C), Big Data stack (HDFS, Map Reduce, Spark, Hive), ELK, NoSQL (MongoDB, Redis) and Visualization tools (Power BI & Tableau).
• Solid understanding of RDBMS, data warehouse, data modeling, ETL & OLAP concepts. Strong knowledge in building large data warehouses, data pipelines, real - time integration patterns and technologies like Kafka, RabbitMQ etc.
• Experience in all phase of software development life cycle. Lead projects with team members working onsite and offshore. Excellent verbal and written skills, coupled with very positive user interaction, strong analytical skills with an interest to learn new technologies.
• Managed and executed all phases of a Big Data project life cycle during the tenure that includes Scoping Study, Requirements Gathering, Architecting, Design, Development, Implementation, Quality Assurance, Application Support for end-to-end IT solution offerings.
• Effective collaboration and leadership skills in building partnerships with Product Owners, SME's, Senior Leaders, Program Managers, Architects and other Technology Leads.
• Experience in architecting Hadoop clusters using major Hadoop Distributions.
• Experience in Docker and LXC containers.
• Highly proficient in Oracle PL/SQL including writing queries, stored procedures, functions and database performance tuning.
• Designed and implemented solution to convert mainframe EBCDIC data to Hadoop based Platform.
• Extensive database experience using Oracle 11i, Oracle 10g, Oracle 9i, UDB DB2, MS Access, SQL, PL/SQL, SQL* Confidential, SQL*Loader, TOAD.

TECHNOLOGY:

Big Data Tools: Hadoop, Hive, Pig, Sqoop, Oozie, Flume, ELK and Kettle Pentaho

Data Base: Hbase, Oracle 11g, Oracle 10g, Oracle 9i, DB2, MySQL

Scripting Languages: Korn Shell Script

Database Tools: PL/SQL, SQL* Confidential, SQL*Loader, TOAD 8.6

Job Scheduling Tools: Tidal, Autosys, Jobtrac, Tidal

Version Controlling Tools: SVN, PVCS, Rational Clear Case

Programming Languages: C, C++, COBOL, and Java J2EE and Python

Operating Systems: Ubuntu, Linux, UNIX-AIX, MS DOS, OS/390

Markup Languages: HTML, XML.

Process / Methodology: Scrum, Ralph Kimball’s Data Modeling, Star and Snowflake Schema Modeling, Waterfall Software Development Life Cycle Model, Onsite and Offshore Model.

PROFESSIONAL EXPERIENCE:

Confidential

Solutions Architect

Responsibilities:

• Manage customer PoCs and Production Implemenations for several customers.
• Create container based application deployment architectures and framework for ELK ( Elasticsearch, Logstash, Kibana)
• Create container based application deployment architectures and framework for Cloudera & Hortonworks HDP
• Create Product documentation.
• Create Marketing and sales collaterals.
• Record product use case demos for sales meetings and webinars.
• Participate in meetups, shows and conferences to demo the product capabilities.

Confidential

Solutions Architect

Responsibilities:

• Researched and Proposed an Architecture that uses Open Source Tools.
• Completed POC using Apache Chukwa and ELK.
• Reviewed the Jobs and Recommended Capacity Scheduler Configuration.
• Reviewed the Hive Tables and Proposed and Implemented changes to improve the performance. Recommended to change the file format to ORC instead of CSV. Implemented, Partitioning and Bucketing to speed up the hive queries.
• Performance tuning for Cassandra database.
• Use AWS JDK to automate starting and terminating EMR Cluster.

Confidential

Technical Lead and Architect

Responsibilities:

• Implemented Data collection using Flume.
• Evaluated suitability of hadoop and its ecosystem to the above project and implementing / validating with various proof of concept applications to eventually adopt them to benefit from the Big Data initiative.
• Validated and cleaned data before performing analysis.
• Wrote Java MapReduce programs to process the log files.
• Developed Hive & PIG scripts to aggregate and de-normalize the log data.
• Exported the Denormalized data to Confidential ’s Cloud based analytics platform for data exploration and analytics.

Confidential

Responsibilities:

• Evaluated suitability of hadoop and its ecosystem to the above project and implementing / validating with various proof of concept applications to eventually adopt them to benefit from the Big Data initiative.
• Validated and cleaned data before performing analysis.
• Developed Hive & PIG scripts to aggregate and de-normalize the log data.
• Stored data in HBase for Core stack.
• Exported the denormalized data to Confidential ’s Cloud based analytics platform for data exploration and analytics.

Confidential

Responsibilities:

• Implemented the solution end to end.
• Developed ftp scripts to copy the Input file.
• Designed and developed Job scheduling and Processing using shell scripts.
• Designed and developed Kettle transformation to call the rest APIs for each record in the Input file.
• Store the Processing results and audit trails in MySQL database.

Confidential

Tech Lead - BI & Data Integration

Responsibilities:

• ETL- Data Cleansing, Integration &Transformation using Pig: Responsible of managing data from disparate sources.
• Data Warehousing: Created and managed Hive tables in Hadoop for Data warehousing.
• Workflow Management: Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
• Created and maintained Technical documentation for launching Hadoop Clusters and for executing Hive queries and Pig Scripts.
• Actively involved in gathering requirements and acquiring application knowledge from the Business.
• Extracted data from different sources like Oracle, flat files, VSAM files and Consolidated the data and stored the aggregated in Hbase.
• Developed ETL routines using SAP BODS and created mappings involving transformations like Lookup, Aggregator, Ranking, Expressions, Mapplets, connected and unconnected stored procedures, SQL overrides usage in Lookups and source filter usage in Source qualifiers and data flow management into multiple targets using Routers.
• Extensively used Mapping Variables, Mapping Parameters to execute complex business logic.
• Design and development of complex ETL mappings making use of Connected/Unconnected Lookups, Normalizer, Stored Procedures transformations.
• Development of PL/SQL Stored Procedures to implement complex business logic and integrate them with the ETL process as pre/post Stored Procedures.
• Proficient in using Source Analyzer, Warehouse Designer, Transformation Designer, Mapping Designer and Mapplet Designer.
• Used debugger in debugging some critical mapping by setting breakpoints and trouble shot the issues by checking sessions and workflow logs.
• Involved in identifying bottlenecks in source, target, mappings and sessions and resolved the bottlenecks by doing Performance tuning techniques like increasing block size, data cache size, sequence buffer length.
• Developed UNIX shell scripts to create parameter files, rename files, compress files and for scheduling periodic load processes.
• Create data validation and data cleansing rules.
• Conduct walk through with the Business users and developers.
• Design the ETL process flow and Job stream.
• Create Systems Integration strategy document and Support the Systems Integration Testing.

Environment: Hadoop, Informatica Powercenter 9.1, PL/SQL, XML, Oracle 11g, UNIX-AIX, Shell Scripts, Windows NT 4.0.

Confidential

Sr. ETL Developer, Roseland, NJ

Responsibilities:

• Study the Business Requirement document and source system to understand the characteristics of data elements.
• Create High-level BO Universe design document.
• Perform Data Analysis and Create Source to Target mapping document.
• Create data validation and data cleansing rules.
• Create and modify tables, views, stored procedures packages.
• Document entities, relationships, and expected access patterns.
• Conduct walk through with the Business users and developers.
• Design the ETL process flow and Job stream.
• Write and Review the PL/SQL scripts and Korn Shell scripts.
• Create Systems Integration strategy document and Support the Systems Integration Testing.
• Create Performance Testing Strategy document.
• Create backup and recovery Strategy document.
• Create Standard Operating Procedures document.
• Do performance tuning and Optimization.
• Prepare the best practices and lessons learned document and present it to the team.

Environment: Oracle 9.2, Business Objects Data Integrator, PL SQL, Java, UNIX-AIX, Shell Scripts, Erwin, Autosys

Confidential, New Jersey

Data Analyst

Responsibilities:

• To coordinate with offshore at the client location (Roseland, NJ)
• Involving in various activities such as:
• Participating in Client meetings
• Study the existing legacy interfaces and create Interface Control document.
• Perform Gap analysis on the legacy data fields.
• Design the Application Specific Business Objects (ASBO) for various legacy Interfaces as per ACORD Standard.
• Create ASBO to GBO mapping as per ACORD Standard.
• Provide day-to-day clarifications to the Developers.
• Provide testing support to Systems Integration, QA and UAT.
• Ensuring that Confidential ’s process and standards are applied to the project.

Environment: Intel Server Web sphere and Workstation, Windows 2000, XMLNB Metrics Data warehousing System -

Confidential, New Jersey

ETL Developer, Roseland, NJ

Responsibilities:

• Gathered requirement from users and translated into technical specifications.
• Involved in data Mapping and Creating Meta Data Grid.
• Involved in Extract file layouts design.
• Involved in ETL processes to load data from Flat files into the target DB2 UDB database by applying business logic on transformation mapping for inserting and updating records when loaded.
• Used SQL Procedures/Functions to build business rules.
• Standardized the data being stored from various Business Units into the warehouse tables.
• Involved in UNIX shell scripts to run batch jobs also automated their schedules.
• Involved in creating reports using Business Objects.

Environment: DB2 UDB, Business Object 5.1, SQL Scripts, Sybase, IBM Mainframe S/390, Unix - AIX, VS COBOL II, JCLs, VSAM, QSAM, Autosys, Jobtrac

Confidential

Developer

Responsibilities:

• To work as a Developer
• Involving in various project activities such as:
• Analysis of the existing programs to determine the behavior of the data.
• Create data mapping specification
• Preparation of test plan.

Environment: IBM MAINFRAME (IBM ES-3090), OS 390, Windows 2000, VS COBOL II, JCL, DB2, IDMS, VSAM, QSAM, IPMS,DB2, ADS/o, CICS, VSAM, File Aid, Inter test, Rexx

Confidential

Developer

Responsibilities:

• To work as a Developer
• Involving in various project activities such as:
• Preparation of System Specifications and Coding.
• Preparation of Test Plan.
• Integration Test Environment set-up and maintenance.
• Integration testing with the various interfaces including the External Administration System. Trouble shooting and bug fixing.
• Support for QA testing and User Acceptance Testing
• At Offshore Development Center, involved in the Enhancement and Maintenance of the System.em
• Placement of issued policies in various Admin systems

Environment: IBM Mainframe S/390, OS/390, NT Server and Windows 2000, VS COBOL II, DB2, VSAM, QSAM, IPMS, Xpeditor, File-aid, MQ, CICS, CHANGEMAN, JOBTRAC