Sr Big Data Consultant Resume
Parsippany, NJ
SUMMARY:
- 10+ years of progressive real time experience in Data Analysis, Design, Development, Testing, Documentation and Implementation of various Business Applications using Hadoop, HDFS, Java, Oracle, Informatica, AS400, DB2, Linux
- Having 2+ years of hands on experience with Bigdata Ecosystems including Hadoop, MapReduce, Pig, Hive, Sqoop, Oozie
- Experience in Big Data Ecosystems (Hadoop) in ingestion, storage, Querying, Processing and Analysis
- Highly Experience in creating Custom UDF’s in HIVE and PIG
- Highly Experience in Importing/Exporting data from RDBMS to HDFS, HIVE and HBase tables
- Hands on experience in optimizing techniques in sorting and phase of Map/Reduce programs and implementation in Optimized Joins from different data sources.
- Experience in Handling Different Data formats like text, sequence, AVRO, Parquet
- Experience in Job workflow scheduling, automation and managing using Oozie and Zookeeper
- Experience in column - family based Databases (HBase/NoSQL)
- Knowledge of Apache Flume, Python, Cassandra, MongoDB
- Experience as Java Developer in Web/intranet, Client/Server technologies using Java, J2EE, Servlets, JSP, JSF, EJB, Hibernate, SOAP/RESTful
- Experience in Design and Developing the Data ware using Informatica
- Experience in all phases of ETL such as Extraction, Cleansing, Transformation and Loading
- Experience in using Informatica Power Center - Workflow Manager, Workflow monitor, Source Analyzer, Designer, Transformation Developer, Mapping Designer, Repository Manager
- Experience in Database design, architecture and performance management
- Highly experienced with all the stages of Software Development Life Cycle(SDLC)
PROFESSIONAL EXPERIENCE:
Confidential, Parsippany, NJ
Sr Big data Consultant
Responsibilities:- Developed MapReduce programs to cleanse the raw data, populate staging tables and store the refined data warehouse using HIVE.
- Created HIVE tables that helped business users to spot trends by comparing fresh data with HIVE EDW reference tables and Historical metrics.
- Used Oozie to automate data loading into Hadoop Distributed File Systems and PIG scripts to pre-process the data.
- Created many custom UDF’s extending the HIVE/PIG functionality
- Experience in Importing/Exporting data from RDBMS to HDFS, HIVE and HBase tables
- Created HBase tables to load large sets of structured, semi structured and unstructured tuning and monitoring
- Experience in optimization techniques in sorting and Map-Reduce programs those will clean the raw source data
- Provided solutions to various performance bottlenecks in building HIVE/HBase data tables
- Created reports for BI team using Sqoop to export data from HDFS and HIVE data warehouse.
- Managed and reviewed Hadoop log files
- Involved in the development of Product Knowledge Base Web-site for the Confidential Employees the User interface (UI) components by using JSF, Servlets, HTML, XML, JavaScript, AJAX and CSS
- Developed Restful web-services layer to interface with PLM which is a Product repository
- Used XML Web Services using SOAP to transfer information between the pages
- Developer on various projects including:
- CID Warehouse - Development of Consolidated Confidential Data warehouse which is a central repository for Item and Inventory from various sources. JDE inventory system, MIPS which is on DB2 and also from various international systems which are on Oracle, SQL server and MySQL etc. This data lake is shared with various business users across the world.
- Google PLA Feed - Involved in design and development of Google PLA(Product Listing Ads) feed for Confidential Ecommerce websites for domestic and International sites.
- MIPS Inventory Transaction Data Warehouse - Development of EDW for MIPS
Tools: Hadoop(Cloudera), HDFS, HIVE, Spark, Scala, Impala, Hue, Java, Hbase, Sqoop, MapReduce, Attunity,Oozie, Informatica, PL/SQL, Oracle
Confidential, Somerset, NJ
Consultant
Responsibilities:- Involved in the Data Analysis of the RxClaim(DB2/400) and Recap (IBM Mainframe) Claim Adjudication systems(PBM)
- Involved in the Logical Data Modelling and Database Design
- Development of Benefit Plan Load (BPL) which is used to Upload Benefit Plans for the Migrations of AETNA, RECAP and QL.
- Worked with various data sources/targets from/to DB2(AS400 & IBM Mainframe), Teradata, Oracle, SQL Server, MS-Access, Excel
- Designed and developed Informatica Mappings, Reusable sessions, Worklets, workflows, Dynamic parameter Files
- Provided solutions for various performance bottle necks in Informatica Mappings
- Performed data quality checks using data quality tool
- Prepared source (Excels downloaded from Mainframe DB2) to Target BPF text files
- Involved in Development/Defect Fix/Testing on the following projects
- Recap to RxclaimConversion: Client Billing Reporting for Wave 0.
- RxclaimEnhancements: Eligibility Do Not delete for Addresses, Table driven CET processing, Automate e-mailing of reports.
- QL to Rxclaim Conversion: PAL4000 process for QL
- Modifications/generation of some Key Performance reports
Tools: Informatica, IBM-Mainframe, DB2/400, Teradata, Oracle, PL/SQL, Linux, XML
Confidential
Lead Developer
Responsibilities:- Manage project life cycle and tasks, from the information gathering and design process, to development and system testing, to delivery and deployment.
- Involved in the development of Website for Agency Management System the User interface (UI) components
- Involved in the Upgrade of the Claim Application Process Web UI
- Led the development efforts for Country-wide third party interfaces such as DELOS, QBE, OCH, PRA and AMR.
- Lead Developer on various projects including:
- Genesis - Developed new interface for DELOS system which is used for reporting and monthly audit for accounting.
- AMS Interface - Development of new interface for AMS Agency Management System which is used for processing Broker monthly commissions and generating checks.
- ISO Modifications - Modification of ISO interface programs as per the new specifications from ISO
- New Policy and Claims Screen Enhancements - Policy and Claims screens modifications as per the new clients PRA, QBE & OCH
Tools: Java, JavaScript, JSP, AJAX, JQuery, SOAP, Spring, Hibernate, DB2,SOAP, XML and IBM Rational WebSphere.
Confidential, Oklahoma City, OK
Consultant
Responsibilities:- Developed and modified interactive UIs using Java, JSP, AJAX, JSF and JQuery techniques.
- Developed Struts action classes, action forms and performed action mapping using Struts framework and performed data validation in form beans and action classes.
- Extensively used Struts framework as a controller to handle subsequent client requests and invoke the model based upon requests.
- Developed build and developed deployment scripts using ANT to customize WAR and EAR files.
- Responsible for working with the manager and other users and creating Workflow.
- Developed stored procedures and triggers using PL/SQL in order to calculate and update the DB2 tables to implement business logic.
- Involved in coordinating with the offshore team, coding, and testing for the following projects
Tools: Java, JavaScript, JSP, SOAP, DB2, AS400, DBU, SQL, Oracle, PL/SQL, COBOL, XML, HTML
Confidential, Tampa, FL
Programmer
Responsibilities:- As a Programmer involved in Project Planning, High level & Detail Estimations, Converting Business Requirements into Functional requirements.
- Implemented MQ-series for the CSSA front-end UI screens
- Creating work breakdown structures, test plans and test cases from Business Requirements.
- Responsible for working with the IT Director and other Business users to create Workflow.
- Involved in coordinating with the offshore team, coding, display and data management functions for the following projects
- Implementation of MQ-Series for CORE and CSSA - Interface for Back-end AS400 DB2 and the Front-end developed in VB
- SFS Host Authorization for Venezuela - Developed interface which checks the current memo balance using MQ-Series for online Authorization Transactions
- IPB Exit - Migration of IPB accounts from AS400 to Mainframe
Tools: DB2, AS400, SQL, RPG, Java, HTML, XML, MQ-Series,Oracle, Query/400, DBU, Hawkeye, XML, Implementer,
