PROFESSIONAL SUMMARY:

• Expertise in Hadoop ecosystem - HDFS, YARN, Impala, Hue, Hive for data analysis, Sqoop for data migration, Oozie for scheduling and Zookeeper for coordinating cluster resources.
• Offering over 6.7 years of rich experience across all phases of IT project life cycle management and software development with specialization in Hadoop since last 4 years and strong background in Databases and Data warehousing concepts.
• Currently associated with TCS, USA as Hadoop Developer working in Mainframe to Hadoop Conversion projects for Confidential .
• Extensive experience in managing data coming from different sources and involved in HDFS maintenance and loading of structured and unstructured data.
• Experience in Installation and Configuration of Hadoop Eco System components.
• Good knowledge on Hadoop MRV1 and MRV2 (YARN) Architecture.
• Experience in importing and exporting data using Sqoop, from HDFS to Relational Database Systems and vice-versa.
• Working knowledge on Oozie, a workflow scheduler system to manage the jobs.
• Good understanding of Hadoop Architecture and Hadoop daemons such as Name node, Secondary name Node, Job tracker, Task tracker.
• Hands on experience in HIVE. Creating Internal and External tables, Partitioning tables, bucketing tables in Hive.
• Excellent understanding of Hadoop distributed File system and experienced in developing efficient jobs to process large datasets.
• Sound knowledge in Cloudera Hadoop distribution.
• Expertise in preparing the test cases, documenting and performing unit testing and Integration.
• Very good experience in complete project life cycle (design, development, testing and implementation) of Client Server and Web applications.
• Experience with SQL, PL/SQL Queries, Teradata Utilities and Database concepts.
• Good knowledge in understanding core java basics.
• Fast learner with good interpersonal skills, having strong analytical and communication skills and interested in problem solving and troubleshooting.
• Self-motivated, excellent team player, with positive attitude and adhere to strict deadlines.

TECHNICAL SKILLS:

Hadoop Ecosystem: HDFS, YARN, MapReduce, Hive, Scoop, Impala, Zookeeper, Hue, Cloudera Manager

Programming Languages: SQL and shell scripting

Databases: Teradata

Platforms: Unix, Linux, Windows 2003/2008

PROFESSIONAL EXPÉRIENCE:

Confidential

Hadoop Developer and Onshore Lead

Responsibilities:

• Analyzed the source data coming from different sources and working with business users and developers to design the DW Model
• Translated requirements into business rules & made recommendations for innovative IT solution
• Worked closely with user decision makers to develop the transformation logic to be used in DMeXpress tool
• Configured data profile and applied data quality rules provided by the product using HQL
• Extensively worked on DMeXpress tool Transformations such as Aggregate, Copy, Join, Merge, Filter, Reformat, Partition, Map reduce
• Removed bottlenecks at source level, transformation level, and target level for the optimum usage of sources, transformations and target loads
• Created Hive tables on top of parsed data in HDFS for end user access and historical metrics
• Applied SNAPPY compression to the parsed data files and converted it into PARQUET format
• Created Shell-scripts to trigger DMX-h jobs and scheduled it to run via Autosys
• Used Oozie to develop automatic workflows of DMX-h and Hive jobs
• Interfaced with and supporting QA/UAT groups to validate functionality
• Developed the Sqoop scripts to import data from RDBMS to HIVE, RDBMS to HDFS and Export Data from HDFS to RDBMS
• Experienced in managing and reviewing Hadoop log files
• Participated in the technical reviews with respective to the progress of the project and will be working for its completion.
• Worked with business users to create reports and engaged them for testing.
• Implemented the DW tables in a flexible way to cater the future business needs
• Worked on preparing the test cases, documenting and performing unit testing and system Integration testing and fixing defects.
• Coordinated with Client and offshore for the project including status meetings.
• Responsible for ensuring quality deliverables within the stipulated timelines.
• Assist in deployment and provide technical and operation support during install as well as post-implementation.
• Ensure overall quality of all the deliverables.

Confidential

Hadoop Developer

Environment: RHEL, HIVE, SQOOP, IMPALA, DMeXpress, Autosys, Teradata Utilities

Responsibilities:

• Analyzed various applications and identified functional modifications required as part of this migration.
• Prepared High level and Low level design documents.
• Worked on environment setup for coding as part of the migration.
• Participated in the technical reviews with respective to migration, operations and will be working for its completion.
• Performed performance testing and analysis along with the performance metrics.
• Used Autosys to schedule jobs in the project.
• Worked on preparing the test cases, documenting and performing unit testing and System Integration testing and fixing defects.
• Coordinate with the end users and help them in validating the data and closing the defects with severity 1,2,3
• Effectively managed the test environment for the smooth execution of parallel projects.
• Responsible for ensuring quality deliverables within the stipulated timelines.
• Involved in post-implementation support.

Confidential

DataWarehouse Analyst

Environment: Teradata, Mainframe

Responsibilities:

• Gather requirements to develop new security compliance reports. Understand and analyze business requirements.
• Coordinate with users from different Lines of Business(LOBs) on adherence to security policies & its compliance.
• Day to day support and maintenance for applications in the Confidential Data Warehouse.
• Provide security consulting and risk assessment of Teradata platform for regulatory controls and industry standards.
• Automate compliance report via Mainframe.
• Create control procedure documents along with end to end process flow diagrams using ARIS - Business Process Modelling & Analysis Tool.
• Generate status reports and project metrics.