Sr. Hadoop developer Resume

CAREER SUMMARY:

Confidential is a Hadoop developer with overall 12 years of experience with successful project implementations across geographies.
His consulting experience includes experience as Hadoop developer, Big Data Analyst, Data warehouse ETL/BI developer, .NET Developer on diverse domains - Retail, Banking & Finance.
3 years of extensive experience into Big Data projects and was part of building disruptive technology where Hadoop was used as platform to build solutions for Analytics, data services and solutions.
Hands on experience in working with Hadoop ecosystems like Hive, Pig, Impala, Sqoop, HDFS; exposure to MapReduce, HBase, Oozie, Flume, Tableau
Expert in importing and exporting data into HDFS and Hive using Sqoop
Expert in writing HiveQL queries and Pig Latin scripts
Experience in working with Cloudera CDH5, Hortonworks HDP2
Experience in writing Unix Shell scripting, Python scripting
Experience in writing Hive UDF’s using Java
Experience in working both Waterfall and Agile methodologies like scrum
Experience working and managing Onsite Offshore delivery model
Knowledge of Hadoop stack administration (HDFS, Map Reduce, Hive, Sqoop)
Knowledge of Amazon AWS services
Understanding of Relational Data Model designs

TECHNICAL SKILLS:

Big Data Ecosystem: Apache Hadoop, Hive, HDFS, Sqoop, Impala, Hue, Cloudera Manager, MapReduce, Oozie, Pig, Python, exposure to (HBase, Flume, AWS)

Tracking & process management Tools: TeamCity, Kraken, SVN, JIRA, HP ALM 11.0, Rational Clear quest

Languages: Shell scripting, HiveQL, PL/SQL, (Ability to code in Java)

Other Tools / Utilities: IntelliJ IDEA, AWS Management console, Oracle SQL Developer, WinSCP, Schedulers (Autosys, Cron), Eclipse, DBeaver

RDBMS: Netezza, Oracle 9i/10g, Teradata, MS SQL Server 2005

ETL & BI Tools: Informatica 8.5/9.x, BODS, Data Stage, AbInitio, SSIS,BOXI, Micro-strategy

SAP Tools & .NET framework: SAP HANA Studio, SAP Logon/Front End, SAP Business Objects, Data Services 4.0, ASP.NET, VB.NET

WORK EXPERIENCE:

Confidential

Sr. Hadoop developer

Responsibilities:

Performed complex data validations using HiveQL on Hadoop platform
Involved in ingesting Terabytes of data from Teradata/Netezza/Oracle into HDFS/Hive using Sqoop
Involved in Encryption & Compression of files before transferring over SFTP/SCP/FileCatalyst
Involved in ingesting data from Hive to Oracle using Sqoop
Involved in parsing the JSON files & loading onto Hive
Involved in modifying the Hadoop jobs to incorporate enhancements
Expert knowledge in debugging MapReduce jobs
Develop & run HiveQL queries on Data science platform
Review data files on HDFS, Hive configuration files, Kerberos authentications
Converting the text files to Avro format while exporting the special characters to RDBMS
Used Cloudera Manager for monitoring and managing Hadoop clusters.
Monitoring Hadoop jobs in production & also bug fixing for the crucial reports like DPR
Data migration from on-prem cluster to AWS S3
Exposure to NoSQL Database like HBase
Exposure to Hadoop ecosystem components like Hue, Sqoop, HDFS, MapReduce, Hive, Impala
Exposure to various file formats like Text/CSV, RC, Avro, Parquet etc.
Facilitate periodic defect triage meetings with development and product teams
Applied SCD type 1/2/3 dimension concepts to populate the Data warehouse Dimension tables
Worked on impact analysis of different transformations, targets and sources
Dashboard reporting for management / stakeholders and providing updates on progress activities.
Responsible for demand management with resource mobilization.
Providing weekly status report with monitored RAIDC (Risk, Assumptions, Issues, Dependencies and Change).
Providing effort estimation and cost estimation for projects / feeds that are in-scope for program.
Preparation of detailed Test cases as part of Unit Testing
Technical solution guidance for data verification and validation for ETL feeds.
Backend database data validation along with data transformations as per business logic in data warehouse and Data mart projects
Used Quality Centre, JIRA for Defect Tracking and reporting
Executed sessions and batches in UNIX, Autosys and Informatica with validation of log file for failed sessions or mappings.
Providing all required support for business users and driving User Acceptance Testing (UAT)

Confidential, Concord, CA

Sr. Hadoop developer

Technology stack: Hive, HDFS, Sqoop, Shell scripting, MapReduce, Netezza, Ambari, Control-M, JIRA, FileCatalyst, Teradata

Responsibilities:

Adding Opportunity fields @SFDC, ECC, BW & EDW systems
List price & Gross price logic has changes for Booking & Billing
Opportunity ID and Opportunity Line ID would be passed on to SAP BW as an extract from EDW
Ensure the complete functionality is working from end to end i.e. From SFDC->ECC->DSO->BW->EDW->Microstrategy

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship