We provide IT Staff Augmentation Services!

Big Data/hadoop Development Resume

0/5 (Submit Your Rating)

Matthews, NC

PROFESSIONAL SUMMARY:

  • 7 years and 11 months of excellent Information Technology experience in project management, application development, business analysis, solutions architect, deployment, and implementation
  • 1 year and 8 months of experience with Hadoop and its ecosystems such as HDFS, MapReduce (MRV1 and MRV2 YARN), Pig, Hive, Hbase, Sqoop, Zookeeper, Oozie, Spark, Storm, and tools such as Tableau, Ambari, Hue, and Cloudera manager
  • Specialized in Big Data/Hadoop applications, Retail Point of Sale (POS) System, Payment Gateway Solutions
  • Good experience in use case analysis, requirements gathering, and implementation of Hadoop applications using Hortonworks and Cloudera distributions
  • Expertise in programming languages such as Java/J2EE, FORTRAN, COBOL, PERL, and DCL and application scripting in Java Script
  • Experience in working with NOSQL column oriented database with HBase and its integration with Hive and Pig
  • Excellent experience in Database using SQL Server 2008, Oracle 11i, MySQL, DB2, Flat - files system, VSAM and DMS2200
  • Specialized in Hive/HCatalog metadata using ORC and Parquet file formats
  • Hands-on experience on scheduling workflows and jobs using Oozie workflow management in Hortonworks production environment
  • Ability to elicit, analyse, verify and manage Business Requirements from all stakeholders using standardized requirement gathering techniques such as interviews, workshops, and Joint Application Development (JAD) sessions
  • Proficiency in development methodologist such as Agile, Incremental and waterfall development models
  • Creative and aggressive self-starter with integrative thinking skills, capable of forming and maintaining positive and productive working relationships in internal, external, independent, and team environments
  • Highly motivated, organized, results and detail oriented with excellent interpersonal, communication and presentation skills
  • Good exposure to Onsite-Offshore team model

TECHNICAL SKILLS:

Languages and Technologies: C, C++, Java/J2EE, Web Services (JAX-WS and RESTful), XML/XSLT, PERL, FORTRAN, Microsoft .Net Foundation,COBOL, DCL

BigData/Hadoop Components: Apache Hadoop, MapReduce (MRV1 & 2), Pig, Hive, Sqoop, Oozie, Tableau, Spark, Strom, Ambari, Hue, Cloudera Manager

Hadoop Distributions: CDH 4 & 5, HDP 2.1, 2.2 and 2.3

Operating Systems: Windows 7 and 8.1, LINUX Ubuntu, CentOS, UNIX

Databases and File systems: Hbase (NoSQL), MySQL, MS SQL Server, DB2, Oracle

Scripting Languages: Java Script, Shell Script, VB Script

PROFESSIONAL EXPERIENCE:

Confidential, Matthews, NC

Big Data/Hadoop Development

Tools: and Technologies:Apache Hadoop 2.0, Map reduce programming using Java, Pig, Hive, Hbase, Sqoop, Spark, Storm, Oozie, Linux, MySQL, HTML, Java Script, Eclipse IDE, Core Java,, Ambari and Hue

Responsibilities:

  • Involved in cluster size estimation and node validation for the new Hadoop cluster
  • Examined the installation and validated the Name node, Data node in HDFS cluster
  • Implemented data ingestion through Sqoop from various oracle tables and optimized the data loading
  • Effective business analysis and design to offload certain process from existing business process without any impact
  • Worked on data guidelines and documentation for internal application users
  • Facilitated review meetings, brain-storm and shared best practices in Hadoop implementation
  • Gathered business requirements from the stake holders and data experts in reusing legacy batch programs
  • Coordinated the Hadoop system setup and data flow implementation with IT architect
  • Executed the Hadoop Ecosystem components installation and maintenance
  • Analyzed status reports on Hadoop system performance and status along with data center administration group
  • Created project architectural design and transaction flow to identify POS Tlog related missing transaction analysis
  • Designed the Hadoop application for the new TLog analyzer
  • Data loading from the multiple applications using various data formats to the HDFS and loading the Retek pricing information into the HDFS to balance the sales data
  • Created Hive tables using ORC files, analyzed, optimized and fine-tuned the Hive engine Tez
  • Provided some HQL scripts for the BI users to analyze the intermediate results
  • Validated the Hive results, evaluated the end user formatting and file type requirements
  • Testing assistance with other application leads to complete end-to-end process validation
  • Created Map Reduce programs to analyze the T-Logs data on the HDFS system, Hive quires to analyze the report generated by the Jobs
  • Developed MapReduce jobs to process the TLogs from different time zones and regions from two different applications
  • Reviewing the MapReduce programs, quires and the database design for the proposed solution
  • Developed scripts in Pig to cleanse the raw TLog to get the necessary information and wrote user defined functions for proprietary field fragmentation purposes.
  • Successfully created workflows in Oozie and enable the scheduling for the recurring processes
  • Visualization based analytics using Tableau
  • Exploring the new process incorporating the Spark and Strom for enterprise requirements
  • Weekly batch execution monitoring and HDFS maintenance Successfully installed Oozie workflow engine to run multiple Hive and Pig Jobs required by different business users

Confidential, Matthews, NC

Solution Delivery Lead / Systems Analyst

Tools: and Technologies: SAP Core POS 2.3, SAP POS Configurator, Microsoft .Net, VB Script, Microsoft SQL Server 2008, JIRA, TFS, PVCS, NoMad, SCCM 2012, and Install Shield.

Responsibilities:

  • Technical consultation on POS system and SAP configuration
  • Coordinated with vendors on requirements clarifications, software delivery and production issues
  • Developed POS application scripts and silent installation packages for image creation and patch upgrade
  • Provided out-of-the-box features in building a robust application staging and installation modules
  • Facilitated JAD sessions with internal and external teams
  • Program management includes planning, business requirements gathering till the production rollout of each application involved in the scope
  • Executed Architectural Impact Review (AIR) meetings with customer leadership team
  • Organized the IT security audits or investigation process for payment processing applications
  • Supported Quality Assurance (QA) team in executing new patches and build during testing phases
  • Organizing steering committee meeting and project meetings
  • Onsite installation of new proposed hardware and application for the first 6 production stores in Feb 2013
  • Assisted QA team in clarifying business requirements, test strategy review, test plan and test case preparation
  • Support for pilot stores and assisting Enterprise Support Team for any new and known issues
  • Excellent track of production rollout and release management which makes business and all stakeholders to take easy business implementation decisions

Confidential

Offshore Tech Lead / Associate - Projects

Tools: and Technologies:Alpha Dec Server, OpenVMS 7.3, LINUX, FORTRAN, COBOL, Java/J2EE, Web Services, C++, DCL and PERL

Responsibilities:

  • Involved in requirement analysis and creating business requirements
  • Creating design document, software development, unit testing, performance testing and support during system testing up to national rollout
  • Interacts with other application counterparts to support end to end functional understanding and delivery
  • Key role in managing the team deliverables, project artifacts, daily and weekly status updates
  • Demonstrated experience in leading a project team in requirement analysis, design, construction, maintenance, production support and testing of application based on VMS technology
  • Wrote C++ library routines for the encryption and decryption functions
  • Create high-level and low-level design document for the new enhancements
  • Wrote Java programs for the legacy to new gen application and web services to integrate Omni channel implementation
  • Involved in construction phase, unit test case preparations, traceability matrix, and monitor quality compliance using Confidential ’s incident and project management tool.
  • Thoroughly test and debug programs to ensure accurate results and desired output
  • Coordinating onsite / offshore teams through all project phases
  • Performed unit testing cases analysis to forecast the problems areas since this deals with additional charges and maintained project to be in-line to the legal issues
  • Responsible for reviewing the design documents and code during programming phase
  • Assistance during system testing, UAT and live stores

Confidential

Programmer Trainee / Software Engineer

Tools: and Technologies: Confidential OS2200, ASCII FORTRAN, ASCII COBOL, Java/J2EE, MySQL and DMS2200

Responsibilities:

  • Software development, bug fixing
  • Code management using Confidential Repository system
  • Unit testing and creating project artifacts

Confidential

Programmer Trainee / Software Engineer

Tools: and Technologies: Java/J2EE, XML, Embedded C, RFID readers, DB2, IBM WebSphere, JSP, Servlets

Responsibilities:

  • Software development, unit testing and system integration
  • Creating high-level design documentation
  • Creating UML and process flow diagrams
  • Delivering release notes for different customers for their product
  • RFID reader communication programming
  • Image processing and warehouse management system maintenance

We'd love your feedback!