Hadoop/big Data Developer Resume
4.00/5 (Submit Your Rating)
Orlando, FL
SUMMARY:
- Offer 15+ years of experience in devising and realizing diverse Software Development Life Cycle Management projects.
- Expertly helping delivering Business Intelligence efforts with strong focus on Big Data.
- Excel at identifying opportunities for software development and information management initiatives and promoting collaboration within teams.
AREAS OF EXPERTISE:
- Big Data development
- Software Development Life Cycle
- Testing Defect Management
- Planning & Estimation
- Requirements Gathering
- Analysis
- ETL
- Hadoop/HDFS/HBase/Hive/NiFi/Pig/Sqoop/Spark/HQL/NoSQL/SQL/XML/UNIX/Yarn/Scala/Python/Java Agile, Waterfall, Iterative, & Hybrid Methodologies
- ALM 11.5
TECHNICAL SKILLS:
- Windows
- Java Script
- VB Script
- Eclipse
- InteliJ
- HP Qulaity Center
- Cognos
- Sharepoint
- Zoho
- JIRA
- Git
- Rally
- Toad
PROFESSIONAL EXPERIENCE:
Confidential, Orlando, FL
Hadoop/Big Data Developer
Responsibilities:
- Requirement Elicitation from various user groups
- Analyze requirements, Model, Validate and design various processes as per the requirements
- C aptured large set of structured, semi - structured and unstructured data as per the requirements from diverse set of sources using Ni-Fi flows and Spark jobs written in Scala and Python
- Main data sources were IBM Cloudant, Amazon AWS S3, Galaxy Ticketing, MDM, Marketing Data Mart
- Used Hadoop's ability to store large quantities of structured, semi-structured and unstructured data at scale
- The data sources were in the form of XML files, csv files, Json, Avro files etc.
- Combined small files into large files for efficient processing on HDFS
- Pushed financial data from the data lake to AS400 by scheduled NiFi flows on HortonWorks cluster
- Created Hive and HBASE tables and u sed HBASE for real time data analysis using various Tablaue dashboards
- Supported data scientists in optimizing spark jobs for faster completion of iterative calculations
- Schedule various jobs using Apache Ni-Fi
- Uniti testing, system testing and supporing UAT
Confidential, Teaxs
Hadoop Developer
Responsibilities:
- Extract, combine and manipulate data located in data repositories and structured/unstructured datasets using Hadoop, HBase, HDFS, Pig, Hive, Map Reduce, Cloudera, Spark, Scala, Java, Java Scripting and Shell Scripting
- Determine if the source data is correct
- Work in a complex data environment comprising enterprise data warehouse, several additional databases and 3rd party data sources.
- Manipulate large data sets and navigate a variety of servers, data types, and data structures to complete statistical and other analyses
- Maintain and enhance a portfolio of standardized reports and dashboards
- Run monthly and quarterly marketing and product reports
- Support the ad-hoc reports based on requests from business stakeholders
- Support data science team “big data” effort through sourcing and manipulating large unstructured data sets including, call logs, social media, web browsing, network usage and internet usage patterns.
Confidential
Programmer Analyst
Responsibilities:
- W orked on complete software development life cycle, requirement elicitation, analyzing, designing, coding, testing and implementation on DPI Billing System
- U sed Java, Java Scripting, DB2, RPG/ILE, CL, MQ, SQL, IFS, FTP, FTPS, Hawkeye, Turnover, Shell Scripting and UNIX tools on IBM iseries
- Extensively worked on ETL processes to extract data from Oracle Data Base
- Provided various data sets and information for company needs.
- T echnical support to maintain the stable operation of the application
- Heaviliy involved in monitoring batch jobs, queues, sub systems, messages, history logs, scheduling, error handling, investigations of route course of job failures, creating User Defined Functions (UDFs)
Confidential
Programmer Analyst
Responsibilities:
- Requirement Elicitation, Analyzing Modeling and Validating.
- Convert Business Requirements and Rules to System Requirements
- Writing Technical Specifications according to Business and System needs
- Liaise with the Users, Managers and Vendors.
- Designing and Programming with Java, Java Script, RPG/ILE, Embedded SQL, DB2, CL and MQ to meet the business requirements with Major Banks and other Financial Institutions, Credit Bureaus and users.
- Provided ad-hoc reports
- Converted Nonpublic Personal Information (NPPI) financial data to Collection Management System for financial institutions as Amex, Citi Bank, Capone, Chase, Bank One, BOA, RBC, CIBC, TD, Bell Canada, Sears, Bay, Canada Student Loans and US Department of Education using ETL methodologies.
- Development of the test strategy, test plan, test cases & test scripts ensuring adherence to business requirements.
- Perform testing according to test plans, monitor & report on results, and work with others on problem resolution,
- Technical support to maintain the stable operation of the application
Confidential
Systems Analyst
Responsibilities:
- Design system changes to switch the company Bank Accounts to a different Bank
- Stream line Profit Plan Process and help Finance Managers to create Excel Reports with Experian Essbase on Excel
- Stream line Monthly Sales Reporting Process on the RS/6000 & Data warehouse
- Developed programs to aggregated McDonald restaurant sales data to data warehouse for the purpose monthly sales reporting, forecasting
- Perform necessary process changes using RPG/ILE, RPG IV, CL, Query/400, SQL, Unix, VB Macros Cognos Impromptu, Java, JavaScript
- Liaise with EDI and MSIS Group to research, analyze and resolve any data discrepancy transmitted for EDI
- Liaise with the Users, Managers and Vendors
- Requirement Elicitation, Analyzing, Modeling and Validating,
- Writing technical specifications according to business requirements,
- Testing, Debugging, Implementation & Documentation
