Spark Bigdata System Analyst Resume
SUMMARY:
- Seeking a challenging solution BUSINESS SYSTEM ANALYST - BIG DATA SPARK position, with a strong emphasis Hadoop, Spark & Java technologies, where I can use my current skill set, ability to learn quickly, 4 years of experience, and desire to define and create the best solutions possible to become an invaluable asset to the company.
- 4 years of overall IT experience in Application Development, System Analysis, Quality Assurance in Big Data platforms.
- Worked closely with manager to analyze & understand Business requirements; gathered User, Functional and Non-Functional requirements & translated the requirements into User Stories for Scrum process using Rally
- Generated Business Requirement documents (BRD), Functional Specification design documents (FSD) and Functional Requirement Documents (FRD)
- Led various Scrum meetings with development team to review Functional specification & design the system
- Developed Process Flow Diagram/Activity Diagrams, Test Cases, Use Cases and performed Functionality testing & Regression testing
- Strong domain knowledge in different sectors of industries such as Healthcare, Banking, Financial and Retail Services with extensive experience specializing in Investment Banking and Wealth Management.
- Expert in business process engineering and software development life cycle, including analysis, design, development, testing and implementation of software applications. Possess comprehensive knowledge of Waterfall and agile methodologies.
- Experience in Big Data/Hadoop with good knowledge of Hadoop Distributed File System and Eco System components like MapReduce, Pig, Hive, HBase, ZooKeeper, Flume, Sqoop, Oozie and Spark.
- Expertise in Hortonworks Data Platform (HDP 2.3)
- Good understanding on Hadoop MR1 and MR2 (YARN) Architecture.
- Experience on Hadoop architecture and various components such as HDFS, Name Node, Data Node, Application Master, Resource Manager, Node Manager and MapReduce programming paradigm.
- Knowledge in analyzing data using HIVEQL, PIG Latin and Map Reduce programs in JAVA.
- Good knowledge on NoSQL databases like HBase, Cassandra and Mongodb.
- Good knowledge on Kafka, Storm and Spark.
- Knowledge of job workflow scheduling and monitoring tools like Tivoli Work Scheduler, Oozie and Zookeeper.
- Good experience in UNIX and Shell Scripting.
- Comprehensive at writing and execution of SQL queries and validation of data at backend.
- Worked in a cross functional team environment in a SCRUM-Waterfall Hybrid methodology to re-engineer and integrate the data feed with the in-house database and reporting tool for the Wealth Management Division.
- Developed Themes, Features, Epics, User Stories and maintained product backlogs in Agile tool Rally (Currently CA Technologies Agile Central).
- Adept at creating and transforming business requirements into functional requirements and designing business models using UML diagrams-Context, Use Case, Sequence Activity diagrams in MS Visio and Rational Rose.
- Facilitated Executive agile transformation team to set objectives and transform deployment, budgeting, and team formation for a bank.
- Excellent facilitation skills in conducting walkthroughs, surveys, interviews, brainstorming, joint requirements planning (JRP) and joint application development (JAD) sessions.
- Performed Feasibility Analysis, Impact Analysis, Cost/Benefit Analysis, Gap Analysis, Data Analysis and Risk Analysis.
- Involved in Test Planning, Test Preparation, Test Execution, Issue Resolution, and Report Generation to assure that all aspects of a Project follow the Business Requirements.
- Experience in Project Lifecycle Management (PLM), managed multiple projects and business analysts.
- Well versed in different management scenarios like Change Management, Release Management, Quality Assurance, Defect tracking, System integration and scheduling.
- Collaborate with the Business Intelligence Team on projects regarding finance departmental needs.
- Strong interpersonal skills resulting in exceptional rapport with people, ability to meet deadlines, adaptive in learning and working on various technologies.
TECHNICAL SKILLS:
BigData Ecosystem: Hadoop, MapReduce, Hive, Pig, HBase, Sqoop, Flume, Oozie, Zookeeper
Methodologies: Waterfall, Rational Unified Process (RUP), Agile methodology
Languages: Java, J2EE, SQL
Business Modelling Tools: Rational Rose, Ms-Visio, Visual Studio
Project Management Tools: MS Project, MS Office Excel (Pivots and Micro's), MPP, JIRA
Requirement Management Tools: Rational Requisite Pro, Clear Quest, Clear Case, Rally
Databases: Oracle, My SQL
NoSQL Databases: HBase, MongoDB, Cassandra
Hadoop Distributions: Apache, Hortonworks
OS: Unix, Windows, CentOS, Linux
Design Tools: Microsoft Visio
Other: LMS, Workday, VMware Workstation
ADDITIONAL SKILLS:
- An efficient Technical and Management graduate with 6 years of experience in IT, Finance & Operations.
- Project Management
- New Product Development
- Excellent written and verbal communication skills
- Outstanding problem-solving, analytical and decision-making skills; with proven ability to conceptualize solutions to complex situations
EXPERIENCE:
SPARk BigData System AnaLYST
Confidential
Responsibilities:
- Working as a Bigdata Analyst handling a hybrid role of being both a Business System Analyst and a Data Analyst.
- Simultaneously working on various projects within Confidential ’s that impact the Bigdata application.
- As a BigData Analyst with the Bigdata Project Solutions & Analysis Team, plans, organizes, designs, creates and modifies business system requirements while managing and supporting numerous critical enterprise applications.
Data Analyst
Confidential
Responsibilities:
- Work along with the solution architects to design the data transfer and management mechanism for the Bigdata application (Datalake Application).
- Implement all the predefined standards in terms of handling data within the projects.
- Design the data retention standards and frame the standards for handling secure personal information of the customers residing on Datalake.
- Manage all the feeds coming from upstream applications and set up the landing zone based on the business requirements.
- Create the formats for the extracts that are being sent to the downstream applications based on the client requirements and communicate the plans to the development team.
- Create Application interface design and High level design documents for the development team to meet the requirements.
- Responsible to meet the information demands of our business users by delivering timely, accurate, meaningful and standardized data and reporting.
- Extensively participate in meetings with the business team to analyze the requirements and create various artifacts.
- Query the Datasets using Hive and generate valuable insights for data analysis.
- Working on Hortonworks Hadoop ecosystem with Agile Development methodology.
Business Analyst
Confidential
Responsibilities:
- Extensively used Agile Methodology in the process of the project management based on SDLC.
- Built business requirements for projects impacting BigData applications and created various project artifacts such as Business requirements document, Joint requirements document, Applications Interface design, High level design document and project scope documents.
- Interacted with Subject Matter Experts (SME), claimers, customers; Conducted detailed interviews with them, recorded the requirements, and reviewed the gathered requirement by both technical and business people.
- Effectively implemented scrum methodology using Rally by creating Epics, Themes, Features, User stories and Tasks. Tracking and managing the product backlogs.
- Documented the complete process flow to describe program development, logic, testing, and implementation, application integration, coding.
- Identified, organized, and documented the changing requirements for the application using Rational Requisite Pro.
- Participated in Daily Agile Scrum "Stand-up", Biweekly Sprint Planning and Retrospective Sessions and update the team on status of upcoming User Stories for the project of changing the client's software maintenance structure of their various projects.
- Developed test cases and test scripts and assisted Quality Assurance activities, with system integration testing and user acceptance testing (UAT).
Hadoop BigData Test AnaLYST
Confidential
Responsibilities:
- Initiated the project from scratch by laying Scope, Project plan, Low level design working with various stakeholders.
- Identified SME's in technology controls team for Risk and Control toolset and Service management toolset for integration/migration efforts.
- Ensured all artifacts complied with corporate SDLC Policies and guidelines.
- Understand enterprise workload, complex business logics and develop data model accordingly.
- Prepare the user stories, technical documentation and prioritize the tasks and work thru SCRUM/Agile process.
- Gathered business requirement through JAD sessions with SMEs and end users and in addition through document analysis, brainstorming, interviews and questionnaires.
- Analyzed various functional requirements about the pilot data ingestion plan into HDFS using tools like Sqoop, Flume and HDFS APIs.
- Worked as an Interface between users and the technical teams involved in the data transformation using tools like Pig and MapReduce.
- Prioritized outstanding issues and ensured accuracy and timelines.
- Reviewed and provided input to the testing scenarios and test cases. That were used in creating Hive external tables, added partitions, and buckets and worked to improve the performance of Hive.
- Validated the various Confidential created by Hadoop developers against functional specifications.
- Worked as an Interface between users and the technical teams involved in the application Development for the better understanding of Business and IT processes.
- Working on reporting, and data analysis validations on Corsearch internal applications for various projects. Co-ordinate with development and QA teams in clarifying the requirements and coordinating with business users and involved in all phases of the projects
- Helped Service center team in resolving various issues with Customers in Wealth Management OLS.
- Liaised with business and functional owner during risk engineering and high-level review sessions to derive and execute action plans, meeting timelines and standards.
- Worked hand in hand with respective project managers and provided value added solutions and timely support.
- Hands on experience with using Linux and HDFS shell commands.
- Developed PL/SQL procedures for processing business logic in the database.
- Got good experience with NoSQL database.
