Big Data Hadoop Resume
2.00/5 (Submit Your Rating)
PROFESSIONAL SUMMARY
- Having 8+ years of overall IT experience in Big Data Hadoop, Spark and Testing.
- Good working noledge with Pig and HIVE.
- Good working experience on Spark Core, Spark SQL.
- Experience with SPARK by improving teh performance and optimization of teh existing algorithms.
- in Hadoop using Spark context, Spark SQL,Data Frame and pair RDD's.s
- Involved in writing teh Pig scripts to reduce teh job execution time.
- Experience in huge data processing with Hadoop by writing PIG Latin scripts/UDF and HIVE Queries.
- Importing and exporting data using sqoop to and fro from HDFS.
- Managing client requirements and delivering optimal solutions within teh constraint of time/cost exceeding customer expectations.
TECHNICAL SKILLS
- Distributed Programming:
- Map - Reduce, Pig, Spark Core
- NoSQL:
- HBase.
- SQL:
- Hive, Spark SQL.
- Ingestion:
- Sqoop, Kafka, Flume.
- Scheduling:
- Oozie.
- Tools:
- QTP, Eclipse.
- Database Tools:
- Oracle 9i, Forms & Reports 6i, MySQL.
PROFESSIONAL EXPERIENCE
Confidential
Big Data HadoopResponsibilities:
- Designed and developed data loading strategies, transformation for business to analyze teh datasets.
- Processedflatfilesin variousfile formatsand stored them as in various partition models inHDFS.
- Responsible forBuilding, develop, testingshared components that will be used across modules.
- Responsible in performing sort,join, aggregations, filter, and other transformations on thedatasetsusingSpark.
- Involved in developing a linear regression model for predicting continuous measurement.
- Responsible in Implementing advanced procedures liketext analyticsand processing using teh in-memory computing capabilities likeSpark.
- Transformations and Aggregations to build teh data model and persists teh data in HDFS
- Involved in convertingHive/SQLqueries into Spark transformations using Spark RDD's.
- Experienced in working with spark eco system using Spark SQL and Scala queries on different formats like Text file, CSV file.
- Experienced in implementing Spark usingScalaandSpark SQLfor faster testing and processing of data responsible to manage data from different sources.
- Managing and scheduling Jobs on aHadoopcluster usingOozie.
- Usingspark - Cassandraconnector to load data to and from Cassandra.
- Imported teh data from different sources like LFS into Spark RDD.
- Responsible in creatingHive tables, loading with data and writingHivequeries.
- Involved in creatingExternal Hive tablesand involved in data loading and writingHive UDFs.
- Experience in using variouscompressiontechniques likeSnappy Codec and Gzipto save data and optimize data transfer over network usingAvro,Parquet.
Confidential
Big Data Hadoop
Responsibilities:
- Manage communication between clients throughout teh project.
- Designing Test scenarios and Test cases for teh jiras.
- Performing Web testing and Regression testing.
- Handle defects and participate in defect calls.
- Loading test cases in ALM.
Confidential
Responsibilities:
- Preparing Test conditions and Test cases for teh functionalities.
- Performing Web testing and Regression testing.
- Preparing Test conditions and Test cases for teh functionalities.
- Performing Web testing and Regression testing.
- Loading test cases to Test Director.
- Generate Report.
Confidential
Responsibilities:
- Understanding teh business requirements.
- Developing test scenarios and test cases to test teh complete functionality of teh application.
- Involved in testing of functionality, GUI and System testing.
- Executing Test Cases, verifying/closing of bugs.
- Release based Up gradation of regression suite
- Loading test cases to Test Director.
- Generate Report.
Confidential
Responsibilities:
- Understanding teh business requirements.
- Developing test scenarios and test cases to test teh complete functionality of teh application.
- Involved in testing of functionality, GUI and System testing.
- Executing Test Cases, verifying/closing of bugs.
- Release based Up gradation of regression suite
- Loading test cases to Test Director.
- Generate Report.:
- Understanding teh business requirements.
- Developing test scenarios and test cases to test teh complete functionality of teh application.
- Involved in testing of functionality, GUI and System testing.
- Executing Test Cases, verifying/closing of bugs.
- Release based Up gradation of regression suite
- Loading test cases to Test Director.
- Generate Report.
Confidential
Responsibilities:
- Understanding teh flow of execution of entire code given in teh COVERAGE document.
- Analyzing code to reach that particular uncovered line of code.
- Writing Low Level requirements for that uncovered code.
- Coding teh test cases in such a way that they hit that particular uncovered code segment and generate teh result file for that test case.
- Code review and filling of checklist as per teh Client Coding Standards.
- Understanding teh business requirements.
- Developing test Scripts to test teh complete functionality of teh application.
- Involved in testing of functionality, GUI and System testing.
- Preparing automated test script using QTP and executing them.
- Executing Test Cases, verifying/closing of bugs.
- Release based Up gradation of regression suite, Driver and Action scripts
- Documenting in accordance with DO 178B Standards.
- Code review as per teh DO 178B Standards.
Software Verification Test Procedure
Confidential
Responsibilities:
- Understanding teh existing manual test procedures available in SVTP document.
- Understanding teh features and usage of MultiTest Tool Environment.
- Writing teh automated test procedures in XML.
- Peer review of teh automated test procedures.
- Generating, Compiling and executing automated test procedures in Multi Test Environment.
- Verifying Automated Test Procedures and debugging if required.
- Generating teh peer review records of teh Automated Test Procedures.
- Generating teh Test Procedure Reports and Summary Reports in HTML format.
