Spark Bigdata Developer Resume
SUMMARY
- 9+ years of experience in the field of Development, Quality Assurance
- Experienced in analyzing Business Requirements, Technical Requirements and Use Cases.
- Extensive knowledge of all stages of the Software Development Life Cycle (SDLC) and QA Life Cycle (STLC).
- Extremely familiar with Quality Assurance and Quality Control procedures and methodologies.
- Extensive experience with Financial, Healthcare applications and analysis of its business, technical, and functional requirements.
- Experience in Integration, Regression, Database, GUI, Connectivity and User Acceptance Testing (UAT).
- Experienced in testing Client/Server, Multi - Tier, BigData and Web based applications as well as Cloud Applications.
- Proficient in manual testing as well as in automated testing using tools such as Quality Center and Load Runner.
- Good exposure in Web based Applications testing.
- Experience in using Big data tools like Spark, Oozie workflows, Spark SQL
- Proficient in using Bug tracking and Test management tool Quality Center.
- Knowledge in C++, JAVA, SQL, Oracle, XML, UNIX Shell Scripting, Relational Database Management Systems, Cassandra,Python, MongoDB.
- Experience in Black Box Testing, End-End Testing and White Box Testing.
- Extensive experience in execution of software quality assurance methodologies on cross platform applications.
- Good exposure to software development methodologies and AGILE and Waterfall.
- A self-starter, team player and have ability to learn new concepts quickly.
TECHNICAL SKILLS
Testing Tools: Quality Center 8.5, 9.0, 9.2, Test Director, Load Runner, Quick Test Pro, Jira, Selenium, VSTS 2010, JMeter,TestNG
Databases: MS SQL Server 6.5/7.0, MS Access 2.0/7.0, Oracle 8i/9i, SQL server 2000/2005
GUI Tools: Visual Basic 6.0/5.0, Java/J2EE, JSP, SSRS, ETL, Selenium IDELanguages SQL, PL/SQL, Visual Basic, MS SQL Server, C/C++.
Scripting Languages: Python, Scala, UNIX Shell ScriptingOperating Systems Windows NT/98/95/3.11/XP/2000, UNIX.
Web Technologies: ASP, HTML, DHTML, and XML, ASP.NET, C#.
Big Data Tools: Spark, Scala, Python, Hue, Zeppelin, Alation, Open Stack Swift Object Store,,Cassandra
PROFESSIONAL EXPERIENCE
Confidential
Spark BigData Developer
Responsibilities:
- Analyzed the business requirements and System specifications to understand the process.
- Created highly efficient, performant big data solution for generating item feed files.
- As part of this project, feed files were created on a schedule, for all the items listed on Confidential .com, on a daily basis.
- As a developer in this team, I wrote the Scala program which accesses item data on Hadoop Sequence Files, performed transformations at scale, using Spark Cluster, and generated files in the tab separated values format, and compressed using gzip (parquet option also available).
- The size of the data varied from 500 GB to 50 TB.
- Used Hue for creating and scheduling workflows, and also accessing the Hadoop data using GUI.
- Used Zeppelin and Alation for writing queries for different data sources, for testing and cross referencing.
- Used Open Stack Swift for storing the final item feed artifacts (gzipped tsv files)
- Db Validations performed for all the API’s.
- Continuous Integration Jobs through Jenkins have been set up for automatic build as well deploy of the code and for regression tests.
- Experience with GIT a versioning and integration tool for check out and check in of files.
- Automation testing of the applications using TestNG, Java.
- Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, and Developers.
- Ability to multitask and work under pressure in a fast-paced environment
- Strong interpersonal and analytical skills
- Conducted Regression testing on various release of API’s involving Vouchers, GiftCards and Coupons.
- Worked in Agile environment and completed the tasks as per sprints.
- Involved in Batch job creations and testing.
Environment: Spark 2.1,Hue, Python 3.6.3, Scala,Spark-SQL,Java1.7, JBOSS, SQL Tools 1.5, Jenkins, GIT, SecureCRT, Windows 7.0, Jira 4.4, Selenium Web Driver, Maven, TestNG, YAML editor, Teradata, Alation, Zeppelin, Cassandra and OOZIE workflows
Confidential
Hadoop Bigdata Developer
Responsibilities:
- Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing
- Worked on Installing and configuring the HDP Horton works 2.x and Cloudera (CDH 5.5.1) Clusters in Dev and Production Environments
- Worked on Capacity planning for the Production Cluster.
- Involved in loading data from UNIX file system to HDFS.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
- Involved in Configuring Kerberos Authentication in the cluster, cluster upgradation in Hadoop and fixing cluster issues.
- Worked on taking Snapshot backups for Hbase tables.
- Involved in Cluster Monitoring backup, restore and troubleshooting activities.
- Responsible for implementation and ongoing administration of Hadoop infrastructure.
- Importing and exporting data from different databases like MySQL, RDBMS into HDFS and HBASE using Sqoop.
- Responsible for Cluster maintenance, Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
- Day to day responsibilities includes solving developer issues, deployments moving code from one environment to other environment, providing access to new users and providing instant solutions to reduce the impact and documenting the same and preventing future issues.
- Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades.
- Monitored workload, job performance and capacity planning
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions.
- Creating collections and configurations, Register a Lily Hbase Indexer configuration with the Lily Hbase Indexer Service.
Environment: Hadoop, MapReduce, Yarn, Hive, HDFS, PIG, Sqoop, Impala, Spark, Cloudera, Flume, HBase, CDH5, and Unix/Linux, Hue (Beeswax).
Confidential
Lead Quality Engineer
Responsibilities:
- Managed a team of three quality engineers and worked closely with different development teams
- Coordinated activities which enforce quality improvements and resolving conflicts among team members.
- Co-ordinated with Development teams and StakeHolders in completing the deadlines of the project.
- Analyzed the business requirements and System specifications to understand the process.
- Involved in writing the Test Cases depending on the business requirement documents.
- Involved in testing of Web services using SOAP UI.
- Involved in reporting defects using JIRA.
- Developed code coverage reports for the Java applications using JBOSS, JAVA and EMMA code coverage tool.
- Experience withPerforce a versioning and integration tool for check out and check in of files.
- Automation testing of the applications using QTP scripts.
- Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, and Developers.
- Coordinating testing of software defects, enhancements, and upgrades with other application teams.
- Worked with Rabbit tool for build and deployments of the code.
- Analyzed JBOSS server error logs for different roles using Poderosa.
- Ability to multitask and work under pressure in a fast-paced environment
- Strong interpersonal and analytical skills
- Performed multi browser testing of the projects.
- Involved in testing the mobile applications.
- Conducted Regression testing on various releases of the application.
- Worked on VMWare cloud instances to test the functionality.
- Performed Functionality, Security, Integration, Regression and Usability Testing.
- Converted all P1, P2 and P3 test cases from QTP scripts to MAUI Automation Framework (an Confidential framework).
- Worked on STAF Automation Framework using Selenium Web Driver, API Driver in converting P1, P2 and P3 test cases in Java.
- Developed code in Java to execute SOAP requests and responses using XML and CSV files.
- Implemented Data Providers for executing the regression test cases without using Database.
Environment: Java1.6, JBOSS, SQL Tools 1.5, Rabbit 2.0, Perforce Visual Client, Poderosa, Windows 7.0, Jira 4.4,Selenium Web Driver, API Driver, Cloud Applications.
Confidential
Sr.QA Analyst
Responsibilities:
- Analyzed the business requirements and System specifications to understand the process.
- Involved in writing the Test Cases depending on the business requirement documents.
- Used Visual Studio 2010 Ultimate for writing the test cases.
- Performed manual testing in Agile Methodology.
- Involved in executing the test cases in VSTS 2010.
- Extensively involved in performing the backend testing of the application by writing and executing various SQL Queries to perform validity of the data.
- Wrote SQL queries using Joins and sub queries to check the integrity of the data.
- Involved in Creating and maintaining defects using Lab Management
- Involved in reporting defects.
- Developed scenarios for Load Test based on the user activity.
- Involved in performance test using VSTS 2010 ULTIMATE.
- Stress and Performance testing done on the websites by creating Virtual users for different user loads and times.
- Done testing on different servers to check the daily jobs executed to transfer the data from one table to another.
- Extensively involved in performing the backend testing of the application to develop and execute various SQL Queries, using SQL Server2005 to perform validity of the data.
- Expertise in writing SQL queries using SQL functions, Joins, subqueries etc.
- Understanding of database design and data structures (Oracle and SQL Server)
- SQL development for data verification / validation.
- Attended standup meetings as well as developer’s meetings to fix the bugs.
- Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, Developers and Business Stakeholders.
- Coordinating testing of software defects, enhancements, and upgrades with users and other application teams.
- Developed the test cases to test user interface and functionality of the application.
- Done multi browser testing of the projects.
- Involved in testing the mobile applications.
- Conducted Regression testing on various releases of the application.
- Performed Functionality, Security, Integration, Regression and Usability Testing.
- Provide status reports to appropriate groups concerning test issues and progress.
- Reaching the deadlines according to the requirements in Agile Methodology.
- Training to the end users regarding the applications.
Environment: Microsoft Visual Studio 2010, SQL SERVER 2005, C#, ASP.NET, Windows 7.0
Confidential, WESTCHESTER, IL
Sr.QA Analyst
Responsibilities:
- Analyzed the business requirements and System specifications to understand the process.
- Involved in writing the Test Cases depending on the business requirement documents.
- Used Visual Studio 2008 and 2010 for writing the test cases.
- Performed manual testing in Agile Methodology.
- Involved in executing the test cases in VSTS 2010.
- Extensively involved in performing the backend testing of the application by writing and executing various SQL Queries to perform validity of the data.
- Wrote SQL queries using Joins and sub queries to check the integrity of the data.
- Involved in Creating and maintaining defects using Quality Center.
- Involved in reporting defects using Quality Center.
- Developed scenarios in Load Runner.
- Involved in performance test using VSTS 2010 ULTIMATE.
- Stress and Performance testing done on the websites by creating Virtual users and generated the reports.
- Done testing on different servers to check the daily jobs executed to transfer the data from one table to another.
- Extensively involved in performing the backend testing of the application to develop and execute various SQL Queries, using SQL Server2005 to perform validity of the data.
- Understanding of database design and data structures (Oracle and SQL Server)
- SQL development for data verification / validation.
- Attended standup meetings as well as developer’s meetings to fix the bugs.
- Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, Developers and Business Stakeholders.
- Coordinating testing of software defects, enhancements, and upgrades with users and other application teams.
- Developed the test cases to test user interface and functionality of the application.
- Tested the projects on IPhone, IPAD.
- Done multi browser testing of the projects.
- Involved in testing the mobile applications.
- Conducted Regression testing on various releases of the application.
- Performed Functionality, Security, Integration, Regression and Usability Testing.
- Provide status reports to appropriate groups concerning test issues and progress.
- Reaching the deadlines according to the requirements in Agile Methodology.
Environment: Microsoft Visual Studio 2010, SQL SERVER 2005, C#, ASP.NET, SNAG - IT, Windows 7.0
Confidential
Sr.QA Tester
Responsibilities:
- Analyzed the business requirements and System specifications to understand the process.
- Involved in writing the Test Cases depending on the business requirement documents.
- Used Quality center for writing the test cases.
- Performed manual testing using Quality center.
- Involved in executing the test cases in Quality center.
- Extensively involved in performing the backend testing of the application to develop and execute various SQL Queries, using TOAD to perform validity of the data.
- Wrote SQL queries to check the integrity of the data.
- Involved in Creating and maintaining defects using Quality Center.
- Involved in reporting defects using Quality Center.
- Developed scenarios in Load Runner.
- Involved in using Load Runner for Stress and Performance testing by creating Virtual users.
- Run various jobs in UNIX using UNIX commands.
- Wrote UNIX commands like FTP, GZIP, and GUNZIP for file transfers.
- Involved in working with files in UNIX.
- Prepared weekly defect reports and weekly test metrics.
- Attended team meetings as well as developer’s meetings.
- Participated in project updates meetings, defect review meetings and defect report meetings.
- Coordinating testing of software defects, enhancements, and upgrades with users and other application teams.
- Performed Functionality, Security, Integration, Regression and Usability Testing.
- Provide status reports to appropriate groups concerning test issues and progress.
Environment: Quality Center, Load Runner, Oracle 9i TOAD SQL, PL/SQL, HTML, Java, UNIX.
Confidential
Sr.QA Tester
Responsibilities:
- Involved in preparing test plans based on Business Requirements Documents (BRD).
- Developed the test cases to test user interface and functionality of the application.
- Tests were planned and managed using Quality Center and performed Manual Testing.
- Performed Functional, Integration, System, Regression testing..
- Tracked and reported bugs using Quality Center.
- Performed database validation by executing SQL queries Interacted with Developers as needed to isolate the main cause of defects and performed SQL backend testing.
- Conducted Regression testing on various releases of the application.
Environment: Quality Center9.2, .NET Framework, ASP.NET, VB.NET, VBScript, JavaScript, HTML, Shell Scripting, XML, SQL Server 2000, UNIX.