Big Data Engineer Resume
SUMMARY
- Confidential has 10 years’ experience in areas like Software & Business Process Automation and Data Engineering (Big Data).
- During his recent engagement he worked as Big Data Analyst(Engineer) Role at a Retail client in Richfield, Minnesota.
- He mentored following best practices to deliver software automation needs as per the Application under test. He helped application pools integrate with data lakes and used state - of-the-art Big Data technologies into the overall architecture.
- He led a team of RPA developers through the construction, testing and implementation phase.
- He developed first Data Ingestion model using Sqoop, Spark Integration and Hive Tables setup.
- He worked on tools like IBM Watson, Microsoft Azure along with custom Code to deliver client needs.
- Integrated new tools and developed technology frameworks/prototypes to accelerate the data integration process and empower the deployment of predictive analytics.
- Working knowledge of machine learning and/or predictive modeling.
- Analytics/Machine Learning Model
- Supervised, Unsupervised m/c learning, Logistic Regression,Clustering with predictive modelling
PROFESSIONAL EXPERIENCE
Confidential
Big Data Engineer
Roles and Responsibilities:
- Experience in data migration from MSSQL/SQL/Oracle/Teradata databases to Big Data Platforms.
- Designed techniques to impose HPOV alerts on Big Data Platform during data ingestion and processing.
- Hands-on with Apache Spark and MLLib.
- In conjunction with data owners and department managers, contribute to the development of data models and protocols for mining production databases by setting up Hadoop clusters and services.
- Develop new analytical methods using Hadoop infrastructure such as MapReduce, Hive, ZooKeeper, HBase, Sqoop, Impala, Spark RDDs for data storage and analysis.
- Contribute to data mining architectures, modeling standards, reporting, and data analysis methodologies using Machine Learning techniques(Logistic Regression, SVM, Naïve Bayes, RandomForest, Decision Tree, NeuralNet e.t.c.) and Ensemble learning techniques.
- Work with application developers to extract data relevant for analysis using HiveQL,Impala queries e.t.c.
- Collaborate with unit managers, end users, development staff, and other stakeholders to integrate data mining results with existing systems.
- Provide and apply quality assurance best practices for data mining/analysis services developed Smart Dev-Ops model using Robotic Process Automation(UIPath) and Artificial Intelligence (Clustering technique applied on Agile artifacts).
- Adhere to change control and testing processes for modifications to analytical models.
- Good knowledge of Microsoft Azure Cortana API’s(Ranker, Sentiment Analytics), IBM Watson Bluemix API’s ( Rank and Retrieve, Speech Recognition NodeJS), Machine Learning custom coded use cases solve.
- Determine required network components to ensure data access, as well as data consistency and integrity.
- Respond to and resolve data mining performance issues. Monitor data mining system performance and implement efficiency improvements.
- Manage and/or provide guidance to junior members of the team.
- Identify and write Frameworks (for e.g. Testing and PageObject Models) to Automate using Selenium for Regression Suite across applications.
- Write Automation Framework using Groovy scripting for Webservice testing.
- Using Cucumber and Java code write and Enhance Automation suite(for webservices) for dot net based thick client.
Technologies: R, Python, HQL, Hadoop(eco-system), Java, Hive, PIG, Spark, HBASE, AWS, Cassandra, Mahout, NOSql, ElasticSearch, Google Cloud Platform. Java, Selenium Web Driver, Testing, SQL Server 2008, Oracle 9i, Amdocs and Tibco products, Windows XP, Eclipse, SOAP UI.UI Automation, Performance, Functional Testing, Database testing.
Confidential
Senior Quality Software Assurance Engineer
Responsibilities:
- Identify and write Frameworks (for e.g. Testing and PageObject Models) to Automate using Selenium for Regression Suite across applications.
- Write Automation Framework using Groovy scripting for Webservice testing.
- Using Cucumber and Java code write and Enhance Automation suite(for webservices) for dot net based thick client.
Confidential
Software Engineer Sr. Analyst
Roles and Responsibilities
- Performed Statistical analytics using Hive and SparkR-Hive Integration and developed in-house text analytics tool.
- Contributed ideas towards analytics strategy for enterprise customer application, leveraged in house analytics tools with Tableau to connect multiple data warehouse source nodes.
- Implemented strategy by Tableau connecting with R server to publish forecast and identify existing Watch Customers(Fraud/Abuse).
- Predictive Modelling using R Script connected with visualization tools, HIVEQL, Microsoft Azure(Cortana).
- Developed Recommender engine using IBM Watson(Bluemix) APIused Rank and Retrieve API with Speech Recognition.
- Setup/Migrate defect tracking tools like HP Quality Centre/HP ALM/Microsoft TFS for Test Team.
- Transition software development efforts to a test-driven development (TDD) process
- Develop new analytical methods and/or tools as required.
- Contribute to data mining architectures, modeling standards, reporting, and data analysis methodologies.
- Conduct research and make recommendations on data mining products, services, protocols, and standards in support of procurement and development efforts.
- Work with application developers to extract data relevant for analysis.
- Collaborate with unit managers, end users, development staff, and other stakeholders to integrate data mining results with existing systems.
- Provide and apply quality assurance best practices for data mining/analysis services.
- Adhere to change control and testing processes for modifications to analytical models.
- Create and executed automated software test plans, cases and scripts
- Test Data Management for all projects/applications
- Sharepoint management/setup
- Identify Business and IT Process Automation scope around applications and implement using Selenium and Testng framework.
- Involve in User Acceptance Test Phase
Technologies: HIVEQL, Spark, Java, SQL Server 2008, Oracle 9i, Amdocs and Tibco products, Windows XP, Tableau (Desktop), Microsoft Power BI, Eclipse, SOAP UI.Process Automation, Performance, Functional Testing, Database testing.
Confidential
Asst. Systems Engineer
Roles and Responsibilities:
- Kick off new Test Team on Mainframe based Applications.
- Assist Automation Team to validate Regression suite for existing functionalities.
- Using Mainframe systems validate Test Scenarios for Portfolio Management, Financial Services and Wealth Management programs.
- Test Cases setup/Execute/Review/Validate Test Scenarios, Test Data management, Environment Setup.
- To work with Client during Requirement Phase.
- Setup defect tracking tools HP Quality Centre for Test Team(as per needs)
- Sharepoint management/setup
- Kick off new E-Commerce Test Team from United Kingdom.
- Knowledge transition to Offshore Team and transition to Application Support Teams.
- Find out scope for any Automation for New work picked up by Organization for the first time.
- Automated Regression Suites using Selenium for the E-Commerce Application forfirst 4 phases of the project.
- To work with Client during Requirement Phase/User Acceptance Testing from United Kingdom (Client Site).
- Setup defect tracking tools HP Quality Centre/ALM for Test Team(as per needs)
- SharePoint management/Involved in ALL new process setup for Test and Support Teams.
Technologies: Functional Performance, E-Commerce Testing, and Automation Testing using Selenium and Cucumber Framework. ASP.NET, MS SQL Server 2008 Standard, Content Management SQL Lite, Load Runner, Jmeter.
