SUMMARY:

• I have 16+ years of IT experience and which includes 6+ years of experience in Big Data Technologies (Spark, Scala, Python - Spark, HIVE, Impala, Sqoop, HBase). Have extensive knowledge and experience in IoT (Internet of Things) and multi-threaded distributed application development using Web service and well versed with using Java and C++ over Linux and other UNIX class OS. Have good experience and knowledge of Machine Learning, software design methodologies, information systems architecture, and software design patterns.
• 6+ years of experience in Big Data Technologies including Hadoop 2.6.0-Cloudera 5.10, Horton works and well versed in SPARK, Scala, Python, HIVE, Impala, Syncsort DMX-h and Sqoop.
• Expertise in writing Java User defined function (UDF’s) for Apache Hive UDF and PIG.
• Extensive knowledge and experience in AWS, Kafka, Cassandra and Azure.
• Developing the applications using programming languages like Scala and PySpark
• Exploring with various modules of Spark and working with Data Frames, RDD and Spark.
• Hand on experience in writing in application development using Java, C++ and UNIX Shell scripting
• Worked on Data frames and Spark SQL for efficient data querying and analysis
• Created numerous Internal and External tables in Hive by partitioning/bucketing concepts based on architectural design of applications.
• Work with technical and end users to understand business requirements and identify data solutions.
• Define enterprise-level standards (coding, architectural, migration), platform and tool selection.
• Develop database migration strategies, including schemas and migrating different kind of DB source system to Hadoop Data lake, Automate migration processes.
• Responsible for gathering the requirements doing the analysis and formulating the requirements specifications with the consistent inputs/requirements.
• Big Data Architect who excels in providing leadership, mentoring, and innovation to technical teams in the areas of Design and Architecture
• Experience at Project Management and Project Development with excellent team building & client interaction skills; Target and oriented with an ability to take up challenges and perform in changing work environment.
• Handled the tasks of supervising and monitoring the development team in delivering quality work.
• Lead Project delivery in agile methodology under stringent timelines and high pressure.
• Mitigate risk by identifying, escalating, and resolving issues across multiple delivery groups and/or projects.
• Worked with business partners and SME’s to understand business process needs and analyze requirements
• Experience in working with multiple application development organizations to understand systems changes and specifications.

TECHNICAL SKILLS:

Big Data Technologies: Hadoop 2.6.0-cdh5.10, Horton works 2.7.3, SPARK 2.3.0, SCALA 2.11.8, HIVE, Impala, Syncsort DMX-h, Kafka, Cassandra, PIG, HBase, Sqoop, Py-Spark, CASCADING Framework, Java UDF, Auto Sys, Ambari.

Cloud Systems: AWS - S3, EC2, Redshift, EMR, Route 53

Operating Systems: Embedded XP, Windows, RTOS, Linux, HP-Unix, Sun Solaris, AIX

Programming Languages: Python 3.7, Java 8, C++, UNIX Internals, Multithreading, ESQL/C, Pro*C, Socket Programming.

Java Technologies / Frameworks: Java 8, Java Collections, Java Multithreading, Java NetworkingJDBC, XML, SOAP, Java Swing, Web-Service (gSoap), WSO2(Web service), Java Script

RDBMS: SqlServer, DB2, Oracle 9i-11g, MySql

Scripting Languages: UNIX Shell Scripting

Development IDE / Tools: Zeppelin Notebook, Eclipse, IntelliJ, Cygwin, ASSET Simulator, KlocWork, GDB, DBX,VSCode

Networking and IoT Protocols: TCP/IP, UDP, HTTP, FTP, MQTT

Source Code Control: Git, SVN, CVS, PVCS, IBM Rational Synergy, Rational Clear Case

PROFESSIONAL EXPERIENCE:

Confidential

Responsibilities:

• Designed the Architecture and Data pipeline of this project.
• Prepared Full Design Doc and Data model for this project.
• Developed Sqoop scripts for initial loading of data
• Developed Python scripts using Spark and Machine Learning libraries.
• Wrote Shell scripts for data extracting from Adobe and injecting into HDFS.
• Developed Spark transformations of Data
• Actively participated in requirement gathering and analyzing business requirement.
• Minimized the joins of Teradata into few in Spark
• Reports on Team progress and activities consistently to the client Director.
• Mentoring and Managing our Off-Shore Development Team

Technologies: Hortonworks on RHEL 7.4, Hadoop 2.7.3, Hive, Spark 2.3.0, Python, Zeppelin Note Book, Scala 2.11.8, Shell Scripting, Teradata, Oracle, Adobe Click Stream, and Data modeling.

Confidential

Responsibilities:

• Involved in Design and Architecture of this project.
• Worked with spark programming to ingest the data from different sources.
• Prepared Design Doc and Approach Papers for this project.
• Writing the Scala with Spark Libraries to pull both the .csv and text files and convert to Data frames and temp tables to query on the typed data as per the requirement.
• Mentoring and Managing the Off-Shore development Team
• Developed Hive queries (Hql) for Provision Layers.
• Automated all the jobs using Auto Sys
• Wrote the Unix script for push the Data to different Layers.
• Responsible for direct interaction with client to gather the requirements.
• Reports on Team progress and activities consistently to the client
• Tracked and assigned the tasks to the Offshore team
• Worked with client business team to get the requirements and met the deadlines.

Technologies: Hadoop 2.6.0-cdh5.10.1, Hive, Impala, Java UDF, Unix Shell scripts, Spark, Scala, Map Reduce and Auto Sys.

Confidential

Responsibilities:

• Developed Hive queries (Hql) for Data mapping and validation.
• Developed Java UDF for getting the correct UTF timestamp
• Wrote Shell scripts for data loading and injecting into HDFS.
• Understand the bottlenecks and dependencies of existing systems
• Determine the optimal way to extract, integrate and maintain the data in the new system
• Responsible for direct interaction with client to gather the requirements.
• Performed requirement analysis and design in building the data lake.
• Work with business and Architect to understand the impact and streamline of the requirement.
• Worked as an interface between the business and technical team to get solutions to identify and solve the issues.
• Actively participated in requirement gathering and analyzing business requirement.

Technologies: Cloudera 5.8.3, Syncsort DMX-h, Hive, Impala, Java UDF, Unix Shell scripts, Python, DB2, SAS, Cobol Copy book, Sql Server, Hadoop 2.0(HDFS & Map Reduce)

Confidential

Responsibilities:

• Developed Java, HIVE for MapReduce code.
• Developing the applications using programming languages like Scala and Spark.
• Involved in implementation of CASCADING Framework for MapReduce.
• Wrote Shell scripts for Tera data offloading and injecting into HDFS.
• Work with business and Architect to understand the impact and streamline of the requirement.
• Conducted Daily Agile meetings and working sessions, to review the requirements and technical specifications, and assess the technical feasibility.
• Worked as an interface between the business and technical team to get solutions to identify and solve the issues.

Technologies: Java, CASSCADING Framework, Abinitio Graphs, Spark, Scala, HIVE, Teradata, Unix Shell scripts, XML, Hadoop 2.0(HDFS & Map Reduce)

Confidential

Responsibilities:

• Developed Java, PIG Scripts, HIVE for MapReduce code.
• Designed Table structure and created tables in Cassandra.
• Enhanced the programs to support the business requirement and new design functionality.
• Designed and implemented Apache Kafka MQ .
• Work with business and Architect to understand the impact and streamline of the requirement.
• Managed the Veeva and SAP CRM solution to realize the business benefits required in the most cost-effective way.
• Conducted Daily Agile meetings and working sessions, to review the requirements and technical specifications, and assess the technical feasibility.
• Worked as an interface between the business and technical team to get solutions to identify and solve the issues.
• Established and implemented project methodologies and processes within work teams
• Actively participated in requirement gathering and analyzing business requirement.
• Prepared & maintained all the status reports on weekly basis with the client director.

Technologies: Java, Spark, Scala, PIG, HIVE, Sqoop, Veeva, SAP CRM, Cassandra, and KafKa.

Confidential

Responsibilities:

• Leadingboth onshore and offshore Developersdoing the development, enhancement.
• Worked for the technical design for the system enhancement
• Involved in production support defect fixes.
• Tracked and assign task of the project status in Microsoft project management.
• Conducted Daily Agile meetings and working sessions, to review the requirements and technical specifications, Managing reports, analysis and decision-making for a change request.
• Actively participated in requirement gathering and analyzing business requirement.
• Work with business, Architect and the SMEs of various systems to understand the impact and streamline of the requirement.
• Prepared & maintained all the status reports on Daily basis with the client Agile Methodologies
• Enhanced the programs to support the business requirement and new design functionality.
• Managing reports, analysis and decision-making for a change request.
• Tracked and assign task of the project status in Microsoft project management.
• Work with the business for new requirements and new design functionality.
• Frequently meeting with Business Directors to update the project status and new requirements.
• Monitoring and mentoring the development team to meet the dead line of this project.

Confidential

Responsibilities:

• Managed and created the scope, cost, schedule, and contractual deliverables through the application of planning, tracking, quality assurance, change control, and risk management.
• Conducted Daily Agile meetings and working sessions, to review the requirements and technical specifications, and assess the technical feasibility.
• Actively participated in requirement gathering and analyzing business requirement.
• Work with business, Architect and the SMEs of various systems to understand the impact and streamline of the requirement.
• Enhanced the programs to support the business requirement and new design functionality.
• Improved the current system with no memory leak and handles all the transactions
• Implemented coding of adding trace logs to detect all the exception handling by the system.
• Configured the Interfaces and Device handler in ASSET Simulator for each Transaction.
• Ran Klockwork reports for handling new exception in the system.
• Code reviewing, unit testing, system testing support and user testing support
• Worked with Client technical team to get solutions to identify and solve the issues.

Environment: C++, AIX, ASSET Simulator, Dbx (debugger), Base24 GUI, Dalci scripts, Rational Synergy

Confidential

Responsibilities:

• Involved Requirement gathering, System analysis, and business/technical design.
• Created libraries for this gSoap web-service calls
• Design and developed gSoap web-service calls
• Involved design and implementation of Oracle call to web-service calls
• Implemented coding of log file parsing algorithm.
• Used Soap-UI for request and response XML’s format.
• Code reviewing, unit testing, system testing support and user testing support
• Worked as an interface between the business and technical team to get solutions to identify and solve the issues.
• In charge of all the status reporting with the management team
• Work closely with other application team to solve all the issues
• Work with business, Architect and the SMEs of various systems to understand the impact and streamline the requirement
• Actively participate in the scheduled implementations

Technologies: Java, C++, HP-UNIX, Web Service (gSoap), SOAP UI, DB2, Clear case, XML and UNIX System calls.

Associate Consultant

Confidential

Responsibilities:

• Actively participated in requirement gathering and analyzing business requirement.
• Involved Design and implementation of WSO2 web-service calls
• Identified all socket communication and implemented web-service calls.
• Writing UNIX scripts to call other applications.
• Leadingboth onshore and offshore Developersdoing the development, enhancement.
• Enhanced the programs to support the business requirement.
• Coordinates and facilitates meetings with clients on larger accounts to gather and document requirements and explore complex solutions
• Code reviewing, unit testing, system testing support and user testing

Technologies: C++, C, UNIX, TCP Socket Programming, WSO2 framework, XML and Unix System calls.

Confidential

Responsibilities:

• Worked for the technical design for the system enhancement.
• Enhanced the programs to support the business requirement.
• Involved requirement gathering and analyzing business requirement.
• Involved Design and implementation of TShell Emulator web-service calls
• Developed main module of keyboard hook procedure calls
• Implemented windows and printer API’s for this application
• Enhanced the programs to support the business requirement.
• Develops test plans to verify logic of new or modified programs.
• Hexaware Technologies - Technical Architect

Confidential

Responsibilities:

• Involved Design of this X-IPC calls and apps.
• Implemented OCI API calls in this X-IPC application
• Integrating this application to existing application
• Created Oracle queuing tables for communication
• Worked as an interface between the business and technical team to get solutions to identify and solve the issues worked for the technical design for the system enhancement.
• Enhanced the programs to support the business requirement.
• Actively participate in the scheduled implementations.
• Telcordia Technologies(Ericsson) - Lead Developer
• Detailed analysis of the application and its architecture.
• Analyzing, Coding and Testing of batch and online codes
• Preparation and review of technical specifications.
• Monitoring and supporting the batch cycles which plays significant role in the Call processing
• Developed and updated Test plans, Test Matrixes, Test Scenarios, and Test Cases for all company products.
• Created UNIX Scripts and log claims with different test scenarios.
• Conducted various management activities by analyzing and verifying test results, providing status reports
• Torry Harris Business Solutions - Software Engineer

Confidential

Responsibilities:

• Analyzing the requirements.
• Enhanced the programs to support the business requirement.
• Tested and reviewed the unit test results done by the offshore team.
• Coordinated with the team for the system changes.
• Solved the issues raised by the System test and UAT team.
• Actively participate in the scheduled implementations.
• Analyzing the design and requirements of Server system.
• Worked for the technical design for the system enhancement.
• Used TCP/IP Socket Programming for client server interaction.
• Developed TCP Client socket calls
• Implemented TCP Socket call and UNIX system calls for this application
• Tested and reviewed the unit test results for TCP communication.
• Actively participate in the scheduled implementations
• Understanding business requirement and test strategies.
• Created functional application for each API’s
• Generated test scenarios, test cases and test data. Executed tests, created problem reports.
• Worked with business analysts, developers, and content department to resolve issues.
• Developed and updated Test plans, Test Matrixes, Test Scenarios, and Test Cases for all company products.
• Created and log claims with different test scenarios.
• Conducted various management activities by analyzing and verifying test results, providing status reports.
• Created functional application for each API’s
• Generated test scenarios, test cases and test data. Executed tests, created problem reports.
• Worked with business analysts, developers, and content department to resolve issues.
• Developed and updated Test plans, Test Matrixes, Test Scenarios, and Test Cases for all company products.
• Created and log claims with different test scenarios.
• Conducted various management activities by analyzing and verifying test results, providing status reports.