SUMMARY

• 12+ years of experience in analysis, design and development of various data visualization and reporting applications, data pipelines.
• Designed and developed Big Data analytics platforms and perform ETL.
• Professional experience as a full stack developer with analytical programming using Python, R, Perl and PHP.
• Experience in Big Data technologies like Hadoop, Spark, Hive, Kafka and Sqoop.
• Create descriptive/predictive analytics solutions utilizing modern machine learning and big data technologies IPython, scikit - learn, pyspark, Numpy, Pandas, regex, matplotlib, Statsmodels .
• Developed applications using python based django, flask, tornado, Scrapy and web.py frameworks.
• Deep understanding of Statistical Analysis & Modelling, Algorithms and Multivariate Analysis.
• Experienced in Machine learning (ML) techniques: Supervised, Unsupervised and Reinforcement learning techniques in building models.
• Extensive in front end development using Angular.js, React JS, Node.js, Java Script and JQuery.
• Experience designing and implementing security focused architecture. XSS, CSRF and SSRF.
• As a site reliability engineer ensure that applications / services are highly available, reliable, and performant through world-class monitoring, alerting, and self-healing capabilities by applying DevOps best practices.
• Design and build solutions to improve the availability, latency, scalability, and performance of applications.
• Solid understanding of security access controls, security based code analysis, Web application security penetration testing and remediation for security vulnerabilities.
• Experience in working with multiple vendors and geographically distributed teams.
• Developed applications based on MVC architecture and industry standards Design Patterns.
• Involved in developing integration testing and load testing modules.
• Experience with continuous integration and automation using Jenkins and Ansible.
• Experience of working and executing projects in Waterfall and Agile methodologies.
• Experience with Test Driven Development (TDD) and Behavior Driven Development (BDD).
• Created web services for consumption by external clients for enterprise businesses and mobile applications

TECHNICAL SKILLS

Languages: Python, R, Perl, PHP, PL/SQL, Elastic search and Shell Scripting

Big Data Technologies: Hadoop, Spark, Hive, Hue, Sqoop, Apache Airflow and Kafka

Databases (SQL and NoSQL): HDFS, MongoDB, Cassandra, Oracle, Teradata, LDAP, PostgreSQL, and MySQL

Front End Scripting: Angular JS, React JS, JQuery, Node JS, HTML and Bootstrap

Frameworks: Django, Flask, PySpark, Pandas, Numpy, matplot and Tornado

Cloud: AWS, OpenStack, Google App Engine and Heroku.

Operating Systems: Red Hat Linux, Ubuntu, Windows and MAC OSX

Others: MVC Architecture, Celery, Nginx, Apache, RabbitMq, Redis, Jenkins, Ansible, Selenium, PyUnit, Jira, Git, bitbucket and SVN

PROFESSIONAL EXPERIENCE

Confidential

Responsibilities:

• As a full stack developer responsible for gathering requirements, system analysis, design, development, testing and deployment.
• Created web portal (using python/flask and angular JS) to calculate Co-term renewal dates.
• Convert manual/excel based formulas (around 70) into python using pandas and scikit-learn modules.
• Created Data pipeline between Hadoop (internal datacenter) and MySQL hosted on Google Cloud Platform using Apache spark (pyspark) to bring sales data to SQL DB
• Used OAUTH for authentication and authorization connecting to LDAP accounts.
• Developed module to export the quotes via PDF, Excel and send mail.
• User and Business acceptance testing including writing unittests.
• Tuning, applications scalability and maintainability.
• Responsible for debugging and troubleshooting the application.
• Resolved ongoing problems and accurately documented progress of the complete project.

Confidential

Responsibilities:

• Responsible for gathering requirements, system analysis, design, development, testing and deployment.
• Creating Analytics Dashboard and Reporting Application using Python.
• Performing ETL process on HDFS (Hadoop, Spark) and other DB’s
• Create automation frameworks to process the data.
• Create automation to execute jobs.
• Migrate Apache Tez jobs to Apache Airflow.
• Implementing Data Science and Machine learning models to increase sales of accuracy.
• User and Business acceptance Testing
• Tuning, applications scalability and maintainability.
• Code Reviews.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• Responsible for gathering requirements, system analysis, design, development, testing and deployment.
• Designed and implemented Apache Spark -Streaming Application.
• Analyze streaming data with offline data stored in Cassandra (In Progress).
• Written Spark jobs to reveal end user authentication and usage patterns.
• Extended foundational aspects like Job Launch Framework, Auditing and Job Monitoring.
• Conversion of Long Running legacy hive jobs to Spark jobs.
• Pilot Phase implementation based on RDD complexity, proved approach for different complexity tables.
• Used data Integration platform for extracting from source and preparing load ready files for different target systems.
• Processing data in an RDD using collections.
• Invoke operations on the RDD by passing closures.
• Client interaction and meetings for non-functional requirements gathering like performance tuning, applications scalability and maintainability.
• Code Reviews.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• Responsible for gathering requirements, system analysis, design, development, testing and deployment.
• Developed modules for internal framework Apollo.
• Automated legacy applications and services.
• Created restful services using Oauth2 Consumer authentication.
• Implemented migration modules from relational database to LDAP.
• Developed front end dashboard using Angular JS to manage the users, applications, regions and machines.
• Created modules for integration and load testing.
• Participated in the software designs, implementations, defect fixes, and deployments.
• Attending Scrum level meetings, requirements gathering, design thinking, code development, integration testing, releasing to production, deployment and production support.
• Client interaction and meetings for non-functional requirements gathering like performance tuning applications scalability and maintainability.
• Responsible for debugging and troubleshooting the application.
• Responsible for analyzing various cross-functional, multi-platform applications systems enforcing best practices to implement authentication.

Confidential

Responsibilities:

• Responsible for building scalable distributed data solutions using Apache Spark.
• Developed Spark scripts by using Python and shell commands as per the requirement.
• Used Spark API over Cloudera Hadoop YARN to perform analytics on data in Hive.
• Developed python scripts, UDFFs using both Data frames/SQL and RDD/Map Reduce in Spark 1.6 for Data Aggregation, queries and writing data back into OLTP system through Sqoop.
• Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.
• Experienced in handling large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations and other during ingestion process itself.
• Worked on migrating Map Reduce programs into Spark transformations using Spark and Scala.
• Loaded the data into Spark RDD and do in memory data Computation to generate the Output response.
• Performed advanced procedures like text analytics and processing, using the in-memory computing capabilities of Spark using Scala.
• Developed Hive queries to process the data and generate the data cubes for visualizing.
• Good Experience working with Amazon AWS for setting up Hadoop cluster.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• Design and implement Data pipeline applications that process 14TB monthly, 80 node production cluster.
• Knowledge of Hadoop ecosystem components like Map Reduce, Hbase, Hive, Sqoop, Pig.
• Analyzed large data sets using HiveQL scripts.
• Involved in HDFS maintenance and loading of structured and unstructured data.
• Written Hive queries and Pig Scripts for data analysis to meet the business requirements.
• Exported the analyzed data to the relational databases using Sqoop.
• In Depth understanding of Map Reduce Internals.
• Analyzed client requirements, prepared and presented design walk through to clients.
• Worked on multiple small projects simultaneously in a fast paced and dynamic environment.
• Prepared revenue, usage and customer trend reports used for financial analysis.
• As a developer, interacted with design and process teams that are spread across various organizations to explore solutions for business requirements.
• Well acquainted with agile methodology, sprint wise development and release wise delivery using Rally.
• Well acquainted with ETL process of a traditional Data Warehouse built on an Oracle Database using ETL tools Informatica and Pentaho.
• Used python for Flat Files processing to extract data from various excel files.
• Fine tune the existing test scripts and SQLs to increase the performance and automate the scripts to reduce the manual execution.
• Prepare the counter SQLs for the ETL validations, writing complex ETL queries in SQL.
• Provide warranty production support and indulge in on-call activities coordinating with the Operations team

Confidential

Responsibilities:

• I was responsible to interact with development team and other stake holders to perform architectural review and create test strategy.
• Wrote and maintained testing tools that increased the productivity.
• Was responsible to analyses stress, supportability, scalability, performance and reliability of the game.
• Used Git version control tool to coordinate team-development.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• I was responsible to interact with development team and other stake holders to perform architectural review and create test strategy.
• Maintained existing tools and improved readability of source code.
• Performed Architectural Review, Requirements gathering and specification reviews.
• Created monitoring tool.
• Created automated test frameworks and test suites.
• Participating in design and code inspections.
• Using Subversion version control tool to coordinate team-development.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• Participated in requirement gathering and worked closely with the client in designing and modeling.
• Used Django as front end framework along with Angularjs.
• Developed Interface for Production Team, Partners, Sponsors and Calling Ops.
• Integrated Google internal Tools using Open ID SSO.
• I have Developed small businesses registration and login process.
• Developed interface for sponsors and partners.
• View registrations, manage registrations, Chart views, submit additional content, and export import of the registrations.
• View tasks, Grab tasks, Complete Tasks, Edit Tasks.
• Pod Lead interface to manage small teams. Developed SMS integration.
• Mailing functionality, Website Handover Process.
• Team Feedback Management module. Customer Feedback Module.

Confidential

Responsibilities:

• Participated in requirement gathering and worked closely with the client in designing and modeling.
• Developed entire frontend and backend modules using Python on Django Web Framework.
• Manage Tasks, Dashboard, Nonprofits Registrations process, Enrollments,
• YouTube integration to the customer websites.
• Google Apps integration, manage leads, Google maps integrations.
• Wrapper to access Google earth.
• Integrated Google internal Tools using Open ID SSO.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• Participated in requirement gathering and worked closely with the client in designing and modeling.
• Developed entire frontend and backend modules using Python on Django Web Framework.
• Developed tools using Python, Shell scripting, XML to automate some of the menial tasks.
• Used PyQt for the functionality filtering of columns helping customers to effectively view their transactions and statements.
• Implemented navigation rules for the application and page.
• Performed testing using Django’s Test Module.
• Used Django configuration to manage URLs and application parameters.
• Also used Bootstrap and Angular.js as a mechanism to manage and organize the HTML page layout.
• Used GIT version control tool to coordinate team-development.
• Responsible for debugging and troubleshooting the application.

Confidential

Responsibilities:

• Participated in requirement gathering and worked closely with the client in designing and modeling.
• Project & Team Management and Development of all (User and Administrative) Modules of the project.
• Developing and Database Designing for the project.
• Integrated PayPal Payflow Pro and PayPal website standards payment gateway.
• Used Mootools JavaScript framework for UI development.

Confidential

Responsibilities:

• Participated in requirement gathering and worked closely with the client in designing and modeling.
• Developed entire frontend and backend modules using PHP on Drupal.
• Design, develop, test, deploy and maintain the website.
• Designed and developed the UI of the website using HTML, AJAX, CSS and JavaScript
• Designed and developed data management system using MySQL.
• Used perforce version control system
• Designing and Coding of Drupal modules.
• Installed appropriate Drupal plugins.

Confidential

Responsibilities:

• Participated in requirement gathering and worked closely with the client in designing and modeling.
• Developed entire frontend and backend modules using.
• Client Interaction and project analysis.
• Developing and Database Designing for the project.
• Developed Administrative modules.
• Used JavaScript for form validations.