SUMMARY

• 8 Years of experience in Analysis, Design, Development, Testing, Customization, Bug fixes, Enhancement, Support and Implementation of various web, stand - alone, client-server enterprise applications using Python, C, Django, Django Rest Framework in various domains.
• Experience of software development in Python (libraries used: libraries- Beautiful Soup, numpy, scipy, matplotlib, python-twitter, OpenCV, Pandasdata frame, network, urllib2, MySQL dB for database connectivity) and IDEs - sublime text, Spyder, pycharm, emacs.
• Experience in implementing python alongside using various libraries such as mat plotlib for charts and graphs, MySQL db for database connectivity, python-twitter, PySide, Pickle, Pandas data frame, network, urllib2.
• Exceptionally solid background in composing API's along with Web Services over Python.
• Good working knowledge of Deep Learning Python libraries. Worked on Anaconda Python Environment.
• Experience with Design, code, and debug operations, reporting, data analysis and web applications utilizing Python.
• Primarily responsible for designing, implementing, Testing, and maintaining database solution for Azure and also strong analytical and problem-solving skills for Hadoop Data Architecture
• Backend applications using Python/Django and SQL/ PostgreSQL. Hands-on experience in writing and reviewing requirements, architecture documents, test plans, design documents, quality analysis and audits.
• Experience in AWS Cloud services such as EC2, S3, EBS, VPC, ELB, Route53, Cloud Watch, Security Groups, Cloud Trail, IAM, Cloud Front, Snowball, RDS and Glacier. Hands on experience on using SVN, Git, JIRA, Bugzilla, Axosoft, Confidential EC2/S3.
• Experience in Setup hosting on AWS EC2 instance and used Confidential SES for email delivery and hands-on experience on SCM tools like GIT, containers like Docker etc.
• Experienced on working with Docker for creating images that are deployed on AWS as Microservices and Experienced on managing the local deployments in Kubernetes and creating local cluster and deploying application containers.
• Experience with Docker containers and container orchestration systems such as Confidential ECS, Kubernetes and Docker Swarm.
• Experience object oriented programming (OOP) concepts using Python,.net, C++ and PHP.
• Experience with JSON based REST Web services and Confidential Web services (AWS) and Responsible for setting up Python REST API framework and spring frame work using Django.
• Strong expertise in development of web-based applications using Python, Java, HTML, XML, KML, Angular JS, CSS, DHTML, JavaScript, JSON and jQuery.
• Experience in working with Python ORM Libraries including Django ORM, SQLAlchemy.
• Experience in implementing with server side technologies with restful API and MVC design patterns with node JS and Django framework.
• Building and Installing servers through ARM Templates for Azure Portal.
• Extensively developed web based applications using Microsoft Visual studio .Net Framework 4.5/4.0 environment like C#, ASP.NET, MVC 4, ADO.NET, Webforms, Entity Framework.
• Experience with ORM's such as Django, database design and normalization. Proficient skills of using PyUnit, PyTest for writing unit test cases.
• Worked with .NET Server Controls, Web User Controls, Data Grid Web Control, and Form Validation Controls and created numerous Custom controls.
• Expertise in test automation and continuous delivery of web applications, client server applications, web services/REST APIs Testing, with Python.
• Hands on experience in using NOSQL libraries like MongoDB, Cassandra, Redis and relational databases like Oracle, SQLite, PostgreSQL and MYSQL databases.
• Proficient in SQL databases MySQL, Oracle and no-SQL databases MongoDB, Cassandra, Sqlite 3.
• Proficient in Front end development experience using HTML, XML, CSS, JQuery, JSON and Javascript, CSS, Bootstrap.
• Experience object oriented programming (OOP) concepts using Python, C++ and PHP.
• Experienced in WAMP (Windows, Apache, MYSQL, and Python/PHP) and LAMP (Linux, Apache, MySQL, and Python/PHP) Architecture.
• Experience with JSPm Servlets, Web Services (SOAP, REST) and Tomcat. Effective in executing multiple tasks and assignments ahead of schedule. Created and maintained effective budgets.
• Experience in writing Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on MySQL and PostgreSQL database.
• H ands-on technical experience and seasoned Azure Infrastructure and migration to Azure
• Excellent experience with Python development under Linux OS (Debian, Ubuntu, SUSE Linux, RedHat Linux, Fedora).
• Experience in leading multiple efforts to build Hadoop platforms, maximizing business value by combining data science with big data.
• Experience in installing, configuring and using eco-System components like Hadoop MapReduce, HDFS, Hbase, Pig, and Flume. Hands-on experience in UNIX and Linux Kernels. Experience in the Hadoop ecosystem components like HDFS, Spark with Scala and python, Zookeeper, Yarn, MapReduce, Pig, Sqoop, HBase, Hive, Flume, Cassandra, MongoDB, Oozie, Kafka, Flume, and TEZ.
• Experience in importing the historical data from RDBMS into HDFS using Sqoop.
• Experience Unit testing, Integration Testing and generating of test cases for web applications using Junit and Python Unit test framework Hudson/Jenkins in the builds triggered by each push to GIT.
• Exposure in building CI/CD pipelines in container-based fashion using Docker, Jenkins, UBUNTU, and Ansible& GitLab. And Experienced with GITHUB, GITLAB, SVN and MAVEN build tool.
• Primarily responsible for designing, implementing, Testing, and maintaining database solution for Azure and also strong analytical and problem-solving skills for Hadoop Data Architecture
• Experience with Apache Kafka JMS and Rabbit MQ as the message oriented middleware.

TECHNICAL SKILLS

Operating systems: Windows, Linux, MAC, UNIX

Languages: Java, C, C++, Python, 3.x/2.x

Scripting languages: CSS, AJAX, Java Script, JQuery, PHP, Shell Scripting

Analytics Tools: SAS, Tableau, Databricks

Markup languages: HTML, XML, JSON, Bootstrap

Databases: Oracle, My SQL, Postgress, Apache Cassandra, MongoDB.

Virtualization: xen, vmware, virtualbox, openstack, vagrand, docker, lxc, lxd

Methodologies & tools: Object Oriented Programming, UML, Agile Scrum, Waterfall

MS office tools: Microsoft Excel (Super user), Microsoft word, Microsoft PowerPoint

Microservices: Docker, Ansible, Jenkins

Cloud Services: AWS, Azure, Kubernetes, GCP

Testing Frameworks: PyUnit, Splunk, Selenium

Message Queue: ActiveMQ, RabbitMQ

IDEs/ Tools: Eclipse, Toad, Sublime text, PyCharm, Pgadmin, SQLite

PROFESSIONAL EXPERIENCE

Confidential, PA

Senior Full stack Python Developer

Responsibilities:

• Automate different workflows, which are initiated manually withPython scriptsandUNIX shell scripting.
• Create, activate and program inAnaconda environment.
• UsePythonunit and functional testing modules such asunit test,unittest2,mock, andcustom frameworksin-line withAgile Software Developmentmethodologies.
• Develop Sqoop scripts to handle change data capture for processing incremental records between new arrived and existing data inRDBMStables.
• Developed the web pages in ASP.NET using .NET framework in C#.NET and application programming interface
• InstalledHadoop, Map Reduce, HDFS, and AWSand developed multipleMapReducejobs inPIGandHivefor data cleaning and pre-processing.
• Gathered Semi structured data from S3 and relational structured data from RDS and keeping data sets into centralized metadata Catalog using AWS GLUE and extract the datasets and load them into Kinesis streams.
• Designed and configured Azure Virtual Networks (VNets), subnets, Azure network settings, DHCP address blocks, DNS settings, and security policies and routing
• Manage datasets usingPanda data framesandMySQL, queried MYSQL database queriesfrompython usingPython-MySQLconnector andMySQL dBpackage to retrieve information.
• Involved in theWeb/Application developmentusingPython 3.5, HTML5, CSS3, AJAX, JSONandJquery.
• Develop and tested many features for dashboard usingPython, Java, Bootstrap, CSS, JavaScriptandJquery.
• GeneratedPython Djangoforms to record data of online users and usedPyTestforwriting test cases.
• Implemented and modified variousSQL queriesandFunctions, CursorsandTriggersas per the client requirements.
• Performed different testing methods like Unit testing, Integration testing, web application testing and also experienced in migrate an On-premises VM or Azure Classic VM to Azure ARM Subscription with Azure Site Recovery
• Clean data and processed third party spending data into maneuverable deliverables within specific format with Excel macros and python libraries such asNumPy, SQLAlchemy and matplotlib.
• UsedPandasasAPIto put the data as time series and tabular format for manipulation and retrieval of data.
• Helped with the migration from the old server toJira database(Matching Fields) withPython scriptsfor transferring and verifying the information.
• Involved in the setting upMicroservicesusing API Gateway, Lambda,DynamoDB that connects to UI.
• Analyze Format data usingMachine Learning algorithmbyPython Scikit-Learn.
• Experience inpython, Jupyter, Scientific computing stack (numpy, scipy, pandasand matplotlib).
• Perform troubleshooting, fixed and deployed manyPython bug fixesof the two main applications that were a main source of data for both customers and internal customer service team.
• WritePython scriptsto parseJSONdocuments and load the data in database.
• Generating various capacity planning reports (graphical) using Python packages likeNumpy, matplotlib.
• Analyzing various logs that are been generating and predicting/forecasting next occurrence of event with variousPython libraries.
• Used JQuery, ASP.NET, AJAX toolkit controls and CSS to enhance the performance and richness to the user interface
• Developed single page application by usingAngular JSbacked byMongoDB and NodeJS.
• Design and maintaindatabasesusingPythonand developedPython based API(RESTful Web Service) usingFlask, SQL AlchemyandPostgreSQL.
• Manage code versioning withGitHub, Bit Bucketand deployment to staging and production servers and implementMVC architecturein developing theweb applicationwith the help ofDjango framework.
• Use Celery as task queue andRabbitMQ, Redisas messaging broker to execute asynchronous tasks.
• Design and manageAPI system deploymentusing fast http server andAmazon AWS architecture.
• Develop remote integration with third party platforms by usingRESTful web servicesand Successful implementation ofApache Spark and Spark Streaming applicationsfor large scale data.
• Built various graphs for business decision making usingPython mat plotlib library.
• Involved in development ofWeb ServicesusingSOAPfor sending and getting data from the external interface in theXMLformat.
• Export Test case Scripts and modified the selenium scripts and executed inSelenium environment.
• Developed entire frontend and backend modules usingPython on Django Web Framework.
• Scraping website usingPython Beautiful Soup, and then parsed it withXML.
• Outputting the parsed dataas JSON/BSONand stored intoMongoDB
• UsedNLTKandStanfordNLPto process text data and created offline intelligence.
• Querying data fromMongoDBand use them as input for the machine learning models
• UsingAWSfor application deployment and configuration.
• WroteUNIX shell scriptingfor automation.
• Developed views and templates withDjangoview controller and template Language to create a user-friendly website interface.
• UsedJavaScriptandJSONto update a portion of a webpage.
• Develop consumer based features usingDjango, HTML and Test Driven Development(TDD).
• DevelopedPython web servicesfor processingJSONand interfacing with the Data layer.
• Increased the speed of pre-existing search indexes throughDjango ORM optimizations.
• Developed module to buildDjango ORM queriesthat can pre-load data to greatly reduce the number of databases queries needed to retrieve the same amount of data.

Environment: Python 2.7, Django, HTML5/CSS, PostgreSQL, MS SQL Server 2013, MySQL, JavaScript, Jupyter Notebook, VIM, Pycharm, Shell Scripting, Angular.JS, JIRA .

Confidential, GA

Full Stack Python developer

Responsibilities:

• Instigated user interface guidelines and standards throughout the development and maintenance of the website using the HTML, CSS, JavaScript and jQuery.
• Implemented color and movement detection using API module which alerts user in real time in case of any theft at home
• Developed views and templates with Python and Django's view controller and Templating language to create a user-friendly website interface.
• Refactor Python/Django modules to deliver certain format of data.
• Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from python using Python-MySQL connector and MySQL dB package to retrieve information.
• Experience in handling REST and SOAP, API Web Services and have Knowledge of Servers like Apache Tomcat and Web Logic
• Hands on Experience in AWS like Amazon EC2, Amazon S3, AmazonRedshift, Amazon EMR and Amazon SQS, glue, Athena, lambda, etc
• Utilized ASR (Azure Site Recovery), PowerShell and MVMC (Microsoft Virtual Machine Convertor) for on-premise to cloud migrations and wrote Python modules to view and connect the Apache Cassandra instance
• Reviewed codes in Shell Script, Pearl, Python, Javascript, AWK, API C++, PL/SQL & T-SQL; created subprograms, procedures and functions, DB triggers, cursors and optimization techniques for T-SQL.
• Coordinated activities between Development, API, QA, and Product Management to ensure
• Designed a python script to load transformed data into cloud services (AWS, Azure, and GCP).
• Wrote Python scripts to parse XML documents and load the data in database.
• Parsers written in Python for extracting useful data from the design data base.
• Development of Python APIs to dump the array structures in the Processor at the failure point for debugging.
• Engineered a data processing pipeline with GCP, API, CSS, API &OpenSlide APIs to pre-process large-scale
• Utilized STL and C++ algorithms to achieve optimal design efficiency.
• Design and develop solutions using C, C++, Multi-Threaded, Shell Scripting.
• Wrote Python Scripts to handle REST API's to retrieve Network data from data centers.
• Involved in development of Web Services using SOAP for sending and getting data from the external interface in the XML format.
• Used extensively Java Script and ASP.NET AJAX for front end and Ajax framework.
• Used python libraries- API and pydicom, to parse medical imaging data.
• Developed applications using mix of technologies (Python, Django, Flask,API CSS, REST, and SOLR).
• Involved in working with python open stock API’s.
• Written functional test cases for Data Layer, and Search server classes using Django, XML base services, and RESTFUL.
• Created the Automation scripts using Python for testing applications as well as the integration of these application (API's &UI's) based on REST calls using Python, phrasing the JSON responses.
• Creating restful web services for Catalog and Pricing with Django MVT, Jersey, API, JAVASCRIPT, MySQL, and RESTFUL .
• Used Python and Django creating graphics, XML processing, data exchange and business logic implementation.
• Developed tools using Python, Shell scripting, XML to automate some of the menial tasks. Interfacing with supervisors, artists, systems administrators and production to ensure production deadlines are met.

Environment: Python 3.4/2.7, Django 1.7, RESTFUL, MySQL, C++, CSS, HTML, API, AJAX,API, GCP,, AWS, REST, GCP, REST, SOAP, jQuery, JavaScript, PyCharm.

Confidential, CA

Full Stack Python Developer

Responsibilities:

• Developed entire frontend and backend modules using Python onDjango Web Framework.
• Worked on designing, coding and developing the application in Python usingDjango MVC.
• Experience in working withPython ORMLibraries includingDjango ORM
• Worked on integrating python with Web development tools and Web Services.
• Experience withDjangoandFlaskahigh-levelPython Web framework.
• Developed tools usingPython,Shell scripting,XMLto automate some of the menial tasks. Interfacing with supervisors, artists, systems administrators and production to ensure production deadlines are met.
• Designed User Interfaces usingJQuery,Bootstrap,JavaScript,CSS3,XMLand HTML5.
• Created a Handler function in Python usingAWS Lambdathat can invoke when the service is executed.
• Developed server side usingPHPin bothWAMPandLAMPserver framework.
• Developed Business Logic using Python onDjango Web Framework.
• Developed views and templates with Python and Django'sview controllerand templating language to create a user-friendly website interface.
• Implemented Simpata virtual cloud infrastructure leveraging latest features of Azure portfolio, Microsoft Office 365, Azure Active Directory, Digital Ocean, AWS, and the Simpata dynamic data model
• Designed and developed integration methodologies between client web portals and existing software infrastructure usingSOAP API'sand vendor specific frameworks.
• UsedDjango Database API'sto access database objects.
• UsedJQueryandAjaxcalls for transmittingJSON data objectsbetween frontend and controllers.
• Created a simple AWS Lambda function using python for deployment management inAWS.
• Design, investigation and implementation of public facing websites onAmazon Web Services (AWS).
• Designed webUI componentsfor various modules and used JavaScript for client-side validation.
• Involved in buildingdatabase Model,APIsandViewsutilizing Python, in order to build an interactive web-based solution.
• Experience in AWS Cloud Computing services, such as EC2, S3, Lambda,API, DynamoDB, EBS, VPC, ELB, Route53, Cloud Watch, Security Groups, Cloud Trail, IAM, Cloud Front, Snowball, EMR and Glacier
• Designing data modeling for .NET applications of new projects and reviewing high and low level designs using VB.net
• Assist in the migration of existingSASprograms from SAS 9.2 to SAS 9.4 and validate the resultant datasets.
• UsedGolangto log the different host system event and alert information to Cassandra database.
• Deployed Core OSKubernetesClusters to manage Docker containers in the production environment with light weight Docker Images as base files.
• Developed microservices on boarding tools leveraging Python and VSTS allowing for easy creation and maintenance of build jobs andKubernetesdeploy and services.
• Modified and createdSAS datasetsfrom various input sources like flat files, CSV, and other formats, created reports and tables from existing SAS datasets.
• Worked on different data formats such as JSON, XML and performedmachine learning algorithmsin Python.
• Used pandas, numpy, seaborn, matplotlib, scikit-learn, scipy, NLTK in Python for developing various machine learning algorithms.
• Working in oauth group to support 2-leg and 3-leg oauth including OIDC protocol.
• Used Python basedGUI componentsfor the front-end functionality such as selection criteria,
• Created test harness to enable comprehensivetestingutilizing Python.
• UsedAmazon Web Services (AWS)for improved efficiency of storage and fast access.
• Added support for AmazonAWS S3andRDSto host static/media files and the database into Amazon Cloud. Deployed on AWS EC2 using nginx andgunicorn
• Built a scalable, cost effective, and fault tolerant data ware house system on Amazon EC2 Cloud. DevelopedMapReduce/EMRjobs to analyze the data and provide heuristics and reports. The heuristics were used for improving campaign targeting and efficiency.
• Developed a functional design of AWSElastic Map Reduce (EMR)specifications with respect to business requirements and technology alternatives.
• Configuration of AWS EC2Auto Scalinggroups and auto scaling policies.
• DevelopedPySparkcode to read data fromHive, group the fields and generate XML files.
• Involved in front end and utilized Bootstrap andAngularJSfor page design.
• Involved in Developing aRestful API'Sservice using Python Flask framework.
• Created Data tables utilizingPyQtto display customer and policy information and add, delete, update customer records
• UsedScalato convert Hive/SQL queries into RDD transformations in Apache Spark.

Environment: Python 3.0, Pycharm, Django, Docker, Amazon Web Services, AWS Lambda, AWS S3, JQuery, PyQuery, MySQL, HTML5, CSS3, JavaScript, Ajax, XML, Restful Web Services, JSON, Bootstrap, AngularJS, NodeJS, Flask, SQL, MySQL, Jenkins, Ansible, Git, GitHub, Linux.

Confidential, TX

Sr. Full Stack Python Developer

Responsibilities:

• Developed a part of UI using Javaspringframework,JSPs, javascript,jquery.
• Developed a web-based reporting system with Java, J2EE, Servlets,EJBandJSPusing Spring framework HTML, JavaScript.
• Developed python code usingcx oracleto retrieve data from oracle database, also retreived data from different data models and pass the data through other data models.
• Wrote and executed variousMYSQLdatabase queries from python usingPython MySQL connectorandMySQL dB package.
• Build numerousLambda functionsusing python and automated the process using the event created.
• With using of PythonOS moduleon Linux environment, made job cloning and forking.
• Worked on Python scripts toparse JSONdocuments and load the data in database.
• Developed tools using Python, Shell scripting, XML to automate some of the menial tasks.
• UsedPandas APIto put the data as time series and tabular format for east timestamp data manipulation and retrieval.
• Worked on Element TreeXMLAPIin Python to parseXMLdocuments and load data into database and also from database to XML documents.
• Designed some of the SAS data models usingBase SASandSAS Macros.
• Modified and created SAS datasets from various input sources like flat files, CSV, and other formats, created reports and tables from existingSAS datasets.
• Responsible for manipulating, transferring, managing and processing financial data in SAS using SAS Enterprise Guide underUNIXPlatform.
• Worked on validating data resulting from data source migration from Netezza to SAS.
• Modified existing SAS programs and created new programs usingSAS macro variablesto improve ease and speed of modification as well as consistency of results.
• GeneratedJUnittest cases for testing various Java components.
• HandedJava Multi-Threadingpart in back-end component, one thread will be running for each user.
• Developed Project SpecificJava API'sfor the new requirements with the Effective usage of Data Structures, Algorithms,and Core Java, OOPS concepts.
• Worked closely with the QA Manager, Team lead and developer to evaluate and enhanceautomation scriptto cover test area and test cases.
• Developed testing steps for GUI components.
• Involved in test execution and performed system Integration testing andregressiontesting.
• Involved in pre-UAT.
• UsedTest driven approach (TDD)for developing services required for the application.
• Response Time was monitored while running Baseline, Performance, Load, Stress and Endurance testing.
• Good Experience inDatabase Backupsand Recovery Strategies and Expert experience in Hot and Cold Backup of databases.
• Involved in the setting upMicroservicesusing API Gateway, Lambda,DynamoDB that connects to UI.
• Developed Complex transformations, Mapplets using Informatica toExtract, Transform and load (ETL)data intoData marts,Enterprise Data warehouse (EDW)andOperational data store (ODS).
• UsedETL (SSIS)to develop jobs for extracting, cleaning, transforming and loading data into data warehouse. WrotePL/SQLstored procedures & triggers, cursors for implementing business rules and transformations.
• Setting up Oracle read only replication with materialized views and developed scripts for automating the rebuilt process of replication.
• Strong knowledge of Oracle utilities likeSQL*Loader, Export/Import,Data Pumpand External Table.

Environment: Python 2.7, Base SAS, SAS Macros, oracle database, SAS Enterprise guide, putty, JQuery, winscp, MySQL, HTML5, CSS3, JavaScript, Toad, XML, Restful Web Services, JSON, Bootstrap, SQL, JenkinsJira, confluence, eclipse, intellij, Linux.

Confidential

Sr. Python Developer

Responsibilities:

• Implemented different python librariesNumPy,SciPy,PyTables,matplotlib,python-twitter,Pandas data frameandurllib2in various tasks
• Responsible for usingDjango, a high-level Python Web Framework to build powerful APIs and Web Applications for desktop and mobile users usingPython,HTML5,CSS3,JavaScript,Git,Command Line,Redisand Graphic Design Software's
• Developed programs to automate thetestingofRAIDcontroller firmware and utilities using Python,Java,Bash script, Windows command line.
• Developed GUI of the website using HTML5, CSS3, Typescript, Angular 2,React.js, Bootstrap and JSON.
• Provided high availability forIaasVMs and PaaS role instances for access from other services in the VNet with Azure Internal Load Balancer.
• Building a Command line tool to interact with RESTful API using inGolang.
• Creating React.js /Flux/ Redux front-end UI, and Node.js applications for backend.
• Build React components and stand-alone functions to be added to any future pages.
• Implemented, designed and coded python user defined functions inPySpark.
• Built user churn prediction model based on user behavior data(16G) usingPySparkML.
• FollowedAgileMethodologies andSCRUMProcess.
• Developed responsive web product features using React JS, SASS, onGolangwith REST.
• UsedETL/SSISandT-SQLstored procedures to transfer data fromOLTPdatabases to staging area and finally transfer into data marts and performed action inXML.
• Designed, developed, and integrated a PostgreSQL database of ontological information with a proprietary Scala- basedNLPpipeline.
• Developed strong knowledge of machine learning algorithms, metric-driven data set analysis andNLPtechniques.
• The application layer for this project isRubywhich has a custom framework(Mojo) to build API's which can be consumed by other client in the internal system of Autodesk.
• Experience in the Hadoop ecosystem components like HDFS, Spark withScalaand pythonZookeeper, Yarn, MapReduce, Pig, Sqoop, HBase, Hive, Flume, Cassandra, MongoDB, Oozie,Kafka, Flume, and TEZ
• Developing and maintenance of new and existing web application features for both internal administrators and end users usingRubyon Rails.
• Experience withUnit testing/Test driven Development (TDD),Load Testing.
• Written Programs in Spark usingScalaand Python for Data quality check.
• Build ApacheKafkaMultinode Cluster and used Kafka Manager to monitor multiple Clusters.
• Built Data Ingestion Microservice to accept and validate raw metric data and publish toRabbitMQas data
• Developed Data Processor Microservice to subscribe data fromRabbitMQ, process data and trigger actions and persist data to MongoDB.
• Used various NLP libraries likeGensim,TextBlob,spaCy.
• Worked on cross browser compilation andresponsive web designusing HTML5, CSS3 and Bootstrap
• Enhanced the PySpark code to replacesparkwith Impyla. Performed installation for Impyla on the Edge node
• Created, planned and executed multi-threadingPySparkjobs on multi node spark cluster with UDF.
• Migrated theDjangodatabase fromSQLitetoMySQLtoPostgreSQLwith complete data integrity
• Responsible for building scalable distributed data solutions usingHadoop
• Review of theAutomationscripts to make sure all the manual test cases and requirements are covered in the Regression suites.
• Worked on JavaScriptMVCframeworks like AngularJS,OpenStack
• Used Django Rest framework for creatingREST APIsand interacted with Jira usingJira Rest API
• Used other packages such as Beautiful soup for data parsing
• Used Python modules such as requests,urllib,urllib2for web crawling
• UsedApache CouchDB (NoSQL)inAWS Linuxinstance in parallel toRDS MySQLto store and analyze job market info.
• Parsing JSON files usingPySparkand applying cleaning, extracting objects for transformations ready
• Performance tuningfor data warehouse queries and indexes.

Environment: Python 2.7/3.0, Django, XML, Hadoop, pig, hive, PySpark, AWS, ETL, HDFS, HBase, mongoDB, Agile, RabbitMQ, SCRUM, PyUnit, Apache, CSS, MySQL, DHTML, HTML, JavaScript, AngularJS, Shell Scripts, Git, Linux, Unix and Windows.