SUMMARY

• Over 9+ years of experience as a Web/Application Developer and coding with analytical programming using Python, Java.
• Experienced with full software development life - cycle, architecting scalable platforms, object oriented programming, database design and agile methodologies.
• Experienced in MVW frameworks like Django, Angular.js, Java Script, JQuery and Node.js and expertise knowledge of and experience in object oriented Design and Programming concepts.
• Experience object oriented programming (OOP) concepts using Python, C++, Java and PHP.
• Experienced in WAMP (Windows, Apache, MYSQL, and Python/PHP) and LAMP (Linux, Apache, MySQL, and Python/PHP) Architecture.
• Experience on Key AWS services: EC2, S3, DynamoDB and Lambda and experienced in creating Amazon EC2 instances and setting up security groups and Configured Elastic Load Balancers with EC2 Auto Scaling groups.
• Experienced in developing web-based applications usingPython, DJANGO, GTK, QT, XML, CSS, HTML, DHTML and JQuery.
• Experience in leading multiple efforts to build Hadoop platforms, maximizing business value by combining data science with big data and advised organizations about big data, a big data strategy, and the implementation of big data, which technologies best fit the needs of the organization and even implements the selected big data solution.
• Experience in project deployment using Jenkins and using web services like Amazon Web Services (AWS) EC2 and AWS S3.
• Proficient inHadoopArchitecture and various components such as HDFS, Job Tracker, Task Tracker, Data Node, Name Node and Map-Reduce concepts.
• Experienced in Python's modules Numpy, matPlotLib, Seaborn, Pickle, PySide, Scipy, wxPython, PyTables etc. for generating complex graphical data, creation of histograms etc
• Experienced in developing web-based applications using Python, Django, PHP, C++, XML, CSS, HTML, DHTML, JavaScript and JQuery.
• Experienced in developing applications using amazon web services like EC2, Cloud Search, Elastic Load balancer ELB, S3, Cloud Front.
• Experienced in installing, configuring, modifying, testing and deploying applications with Apache.
• Experienced in NoSQL technologies like MongoDB, HBase, relational databases like Oracle, SQLite, PostgreSQL, Dynomodb and MySQL databases
• Well versed with design and development of presentation layer for web applications using technologies like HTML, CSS, and JavaScript and familiar with JSON based REST Web services and Amazon Web services.
• Experienced working on with Integrated Development Environments (IDE's) like PyCharm, PyScripter, Spyder, PyStudio, PyDev and Sublime text.
• Experience in writing Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on MySQL and PostgreSQL database.
• Experienced in agile and waterfall methodologies with high quality deliverables delivered on-time.
• Experience in utilizing SAS Procedures, Macros, and other SAS application for data extraction, data cleansing, data loading and reporting.
• Experience with continuous integration and automation using Jenkins and experienced with Unit testing/ Test driven Development (TDD), Load Testing.

TECHNICAL SKILLS

• Java
• Python
• C++
• HTML
• XML
• CSS
• DHTML
• JavaScript
• JQuery
• AJAX
• Angular JS
• Heroku
• Jenkins
• Devops
• Puppet
• Django
• Flask
• Web2py
• Bottle
• Pyramid
• PyCharm
• Sublime Text
• Eclipse
• Net Beans
• RAD
• Web Logic Workshop
• SQL
• PL/SQL
• MySQL
• MS SQL Server 2008/
• Oracle 12c/11g/10g
• MongoDB
• Cassandra
• SQR reports
• AXSPoint Reports
• Sql Server Reporting Services (SSRS 2008/2005)
• Bugzilla
• Junit
• Jira
• WebSphere
• Apache
• WebLogic
• Apache
• Linux
• Windows
• Unix
• OS X
• :Python
• Django
• Flask
• JavaScript
• SQL
• Ajax
• Html-5
• CSS-3
• Bootstrap
• Web services
• Mongo DB-3.2Xampp
• MySQL
• XML
• JQuery
• AngularJS
• REST
• JSON
• Eclipse
• Git
• DevOps
• AWS
• Linux
• Shell Scripting
• Agile
• Scrum
• Hadoop
• Hive
• Pig
• MapReduce
• AWS S3
• AWS Cloud Watch
• AWS Redshift
• SQL
• ETL.

PROFESSIONAL EXPERIENCE

Sr. Python Developer

Confidential, Chicago IL

Responsibilities:

• Participated to develop a data platform from scratch and took part in requirement gathering and analysis phase of the project in documenting the business requirements.
• Worked in designing tables in Hive, MYSQL using SQOOP and processing data like importing and exporting of databases to the HDFS, Involved in processing large datasets of different forms including structured, semi-structured and unstructured data.
• Developed rest API's using python with flask and django framework and done the integration of various data sources including Java, JDBC, RDBMS, Shell Scripting, Spreadsheets, and Text files.
• Worked with Hadoop architecture and the daemons of Hadoop including Name-Node, Data Node, Job Tracker, Task Tracker, and Resource Manager.
• Used AWS data pipeline for Data Extraction, Transformation and Loading from homogeneous or heterogeneous data sources and built various graphs for business decision-making usingPythonmatplot library
• Developed python scripts to load data to hive from HDFS and involved in ingesting data into Data Warehouse using various data loading techniques.
• Developed pig scripts and hive scripts for processing the data and handled the JSON, XML, Log data using Hive (SERDE), Pig and filter the data based on query factor.
• Scheduled Jobs using crontab, rundeck and control-m.
• Developed and validate novel airflow management features and systems.
• Used Python based tools such as Airflow or Luigi as well as other tools to provide ETL, Data Cleansing and Data Mining of large, complex datasets derived from multiple structured and unstructured sources.
• Created an Azure Web Site and publish an existing ASP.NET web application to the site. Create an Azure SQL server and database. Create a Virtual Machine using the existing SQL template and connect this Virtual Machine to the existing application.
• Managed and maintained thousands of production customer databases and Elasticsearch nodes and indexes associated with search capabilities
• Managed large database clusters and improve existing Elasticsearch performance for our multitude of existing customer bases.
• Experience in implementing and deploying workloads on Azure VM. Good understanding of Azure Web App hosting plans and experience of Implementing, deploying and configuring Azure Websites. Good understanding of Azure SQL, networking concepts. Azure Virtual Network.
• Build Cassandra queries for performing various CRUD operations like create, update, read and delete, also used Bootstrap as a mechanism to manage and organize the html page layout
• Developed entire frontend and backend modules usingPythonon Django Web Framework and created User Interface (UI) using JavaScript, bootstrap, Cassandra with MySQL and HTML5/CSS
• Importing and exporting data jobs, to perform operations like copying data from HDFS and to HDFS using Sqoop and developed Spark code and Spark-SQL/Streaming for faster testing and processing of data.
• Wrote and Implemented Apache PIG scripts to load data from and to store data into Hive and Data was Ingested which is received from various database providers using Sqoop onto HDFS for analysis and data processing.
• Added support for Amazon AWS S3 and RDS to host static/media files and the database into Amazon Cloud.
• Developed multi-threaded standalone app inPython, PHP, C++to view Circuit parameters and performance.
• Worked in development of applications especially in LINUX environment and familiar with all its commands and worked on Jenkins continuous integration tool for deployment of project and deployed the project into Jenkins using GIT version control system
• Managed the imported data from different data sources, performed transformation using Hive, Pig and Map- Reduce and loaded data in HDFS.
• Executed Oozie workflow engine to run multiple Hive and Pig jobs, which run independently with time and data availability and developed Oozie workflow to run job onto data availability of transactions.
• To achieve Continuous Delivery goal on high scalable environment, used Docker coupled with load-balancing tool Nginx.
• Used MongoDB to stored data in JSON format and developed and tested many features for dashboard usingPython, Bootstrap, CSS, and JavaScript.
• Used Shell scripting to analyze the data from SQL Server source and processed it to store into HDFS and generated reports from Hive data using Microstrategy.
• Increased the time efficiency of the HIVEQL and reduced the time difference of executing the sets of data by applying the compression techniques for Map-Reduce Jobs and created Hive Partitions for storing Data for Different Companies under Different Partitions.

Environment: Hadoop, Hive, Sqoop, Pig, java, Django, Flask, XML, MySQL, MS SQL Server, Linux, Shell Scripting, Mongodb, SQL, Python3.3, Django, HTML5/CSS, Cassandra, JavaScript, PyCharm, GIT, Linux, Shell Scripting, RESTful, Docker, Jenkins, JIRA, JQurey, MySQL, Bootstrap, HTML5, CSS, AWS, EC2, S3.

Sr. Python Developer

Confidential, Charlotte NC

Responsibilities:

• Participate in requirement gathering and analysis phase of the project in documenting the business requirements by conducting workshops/meetings with various business users.
• Developed Python/Django application for Google Analytics aggregation and reporting and used Django configuration to manage URLs and application parameters.
• Worked on Python Open stack API's and used Python scripts to update content in the database and manipulate files.
• Generated Python Django Forms to record data of online users and detailed Understanding on existing build system, Tools related for information of various products and releases and test results information.
• Designed and implemented map reduce jobs to support distributed processing using java, Hive and Apache Pig.
• Involved in using AWS for the Tableau server scaling and secured Tableau server on AWS to protect the Tableau environment using Amazon VPC, security group, AWS IAM and AWS Direct Connect.
• Configured EC2 instances and configured IAM users and roles and created S3 data pipe using Boto API to load data from internal data sources.
• Configured JBoss cluster and MySQL database for application access and developed UDF's to provide custom hive and pig capabilities.
• Involved in creating an Azure cloud business case template for clients by comparing On-Premises cost v/s Azure costs.
• Built a mechanism for automatically moving the existing proprietary binary format data files to HDFS using a service called Ingestion service.
• Involved and worked onPythonOpen stack API'sand used severalpythonlibraries such as wxPython, numPy and matPlotLib
• Experience working with distributed machine learning or data processing systems such as Spark or Airflow.
• Performed Data transformations in HIVE and used partitions, buckets for performance improvements.
• Ingestion of data into Hadoop using Sqoop and apply data transformations and using Pig and HIVE.
• Used Python and Django creating graphics, XML processing, data exchange and business logic implementation
• Used Git, GitHub, and Amazon EC2 and deployment using Heroku and Used extracted data for analysis and carried out various mathematical operations for calculation purpose usingpythonlibrary - numpy, scipy.
• Developed server based web traffic using RESTful API's statistical analysis tool using Flask, Pandas.
• Developed PL-SQL store procedures to convert the data from Oracle to MongoDB and automate report generation in MongoDB using JavaScript, Shell Scripting, SED, Java.
• Used Pandas API to put the data as time series and tabular format for east timestamp data manipulation and retrieval.
• Created sustainable and maintainable environments for our NoSQL and Elasticsearch arenas
• Added support for Amazon AWS S3 and RDS to host static/media files and the database into Amazon Cloud.
• Systems automation utilizing Control-M for scheduling and Powershell/C# for script development and used Pandas library for statistical Analysis.
• Used Amazon Elastic Beanstalk with Amazon EC2 to deploy project into AWS and good experience with AWS storage services (S3)
• Developed tools using Python, Shell scripting, XML to automate some of the menial tasks. Interfacing with supervisors, artists, systems administrators and production to ensure production deadlines are met.
• Participate in the design, build and deployment of NoSQL implementations like MongoDB.
• Worked very closely with designer, tightly integrating Flash into the CMS with the use of Flashvars stored in the Django models and also created XML with Django to be used by the Flash.
• Used HTML, CSS, JQuery, JSON and Javascript for front end applications and designed and developed the UI of the website using HTML, XHTML, AJAX, CSS and JavaScript.
• Also used Bootstrap as a mechanism to manage and organize the HTML page layout and used Django configuration to manage URLs and application parameters.
• Wrote and executed various MYSQL database queries from Python using Python-MySQL connector and MySQLdb package.
• Developed variousPythonscripts to find vulnerabilities with SQL Queries by doing SQL injection, permission checks and performance analysis and developed scripts to migrate data from proprietary database to PostgreSQL.
• Involved in development of Web Services using SOAP for sending and getting data from the external interface in the XML format.
• Responsible for debugging the project monitored on JIRA (Agile) and Worked on development of SQL and stored procedures on MYSQL.
• Performed troubleshooting, fixed and deployed many Python bug fixes of the two main applications that were a main source of data for both customers and internal customer service team.

Environment: Python, Hive, Oozie, Amazon AWS S3, MySQL, HTML, Python 2.7, Django, HTML5, CSS, XML, MySQL, MS SQL Server, GIT, Jenkins, JIRA, MySQL, Cassadndra, Pig, Hadoop, AWS Cloud Watch, AWS Redshift, SQL, SOAP, Rest APIs, AWS EC2, XML, JavaScript, AWS, Linux, Shell Scripting, AJAX, Mongodb.

Sr. Python Developer

Confidential, Dallas TX

Responsibilities:

• Worked with team of developers on Python applications for RISK management and designed the database schema for the content management system.
• Designed and developed the UI of the website using HTML, XHTML, AJAX, CSS and JavaScript.
• Involved in development of Web Services using SOAP for sending and getting data from the external interface in the XML format.
• Wrote Python routines to log into the websites and fetch data for selected options and performed testing using Django's Test Module.
• Involved in installing, configuring and using Apache Hadoop ecosystems such as Pig and Spark.
• Built the entire Hadoop platform from scratch and ingested real time/near real time data using Flume, Kafka, Storm
• Worked with JSON based REST Web services and Amazon Web services (AWS) and Responsible for setting upPythonREST API framework and spring frame work using DJANGO.
• Evaluated suitability of Hadoop and its ecosystem to the above project and implementing / validating with various proof of concept (POC) applications to eventually adopt them to benefit from the Big Data Hadoop initiative.
• Developed entire frontend and backend modules usingPythonon DjangoWeb Framework.
• Estimated the Software & Hardware requirements for the Name Node and Data Node in the cluster.
• Extracted the needed data from the server into HDFS and Bulk Loaded the cleaned data into HBase using MapReduce
• Developed CI/CD methodology in Azure using VS online, TFS and DevOps.
• Written the Map Reduce programs, Hive UDFs in Java and develop HIVE queries for the analysts and defined job work flows as per their dependencies in Oozie.
• Closely observed building the Reporting Application, which uses the Spark SQL to fetch and generate reports on table data
• Used severalpythonlibraries such as wxPython, numPy and matPlotLiband usedpythonscripts to update content in the database and manipulate files.
• Implemented Business logic, worked on data exchange, processed XML and HTML usingPython2.7 and its familiar framework Django.
• Managed datasets using Panda data frames and MySQL, queried MYSQL database queries fromPythonusingPython-MySQL connector and MySQL dB package to retrieve information.
• Knowledge in performance troubleshooting and tuning Hadoop clusters in Cloudera
• Worked on middle tier and persistence layer. Created service and model layer classes and Value objects/ POJO to hold values between java classes and database fields.
• Exported/Imported data between different data sources using SQL Server Management Studio and maintained program libraries, users' manuals and technical documentation.
• Developed Application to access JSON and XML from Restful, WebServices from consumer side using JavaScript and Angular.JS.
• Used Django framework to develop the application and usedPythonmodules such as requests, urlib, and urlib2 for web crawling
• Responsible for debugging and troubleshooting the web application and successfully migrated all the data to the database while the site was in production.
• Implemented the validation, error handling, and caching framework with Oracle Coherence cache.
• Worked on scripts for setting up the discovery client with attribute data. Worked on scripts (granite reference data scripts) for setting up adapter attributes in granite system.
• Utilized SAS procedures, Macros and other SAS application for data extraction, data loading, cleaning and reporting.

Environment: Python 2.7, Hadoop, Django 1.4, HTML5, CSS, XML, MySQL, JavaScript, JQuery, Mongo DB, MS SQL Server, JavaScript, GitHub, AWS, Linux, Hadoop, Hive, Cassandra, Pig, Oozie, Sqoop, MapReduce, AWS S3, AWS, EC2, AWS, Python Libraries, Shell Scripting, SQL, JASON, ETL, AJAX.

Sr. Python Developer

Confidential, NYC NY

Responsibilities:

• Involved in Data warehouse migration Sybase 12.5 to Sybase 15 and more than 70% of work is developing code in Python, remaining time spent on database development and data modeling.
• Worked on requirement gathering, high level design, implementation, testing and deployment of code and creating and following the production deployment run book.
• Did Proof of Concept on DB2 BLU(column organized database)
• Designed and developed reusable Autosys jobs parsing and documentation software in Python using object oriented features, being implemented in other projects in firm.
• Designed and developed database object parsing, dependency builder and documenting software in Python using object oriented features
• Developed ETL (Extract Transform Load) software for DB2 columnar database fact and dimension tables.
• Massive data processing (Sybase ~15TB and Db2 ~2TB) and data modeling in Sybase and DB2.
• Setting up schema, users, permissions, creating database objects and involved in database performance tuning - procedures, table functions(db2)
• Data reconciliation program for Sybase vs Db2, and Db2 vs Db2 (prod vs QA) in Python used other tools developed in Python to automate daily activities in python like monitoring DB
• Worked with shell scripts to build wrapper around ETL to do one time historic load.
• GeneratedPythonDjango forms to record data of online users and used PyTest for writing test cases.
• Designed and Developed User Interface using front-end technologies like HTML, CSS, JavaScript, JQuery, AngularJS, Bootstrap and JSON.
• Developed views and templates withPythonand Django's view controller and templating language to create a user-friendly website interface.
• Supported Apache Server on Linux Platform and Model View Control architecture is implemented using Django Framework to develop web applications.
• Used Rational Rose Enterprise to develop Use Case diagrams, Class diagrams, Collaboration and Sequence Diagrams, State Diagrams, Data Modeling.
• Associated with development of Web Services using SOAP for sending and getting data from the external interface in the XML format.

Environment: Python, Java, MySQL, Linux, HTML, XHTML, CSS, AJAX, JavaScript, Apache Web Server, Django, SOAP, Bootstrap, JQuery, JSON, AngularJS, PyTest, LINUX, ETL, REST APIs, Sybase, DB2, Data Warehousing, Autosys.

Python Developer

Confidential

Responsibilities:

• Wrote Python routines to log into the websites and fetch data for selected options and used Python modules such as requests, urllib, and urllib2 for web crawling.
• Worked on writing and as well as read data from csv and excel file formats and Used other packages such as Beautiful soup for data parsing.
• Developed a MATLAB algorithm which determines an object's dimensions from digital images.
• Web-services backend development using Python (CherryPy, Django, SQLAlchemy).
• Participated in developing the company's internal framework on Python. This framework became a basement for the quick service's development. Framework based on CherryPy with GnuPg encryption (reGnuPg module) on the top.
• Worked on resulting reports of the application and Tableau reports and involved in modifying data using SAS/BASE, SAS/ MACROS.
• Worked on HTML5, CSS3, JavaScript, AngularJS, Node.JS, Git, REST API, Mongo DB, intelliJ IDEA.
• Design and Setting up of environment of Mongodb with shards and replicasets. (Dev/Test and Production).
• Private VPN using Ubuntu, Python, Django, CherryPy, Postgres, Redis, Bootstrap, Jquery, Mongo, Fabric, Git, Tenjin, Selenium, Sphinx, and Nose.
• Extracting data from the database using SAS/Access, SAS SQL procedures and create SAS data sets.
• Performed QA testing on the application.
• Developed approaches for improving NLP pipeline and NLP File Prep Settlement-Prepare files for review for Settlement.
• Create custom VB scripts in repackaging applications as needed.
• Participated in the complete SDLC process and Held meetings with client and worked all alone for the entire project with limited help from the client.
• Developed and maintained various automated web tools for reducing manual effort and increasing efficiency of the Global Shipping Team and developed rich user interface using CSS, HTML, JavaScript and JQuery.
• Created a Python based GUI application For Freight Tracking and processing and used Django framework for application development.
• Created database using MySQL, wrote several queries to extract data from database.
• Setup automated cron jobs to upload data into database, generate graphs, bar charts, upload these charts to wiki, and backup the database.
• Wrote scripts in Python for extracting data from HTML file.
• Effectively communicated with the external vendors to resolve queries and used Perforce for the version control.

Environment: Python, Django, MySQL, Windows, Linux, HTML, CSS, JQuery, JavaScript, Apache, Linux, GIT, MySQL, SAS, NLP.

Software Engineer / Python

Confidential

Responsibilities:

• Involved in various phases of Software Development Life Cycle (SDLC) such as requirements gathering, modeling, analysis, design and development.
• Generated Use case diagrams, Activity flow diagrams, Class diagrams and Object diagrams in the design phase.
• Responsible for entire data migration from Sybase ASE server to Oracle
• Migration of API code written for Sybase to Oracle.
• Overlook the migration activity of PL/SQL programs
• Migration of the PL/SQL code from Sybase to Oracle.
• Migration of the data contained in the earlier ASPL Database from Sybase to Oracle.
• Migrate the Libraries written using Sybase API's to Oracle's OCCI API's
• Automation of testing using Python.

Environment: Python, Shell scripting, PL/SQL, SVN, Quality Center, Solaris, Windows, perl.