Lead/senior Software Engineer Resume
San Antonio, TX
SUMMARY
- Ten plus years of experience in Web/Application Development in analytical programming using python with skills in analysis, design, development, testing and deploying software applications.
- Good experience using various python libraries to speed up development (libraries used: Beautiful Soup, SciPy, Matplotlib, Python - twitter, Pandas data frame, network, urllib2, MySQL dB for database connectivity, JSON libraries).
- Implemented Hadoop stack and different big data analytic tools, migration from different databases (i.e. Teradata, Netezza, Oracle, and MySQL) to Hadoop.
- Participated in different projects Confidential as AML, Fraud, ERP, CRM, BI and banking platforms, experiencing different methodologies including Agile, XP and Scrum.
- Expertise in Object Oriented concepts like Creating Classes, Inheritance, Constructors, Polymorphism, Encapsulation, Overloading and Overriding.
- Experience as a Python Developer in design, development, testing, maintenance and documentation of Enterprise applications using various technologies, analyzing complex business requirements & mapping them to system specifications.
- Experience in the Hadoop ecosystem components like HDFS, Spark with Scala and python, Zookeeper, MapReduce, Pig, Sqoop, HBase, Hive, Flume, Cassandra, MongoDB, Oozie, Kafka, Flume, and TEZ.
- Experienced in developing web-based applications using Python, Django, AWS, WSGI, PostgreSQL, Redis, HTML, CSS, JavaScript, JQuery, and XML.
- Experience in the field of Data warehouse using ETL tools Confidential as DataStage, Power Mart 9x/8x databases as DB2, Oracle, MS SQL Server and Teradata.
- Capable of processing large sets of structured, semi-structured and unstructured data and supporting systems application architecture
- Experience in leading multiple efforts to build Hadoop platforms, maximizing business value by combining data science with big data.
- Excellent experience with Python development under Linux/Unix OS (Debian, Ubuntu, SUSE Linux, RedHat Linux, Fedora) and Windows OS.
- Proficient in SQL databases MySQL, PostgreSQL, Oracle and NoSQL databases MongoDB, Cassandra, HBase.
- Experience in version control systems using CVS, SVN and Git/GitHub and issue tracking tools like Jira and Bugzilla.
- Highly analytical and detailed with a documented track record in full software development life cycle (SDLC) methodologies and agile techniques.
- Strong experience as Business Intelligence Developer and Data Analyst in Production, Development and Staging Environments.
- Extensive experience in Text Analytics, developing different statistical machine learning, Data Mining solutions to various business problems and generating data visualizations using Python, and Tableau.
- Mapping and tracing data from system to system in order to establish data hierarchy and lineage.
- Used Data Lineage and Reverse engineering as a way to track back errors in data till the data source.
- Well versed in writing test cases using Nose, unit test and Robot test frameworks
- Experience working lead for small to mid-size teams and mentor junior and mid-level developers in several projects throughout career.
- Excellent analytical and problem-solving skills and ability to work on own besides being a valuable and contributing team player.
TECHNICAL SKILLS
Programming Languages: Python (2.7,3.x), C/C++, PHP, JavaScript, Java, Shell Script, & Perl, SQL
Web Technologies: Django, HTML5, CSS3, JavaScript, JSON, JQuery, AJAX, XML, NodeJS, ExtJs and Bootstrap.
Web Services: AWS (EC2, AMI, EBS Cloud watch, AWS Config, Auto-scaling, REST, SOAP, WSDL
Python Libraries: BeautifulSoup, NumPy, SciPy, Matplotlib, Python-twitter, Report Lab, Urllib2, HTTPLib2, Pickle, Pandas, PyPI, PySpark, Pygit.
Big data: Hadoop, Pig, Hive
RDBMS: Oracle, MYSQL, SQL Server, SQL Lite, DB2, MS Access
NoSQL: MongoDB, Dynamo DB, Cassandra, Redis
Operating Systems: Windows, Linux, Unix, Mac
Bug Tracking tools: Bugzilla, Jira, Confluence, VersionOne
Python Libraries: Pandas, Numpy, UnitTest, JSON, CSV, XML, XLS
IDE’s: PyCharm, Sublime, Eclipse, Spyder and NetBeans, Atom, Sublime Text, Visual Studio.
Version Control Tools: Git, GitHub, SVN, VSS
Technologies: Netconf, Yang, Openstack, BSCS, MSCS, MS Visio
Framework: Software Development Life Cycle Agile Methodology, Scrum
PROFESSIONAL EXPERIENCE
Confidential, San Antonio, TX
Lead/Senior Software Engineer (Python)
Responsibilities:
- Designing and building full end-to-end Data Warehouse infrastructure from the ground up on Confidential Redshift for large scale data handling.
- Developed Spark program using PySpark API with Hive and SQL.
- Write complex stored procedures to extract data in Redshift.
- Create and update Python/Unix scripts.
- Create and update Pig/hive/Sqoop/Hadoop scripts in order to process structured and unstructured data.
- Create and update ETL DataStage jobs.
- Create and analyze NoSQL/SQL queries and tables.
- Create and update Control-M cycles in order to schedule ETL and scripts Runnings.
- Responsible for ETL and data validation using Python scripts.
- Worked on Quality Check scripts for matching extract count and trigger error in case of mismatch count in extracts using python.
- Worked on AWS Data Pipeline to configure data loads from S3 to into Redshift.
- Worked on boundary queries for media plan and digital media Cypher queries.
- Deploy and execute python scripts using Unix command line.
- Used Design patterns efficiently to improve the code reusability.
- Took part in the entire project's lifecycle which includes Design, Development and Deploying, Testing, Implementation and support.
- Lead and coach to the fresher and junior developers.
Environment: Python, PySpark, Pig, Hive, Sqoop, Hadoop, ETL, Datastage, NoSQL, SQL Queries, Unix Scripts.
Confidential, San Antonio, TX
Senior Python Developer
Responsibilities:
- Involved in building database Model and Views utilizing Python, to build an interactive web-based solution.
- Create and maintain paralells/sequential jobs in DataStage.
- Create DataMarts in Data Warehouse with Netezza.
- Verified the Data completeness, Data Migrations, Data transformations and Data Quality
- Managed development, testing, and implementation of various Transportation Management Crystal Reports for new customers which was important in the onboarding process.
- Create and update queries in order to improve the performance.
- Create, update and maintain Python scripts.
- Implementing the following software: Homebrew, PySpark, Java JDK, Redis, Github/Git, implementing/creating Bash profiles, installing modules via bootstrap.
- Comprehensive experience in application development and design using Hadoop echo system tools, Big Data, Big Data/Spark Analytics.
- Experience working on Hadoop/hive/sqoop/spark development
- Successfully delivered couple of initiatives (Implementation & development) on Big Data Analytics and large data processing using Hadoop ecosystem.
- Optimized the boot time for image-generation and scan data acquisition server by enhancing the startup scripts.
- Involved and worked on different Rest API's development by using Flask and Swagger.
- Implemented Agile Methodology for building an internal application.
- Created, tested and ran the application configuration to compile the list of data quality issues and compute data quality metrics.
- Worked with development, QA, and Automation engineers to research, design, and develop test automation units.
Environment: Python, Django, Shell Scripting, PySpark, PyUnit, Data Marts, Netezza, Hadoop, Hive, sqoop, spark.
Confidential
Python Software Engineer
Responsibilities:
- Requirements analysis based on new challenge (migrate desk system to web system).
- Enhancements to databases like index, sp, queries refactoring and tuning.
- Implementing Responsive Design in order to improve the functionality.
- Assist in designing and developing a scalable recommendation platform that can be used by various systems/application
- Model View Control architecture is implemented using Django Framework to develop web applications.
- Developed scripts to migrate data from proprietary database to MySQL.
- Created Django dashboard with custom look and feel for end user after a careful study of Django admin site and dashboard.
- Ensured high quality data collection and maintaining the integrity of the data.
- Developed Use Case diagrams, Class diagrams, Collaboration and Sequence Diagrams, State Diagrams, Data Modeling.
- Developed application logic using Python and Java script.
- Extracted and loaded data using Python scripts.
- Used Pandas library for statistical Analysis.
- Developed Views and Templates with Django view controller and template language to create a user-friendly website interface
- Implemented user interface guidelines and standards throughout the development and maintenance of the website using the HTML, CSS, JavaScript and JQuery.
- Created APIs, database Model and Views Utilization Python in order to build responsive web page application.
- Participated in Agile methodology and SCRUM process.
- Supporting junior/middle developers regarding Python/JavaScript technologies.
- Consuming web services in order to perform a bidirectional communication.
Environment: Python, Django, PHP, HTML5, CSS, MySQL, JavaScript, jQuery, CSS, Bootstrap, Git, GitHub, Linux, Shell Scripting.
Confidential
System Supervisor
Responsibilities:
- Enhancements to existing system, creating new modules and doing code refactoring.
- Interacted and communicated across multiple team and to discuss requirements, design aspects of application
- Application developed parses information from logs and provides analysis of data by mapping to information in database to provide analysis for proactive monitoring and alerts
- Report generation from PostgreSQL server with SQL/PLSQL and showing it thru Django intranet.
- Developed Python feature for parsing data from logs, alerts, network dump and create a analysis matrix to display. Automating Tasks and scale systems by developing automatic test cases, building frameworks
- Bug fixing with GDB and its debugging scripting language.
- Worked on IT innovation related to existing system (suggestion, advise, etc.).
- Internal meetings in order to gather new requirements about efforts.
- Training to middle developer with new technologies.
Environment: Python, Django, Postgres, SQL, PL/SQL, Unix scripting.
Confidential
Web Developer
Responsibilities:
- Development of web systems and web sites on both frontend and backend development.
- Used Python, Django and Zope frameworks to develop applications.
- Implemented business logic using Python 2.7.
- Used HTML, CSS, JavaScript and JQuery and Implemented AJAX for dynamic functionality of a webpages for front end applications.
- Worked on front end frame works like Bootstrap for responsive webpages.
- Developed and executed various MySQL database queries from python using Python-MySQL connector and MySQL database package.
- Implemented SQLAlchemy which is a python library for complete access over SQL.
- Designed object model, data model, tables, constraints, necessary stored procedures, functions, triggers, and packages for Oracle Database.
- Experience and worked building applications using Model-View-Controller design patterns with python in client server environment setup
- Mobile web development.Development web services
- Analyzing the data flow from Network and on Mobile devices for various configuration
- Developing XML based Test cases and Use cases for testing multiple Scenario
- Testing, Debugging, Bug fixing issues related to Automation framework
- Code refactoring.
Environment: Python, HTML5, CSS3, JQuery, JavaScript, Mobile
Confidential
Software Developer
Responsibilities:
- Responsible for gathering requirements, system analysis, design, development, testing and deployment.
- Development of web systems for warehouse.
- Design and developed web applications using Python, HTML5 and CSS3 for UI design, JavaScript for application functionality, and MySQL for supporting database server.
- Participated in the complete SDLC process.
- Developed rich user interface using CSS, HTML, JavaScript and JQuery.
- Development new modules.
- Used Django framework for application development.
- Code refactoring/ Bug fixing.
- Effectively communicated with the external vendors to resolve queries.
- Used Git for the version control. Experienced in Agile methodology and SCRUM process.
Environment: Python, HTML5, CSS3, Jquery, JavaScript, MySQL, GIT
Confidential
Web Developer
Responsibilities:
- Involved in various phases of Software Development Life Cycle (SDLC) of the application like meeting with employees and customers to gather requirements, design, and analysis and code development.
- Design and developed web system and web sites using various advance technologies.
- Created optimized graphic websites and application interfaces using HTML, CSS and JavaScript
- Worked modules of front-end using technologies like HTML, CSS
- Usage of Cascading Style Sheets, JavaScript, and HTML PDF (third-party tool) for generating reports in PDF format.
- Handled all aspects of the web applications including maintaining, testing, debugging and deploying
- Manipulation and retouching of images with Photoshop
- Participated with QA to develop test plans from high-level design documentation.
Environment: HTML, CSS, JavaScript, JQuery, Windows.