Hadoop Consultant Resume
SUMMARY
- Extensive experience in designing, developing, enhancing and managing large scale information systems
- Experience in information governance and metadata management
- 9+ years of IT experience focusing on Enterprise Data Lake design, development and implementation
- Implemented standards and processes for Data Lake design and implementation
- Strong experience in Data Lake strategy implementation
- Evaluated ETL vendors, new tools and technologies based on organization’s needs and goals
- Extensive experience in design, development and implementation of Big Data projects
- Strong working experience in integrating on premise Data Lake implementation with cloud providers like AWS, Azure and GCP
- Strong experience in designing and developing cross functional and cross platform applications
- Strong knowledge in Java based design pattern implementation and object oriented programming
- Strong analytical skills, critical thinking and problem solving abilities
- Strong verbal and written communication skill
- Detail oriented, ability to work independently in a fast paced, multi - task environment
- Excellent team player and self-starter with proven abilities to finish tasks before target deadlines
TECHNICAL SKILLS
Languages: Java, HiveQL, PigLatin, SQL/PL SQL, HTML, JavaScript, R, Python
Software Stack: J2EE, Spring, Hibernate, JMS, Servlet, Rest Services, JSP, JNDI, JQuery, JSON
Cloud Technologies: Hadoop, HDFS, Map Reduce, Pig, Sqoop, Flume, Oozie, Zookeeper, Azure, Amazon EC2, EMR, RDS, S3, SES, SNS, SQS, IAM
Hadoop: Distro Hortonworks, MapR, Cloudera
Databases: Hive, MySQL, MS SQL, Oracle 9i/10g/11g, Sybase, DB2
Servers: JBoss AS 4.2.3, Apache Tomcat 6.0
Tools: Talend, SSAS, SSRS, SSIS, Pentaho, Eclipse, Visual Studio, Maven, Ant, Git, SVN, JUnit, TestNG, Aqua Data Studio, Oracle SQL Developer, Autosys, Quality Center, Selenium, VersionOne, R-Studio, MATLAB, Adobe Photoshop, Illustrator
Operating Systems: MAC OS X, Windows (versions 98 - XP, Vista, 7, 8.1, 10), Linux, VMware Virtualization
PROFESSIONAL EXPERIENCE
Hadoop Consultant
Confidential
Responsibilities:
- Designed, developed and implemented ELT/ETL processes and procedures
- Profiled, cleansed, enriched and exported large data sets to relational databases for downstream applications
- Analyzed source system data to understand data structure, definitions and anomalies
- Designed, developed, validated and documented various Data Lake initiatives within the organization
- Gathered requirements, designed, developed, tested and documented various development and support activities
- Worked with remote development teams to complete projects on schedule
- Interacted with customers as needed to better define and understand the general reporting requirements
- Performed data query, extracted, transformed datasets using SQL and Java
Environment: Talend Data Fabric, Talend Metadata Management, Hive, HDFS, Pig, Sqoop, Azure Cloud Platform
Big Data Consultant
Confidential
Responsibilities:
- Deployed multi-tenant clusters based on line of business, departments, regions within the organization needs and goals
- Monitored and supported MapR based Hadoop clusters globally for banking organizations and financial institutions
Environment: Hadoop, Hive, HDFS, Pig, Sqoop, Shell Scripting, Linux Red Hat, Amazon EC2, Elastic Map Reduce, RDS, S3, SES, SNS, SQS, EMR, IAM
Data Scientist Intern
Confidential
Responsibilities:
- Developed, enhanced, and maintained statistical models that generate predictive business insights for hospitals in US Healthcare industry
- Designed machine learning models for data discovery and identified key business drivers
- Performed cluster analysis on hospital big data for predicting cost and mortality rate using advanced clustering algorithms
Environment: R, R-Studio, Hadoop
Product Manager Intern
Confidential, AZ
Responsibilities:
- Architected, developed and deployed Java based web application for generating dynamic reports for Mining Industry
- Responsible for packaging the finished product for installation and provided software support to the on boarded clients
Environment: Java, J2EE, Spring, Hibernate, JSP, HTML, CSS
Application Developer
Confidential
Responsibilities:
- Designed and developed bulk email enhancement for client center module to send periodic emails to HNI clients
- Developed end to end system for email delivery from web interface
- Developed grammar for removing code documentation and comments from HTML, CSS, FCC, JSP and JavaScript
- Developed authentication solution by encrypting client login using IBM's Total Authentication Solution, securing the application system improving systems security
Environment: Java, J2EE, Spring, DB2, EXT-JS, Agile, Sybase, Perl, JavaMail, JFLEX (Java based regular expressions)
Software Engineer Consultant
Confidential
Responsibilities:
- Worked on Giga-spaces (online caching middleware system) for storing data (accounts, products and stock positions) for performing ultra-low latency transaction by effectively designing database query
- Responsible for production support and enhancements
- Designed, developed, enhanced cloud based application systems for effectively managing cash, collateral, intraday trades and automated prime brokerage selection for trade execution
Environment: Java, J2EE, Unix, Giga-spaces, Spring, Hibernate, Jolt, JAXP, DB2, Sybase, CVS
Software Engineer Consultant
Confidential
Responsibilities:
- Designed and Developed report generation module
- Migrated collateral information management system from excel sheet to an online web application for effective collateral management
- Provided technical guidance to team members, handled design, and coordinated development and testing processes
Environment: Java, J2EE, Google Web Tool Kit 1.6, Spring 2.5, iBATIS, Oracle 10g, Apache Tomcat 5.5
Senior Software Engineer
Confidential
Responsibilities:
- Involved in design, development and implementation of administrator and super administrator module
- Designed and developed report generation module and integrated with the system
- Created functional requirement document after gathering requirements from users, performed feasibility analysis and managed software service systems
- Provided technical and user support for the system
Environment: Java, MySQL, Windows Vista, Struts, JSP, Servlet, Spring, Hibernate, Jasper reports, iReports