Tech Lead/ Hadoop Architect Resume
Plano, TX
SUMMARY:
- 9+ years of experience in Java and Hadoop Development in all phases of application development life cycle including requirement gathering, analysis, design, development, unit testing, integration testing, user acceptance testing, operation acceptance testing, deployment, support and maintenance over Linux and Unix platforms.
- + 3 years of experience as Hadoop Developer wif developing java based projects, designing software architectures, leading development teams, provide effort estimations, project status reporting, management of quality and execution of change management processes and production deployments.
- Extensively worked on Hadoop framework wif Hortonwork (HDP) & MapR distributions.
- Building Big Data solutions using Hadoop technology.
- Extensive experience developing complex MapReduce programs against structured and unstructured data.
- Experience wif loading data to Hive and writing software accessing Hive data.
- Experience loading external data to Hadoop environments using tools like MapReduce, Sqoop and Flume.
- Experience using scripting languages like Pig to manipulate data.
- Experience in creating User defined functions in Pig using Java and Python.
- Experience in using various analytics tools like Splunk and YellowFin.
- Experience in creating dashboard for Ordering and CRM Services for Confidential &T using Splunk.
- Installed and configured Hive, Pig and Sqoop on teh Hadoop cluster.
- Created Hive Tables, loaded retail transactional data from Oracle using Sqoop.
- Monitored workload, job performance and capacity planning using Cloudera Manager.
- Experience in writing complex database queries using SQL and distributed computing frameworks like MapReduce, Hadoop, Impala and Spark to establish links between large datasets for analytic applications.
- Experience in performance tuning and query optimization on Impala.
- Experience in Oracle Loader for Hadoop.
- Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms.
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted teh data from Oracle into HDFS using Sqoop.
- Excellent knowledge in J2EE architecture and understanding of object oriented concepts, as well as good comprehension and effective utilization of design patterns including MVC, Singleton, Factory, Observer, Decorator and Adapter.
- Extensive experience in developing web applications using J2EE related technology (Servlets, JSP, JSF, EJB, JMS, Web Services) web technology (HTML, JavaScript, Ajax) and Java frameworks (Struts, Hibernate, Spring, Execution Services) and testing frameworks like JUnit.
- Experience implementing web services technology using SOAP and REST approaches.
- Knowledge in UI frameworks such as GWT and JSP.
- Extensive experience in execution of software development methodologies such as CMMI, RBPM, SDLC and Agile processes.
- Highly skilled in application architecture, analysis, design, development and implementation using Java, JEE/J2EE, SOA, UML, Struts/Spring/Hibernate, JSP/JSF, Multi - threading, JPA, Web Services, WebSphere/Web Logic, MQ/JMS and DB2/Oracle/SQL Server
- Experience in optimizing tablespace use by reserving a tablespace for a particular type of database use, such as high update activity, read-only activity, or temporary segment storage.
- Creating and managing bigfile/user/temp tablespaces for enhancing DB performance.
- Extensively used IBM WebSpherePortalAPIs for autantication and personalization features.
- Experience in teh usage of Enterprise Application Platforms including IBM RAD wif Websphere Application Server, Apache Tomcat, Oracle Web Logic, and Red Hat JBoss.
- Extensive expertise in using versioning systems such as SVN and CVS.
- Strong skills using modeling processes wif UML including class diagrams, use cases, sequence diagrams, activity diagrams, etc.
- Ability to communicate and interact effectively wif teh business users / customers.
- Ability to look Confidential things from user’s perspective as opposed to only technology perspective.
- Ability to persuade / convince business wif alternative solutions.
- Ability to communicate effectively wif fellow developers, immediate and senior management.
- Ability to work in a team as well as independently.
- Ability to cope wif difficult situations like stress due to workload, deadlines, etc. and manage or deal wif difficult people.
- Strong analytical and participatory in teh resolution of application issues and contribution of making critical decisions.
- Proven skills in effective learning of new technical and business concepts under pressure and apply knowledge in teh projects.
TECHNICAL SKILLS:
Operative Systems: Microsoft Windows, Linux (Ubuntu), Mac OS X 10.x
Web Technologies: Java SE 6/7, J2EE 5, HTML, XML, XSL, XSLT, JSTL, JavaScript
J2EE Frameworks: Apache Struts, Hibernate, JSF, Ajax Framework, Google Web Toolkit (GWT)
J2EE Standards: MVC Architecture, Design Patterns, Multithreading, JSP, SOA, JDBC, EJB, JMS, JNDI, RMI, iText, POI, Quartz
Tools: MKS Integrity Client, SVN, CVS, Quality Center 9.2, Ant 2, Maven 3.0, Apache James 2.3, XDoclet 1.2, UML, Jenkins, JUnit, Putty, Tibco Studio, Contivo, XML Spy, Svn, Maven, CVS and Hudson Build.
RDBMS / Databases: Oracle (9i, 10g, 11g), DB2 Client 9.0, MySQL 4.0, PL/SQL
Application Servers: IBM RAD WAS 8.0, Oracle Web logic Application Server 8.1, Apache Tomcat 5.5, Red Hat JBoss Application Platform 4.0
Big Data Ecosystems: Hortonwork, Hadoop, MapReduce, HDFS, HBase, Zookeeper, Hive, Pig, Sqoop, Cassandra, Oozie, Flume, Splunk, Chukwa, Pentaho Kettle and Talend.
Other: Microsoft Office, Rational Rose, Macromedia Suite, Rational Software Development Platform, Eclipse, Net Beans, IBM MQ Series, Rally Dev, JIRA, IBM WebSpherePortal, Connect Direct.
PROFESSIONAL EXPERIENCE
Confidential, Plano, TX
Tech Lead/ Hadoop Architect
Responsibilities:
- Involved in Design and Development of technical specifications using Hadoop technology.
- Involved in moving all log files generated from various sources to HDFS for further processing.
- Importing and exporting Data from RDBMS to HDFS Using Sqoop.
- Hands on design and development of an application using Hive (UDF).
- Involved in data movement from Oracle to Hadoop Cluster using Oracle Loader for Hadoop.
- Used Sqoop & Flume for collecting data from different data sources of different system raising teh events.
- Collecting streaming data from different sources and putting in Hadoop cluster by writing HDFS programs.
- Wrote complex Hive queries in order to do advanced analytics on top of teh Hadoop cluster.
- Also involved in real time data processing for huge datasets in Apache Kafka.
- Create Splunk dashboard for data visualization & reporting.
- Creating and analyzing complex queries in Impala.
- Analyze and document Business and Technical Requirements
- Collaborate wif interfacing development team to analyze teh impact of teh requirement.
- Review and baseline of Business and Technical Requirements.
- Prepare Business Requirement Document (BRD).
- Interaction wif client right from teh requirements stage to delivery of teh application.
- Interaction wif client about teh daily status of teh project related activities
- Highlighting about teh issues, risks, limitations etc for teh present and future deliverables.
- Understanding of teh change requests dat are raised by teh client after teh development started.
- Map Technical Requirement to sub-systems.
- Prepare System Feature Design (SFD) Document.
- Co-ordinate wif other development teams to develop Interface Agreements (IA).
- Design components to meet Technical requirements.
- Prepare Detailed Design Specifications (DDS).
- Review and baseline Detailed Design Specifications (DDS).
- Traceability Matrix (RTM).
- Implement version control mechanism using appropriate version control tool.
- Keep track of teh status of all defects opened during test execution. Prioritize, trouble shoot and fix defects.
- Monitor applications in production environments and provide real time support for analyzing and troubleshooting issues.
- Trouble Maintenance Functions such as creating, updating, retrieving or closing a trouble report.
Environment: Big Data (HDFS, Map Reduce, Sqoop, Hcatalog, Hive), Oozie, Apache Kafka, HBase and Splunk, Java 1.8, Sun Solaris.
Confidential, Plano, TX.
Tech Lead/ Hadoop Developer
Responsibilities:
- Involved in Design and Development of technical specifications using Hadoop technology.
- Involved in moving all log files generated from various sources to HDFS for further processing.
- Importing and exporting Data from RDBMS to HDFS Using Sqoop.
- Hands on design and development of an application using Hive (UDF).
- Responsible for writing Hive Queries for analyzing data in Hive warehouse using Hive Query Language (HQL).
- Loading teh data from source system to HDFS and imposing Hive Schema on teh data.
- Involved in data movement from Oracle to Hadoop Cluster using Oracle Loader for Hadoop.
- Created Hive tables to store teh processed results in a tabular format.
- Monitoring Hadoop scripts which take teh input from HDFS and load teh data into Hive.
- Implemented Partitioning, Dynamic partitions, Buckets in Hive
- Analyzed large data sets by running Hive queries and Pig scripts
- Involved in creating teh flow from data import till landing teh data in HDFS.
- Created Hive external tables for teh imported data.
- Worked on hive joins and implemented hive bucketing for performance tuning.
- Worked in Agile environment and used rally for tracking stories.
- Experienced in importing real time logs to HDFS using Flume.
- Responsible for managing data from multiple sources.
- Involved in Hunk reporting
- Maintain and monitor all teh related applications in all teh environments dat is, development, staging and production,
- Fixing all teh bugs dat may arise in production.
- Deployment of teh enhanced modules.
- Requirements Gathering and Analysis.
Environment: MapR, HDFS, Hive, Flume, Oozie, Hunk Reporting, Splunk, Java, Sun Solaris (5.10) and Shell Script.
Confidential
Tech Lead/ Hadoop Developer
Responsibilities:
- Involved in Design and Development of technical specifications using Hadoop technology.
- Hands on design and development of an application using Hive (UDF).
- Analyzed large data sets by running Hive queries.
- Worked on hive joins and implemented hive bucketing for performance tuning.
- Used Sqoop & Flume for collecting data from different data sources of different system raising teh events.
- Collecting streaming data from different sources and putting in Hadoop cluster by writing HDFS programs.
- Wrote complex Hive queries in order to do advanced analytics on top of teh Hadoop cluster.
- Involved in automation process teh jobs to process teh data from different data sources by using Oozie automation tool.
Environment: MapR, HDFS, Hive, Flume, Oozie, Hunk Reporting, Splunk, Java, Sun Solaris (5.10) and Shell Script.
Confidential
Java Team Lead
Responsibilities:
- Managing a team of 5 people.
- Analyzing teh requirements & prepare low level.
- Developing java modules using various java collection framework.
- Creating and maintaining EJB components, MQ Series implementation.
- Creating and implementing web services using SOAP based Web Services.
- Developed and Executed JUnit Test Cases using Eclipse IDE.
- Writing Oracle store procedures. Involved in deployment of application in application server.
- Work wif Project PM, BA’s, Designer, Lead Developer to review design/code & get necessary approvals.
- Coding & Unit testing.
- Issuance of developed components to production using SF specific Issuance process.
- Ensuring process compliance wif teh Client guidelines.
Environment: JAVA (1.5), Oracle 10g, Putty 0.60, WinSCP 4.2, Eclipse (3.4), Toad 9.6, SVN., AIX (6.1) and Sun Solaris (5.10), EJB 2x (Entity Beans, Session Beans and MDB), JMS, WebServices, IBM MQ Series, Unix and Linux.
Confidential
Java Module Lead
Responsibilities:
- Managing a team of 10 people.
- Creating and maintaining EJB components, JPA entities, web components using servlet.
- Handle PCI and PA-DSS audit.
- Involved in deployment of application in application server.
- Creating and implementing web services using SOAP based Web Services.
- Analyzing teh requirements & prepare low level.
- Creating and maintaining EJB components, MQ Series implementation.
- Writing Oracle store procedures. Involved in deployment of application in application server.
- Work wif Project PM, BA’s, Designer, Lead Developer to review design/code & get necessary approvals.
- Developing components using various java collection framework & Unit testing.
- Issuance of developed components to production using SF specific Issuance process.
- Ensuring process compliance wif teh Client guidelines.
Environment: JAVA (1.5), EJB 3x (Entity Beans, Session Beans and MDB), JMS, WebServices, IBM MQ Series, JDK 1.5, MySQL 5.0, SQL Developer, Eclipse 3.4, Putty, WinSCP, MySQL 5.0, Eclipse (3.4), Toad 9.6, Star Team for version control.
Confidential
Java Module Lead
Responsibilities:
- Atom lite mobile application is a Simple, Secure, and Safe way to make payments using a mobile. It allows customers to avail multiple services and buy multiple products on a common platform.
- All a customer requires is a Java MIDP 2.0 enabled phone to install teh atom application to avail teh services offered by teh mobile application platform. Once teh atom application is downloaded on teh customer’s phone s/he can add up to 16 credits / debit / prepaid cards his / her phone. All transactions made using these cards are authorized by a PIN and encrypted ‘end-to-end’, which means dat teh data is completely protected while it is relayed from teh customer to teh bank server and back.
- atom’s mobile application is convenient and easy to use, can be downloaded through multiple channels like SMS, WAP link, atom / merchant website etc., one just needs to has basic GPRS activated on phone. Atom allows customers to make payments towards extensive suite of services.
- This solution is for merchants like IRCTC, MSRTC, MSEB, Neeta Travels, Reliance Energy, Adani Gas, Euronet mobile recharge, MyBusTickets, Loop Mobile, and Reliance Securities.
- This platform is certified for PCI-DSS (Payment Card Industry Data Security Standards), PA-DSS (Payment Application Data Security Standard).
- Managing a team of 8 people.
- Creating and maintaining EJB components, JPA entities, web components using servlet and core java.
- Handle PCI and PA-DSS audit.
- Involved in deployment of application in application server.
- Analyzing teh requirements & prepare low level.
- Creating and maintaining EJB components, MQ Series implementation.
- Writing Oracle store procedures. Involved in deployment of application in application server.
- Work wif Project PM, BA’s, Designer, Lead Developer to review design/code & get necessary approvals.
- Coding & Unit testing.
- Issuance of developed components to production using SF specific Issuance process.
Environment: JAVA (1.5), EJB 3x (Entity Beans, Session Beans and MDB), JMS, WebServices, IBM MQ Series, JDK 1.5, MySQL 5.0, SQL Developer, Eclipse 3.4, Putty, WinSCP, MySQL 5.0, Eclipse (3.4), Toad 9.6, Star Team for version control.
Confidential
Senior Consultant
Responsibilities:
- Interacting directly wif clients for their support.
- Doing UAT support.
- Worked in all teh tiers basically involvement in business logic part.
- Developing application in application server.
- Implementing struts framework.
- Writing Stored Procedures, creating of indexes. And also managing database.
- Done Unit Testing
- Involved in client side as well as server side validations.
- Migrating Websphere Application to JBoss Application Server.
- Migrating EJB 2.0 to EJB 3.0.
- Creating Crystal Report using Crystal Report XI Release 2.
- Interacting directly wif clients for their support.
- Doing UAT support.
- Worked in all teh tiers basically involvement in business logic part.
- Involved in deployment of application in application server.
- Implementing struts framework.
- Writing Stored Procedures, creating of indexes. And also managing database.
- Done Unit Testing
- Involved in client side as well as server side validations.
- Creating Crystal Report using Crystal Report XI Release 2.
Environment: JDK 1.5, TOAD, Oracle 10g RAD and WSAD, Putty, WinSCP, Unix, Linux and Sun Solaris (5.10), EJB 2x and 3x (Stateless Session Beans), Struts 1.2, Crystal Report, JSP, Java Script, Joss Application Server, WebSphere Application Server.
