Senior Hadoop Developer Resume
Atlanta, GeorgiA
SUMMARY
- Over 11 years of Java/J2EE including 2 yrs of experience in Hadoop/Talend/Spark all phases of software development life cycle, including requirement analysis, design, development, testing, debugging, performance tuning and production support.
- Expertise in Talend Big data tool with involved in architectural designing and development of ingestion and extraction job in big data and Spark streaming.
- Hands on experience Cloudera CDH 5.9.X as a Hadoop admin., Sentry,Hue,Cloudera CMF,Impala,Hive.HDFS.
- Hands on experience in Kafka,Flume,Sqoop,Pig, MapReduce,Apache Nifi,ActiveMQ.
- Hands on integrated enterprise platform for API & web services development on WSO2.
- Hands on experience in Altiscale Big data Cloud platform,Alation.
- Hands on experience in leading and developing ingestion and extraction job.
- Experienced in using configuration management tools like GIT, CVS, Subversion, IBM clear case.
- Hands on in Agile development and receive gold certificate from client in Agile.
- Worked on various IDEs such as Eclipse, IDEA IntelliJ and DevOps tool Jenkins,code quality tools Sonar,code review tools VeraCode.
- Experience in BPM tool Cordys and messaging queue IBM MQ,JMX.
- Experience in J2ee framework like Struts,JSF and testing framework JUnit, mobile game development in J2ME.
- Domain experience in Banking & Finance, Healthcare, Industrial Automation and Research and Development in mobile game AI.
- Experience in using various Java/J2EE Design patterns, UML and OOPS concepts.
- Experienced in writing complex queries, query tuning, triggers, functions and stored procedures.
- Experience in architecting SOA Integration projects using SOAP/RESTful web services, Spring Boot, Spring Integration and other open source frameworks.
- Hands on experience in using ORM frameworks like Hibernate
- Experience in Working on Oracle and ms sql server Databases. Have very good knowledge on writing SQL queries and PL/SQL Procedures
- Experience in working with Object Oriented Programming (OOP) concepts, Multithreading, Collections and Generics in Java
- Excellent in implementing Object Oriented Programming (OOP) techniques
- Experience with developing RESTful Web Services using Spring Boot technologies, also hands on Spring Security.
- Good understanding of middleware concepts like Connection pooling, Transactions, Security
- Knowledge on latest HTML 5 and CSS3 technologies.
- Experience in working with Unix/Linux based environments along with maintaining and enhancing Unix Shell script, Python and batch Jobs.
- Experienced in working under Agile Scrum Methodology and Waterfall model.
- Strong presentation skills and the ability to communicate Confidential different levels within the organization with exceptional problem solving, analytical skills and excellent attention to detail.
- Experienced in business/technical requirements capturing, configuration management, team coordination and software engineering processes
- Experience in creating the Build, release Patch & maintain Release Notes.
TECHNICAL SKILLS
Languages: Java 8, J2ee, Scala,Python, JavaScript, Shell Scripts,J2ME
BigData Technologies: Hive,HDFS,Impala, Spark,Spark SQL,Flume,Sqoop,Altiscale Bigdata Cloud, Kafka, Cloudera CDH 5.9.X, Hue, Coludera Manager,Beeline. Pig,HBase.
ETL Tools: Talend BigData Enterprise, Apache Nifi
Web Technologies: JSP, Servlets, GWT, HTML, EXTJS.
Web Services: SOAP, RestAPI.
Web Service API Tools: WSO2
Scripting Languages: JavaScript, JQuery,JSON, AJAX
Middleware: JMS Messaging, IBM MQ,ActiveMQ.
BPM Tool: Cordys
Application Servers: JBOSS - 7.1 Final/Wildfly
Web Servers: Apache 2.1, Tomcat 8.0
OS: UNIX, LINUX, Windows
IDE: IDEA IntelliJ, Eclipse
Framework: Spring Boot,Spring MVC,Spring kafka integration,Spring Batch Hibernate, JSF.
Database: Oracle 11g, SQL Server
Design Patterns: J2EE Design Patterns.
Database Tools: TOAD, Oracle SQL Developer
Version Control: CVS, Subversion, Git, IBM clear case.
DevOpS Tools: Jenkins, GitHub.
PROFESSIONAL EXPERIENCE
Confidential, Atlanta, Georgia
Senior Hadoop Developer
Responsibilities:
- Played the role of Senior BigData developer completed the project from the development phase till the completion of project.
- Requirements Gathering from Business Team and other stakeholders.
- We are using Spark streaming SCALA API to load data from Kafka to HDFS and also python based script which loading data from Netezza, DB2, Oracle db source to HDFS using Sqoop jobs.
- We have few Flume based jobs which are loading data from KAFKA to HDFS
- We are using load balancing by HA configuration. We have many data node for Hadoop yarn cluster and two NameNode. We are using Caloudera CMF to support any job failure and monitoring hive,impal,hdfs,yarn. We are using Sentry and ACLs for hive and HDFS security management .We are using HUE to look HIVE, IMPALA, HDFS and Sentry management
- Working as Hadoop admin to resolve Hadoop issue support for production jobs.
- I am doing daily on job creation on Talend using their component like Hive,Impala,HDFS with security keytab and principle configuration for open HDFS and hive connection to load file data into HDFS form ingestion server(Linux) .Since we get mainframe files from source so required to parse this raw file by using Jrecord API with Talend java component and need to voltaziged PII/PCI data by using HP voltage simple java api. File come with average sized 20 GB(sometimes around 40GB) from each platform like north,south etc.we are storing file into hdfs as parquet format.
- Code checking in Git repo on daily basis and create and configured jobs in TAC (Talend Administrative toll for jobs deployment and maintain) and deployment of jobs maintain from Nexus in TAC.
- Architected and designed solutions by working with Technical Design Authority (TDA). Provide inputs and direction in requirement gathering, Functional and Technical design discussions.
- Working as support after deployment in production for those jobs as well other jobs 24*7.
- Need to watch and response immediately after receiving call from production support team after job failure
- Closely worked with Enterprise Architect and Business Analyst in finalizing architecture
- Co-ordination with the offshore team members to maintain the top quality of deliverables by doing code review of team members and provide end to end support of implemented application.
Environment: Java 1.8, Hadoop(hive,impala,hdfs),Altiscale Hadoop Cloud.,Kafka,apache Spark, Flume,Sqoop.Linux,python,hp voltage simple java api,Talend Bigdata Tool.
Confidential, Boston, MA
Senior Developer
Responsibilities:
- Played the role of Senior Java/J2EE developer and functional lead from the development phase till the completion of project.
- Involve in coding for each iteration story and deployment in two week time of iteration includes testing.
- We are using here Cloud api also to check security because we need to deployed this code to our Cloud base environment.
- Write code in Java,Cloud api and GWT and IBM MQ also witting store proc in oracle.
- Create request to deployed code change in their own cloud based system checked in code in SVN so that Jenkins deployed job and create war in cloud system.
- Once the war created we need to raise request for deployment into prod and request goes to authorized person for accept.
- Once he/she accept it deployed on given parameter (like war deployment time,war version, parameter profile etc)
- Provide point for every story in team meeting
- Meeting with business team to clarification on stories.
- Achieve business story point for every iteration.
- Deploy the changes into Apache Tomcat server and provide post production support.
- Used IBM Clear Case for source code control.
- Project deployment by using Jenkins CI tools for auto in Cloud.
- Code merging in IBM Clear Case and SVN.
- Code review using Veracode.
- Creation of Test Plan, Test Case creation and execution. Involved in Functional, Integration, Regression, User Interface Testing.
Environment: Java 1.6, GWT 2.4, IBM MQ, JMS, Oracle, and Cloud,Veracode,Junit,Sonar,Jenkins CI Tools.
Confidential
Lead Developer
Responsibilities:
- Played the role of Senior Java/J2EE developer completed the project from the development phase till the completion of project.
- Involved in enhancements and bug fix for edoc.
- Work on IBM CMOD to provide access to end user to load files in their authorized folder in cmod. We used ODWEK java api to load data into folder in CMOD.
- We used spring core and spring security for authorization and security.
- Requirement analysis and end to development and testing for edoc
- Deploy the changes into Apache Tomcat server and provide post production support.
- Used SVN for source code control.
- Writing JUnit test case for our code.
- Co-ordination with the offshore team members to maintain the top quality of deliverables by doing code review of team members and provide end to end support of implemented application.
Environment: Java 1.6, spring 3.1, Maven, GWT 2.3, UNIX, ODWEK 8.5, AdoveLive TeamCity,JUnit.
Confidential
Senior Developer
Responsibilities:
- Played the role of Senior BPM developer completed the project from the development phase till the completion of project.
- Involved in creating BPM using Cordys tool and also design database in MS SQL Server 2008 individually.
- Creating BPS process to generate form as per requirement for this did POC and developed as it was new in Cordys.
- Helping team member to design and development BPM process.
- Proactively contributed during Design Sessions and participated in Scrums, Project meetings delivering the project successfully on time.
- Used SVN for source code control, Bower for package management.
- Provided production assurance on SLA based application support
- Unit Testing
- Active participation in team meeting scrum call with client.
Environment: Java,Cordys BPM, JDBC, MS SQL Server 2008, xml.
Confidential
Team Lead
Responsibilities:
- Played the role of Team Lead and completed the project from the development phase till the completion of project.
- Coding in various modules like Dashboard,database design and written store proc in Oracle
- Design and development of FD form.
- Unit Testing and deployment process and release doc creation
- Active participation in team meeting.
Environment: Java, JSP, Struts, Hibernate3, XML, XSLFO, Oracle 10g.
Confidential
Senior Software Engineer
Responsibilities:
- Involved in coding as daily basis and meeting with client on clarifications if needed.
- Once one part done then write Junit test case to validate code before deployment.
- We used store oracle proc to load data and I written many store proc in Oracle.
- We used here oracle trigger and many view to generate report.
- Involve in design and deployment and code checking in SVN repo
- Active participation in team meeting and helping team member.
Environment: Java, JSP, JSF 1.2, XML, Oracle 10g, Unix, Hibernate, Jboss.
Confidential
Developer
Responsibilities:
- Active participation in team meeting.
- Development in game on j2me.
- Involved in coding as well as AI design.
- Involved in bug fixing during testing.
Environment: JAVA, J2ME.
