J2ee Developer Resume
Raleigh, NC
SUMMARY
- 8+ years of professional experience which includes Analysis, Design, Development, Integration, Deployment and Maintenance of quality software applications using Java/J2EE Technologies and Big data Hadoop technologies.
- 3+ Years of hands - on implementation experience with a combination of the following technologies: Hadoop distributions, Spark streaming, Kafka, NoSQL data warehouses such as Hbase and Cassandra, data processing frameworks like ApacheNiFi.
- Proficiency in Java, Hadoop Map Reduce, Pig, Hive, Oozie, Sqoop, Flume, Zookeeper and NoSQL Database.
- High Exposure on BigData technologies and Hadoop ecosystem, In-depth understanding of Map Reduce and the Hadoop Infrastructure.
- Excellent knowledge on Hadoop Architecture and ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, YARN and Map Reduce programming paradigm.
- Good exposure on usage of NoSQLdatabase column-oriented HBase, Cassandra.
- Extensive experienced in working with semi/unstructured data by implementing complex map reduce programs using design patterns.
- Extensive experience writing custom Map Reduce programs for data processing and UDFs for both Hive and Pig in Java.
- Experienced in migrating map reduce programs into Spark RDD transformations, actions to improve performance.
- Strong experience in architecting real time streaming applications and batch style large scale distributed computing applications using tools like Spark Streaming, Spark SQL, Flume, Map Reduce, Hive etc.
- Extensive experienced in working with structured data using Hive QL, join operations, writing custom UDF’s and experienced in optimizing Hive Queries.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database.
- Experienced in job workflow scheduling and monitoring tools like Oozie.
- Experience in Apache Flume for collecting, aggregating and moving huge chunks of data from various sources such as webserver, telnet sourcesetc.
- Strong experience in architecting batch style large scale distributed computing applications using tools like Flume, Map reduce, Hive etc.
- Experience using various Hadoop Distributions (Cloudera, Hortonworks etc.) to fully implement and leverage new Hadoop features
- Worked on custom Pig Loaders and Storage classes to work with a variety of data formats such as JSON, Compressed CSV, etc.,
- Experience in managing and reviewing Hadoop log files.
- Good Knowledge in Amazon AWS concepts like EMR and EC2webservices which provides fast and efficient processing of Big Data.
- Proficient in Java, J2ee, JDBC, Collections, Servlets, JSP, spring, Hibernate, JSON, XML, REST, SOAP Web services, and Eclipse Link.
- Extensive experienced in working with SOA based architectures using Rest, SOAP based services using JAX-RS and JAX-WS.
- Experienced in working with different scripting technologies like Python, UNIX shell scripts.
- Experience on Source control repositories like SVN, CVS and GIT.
- Strong experienced in working with UNIX/LINUX environments, writing shell scripts.
- Skilled at build/deploy multi module applications using Maven, Ant and integrated with CI servers like Jenkins.
- Expertise in implementing Map Reduce jobs with both Java API and Apache Pig.
- Experience on Linux, Shell Scripting, SQL and SQL Performance Tuning.
- Experienced in requirement analysis, application development, application migration and maintenance using Software Development Lifecycle (SDLC) and Java/J2EE technologies.Proficient in producing/consuming Rest based/ SOAP based web services using JAX-RS and JAX-WS.
- 3+ years’ of experience with UNIX Shell Scripting.
- Developing and Maintenance the Web Applications using the Web server Tomcat.
- Experience in writing database objects like Stored Procedures, Functions, Triggers, PL/SQL packages and Cursors for Oracle, SQL Server, MySQL & Sybase databases.
- Expertise in Web pages development using JSP, HTML, Java Script, JQuery and Ajax.
- Great team player and quick learner with effective communication, motivation, and organizational skills combined with attention to details and business improvements.
- Adequate knowledge and working experience in Agile & Waterfall methodologies.
TECHNICAL SKILLS
Big Data Ecosystems: Map Reduce,HDFS, Apache NiFi, Hive, Pig, Sqoop, Oozie,Spark, Flume, Zookeeper, Impala,YARN, RabbitMQ.
NoSQL Databases: HBase, Cassandra
Hadoop Distributions: Apache Open-source Cloudera, Horton Works.
Monitoring and Reporting: Tableau, Custom shell scripts.
Build Tools: Maven, SQL Developer
Programming & Scripting: JAVA, C, SQL, Scala, Shell Scripting.
Application Servers: WebSphere, JBoss
Databases: Oracle, MY SQL, And Teradata
Web Technologies: HTML, XML, CSS, JSON, And JavaScript.
Framework & Testing: Ajax, Strut, Hibernate, Junit.
Web Servers: Apache Tomcat.
Version Control: SVN, CVS, GIT
Operating Systems: Linux, UNIX, Mac OS-X, CentOS, Windows 8, Windows 7And Windows Server 2008/2003.
PROFESSIONAL EXPERIENCE
Confidential, Cincinnati, OH
Big Data/Hadoop Developer
Responsibilities:
- Developed Data Ingestion Service from remote SaaS server into HDFS.
- Involved in migration of HDFS files from old Dunnhumby to new domain Confidential cluster.
- Developed flow xml files using ApacheNiFi, a workflow automation tool to ingest data into HDFS.
- Worked on performance tuning of Apache NiFi workflow to optimize the data ingestion speeds.
- Used RabbitMQ as a messaging service to get down streams notified about the data ingested.
- Pre Processed the data ingested using Apache Pig to eliminate the bad records as per business requirements with the help of filter functions, User Defined Functions.
- Worked on Apache Spark component in Scala to do transformations like normalization and standardization and convert raw data to Apache Avro, one of the best serialization techniques in Hadoop.
- Worked on creation of Hive tables on top of Avro files for execution of HQL queries as per client’s requirement.
- Optimized ApacheHive queries using partitioning using asofmonth for performance improvement.
- Move data from different sources in to Hadoop and define detailed technical processes for data acquisition.
- Worked on Oozie workflows for automation of MR, Hive, Pig, Spark jobs and developed an Oozie Java Wrapper called from Pivotal Cloud Foundry (PCF).
- Configured Team city for Continuous Integration/Continuous Deployment (CI/CD) of code into Edge Node.
- Responsible for writing validation script using Shell scripting.
- Used GitHub for version control repository.
- Worked in XMLtransformation using XSLT.
- Participate and contribute to estimations and Project Planning with team and Architecture.
Environment: Hadoop, HDFS, Apache NiFi, RabbitMQ, Oozie, Pig, Spark, Scala, Hive, Shell Scripting, LINUX, Shell Scripting, CDH5.4.
Confidential, Columbus, OH
Big Data/Hadoop Developer
Responsibilities:
- Worked with highly unstructured and semi structured data of 2 Petabytes in size.
- Involved in full life cycle of the project from Design, Analysis, logical and physical architecture modeling, development, Implementation, testing.
- Created HiveTables, loaded transactional data from Teradata using Sqoop.
- Developed MapReduce (YARN) jobs for cleaning, accessing and validating the data.
- Created and worked Sqoop (version 1.4.3) jobs with incremental load to populate Hive External tables.
- Experience working with very large datasets of data distributed across large data clusters
- Developed optimal strategies for distributing the web log data over the cluster importing and exporting the stored web log data into HDFS and Hive using Sqoop.
- Extensive experience in writing Pig(version 0.11) scripts to transform raw data from several data sources into forming baseline data.
- Implemented HiveGenericUDF’s to in corporate business logic into Hive Queries.
- Analyzed the web log data using the HiveQL to extract number of unique visitors per day, page views, visit duration, most visited page on website.
- Integrated Oozie with the rest of the Hadoop stack supporting several types of Hadoop jobs out of the box (such as Map-Reduce, Pig, Hive, and Sqoop) as well as system specific jobs (such as Java programs and shell scripts).
- Creating Hive tables and working on them using Hive QL.
- Designed and Implemented Partitioning (Static, Dynamic), Buckets in HIVE.
- Involved in End-to-End implementation of ETLlogic.
- Developed syllabus/Curriculum data pipelines from Syllabus/Curriculum Web Services to HBASEand Hive tables.
- Worked on Cluster co-ordination services through Zookeeper.
- Monitored workload, job performance and capacity planning using Cloudera Manager.
- Involved in build applications using Maven and integrated with CI servers like Jenkins to build jobs.
- Exported the analyzed data to the RDBMS using Sqoop for to generate reports for the BI team.
- Worked collaboratively with all levels of business stakeholders to architect, implement and test Big Data based analytical solution from disparate sources.
- Involved in Agile methodologies, daily scrum meetings, spring planning.
Environment: Hadoop, HDFS,Map Reduce, Hive, Pig, Hbase, Sqoop, Oozie, Maven, Shell Scripting, CDH.
Confidential, Reston, VA
Hadoop Developer
Responsibilities:
- Responsible to manage data coming from different sources and involved in HDFS maintenance and loading of structured and unstructured data.
- Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
- Involved in creating Hive tables, and loading and analyzing data using hive queries.
- Developed Simple to complex Map Reduce Jobs using Hive and Pig.
- Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
- Mentored analyst and test team for writing Hive Queries.
- Used OOZIE Operational Services for batch processing and scheduling workflows dynamically.
- Developed MapReduce programs to parse the raw data and store the refined data in tables.
- Worked with application teams to install operating system, Hadoop updates, patches, version upgrades of Horton works as required.
- Developed multiple Map Reduce jobs in java for data cleaning and preprocessing
- Worked with Linux systems and RDBMS database on a regular basis in order to ingest data using Sqoop.
- Develop and maintains complex outbound notification applications that run on custom architectures, using diverse technologies including Core Java, J2EE, SOAP, XML, JMS, JBoss and Web Services.
- Experienced in running Hadoop streaming jobs to process terabytes of xml format data.
- Load and transform large sets of structured, semistructured and unstructureddata.
- Generated the datasets and loaded toHADOOPEcosystem.
- Assisted in exporting analyzed data to relational databases using Sqoop.
- Created and maintained Technical documentation for launching HADOOP Clusters and for executing Hive queries, Pig Scripts, Sqoop jobs.
Environment: Horton works, Hadoop, HDFS, Oozie, Pig, Hive, MapReduce, Sqoop, Flume, and LINUX.
Confidential, Raleigh, NC
J2EE Developer
Responsibilities:
- Developed the application using Struts Frameworkthat leverages classical Model View Layer (MVC) architecture UML diagrams like use cases, class diagrams, interaction diagrams, and activity diagrams were used
- Participated in requirement gathering and converting the requirements into technical specifications
- Created Business Logic using Servlets, Sessionbeans and deployed them on Web logic server
- Wrote complex SQL queries and stored procedures
- Developed the XMLSchema and Web services for the data maintenance and structures
- Implemented the Web Service client for the login authentication, credit reports and applicant information using Apache Axis 2 Web Service
- Responsible to manage data coming from different sources.
- Designed the logical and physical data model, generated DDL scripts, and wrote DML scripts for Oracle 9i database
- Used struts validation framework for form level validation
- Wrote test cases in JUnit for unit testing of classes.
- Provided Technical support for production environments resolving the issues, analysing the defects, providing and implementing the solution defects
- Built and deployed Java applications into multiple UNIX based environments and produced both unit and functional test results along with release notes.
Environment: J2EE, SQL, Web Sphere, HTML, XML, ANT, Oracle, JavaScript.
Confidential
Java Developer
Responsibilities:
- Actively participated in requirements gathering, analysis, design, and testing phases.
- Designed use case diagrams, class diagrams, and sequence diagrams as a part of Design Phase.
- Strong experience in SQL and knowledge of Oracle and MS SQL Server database.
- Experience in ETL software development.
- Create logical and physical data models and generate the SQLfor the design using Erwin.
- Developed the Enterprise Java Beans (Stateless Session beans) to handle different transactions such as online funds transfer, bill payments to the service providers.
- Implemented Service Oriented Architecture (SOA) using JMS for sending and receiving messages while creating web services.
- Developed XML documents and generated XSL files for Payment Transaction and Reserve Transaction systems.
- Developed SQL queries and stored procedures.
- Developed Web Services for data transfer from client to server and vice versa using Apache Axis, SOAP and WSDL.
- Used JUnit Framework for the unit testing of all the java classes.
- Implemented various J2EE Design patterns like Singleton, Service Locator, DAO, and SOA.
- Worked on AJAX to develop an interactive Web Application and JavaScript for Data Validations.
Environment: J2EE, JDBC, SQL, Java, SQL, JSP, Struts, Hibernate, Web services, SOAP, WSDL, Design Patterns, MVC, HTML, JavaScript, WebLogic, XML, Junit, Web Sphere,My Eclipse.
