Bigdata Developer Resume
Omaha, NE
SUMMARY:
- 9+ years of IT experience in analysis, design and development usingBigData, Java and J2EE.
- Experience withBigData(Hadoop, HDFS, MapReduce, Hive, Pig, Impala, Sqoop, Oozie, Flume, Kafka, spark)
- Hands on experience in writing MapReduce jobs using Java.
- Configured Zoo Keeper, Flume, Kafka & Sqoop to the existing hadoop cluster.
- Hands - on experience with Hadoop applications (such as administration, configuration management, monitoring, debugging, and performance tuning).
- Having experience on various Databases like Oracle, Netezza, MySql, Sql Server, Db2, Postgres.
- Object Oriented Design (OOD) experience with Rational Rose and Enterprise Architect (EA).
- Participated in requirement analysis, reviews and working sessions to understand the requirements and system design.
- Experience in developing Front-End using JSF, JavaScript, HTML, XHTML and CSS.
- Experience in working with web/applications servers IBM Web sphere, Oracle Weblogic, Apache Tomcat.
- Thorough knowledge of scalable n-tier, distributed as well as client/server architectures.
- Experience in designing highly transactional web sites using J2EE technologies and handling design/implementation-using RAD/Eclipse.
- Experience in designing Low Level and High Level design documents.
TECHNICAL SKILLS:
Languages: C, C++, Java, R
Platforms: HP-UX, LINUX, Windows 2000/XP, UNIX
BigData: Hadoop, HDFS, MapReduce, Hbase, Pig, Zookeeper, Hive, Sqoop, Flume, Kafka, Spark
J2SE / J2EE Technologies: Java, J2EE, JDBC, JSF, JSP, Java Beans, Web Services, Maven.
Web Technologies: HTML, XHTML, CSS, Java Script, JSF, PHP and AJAX, Qlikview
XML Technologies: XML, XSL and XQuery, Shell Script
Web/Application: Servers Web Sphere, Web logic Application server, Apache Tomcat
IDE / Tools: RAD, Eclipse, IntelliJ, RStudio
Methodologies: Unified Modeling Language (UML), Agile, Scrum
WORK EXPERIENCE:
BigData Developer
Confidential, Omaha, NE
Responsibilities:
- Worked with closely with Business sponsors on the architectural solutions to meet their business needs
- Conducted information sharing and teaching sessions to facilitate increased awareness of industry trends and upcoming initiatives by ensuring compliance between business strategies and goals and solution architecture designs
- Performance tuned the application at various layers - MR, HIVE, CDH, Oracle
- Used Spark streaming for the real time processing of thedatafrom hdfs.
- Used Qlikview to create visual interface of the real timedataprocessing.
- Implemented partitioning, dynamic partitioning and bucketing in hive
- Imported and exporteddatafrom variousdatabases netezza, oracle, MySql, DB2 into hdfs.
- Implemented Pub/Sub model using Apache Kafka for real-time transactions to load in hdfs.
- Automated the process from pulling thedatafromdatasources to Hadoop and exporting thedatain the form of Jason files in to specified location.
- Migrated the Hive queries to Impala
- Worked on various file formats Avro, SerDe, Parquet, Text by using snappy compression.
- Created analysis batch job prototypes using Hadoop, Pig, Oozie, Hue and Hive.
- Used Git repository to checking and checkout the code.
- Designed, documented operational problems by following standards and procedures using a software-reporting tool JIRA.
Environment: Hadoop, HDFS, Map Reduce, Spark, Kafka, Hive, Impala, Pig, Sqoop, Java, Unix shell scripting, Oracle, Netezza, MySql, Db2, Qlikview, GIT
Hadoop Developer
Confidential, Charlotte, NC
Responsibilities:
- Worked extensively on importing and exporteddatainto HDFS and Hbase using sqoop.
- Responsible for creating complex tables using hive.
- Created partitioned tables in Hive for best performance and faster querying.
- Developed workflow in Oozie to automate the tasks of loading thedatainto HDFS.
- Experience with professional software engineering practices and best practices for the full software development life cycle including coding standards, code reviews, source control management and build processes.
- Worked collaboratively with all levels of business stakeholders to architect, implement and testBigDatabased analytical solution from disparate sources.
- Written MapReduce using java for implementing various formulas. By using partitioners, combiners and sorting.
- Written multiple MapReduce procedures to powerdatafor extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV & other compressed file formats.
- Handling structured and unstructureddataand applying ETL processes.
- PrepareDeveloper(Unit) Test cases and executeDeveloperTesting.
- Create/Modify shell scripts for scheduling variousdatacleansing scripts and ETL loading process.
- Supports and assist QA Engineers in understanding, testing and troubleshooting.
- Written build scripts using ant and participated in the deployment of one or more production systems
- Production Rollout Support that includes monitoring the solution post go - live and resolving any issues that are discovered by the client and client services teams.
- Designed, documented operational problems by following standards and procedures using a software-reporting tool JIRA.
- Used Git repository to checking and checkout the code.
Environment: MapReduce, Java, Flat files, Oracle, Netezza, Postgres, UNIX, HDFS, Sqoop, Hbase, Hive, Oozie, Intellij, GIT
Hadoop Developer
Confidential, Kansas City, MO
Responsibilities:
- Extracteddatafiles from MySql, Oracle through Sqoop and placed in HDFS and processed.
- Load and transform large sets of structured, semi structured and unstructureddata.
- Responsible to managedatacoming from different sources.
- Involved in loadingdatafrom UNIX file system to HDFs.
- Involved in creating Hive tables, loading withdataand writing hive queries which will run Internally in map reduce way.
- Experienced in running Hadoop streaming jobs to process terabytes of xml, csv formatdata.
- Load and transform large sets of structured, semi structured and unstructureddata.
- Loaded structureddatafrom oracle into Cassandra (NoSql) using sqoop.
- Worked on file formats csv, xml, json, avro, parquet
- Used compressions snappy, bz2, avro.
- Worked on Qlikview for developing dashboards.
Environment: HDFS, Hive, Map Reduce, Eclipse, Oracle, MySQL, unix, sqoop, Cassandra, Shell Scripting, Qlikview
Java Developer
Confidential, Bloomington, IL
Responsibilities:
- Coordinated with mainframedevelopersto understand, preserve and migrated legacy application functionality from mainframe to Java/J2EE.
- Developed application using core java, J2EE, hibernate, oracle.
- Worked on JavaScript, JSP, and Servlets as a web application replacement for mainframe front end.
- Wrote customization codes for FIT to adapt to the application requirements.
- Identified bugs in the migrated application by running test cases and using Eclipse IDE.
- Wrote ANT scripts and handled deployments on Weblogic server at test, stage levels.
- Analyzed, created and proposed remediation measures to fix the bugs in the application.
- Used log4j for logging monitoring errors and exceptions all across the application.
- Analyzed database table relationships to understand legacy application.
- Coordinated with Database Administrators to analyze and optimize the application load on database.
Environment: Java Core, J2EE, Oracle, Eclipse, Tomcat, Hibernate, JavaScript, JSP and Servlets
.Java Developer
Confidential
Responsibilities:
- Used class - responsibility-collaborator (CRC) model to identify organized classes in the Hospital Management Systems.
- Used sequence diagrams to show the object interactions involved with the Use-Cases of a user of the system.
- Involved in Database Design by creatingDataFlow Diagram (Process Model) and ER Diagram (DataModel).
- Designed HTML screens with JSP for the front-end.
- Made JDBC calls from the Servlets to the Database
- Involved in designing stored procedures to extract and calculate billing information connecting to oracle.
- Formatting the results from the Database as HTML reports to the client.
- Java Script was used for client side validation.
- Servlets are used as the controllers and Entity/Session Beans for Business logic purpose.
- Used WebLogic to deploy applications on local and development environments of the application.
- Used Eclipse for building the application.
- Participated in User review meetings and used Test Director to periodically log the development issues, production problems and bugs.
- Implemented and supported the project through development, Unit testing phase into production environment.
- Used CVS Version manager for source control and CVS Tracker for change control management.
Environment: Java, JSP, JDBC, Java Script, HTML, WebLogic, Eclipse and CVS.
