We provide IT Staff Augmentation Services!

Bigdata Developer Resume

0/5 (Submit Your Rating)

Omaha, NE

SUMMARY:

  • 9+ years of IT experience in analysis, design and development usingBigData, Java and J2EE.
  • Experience withBigData(Hadoop, HDFS, MapReduce, Hive, Pig, Impala, Sqoop, Oozie, Flume, Kafka, spark)
  • Hands on experience in writing MapReduce jobs using Java.
  • Configured Zoo Keeper, Flume, Kafka & Sqoop to the existing hadoop cluster.
  • Hands - on experience with Hadoop applications (such as administration, configuration management, monitoring, debugging, and performance tuning).
  • Having experience on various Databases like Oracle, Netezza, MySql, Sql Server, Db2, Postgres.
  • Object Oriented Design (OOD) experience with Rational Rose and Enterprise Architect (EA).
  • Participated in requirement analysis, reviews and working sessions to understand the requirements and system design.
  • Experience in developing Front-End using JSF, JavaScript, HTML, XHTML and CSS.
  • Experience in working with web/applications servers IBM Web sphere, Oracle Weblogic, Apache Tomcat.
  • Thorough knowledge of scalable n-tier, distributed as well as client/server architectures.
  • Experience in designing highly transactional web sites using J2EE technologies and handling design/implementation-using RAD/Eclipse.
  • Experience in designing Low Level and High Level design documents.

TECHNICAL SKILLS:

Languages: C, C++, Java, R

Platforms: HP-UX, LINUX, Windows 2000/XP, UNIX

BigData: Hadoop, HDFS, MapReduce, Hbase, Pig, Zookeeper, Hive, Sqoop, Flume, Kafka, Spark

J2SE / J2EE Technologies: Java, J2EE, JDBC, JSF, JSP, Java Beans, Web Services, Maven.

Web Technologies: HTML, XHTML, CSS, Java Script, JSF, PHP and AJAX, Qlikview

XML Technologies: XML, XSL and XQuery, Shell Script

Web/Application: Servers Web Sphere, Web logic Application server, Apache Tomcat

IDE / Tools: RAD, Eclipse, IntelliJ, RStudio

Methodologies: Unified Modeling Language (UML), Agile, Scrum

WORK EXPERIENCE:

BigData Developer

Confidential, Omaha, NE

Responsibilities:

  • Worked with closely with Business sponsors on the architectural solutions to meet their business needs
  • Conducted information sharing and teaching sessions to facilitate increased awareness of industry trends and upcoming initiatives by ensuring compliance between business strategies and goals and solution architecture designs
  • Performance tuned the application at various layers - MR, HIVE, CDH, Oracle
  • Used Spark streaming for the real time processing of thedatafrom hdfs.
  • Used Qlikview to create visual interface of the real timedataprocessing.
  • Implemented partitioning, dynamic partitioning and bucketing in hive
  • Imported and exporteddatafrom variousdatabases netezza, oracle, MySql, DB2 into hdfs.
  • Implemented Pub/Sub model using Apache Kafka for real-time transactions to load in hdfs.
  • Automated the process from pulling thedatafromdatasources to Hadoop and exporting thedatain the form of Jason files in to specified location.
  • Migrated the Hive queries to Impala
  • Worked on various file formats Avro, SerDe, Parquet, Text by using snappy compression.
  • Created analysis batch job prototypes using Hadoop, Pig, Oozie, Hue and Hive.
  • Used Git repository to checking and checkout the code.
  • Designed, documented operational problems by following standards and procedures using a software-reporting tool JIRA.

Environment: Hadoop, HDFS, Map Reduce, Spark, Kafka, Hive, Impala, Pig, Sqoop, Java, Unix shell scripting, Oracle, Netezza, MySql, Db2, Qlikview, GIT

Hadoop Developer

Confidential, Charlotte, NC

Responsibilities:

  • Worked extensively on importing and exporteddatainto HDFS and Hbase using sqoop.
  • Responsible for creating complex tables using hive.
  • Created partitioned tables in Hive for best performance and faster querying.
  • Developed workflow in Oozie to automate the tasks of loading thedatainto HDFS.
  • Experience with professional software engineering practices and best practices for the full software development life cycle including coding standards, code reviews, source control management and build processes.
  • Worked collaboratively with all levels of business stakeholders to architect, implement and testBigDatabased analytical solution from disparate sources.
  • Written MapReduce using java for implementing various formulas. By using partitioners, combiners and sorting.
  • Written multiple MapReduce procedures to powerdatafor extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV & other compressed file formats.
  • Handling structured and unstructureddataand applying ETL processes.
  • PrepareDeveloper(Unit) Test cases and executeDeveloperTesting.
  • Create/Modify shell scripts for scheduling variousdatacleansing scripts and ETL loading process.
  • Supports and assist QA Engineers in understanding, testing and troubleshooting.
  • Written build scripts using ant and participated in the deployment of one or more production systems
  • Production Rollout Support that includes monitoring the solution post go - live and resolving any issues that are discovered by the client and client services teams.
  • Designed, documented operational problems by following standards and procedures using a software-reporting tool JIRA.
  • Used Git repository to checking and checkout the code.

Environment: MapReduce, Java, Flat files, Oracle, Netezza, Postgres, UNIX, HDFS, Sqoop, Hbase, Hive, Oozie, Intellij, GIT

Hadoop Developer

Confidential, Kansas City, MO

Responsibilities:

  • Extracteddatafiles from MySql, Oracle through Sqoop and placed in HDFS and processed.
  • Load and transform large sets of structured, semi structured and unstructureddata.
  • Responsible to managedatacoming from different sources.
  • Involved in loadingdatafrom UNIX file system to HDFs.
  • Involved in creating Hive tables, loading withdataand writing hive queries which will run Internally in map reduce way.
  • Experienced in running Hadoop streaming jobs to process terabytes of xml, csv formatdata.
  • Load and transform large sets of structured, semi structured and unstructureddata.
  • Loaded structureddatafrom oracle into Cassandra (NoSql) using sqoop.
  • Worked on file formats csv, xml, json, avro, parquet
  • Used compressions snappy, bz2, avro.
  • Worked on Qlikview for developing dashboards.

Environment: HDFS, Hive, Map Reduce, Eclipse, Oracle, MySQL, unix, sqoop, Cassandra, Shell Scripting, Qlikview

Java Developer

Confidential, Bloomington, IL

Responsibilities:

  • Coordinated with mainframedevelopersto understand, preserve and migrated legacy application functionality from mainframe to Java/J2EE.
  • Developed application using core java, J2EE, hibernate, oracle.
  • Worked on JavaScript, JSP, and Servlets as a web application replacement for mainframe front end.
  • Wrote customization codes for FIT to adapt to the application requirements.
  • Identified bugs in the migrated application by running test cases and using Eclipse IDE.
  • Wrote ANT scripts and handled deployments on Weblogic server at test, stage levels.
  • Analyzed, created and proposed remediation measures to fix the bugs in the application.
  • Used log4j for logging monitoring errors and exceptions all across the application.
  • Analyzed database table relationships to understand legacy application.
  • Coordinated with Database Administrators to analyze and optimize the application load on database.

Environment: Java Core, J2EE, Oracle, Eclipse, Tomcat, Hibernate, JavaScript, JSP and Servlets

.Java Developer

Confidential

Responsibilities:

  • Used class - responsibility-collaborator (CRC) model to identify organized classes in the Hospital Management Systems.
  • Used sequence diagrams to show the object interactions involved with the Use-Cases of a user of the system.
  • Involved in Database Design by creatingDataFlow Diagram (Process Model) and ER Diagram (DataModel).
  • Designed HTML screens with JSP for the front-end.
  • Made JDBC calls from the Servlets to the Database
  • Involved in designing stored procedures to extract and calculate billing information connecting to oracle.
  • Formatting the results from the Database as HTML reports to the client.
  • Java Script was used for client side validation.
  • Servlets are used as the controllers and Entity/Session Beans for Business logic purpose.
  • Used WebLogic to deploy applications on local and development environments of the application.
  • Used Eclipse for building the application.
  • Participated in User review meetings and used Test Director to periodically log the development issues, production problems and bugs.
  • Implemented and supported the project through development, Unit testing phase into production environment.
  • Used CVS Version manager for source control and CVS Tracker for change control management.

Environment: Java, JSP, JDBC, Java Script, HTML, WebLogic, Eclipse and CVS.

We'd love your feedback!