We provide IT Staff Augmentation Services!

Hadoop / Spark Developer Resume

4.00/5 (Submit Your Rating)

SUMMARY:

  • 6.5 Plus years of total IT experience with 2 years’ experience in Big Data Technologies working through all phases of SDLC including application design, development, production support and maintenance projects
  • 2 plus years of experience in working with Hadoop platform including components like MapReduce, HDFS, Hive, Sqoop, PIG, Kafka, Flume, Impala and Spark technologies
  • Hands on Expertise on Scala development including Spark RDD and Data frame programming
  • Strong experience with application migration from RDBMS to Hadoop platform
  • Sound relational database concepts and extensively worked with SQL Server and Oracle. Expert in writing complex SQL queries and stored procs.
  • Strong knowledge of Database architecture and Data Modeling including Hive and Oracle
  • Excellent interpersonal and communication skills, technically competent and result - oriented with problem solving and leadership skills
  • Sound understanding of agile development and Agile Tools
  • HealthCare domain knowledge and sound knowledge of Networking and Database platforms
  • Experience with Real time streaming involving Apache Kafka and Spark Streaming.

TECHNICAL EXPERTISE:

Big Data: Hadoop, HDFS, MapReduce, Hive, Sqoop, Apache Spark, SparkSQL, Spark Streaming, HBase, YARN

Database: Oracle, SQL Server, MySQL, Hive

Hadoop Management: Cloudera Hadoop Distribution

Languages: SQL, Scala, Python, Shell Scripting, Java, C and C++, Microsoft Office; Visual Basic 6.0

IDEs: IntelliJ, Eclipse, Maven, Bit Bucket

Software: Microsoft Project and Visio, Rational Rose, Rational Requisite Pro, Adobe Photoshop, Adobe Illustrator, Blue Prism RPA

Processes/Technologies: Rational Unified Process (RUP), SDLC, Waterfall, Agile/Scrum, Use Cases, Storyboards, Scenarios, UML, Joint Application Development (JAD)

Automation Tools: Rational Suite including Rose and Requisite Pro, Quality Center, Share Point

PROFESSIONAL EXPERIENCE:

Hadoop / Spark Developer

Confidential

Responsibilities:

  • Loaded the data from SQL Server, Oracle RDBMS to Hive using Sqoop.
  • Created Hive tables to store the processed results in a tabular format.
  • Developed the Sqoop scripts to automate data load between RDBMS databases and Hadoop
  • Developed Apache spark based programs to implement complex business transformations
  • Used different data formats (Text, Avro, Parquet, JSON, ORC) while loading the data into HDFS.
  • Created Managed tables and External tables in Hive and loaded data from HDFS
  • Perform complex HiveQL queries on Hive tables for data profiling and reporting
  • Optimized the Hive tables using optimization techniques such as partitions and bucketing to provide better performance with HiveQL queries.
  • Used Hive to analyze partitioned and bucketed data and compute various metrics for reporting.
  • Created partitioned tables and loaded data using both static partition and dynamic partition method.
  • Participated in History load and built scripts to do incremental data load to Hive data warehouse
  • Created custom Hive user defined functions in Java ( Special Date functions )
  • Created and scheduled SQOOP Jobs for automated batch data load
  • Use JSON and XML SerDe Properties to load JSON and XML data into Hive tables.
  • Used SparkSQL and Spark Dataframe extensively to cleanse and integrate imported data into more meaningful insights.
  • Dealt with several source systems( RDBMS/ HDFS/S3) and file formats(JSON/ORC and Parquet) to ingest, transform and persist data in hive for further downstream consumption
  • Built Spark Applications using IntelliJ and Maven
  • Extensively worked on Scala programming language for Data Engineering using Spark
  • Scheduled spark jobs in production environment using Oozie scheduler.
  • Maintained Hadoop jobs (Sqoop/Hive and Spark) in production environment

Environment: Cloudera 5.8, Spark 2.0, HDFS, Map Reduce, Hive 2.0.1, Sqoop 1.4.6, Oozie Scheduler 4.3, YARN, Java, Linux Shell Scripting, Scala, Spark SQL, Impala 2.8, and Kafka.

Network Security Analyst

Confidential

Responsibilities:

  • Analyzed problems, recommended solutions, products, and technologies to meet business objectives
  • Implemented firewall solutions to properly secure data and provided consultation on all new firewall implementations, firewall configuration changes, and projects requiring security operational support
  • Assisted the end-user, other IT professionals, and external customers in requesting security variances and implementation of subsequent configuration change requests
  • Recommend best security practices to achieve stated business objectives, advises on risk assumptions for any variances granted, and provides alternatives to achieve desired end results
  • Assisted in incident response for any breaches, intrusions, or theft
  • Monitored systems for any anomalies, proper updating, and patching
  • Monitored vendor websites for potential threat alerts and software upgrades
  • Evaluated and performed planning, testing, and implementation of software and hardware upgrades
  • Maintained system documentation and configuration data for regulatory and audit purposes
  • Generated daily business reports for stakeholders and managers.
  • Coached and guided Service Desk and Desk Side Support technicians in their incident response, directing incident first responder actions, and appropriately escalating issues

Service Desk Analyst

Confidential

Responsibilities:

  • Assistance provided with monitoring the network management systems and ensure a prompt and appropriate response to customer requests and issues.
  • Role as a liaison between the client and program developers.
  • Initial problem analysis and triages problem performed to technical staff when appropriate.
  • Continuously coordinates efforts with staff associates and subject matter experts to resolve problems; logs and tracks requests for assistance related to the application as a primary user contact.
  • Depth- knowledge on when to escalate an incident, resolves basic questions to problems associated with account administration, system navigation/functionality, access and FAQs.
  • Assistance provided by compiling data and preparing reports setting forth progress, adverse trends, and appropriate recommendations based on information from the Call Management Tracking System.
  • Assistance provided by compiling and regularly maintaining a log of Frequently Asked Questions (FAQ) originating with all categories of users. On daily basis providing and managing official answers to all FAQs and distributing same to all interested stakeholders.
  • Contributed to the preparation of procedure manuals and documentation for help desk use.
  • Assistance provided in conducting periodic user satisfaction surveys and tracking user problem trends.
  • Made recommendations for improvements to help desk and assists with creating reports based on information provided from user surveys and trend analysis.

Information Technology Specialist

Confidential, Fort Hood, TX

Responsibilities:

  • Provided support to end users with non-routine events and incidents involving computer, hardware, software and network through telephone calls, email requests and walk-in requests.
  • Trained computer users on new products and software.
  • Responsible for maintaining, monitoring and documenting the daily performance of computer systems.
  • Implemented the security programs designed to minimize the system vulnerabilities.
  • Assisted in reviewing a proposed system, networks, and software designs for potential security risks recommending the countermeasures and all other issues regarding implementation of the new system in the existing infrastructure.
  • Installed, modified and repaired computer systems, network printers, scanners and software.
  • Assisted customers with technical issues involving Local Area Network (LAN), Wide Area Networks (WAN) and other systems.
  • Configured new computer systems in the organization to the United States Army Gold Master Image (AGM)
  • Escalated the technical issues that cannot be resolved to the higher level technical support.
  • Routinely followed up with customers to ensure the issues has been resolved.
  • Send email reminders and updates to users if any new changes are done to the computer system.
  • Conducted analysis of task performed with supervisor on weekly basis to ensure that the end users are getting the best technical support and customer service.
  • Recorded all the issues in a database and update the database as needed.

We'd love your feedback!