We provide IT Staff Augmentation Services!

System Analyst & Hadoop Developer Resume

3.00/5 (Submit Your Rating)

New York, NY

SUMMARY:

  • Over 8 years of application design, development and maintenance experience on Confidential for one of largest healthcare insurance company
  • Exposure to data quality analysis, data migration and data validation
  • Experience in using Apache Spark, Hive, Scoop, Flume and Cloudera Manager.
  • Cloudera certified Spark and Hadoop developer
  • Hands on experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
  • Hands on experience in application development using PYTHON, SCALA RDBMS, COBOL and JCLs.
  • Hands on experience in developing applications using Apache Spark’s APIs and SparkSQL
  • Knowledge in job workflow scheduling and monitoring tools like oozie and Job Control Language .
  • Experienced in leading, mentoring and training junior developers.
  • Award winning automation expert. Developed arrays of tools on job for repaid deployement.
  • Exposure to design, development and implementation of connectivity products that efficiently exchange data between database and Hadoop ecosystem.
  • Techno-functional responsibilities include identifying functional and technical gaps, estimates timelines, designing custom solutions, development, leading developers, producing documentation, and production support.
  • Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills.

TECHNICAL SKILLS:

Big data ecosystem: Hadoop, MapReduce, HDFS, Hive, Flume, Sqoop, Hbase, Zookeeper, Cloudera VM 5.8, Oozie, InfoSphere BigInsight 4.2

Programming/scripting languages: Python, Scala, Linux shell scripts, Cobol, JCL, Rexx,XML,JSON,AVRO.

Framework: Apache Spark

Databases: IBM-DB2,MySQL

Operating systems: Unix, centos 6.7, Z/OS, MVS, Windows 95/NT/2000/XP/7,TSO

Development tools: Pycharm-CE, Ipython, Git, SPUFI,SUBLIME 2, Eclipse, AVRO-TOOLS

Collaboration Tools: Rational Team Concert, Rational ClearQuest, SharePoint

WORK EXPERIENCE:

Confidential, New York, NY

System Analyst & Hadoop Developer

Responsibilities:

  • Involved in developing roadmap for migration from legacy system to Hadoop cluster.
  • Create, validate and maintain scripts to load data using Sqoop manually.
  • Create, validate and maintain scripts to extract and transform data from IBM DB2 to flat files and JSON format.
  • Create Oozie workflows and coordinators to automate Sqoop jobs weekly and monthly.
  • Worked on reading multiple data formats on HDFS using PySpark and Python.
  • Wrote python scripts for spark to perform operations like data inspection, cleaning, load and transformsthe large sets of structured and semi-structured imported data
  • Developed, validate and maintain HiveQL queries.
  • Designed Hive tables to load data to and from external HDFS datasets
  • Designed HiveQL script to create database, partitioned tables in hive metastore and wrote queries which will run internally in mapreduce way.
  • Running weekly and monthly reports using SparkSQL and python scripts.

Environment:: InfoSphere BigInsight 4.2, Hadoop 2.6, Apache Spark 1.2.1, Hive, Sqoop, Flume, Python, Oozie, DB2 SQL, Softlayer Cloud infrastructure.

Confidential, New York, NY

System Analyst & Developer,

Responsibilities:

  • Conduct detailed business functional requirement analysis for various health plan contracts.
  • Work with requirement writers and end customers to finalize & translate business requirements into functional requirements
  • Prepare detailed design document based on functional requirements.
  • Develop solution using COBOL & wrote SQL queries to process large amount of data
  • Develop and prepared various ad-hoc reports using SORT utilities, VSAM JCL,DB2 scripts and REXX.
  • Wrote Job Control Language scripts to design controlled work flow of business logic.
  • DB2 SQL queries and test scripts written on occasion to assist with the investigation and resolution of a particular defect.
  • Work with system testers for preparing regression test-cases.
  • Support User Acceptance Testing & code implementation.
  • Coordinate offshore and onshore work efforts.
  • Administer SharePoint sites - Access and storage management, Customization.

Environment:: Z/OS, MVS, COBOL, JCL/PROC, VSAM,Cobol-XML, DB2 SQL, SPUFI,IMS, REXX, CLIST, VB scripting, ClearQuest, Share-point

Confidential

Batch Process Lead & Application developer

Responsibilities:

  • Worked with customer to gather business functional requirements.
  • Analyzed and prepared design plan for batch process.
  • Assigned task to team members and reviewed design documents.
  • Designed and tested rexx modules to update table(s).
  • Designed and tested JCL, PROCs & Cards to update table(s).
  • Designed and tested JCL, PROCs & Cards for backup and recovery.
  • Provided after implementation support & Knowledge transfer for developed items.

Environment:: Z/OS, MVS, JCL/PROC, REXX, CLIST.

Confidential

Application Developer

Responsibilities:

  • Analyze and repurpose interface for reading XML web portal requests raised by customers.
  • Designed cobol programs, copybooks to process requests
  • Designed and implemented SQL queries
  • Perform on demand modification to programs to provide customized summary reports
  • Designed monthly and yearly batch jobs
  • Designed report archival jobs

Environment:: Z/OS, MVS, COBOL, JCL/PROC, VSAM, Cobol-XML, DB2 SQL, SPUFI,IMS, ClearQuest, Share-point.

Confidential

System Quality Assurance Analyst

Responsibilities:

  • Supported all phases of the testing lifecycle related to medical & institutional claims processing.
  • Ensured application of correct managed care benefits.
  • Built positive and negative test cases & prepared test matrices.
  • Identified the miss-coded benefits and its cause.
  • Coordinated and communicated errors & causes to developer.
  • Established implementation and test plans, built software acceptance criteria, coordinated and worked with clients to oversee the acceptance and dissemination process
  • Communicate the successful execution of change request to customer & handling of customer queries.
  • Utilize in-depth knowledge of functional and technical experience in Healthcare and other leading-edge products and technology in conjunction with industry and business skills to deliver solutions to customer.
  • Mentoring and guidance on CRs / Production Support

Environment:: Z/OS, MVS, COBOL, JCL/PROC, VSAM, IMS, ClearQuest, Share-point.

We'd love your feedback!