System Analyst & Hadoop Developer Resume
New York, NY
SUMMARY:
- Over 8 years of application design, development and maintenance experience on Confidential for one of largest healthcare insurance company
- Exposure to data quality analysis, data migration and data validation
- Experience in using Apache Spark, Hive, Scoop, Flume and Cloudera Manager.
- Cloudera certified Spark and Hadoop developer
- Hands on experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
- Hands on experience in application development using PYTHON, SCALA RDBMS, COBOL and JCLs.
- Hands on experience in developing applications using Apache Spark’s APIs and SparkSQL
- Knowledge in job workflow scheduling and monitoring tools like oozie and Job Control Language .
- Experienced in leading, mentoring and training junior developers.
- Award winning automation expert. Developed arrays of tools on job for repaid deployement.
- Exposure to design, development and implementation of connectivity products that efficiently exchange data between database and Hadoop ecosystem.
- Techno-functional responsibilities include identifying functional and technical gaps, estimates timelines, designing custom solutions, development, leading developers, producing documentation, and production support.
- Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills.
TECHNICAL SKILLS:
Big data ecosystem: Hadoop, MapReduce, HDFS, Hive, Flume, Sqoop, Hbase, Zookeeper, Cloudera VM 5.8, Oozie, InfoSphere BigInsight 4.2
Programming/scripting languages: Python, Scala, Linux shell scripts, Cobol, JCL, Rexx,XML,JSON,AVRO.
Framework: Apache Spark
Databases: IBM-DB2,MySQL
Operating systems: Unix, centos 6.7, Z/OS, MVS, Windows 95/NT/2000/XP/7,TSO
Development tools: Pycharm-CE, Ipython, Git, SPUFI,SUBLIME 2, Eclipse, AVRO-TOOLS
Collaboration Tools: Rational Team Concert, Rational ClearQuest, SharePoint
WORK EXPERIENCE:
Confidential, New York, NY
System Analyst & Hadoop Developer
Responsibilities:
- Involved in developing roadmap for migration from legacy system to Hadoop cluster.
- Create, validate and maintain scripts to load data using Sqoop manually.
- Create, validate and maintain scripts to extract and transform data from IBM DB2 to flat files and JSON format.
- Create Oozie workflows and coordinators to automate Sqoop jobs weekly and monthly.
- Worked on reading multiple data formats on HDFS using PySpark and Python.
- Wrote python scripts for spark to perform operations like data inspection, cleaning, load and transformsthe large sets of structured and semi-structured imported data
- Developed, validate and maintain HiveQL queries.
- Designed Hive tables to load data to and from external HDFS datasets
- Designed HiveQL script to create database, partitioned tables in hive metastore and wrote queries which will run internally in mapreduce way.
- Running weekly and monthly reports using SparkSQL and python scripts.
Environment:: InfoSphere BigInsight 4.2, Hadoop 2.6, Apache Spark 1.2.1, Hive, Sqoop, Flume, Python, Oozie, DB2 SQL, Softlayer Cloud infrastructure.
Confidential, New York, NYSystem Analyst & Developer,
Responsibilities:
- Conduct detailed business functional requirement analysis for various health plan contracts.
- Work with requirement writers and end customers to finalize & translate business requirements into functional requirements
- Prepare detailed design document based on functional requirements.
- Develop solution using COBOL & wrote SQL queries to process large amount of data
- Develop and prepared various ad-hoc reports using SORT utilities, VSAM JCL,DB2 scripts and REXX.
- Wrote Job Control Language scripts to design controlled work flow of business logic.
- DB2 SQL queries and test scripts written on occasion to assist with the investigation and resolution of a particular defect.
- Work with system testers for preparing regression test-cases.
- Support User Acceptance Testing & code implementation.
- Coordinate offshore and onshore work efforts.
- Administer SharePoint sites - Access and storage management, Customization.
Environment:: Z/OS, MVS, COBOL, JCL/PROC, VSAM,Cobol-XML, DB2 SQL, SPUFI,IMS, REXX, CLIST, VB scripting, ClearQuest, Share-point
ConfidentialBatch Process Lead & Application developer
Responsibilities:
- Worked with customer to gather business functional requirements.
- Analyzed and prepared design plan for batch process.
- Assigned task to team members and reviewed design documents.
- Designed and tested rexx modules to update table(s).
- Designed and tested JCL, PROCs & Cards to update table(s).
- Designed and tested JCL, PROCs & Cards for backup and recovery.
- Provided after implementation support & Knowledge transfer for developed items.
Environment:: Z/OS, MVS, JCL/PROC, REXX, CLIST.
ConfidentialApplication Developer
Responsibilities:
- Analyze and repurpose interface for reading XML web portal requests raised by customers.
- Designed cobol programs, copybooks to process requests
- Designed and implemented SQL queries
- Perform on demand modification to programs to provide customized summary reports
- Designed monthly and yearly batch jobs
- Designed report archival jobs
Environment:: Z/OS, MVS, COBOL, JCL/PROC, VSAM, Cobol-XML, DB2 SQL, SPUFI,IMS, ClearQuest, Share-point.
ConfidentialSystem Quality Assurance Analyst
Responsibilities:
- Supported all phases of the testing lifecycle related to medical & institutional claims processing.
- Ensured application of correct managed care benefits.
- Built positive and negative test cases & prepared test matrices.
- Identified the miss-coded benefits and its cause.
- Coordinated and communicated errors & causes to developer.
- Established implementation and test plans, built software acceptance criteria, coordinated and worked with clients to oversee the acceptance and dissemination process
- Communicate the successful execution of change request to customer & handling of customer queries.
- Utilize in-depth knowledge of functional and technical experience in Healthcare and other leading-edge products and technology in conjunction with industry and business skills to deliver solutions to customer.
- Mentoring and guidance on CRs / Production Support
Environment:: Z/OS, MVS, COBOL, JCL/PROC, VSAM, IMS, ClearQuest, Share-point.