SUMMARY

• 11+ Years of IT industry experience encompassing a wide range of skill sets. Roles and industry verticals.
• 3 Years’ experience in performing development and data analytics using HADOOP (BIG - DATA) tools and technologies which included HDFS, MAPREDUCE, HIVE, PIG, HBASE, MONGODB, FLUME, SQOOP, Hue and OOZIE.
• Strong database skills in IDMS, DB2, HIVE, Oracle, MySQL and No-SQL databases like HBASE, MONGODB, familiarity with CASSANDRA.
• Experienced in installing, configuring, managing and testing Big-data “HADOOP” ecosystem components.
• Experienced in Data warehouse concepts and ETL tools (Informatica and Talend).
• Experience in the area of legacy systems based on Mainframe platform
• Experienced in UNIX, and Linux desktops such as Ubuntu, CentOS
• Experienced with work flow schedulers, data architecture including data ingestion pipeline design and data modeling.
• Experience in leading and managing teams.
• Possess functional knowledge in the areas of Insurance systems, Financial Systems and Material Management System.
• Good experience in all phases of systems life cycle Development, Testing (Unit test, System test, Integration Testing and Regression Testing) and Pre Production support.
• Proficient in analyzing and translating business requirements to technical requirements and architecture.
• Experience in projecting financial forecasts, building staffing plan, preparing Metrics and implementation plans.
• Performed Knowledge management in the form of AIDs and Project knowledge and change documents.
• Experienced in handling internal and external functional, process and data audits.

TECHNICAL SKILLS

Big Data Ecosystem: Apache Hadoop, CDH, HDFS, Hive, Impala, Sqoop, Pig, HBase, MongoDB, AVRO, Flume, Zookeeper, Cassandra, Oozie, Hue

Database skills: IDMS, DB2,DMS1100, Oracle, VSAM, MySQL

Programming/ Scripting Languages: COBOL, Java, PL/SQL, Unix shell, XML, SQL, HIVEQL, PIG scripts

Operating environments: MVS/ESA, ZOS, WINDOWS, UNIX, LINUX, AWS

Legacy: Mainframe, JCL, VSAM, ADSO, CICS, OLQ, DBOL, DMLO, CULPRIT, CHANGEMAN, PANVALENT, File manager, IBM Debug, ESP, ZEKE, CA-7

ETL/Reporting: Informatica, Talend, TABLEU

Processes: IBM’s OPAL (On Demand process asset library), QMS, Lean

Other tools: RPM, MPP, MANAGENOW R2, TEST DIRECTOR 8.0, CLARITY, QUALITY CENTER, SERVICE CENTER, FTP, SFTP, MOBIUS, DB Visualizer, Toad, SSHEclipse, IntelliJ Idea, SVN, IBM Websphere, Hudson, Maven, putty, puppet, pdsh.

PROFESSIONAL EXPERIENCE

Senior Hadoop Developer

Confidential

Responsibilities:

• Involved in installing Hadoop Cluster and Hadoop Ecosystem components.
• Importing and exporting data from various data sources into HDFS using Sqoop, NFS, FTP.
• Creating Hive tables and working on them using HiveQL and Hue.
• Experienced in analyzing data with Hive
• Written Apache PIG scripts to process the HDFS data.
• Experience in using Sequence files, RCFile, AVRO and ORC file formats.
• Created Java UDFs in PIG and HIVE.
• Reporting on popular pages, unique visitors, page views, keyword trends using Pig, Hive
• Implemented Partitioning, Bucketing in HIVE.
• Involved in data modeling in Hadoop.
• Performed Searches, counts, calculations, aggregations using Map-reduce programs
• Performed data handling related to CDR, Telematics, click streams
• Developed Oozie workflow for scheduling and orchestrating the ETL process
• Used Talend for data integration and transformation including hive and sqoop actions.
• Performed data processing (aggregates, filters, sorts, joins) using Talend before importing/ exporting to CDH.
• Involved in mongoDB setup, storing data and analyzing it using Java API and shell.
• Involved in querying Hbase database using shell and Java API.
• Performed Hbase and Hive integration using Hbase storage handlers (Serde).
• Handled claims data using HDFS and document oriented database (NO-SQL).
• Good working knowledge of Amazon Web Service components like EC2, EMR, S3, EBS, ELB
• Worked with the admin team in upgrading Hadoop Version.
• Experience with MRV1 and MRV2 (YARN) frameworks.
• Participated in commissioning and decommissioning of nodes.
• Participated in backup and recovery of Hadoop file system.
• Used to manage and review the Hadoop log files and Monitor systems using CLI and Cloudera Manager.
• Automated tasks using Unix shell scripts.
• Come up with estimations and Technical Design Specifications for projects.
• Gathered the business requirements from the Business Partners and Subject Matter Experts.

Environment: HADOOP, HDFS, MAPREDUCE, HIVE, Hue, PIG, Flume, SQOOP, HBASE, OOZIE, MONGODB, AVRO, ZooKeeper, Core Java, Oracle, SQL, UBUNTU/UNIX, eclipse, IntelliJ, Maven, TABLEU, JDBC drivers, Mainframe, MySQL, Informatica, Linux, AWS, XML, CRM, SVN, PDSH, Putty, SSH, Kerberos, Talend.

Senior Developer/ Tech Lead

Confidential

Responsibilities:

• Providing production support for applications by monitoring the daily job cycles providing fixes for the reported program errors, including Batch and Online programs or user queries.
• Performing data analysis and data cleansing using automated batch scripts.
• Provide solutions to Walkups, operational, incident tickets
• Provide data fixes and code fixes related to defects
• Participated in regulatory data audits requiring data gathering exercises
• Developed Queries for reporting
• Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Oracle and Informatica PowerCenter.
• Responsible for design and build data mart as per the requirements.
• Performed Data Migration from Main Frame and Legacy Systems.
• Developed applications using Eclipse
• Performed process enhancement by SQL Tuning.
• Performed CRUD operations using PL/SQL.
• Provide low level and high level solution design document.
• Developed programs and Jobs and automate them using schedulers
• Responsible for disaster recovery of systems
• Participate and Perform software upgrades and conversions.
• Translate customer requirements into formal requirements and design documents, establish specific solutions, and leading the efforts including programming and testing that culminate in client acceptance of the results.

Environment: Oracle, Java, PL/SQL, UNIX shell scripting, Oracle Insurance Policy Administration platform, Oracle forms, XML,SVN, eclipse, Informatica, Talend, Data mart, Tableu, COBOL, IDMS, DB2, CICS, ADSO, JCL, ESP, VSAM, FTP, SFTP

Senior Developer

Confidential

Responsibilities:

• Monitoring the daily job cycles Providing fixes for the reported program errors, including Batch and Online programs or user queries.
• Provide data fixes and code fixes related to defects
• Performing data analysis and data cleansing using automated batch scripts.
• Translate customer requirements into formal requirements and design documents.
• Coding as per specifications and test the programs for FSS applications enhancements.
• Preparation of Test Plans, Test Data, perform Testing and Verification of changes made
• Develop Jobs and automate them using schedulers

Environment: COBOL, DB2, IDMS, ADSO, CICS, JCL, ELIPS, VSAM, FTP, Oracle, Java, eclipse, SVN, SQL

Software Engineer

Confidential

Responsibilities:

• Performing data analysis and data cleansing using automated batch scripts.
• Provide data fixes and code fixes related to defects
• Developed Queries for reporting
• Developed applications using Eclipse
• Performed CRUD operations using PL/SQL.
• Developed programs and Jobs and automate them using schedulers
• Translate customer requirements into formal requirements and design documents.

Environment: COBOL, JCL, CICS-DB2, VIASOFT-SMART TEST, DMS1100, Oracle, Java, eclipse, SQL