We provide IT Staff Augmentation Services!

Lead Engineer Resume

SUMMARY:

  • He has 10+ years of IT experience with great exposure to all the stages of life cycle of a project.
  • He was Involved in the following activities.
  • Involved in estimation, planning.
  • Involve in Business analysis.
  • Involved in requirement gathering.
  • Involved in discussions with Vendors,stake holders and coordinators over various technical challenges.
  • Involved in the High level design and low level design of deliverables and build.
  • Involved in component integration testing and support of system integration testing.
  • Involved in installation of components in production, and job monitoring.
  • Involved in post implementation fixes and job monitoring.
  • Involved in production support activities for existing applications.
  • Worked on Hadoop and Map Reduce programs for Analytics for 4 years
  • Worked on Visualization tool R - Programming
  • Worked on scala, xml, json data in Hadoop.
  • Worked on data ingestion using Kafka, flume, sqoop tools to import data into Hadoop ecosystem.
  • Working on spark ecosystem from past 1 year
  • Experience in using UNIX platform with shell scripting
  • Having Good knowledge of No SQL databases (Hbase, Mango DB)
  • He has worked with various clients as below:
  • Card Industry ( Confidential )
  • Manufacturing ( Confidential )
  • Insurance (Union Bank of Switzerland, U.S.)
  • Banking(Bank of America)

TECHNICAL SKILLS:

Big data Technologies: Hadoop Map Reduce, Hive, Pig, Spark, Sqoop, Flume, Kafka

Visualization tools: R-Programming

No SQL DB: Mongo DB

Languages: JAVA, SCALA, Python, XML, SQL, PL/SQL

Operating Systems: MVS,Linux

RDBMS: DB2,Oracle

ETL Tools: Informatica 9.X

Mainframe System: MVS,COBOL,JCL,CICS,VSAM

PROFESSIONAL EXPERIENCE:

Confidential

Lead Engineer

Responsibilities:

  • Responsible for designing, coding, testing and deployment phases of Complete Hadoop project.
  • Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
  • Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW tables and historical metrics
  • Used Oozie to schedule pig,map reduce hive and, sqoop jobs.
  • Completed a migration of hive project code from hive server to hive server 2.
  • Worked on Sentry security tool for Hive.
  • Worked on Hadoop security using kerboros.
  • Worked on hive query performance tuning in joins,portioning and bucketing.
  • Processing huge data using hive for ETL and data warehouse
  • Data transfers between Hadoop and non-Hadoop systems
  • Worked on Distcp to transfer files from one cluster to another cluster.
  • Worked on impala and sqoop for data analysis
  • Responsible for Map reduce programs to filter and process XML files.
  • Worked on pig scripts for transformations and loading different file formats.
  • Worked on sqoop to import data from oracle to hdfs and used hiveimport also.
  • Automated sqoop incremental imports into hive tables.
  • Worked on Eclipse IDE for map reduce and scala code..
  • Worked on Spark core and spark sql and spark streaming in POC.
  • Worked with different data formats in Spark like CSV,Json,XML .
  • Worked on Spark RDD trasformations and actions.
  • Worked on different storage formats in spark.
  • Worked on HIVE Context to import data from HIVE and store back after trasformations.
  • Scheduled Sparks job in oozie.
  • Worked with Kafka and Spark streaming for Streaming data from website using different APIs.

Confidential

Business Systems Design Specialist

Responsibilities:

  • Completed one POC in Hadoop to move data from DB2 database and verified performance.
  • Worked on importing data using Sqoop from DB2 database and scheduled jobs.
  • Involved in the requirements definition and analysis phases of multiple Data Warehousing projects.
  • His role involves significant customer communication activities to understand their challenges while implementing Oracle Business Intelligence Applications
  • Resolving customer issues during implementation of Oracle Business Intelligence Applications.
  • Created Procedures and scripts for running mappings
  • Worked on Configuration Manager and Functional Setup Manager
  • Developed test cases and tested the mappings per Test plans
  • Involved in Peer Testing and Code Review test cases preparation.
  • Helping presales technical teams to demo the advanced Oracle products features to prospective customers.
  • Installation and configuration of Oracle Business Intelligence Applications environments for Customer CVCs.
  • Prepared functional design documents on Procurement & Supply chain domains.

Confidential

Business Systems Design Specialist

Responsibilities:

  • Involved in impact analysis during HLD phase, estimation and review of deliverables.
  • Involved and assisted in preparation of the High Level Design and Low Level design documents.
  • Involved in component integration testing and support of system integration testing.
  • Involved in post implementation fixes and job monitoring.
  • Provide Production support.
  • Involved in ADHOC Report generation.

Hire Now