Lead Engineer Resume

SUMMARY:

He has 10+ years of IT experience with great exposure to all the stages of life cycle of a project.
He was Involved in the following activities.
Involved in estimation, planning.
Involve in Business analysis.
Involved in requirement gathering.
Involved in discussions with Vendors,stake holders and coordinators over various technical challenges.
Involved in the High level design and low level design of deliverables and build.
Involved in component integration testing and support of system integration testing.
Involved in installation of components in production, and job monitoring.
Involved in post implementation fixes and job monitoring.
Involved in production support activities for existing applications.
Worked on Hadoop and Map Reduce programs for Analytics for 4 years
Worked on Visualization tool R - Programming
Worked on scala, xml, json data in Hadoop.
Worked on data ingestion using Kafka, flume, sqoop tools to import data into Hadoop ecosystem.
Working on spark ecosystem from past 1 year
Experience in using UNIX platform with shell scripting
Having Good knowledge of No SQL databases (Hbase, Mango DB)
He has worked with various clients as below:
Card Industry ( Confidential )
Manufacturing ( Confidential )
Insurance (Union Bank of Switzerland, U.S.)
Banking(Bank of America)

TECHNICAL SKILLS:

Big data Technologies: Hadoop Map Reduce, Hive, Pig, Spark, Sqoop, Flume, Kafka

Visualization tools: R-Programming

No SQL DB: Mongo DB

Languages: JAVA, SCALA, Python, XML, SQL, PL/SQL

Operating Systems: MVS,Linux

RDBMS: DB2,Oracle

ETL Tools: Informatica 9.X

Mainframe System: MVS,COBOL,JCL,CICS,VSAM

PROFESSIONAL EXPERIENCE:

Confidential

Lead Engineer

Responsibilities:

Responsible for designing, coding, testing and deployment phases of Complete Hadoop project.
Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW tables and historical metrics
Used Oozie to schedule pig,map reduce hive and, sqoop jobs.
Completed a migration of hive project code from hive server to hive server 2.
Worked on Sentry security tool for Hive.
Worked on Hadoop security using kerboros.
Worked on hive query performance tuning in joins,portioning and bucketing.
Processing huge data using hive for ETL and data warehouse
Data transfers between Hadoop and non-Hadoop systems
Worked on Distcp to transfer files from one cluster to another cluster.
Worked on impala and sqoop for data analysis
Responsible for Map reduce programs to filter and process XML files.
Worked on pig scripts for transformations and loading different file formats.
Worked on sqoop to import data from oracle to hdfs and used hiveimport also.
Automated sqoop incremental imports into hive tables.
Worked on Eclipse IDE for map reduce and scala code..
Worked on Spark core and spark sql and spark streaming in POC.
Worked with different data formats in Spark like CSV,Json,XML .
Worked on Spark RDD trasformations and actions.
Worked on different storage formats in spark.
Worked on HIVE Context to import data from HIVE and store back after trasformations.
Scheduled Sparks job in oozie.
Worked with Kafka and Spark streaming for Streaming data from website using different APIs.

Confidential

Business Systems Design Specialist

Responsibilities:

Completed one POC in Hadoop to move data from DB2 database and verified performance.
Worked on importing data using Sqoop from DB2 database and scheduled jobs.
Involved in the requirements definition and analysis phases of multiple Data Warehousing projects.
His role involves significant customer communication activities to understand their challenges while implementing Oracle Business Intelligence Applications
Resolving customer issues during implementation of Oracle Business Intelligence Applications.
Created Procedures and scripts for running mappings
Worked on Configuration Manager and Functional Setup Manager
Developed test cases and tested the mappings per Test plans
Involved in Peer Testing and Code Review test cases preparation.
Helping presales technical teams to demo the advanced Oracle products features to prospective customers.
Installation and configuration of Oracle Business Intelligence Applications environments for Customer CVCs.
Prepared functional design documents on Procurement & Supply chain domains.

Confidential

Business Systems Design Specialist

Responsibilities:

Involved in impact analysis during HLD phase, estimation and review of deliverables.
Involved and assisted in preparation of the High Level Design and Low Level design documents.
Involved in component integration testing and support of system integration testing.
Involved in post implementation fixes and job monitoring.
Provide Production support.
Involved in ADHOC Report generation.

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship