SUMMARY:
- He has 10+ years of IT experience with great exposure to all the stages of life cycle of a project.
- He was Involved in the following activities.
- Involved in estimation, planning.
- Involve in Business analysis.
- Involved in requirement gathering.
- Involved in discussions with Vendors,stake holders and coordinators over various technical challenges.
- Involved in the High level design and low level design of deliverables and build.
- Involved in component integration testing and support of system integration testing.
- Involved in installation of components in production, and job monitoring.
- Involved in post implementation fixes and job monitoring.
- Involved in production support activities for existing applications.
- Worked on Hadoop and Map Reduce programs for Analytics for 4 years
- Worked on Visualization tool R - Programming
- Worked on scala, xml, json data in Hadoop.
- Worked on data ingestion using Kafka, flume, sqoop tools to import data into Hadoop ecosystem.
- Working on spark ecosystem from past 1 year
- Experience in using UNIX platform with shell scripting
- Having Good knowledge of No SQL databases (Hbase, Mango DB)
- He has worked with various clients as below:
- Card Industry ( Confidential )
- Manufacturing ( Confidential )
- Insurance (Union Bank of Switzerland, U.S.)
- Banking(Bank of America)
TECHNICAL SKILLS:
Big data Technologies: Hadoop Map Reduce, Hive, Pig, Spark, Sqoop, Flume, Kafka
Visualization tools: R-Programming
No SQL DB: Mongo DB
Languages: JAVA, SCALA, Python, XML, SQL, PL/SQL
Operating Systems: MVS,Linux
RDBMS: DB2,Oracle
ETL Tools: Informatica 9.X
Mainframe System: MVS,COBOL,JCL,CICS,VSAM
PROFESSIONAL EXPERIENCE:
Confidential
Lead Engineer
Responsibilities:
- Responsible for designing, coding, testing and deployment phases of Complete Hadoop project.
- Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
- Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW tables and historical metrics
- Used Oozie to schedule pig,map reduce hive and, sqoop jobs.
- Completed a migration of hive project code from hive server to hive server 2.
- Worked on Sentry security tool for Hive.
- Worked on Hadoop security using kerboros.
- Worked on hive query performance tuning in joins,portioning and bucketing.
- Processing huge data using hive for ETL and data warehouse
- Data transfers between Hadoop and non-Hadoop systems
- Worked on Distcp to transfer files from one cluster to another cluster.
- Worked on impala and sqoop for data analysis
- Responsible for Map reduce programs to filter and process XML files.
- Worked on pig scripts for transformations and loading different file formats.
- Worked on sqoop to import data from oracle to hdfs and used hiveimport also.
- Automated sqoop incremental imports into hive tables.
- Worked on Eclipse IDE for map reduce and scala code..
- Worked on Spark core and spark sql and spark streaming in POC.
- Worked with different data formats in Spark like CSV,Json,XML .
- Worked on Spark RDD trasformations and actions.
- Worked on different storage formats in spark.
- Worked on HIVE Context to import data from HIVE and store back after trasformations.
- Scheduled Sparks job in oozie.
- Worked with Kafka and Spark streaming for Streaming data from website using different APIs.
Confidential
Business Systems Design Specialist
Responsibilities:
- Completed one POC in Hadoop to move data from DB2 database and verified performance.
- Worked on importing data using Sqoop from DB2 database and scheduled jobs.
- Involved in the requirements definition and analysis phases of multiple Data Warehousing projects.
- His role involves significant customer communication activities to understand their challenges while implementing Oracle Business Intelligence Applications
- Resolving customer issues during implementation of Oracle Business Intelligence Applications.
- Created Procedures and scripts for running mappings
- Worked on Configuration Manager and Functional Setup Manager
- Developed test cases and tested the mappings per Test plans
- Involved in Peer Testing and Code Review test cases preparation.
- Helping presales technical teams to demo the advanced Oracle products features to prospective customers.
- Installation and configuration of Oracle Business Intelligence Applications environments for Customer CVCs.
- Prepared functional design documents on Procurement & Supply chain domains.
Confidential
Business Systems Design Specialist
Responsibilities:
- Involved in impact analysis during HLD phase, estimation and review of deliverables.
- Involved and assisted in preparation of the High Level Design and Low Level design documents.
- Involved in component integration testing and support of system integration testing.
- Involved in post implementation fixes and job monitoring.
- Provide Production support.
- Involved in ADHOC Report generation.
