Technologist with strong business acumen and technical experience in Big Data / Hadoop space, Big Data consulting, implementations, architecture.
Over 6.8 years experience in data cleaning, data management and providing expertise for building business intelligence application. Good communication and problem analysis skills in retail, finance, telecom domain.
- Proficient in Hive, Teradata, Sqoop,Hortonworks Framework, Hadoop Eco system.
- Tool expertise in Autosys, GIT,SQL Developer,SQL Workbench,Putty,Winscp
- Expertise on end to end Hortonworks framework, starting from source data landing, data processing in hive, replication within hadoop platforms and across platforms like Teradata and Vertica.
- Have knowledge on Cloudera framework.
- Designed and developed various aggregates in Hive along with the cross environment replication setup.
- Designed and developed an TD steaming utility which helped our team and various other teams to send huge volume data from hadoop Teradata with high accuracy, which helped Confidential save lot of money in terms of infrastructure and employee working hours.
- Expertise in working with huge volume data sets.
- Expertise on Oracle SQL developer, which is used as the Metadata Framework for our application.
- Experience in Tez, Sqoop, Teradata, Distcp, Oozie, Splunk,Autosys
- Performance tuning of hadoop workflow,replication and Teradata replication flows.
- Expertise in hadoop and and TD DR setup and data recovery.
- Strong communication, collaboration and interpersonal skills with proficiency in grasping new technical concepts quickly and utilizing them in an effective manner.
- Leading a team of five offshore members.
- Worked with B.D.A.T(Business,Data,Architecture,Technology) model helped me synchronizing business requirements with the solution implementation using various HADOOP related technologies such as HIVE,PIG,HBASE,SQOOP,MAPREDUCE.
- Understanding the business domain, including business plan.
- Structural and functional analysis of data involved in the project.
- Helping our team for building the architecture of the solution.
- Data Loading,Data transformation,Data Quality optimization,Data Sampling,Analysis,Reporting.
- As an Implementation Engineer my responsibility varied from Understanding the business and the requirements,Designing the architecture,development and Implementation,deployment,UAT and client support.