Lead Associate Software Resume
PROFESSIONAL SUMMARY:
- Expreineced Data Engineer and Hadoop Devleoper backed by 7+ years of insightful experience in IT arena distinguished by commended performance and proven results with expertise on Big Data, Data warehouse, ETL/ELT, RDBMS.
- Worked on all critical development tasks like Big Data Analytics, Data Analysis, Data Quality (DQ), Performance Tuning, Data warehousing, ETL (Informatica Power Center) andreport development using visualization tool (Tableau).
- Quick learner and ready to learn new technologies and frameworks as and when necessary.
- Strong hands on experience on Hadoop Eco System: HDFS, Hive, Impala, Sqoop, Spark - Scala.
- Certified database professional as well as expertise in programming in various lannguages like Java,Python,Scala
- Have expertise and experience in all phases of project life cycle namely analysis, design, coding, testing, and implementation phases
- Worked on data analytics project on building complex analytical reports and supporting Ad-hoc data analysis
- Hands on experience on implementing complex business rules / algorithms in SQL and then integrating the same in Business Server in Java
- Experienced to build Data Quality (DQ) rules framework on various database systems
- Database architecture level understanding and development and performance tuning experience
- Experienced in Informatica Power Center (ETL)
- Experience on working with an Agile methodology
- Knowledge of various Statistical Techniques for Data Analytics
- Good team player as well as team lead; able to manage and work with Onsite-Offshore model.
- Able to manage and work with end users/business users with high satisfaction track record.
TECHNICAL SKILLS:
Big Data / Hadoop: HDFS, Hive, Impala, Sqoop, Spark with Scala, MongoDB, HBase
OLAP / MPP Database: Netezza, NZSQL, NZPL-SQL, NZLOAD, NPS, Netezza-ADMIN, Vertica HPE
OLTP / RDBMS: Oracle 9i, 10g, 11g (SQL, PL-SQL)
ETL Tools: Informatica Power Center 9.x
Visualization Tool: Tableau 10
Operating System: Unix-Linux, Windows
Scheduling Tools: Cron Jobs, Oozie.
Tools: NPS, Netezza Query Tool, Hue, PL/SQL Developer, Oracle Enterprise Manager, SQL*Plus, Aginity
Scripting: Unix Shell Scripting, Python 2.6
PROFESSIONAL EXPERIENCE:
Confidential
Lead Associate Software
Platform: Netezza/Oracle/Vertica/Custom Application/Hadoop Eco System
Skills: NZSQL/NZPLSQL, VSQL, Java, Scala, Python, R, MapReduce, Shell Scripting, Pig, Hive, HBase, MongoDB, Kafka, Informatica, Tableau
Responsibilities:
- Involved and leading entire Database migration project from Netezza legacy system to Hadoop
- Developed seamless data warehousing application on Netezza/vertica HPE
- Development of analytical report on Hadoop and Netezza/Vertica HPE
- Database design for Netezza and Hadoop (Data Modelling)
- Successfully developed generic CDC (Change Data Capture) module on Hadoop and Netezza
- Accept the report development request from various clients through JIRA system interface
- Analyze the request and plan data modeling for raised report request
- Use of Hadoop streaming to get the data by an hour to the system
- Develop data quality framework before consuming the data into the actual Analytics database
- Extensive use of Sqoop to load the data from various file system and vendors to the system
- Development of NZSQL script and Netezza database for each report request (Data Modeling)
- Development on Hive (Map-Reduce) and Impala for each report request
- Development of DQ framework on Hadoop, Netezza on each hops of the system (Source to all downstream)
- Key role in the implementing complex and advanced analytical reports in and there integration in Zeus appliance
- Establish daily, monthly, hourly data loading and unloading activity for Netezza and Hadoop (NZLOAD, NZMIGRATE, Sqoop, Hive, Spark-Scala, Shell Scripting)
- R&D activity on analytical report for development.
- Responsible for all offshore new development and enhancement for Zeus Appliance
- Subject matter expert for Netezza Performance tuning issues.
- Leading the POC development and presentation of the results to senior management
- Development custom report mostly from Vertica/Netezza Appliance and sometimes directly from Hadoop (Pig/Hive)
- Communication with all downstream and handling business issues as a lead point of contact person.
- Provide training to other team members on existing database process, database programming, Technologies like Netezza/Vertica and Hadoop/Big Data.