Etl Developer Resume
San Ramon, CA
SUMMARY
- Having 10 years of IT experience and technical proficiency in Data Warehousing involving Business Requirement Analysis, Application Design, Concepts of Dimensional Data Modeling, Development, Coding, Testing and Implementation of business applications with RDBMS, Data Warehouse/Data Mart, ETL.
- Extensive knowledge in Data Modeling using Dimensional Data modeling, Star Schema/Snow flake schema, FACT & Dimensions tables, Physical & logical data modeling
- Vast experience in designing and developing complex Pentaho jobs.
- Expertise with querying relational databases using SQL.
- Worked extensively on Optimization and Tuning for increasing Query and Database performance.
- Understanding of Ralph Kimball Data Warehouse methodologies and knowledge on the various data design models like Star Schema and Snowflake models.
- Experience with Type I, Type II, Type III Dimensions and working with Big Data
- Experience in writing UNIX shell scripts to support and automate the ETL process.
- Excellent analytical and logical programming skills with a good understanding at the conceptual level and possess excellent presentation, interpersonal skills with a strong desire to achieve specified goals.
- Solid understanding of relational database concepts.
- Solid understanding of data warehouse star schema concepts.
- Experience in creating workflows sessions in Workflow Manager and running the workflows in Workflow Monitor and analyzing them.
- Expertise using Pentaho Kettle (PDI, Spoon, Kitchen, Pan)
- Proficient in working with Hadoop, HDFS, writing PIG scripts and Sqoop scripts
- Knowledgeon Oozie, Hbase, Hive, NoSQL
- Experience in the Healthcare claims processing field.
- Proficient in JEE technologies such as EJB 3.0, hibernate, spring, JSP and Servlets
- Proficient in Web services & SOA.
- Expertise with JEE application servers like IBM WebSphere, Tomcat, JBOSS.
- Expertise with JEE compliant IDE’s like Eclipse, WSAD, RAD, JBuilder and IntelliJ
- Expertise in open source frameworks like Struts, ANT, Junit and Log4J.
- Expertise in Rational Rose Enterprise Tool for Object Oriented Analysis (OOA) and Design (OOD) using UML.
- Expertise with using Oracle, MySQL, PostgreSQL, DB2 databases and writing highly complex SQL queries.
- Extensive knowledge of Front End Technologies: AJAX, JSTL, JSP, HTML, DHTML, JavaScript and CSS.
- Expertise with UNIX, Linux and Windows 2000/XP/NT
- Expertise in developing graphics images using Adobe Photoshop.
- Well versed with complete Life Cycle Development process which includes Designing, Developing, Testing and Implementation.
- Good team player and can work efficiently in multiple team environments and multiple products. Easily adaptable to the new systems and environments.
- Good organizational skills and ability to multi - task, work independently.
- Excellent written and verbal communication skills including experience in proposal and presentation creation.
TECHNICAL SKILLS
ETL Tools: Pentaho Kettle (PDI, Spoon, Kitchen, Pan), PIG, Sqoop, Hadoop, Informatica
Programming Languages: Java, C, C++
Java Technologies: JSE, JEE, Servlets, JSP, EJB 3.0, JDBC, JMS, spring, hibernate
Application Servers: WebSphere, Tomcat, WebLogic, Jboss
Web Servers: Apache, IIS
MVC Frame Works: Jakarta Struts, Spring MVC
Databases: DB2, PostgreSQL, MS SQL server, Oracle, SOQL
IDE s & Utilities: Eclipse, WSAD, RAD, Intellij, Jbuilder, SQL Developer, TOAD
Web Dev. Technologies: HTML, XML, XSL, XSLT
Scripting Languages: JavaScript, PHP, Python
Protocols: TCP/IP, SOAP, HTTP
Operating Systems: UNIX, WINDOWS 98/2000/NT/XP
Design/ Version control: UML, Rational Rose, CVS
Animation Tools: 3DS MAX, Photoshop
PROFESSIONAL EXPERIENCE
Confidential, San Ramon, CA
ETL Developer
Responsibilities:
- Worked on extracting data from DB2/Oracle database and load to Oracle database
- Worked extensively on optimizing transformations for better performance
- Perform error handling on Pentaho transformations
- Involved in developing huge transformations in Pentaho kettle
- Performing data validation for the Pentaho pipelines
- Involved in knowledge sharing sessions with teams
- Contributed for creating document on naming conventions and best practices
- Mentor, develop and train team members
- Generalizing transformations to work with different countries data
- Experience using Hadoop, HDFS
- Worked on writing many hadoop PIG scripts applying transformation logic and Salesforce trigger validation logic
- Worked on UDF for PIG scripts in hadoop
- Knowledge on Oozie, MapReduce, Hive, HBase
- Worked on hadoop Sqoop scripts to move data from relational databases to HDFS
- Worked on preload for Salesforce using hadoop PIG scripts
- Worked on creating .sdl properties file for Salesforce data load with maps values between Salesforce and data access objects
Environment: Pentaho 5.0, Hadoop, PDI, Kettle, Spoon, Pan, Kitchen, HDFS, MapReduce, Hive, HBase, Oozie, NoSQL, SQL Developer, TOAD, Oracle, DB2, Salesforce, SDL, Workbench, Livelink, TortoiseSVN, Eclipse, JAVA, Sublime Text, Big data, Alfresco, Lync, Skype
Confidential, Mountain View, CA
ETL Developer
Responsibilities:
- Worked on migrating the Flume pipelines in java to Pentaho transformations
- Worked extensively with business to translate Flume code into technical specifications
- Involved in developing huge transformations in Pentaho kettle
- Performing data validation for the Pentaho pipelines
- Worked on Unit testing by creating test data and comparing expected results
- Running the pipeline on Confidential ’s Borg which enables it to run on Confidential 's clusters which can run hundreds of thousands of different applications on which it has tens of thousands of machines
- Contributed for creating document on naming conventions and best practices
- Creating intermediate files using flume code to generate test data
- Worked with Big Data technologies like Confidential File System, BigTable
- Involved in knowledge sharing sessions with other teams
Environment: Pentaho 4.3.0, Kettle, Spoon, Pan, Kitchen, Ubuntu, Perforce, Sigma, Borg, Buganizer, Big DataGFS( Confidential File System), Big Table, MapReduce
Confidential, Mechanicsburg, PA
ETL Developer
Responsibilities:
- Extensively worked with business and data analysts in requirements gathering and to translate business requirements into technical specifications.
- Study functional specs provided by business and create technical specs.
- Tuned the jobs for better performance.
- Used indexes, hints, partitioning at the database level as a part of tuning effort.
- Design and develop number of complex Pentaho jobs.
- Used shell scripts and Cron job to schedule the Pentaho jobs.
- Mentor, develop and train team members.
- Involved in Testing & debugging.
- Distributing and coordinating work among team members.
- Interacting with the project manager on various forums to discuss the status of the project, clarify any queries regarding the functionality, technicality and performance.
- Taking Knowledge sharing session.
- Worked extensively with production support team to improve performance.
- Wrote documentation to describe program development, logic, coding, testing, changes and corrections.
- Created document on best practices to be followed while coding.
- Create ETL transforms and jobs to move data from files to our operational database and from operational database to our data warehouse.
- Use SQL in a DB2 environment to write queries to extract data.
- Design and create staging tables for ETL tasks.
- Used file repository as well as database repository for Pentaho Kettle
- Use SVN for revision control of source files.
- Follow established processes to develop and deploy code in a team setting.
- Involved in requirements gathering, understanding the application and documented the same.
- Involved in the design of Health Plan Data Model (HPDM).
- Involved in writing test cases and used Mantis tool for bug fixing.
Environment: Pentaho 3.2.5 (PDI), Pentaho 4.2.0, DB2, PostgreSQL, TortoiseSVN 1.5, Windows XP, Linux, Data Studio 3.2, PuTTY, MS SharePoint, MantisBT
Confidential, Camp Hill, PA
ETL Developer
Responsibilities:
- Analyzed functional specs provided by business and created technical specs.
- Worked on implementation of Physical and Logical Data warehouse.
- Mapping business requirements to technical specifications and design logic of the code for implementing the same.
- Analysis, Coding of Informatica objects and UNIX scripts.
- Design and develop number of complex Informatica mappings, mapplets to implement the business logic.
- Worked on troubleshooting the Mappings to improve Performance by identifying bottlenecks.
- Reviewing Code of Team Members and defect fixing.
- Testing and Debugging.
- Created and ran sessions and workflows using Workflow Manager.
- Worked on Power Center tools like Designer, Workflow Manager, Workflow Monitor, Task Developer, and Repository Manager.
- Created Informatica mappings using various transformations like Filter, Normalizer, Router, Expression, Aggregator, Look Up, Source Qualifier, Joiner, Update Strategy, Rank, and Sorter.
- Worked on Slowly Changing Dimensions Mappings of type II
- Wrote SQL, PL/SQL, stored procedures for implementing business rules and transformations.
- To load the data from Staging area to DW.
- Preparing Task plan and Updating Weekly Status Report for discussing Project Status with Client and Onshore Managers
Environment: Informatica Power Center 8.5.1 (Source Analyzer, Warehouse Designer, Transformation Developer, Mapplet Designer, Mapping Designer, Workflow Manager, Workflow Monitor), Unix, Unix Shell Scripting, PL/SQL, Windows XP
Confidential, RTP, NC
Java Developer
Responsibilities:
- Developed web applications containing AJAX based rich UI components according to the Confidential look and feel standards
- Developed custom tag libraries for reusable user interface components
- Used Spring template library to generate web pages on fly from commonly used templates
- Used MAVEN for build, dependency management, testing, continuous integration projects
- Developed and implemented standards for Confidential applications, performed optimization for implementations
- To make the application templates scale well with WTP/WAS, developed RAD project wizards and catered using multi threaded RAD plug-in from a central repository
- Built SOAP web service interface implemented in Java using Apache Axis
- Developed and maintained implementations which use Struts MVC
- Upgraded Struts applications to Spring MVC
- Used apache tiles (formerly Struts Tiles) for page composition and layout
- Developed session beans using EJB 3.0
- Worked on development and optimization of PL/SQL stored procedures
Environment: J2SE, JSP, JSTL, Struts, Servlets, Spring 2.x, XML/XSLT, XSL, HTML 3.0, Javascript, Ajax, Oracle, Eclipse, RAD, WebLogic, SWT, Apache commons, Axis, Firebug
Confidential, Ruston-LA
Web Developer
Responsibilities:
- Developed and maintained web site for GK-12 program at Confidential .
- Built web applications required for the GK-12 program.
- Built interactive media applications for online learning system.
- Developed applications using HTML, CSS, DHTML, XML, JavaScript.
- Involved in presenting data to the user in an effective manner.
- Fulfilled many administrative roles required by the online learning system.
Environment: Windows XP, HTML, DHTML, Java Script, CSS, XML, Macromedia Dream Weaver, Flash, Adobe Photoshop 7.0, Apache Tomcat Server.
Confidential, Ruston-LA
Graduate Assistant
Responsibilities:
- Developed animations to simulate the sensor networks in real world for presentations
- Extending the projects done by the students to show the interpretation of the results graphically.
- Research on artificial intelligence projects like key stroke recognition and sensor networks.
- Fixing bugs related to the projects written in different programming languages.
- Worked on student projects written in JAVA, C++, C, and Visual Basic.
Environment: MSDOS, Windows XP, HTML, Visual Basic 6.0, JAVA 1.4, C, C++, JCreator, J2EE.
Software Engineer
Confidential
Responsibilities:
- Used WebSphere3.5, which has high performance and full-integrated Java platform for Enterprise Applications.
- Used Visual Age for Java IDE that gives Java Development Environment and supports the development and management of Java Applications.
- Converted well-designed HTML pages to JSP pages by adding dynamic content to it.
- Used XML file as a site map to call the respective JSP.
- Involved in creating EJBs that handle business logic and persistence of data.
- Java Transaction Services (JTS) to maintain data integrity and manage distributed transactions
- Used JETACE to generate deployment descriptor
- Java Naming/Directory Interface (JNDI) to support transparent access to distributed components.
- Used DB2 UDB 6.5 as a backend database.
Environment: Java-based three-tier architecture, WebSphere, HTML, JSP, Servlets, EJB, Java Script, JDBC, Visual Age, Windows 2000 operating environments, DB2.
