Senior Developer / Lead Technical Consultant Resume
Charlotte, NC
SUMMARY:
- Fuel cost savings and lead the expansion of enhanced capabilities through the adoption of proven development, testing, and data management tools, methods, practices, and controls.
- Deliver enabling capabilities through industry leading integration practices, leveraging hybrid cloud deployments, and DevOps methodologies.
- Lead elite global teams, infusing no - nonsense approach with active guidence & listening skills to drive aggressive pursuit of problem resolution.
- 13+ years of professional IT experience including 4 years in Big data ecosystem technologies.
- Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
- 1 year as master data management tehnical lead consultant.
- 4 years of hands-on experience in BigData tools Hadoop, Pig,Hive,Sqoop & HBase.
- 8 years of experience as Inforamtica ETL consultant .
- Experience in analyzing data using Hive QL and Pig Latin.
- Build applications leveraging different Big Data tools & Technologies - Apache Hadoop, Hive, Pig,Sqoop, Oozie.
- Worked with both NoSQL and SQL data bases.
- Experience in importing and exporting data using Sqoop from Relational Database Systems to HDFS.
- Extending Hive and Pig core functionality by writing customUDFs.
- Knowledge on Spark.
- Knowledge on writing Scala Scripts.
- Experience in large-scale, distributed systems, with ETL tools
- Experience in OLTP Modeling and OLAP Dimensional modeling (Star and Snow Flake) .
- Hands on experience on Anaplan forecasting tool.
- Certified Teradata Master.
- Worked with multiple relational databases such as Oracle 8i/9i/10g, SQL Server 2005, Teradata V2R5.
- Experience in UNIX/Python Shell Scripting.
- Knowledge on core Java.
- Strong skills in SQL, PL/SQL functions, stored procedures, and materialized views to implement business logic in oracle database.
- Experience with Database SQL tuning and query optimization.
- Extensively worked on developing Informatica Mappings, Mapplets, Sessions, Worklets and Workflows for data loads.
TALENTS & EXPERTISE:
- Software Development
- Architecture
- SDLC
- DevOps
- Data Management
- Data Integration
- Collaboration
- Enterprise Application Integration
- Cloud
- Test Data Management
- Process Improvement
PROFESSIONAL EXPERIENCE:
Confidential, Charlotte, NC
Senior Developer / Lead Technical Consultant
Responsibilities:
- Collected business requirements from LoB(LineofBusiness) and SMEs.
- Worked on loading data from SQL Server into HDFS (Bronze Layer) using Sqoop.
- Used Impla to load data from Bronze layer to Silver Layer .
- Reports are created using Tableau in Gold Layer.
- CResponsible for designing and managing Sqoop jobs and Impla jobs.
- Wrote Impla Queries to have a consolidated view of data for analysis and ad hoc querying.
Environment: SQL Server,HDFS, Impala, Oozie,Sqoop,Tableau.
Confidential, Salisbury, NC
SYSTEM ANALYST / Lead Technical Consultant
Responsibilities:
- Involved in business requirement JAD sessions.
- Prepared customer CDL Logical and Physical data models
- Created source to Confidential mapping document for etl developers.
- Provided clarifications to third paryt vendor Metasource to implement customer master data solution
- Designed and developed DB2 queries to parse PointofSales(PoS) data and helped to automate data validation process
- Helped in Ideintifing data issues in Tlog application
- Involved in data comparision between Tlog & Sales Re-engineering applications.
- Helped Big data team to validate data by using tools BigSheets and BigSQL
- Reviewed QA test scripts.
- Done POC on integrating IBM Cloud DataBase with Datastage tool.
Environment: Datastage 11.5, IBM DB2, Data Direct, BigData Tools.
Confidential
DATA ENGINEER
Responsibilities:
- Collected business requirements from the Business Partners and Subject Matter Experts.
- Worked on loading data from ERP sources into HDFS using Sqoop.
- Created various pig/hive scripts to ingest, extract and managing Data over HDFS.
- Responsible for designing and managing Sqoop jobs that uploaded the data from Oracle to HDFS.
- Wrote Hive Queries to have a consolidated view of the transactional data for analysis and ad hoc querying.
- Created partitioned tables in Hive for best performance and faster querying.
- Data was loaded into HBase for reporting and for the business users to analyze and visualize the data.
- Used python to embed data from file attachment to body of the email.
- Analyzed large amounts of data sets to determine the optimal way to aggregate and report on it.
- Participate in requirement gathering and analysis phase of the project and documenting the business requirements.
Environment: Oracle 11g,HDFS, Pig, Hive, Oozie,Sqoop,Informatica.
Senior Applications Developer / ETL Consultant
Confidential, Palo Alto, CA
Responsibilities:
- Worked in Informatica 9x/ 8x for the ETL from MS Sql server source to data warehouse.
- Created Technical Required document based on the FRD.
- Provide the estimated timelines for Integration work.
- Completed the development of informatica mappings, sessions and workflows.
- Worked with Trillium libraries for cleansing the address fields.
- Created Unix scripts that are required to process the data from source to Confidential which includes
- Sftp scripts, encrypting and decrypting scripts.Designed and developed the error handling mechanism by using the oracle stored proc and Unix scripts.
- Worked on EBS Concurrent Program Mananager for Inforamtica job scheduling.
- Providing support activities /Enhancements for ETM.
Environment: Informatica 9.1, MS Sql Server, Oracle 10g, Linux,, Anaplan.
Confidential, Sanjose, CA
ETL / Data Analyst
Responsibilities:
- Created CR’s extensively to fix data issues on TD (Long-term fixes/Short-term fixes).
- Used Data Flux tool extensively to compare data between Oracle and Teradata.
- Created SQL scripts for data validations on daily basis in Products Subject area.
- Collecting requirements for data quality checks to be done for data within various application and data across applications using Dataflux.
- To define data quality rules especially for those data elements where the data quality is not controlled by application itself due to various limitations in the applications.
- Worked with Informatica PowerCenter to create mappings for extracting data from various database sources which include oracle and Flat files.
- Worked on OBIEE for generating reports and dashboards for DQG (Data Quality & Governance) project.
- Migrated data from Oracle to Teradata by writing BTEQ, Fast Load and MultiLoad scripts.
- Wrote Teradata BTEQ, Fast Load, MultiLoad, TPump and Fast Export scripts to import / export data.
Environment: Informatica 8.6.1, Oracle 10g, Teradata V2R6,OBIEE,DataFlux.
Confidential, Pleasanton, CA
ETL Development Lead
Responsibilities:
- Contacting the Business Analysts/Users to develop, document and to evolve process and data models based upon their input and feedback.
- Experience in preparing Logical data models as well as Physical data models and document the same.
- Worked with DBA’s to design and build the Staging/ Confidential databases.
- Worked in Informatica 8.6 for the Extraction, Transformation and Loading from various sources to the enterprise data warehouse.
- Developed and tested extraction, transformation, and load (ETL) processes.
- Involved in change data capture ( Confidential ) ETL process.
- Created sessions and workflows for the source to staging data flow and staging to Confidential loading.
- Implemented Type II changes for different Dimensions.
- Developed functions and stored procedures to aid complex mappings.
Environment: Informatica 8.6, Teradata R12,Oracle 9i.
Confidential, Sunnyvale, CA
ETL Development Lead /Onsite Co-ordinator
Responsibilities:
- Worked in Informatica 7.1 for the Extraction, Transformation and Loading from various sources to the enterprise data warehouse.
- Interacting with the Business Analysts to get the project requirements.
- Responsibilities including Production support and enhancement.
- Involved in bulk extracts as well as change data capture ( Confidential ).
- Created sessions and workflows for the source to staging data flow and staging to Confidential loading.
- Design, Development and tested of the various Mappings and Mapplets involved in the ETL process
- Implemented Type II changes for different Dimensions.
Environment: Informatica 7.1, Oracle, Oracle Apps, Unix (AIX).
Confidential, Jersey Heights, NJ
ETL Development Lead /Onsite Co-ordinator
Responsibilities:
- Worked in Informatica 8.1 v for the ETL from MS Sql server source to the governance technology data warehouse.
- Created sessions and workflows for the source to staging data flow and staging to data warehousing.
- Design, Developing and testing of the various Mappings and Mapplets, worklets and workflows involved in the ETL process.
- Implemented Type II changes for Project and Organization Dimensions.
- Developed stored procedures to aid complex mappings.
- Involved in fixing invalid Mappings, testing of Stored Procedures, Unit and Integration Testing of Informatica Sessions and the Confidential Data.
- Created Unix scripts during quality analysis phase.
Environment: Informatica 8.1, MS Sql Server, Oracle 10g, UNIX, DB Artisan.
Confidential, Andover, MA
ETL Consultant
Responsibilities:
- Worked in Informatica 8.1 for the ETL from various sources to the central data warehouse.
- Design, Development and testing of the various mappings involved in the ETL process.
- Instead of using Normalizer Transformation,designed mapping for concatenating the mainframe fixed length flat files.
- Created customized transformations to handle miscellaneous characters.
- Created different mapplets, and worklets as per the business requirements.
- Implemented a common Error handling for all the workflows loading fact data.
- Implemented Type I and Type II slowly changing dimensions.
- Informatica components for daily and monthly incremental loading of around 50 tables were designed.
- Created Unix scripts for scheduling.
Environment: Informatica 8.1, Mainframe, Oracle 9i, UNIX (AIX), Toad.
Confidential, Sanjose, CA
ETL Consultant
Responsibilities:
- Validation of Informatica mappings for source compatibility due to version changes at the source level.
- Conversion of oracle procedures to informatica mappings
- Customization of mappings to accommodate new environment
- Performance Tuning of Informatica mappings
- Repository migration for Development, SIT & UAT environment
- Changed universe design to accommodate new business requirements
- Created new Deski reports and Webi reports as per user requirements
- Documentation of existing informatica mappings
- Created UAT environment for informatica by creating repository from the production repository.
- Took backup of repository from production and restored it into DEV and UAT.
Environment: Informatica Power Center 8.1, Oracle 10g, SQL * Plus, Business Objects xi.
Confidential
ETL Applications Developer
Responsibilities:
- Worked in Informatica 7.1 for the ETL from various sources to the central data warehouse.
- Created mappings, sessions, workflows for loading three fact tables and 6 dimension tables.
- Design, Development and testing of the various mappings involved in the ETL process.
- Extensively used Transformations like Router Transformation, Aggregator Transformation, Normalizer Transformation, Source Qualifier Transformation, Joiner Transformation, Expression and Sequence generator.
- Implemented a common restart strategy for all the workflows.
Environment: Informatica 7.1, DB2 v7, Oracle 9i, Unix (AIX).
