Sr. Etl Developer Resume
SUMMARY
- I am an IT professional with over 7+ years of hands - on development experience in data warehousing working within the Mortgage, Healthcare, financial industries having good experience in ETL tools and Data Virtualization tools.
- In-depth knowledge of Software Development Lifecycle(SDLC) including Requirements gathering, Analysis, Design, Implementation, and Maintenance.
- Experience in ETL tools such as Informatica Power Center, Informatica Power Exchange, Big data manager and SQL Server Integration Services(SSIS)
- Experience working with Data Virtualization tools(COMPOSITE).
- Solid understanding of Datawarehousing concepts such as logical,physical models,star schema, Snow flakes schema,fact and dimension tables.
- Hands-on experience with several SQL databases including Oracle, Netezza, SQL Server, Teradata,XML files, CSV files and flat files and NoSQL databases like MongoDB.
- Knowledge in Hadoop, Good knowledge of database structures, theories, principles, and practices.
- Hands on experience in HiveSQL, Analytical and problem solving skills, applied to Big Data domain.
- Proven understanding with Hadoop,Spark SQL, Hive, Pig, HBase and Kafka
- Designing Stored procedures involving complex JOINS,Conditional and CASE statements,Nested queries,Exception handling etc.,.
- Hands-on experience developing active script tasks using VB.NET
- Experience in identifying bottlenecks and Performance tunning techniques
- Knowledge in programming languages such as Python and Ruby.
- Experience in working on cloud Platforms such as Microsoft Azure, AWS
- Scheduling and Automating ETL jobs using Autosys.
- Experience working with SOAP(XML) and REST(JSON) web services
- Experience with Version control systems such as GIT and SVN
- Experience in CI/CD with tools such as Jenkins.
- Experience using Reporting tools such as SQL Server Reporting Services(SSRS), Tableau
- Performing ETL system Testing using the DTF(Data Testing Frameworks)
- Experience working with database client tools such as SSMS, Toad, Agnityworkbench, Teradata SQL Assistant.
- Experience working in Waterfall environment as well as Agile methodology.
- Passionate about learning new technologies, team player and a quick learner
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 10.1,SQL Server Integration Services(SSIS) 2008 R2 and 2012,2014,2016
Databases: Oracle11g/12C,MSSQLServer,Nettezza,Teradata,MongoDB, Cassandra
Database programming: PL/SQL and T-SQL
Version Control Systems: GIT, SVN,CVS,TFS
Data Visualization: SSRS, Tableau
Data Virtualization: Composite, Tibco Data Virtualization(TBV)
Programming languages: Python and Ruby,Java,Javascript,HTML,C#,VB.NET
Agile Environment tools: Jira, Rally, Kanbanize
Big Data Technologies: Hadoop,Oozie,Hive, Spark,Scoop,HBase,Kafka,Pentaho
Other tools: Autosys, Toad, SSMS, Agnity Work bench,Teradata SQL Assistant, SQL Loader
PROFESSIONAL EXPERIENCE
Confidential
Sr. ETL Developer
Responsibilities:
- Interacting with business users,TSBI to understand the requirements and design it using PowerDesigner.
- Designing SSIS packages to extract the data from the L1 Sources and making transformations based on the requirements and load to the L3 tables
- Creating control flow tasks such as Data flow task, Expression task Script task(C#) Execute Package task, File system task,Send mail task,Execute SQL Task, Sequence containers etc.,
- Experience working with Data flow tasks such as Conditional Split,Merge,Union all,derived column,Row count etc.,
- Working with various SSIS components like parameters, variables,connection managers,event handlers etc.,
- Designing stored procedures,functions and calling them using execute SQL task.
- Designing Views and generating files for the down streams to access the data.
- Using Team Foundation Server(TFS) for version control.
- Creating ESP jobs for the SSIS packages for Automation
- Auto- Deploying packages to SSIS Catalog by sending the Integration services project deployment files through Jenkins pipelines.
- Designing Workflows using Informatica Power center,Extracting the data from Netezza and making mapping transforamtions and loading data to SQL Server.
- Experience in designing transformations such as Router,Joiner,Update strategy, Aggregrator etc.,
- Using HSQL for data transformations and aggregrations.
- Migration of data from Netezza to Hadoop using Pentaho.
- Migration of sreaming platforems such as RabbitMQ to kafka
- Responsible for systems analysis - Design, Coding, Unit Testing and other SDLC activities
- Documenting the phases of design,development and KT documents on sharepoint.
- Working in Agile environment, Using JIRA and Confluence to log the work and trach the progress on regular basis.
Confidential, Virginia
Sr. ETL Developer
Responsibilities:
- Involved in meetings with SME’s to gather business requirements and to analyze source system data.
- Develop detailed technical specifications and mapping design documents in collaboration with data warehouse architect and SME’s.
- Designing SSIS packages for the migration of data from Netezza to MS SQL Sever and MS SQL Server to Azure.
- Working with Containers like For Loop, For each loop, Sequence containers and control flow tasks such as Data flow,Execute SQL, Bulk Insert, Script Task,Send Mail,XML,File system etc.,
- Working with several data flow tasks such as Aggregate,Conditional Split,Derived Column,Lookup,Merge,MergeJoin,Multicast,Rowcount,Sort,Slowly changing dimensions, Union All etc.,
- Creating Event handlers, Package Configurations, Mapping paramteres and Variables to make the Packages dynamic and deploying packages using SSIS Catalogs.
- Creating Triggers,Common Table expressions, Stored procedures,Indexes etc.,
- Involved in Performed tuning and optimization of packages and Stored procedures.
- Using Informatica Power center tools - Source Analyzer, Target Designer, Mapping Designer, Mapplet Designer, Workflow Manager, Workflow Monitor etc.,
- Developing Complex Informatica mappings using transformations such as Unconnected Lookup, Joiner, Rank, Source Qualifier, Sorter, Aggregator, Router, Sequence generator etc to extract, transform and load the data to the targets
- Knowledge on Incremental loading, Commit Intervals,Session properties, Look up caches etc.,
- Involved in performance tunning of mappings and fixing bottle necks for the processes and improving performance of sessions using Partitioning
- L2 Production support for Informatica Workflows and SSIS Packages.
- Developing shell scripts for Informatica Pre-Session, Post-Session Scripts.
- Generating BAT files, JIL files, Configuring and Scheduling jobs using Autosys.
- Automating workflows and SSIS package via Shell scripting and Python scripts.
- Building and Managing virtual views and data services by combining data from disparate systems and publishing them as database and web services(JSON/XML) using Tibco Data virtualization formerly Composite.
- Validating the TDV published views using REST API for Json and SOAPUI for XML,DB Visualizer for database.
- Designing multiple caching policies and Caching techniques in Composite studio.
- Generated various Monthly, Quarterly, Bi-Yearly, Yearly reports by different type of reports such as Drill through reports,click through reports,linked reports and sub reports using SSRS.
- Creating Parameterized reports, Generated context filters and data source filters while handling huge volume of data and Published Workbooks by using Tableau
- Working in Agile Environment, JIRA is used to track the progress.
Confidential
ETL Developer
Responsibilities:
- Interacted with business analysts to finalize the requirements and completed the technical design document for coding
- Managed the design, development and implementation of the MDM decommissioning project using Informatica Power Center, reducing development and implementation cost
- Successfully managed and implemented various ETL projects using Informatica Power Center that loaded data from DB2, flat files and other data sources to Oracle and other targets used for reporting
- Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Capture, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer, Row Generator stages
- Developed map, reusable objects, transformation, and Mapplets using Mapping Designer, Transformation Developer and Mapplet Designer
- Extracted data from Flat Files and Oracle databases and applied business logic to load them in the central Oracle database
- Used Informatica PowerCenter Workflow manager to create sessions and batches to run with logic embedded in the mappings
- Designed the job templates and created new jobs from existing templates
- Enhanced job performance by using partitioning methods and analyzing the resources utilized using Job Monitor
- Created test plans for unit testing of designed jobs the reports.
- Built an determinantion engine using Ruby on rails MVC framework
- Experience working with PHP on the server side to create the web pages.
Confidential, CA
ETL Developer
Responsibilities:
- Experience with high volume datasets from various sources like SQL Server, Oracle, DB2, Flat Files.
- Write complex SQL queries for validating the data against different kinds of reports.
- Performance tuning on sources, targets mappings and SQL (Optimization) tuning.
- Created mappings which involved Slowly Changing Dimensions Type 1 and Type 2 to implement business logic and capturing the deleted records in the source systems.
- Developed mappings using Mapping Designer and worked with Aggregator, Lookup (connected and unconnected), Filter, Router, Joiner, Source Qualifier, Expression, Stored Procedure, Sorter and Sequence Generator transformations, Java transformation using Informatica Power Center.
- Experienced in writing Unix Shell Scripts for different purposes such as scheduling jobs and moving the files from remote server to local informatica server.
- Effectively used Informatica parameter files for defining mapping variables, workflow variables, FTP connections and relational connections.
Confidential
ETL Developer
Responsibilities:
- Design mappings and perform Extraction, Transformation and Load of source data into data warehouse by using various transformations such as lookups, unions, aggregations, filter, router and source qualifier to meet the requirements.
- Communicated with business customers to discuss the issues and requirements.
- Created mappings which involved Slowly Changing Dimensions, implementation of Business Logic and capturing the deleted records in the source systems.
- Reviewed and analyzed functional requirements, mapping documents, problem solving and trouble shooting.
- Document data models in ERWIN and evaluate target tables for fact / dimensional structure.
- Troubleshoot data anomalies in data warehouse by finding source of data elements in an environment where mappings, sessions, stored procedure transformations, SQL overrides and changes in source or access to objects present a challenge for finding data lineage
