Technical Specialist Resume
SUMMARY:
- An accomplished ETL Lead developer with over 7 years of experience on medium to large - scale global projects as a Lead/Sr. Datastage Developer in the Consulting Domain and Banking.
- Extensive experience in design, requirement gathering, development, issue resolution, team management and full project life cycle.
- Well acquainted with various tools such as IBM Datastage, Informatica; proficient at various methodologies such as Agile, Waterfall and iterative methods; experience in Project Management tools such as Rational, Mingle.
- 6+ years of experience working on Agile Methodology.
- Designed Parallel jobs using various stages like Join, Merge, Lookup, Remove Duplicates, Filter, Dataset, and Lookup file set, Modify, Aggregator and Transformer.
- Developed Server jobs using various types of stages like Sequential file, ODBC, Hashed File, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
- Experience in loading data from Flat files, XML files, Oracle, DB2, SQL Server, Postgres, Salesforce, Teradata, Webservices into Data Warehouse/Data Marts using Datastage.
- Strong in writing UNIX shell scripts for Data validations, Data cleansing etc.
- Streamlined development/deployment process by building DEV/UAT environment, coming up with standard for deployment plans.
- Strong database skills with Oracle, and SQL Server, Teradata. Have knowledge of Teradata Utilities TPUMP, MLoad, FastLoad, and Bteq.
- Worked on “Infosphere IGC (Information Governance Catalog), IA (Investment Analyzer), IMAM ( Metadata Asset Manager)”.
- Experience in Data Profiling, Standardization, matching and survivorship using Quality Stage. Worked with Information Analyzer for Column Analysis, Primary Key Analysis and Foreign Key Analysis.
- Expertise in using Oracle 9i/10g/11g/12c enterprise edition
- Proficient in related tools like Toad, PL/SQL Developer
- Proficient in query optimization and troubleshooting
- Strong Data modeling skills including Star Schema and Snow-Flake models and E-R modelling and Expertise in Kimball methodology.
- Created Autosys and Cron Jobs to schedule and run the jobs in Datastage.
- Proven track record in troubleshooting of Datastage jobs and addressing production issues like performance tuning and enhancement. Experience in Parallel Extender (DS-PX) developing Parallel jobs using various stages. Well versed with version management systems like SVN and Github.
- Experience in Installation, sizing & configuration of Hadoop ecosystem.
- Experience in managing the end-to-end project life cycle including requirement gathering, system modelling/designing, iterative development, testing and QA, release and production support.
TECHNICAL SKILLS:
Operating Systems: Windows and UNIX
Languages & Scripting: PL/SQL, Shell Script, XML, Core Java and HTML
Database: Oracle 11g, MS SQL, Postgres, Salesforce, Teradata
Applications: Datastage 11.5/9.1/8.0/7.0 Parallel/Server, QualityStage 11.5, Informatica, Autosys, Teradata Utilities, and Cognos.
Packages: MS Office - Excel, Word, PowerPoint
Tools: TOAD, Oracle SQL Developer, Putty, SVN, Github
Data Modelling: Erwin
Version Management: SVN, Github
WORK EXPERIENCE:
Confidential
Technical Specialist
Responsibilities:
- Perform initial analysis of existing datastage setup.
- Give recommendations to set up the new server (Cores and PVUs) as we move from AIX to Linux system on VM.
- Fixing data quality issues in the source feeds.
- Design changes and fixing issues in existing code.
- Migrate DS Jobs, Routines, Parameter Sets, Shared Containers, scripts to new environment.
- Replace deprecated stages in v11.5
- Identification of jobs to be modified by running them through connector migration tool.
- Perform Unit testing, SIT and UAT
- Setup and code baselining on SVN.
Confidential
Lead Datastage Developer
Responsibilities:
- Designed and developed the entire IDF (Inbound Data Flow) and ODF (Outbound Data Flow) to/from the cloud system.
- Involvement in all the software development phases of this project - beginning from conception to the project deployment.
- Development and design of a new system from the core.
- Worked with DataStage designer for importing metadata and DataStage Components.
- Implemented complex logics in transformer stage like date validation, use of stage variables.
- Used Change Capture Stage for incorporating the incremental logic.
- Unit testing and Integration testing of the individual and extract-transform-load jobs in sequence respectively.
- Incorporated fSQL Logic to use Process Control Table for incremental data load.
- Exported and imported the Data stage jobs between the production and the development servers
- Wrote UNIX shell scripts for file SCP to Go Anywhere Server (Keyless), archiving the files after successful transfer after appending a timestamp, Mailing and archiving the reject file.
- Shell Script to get the photos of all Firm Employees and sent that via sFTP to CSOD.
- Created jobs to connect to Webservices and load that to the database.
- Work with the architect team to come up with the most efficient design.
- Develop methodology to change such that the existing data can be transferred to the new system without any hassle.
- Worked on “Infosphere IGC (Information Governance Catalog), IA (Investment Analyzer ), IMAM ( Metadata Asset Manager)”.
- Experience in Data profiling, standardization, matching and survivorship using Quality Stage.
- Worked with Information Analyzer for Column Analysis, Primary Key Analysis and Foreign Key Analysis.
- Used Dimensional Modeling Techniques to create Dimensions and Fact tables using Erwin.
- Used Dimensional Modelling Techniques to create Dimensions and Fact tables using Erwin.
- Development and modification of existing Datastage ORS/ MSTG jobs.
- Writing and editing PL/SQL Procedures, triggers etc.
Confidential
Microsoft SQL Developer
Responsibilities:
- Implemented data extraction and report logic in Microsoft SQL server using stored procedures and views.
- Wrote complex queries in Microsoft SQL server using analytical functions.
- Graphical Reports and pivot tables generated in excel using the data extracted from MS SQL Server.
- Perform quality checks on reports and exports to ensure exceptional quality.
- Collaborate with Team members to maintain documentation.
Confidential
Programmer Analyst/ETL Consultant
Responsibilities:
- Worked with the Business analysts and the DBA for requirements gathering, business analysis, testing, and project coordination.
- Used several stages like Sequential file, Hash file, Aggregator, Funnel, Change Capture, Change Apply, Row Generator (debugging stage), Peek, Remove Duplicates, Copy, Lookup and RDBMS during the development process of the DataStage jobs.
- Developed DataStage parallel jobs to load data from sequential files, flat files and MS SQL Server.
- Created several complex queries in SQL.
- Testing of Datastage jobs.
- Creation on multiple database objects.
- Data quality analysis to determine cleansing requirements.
- Used Dimensional Modelling Techniques to create Dimensions and Fact tables using Erwin.
- Modelling the data using Erwin to provide a simple, visual interface to manage complexity of data.
Confidential
Sr. Datastage/ ETL Consultant
Responsibilities:
- Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and load data into target tables.
- Extracted data from various sources performed Data transformations and loaded into the target Oracle database.
- Had to build the compensation system for Zurich for the pilot run and eventually it would roll out to different countries.
- Worked directly with the compensation team of Zurich and gave the overall architecture of new compensation system.
- Involved in design phase of logical and physical data model using Erwin.
Confidential
Datastage Developer
Responsibilities:
- Worked extensively with Flat files with Various Data Files coming from Various Sources.
- Worked with stages like Transformer, Aggregator, Sort etc.
- Used Datastage Designer to create complex mappings
- Involved in design phase of logical and physical data model using Erwin 4.0
- Involved in designing Star Schema for the business processes.
- Develop UNIX Shell scripts and schedule the jobs.
- Wrote Jil scripts to automate Datastage jobs on daily basis
- Development new Datastage jobs to consume MobileIron data stored in a Postgres Database and send that across to salesforce system.
- Database queries on Postgres system.
- Worked on data profiling for null values and duplicate values
- Gathered Requirements
- Written technical design document and mapping sheets
- Populated the tables with test data in order to test jobs.
Confidential
Datastage Developer
Responsibilities:
- Involved in reviewing Business/System requirements and other deliverables.
- Developed in ETL jobs using Datastage, supporting all ETL process such as implementing Source to target mapping.
- Involved in System testing strategies preparation. Designed Test Cases
- Expertise in resolving performance tuning issues. Expertise in UAT, IT test cases, UAT Results.
- Used Autosys tool for scheduling ETL Jobs
- Worked extensively on different types of stages like Aggregator, Merge Join, Lookup, Remove Duplicates, Transformer, Copy, Filter, Modify, Sorter, Investigate, Standardize, match frequency, Survive.
- Created stages to look up the data from the source and target tables. Developed various shared containers, stages and validated and fine-tuned the ETL logic coded into jobs.
- Responsible for validating the Datastage jobs, sequences against the pre-defined ETL design standards.
- Tuned Source, Targets, jobs, stages and Sequences for better performance. Developed SQL Procedures for synchronizing data
- Extensively used IBM Web sphere Datastage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the Data warehouse database
- Created user defined transforms and routines for handling special cases
- Extracted data from various sources, Transformed according to the requirement and Loaded into Data warehouse schema using various stages like sequential file, Aggregator, Transformer stage.
Confidential
DataStage Developer/Production Support
Responsibilities:
- Responsible for understanding user requirements and validating them.
- Involved in various activities related to Development of application.
- Understanding functionality of all the existing BI applications.
- Analyze and solve problems for user’s issues and concerns regarding reports/data.
- Analyze for new project requirements/enhancements.
- Direct communication with end users to understand the requests/issues and provide resolutions/suggestions.
- Performance improvement of several jobs using Hash Files, IPC Connector Stage.
- Analyze complex PL/SQL queries and database objects.
- Internal Process compliance.
Confidential
BI Lead
Responsibilities:
- Responsible for understanding user requirements and validating them.
- Understanding functionality of all the existing BI applications.
- To analyze and solve problems for user’s issues and concerns regarding reports/data.
- Implementation of small enhancements
- Worked on Teradata connectors and Teradata utilities (MLoad and fastLoad, Bteq, FASTLOAD)
- Direct communication with end users to understand the requests/issues and provide resolutions/suggestions.
- Internal reviews and code walkthroughs.
- Worked on business needs and implement the same into a functional database design.
- Extensively used almost all of the stages and transforms of DataStage for various types of data conversions.
- Worked with Informatica tool in developing jobs and perform transformations to extract and load the data from flat files and Oracle to Oracle.
- Worked on programs for scheduling data loading and transformations using DataStage from legacy system to DB2.
- Fine-tuned the Informatica Mappings and Session to get better performance.
- Identify business rules for data migration and perform data administration through data models and metadata.
- Created multiple shell scripts for cleaning and loading data and scheduling DS job process.
- Define process to create source package and deployment to different server (pretest, test, and production)
- Support administrators with DataStage application for production.
- Involved in writing Test Cases and Test Scripts and performed the Unit, Integration, System testing and User Acceptance Testing.
- Expertise in monitoring and performance tuning using DataStage.
- Experience in working with Ralph Kimball’s methodologies in Dimensional modeling to work with Star schema and Snowflake schema.
- Created user groups and roles in UNIX for Datastage projects.
- Strictly followed the change control methodologies while deploying the code from DEV, QA and Production.
- Used several stages in Sequencer like Abort Job, Wait for Job, Nested Condition and Mail Notification stages to build an overall main Sequencer and to accomplish Re-startability. Making Guidelines in terms of SLA’s to track the team’s progress.
- Internal Process compliance.
Confidential
Software Engineer/ Datastage Developer
Responsibilities:
- Responsible for understanding user requirements and validating them.
- Used ETL to extract and load data from Oracle, and Flat files to Oracle.
- Involved in writing lot of Functions, Stored Procedures.
- Created various transformations
- Developed mapping to load data in slowly changing dimensions.
- Creating Relational Connections, Migrating the Mappings from Dev to Test and Test to Production
- Worked on Sequential files, Hash files, Transformer, in designing the ETL jobs.
Confidential
Datastage Prod Support
Responsibilities:
- Worked on high and low level design for enhancements, application development & Business Change requests.
- Wrote the handbooks and provided Client training.
- Provided Production Support& Code Fixes for problems reported by Business Users in the Production Environment.
- Did User Acceptance Testing, follow-up tests, production follow-up and price estimation.
- Wrote Complex SQL Queries to retrieve the data from the source databases.
- The mappings were Unit tested to check for the expected results.
- Documented the purpose of mapping so as to facilitate the personnel to understand the process and incorporate the changes as and when necessary.
