Lead Python And Teradata Developer/ Agile Program Manager/ Business Analysist Resume
Jersey City, NJ
SUMMARY:
- Over 14+ years of IT experience in building and leading high performing technology team for delivering projects to Financial, Banking and Pharmaceutical customers.
- Having strong experience in managing deliverables using Agile methodologies and a successful scrum master and leading and building technology teams around DataMart, Datawarehouse technologies using tools such as Informatica and Talend.
- Worked on AWS technologies like Redshift, S3, Mbox, EC2 Server, Athena.
- Having strong experience in working with business teams in requirement gathering and converting into quality data analyst ETL documents for ETL development team.
- Implemented industry best practices of performance tuning on ETL and Database objects.
- Having strong experience in managing deliverables using Agile methodologies and a successful scrum master.
- Played multiple roles like Agile Program Manager/Scrum Master, ETL Lead/Developer, Senior Data Analyst, Release Manager and Senior Business Analyst for AML, Global wealth and investment and management (Broker Dealer and US Trust) Trade Surveillance, Sales Surveillance, Regulatory, Risk & Compliance domains.
- Hands on experience in Extraction/Transformation/Loading (ETL) of data using Informatica Power Center 9.x and Talend 6.1. For ETL process used various file formats like .csv, .xlsx, .txt, JSON, XML flat files and various delimited formats using Talend.
- Involved in the creation of different types for ETL objects such as Mappings, Mapplets, Session task, command task, email task, workflows and designed them to load the data efficiently into target systems
- Strong experience with Agile development methodologies and worked on AWS, UNIX, and Windows environment.
- Worked on different databases like Oracle/Teradata/ Vertica/Redshift/ SQL Server/ Netezza
- Managed/processed different files in Mbox/S3 Lake to load the data to Redshift using COPY command and multiple files to Redshift with automatic compression.
- Worked with Database utilities like FLOAD, MLOAD, TPT streams, BTEQ scripts and NZLOAD.
- Expertise in scheduling, executing, and monitoring the workflows using BMC Control - m, Informatica Scheduler, TAC, Autosys and Tidal.
- Involved in the creation of large Multi-terabyte data staging warehouses and business-related Data Marts.
- Excellent communication (verbal and written) and inter-personal skills accustomed to work in a team environment.
TECHNICAL SKILLS:
DW Tools: Informatica 9.6.1/9.5.1/9.1/8. x/7x. Talend 6.1
DB: Redshift, Oracle 11g/10g/9i, DB2, SQL Server 2008, Teradata 14.10/13.11 , Netezza, and Vertica
NICE: Actimize (AIS) 4.22, RCMD/RCM 5.11
AWS: S3, MBOX, EC2 Server, Athena
BI: Tableau 2020.3, Business Objects 6.0/ 5.1, Crystal Reports
OS: Win - XP, Sun Solaris UNIX, SUSI Linux.
Automation tool: Control-m 8.0, Autosys, Tidal 6.2, Informatica Scheduler, TAC
Testing Tool: HP Quality Center, Change Management, BMC Remedy, HP Application Life Management
Other Tool: Java, python, SVN, PVCS, Bitbucket, SharePoint, WinSCP, JIRA, SDM, XML, XSL, Datanomics, IDQ
PROFESSIONAL EXPERIENCE:
Lead Python and Teradata developer/ Agile program manager/ Business Analysist
Confidential, Jersey City, NJ
Responsibilities:
- Import all OMR template like model details, change type, threshold, metric, RAI, Overrides/Overlays and model owner assessment summary to Teradata by using python.
- Created various visualization of dashboard for performance, drift, LOB, Model status, drilldown of OMR model and Attestation, Roles, performance and Drift.
- Retrieving datasets from multiple sources across the firm, enriching a dataset by linking it to data in another dataset, filtering rows, identify the data dependencies, data lineage by using NFRR GRS DSL Data Visualization
- Created FLoad/MLoad/bteq script to import/export data to target tables.
- Creating the stories based on the requirements and working with developers to assign the stories and story points, In scrum of scrum meeting to identify the priority and interdepend tasks of other teams stories, and sprint planning based on the priority will takes the stories for upcoming sprint.
Environment: Python, Teradata, tableau 20202.3, Informatica 9.6.1/Talend, Oracle 11g, Autosys, JIRA/Horizon, SharePoint, Unix, WinSCP, HDFS/Hadoop, Oracle Data, Bitbucket and Java.
Actimize Lead /RCMD Developer
Confidential, Jersey City, NJ
Responsibilities:
- Enhanced Actimize model by using AIS - Connectors, Channels, Expression Builder, Flows, Active tables, Formatting-Templates, Utilities, and Execution Plan, RCMD - Created Alerts Views, Thresholds, Lists, User and Roles -Permissions setup.
- Created different format of XSL like view alerts, pdf version of alerts, print version of alerts-based user request in RCM. Adding new RFI notes, updating workflow of alert staging and adding/removing user/group access by using roles in RCMD
- Involved in SDM automation process to promote the code from lower environment to higher environment by using Bitbucket. Managed/Involved cross functional business processes like CRQ creation and support ITSM to deploy the code to higher environment (PROD - migration).
- Created complex queries from xml data to get alert information, threshold, threshold history, metrics for each alert and automated the process called parameter tuning automation.
Environment: Actimize (AIS) 4.22, RCMD/RCM 5.1/5.11, Hadoop, MIDAS(DB2), Oracle 11g, Autosys, JIRA/Horizon, Share-point, Unix, WinSCP, Visio 2010, Oracle Data Point, Hue (Hive), J2EE, XML, XSL, Bitbucket
ETL Lead
Confidential, Piscataway, NJ
Responsibilities:
- Worked closely with Functional team to identified the records which are eligible for purge based on FR, copied to CARSIS PURGE schema such has sales/transaction data, Government contracts without transaction and end data <1/1/2018 records for purge, Customer, Product, Pricing, Codes and IDs
- Developed procedure for drop/create Index, STATS gather schema level and BULL COLLECT before and after insert/update the tables for better performance.
- Created Informatica mappings to which is required for new MODEL N system, Extracted the data from different source system and loading to staging, integration and semantic (presentation layer) databases.
- Design and developed Migration Reconciliation Report - compared contracts, transaction/sales, customer, product, pricing related tables in aggregate-overall level and aggregate-column level and detail/line level between CARS RECON schema and RM MRB (MODEL N) schema.
Environment: Talend 6.1/6.2, Oracle 11g, Redshift, AWS, S3, MBOX, Tidal, JIRA, Share-point, Linux, WinSCP, Visio 2010, Oracle SQL Developer or Toad for Oracle, EC2 Server
Application Architect/ ETL Lead
Confidential, Somerville, NJ
Responsibilities:
- Created the folder in MBOX and S3 for all environments (DEV/QA/PROD), setup the auto synchronizes between MBOX to S3, to get the data from Source SYNYGY files to S3 to load to Redshift. Loading data to Redshift by using copy command from S3 location with multiple files.
- Developed Talend code using Joblet, parallel processing, context variables and bulk components to load the data on S3 to Redshift. Split the data into multiple files and compress the files on S3 Lake and loaded to RS using bulk load/parallel concept.
- Involved in performance tuning on Talend ETL code by filter and remove columns early, use bulk components where it’s possible, aggregate early, minimize sorting, join on the largest flow, maintain code backups and job version control.
- Published Talend code in Nexus, worked with Talend Admin team to move code to higher environment and creating job conductor to monitor the jobs in TAC by raising iris request.
Environment: Informatica 9.5.1, Talend 6.1/6.2, Redshift (SQL/Aginity SQL Workbench), Athena, AWS, S3, MBOX, Tidal, TAC (Talend Admin Console), Nexus, Share-point, Linux, WinSCP, Oracle (Toad), EC2 Server
Senior ETL developer /Business Analyst
Confidential, New Port, NJ
Responsibilities:
- Prepared Business Analysis documents based on the impacted database objects (schema/table/fields).
- Involved with UNIX team and different source vendor team in setting up the SFTP connection from DEV, QA, UAT and PROD environment.
- Identified the impacted LOANMGR schema, tables and field to map the corresponding database elements in MC156MGR schema from MSP.
- Promoting and Validating UAT results with business users and getting signoff and promoting code to PROD environment by working with all cross functional teams like testing team, Data Architect, DBA, data modeling, data profiling and production team.
Environment: Informatica 9.x, Talend 6.1/6.2, SSIS 2008/2012, Oracle, SQL Server, Teradata 14.10/13.11 , BMC Control-m 8.0 Automation Tool, UNIX, IDQ, ALM, SVN, Share-point, FileZilla, MS-Excel and Windows
ETL Developer/ Lead
Confidential, New Port, NJ
Responsibilities:
- Prepared ETL data mapping documents, worked with data profiling team in creating IDQ profiling for different type of data profiling like column profiling, primary key profiling to validate the data from source.
- Developed ETL mapping with informatica objects, Interacted with Data modeling team for designing the physical and logical data model which will be used to start the ETL development.
- Worked with Data Masking team to get the masked files to lower (Dev and QA) environment from higher environment for the ETL development and unit testing.
- Designed and Developed in automating daily, weekly, bi-weekly, monthly jobs using control-M, implemented complex scheduled jobs for dependent job scheduled of business requirements.
Environment: Informatica 9.6.1/9.5.1/9.1.0 , Teradata 14.10/13.11 , BMC Control-m 8.0 Automation Tool, UNIX, IDQ, ALM, BRISK, SVN, Share-point, WinSCP, MS-Excel and Windows XP
Sr. Informatica Consultant
Confidential, New York City
Responsibilities:
- Directly working with different source system and involved in setting up FTP connection with different source system to get data from Oracle and SQL Server, flat files (Pipe delimited, comma separated) to staging database and target system and built Data Warehouse and Data Mart.
- Design and develop Informatica mapping, mapplets and Involved in Performance tuning the long running ETL mappings. Involved in the creating of Oracle Stored procedures, for weekly/monthly maintenance of the database partitions, enabling and disabling of index on high volume tables and calling the stored procedures through Informatica workflows
- Developed UNIX Shell scripts to automate the process of running jobs/batches, schedule workflows, file manipulation and FTP.
Environment: Informatica 9.1, SQL Server, Tidal Automation Tool, UNIX, Oracle 11g, PL/SQL, MS-Excel and Windows
Lead Informatica Developer
Confidential, Jersey City, NJ
Responsibilities:
- Migration of ETL objects from DEV to QA and Performed Positive and Negative testing based on Business requirement.
- Used mapping and parameter variables in the ETL mappings and Invoked parameter files through Informatica for setting up dynamic values to run the mapping through automation tool.
- Identifying the data issues and communicating the source team for fixing the source data.
- Importing of database definition, creating source definition for flat file sources and creating source and target shortcuts for mapping development.
Environment: Informatica 8.x/9x SCO-Unix/AIX, Oracle, Netezza, Tidal Automation Tool, MS-Excel, and Windows XP.
