Bd & Etl Technical Lead Resume
4.00/5 (Submit Your Rating)
Phoenix, AZ
SUMMARY
- Over 12 years of professional experience
- Managed various EDW BI and Big Data projects which had end to end rollouts; varying from requirements phase, designing, developing, code reviewing, testing, and migration and Business user education for all ERP systems implemented
- Successfully managed complex projects globally with rapidly evolving requirements
- Thorough Understanding of Software Development Life Cycle (SDLC), involved in various phases like Requirements, Analysis/Design, Development and Testing
- Excellent understanding of Star Schema/Snow flake Schema, Dimensional Modeling with ETL
- Worked Extensively on OBIEE, Oracle BI Administration Tool, Presentation Services, Answers, & Interactive Dashboards and Security Implementation with Informatica and Talend
- Expertise in implementing the Oracle BI Security Setup (groups, data access/query privileges), Metadata Objects and Web Catalog Objects (Dashboard, Pages, Folders, Reports)
- Expertise in Universe designing, developing and generating complex, Ad - hoc, dashboard Reports, Business views, List of values
- Experience dealing with Big Data Apache Hadoop components HDFS, MapR, HiveQL, Hbase
- Automating Big Data Hadoop job to eliminate manual intervention and use Splunk dashboards
- Have experience in creating visualizations using Tableau Desktop
- Knowledge in SQL Stored Procedures, User Defined Functions, Cursors, Dynamic SQL Statements and write ad-hoc SQL queries to answer business questions
- Worked with Dimensional Data warehouses in Star Schemaand experience in working with Slowly changing dimensions using Type1, Type 2
- Experience with various data sources Teradata, Oracle, DB2, Flat files, etc.
- Experience in Performance tuning ofInformaticamappings and Datastage jobs
- Knowledge on Teradata utilities like BTEQ, Fast Load, MultiLoad, Fast Export, Tpump and Teradata SQL assistant
- Establishes relationships with business sponsors across multiple lines of businesses
- Demonstrates the ability to manage multiple concurrent high visibility customer facing technology projects with broad scope and high availability objectives
- Develops project charters, business cases, schedules and communication plans
- Responsible for prioritizing, alignment of projects with an organization's strategy
- Manages teams’ workload and delivery of high-quality deliverables on a timely (and cost-effective) basis. Mitigate risks and address program/project obstacles as needed
- Excellent people management and stakeholder management skills recruiting/Building, mentoring/enabling team
- Innovates and drives continuous improvements to operational processes
TECHNICAL SKILLS
- Informatica 9x
- Datastage 8x
- DAC
- Talend
- OBIEE 11g/10g
- OBIA 7.9.6.3
- COGNOS 10
- ORACLE
- TERADATA
- SQL SERVER
- TOAD
- SQL DEVELOPER
- MYSQL
- UNICA
- HIVE
- SPLUNK
- UNIX
- OOZIE
- VISIO
- SERVICE NOW
- JIRA
- REMEDY
- HPQC
- CONFLUENCE
- SHARE POINT
PROFESSIONAL EXPERIENCE
Confidential, Phoenix, AZ
BD & ETL Technical Lead
Responsibilities:
- Processed data into Big Data Hadoop HDFS by developing solutions, analyzed the data using MapReduce, Pig, Hive and produce summary results from Hadoop to downstream systems
- Manage and review the Hadoop log files for any cluster issues
- Responsible to manage data coming from different sources, involved in loading data from UNIX file system to HDFS
- Supported Big Data Map Reduce Programs those are running on the cluster
- Implement the restartability process from where it failure by using Talend
- Having daily interaction with the customer and offshore team to implement the requirements using Talend ETL.
- Automate the metadata driving mechanism thorough Talend ETL
- Ingesting data using parsers running on python scripts
- Write shell scripts and HIVE to generate failure alerts notification to email
- Analyze the failures and debugging in the edge node servers
- Schedule Big Data Hadoop jobs using Oozie, Spring Batch
- Provide optimal solution to reduce the job runtime
- Production support for all the use cases running in MapR 24/7
- Fixing code issues and implementing change using RFC process
- Raise incidents to Infrastructure team for any environmental issues
- Check and Validate errors using server logs of oozie jobs
- Maintain daily issue tracker for capturing every issue
- Sync with Dev teams to make sure any code changes are published to Production
- Reach out to source teams for any data mismatch issues
- Involved in HDFS maintenance and loading of structured and unstructured data
- Involved in managing and reviewing Hadoop log files
- Imported data to load data from MySQL to HDFS on regular basis
- Written Hive queries for data analysis to meet the business requirements
- Creating Hive tables and working on them using Hive QL
- Work on code repositories using GIT
- Collaborate with product owners and stake holders for new Big Data enhancements
- Peer review to all changes made to existing code
- Utilized Agile Scrum Methodology to help manage ticketing system
- Developed parallel jobs using various Development/debug stages (Peek stage, Row generator stage, Column generator stage, Sample Stage) and processing stages (Transformer, Join, Lookup, Aggregator, Change Capture, Change Apply, Filter, Sort & Merge, Funnel, Remove Duplicate Stage and surrogate key files)
- Create most sophisticated job sequences to load from files/external tables into Netezza
- Thoroughly unit testing of the job to ensure any data issues are being encountered
- Peer review of the code done by team members
- Work with product owners to make sure the developed code is as expected
- Raise RFC to migrate the UAT code to production
- Validate the changes post production to ensure the data required is as per requirements
- Develop Ad-hoc jobs to load historical data from different file systems
Confidential, Torrance, CA
BI Technical Lead
Responsibilities:
- Interact with the Business users and work to gather the requirements
- Manage, and appropriately escalate, delivery impediments, risks, issues, and changes impacting development
- Owner for all HPQC activities
- Provides and ensures proper communication between all parties involved in the project; interacts with users to identify project requirements and resolve problems
- Prepare project layout and provide technical guidance to the development team
- Works closely with all IT roles including governance, architecture, development, infrastructure and IT security teams in managing appropriate project activities
- Construct reports & KPIs using OBIEE dashboards for Confidential, Lexus and Scion team
- Proactively identify dashboard production issues and provide troubleshooting methods
- Implement best practices of OBIEE standards to meet project and company objectives
- Works with business partners to develop technological concepts, requirements, design alternatives, project schedules, and cost analysis for new system initiatives Plans, establishes, and directs complex program schedules and budgets, monitoring project status in comparison to cost/time projections
- Used JIRA for reports enhancements and tracking details
- Tracks project forecasted dates to actual delivery dates, documenting reasons for variance and impact to schedules and other projects in pipeline Maintains project budget and resource utilization against forecast and actuals
- Involve in ETL applications, data feeding, cleansing, archiving and re-modeling
- Work with administrators, users and analysts to maintain exchange of reporting requirements
- Enhanced performance of Reports / Dashboards by implementing the Aggregate tables, Materialized Views, Table partitions, indices and managing Cache
- Train the administration team on new OBIEE, BI and ETL tools
- Establishes and manages project schedules; taking into consideration deadlines, dependencies, resources, and costs
- Communicates with program/project managers and solution managers to ensure projects adhere to all phases of software development life-cycle management
- Peer review of OBIEE and ETL code before migration periodically and optimize reports
- Provide estimations for each report requirement by distinguishing the complexity
- Broaden my thoughts by involving in discussions with business teams on building tactical approach for meeting business needs
Confidential, Woodland Hills, CA
BI Technical Lead
Responsibilities:
- Lead Healthcare Business Intelligence (BI) projects involving assessing and defining a BI strategy, roadmap, and implementation plan
- Design and implement data governance framework to include defining policies around data ownership, integrity and structure
- Drive the process to deliver effective business intelligence solutions by working closely with product owners, architects, engineers, and quality assurance
- Work with the entire Business Intelligence Infrastructure team and stakeholders to prioritize, plan, and execute on the project roadmap for the analytics platform
- Manage contracts, licensing and vendor relationships to ensure the organization receives the greatest value from its software investments
- Responds to service problems/incidents and ensures their resolution, by actively coordinating with team members, service support groups and vendors
- Building reports using OBIEE 10g with SSO integration to SIEBEL
- Enhancements of Informatica mappings as per requirements, Implementing data and object level securities
- Developed estimation tracker to manage FTEs(Full time employee) based on the business needs and project plan
- Design the process of external FTP files to Datawarehouse using ETL
- Worked with the Business analysts and the DBA for requirements gathering, business analysis, and testing and project coordination
- Has studied the Current business processes, future business flow & identification of gaps/Workaround in order to provide an integrated information system solution to meet the business needs of the company
- Implemented Business Continuity Plans
- Executing mappings using the DAC and monitored the same
- Used UNIX for accessing different environment paths and files transfers
- Developing mappings and workflows for new business releases from SIEBEL to TERADATA
- Creating level of effort for all the defects and change requests created
- Mentoring and coaching junior resources
Confidential, Atlanta, GA
Project Lead/BI Consultant
Responsibilities:
- Development Lead for Hypercare Development team of credit risk application
- Drive consensus and decision-making with business and executive management
- Mentored and helped other employees in understanding the functional requirements to develop the code
- Manage, and appropriately escalate, delivery impediments, risks, issues, and changes impacting development
- Facilitates the design and drives the planning for the integration of all data warehouse components, with scalability, performance, and availability in mind
- Owner of HPQC and maintain progress of tickets on daily basis
- Applies broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse life cycle phases to design an integrated, quality solution to address the business requirements
- Involved in assisting building detailed project management schedule, gathering the requirement, completed the proof of concept in translating functional requirements into technical requirements, designed, developedmaking Technical designs and Unit test scripts.
- Engage in front end proposals, provide estimations for each report requirement by distinguishing the complexity
- Has implemented selective refresh of dimensions and fact using ETL
- Improving processes to optimize performance and value over time
- Working closely with Users, Developers, Administrators and Testers to resolve ongoing Production Problems by reviewing design changes made to production systems and made corresponding changes to Repository.
- Validated technical design created by developers against functional specifications.
- Work with technical teams to build dimensional models
- Continue to build an effective development organization by driving the recruiting and hiring of data engineers, developing and managing the group, and conducting performance reviews of team members.
- Coaches/mentors team members to yield maximum value to the business
Confidential, Bentonville
BI Consultant
Responsibilities:
- Developed business process model of transportation module.
- Helped in building Business model and established relationships & Foreign Keys (Physical & Logical) between tables.
- Design and implement data governance framework to include defining policies around data ownership, integrity and structure
- Drive the process to deliver effective business intelligence solutions by working closely with product owners, architects, engineers, and quality assurance team.
- Followed agile methodology for project implementation.
- Worked with the Business analysts and the DBA for requirements gathering, business analysis, and testing and project coordination.
- Implemented Industry ETL standards and best practices, performance tuning during designing the DatastageJobs.
- Creating level of effort for all the defects and change requests created
- Implemented Business Continuity Plans.
- Responds to service problems/incidents and ensures their resolution, by actively coordinating with team members, service support groups and vendors.
- Was responsible for developing the technical design specifications from the Business functional standpoint of view.
- Developed Parallel jobs using Parallel stages like Dataset, Sequential file, Funnel, Filter, Modify, Merge, Join, Lookup, Transformer and External Source Stage.
- Extensively used processing stages like the Lookup stage to perform lookup operations based on the various target tables and change capture for implementing SCD Type -I and Type - II dimensions.
- Peer review of the code developed by team members.
- Migrating the code from one environment to other and versioning the code using SVN
- Mentor new and junior resources in developing their skills towards technical approaches.
- Automate all the new ETL jobs usingAIX UNIXshell scripts and add data validation checks including business rules and referential integrity checks.
- Involved in Unit testing and SIT and used QC for defects tracking.
Confidential
Lead Developer
Responsibilities:
- Prepared Estimations for FTEs based on the business requirements and plans.
- Scheduling the mappings as per the work flow and running the dimensions, facts to load data daily. Troubleshoot when there is any performance issue.
- Developing Ad Hoc reports using OBIEE and Bi Publisher. Supporting business with Technical issues and troubleshooting real time.
- Built reports with layout like displaying a customer copy of Invoice with signature captured in the handheld device transferred to OLTP database from technician at site location.
- Structured way of reports built to view them online web based reports.
- Developed reports that can be viewed at the SIEBEL end for Invoice printing,
- Also use to schedule the reports for printing or FTPing to another location.
- Keeping tracking of all the critical tickets to resolve as per SLAs.
Confidential
BI Developer
Responsibilities:
- Responsible for Technical development and Interacting with various internal billing teams of client and end users for gaining understanding of the business processes of the client.
- Developing report layout using OBIEE to build RPD. Creating alias for tables and physical joins. Implementing Union of reports.
- Performance tuning of jobs for reports, calling filter from already created report.
- Responsible for peer reviews of ETL Jobs
- Creating YTD,MTD,QTD,WTD measures for comparison to last year’s data.
- Preparing the Technical Design Document, where the details can be taken from the Repository documentation to show the mapping of the Presentation columns to Physical columns and tables.
- Intensive Unit testing of the developed jobs and reports. Regression testing in all the environments.