We provide IT Staff Augmentation Services!

Sr Data Engineer/solution Designer Resume

3.00/5 (Submit Your Rating)

San Jose, CA

SUMMARY

  • Software professional with 16+ years of experience as Sr Data Engineer /Technical Architect/ Solution Designer/Sr Business Data Analyst/ Sr. ETL Consultant/Project Lead developer in Data Warehouse technologies using Teradata, Oracle, Informatica, Hadoop, HDFS, Hive, Spark.
  • Extensive experience in all stages of Project Life Cycle (PLC) including business requirement analysis, Source System analysis, Solution Design, Build, BAT, UAT, managing cross functional teams in implementing large scale Business Intelligence Applications and Big data solutions.
  • Experience in providing scalable architecture to support data analytics requirements for operational and analytical reporting.
  • Interaction with business users to understand the data & reporting needs to provide scalable solutions.
  • Expertise in translating business requirements into Functional Specification (FSD) and providing technical specifications, High Level and Low level design documents.
  • Expertise in handling large data volumes and solving complex data challenges through innovative solutions & Implementations
  • Extensively involved in Solution design, Data architecture, Data modeling activities such as creating conceptual, logical, physical & dimensional models.
  • Performed activities such as Source System Study and Analysis (SSA), Data Collection, Data Cleansing, Transformation, Source - to-target mappings, Data Profiling, verifying data quality & GAP Analysis.
  • Defined new ETL standards and Templates to simplify and reduce Teradata resource consumption.
  • Expertise in implementing Data warehouse solutions using Teradata, well versed with Bteq Scripts Performance tuning of complex SQL Queries & Teradata utilities- Fast load, Multi load, TPUMP, Fast Export & TPT
  • Extensive experience on designing and developing ETL Jobs using Informatica Transformations, mapplets, mappings, Sessions & workflows.
  • Extensive experience in processing Kafka streaming files into Hadoop using Hive,Spark.
  • Hands on experience in writing UNIX, SAS and R and Python scripts.
  • Exposure in generating reports using Tableau.
  • Expertise in working data replication tool Golden Gate using Extract, datapump & Replicat.
  • Experience on scheduling tools Appworx, UC4 and Dollar U to schedule Bteq Scripts and ETL jobs
  • Good Functional & Technical Knowledge in Order Management, Supply Chain,HR, Case management, Shipments, financial & consumer domains.
  • Expert in Agile software development and release management using Scrum Process with tools such as Rally and JIRA.
  • Worked extensively on Error Handling, Performance Analysis and Fine Tuning of scripts in Oracle and Teradata.
  • Designed ETL process for Exception handling, control tables, parameterization and Reconciliation
  • Demonstrated interpersonal, communication, team building, issue resolution, project coordination & technical leadership skills
  • Experience in estimation, planning, work allocation and tracking health of projects.
  • Sound analytical, logical and communication skills and ability to adapt to new technologies.
  • Expertise in providing leadership to development and cross functional teams in implementing EDW projects in both traditional water-fall and Scrum agile development methodologies.
  • Extensive experience in supervising progress of Project activities using Agile methodology, monitoring milestones through daily status call, tracking project deliverables.
  • Having strong experience as Delivery Lead in implementing projects in Onsite-Offshore model.

TECHNICAL SKILLS

ETL Tools: Informatica 9.6/9.1/8.6

Database: Teradata(Fast Load,BTeq,TPump and TPT), Oracle

Scheduling Tools: Appworx,UC4 and Dollar U

Distributed Systems: Bigdata Hadoop, Hive & Spark

Programming/Reporting: SQL, PL/SQL, Golden Gate, UNIX Shell Scripting, Python,SAS, Tableau

Methodologies: Waterfall, Agile

PROFESSIONAL EXPERIENCE

Confidential, San jose, CA

Sr Data Engineer/Solution Designer

Responsibilities:

  • Gather Business requirements, and Analyze the data & reporting needs.
  • Responsible for detailed data analysis and provide the data architecture and design for BI applications.
  • Provide Logical and Physical data models for data requirements.
  • Responsible to provide high level and low level design documents.
  • Process Risk data, Credit Merchant loan application data into EDW layer. Using Teradata BTEQ, SparkQL & Informatica, SAS.
  • JSON risk data processing into Teradata EDW using HDFS, Hive and Spark.
  • Create UC4 Jobs and Job Plans for Teradata Scripts Job Scheduling.
  • Responsible for end to end delivery of ETL development portion of project in agile methodology.
  • Provide guidance to development team in ETL development/support activities.
  • Responsible for preparation of Project documentation.
  • Socialize the business teams about usage of Data Warehouse models.

Key Technologies/Skills: Teradata, HDFS, Hive, Spark,SAS Informatica,UNIX, UC4

Confidential, Mountain View, CA

Data Analyst/ Sr ETL Consultant

Responsibilities:

  • Analyze the Business requirements, data source and patterns.
  • Work with Logical and Physical data modelers for database objects design.
  • Perform detailed analysis for new requirements and prepare design document.
  • Create ETL Scripts using Teradata Utilities Fast Load, Fast Export and TPT using Informatica.
  • Write the BTEQ scripts with error handling mechanism in order to handle batch processing.
  • Implemented SCD & Time Variant logic as per user requirement.
  • Performance analysis, monitoring and SQL query tuning in Teradata.
  • Develop scheduling modules using Appworx Teradata Scripts and Informatica ETLs for Job Scheduling.
  • Responsible for end to end delivery of ETL development portion of project in agile methodology.
  • Provide guidance to development team.
  • Responsible for preparation of Project documentation.

Key Technologies/Skills: Teradata, Oracle, Informatica 9.6.1, UNIX AppWorx

Confidential

Technical Architect/Solution Designer

Responsibilities:

  • Responsible for gathering business requirements by interacting with business users and perform detailed requirement analysis.
  • Responsible for providing functional & technical design documents.
  • Design the data architecture for reporting requirements and socialize with development and reporting teams.
  • Designed the architecture for data replication into Teradata replication using Golden Gate.
  • Work with Logical and Physical data modelers for data modeling and responsible for providing the ETL architecture of the Project.
  • Performance Tuning, monitoring and Teradata queries.
  • Involved in designing Order & case metrics
  • Developed Informatica workflows using various transformations and Pushdown Optimization.
  • Performed Technical Project manager role, provided leadership and guidance to the team in High level & Low-Design, end to end development activities and during QA Support, BAT Support.
  • Developed scripts to load data into Teradata using FastLoad, BTEQ, Fast Export, MultiLoad and UNIX scripts.
  • Responsible to provide the common platform between developers, QA team, BAT users during test cycle for defect resolution.
  • Involved in generating reports using Tableau.
  • Identify the potential risk factors and provide the mitigation plan.
  • Conducting review sessions once the project went Go-live for improvement analysis.
  • Manage customer escalations and work with the delivery teams to maintain a high level of customer satisfaction.
  • Coordinate with all the stake holders in the project and track the health of the project periodically (weekly or bi-weekly) and present it to Customer management.
  • Involve with the Delivery teams and SMEs (Subject Matter Experts) in constantly exploring further process improvements, automation and cost optimization.
  • Responsible for Overall development life cycle of the ETL portion of the Project.

Key Technologies/Skills: Teradata, Oracle, .Informatica 9.6.1, UNIX Golden Gate, DollarU

We'd love your feedback!