We provide IT Staff Augmentation Services!

Big Data Solution Designer Resume

3.00/5 (Submit Your Rating)

EXPERIENCE SUMMARY:

  • 11 years of rich IT experience in data analytics, data warehousing, business intelligence area entirely in Banking domain with emphasis on portfolios of Credit card, Retail bank, Basel regulatory reporting and Securities regulatory reporting
  • Strong experience as Big data solution designer in end to end design and development of distributed data processing framework with large datasets using big data technology stack - Hadoop File System ( Confidential ), Spark, Python(PySpark), Scala, MapReduce, Impala and Hive
  • Strong experience in design framework using Spark and Python(PySpark) and development for big data projects
  • Strong knowledge of Cloud platforms such as Amazon Web services(AWS) with services like S3, EC2 and EMR
  • Expertise in implementation of big data solutions using Spark through Cloud services using AWS
  • Strong data modelling experience using Erwin tool
  • Hands on experience with SQL and Unix - Shell Scripting
  • Hands on experience with Python Programming skills
  • Strong knowledge of No SQL databases such as MongoDB and Cassandra
  • Strong experience in end to end ETL/ELT design and development in high complex and high volume data warehousing projects with expertise on ETL tool - Ab Initio, Unix and Teradata/Oracle
  • Rich exposure in data analytics and data warehouse with large datasets across all financial projects
  • Strong experience in Agile methodologies - Scrum and Kanban models and exposure on JIRA board
  • Interaction with Product Owners and Scrum Masters on daily basis
  • Work closely with customers and software development teams to provide continuous and crucial support to eliminate any gaps and help them in effectively translating business requirements to technical designs and software applications
  • Flexible and versatile to adapt to any new environment and work on any project.
  • Fast learner and Good Adaptability towards people and working environment.
  • Possess excellent analytical, interpersonal and communication skills with demonstrated abilities in accomplishing high complex projects

SKILL SET:

Big data: Hadoop File System ( Confidential ), Spark and Python(PySpark), Scala, MapReduce, Impala and Hive

Cloud: Amazon Web Services (AWS) - EC2, EMR, S3 and Redshift, PostgreSQL

ETL: Ab Initio, Datastage, Hydrograph

Programming Language: Python, Java

Scripting Language: UNIX Shell scripting

Databases: Snowflake, Oracle, Teradata, SQL server, DB2, MongoDB and Cassandra (No SQL databases)

Tools: GitHub, Data Modelling - Erwin, Control-M scheduler, Autosys scheduler, Tivoli Scheduler

WORK EXPERIENCE:

Confidential

Big data solution designer

Responsibilities:

  • Designed and developed distributed data processing framework using Big data technologies like Spark, Python(PySpark) and Amazon Web Services (AWS) for Customer Information Management(CIM) application big data migration project in Confidential
  • Implement data strategies, build data pipeline and created coding standards for developing Spark and Python(PySpark) data processing framework
  • Developed Spark and Python(PySpark) code for conversion of all legacy process for each data product
  • Worked with Proof of Concept using Spark and Scala for distributed processing framework
  • For Retail Bank project, Involved in development of big data framework for processing data from different Retail bank source systems and fill the data lake (FTL) using Hadoop, MapReduce and Hive
  • Maintained big data registry tool to store all metadata information for each source file and target file on Confidential
  • Understand and translate business needs into data models supporting long-term big data solutions
  • Creating and maintaining various project documents such as high-level design(HLD), low level design(LLD), impact assessments, estimates, scheduling and Implementation documents
  • Functional analysis and technical solution provided for all business requirements
  • Create database design and database schema using Erwin tool for Retail Bank projects

Confidential

Big data solution designer

Responsibilities:

  • Gathering of business requirements and impact assessments
  • Design high level end to end ETL design for regulatory data warehouse
  • Ab Initio graph design and development
  • Performance tuning of Ab Initio graphs
  • Participate in code reviews of Ab Initio graphs developed by ETL team
  • Providing support to SIT and UAT teams
  • Coordinating with various source systems and getting the required information
  • Creation of support handover document and release notes for Production Implementation
  • Providing Warranty Support after Implementation

Confidential

Big data solution designer

Responsibilities:

  • Setting up Basel reporting for new portfolios that are added in Confidential reporting
  • Development of end to end ETL design
  • Ab Initio graph design and development
  • Performance tuning of Ab Initio graphs
  • Development of scripts using Python for processing data to load to reporting tool
  • Enhancements in the schedule such as optimized error handling, data quality, redesign for parallel running of jobs for faster processing
  • Testing of developed graphs to ensure defect free code
  • Solving of Ab Initio Dependency errors
  • Project Environment set up done
  • Component Integration testing done
  • System Testing and support for Operational Acceptance Testing
  • Creation of design documents and test cases
  • Mentoring and Training of new team Members
  • Being a Module Lead ensure the implementation document is reviewed by all stakeholders and application is delivered on time

We'd love your feedback!