We provide IT Staff Augmentation Services!

Datastage/big Data Developer Resume

San Leandro, CA

SUMMARY:

  • 11.7 years of experience in the field of system analysis, design, development, testing and implementation of Data Warehouse/Data Mart and big data applications.
  • Ample working experience in IBM DataStage and Quality Stage 11.7/11.5/11.3 /8. x.
  • Expertise in Designing, Developing, Testing and implementing the ETL jobs to populated data into Data Warehouse and Data Marts.
  • Ample working experience with Big data and Hadoop Technologies like HDFS,Hive, Sqoop, Spark and Kafka.
  • Having knowledge with publish message from RDBMS into Kafka Topics and subscribe message from Kafka topics into RDBMS.
  • Extensive working knowledge to design the data model Star/Snowflake schema.
  • Extensive working experience with Oracle Golden Gate process.
  • RDBMS experience with Teradata, Oracle, SQL Server, DB2 and Sybase.
  • Having extensive knowledge of NoSQL Databases like HBase,Cassandra and Mongo DB.
  • Extensive working experience with scheduling tools like AutoSys,CA ESP,Control - M.
  • Having experience in creating Unix and Python scripts.
  • Highly motivated team player with ability to lead, manage and work in all environments to meet deadlines.
  • Having extensive working experience with Agile project methodology.

TECHNICAL SKILLS:

ETL Tools: DataStage 11.7/11.5/11.3 /8. x/7.x

Modelling Tools: Erwin, ER Studio, Visio, Toad

Languages: SQL, Unix, PL/SQL, Python

RDBMS: Teradata, Oracle, SQL Server, DB2,Sybase

Operating Systems: Windows, Unix, Linux

Big Data Echo Systems: Hadoop 2.6, HDP Framework 3.0, Hive, Sqoop,HDFS,Spark,Kafka,Oozie,Yarn

NoSQL DBs: Cassandra, HBase, MongoDB

Other Tools: JIRA,BMC Remedy,PVCS,TFS,AutoSys,CA ESP

PROFESSIONAL EXPERIENCE:

Confidential, San Leandro,CA

DataStage/Big Data Developer

Responsibilities,

  • Working closely with business analysts in requirements gathering, reviewing business rules and identifying data sources.
  • Involving in designing and development of Tablet Usage Data(TUD), Remedy(RMD), Customer Behavior Data-warehouse(CBD), Branch ATM Data Analytics (BADA) and ATM Hardware(AHA) projects.
  • Extensively used Data Stage Designer, Quality Stage, and Administrator Director for creating and implementing jobs to load the Data Marts/Data Warehouse.
  • Extensively used hierarchal data stage to parsing JSON data and Unstructured Data stage to read and write Microsoft Excel files.
  • Created logical and physical data models, business rules and data mapping for the Enterprise Data Warehouse system.
  • Coordinate with Data scientists/Business Analyst and responsible for writing the complex Hive queries and get insights that convert the potential value of big data into real, tangible business value.
  • Creating Sqoop Import and export scripts to brings data from RDBMS to HDFS and from HDFS to RDBMS.
  • Creating Hive tables, loading the structured/semi-structured data into hive tables and writing hive queries to further analyze the logs to identify issues and behavioral patterns.
  • Creating Kafka topics and publish message from Oracle into topics and subscribe message from topics into SQL Server.
  • Importing CSV files into hive table using spark.
  • Involving in creating Oozie workflow and Coordinator jobs to kick off the jobs on time for data availability.
  • Generating test data using python script.
  • Using JIRA to tracking and monitor the bugs/issues related to projects.

Environment: IBM DataStage 11.7/11.5/11.3 , Oracle 11g,SQL Server 2014,Hadoop 2.6,HDP 3.0,Python,PySpark,JIRA,Kafka

Confidential, Grand Rapids, MI

DataStage Consultant

Responsibilities,

  • Worked closely with business analysts in requirements gathering, reviewing business rules and identifying data sources.
  • Involving in designing and development of Supply Chain,Logistic,Space Management,Predictix,mPerks,Market Basket,ICAP,HR-PeopleSoft,Finance,Pricing & Promo, Digital Account, Digital Transformation and Marketing & Analytical projects.
  • Extensively used Data Stage Designer, Quality Stage, and Administrator Director for creating and implementing jobs to load the Data Marts/Datawarehouse.
  • Worked with Data Modelling team for building the dimensional model for the proposed system.
  • Created ESP jobs to schedule the ETL jobs.
  • Created implementation plans and Change Management Requests.
  • Coordinated with Development team, SME, Customer and Data Modeler to deliver the project on time.

Environment: DataStage11.3,Teradata, DB2, Sybase, Oracle, SQL Server,Unix, CA ESP.

Confidential

DataStage Team Lead

Responsibilities,

  • Involved in designing, development, testing and implementing of Supply Chain, Logistic, Space Management, mPerks, Market Basket, ICAP, HR-PeopleSoft, Finance, Digital Transformation and Marketing & Analytical projects.
  • Extensively used Data Stage Designer, Quality Stage, and Administrator Director for creating and implementing jobs to load data into Data Marts/Datawarehouse.
  • Created ESP jobs to schedule the ETL jobs.
  • Involved to prepare mapping document and designing the data model.
  • Executed test cases in Test Case Manager (TCM).
  • Managed and providing technical solutions to team members.

Environment: DataStage 11.3/8.5, Teradata, DB2, Sybase, Oracle,SQL Server,Unix,CA ESP.

Confidential

Client: Royal Bank of Scotland (UK) Sr.DataStage Developer

Responsibilities,

  • Involved in Develop ETL jobs using datastage to load the data into DWH/DM.
  • Involved to prepare HLD and LLD documents.
  • Involved in Designing Jobs using stages like Seq/Dataset file, Filter, Lookup, Join, Aggregate etc.
  • Prepared Unit Test Cases and System Test Cases.
  • Coordinated the team members & assist them to make delivery on time

Environment: DataStage 8 .1, DB2, Oracle, SQL Server, Unix, Control-M.

Confidential

Sr.DataStage Developer

Responsibilities,

  • Involved in Develop ETL jobs using datastage to load the data into DWH/DM.
  • Involved to prepare HLD and LLD documents.
  • Involved in Design Jobs using stages like Seq/Dataset file, Filter, Lookup, Join etc.
  • Prepared and executed Unit Test Cases and System Test Cases.
  • Coordinated the team members & assist them to make delivery on time

Environment: Data Stage 8x, DB2, SQL Server, Oracle 9i, Toad, Zena, and Windows.

Confidential

Sr.DataStage Developer

Responsibilities,

  • Analyzed the business requirement documents (BRD) and mapping documents.
  • Involved in Develop ETL jobs to extract, transform and load the data into DWH/DM.
  • Involved in Design Jobs using stages like Seq/Dataset file, Filter, Lookup, Join, Aggregate etc.
  • Monitored and fixed production job failure.
  • Involved to execute unit and system test cases.
  • Coordinated the team members & assist them to make delivery on time

Environment: DataStage 8.x/7.x, Teradata, DB2, Oracle, SQL Server, UNIX, Tivoli.

Hire Now