Datastage/big Data Developer Resume
San Leandro, CA
SUMMARY:
- 11.7 years of experience in the field of system analysis, design, development, testing and implementation of Data Warehouse/Data Mart and big data applications.
- Ample working experience in IBM DataStage and Quality Stage 11.7/11.5/11.3 /8. x.
- Expertise in Designing, Developing, Testing and implementing the ETL jobs to populated data into Data Warehouse and Data Marts.
- Ample working experience with Big data and Hadoop Technologies like HDFS,Hive, Sqoop, Spark and Kafka.
- Having knowledge with publish message from RDBMS into Kafka Topics and subscribe message from Kafka topics into RDBMS.
- Extensive working knowledge to design the data model Star/Snowflake schema.
- Extensive working experience with Oracle Golden Gate process.
- RDBMS experience with Teradata, Oracle, SQL Server, DB2 and Sybase.
- Having extensive knowledge of NoSQL Databases like HBase,Cassandra and Mongo DB.
- Extensive working experience with scheduling tools like AutoSys,CA ESP,Control - M.
- Having experience in creating Unix and Python scripts.
- Highly motivated team player with ability to lead, manage and work in all environments to meet deadlines.
- Having extensive working experience with Agile project methodology.
TECHNICAL SKILLS:
ETL Tools: DataStage 11.7/11.5/11.3 /8. x/7.x
Modelling Tools: Erwin, ER Studio, Visio, Toad
Languages: SQL, Unix, PL/SQL, Python
RDBMS: Teradata, Oracle, SQL Server, DB2,Sybase
Operating Systems: Windows, Unix, Linux
Big Data Echo Systems: Hadoop 2.6, HDP Framework 3.0, Hive, Sqoop,HDFS,Spark,Kafka,Oozie,Yarn
NoSQL DBs: Cassandra, HBase, MongoDB
Other Tools: JIRA,BMC Remedy,PVCS,TFS,AutoSys,CA ESP
PROFESSIONAL EXPERIENCE:
Confidential, San Leandro,CA
DataStage/Big Data Developer
Responsibilities,
- Working closely with business analysts in requirements gathering, reviewing business rules and identifying data sources.
- Involving in designing and development of Tablet Usage Data(TUD), Remedy(RMD), Customer Behavior Data-warehouse(CBD), Branch ATM Data Analytics (BADA) and ATM Hardware(AHA) projects.
- Extensively used Data Stage Designer, Quality Stage, and Administrator Director for creating and implementing jobs to load the Data Marts/Data Warehouse.
- Extensively used hierarchal data stage to parsing JSON data and Unstructured Data stage to read and write Microsoft Excel files.
- Created logical and physical data models, business rules and data mapping for the Enterprise Data Warehouse system.
- Coordinate with Data scientists/Business Analyst and responsible for writing the complex Hive queries and get insights that convert the potential value of big data into real, tangible business value.
- Creating Sqoop Import and export scripts to brings data from RDBMS to HDFS and from HDFS to RDBMS.
- Creating Hive tables, loading the structured/semi-structured data into hive tables and writing hive queries to further analyze the logs to identify issues and behavioral patterns.
- Creating Kafka topics and publish message from Oracle into topics and subscribe message from topics into SQL Server.
- Importing CSV files into hive table using spark.
- Involving in creating Oozie workflow and Coordinator jobs to kick off the jobs on time for data availability.
- Generating test data using python script.
- Using JIRA to tracking and monitor the bugs/issues related to projects.
Environment: IBM DataStage 11.7/11.5/11.3 , Oracle 11g,SQL Server 2014,Hadoop 2.6,HDP 3.0,Python,PySpark,JIRA,Kafka
Confidential, Grand Rapids, MI
DataStage Consultant
Responsibilities,
- Worked closely with business analysts in requirements gathering, reviewing business rules and identifying data sources.
- Involving in designing and development of Supply Chain,Logistic,Space Management,Predictix,mPerks,Market Basket,ICAP,HR-PeopleSoft,Finance,Pricing & Promo, Digital Account, Digital Transformation and Marketing & Analytical projects.
- Extensively used Data Stage Designer, Quality Stage, and Administrator Director for creating and implementing jobs to load the Data Marts/Datawarehouse.
- Worked with Data Modelling team for building the dimensional model for the proposed system.
- Created ESP jobs to schedule the ETL jobs.
- Created implementation plans and Change Management Requests.
- Coordinated with Development team, SME, Customer and Data Modeler to deliver the project on time.
Environment: DataStage11.3,Teradata, DB2, Sybase, Oracle, SQL Server,Unix, CA ESP.
Confidential
DataStage Team Lead
Responsibilities,
- Involved in designing, development, testing and implementing of Supply Chain, Logistic, Space Management, mPerks, Market Basket, ICAP, HR-PeopleSoft, Finance, Digital Transformation and Marketing & Analytical projects.
- Extensively used Data Stage Designer, Quality Stage, and Administrator Director for creating and implementing jobs to load data into Data Marts/Datawarehouse.
- Created ESP jobs to schedule the ETL jobs.
- Involved to prepare mapping document and designing the data model.
- Executed test cases in Test Case Manager (TCM).
- Managed and providing technical solutions to team members.
Environment: DataStage 11.3/8.5, Teradata, DB2, Sybase, Oracle,SQL Server,Unix,CA ESP.
Confidential
Client: Royal Bank of Scotland (UK) Sr.DataStage Developer
Responsibilities,
- Involved in Develop ETL jobs using datastage to load the data into DWH/DM.
- Involved to prepare HLD and LLD documents.
- Involved in Designing Jobs using stages like Seq/Dataset file, Filter, Lookup, Join, Aggregate etc.
- Prepared Unit Test Cases and System Test Cases.
- Coordinated the team members & assist them to make delivery on time
Environment: DataStage 8 .1, DB2, Oracle, SQL Server, Unix, Control-M.
Confidential
Sr.DataStage Developer
Responsibilities,
- Involved in Develop ETL jobs using datastage to load the data into DWH/DM.
- Involved to prepare HLD and LLD documents.
- Involved in Design Jobs using stages like Seq/Dataset file, Filter, Lookup, Join etc.
- Prepared and executed Unit Test Cases and System Test Cases.
- Coordinated the team members & assist them to make delivery on time
Environment: Data Stage 8x, DB2, SQL Server, Oracle 9i, Toad, Zena, and Windows.
Confidential
Sr.DataStage Developer
Responsibilities,
- Analyzed the business requirement documents (BRD) and mapping documents.
- Involved in Develop ETL jobs to extract, transform and load the data into DWH/DM.
- Involved in Design Jobs using stages like Seq/Dataset file, Filter, Lookup, Join, Aggregate etc.
- Monitored and fixed production job failure.
- Involved to execute unit and system test cases.
- Coordinated the team members & assist them to make delivery on time
Environment: DataStage 8.x/7.x, Teradata, DB2, Oracle, SQL Server, UNIX, Tivoli.