We provide IT Staff Augmentation Services!

Etl And Big Data Developer Resume

3.00/5 (Submit Your Rating)

Phoenix, AZ

SUMMARY

  • More than 8 years of experience Working in IT industry
  • Worked in End to End Implementation of Data warehouse application
  • Experience with creating ETL design and development using Informatica, SSIS, Talend, Pentaho, custom Python code
  • Worked on No Sql/Cloud Database like Snowflake Data warehouse, MongoDB, Parse DB
  • Extensive Experience with deploying BI applications in AWS
  • Informatica Certified Developer from Informatica and Oracle Certified Associate from Oracle
  • Worked with Very Large Relational Databases (VLRDs) and experience in Dimensional Data modeling, Star Schema modeling, Snow - Flake modeling, Fact and Dimensions tables, Slowly Changing Dimensions, and OLAP systems
  • Experience in Data lake creation in cloud
  • Data warehouse Implementation experience with AWS databases like Redshift, Postgres RDS, Oracle RDS
  • Strong Experience in BI report creation using Jaspersoft, Pentaho, Tableau and Micro strategy
  • Excellent knowledge on Perl, Unix & Python.
  • Experience with Automation of Production deployments using Docker and cloud formation templates in AWS
  • Exposure to gathering and defining business requirements having worked in cross functional environments with business and technical professionals often serving as a liaison between the two.
  • Versatile and dependable; able to learn new tools and processes quickly, adapt easily to new priorities and environments, and complete projects on time.
  • Strong communication, interpersonal, and organizational skills that support strengths as both independent contributor and team leader

TECHNICAL SKILLS

Database: Oracle 9i/10g/11g, SQL server 2005/2008/2012 , MS-Access, My Sql, Teradata, Exadata, EB2

ETL Tools: Informatica 9.5.1/9.1/8.6/7.1.2 , SSIS package, Pentaho Data Integration, Talend ETL 6.1.1

AWS Technologies: Lambda, EMR, Data Pipeline, VPC, RDS, S3, Cloud Formation, Redshift, Redshift Spectrum, Athena, glue, EC2, Cloudwatch, Kinesis

Business Intelligence tools: Tableau 10, Micro Strategy 9.4.1, Tibco Jaspersoft 6.4.1

Hadoop Tools: HDFS, HBase, Hive, Pig, ZooKeeper, sqoop, spark

No Sql and Cloud Database: Snowflake Datawarehouse, Mango DB, Parse Cloud Database, Postgres RDS

Mobile and Web App Development Tools: HTML, DHTML, JAVA Script, XML, Xcode 4.5.2, Android SDK tools Revision 21.0.1

PROFESSIONAL EXPERIENCE

BI Solution Architect

Confidential, Phoenix AZ

Responsibilities:

  • Developed the ETL mappings for web service, XML, .csv, .txt sources and loading the data from these sources into RDS tables and Redshift with Talend ETL.
  • Worked on Running ETL workflows in AWS lambda and cut down the server maintenance and cost by 40%
  • Created ETL mappings to source the data from S3 and write the data back into S3
  • Designed and developed a Data lake in AWS S3 using Talend, EMR(Hadoop), glue, Athena and Redshift.
  • This simplified the data accessibility and generated lot of revenue
  • Used AWS Athena and Redshift spectrum for Adhoc Analysis.
  • Also worked on creating Tableau reports on top of Data lake
  • Developed complex ETL mappings for Staging, Operational Data Source(ODS), Data warehouse and Data marts load.
  • Used Java transformations in Talend ETL jobs to perform data quality validations, hashing algorithms and complex calculations
  • Created Reusable ETL transformations and dynamic schema generation using Talend
  • Automated the deployment process of entire BI stack in AWS cloud
  • Worked on Dockerizing ETL and Report environment setup in AWS environment using VPC and resolved issues with AWS
  • Worked on automated Database deployment scripts for Amazon Postgres RDS, Mongo DB, Dynamo DB and Redshift using Flyway
  • Designed a star schema based logical and physical model for an HL7 oriented system
  • Designing high level Data warehouse flow with tools like Erwin, Microsoft Visio.
  • Developed BI reports using Tableau and Jaspersoft.
  • Created No SQL related BI reports on Mongo DB and AWS Dynamo DB
  • Optimized the report loading time
  • Worked on Postgres DB optimization by creating partitions and index
  • Implemented User based Domain security in reports and dashboards
  • Mentoring junior developers, vendors and contractors in development activities

ETL and Big Data Developer

Confidential

Responsibilities:

  • Improved the performance of current SSIS jobs and stored procedure by doing the incremental load
  • Successfully Installed Informatica in Dev, Test and Prod
  • Working on migrating current SSIS jobs to Informatica ETL
  • Created automated backup scripts to back up the ETL repository
  • Documented the best practices in ETL development and shared with the team
  • Developed some sample profiles on our source systems
  • Analyzed the profile results and gave recommendations to data architect in updating the data model
  • Worked on bringing the unstructured data from our source system into our Warehouse using Microsoft's

Specialist IT APP Developer

Confidential

Responsibilities:

  • Developed Sql server Stored Procedures
  • Worked extensively on Optimization of Sql Server Stored procedures
  • Worked on partitioning of fact tables
  • Built complex ETL logics using most of the Informatica Power Center and SSIS transformations to validate the business rules
  • Used Informatica Java transformations to perform data quality validations
  • Did Basic reporting using Micro strategy including designing schema objects and building reports using attributes, metrics, advanced filters, prompts etc.
  • Involved in extensive DATA validation by writing several complex SQL queries and Involved in back-end testing and worked with data quality issues
  • Worked with R&D team in Big data learning and developed some case studies on processing the raw data into Business consumption ready state using MAPREDUCE, APACHE PIG

ETL Architect

Confidential

Responsibilities:

  • Suggested approaches to change current implementations and collaborating with team leads on making these changes.
  • Reverse Engineered the existing Stored Procedures created the design, to convert SQL Server stored procedures into ETL worked on ETL related production issues, and provided the fix for it
  • Developed Unix script to send email attachments

Mobile app and SDK Developer

Confidential

Responsibilities:

  • worked an Android Mobile appp to support SDK version of the native Breadkrum APP
  • Developed code to Parse the json response from Google maps API
  • Worked on app integration with social media API like facebook and twitter
  • Part of the team setting up GitHub Repository

Confidential

ETL Developer

Responsibilities:

  • Being Part of the team, proposed an Open source tool to reduce the cost of the Project
  • Worked on creating Pentaho ETL mappings
  • Document the complete process flow to describe program development, logic, testing, and implementation, application integration, coding
  • Developed test cases to test the ETL process for both before data validation and after data validation process
  • Remain knowledgeable in all areas of business operations in order to identify systems needs and requirements.
  • Involved as an External Quality Audit for the project

Confidential

ETL and Unix Script Developer

Responsibilities:

  • created PL procedures to automate the data loading process
  • Worked on the data integration from different sources like flat file, XML, oracle database using Informatica
  • Managed the Informatica Server sessions, scheduled and monitored the progress using warehouse/workflow manager
  • Tested Complex ETL Mappings and Sessions based on business user requirements and business rules to load data from source flat files and RDBMS tables to target tables.
  • Developed Unix scripts in performing file handling operation
  • Worked on query optimization, to minimize the query run time by 70%

Confidential

ETL and Unix Script Developer

Responsibilities:

  • Designed the framework for data warehousing and implemented using star schema method
  • Created Informatica mapping to perform ETL (Extract Transformation Load)
  • Mappings were developed with transformations like Source qualifier, Aggregator, Expression, Lookups, Filter, Router, Sequence Generator
  • Tested the Application by load Testing
  • Documented the complete process flow to describe program development, logic, testing, and implementation, application integration, coding.
  • Written Unix Shell scripts to run the PL Sql procedure

Confidential

PL SQL Stored Procedure Developer

Responsibilities:

  • Created user defined exception handlers
  • Experience in testing and writing SQL and PL/SQL statements - Stored Procedures, Functions, Triggers and packages.
  • Completed performance optimization of Stored procedure
  • Created Knowledge Transition document for the project
  • Worked on Low Level Documentation and Unit Testing
  • Tested the database to check field size validation, check constraints, stored procedures and cross verifying the field size defined within the application with metadata.

We'd love your feedback!