Etl And Big Data Developer Resume
Phoenix, AZ
SUMMARY
- More than 8 years of experience Working in IT industry
- Worked in End to End Implementation of Data warehouse application
- Experience with creating ETL design and development using Informatica, SSIS, Talend, Pentaho, custom Python code
- Worked on No Sql/Cloud Database like Snowflake Data warehouse, MongoDB, Parse DB
- Extensive Experience with deploying BI applications in AWS
- Informatica Certified Developer from Informatica and Oracle Certified Associate from Oracle
- Worked with Very Large Relational Databases (VLRDs) and experience in Dimensional Data modeling, Star Schema modeling, Snow - Flake modeling, Fact and Dimensions tables, Slowly Changing Dimensions, and OLAP systems
- Experience in Data lake creation in cloud
- Data warehouse Implementation experience with AWS databases like Redshift, Postgres RDS, Oracle RDS
- Strong Experience in BI report creation using Jaspersoft, Pentaho, Tableau and Micro strategy
- Excellent knowledge on Perl, Unix & Python.
- Experience with Automation of Production deployments using Docker and cloud formation templates in AWS
- Exposure to gathering and defining business requirements having worked in cross functional environments with business and technical professionals often serving as a liaison between the two.
- Versatile and dependable; able to learn new tools and processes quickly, adapt easily to new priorities and environments, and complete projects on time.
- Strong communication, interpersonal, and organizational skills that support strengths as both independent contributor and team leader
TECHNICAL SKILLS
Database: Oracle 9i/10g/11g, SQL server 2005/2008/2012 , MS-Access, My Sql, Teradata, Exadata, EB2
ETL Tools: Informatica 9.5.1/9.1/8.6/7.1.2 , SSIS package, Pentaho Data Integration, Talend ETL 6.1.1
AWS Technologies: Lambda, EMR, Data Pipeline, VPC, RDS, S3, Cloud Formation, Redshift, Redshift Spectrum, Athena, glue, EC2, Cloudwatch, Kinesis
Business Intelligence tools: Tableau 10, Micro Strategy 9.4.1, Tibco Jaspersoft 6.4.1
Hadoop Tools: HDFS, HBase, Hive, Pig, ZooKeeper, sqoop, spark
No Sql and Cloud Database: Snowflake Datawarehouse, Mango DB, Parse Cloud Database, Postgres RDS
Mobile and Web App Development Tools: HTML, DHTML, JAVA Script, XML, Xcode 4.5.2, Android SDK tools Revision 21.0.1
PROFESSIONAL EXPERIENCE
BI Solution Architect
Confidential, Phoenix AZ
Responsibilities:
- Developed the ETL mappings for web service, XML, .csv, .txt sources and loading the data from these sources into RDS tables and Redshift with Talend ETL.
- Worked on Running ETL workflows in AWS lambda and cut down the server maintenance and cost by 40%
- Created ETL mappings to source the data from S3 and write the data back into S3
- Designed and developed a Data lake in AWS S3 using Talend, EMR(Hadoop), glue, Athena and Redshift.
- This simplified the data accessibility and generated lot of revenue
- Used AWS Athena and Redshift spectrum for Adhoc Analysis.
- Also worked on creating Tableau reports on top of Data lake
- Developed complex ETL mappings for Staging, Operational Data Source(ODS), Data warehouse and Data marts load.
- Used Java transformations in Talend ETL jobs to perform data quality validations, hashing algorithms and complex calculations
- Created Reusable ETL transformations and dynamic schema generation using Talend
- Automated the deployment process of entire BI stack in AWS cloud
- Worked on Dockerizing ETL and Report environment setup in AWS environment using VPC and resolved issues with AWS
- Worked on automated Database deployment scripts for Amazon Postgres RDS, Mongo DB, Dynamo DB and Redshift using Flyway
- Designed a star schema based logical and physical model for an HL7 oriented system
- Designing high level Data warehouse flow with tools like Erwin, Microsoft Visio.
- Developed BI reports using Tableau and Jaspersoft.
- Created No SQL related BI reports on Mongo DB and AWS Dynamo DB
- Optimized the report loading time
- Worked on Postgres DB optimization by creating partitions and index
- Implemented User based Domain security in reports and dashboards
- Mentoring junior developers, vendors and contractors in development activities
ETL and Big Data Developer
Confidential
Responsibilities:
- Improved the performance of current SSIS jobs and stored procedure by doing the incremental load
- Successfully Installed Informatica in Dev, Test and Prod
- Working on migrating current SSIS jobs to Informatica ETL
- Created automated backup scripts to back up the ETL repository
- Documented the best practices in ETL development and shared with the team
- Developed some sample profiles on our source systems
- Analyzed the profile results and gave recommendations to data architect in updating the data model
- Worked on bringing the unstructured data from our source system into our Warehouse using Microsoft's
Specialist IT APP Developer
Confidential
Responsibilities:
- Developed Sql server Stored Procedures
- Worked extensively on Optimization of Sql Server Stored procedures
- Worked on partitioning of fact tables
- Built complex ETL logics using most of the Informatica Power Center and SSIS transformations to validate the business rules
- Used Informatica Java transformations to perform data quality validations
- Did Basic reporting using Micro strategy including designing schema objects and building reports using attributes, metrics, advanced filters, prompts etc.
- Involved in extensive DATA validation by writing several complex SQL queries and Involved in back-end testing and worked with data quality issues
- Worked with R&D team in Big data learning and developed some case studies on processing the raw data into Business consumption ready state using MAPREDUCE, APACHE PIG
ETL Architect
Confidential
Responsibilities:
- Suggested approaches to change current implementations and collaborating with team leads on making these changes.
- Reverse Engineered the existing Stored Procedures created the design, to convert SQL Server stored procedures into ETL worked on ETL related production issues, and provided the fix for it
- Developed Unix script to send email attachments
Mobile app and SDK Developer
Confidential
Responsibilities:
- worked an Android Mobile appp to support SDK version of the native Breadkrum APP
- Developed code to Parse the json response from Google maps API
- Worked on app integration with social media API like facebook and twitter
- Part of the team setting up GitHub Repository
Confidential
ETL Developer
Responsibilities:
- Being Part of the team, proposed an Open source tool to reduce the cost of the Project
- Worked on creating Pentaho ETL mappings
- Document the complete process flow to describe program development, logic, testing, and implementation, application integration, coding
- Developed test cases to test the ETL process for both before data validation and after data validation process
- Remain knowledgeable in all areas of business operations in order to identify systems needs and requirements.
- Involved as an External Quality Audit for the project
Confidential
ETL and Unix Script Developer
Responsibilities:
- created PL procedures to automate the data loading process
- Worked on the data integration from different sources like flat file, XML, oracle database using Informatica
- Managed the Informatica Server sessions, scheduled and monitored the progress using warehouse/workflow manager
- Tested Complex ETL Mappings and Sessions based on business user requirements and business rules to load data from source flat files and RDBMS tables to target tables.
- Developed Unix scripts in performing file handling operation
- Worked on query optimization, to minimize the query run time by 70%
Confidential
ETL and Unix Script Developer
Responsibilities:
- Designed the framework for data warehousing and implemented using star schema method
- Created Informatica mapping to perform ETL (Extract Transformation Load)
- Mappings were developed with transformations like Source qualifier, Aggregator, Expression, Lookups, Filter, Router, Sequence Generator
- Tested the Application by load Testing
- Documented the complete process flow to describe program development, logic, testing, and implementation, application integration, coding.
- Written Unix Shell scripts to run the PL Sql procedure
Confidential
PL SQL Stored Procedure Developer
Responsibilities:
- Created user defined exception handlers
- Experience in testing and writing SQL and PL/SQL statements - Stored Procedures, Functions, Triggers and packages.
- Completed performance optimization of Stored procedure
- Created Knowledge Transition document for the project
- Worked on Low Level Documentation and Unit Testing
- Tested the database to check field size validation, check constraints, stored procedures and cross verifying the field size defined within the application with metadata.