Bigdata Etl Developer Resume
5.00/5 (Submit Your Rating)
OBJECTIVE:
Talented and accomplished Data Warehousing and Bigdata ELT Developer with 5+ years of experience in contributing the design, development and maintenance of high quality Transactional and Decision Support Systems that can deliver data and reports in an “easy & efficient” way to understand the Client Business requirements.
SUMMARY:
- Around 5+ Years of experience in Data Warehousing as an ELT & ETL developer
- Proficient in Spark ELT Development using Bigdata Technologies like Hadoop ecosystems and filesystem for the last two years
- Hand on experience in the other Hadoop components such as MapReduce, HDFS, YARN, Hive, Pig, Sqoop, HBase, Kafka, Zeppelin, Oozie and others
- Successful contribution in migrating on premise Data Stage ETL application to AWS Elastic Map Reduce
- Experienced in Amazon Web Services in provisioning and maintaining AWS resources such as EMR, S3 buckets, EC2 instances, RDS and others.
- AWS associate Solutions Architect, Associate Developer Certified
- Very good knowledge in Python programming.
- Excellent technical and analytical skills with clear understanding of design goals and development for OLTP and dimension modeling for OLAP. Solid understanding in Data Warehousing techniques
- Programming experience as an Oracle PL/SQL Developer for Business Applications using the Oracle Relational Database Management System (RDBMS).
- Experienced in Shell Scripting and wrappers for the ETL jobs
- Over two years of solid experience in Ab Initio Development of Data warehousing solutions and in developing strategies for Extraction, Transformation and Loading (ETL) mechanism.
- Sound knowledge in IBM - DataStage
- Job scheduling, maintenance and monitoring through Confidential
- Implemented Agile development practices to the application requirements in every project and tracked the development efforts, issues and stories using JIRA and Confidential
- Version control and source code management using GitHub
PROFESSIONAL EXPERIENCE:
Confidential
Bigdata ETL Developer
Responsibilities:
- Understanding the overall business through the existing documents and job schedules
- In depth and grained analysis of existing businesses and logics.
- Analyzing and understanding the current workflow of DataStage jobs
- Gathering the required data base objects, which provides the data for front end applications and reports.
- Re-architecting and designing the ELT model, while helping facilitate a more intuitive and efficient interface to processes in the data workflow
- Spark configurations in EMR
- Setting up the development environments
- Design and development of flexible, reliable, robust framework
- Application Designing, developing and testing in Spark
- Database design, profiling and data analysis in PostgreSQL
- Existing stored procedures implemented in a current data warehouse implementation were moved over with reasonable effort, though this required some development efforts to cover for platform specific features (Oracle) and SQL compatibility.
- Integration and System testing support.
- User Acceptance Testing
- Support for Production Implementation and bug fixes if any issues reported.
- Technical assistance from design and development standpoint
- Identify the process gaps and provide alternatives to the team
- Planning the test activities and preparation of test scenarios as per the customer requirements
Confidential
ETL Developer
Responsibilities:
- Requirement gathering and analysis.
- Technical Architecture and high level design
- Database design
- Data profiling and data analysis.
- Extract-Transform-Load Design and Development
- Application Development and Unit Testing
- Integration and System testing support.
- User Acceptance Testing
- Support for Production Implementation and bug fixes if any issues reported.
- Technical assistance from design and development standpoint
- Identify the process gaps and provide alternatives to the team
- Planning the test activities and preparation of test scenarios as per the customer requirement