Job Seekers, Please send resumes to resumes@hireitpeople.com
Must Have Skills (Top 3 technical skills only)*:
- MongoDB
- Kafka
- Nifi
Nice to have skills:
- AWS
Detailed Job Description:
- Advanced AWS Components: EMR, EC2, S3
- Experience in handling, configuration and administration of databases like NoSQL databases like MongoDB
- Experience in working with databases like MongoDB.
- Experience in upgrading different databases and also migration of data among multiple databases
- Experience in managing large shared MongoDB cluster
- Experience in MongoDB installation, patching, troubleshooting, performance, tracking/tuning, back - up and recovery in dynamic environments
- Experience in managing life cycle of MongoDB including sizing, automation, monitoring and tuning
- Implemented Spring boot microservices to process the messages into the Kafka cluster setup
- Closely worked with Kafka Admin team to set up Kafka cluster/module setup on the QA and Production environments
- Had knowledge on Kibana and Elastic search to identify the Kafka message failure scenarios.
- Implemented to reprocess the failure messages in Kafka using offset id.
- Implemented Kafka producer and consumer applications on Kafka cluster setup with help of Python
- Used Spring Kafka API calls to process the messages smoothly on Kafka Cluster setup
- Have knowledge on partition of Kafka messages and setting up the replication factors in Kafka Cluster
- Good experience on Apache Nifi Ecosystem
- Worked on Nifi for data cleaning and preprocessing
- Implemented solutions utilizing Advanced AWS Components: EMR, EC2, S3 etc integrated with Big Data/Hadoop Distribution Frameworks like NiFi.
- Worked on NiFi data Pipeline to process large set of data and configured Lookup’s for Data Validation and Integrity
- Worked with Devops team to Clusterize NIFI Pipeline on EC2 nodes integrated with Kafka running on other instances using SSL handshakes in QA and Production Environments.
Minimum years of experience*: 5+
Certifications Needed: No
Responsibilities you would expect the Subcon to shoulder and execute*:
- Candidate should have enough experience in Kafka, Nifi, MongoDB
Interview Process (Is face to face required?) Yes
Does this position require Visa independent candidates only? No