Data Ingestion Engineer Resume
SUMMARY
- Functionally strong & technically sophisticated Sr Data Engineering Analyst professional with 9+ years of career, reflecting strong liaising qualities with hands - on Big Data, Spark, and Hadoop Eco System.
- Hands on Experience on Java, Python and Scala technology.
- Certified in Associate Google Cloud Engineer (GCP).
- Good Knowledge onHadoopClusterarchitectureand monitoring the cluster.
- Hands on Experience in MapR and Hortonworks Hadoop Distributions.
- Experience in importing and exporting data usingSqoopfromHDFSto Relational Database Systems and vice-versa.
- Hands on experience in Hadoop ecosystem components like HadoopMapReduce, HDFS, HBase, Hive and Sqoop.
- Scheduled workflow usingOozieworkflow Engine and Control-M Scheduler.
- Provide L2/L3 development effort.
- UsedMavento achieve source building framework.
- Hands on experience in application development using Java RDBMS and Linux shell scripting.
- Worked in Agile Scrum process.
- Proactively, initiate, develop, and maintain effective working relationships with team members. Coordinate with all team members, including 3rd party suppliers.
- Capable of understanding new Technologies and concepts quickly.
- Understanding Business Requirements, flow of application and working experience on Bug fixing.
- Having domain experience in Banking, Telecom, Health Care and Logistic (Value Added Services).
- Expertise in Sterling Commerce (Order Management System components), API’s and related Interfaces.
- Independently perform complex troubleshooting, root-cause analysis, and solution development.
- Well organized versatile, flexible, self-motivated team player with collaborative approach & team building skills with proficiency in grasping new technical concepts quickly and utilizing the same in a productive manner.
- Excellent interpersonal and communication abilities (both oral and written) and experienced in working with senior level managers, businesspeople, and developers across multiple disciplines.
TECHNICAL SKILLS
Big Data Ecosystem: Hadoop, MapReduce, Spark, HDFS, Hive, HBase, Sqoop.
Certification: Associate Google Cloud Engineer (GCP)
Programming Languages: Java, Python, Scala and UNIX Shell Scripting.
Hadoop Scheduling Tools: Oozie, Control-M
FrameWorks: Hibernate, VAADIN.
Tools: Eclipse, Putty, RAD, Intellij IDEA
Databases: MySQL, Oracle
Platforms: Windows 7, Linux (Red Hat 7.3)
PROFESSIONAL EXPERIENCE
Confidential
Data Ingestion Engineer
Environment: Hadoop Cluster, Unix, HDFS, Python, Hive, Sqoop, YARNControl-M, GCP, Jenkins, Git Hub.
Responsibilities:
- Responsible for Code changes, research and develop solutions for challenging new or unknown issues.
- Working on the Incidents raised by the L1 team and provide solutions and implementing the Change Request.
- Involved in creating workflows through Control-M.
- Developed Shell Scripts to automate the Source specific daily activities.
- Need to take care and JIRA assigned Incidents.
Confidential
Sr Data Engineering Analyst
Environment: Hadoop, Spark, Java, Scala, Oozie, HDFS, Hive, HBase, Sqoop
Responsibilities:
- Handling 8 Sources and taking complete responsibilities on the sources
- Working on the Source specific Incidents and responding to the Customers
- Involved in creating workflows in Oozie.
- Developed Shell Scripts to automate the Source specific daily activities
- Developed different Oozie Actions to configure the workflows.
- Developed Kibana dashboards to monitor and reduce the manual task using Spark, Java and Scala.
Confidential
Java Developer
Environment: Vaadin, Spring, Hibernate, and SQL Server.
Responsibilities:
- Coding, involved in fixing bugs and testing.
- Application Maintenance and support.
- Unit testing and rectifying the defects.
- Responsible for Daily Status Reports.
- Working as a Sprint Basis.
Confidential
Java Developer
Environment: Spring, Hibernate, Web Service Linux and Oracle.
Responsibilities:
- To analyze various client requirement
- Coding and Unit Testing
- Unit testing and rectifying the defects.
- Responsible for Weekly, Daily Status Reports.
- Worked with Testing team for testing and resolve defects
- Working as a Sprint Basis.
Confidential
Java Developer
Environment: Java, JSP, Struts 1.2, Servlets, Oracle 10g.
Responsibilities:
- Analysing the Code Change Request and fix.
- Finding out the defects and providing the solutions for them.
- Determining the change/alter/new code that is required or what modifications to existing software are needed.
- Unit testing and rectifying the defects.
- Responsible for Weekly, Daily Status Reports.