Application Development Team Lead/ Big Data Engineer Resume

SUMMARY:

Multifaceted technical professional with 10+ years’ industry experience
Technically sophisticated Software Engineer having 10 years of overall industry experience with 5+ years’ hands - on experience in designing and developing data pipelines on Hadoop based platforms.
Proficient in Hadoop, Spark (Core, SQL, Streaming), Kafka, Hive, Flume, Sqoop, Oozie, and SQL.
Proficient in Java (1.8), Python 3.x, and Bash.
Good hands-on experience in Agile (Scrum) methodology for software lifecycle and delivery management.
Broad knowledge and understanding of data engineering, integration as well as warehousing.
Knowledge of machine learning techniques for regression and classification.
Knowledge of DevOps tools for continuous integration.
A fast learner and an exceptional problem-solver. Outstanding interpersonal and communications skills, leveraging strengths in team leadership, cross-team collaboration, stakeholder communication and project management.

TECHNICAL SKILLS:

Software: Hadoop MRv2, Spark 2.2.x, Hive, HBase, MySQL, Sqoop, Flume, Kafka, Oozie, Hue, Ambari

Language: Java 1.8, Python 3.x, Bash

Applications: JIRA, Confluence, Git, SVN, Maven

PROFESSIONAL EXPERIENCE:

Application Development Team Lead/ Big Data Engineer

Confidential

Responsibilities:

For a large Telecom company in Australia designed the E2E data processing pipeline for customer interaction analysis to get both long and short-term insights into business performance. Designed and developed applications like:
Creating customer journeys to understand customer interaction pattern - Pulling data from inbound Kafka queues, FTP servers to be processed with Spark in batches plus in near-real time streams, for saving into HDFS along-with pushing to outbound Kafka queues for downstream consumption, to Hive for adhoc queries.
Deriving Customer Lifetime Value, an important metric used later in customer churn prediction - Pulling data from inbound Kafka queues, FTP servers to be processed with Spark in batches, for saving to views in Hive.
Trouble ticket data analysis to understand time and efforts to resolution for categories of trouble tickets - Pulling data from inbound Kafka queues, FTP servers to be processed in Spark as batches and saved to views in Hive as well as exported to FTP as delimited text.
Applied Lambda architecture concepts to re-design the pipelines to in corporate streaming data analysis.
Led 5-member team following the Agile Scrum, serving both as scrum master and data engineer. Provided technical mentorship on Spark; created tactical plan for applications’ development.
Received in machine learning techniques for regression and classification; also in DevOps methodologies, particularly Jenkins.
Spearheaded the customer dialogue analysis which helped client’s marketing team to create targeted advertising campaigns.
Delivered trouble ticket analysis application which became useful in reducing truck-roll effort and expenses for the client by 7-10%.
Received a second ACE for high performance and strong team skills.

Senior Software Engineer/ Big Data Engineer

Confidential

Responsibilities:

For a web content delivery service in USA, designed and developed real-time metrics on customer subscription data - Pulling data from FTP servers using co-located Flume agents to be processed with Hive QL, for storing in partitioned Hive tables.
For a Telecom service provider in India created applications to produce metrics on network device statuses to allow for network health monitoring - Pulling data from FTP servers using co-located Flume agents, extracting device information from MySQL database using Sqoop to process in large batches using Hadoop MRv2 applications running over YARN cluster. Processed data stored in partitioned Hive tables for ad-hoc querying.

IT Analyst

Confidential

Responsibilities:

Played an integral role as Lead Analyst and Senior Engineer for prominent overseas client, understanding business needs and directing applications migration from legacy to BPM, mining functional requirements and documenting extracted requirements - This included analyzing 1) code to extract functional behavior, and 2) business data to understand the current state of the legacy system under use.
Prepared full-scale test plan, ensuring functional testing results aligned with project requirements. Collaborated with cross-functional teams, providing support across development and QA phases.
Provided support for implementation and maintenance of applications, developing technical solutions and deploying applications aligned with business needs.

Systems Engineer

Confidential

Responsibilities:

For a leading Telecom company in North America developed custom applications for Mobile Switches (MSCs).
Led 3-member team, developing independent modules for large-scale migration project.
Directed software transition project to Agile from Waterfall methodology.

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship