SUMMARY:

• Experienced software engineer with 13+ years in the software industry with Confidential developing, architecting and providing complex solutions for major Telecom companies.
• Over 4+ years of Technical Lead/Architect experience and have ability to co - ordinate multiple development teams for initiating, facilitating and delivering the projects on Big Data platform for building and designing large scale ETL jobs/transformations on ~30+ PB of bulk data.

LANGUAGES AND TECHNOLOGIES:

Big Data / Hadoop: HDFS, Hive QL, Apache Spark, Sqoop, HBase, Kafka Streaming, Spark Streaming, PIG

Languages: Java, Scala, Python, EJB, JavaScript, Shell Scripting, C Language, Sybase PowerBuilder

Cloud: AWS S3 SDK, AWS S3 CLI

Database: Oracle

Markup languages: XML, HTML

Platforms: Unix and Linux

CI/CD: SVN, Code Cloud, X-trac

EXPERIENCE

Confidential

Software Development Specialist

Responsibilities:

• Working with 300+ data sources to consume the data into Confidential & Confidential Data Lake platform which includes data like Setup box customer’s usage, viewership event data, account/profile level master data sets, Confidential & Confidential streaming apps DTVNOW and WTCH TV clickstreams, app diagnostics, video session quality details, voice commands from Alexa devices and so on.
• Lead Architect for 10+ ETL jobs on Spark framework for generating large extracts prepared from 100+ data sources of size ~30 PB volume and published them to AWS S3 buckets using AWS SDK for business clients like BI teams, data science teams.
• Lead Architect for designing Blue Print ad-platform application based on historical customer viewership and billing data which enables Confidential & Confidential business to allocate advertisement slots on Direct TV Setup boxes for companies who approached for advertising their products.
• Confidential & Confidential DTVNOW/OTT data analysis: Designed and developed a Viewership platform on the core data sources available in Data Lake for generating every hour/day reports to Confidential & Confidential business which enabled them to build Ad-Platform, better marketing products and build a Machine Learning model for better customer experience.
• Reduced time to ingest ~300 TB data into HDFS by 75%, by creating a multi-threaded application in Scala
• Increased the performance for existing ETL jobs by 40%, by migrating the jobs from Apache PIG to Spark framework which released the dependent jobs on time.
• Implemented Spark streaming ability to consume the data from Kafka topic which enabled the real time data availability for Data lake users and retired the EOD SQOOP jobs for ingesting the data from traditional RDBS sources.
• Designed and developed processing pipeline in Spark and Java to handle Billions of streaming app viewership data which comes in file formats like ORC, SNAPPY, PARQUET, AVRO, JSON, CSV and TXT.
• Designed and developed a workflow manager in Scala & spring framework to handle hierarchical dependencies among 200+ jobs to provide complex extracts involving Confidential & Confidential customers’ usage & viewership data for Content supplier payment management team who generate invoice for Studios like Warner Bros, Disney, HBO etc.,
• Collaborate with data science team to consume new data sources for marketing analysis, advertisements, mobile app crashes.
• Actively worked with Cloudera/Hortonworks team during Hadoop 3.1 upgrade. Analyzing detailed level impacts due to HIVE client retirement and major spark changes.
• Architect End-to-End solution for ingestion and ETL pipelines considering SPI requirements by applying FPE encryption and hashing technique on sensitive attributes.
• Major Highlights:
• Worked as a Development Specialist for Canada major telecom giant Bell for billing software.
• Participated in the assessments for new business requirements like Mobile Installment option, Connected Cars etc.
• Designed and developed a module for Canadian postal address validations by migrating the legacy library to open source library which saved licensing cost to the company.
• Designed and developed the solution for Mobile installment option and integrated the design with existing architecture.
• Provided an overnight back-end fix for an issue occurred in Bell.ca site which blocked large customers in accessing/buying new plans/features.
• Debugged and provided a fix for a Core dump generated during Credit check evaluation for due to Equifax interface changes which reduced the subscriber activation, device upgrade failure rate in the stores.
• Implemented API caching mechanism for reference table data which reduced lot of I/O to database.
• Implemented XML bridge application which gives ability for the 3rd parties who does not have capability to invoke API but can place API call details in XML format on to MQ queues.
• Designed and implemented an API simulator for debugging and reproducing the exceptions occurred in day-2-day production activities.
• Direct client facing model for providing best support on production issues occurred during the deployment and normalization period.
• Acted as UAT lead for CSM & API application teams and managing on-site and offshore resources to clear the gaps in the design and development.
• Responsible for Status Reporting and single point contact for client escalations and issue resolutions.

SENIOR SUBJECT MATTER EXPERT

Confidential

Responsibilities:

• Developing complex parts of various Confidential telecom product features and modules like Device upgrade, Number portability features, Subscriber contracts etc.
• Developed an application Mass Campaign Orchestrator (MCO) which allows business to bulk subscriber activations, plan changes without login to GUI.
• As part of the Wireless Number portability development, designed and implemented a daemon process which process the messages in/out messages near real time for subscriber port completion process.
• Adding enhancements to GUI screens for better Customer care Reps experience.
• Fixing bugs during UAT & ST phases.
• Implemented a data processing pipeline in C and Pro*C for the activities received from front-end platforms.
• Debugging the core dumps created during the production and analyzing the cores and providing the fix.
• Fixing bugs and supporting testing activities

SUBJECT MATTER EXPERT

Confidential

Responsibilities:

• Designing and developing major modules for Confidential ensemble product for a Canada telecom giant BELL.
• Developing the solutions in C language, Pro *C, Shell Scripting and Sybase PowerBuilder.
• Fixing bugs/defects during ST/UAT phases.