OBJECTIVE:

To secure challenging and responsible job that matches my skill s, abilities , expertise and provides scope to achieve goals of the organization as well as career growth .

PROFESSIONAL SUMMARY:

• 13 years of IT experience 1. Application development experience in Big Data 2. Design, development, Implementation and integration experience in Telecom OSS and BSS Domain ( Confidential, InterOperator Billing and Provisioning).
• Over 4 years of exclusive experience in Big Data technologies like Hadoop, Hive, Impala, Sqoop, Spark, Kafka, Map Reduce and Oozie.
• Having strong hands on experience in application development using Hadoop Ecosystem components such as Spark with Scala, Spark Integration with Kafka,HDFS, HIVE, Oozie and Sqoop.
• Around 10 months of working experience in Amazon S3 and Redshift, Spark integration with S3 and Redshift.
• Worked with Cloudera 5.13.x components and HDP 2.6.4 components.
• Knowledge on NoSQL databases like Postgres, HBase and Cassandra.
• Strong experience in Installation, Configuration, System Administration and trouble Shooting of Confidential, Wipro OSSSmart, OCOMC (Oracle Confidential )
• Experience in InterOperator billing settlements using Subex Concilia.
• Working experience in Oracle Order and Service Management in handling the order flow.
• Proven Customer Management skills ( Client Interfacing experience in meeting the Service Level Agreements in delivery).
• Experience in Agile Scrum Methodology and ensuring delivery of by weekly sprint releases from Solution Team with a focus on guiding the team members.
• Part of core end - to-end architecture team in supporting across the telecom projects on crisis.
• Good functional and integration understanding of Confidential with various telecom network elements (IMS,WiMax, MSC,HLR,IN etc) and downstream applications like Billing,DWH,Fraud management etc.

TECHNICAL SKILLS :

Operating Systems: Linux/UNIX, Solaris and Windows

Programming Skills: Scala, Core Java, C/C++,DUP,NPL and PL/SQL

Development Tools: IntelliJ IDEA, Eclipse, JDeveloper

Scripting Languages: UNIX shell scripting

Big Data Analytics: Hadoop, Spark, Kafka, Cassandra, Hive, Hbase, Sqoop,Oozie, HDFS,S3 and nifi

Database: Oracle,MySQL,Redshift,PostgreSQL,HBase and Cassandra

Build Tools: SBT, Maven

Code Management Tools: SVN, GIT version control tools

Domain Knowledge: Telecom, Finance and Hospitality

Confidential Frameworks/Products: OCOMC/ONM, Ericsson Multi Confidential (EMM) and OSSSmart

InterOperator Billing Product: Subex Concilia 6.3

Provisioning Products: OSSSmart, OSM

PROFESSIONAL EXPERIENCE:

Confidential, Mclean, VA

Senior Spark Scala developer in ETL

Responsibilities:

• Responsible for building scalable distributed data solutions using spark,scala and Hadoop technologies
• Transform the data using big data tools like Spark, Scala, Hive and load into Redshift Tables which will be consumed by the Reporting Team to report the data in the consumable format and for the use of analytics
• Developed common process to bulk load raw HDFS files into dataframe
• Developed common process to persist dataframe into S3, Redshift, HDFS, Hive
• Created hive External tables as per requirement and defined with appropriate static, dynamic partitions and bucketing, intended for efficiency.
• Creating business on books, jobs to forecast Hilton corporate business based on snapshot date
• Prune the ingested data to remove duplicates by applying window functions and perform complex transformations to derive various metrics.
• Used oozie scheduler to trigger spark jobs
• Created UDF s in spark to be used in spark sql.
• Performed performance tuning of spark jobs using broadcast joins, correct level of Parallelism and memory tuning.
• Analyze and define client's business strategy and determine system architecture requirements to achieve business goals
• Used Maven as the build tool and GIT for code management.
• Worked with admin team for the deployments,job runs, job scheduling, job resource management etc

Confidential

Responsibilities:

• Analyze and understand the data generated by source systems, which includes various file types(csv, xml fixed length e.t.c), RDBMS tables and EDRs/transaction details generated by Fulfillment Systems.
• Designed and developed data injection processes using SQOOP and SPARK SQL. Importing & Exporting Data from Oracle Database to HDFS and HIVE.
• Involved in writing scripts and Cron jobs to pull processed transaction data from Confidential system to HDFS Landing area(Data lake) .
• Designed and developed Spark-Streaming to read continuously generated data in different formats(ASCII) from various Fulfillment systems,perform transformations using Spark-Core and Spark-SQL,store output data into Data Mart like HBase,RDBMS… which is furth er used for reconciliation process.
• Designed and Developed Spark-Streaming to perform necessary transformations and actions on the fly for building the common learner data model which gets the data from Kafka in near real time and Persists into Cassandra.
• Created Hive Managed and External tables using partitioning and bucketing in Hive and loaded data.
• Involved in Code Deployment for various environments using git, perform smoke test before releasing the code to QA Team for UAT.

Confidential

Responsibilities:

• Analyze and understand the data generated by various Ericsson core network elements(Charging components CCN,SDP,AIR & IMS components MTAS etc)received at Confidential System.
• Involved in writing shell scripts and cron jobs to pull data from remote file system(EMC Storage) to HDFS staging area.
• Designed and Developed Spark jobs to parse and validate the raw input data and applied transformations/filters/business logic (which involves correlations and aggregations)and write output data to NoSql DB.
• Created Hive databases, views, Managed and External tables with partition and buckets in Hive and loaded data.
• Designed Oozie workflow with various Spark, HIVE actions, and scheduled the workflow with time-based Oozie Coordinator.

Confidential

Responsibilities:

• Analyze the PRTS generated network performance data for various devices/platforms which are connected to its network.
• Involved in writing shell scripts and cron jobs to pull data(which is pushed by Confidential System) from landing area
• Involved in writing hive scripts to parse data and store in external table,aggregate data using managed tables
• Involved in aggregating data into 5 minute, 10 minute, Qhourly, Hhourly, Hourly, Daily, Weekly and Monthly data and store in Teradata DB