Senior Software Engineer Resume

SUMMARY

Senior BigData Architect having 15+ years of experience in IT and Software development and predominantly in Web Applications, Databases, BigData and Analytics with capabilities of performing in multi disciplinary teams and technologies, including product, application and solution development, planning, system analysis.
Over 7+ years of experience in designing and developing POCs and solutions in Big Data Engineering space as Senior Data Engineer using eco system such as Hadoop, Spark, Hive, HBase, Storm, Elastic Search (ELK), Kafka, Redis, MapReduce, Sqoop and Pig
Extensive hands - on experience with Spark with Python (PySpark) and Scala, SparkSQL in building statistical models and analysis
Working experience with data platforms HDP, HDInsight, AWS, Azure Databricks and Azure Data Lake
Virtuous knowledge in Security and Authentication Azure AD Service, Kerberos, OAuth2, Spring Security
Expertise in designing and building Web Application using REST APIs in J2EE (Spring Boot) and Python DJango, Flask and integrations such as Messaging systems, Event Hub, Mail Notification services, Security and Storage, etc.
Solid knowledge in product development and deployment

Core Competencies

Design Data Modeling, Data Analysis, ETL
Analytics with Predix, HDP, HDInsights, Confidential, Confidential Tivoli, Pentaho Data Integration & Kettle Transforms
ETL (Pentaho Data Integration), SSIS-CDC, Apache ActiveMQ, MSMQ, GlassFish JMS Sever, WebSphere App Server, Tomcat Server,
Distributed Systems, MySQL, MSSQL, Oracle,PostgreSQL
Automation Tools - Jenkins, Maven, Ant, Git, JMeter, Selenium Webdriver
BI Tools - Eclipse BIRT, Confidential Cognos,

PROFESSIONAL EXPERIENCE

Confidential

Senior Software Engineer

Responsibilities:

Design architecture, Data Modeling of product, develop framework and Deploy application on AKS cluster.
Implement complex business rules as extendable python and PySpark methods to run rules on Databricks cluster using databricks-connect.
Identify potential failed cases and notify Data Analyst to validate missing/dirty data by scheduling jobs on AirFlow and co-ordinate with vendor to address failures.
SparkML models for finding anomalies in data

Confidential

Back-Test

Responsibilities:

Understand new financial strategies given by Business, Quant and Data Analysts.
Implement complex to simple pricing calculations and estimate returns based on given list of securities and strategies.
Calculate statistics such as Total Return, Daily Sharp, Max Drawdown, Loopback Returns etc.
Create reusable Python libraries for reconciliation, calculate adjusted prices according to volume and back test dates.

Confidential

Sr. Data Engineer

Responsibilities:

Designed and developed AxCore platform solution for Spark analytics to build and run Distress and Ranking models on distributed environment.
Implementation of FlyFwd to forecast data for flights based on history data, stitched data in Aviation data lake, to build Core Analytics and OneFleet analysis on predicted data.
A multi-layered distributed system building and enabled as a service on Predix IoT Analytics Platform.

Confidential

Sr. BigData Developer

Responsibilities:

Developing DataSwarm PaaS application which is real-time event processing system, mechanism for integrating data, analysis on batch and real-time procedures across multi domain extractions built on Apache Storm- Kafka-MongoDB tech stack.
Focused on endowing with different Java, Python and SQL components to work with complex topologies which run on Apache Strom engine.

Confidential

Team Lead

Responsibilities:

Involved in design and development of various products such as Online-Ad Server Tracking, WhamTech External Index and Query, EARN Starter Account, Confidential Engine Agent monitoring and reporting, SolidcoreLite file system change tracking.
Data migration to MSSQL Server, Oracle, PostgreSQL and DB2 using Pentaho Data migration Interface using DDL scripts and kettle transformations.

Confidential

Embedded Developer

Responsibilities:

Involved in implementation and testing of serial driver and registering the driver with Vxworks I/O system API functions.
Programming NetFilters for filtering and transferring incoming packets based on the policies and hooks assigned to it.