SUMMARY:

• 11 years of experience in design and development application in open source and big data
• Excellent knowledge and experience working in Bigdata Platform Parquet, Spark, Hadoop, HBase
• Created roadmap and build prototype for data lake
• Experience developing data ingestion pipelines Batch and Streams
• Implemented NoSQL capabilities in PostgreSQL Jsonb, Cassandra, AWS Athena, DynamoDB, Hbase
• Experience building resilient, scalable, distributed systems using Reactive Platform
• Design and developed search application using elastic search and solr
• Design and developed data pipelines for both stream and batch processing
• Working knowledge of ETL Tools, Talend, and SSIMS
• Experience developing asynchronous and synchronous web - based application
• Experience architecting and designing micro services in Kubernetes and docker swarm
• Design and developed micr service in spring boot and dotnet core
• Design and developed single page application in react and angular
• Working knowledge of devops tools GitLab-ci, Jenkins, octopus
• Good Understanding of architectural patterns like Domain Modelling, CQRS, Event Sourcing, Micro service Choreography, Read optimized storage, Lambda architecture
• Expertise in creating Conceptual Data Models, Process/Data Flow Diagrams, Use Case Diagrams, Class Diagrams, State Diagrams, Sequence Diagrams & Activity Diagrams.
• Experience working in Agile and Scrum methodologies

DEVELOPMENT STACK:

Language: Java, Scala, Python, Dotnet core

Big Data: Spark, MapReduce, Hadoop, HBase, Hive, Pig, Sqoop, oozie

Web services: SOAP/REST

Messaging: Active MQ, Rabbit MQ, kafka

MVC: Struts, Spring

ORM: Hibernate, JDBI, dapper

EIP: Camel

Scripts: Bash, Perl, UI, React, Angular, SAAS, Bootstrap

Application/Web Server: Apache tomcat, Kestrel, Ngix, Apache httpd

Operating System: Linux, Windows

SCM: Git, TFS, SVN

IDE: Eclipse, Intelij

EMPLOYMENT HISTORY AND WORK EXPERIENCE:

Confidential, Milwaukee

Open Source Engineer / Architect

Technology: Java, dot net core, Python, Solr, PostgreSQL, Spring 5, Spark, Kafka, Jenkins, Liquibase, Maven, Ansible, Zabbix, Terraform, Vault, AngularJS, TFS, Git, Eclipse, Intelij, Windows, Linux

Responsibility:

• Migrate on Premise Application into aws cloud Database, Web based application
• Setup cloud infrastructure IAAS using Terraform scripts.
• Part of product development team design and developed ecommerce application, designing database, data access layer search layer
• Designed and developed dotnet core application and packaged the code as docker images
• Used gitlab ci as ci/cd pipeline
• Implemented Microservice using SpringBoot as proof of concept for document search
• Implemented JWT framework for Authentication
• Created ci/cd pipeline using git/Jenkins/octopus
• Part of Database Engineering Team, was given the responsibility to build database as service using postgresql
• Created roadmap on building database as service.
• Designed Transactional layer over Cassandra using Apache Ignite Distributed cache as proof of concept for demonstrating high availability low latency using Nosql capabilities
• Evaluated PostgreSQL, identified benchmark requirements, developed automatic creation and deployment strategy, implemented monitoring, backup and restore.
• Identified candidate application and developed strategy to migrate to new platform DBAS
• Created architecture for CI/CD using Git, Jenkins and Liqiuibase for application using DBAS
• Developed Spark Streaming for ingesting RabbitMQ message, once consumed, messages are stored in Parquet format to leverage columnar storage capabilities
• Used Impala to Query Parquet Files
• Created Architecture for document search using Solr cloud
• Developed architecture for file search using Apache Manifest and Solr Cloud
• Created custom schemas and custom indexer for faceted searching in solr
• Worked on developing ETL for Data Mart used for Pricing quotes, create a working prototype on migrating data mart build from SQL Server to Big data platform using Datalake concepts

Confidential, Allen, TX

Java Architect

Technology: Java, Guava, Akka, Spray-can, Play, Resteasy, Hadoop, Hive, Hbase, Pig, Oozie, Sqoop, Avro SVN , Eclipse, Windows, Linux

Responsibilities:

• Designed cluster aware asynchronous REST API application using Akka Actor Model as part of POC, the design involved using Akka Singleton Cluster Manager as Master actor, Master actor receives input from REST API using cluster client, Master actor publish input to Worker actor using DistributedPubSubMediator pattern.
• Designed catalog for Json Feed using Avro .
• Designed and Developed POC on JSON validation using Rhino JavaScript Engine, designed custom rules using parboiled
• Importing and exporting data into HDFS and Hive using Sqoop.
• Involved in developing Pig scripts to process the data.
• Involved in defining job flows.
• Experienced in monitoring the logs.
• Experienced in running Hadoop streaming jobs to process terabytes of data in xml format.
• Load and transform large sets of structured, semi structured and unstructured data
• Responsible to manage data coming from different sources
• Developed Map Reduce Programs
• Involved in loading data from UNIX file system to HDFS
• Involved in developing Hive UDFs.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
• Involved in creating and bulk loading of data into HBase Tables.
• Assist with the addition of Hadoop processing to the IT infrastructure.
• Perform data analysis using Hive and Pig.
• Load log data into HDFS using Flume.

Confidential

Architect

Technology: OSGI, FUSE ESB, Apache CXF, spring, Hibernate, Active MQ, GIT, Eclipse, Windows

Responsibilities:

• Role Involves Designing bundles for Business/ Confidential / Messaging Layer, involves Message Routing EIP and exposing services as REST end point.
• Created POC message aggregation and routing, identified best practices for integrating J2EE legacy application suites to OSGI container Wavemaker (ADF), JBPM(Workflow),
• Written article on how to integrate J2EE application in OSGI using spring DM and Pax, created High Level Design Document. For SIP, Customized pax-jetty bundle to facilitate war deployment
• Provide Architecture Solutions SIP Service Integration Platform ADF +JBPM integration
• Designed OSGI Bundles for Data Access Layer
• Exposed Connection Pool as a Service in OSGI Layer
• Designed and Implemented Architecture for JPA layer in OSGI
• Created design specs for FASAM Facilities and Asset Management,
• Designed Declarative Transaction using spring Transaction feature
• Customized Felix Container to facilitate Automatic bundle deployment during runtime
• Designed Multi Tenancy in wavemaker Application Development Framework
• Created POC to integrate third party tools into Fuse ESB, customized DOJO framework to enable session management in Wavemaker projects
• Automated project deployment into Catalina service, combining Ant zip and Felix bundle install features
• Created JAXB context to customize unmarshalling of messages consumed by wavemaker.
• Integrated j2ee Wavemaker, JBPM, BIM application suite to OSGI Fuse ESB
• Created Entities for FASAM Facilities and Asset Management
• Created EIP rules for ActiveMQ and REST end points using Camel in Fuse ESB

Confidential

Technical Lead/Project Manager

Technology: Java, JSF, web services Clear Case 7.0, IDE, RSA Windows, CICS

Responsibilities:

• Project Transition from onsite to offshore
• Set up DEV and ST Environment Created work book supporting environment requirements Workbook for front-end IIS, App server Web sphere 6.1, URL Access, IP Security,
• Created copy books for CICS region to facilitate java program to call routines running in CICS regions
• Created High Level Design Document to Implement Random Security Popup for MIS Application Customer Preview
• Created automated build process for CAO Customer account opening war deployment
• Written Junit test cases
• Created JCA Components using WSAD IE
• Created High Level Design Document to implement Java Web services Jax-RPC • Project Delivery Coordination and Metrics Reporting

Confidential

Module lead

Technology: Java, PL SQL, Oracle9i, 10g, shell scripts ksh, spring, Hibernate, web services StarTeam, sub version, Eclipse, Solaris, Windows

Responsibilities:

• Created Cursors and Triggers to facilitate Middleware components data storage and to facilitate Transformations to stage Environments
• Created Bulk Loading scripts to facilitate data loading
• Created Materialized views for weather forecasting applications.
• Created PL Sql Functions.
• Executed sql plans to fine tune query’s
• Enhancements Development and Testing
• Created Business Layer and Confidential layer, Implemented Spring IOC feature
• Created Java remote object to facilitate flex calls to Business Layer
• Created Automated deployment script using Maven and Hudson to support continuous integration
• Created Hibernate Pojos for Entities
• Created Associations and Inheritance mapping for pojos
• Created spring based Hibernate session factory and used IOC to inject the session Factory
• Created logging aspect using spring AspectJ
• Created spring based declarative transaction for Confidential layer