Sr. Big Data Cloud Architect Resume
Denver, CO
SUMMARY
- A result oriented leader with proven extensive experience in POC and Product Development using next generation technologies.
- Self - driven and effective leader with experience in solving problems with best available architectural patterns with best technology stack for variety of business domains.
- Vast experience with many industry domains and variety of problem solving skills using right tools and methodologies.
- A collaborative with proven result oriented Information Technology professional with 20 years of experience in Software Architecture, Design, Enterprise Integration Patterns (EIP), Enterprise Application Integration (EAI), Several RDBMS Databases, Multiple Big Data/ NoSQL databases along with Scala/Java/J2ee/SMACK stack and many software development methodologies across multiple domains.
- Exposure to Machine Learning and AI.
- Expert on OpenShift/Kubernetes and complete end to end product life cycle along with containerizing several software stacks including big data technologies.
- Involved in Research of next-generation technologies, particularly cloud virtualization and containerization and worked on several prototype projects involving clustered container orchestration and management: OpenShift/Kubernetes and AWS ECS.
- Experienced in Cloud architectures: private and hybrid clouds development (creating private cloud architectures on both: system and software level), custom services, cloud technologies: OpenShift, AWS, Azure, Docker.
- Skilled in cloud computing like open stack, AWS, Google Cloud etc., information management, application development, and virtualization. Demonstrated mastery in evaluating requirements for business application integration and service activation.
- Many years worked on Open source technologies and frameworks. Known for using the right tools when and where they make sense and creating an intuitive architecture that helps organizations effectively analyse and process terabytes of structured and unstructured data.
- Demonstrated several POC’s and implemented many production systems end to end. An excellent expert with public relations, problem-solving and leadership skills, combined with my deep knowledge of engineering and architectural codes in communicating across organizational levels and with cross-functional teams to drive shared vision and foster makes me a highly valuable employee and team leader.
- Architected and designed many Software Systems from high-level concepts to Implementation including testing / staging to production servers and their maintenance.
- Research of next-generation technologies, particularly cloud virtualization and containerization
- Worked on several prototype OpenShift projects involving clustered container orchestration and management.
- Contributed and developed automation application of Kubernetes clusters to the Kubernetes project
- Executed data migration process from many data sources to Big Data platform like Cassandra, hbase redis, Mongo DB etc.
- Integrated Cassandra as a distributed persistent metadata store to provide metadata resolution for network entities on the network.
- Architected and Implemented Cassandra based systems using Apache Cassandra and Datastax.
- Perform large-scale data migration experience such as data migration audit, reconciliation and exception reporting from variety of sources to big data platform.
- Developed enterprise applications using Scala.
- Involved in building scalable analytics, clicks event processing system using Kafka, Scala, Akka actors for handling heavy loads of asynchronous events.
- Distributed Application Development using Actor Models for extreme scalability using Akka.
- Implemented end-to-end ELK based log analytics system for ecommerce platform.
- Highly experienced with Implementing Business Intelligence systems and Implemented analytic systems.
- Architected and designed implemented analytics platform using Elastic Search/ Lucene.
- Implemented analytics / search platform Datastax Search, Datastax Analytics /Spark platform.
- Architected and did POC for analytics comparison using Datastax Enterprise Analytics and ELK platform.
- Implemented end-to-end solution for E-commerce using Kafka, Spark and Cassandra for heavy throughput application.
- Architected and designed
- Social Integrations like Facebook, Twitter, LinkedIn, and Google+
- Payments Systems like Google Checkout, PayPal and AWS
- End to End Software Systems and deployed into Data Center and Private and Public clouds
- Very High Volume Analytic Platform and Analytic Solutions
- Enterprise Applications using Enterprise Application Integration (EAI) and Enterprise Architecture
- Security for several Software Systems using Spring Security, Oracle OWSM security policies with Web services security, CAS Single-Sign on using RDBMS or LDAP and OAuth 2 etc.
- Architected, designed and implemented successfully Big Data/NOSQL Based Solutions, Big Data Productions Clusters and Big Data Based Systems using MR, Pig, Hive, Map Reduce and HBase.
- Worked on Data handling including RDBMS, ORDBMS, NOSQL and Big Data.
- Architected, designed Integration solutions and Integrated J2ee Based Systems / Open Source Systems with Big Data Hadoop Based Systems and Time Series databases developed on different platforms.
- Solid experience in Database Architecture, Modeling, Design and Implementation with Oracle, GreenPlum, MYSql.DB2 and SQL Server.
- Strong experience in Application Servers and Tuning and Clustering Experience with Web logic, Web sphere, JBoss, Karaf, Tomcat etc.
- Manage cross-program data assurance for physical data items in source and target systems.
- Managed varied technical development teams around the globe effectively with strategic objectives.
- Deep experience and knowledge of software design methodologies, information systems architecture, object oriented design, and software design patterns
- Passionate to continuously involve, explore and experience many new technologies and new concepts in the Software Industry.
- Spark ML, Tensor Flow, Akka Stream, Spark Stream Machine Learning Model development.
TECHNICAL SKILLS
Core Skills: Java, Scala, Ansible, Python, Dev-Ops, OpenShift, Kubernetes, Docker Data Center.
Languages: Java, Scala, Ansible, Python
Web Technologies: Spring Boot, Play Framework, AngularJS.
Big Data /NOSQL: Cassandra, Hadoop, Redis, Mongo DB, Neo4j, Historian Time series DB
Databases: Oracle, Green Plum and MySQL, SQLServer, Historian Time Series
Open Shift: Red Hat OpenShift Container Platform, Kubernetes
App/Web Servers: Web Logic, Apache Tomcat, Web Sphere, Karaf and Jboss
Operating System (OS): Windows, UNIX, Linux, MAC, AIX
Source Control: Git-Hub, SVN, CVS, VSS, Perforce, Junit, Star Team, Code Guide.
Frameworks/ Design Patterns: Spark, Play, Map Reduce, Struts, Spring, Spring Security, OAuth2, Hibernate and IBATIS.
Build Tools: Ant, Maven, Gradle, Hudson, and CI Tools
Reports/Reporting Tool: LOGIXML, Crystal Reports
PROFESSIONAL EXPERIENCE
Confidential, Denver CO
Sr. Big Data Cloud Architect
Responsibilities:
- Deployed ELK stack into DDC for managing orders and patients data to provide better search capabilities.
- Reviewed strategies for increasing development team efficiency and consistency with container platform.
- Implemented a centralized logging system using log stash configured as an ELK stack
- Architected, designed and implemented No SQL based databases like ELK, Kafka layers which are critical components of Confidential which needs to be containerized and requires yaml solutions for OCP.
- Developed Spark ML and Akka Stream, Spark Stream for Pipelines and developed Model for machine Learning.
Environment: Cloud frameworks, DDC, Spark, Scala, Akka, Play, Red Hat Linux, ELK Stack, Zookeeper, Kafka, Docker, Monitoring tools, SMACK stack.
Confidential, San Jose CA
Sr. Big Data Consultant / IT Architect
Responsibilities:
- Vendor relationship, technical integration and development activities on integrating big data products into Confidential platform.
- Worked with Vendors and initiated integrating products like DataStax / Confluent / ELK stack into Confidential
- Worked on Reference Architecture for Confidential platform for DataStax Cassandra / Spark, Confluent Zookeeper, Kafka, ELK products into Confidential platform using OpenShift Container Platform (OCP)
- Performed Cassandra performance tuning and cluster setup using OCP yaml deployment process.
- Worked on Cassandra data modeling recommendations, back up restore best practices for production Confidential platform.
- Performed container adoption for big data and messaging stack into OCP / Kubernetes.
- Involved in Building and configuring AWS Servers required for the projec t.
- Provided gap analysis and preliminary framework for container adoption strategy.
- Worked with development workflow and making recommendations to best utilize OpenShift Container Platform, IDEs, and deployment process OCP CLI tools.
- Reviewed strategies for increasing development team efficiency and consistency with container platform.
- Implemented a centralized logging system using logstash configured as an ELK stack
- Worked with Akka, Scala, Play Framework for developing actors.
- Involved in building a scalable analytics, clicks event processing system using Kafka, Scala, Akka actors for handling heavy loads of asynchronous events.
- Extensively used Akka actor architecture for scalable & hassle free multi-threading. Millions of activity messages per second were handled very easily by the actors by propagating the messages to appropriate child actors in asynchronous or synchronous fashion.
- Did POC for ELK for open stack and used Mirant is open stack to perform POC’s
- Converted requirements to POC and demonstrated to Executive management and cross teams.
- Converted POC to production including Deployment production planning and Capacity planning.
- Design and demonstrated several Proof of Concepts (POC for OpenShift / Kubernetes platform.
- Architected and implemented/recommended the best for Cassandra cluster and software hardware configurations plus recommended best compaction strategies suitable for Confidential .
- Chatbot Architecture and Integration with Back end systems.
- Spark ML, Akka, Scala Machine learning Models implementation and moving to production .
- Collected high-level requirements for Impact analysis, developed and demonstrated POC to executive management and continuous development of system to the production.
- Architected, designed and implemented No SQL based databases like Cassandra, ELK, Kafka layers which are critical components of Confidential which needs to be containerized and requires yaml solutions for OCP.
Environment: Cloud frameworks, OpenShift Container Platform OCP, DataStax Cassandra, Solr, Spark, Scala, Akka, Spark Stream, Spark ML, Akka Stream, Akka ML, Play, Hadoop, AWS, Red Hat Linux, ELK Stack, Zookeeper, Kafka, Docker, kubernetes, Monitoring tools, SMACK stack.
Confidential, San Ramon CA
Sr. Big Data Consultant / Sr. Cloud Architect
Responsibilities:
- Worked on Intel lab for creating 20000 vm’s on 500 compute servers and recommended best configurations and solutions for database and messaging software’s used in open stack.
- Performed Cassandra performance tuning and cluster setup for Contrail SDN platform.
- Worked on Cassandra data modeling recommendations, back up restore best practices for production Confidential platform.
- Performed container adoption deep dives
- Involved in Building and configuring Red Hat Linux Servers using Kick Start server as required for the projec t.
- Provided gap analysis and preliminary framework for container adoption strategy.
- Worked with development workflow and making recommendations to best utilize OCP, IDEs, and yaml deployment process.
- Reviewed strategies for increasing development team efficiency and consistency with container platform.
- Implemented a centralized logging system using log stash configured for an ELK stack
- Involved in best monitoring tools for all the database and messaging software’s involved in Open stack platform in Intel lab as well as Confidential .
- Did POC for ELK for open stack and used Mirant is open stack to perform POC’s
- Converted requirements to POC and demonstrated to Executive management and cross teams.
- Converted POC to production including Deployment production planning and Capacity planning.
- Design and demonstrated several Proof of Concepts (POC) for Confidential particularly SDN and Open stack components.
- Architected and implemented/recommended the best for Cassandra cluster and software hardware configurations plus recommended best compaction strategies suitable for Contrail SND platform.
- Created POC for messaging software’s for Confidential using Kafka and RabbitMQ.
- Collected high-level requirements for Impact analysis, developed and demonstrated POC to executive management and continuous development of system to the production.
- Architected, designed and implemented No SQL based databases like Cassandra, ELK, Kafka layers which are critical components of Open stack / Contrail/ Confidential
Environment: Cloud frameworks, Open stack, Mirantis, Contrail, Cassandra, DataStax, Scala, Akka, Play, Red Hat Linux, MySQL, ELK Stack, Mongo DB, Zookeeper, Kafka, Spark, RabbitMQ, Docker, kubernetes, DB Monitoring tools.
Confidential
Sr. Big Data Consultant / Sr. Cloud Architect
Responsibilities:
- Worked on several modules and projects that involve gathering very high-level conceptual requirements.
- Executed data migration in coordination with management and technical services personnel.
- Maintained existing data migration program with occasional upgrades and enhancements.
- Converted requirements to POC and demonstrated to Executive management and cross teams.
- Converted POC to production including Deployment production planning and Capacity planning.
- Design and demonstrated several Proof of Concepts (POC) for ROAST.
- Involved in choosing Business Intelligence tools, Software Frameworks, technologies.
- Architected many layers of ROAST platform from end to end.
- Architected ETL components and data cleansing components for ROAST.
- Architected and implemented GRID framework for accessing Cassandra database.
- Architected and developed data connectors for several data sources including Horton works, Cassandra, Oracle, REST services.
- Participated in the development of strategic goals for leveraging big data.
- Install, configure and maintain ELK Stack Systems.
- Architect horizontally scalable solutions (terabyte scale or larger)
- Elasticsearch and Logstash performance and configuration tuning.
- Architected Messaging system for ROAST and depending systems using Kafka and RabbitMQ.
- Did Dashboard POC’s using Micro strategy BI tool connecting to several databases like Horton Works, Casandra, Oracle.
- Collected high level requirements for Impact analysis and developed POC, demonstrated to executive management and continued to develop system to the production.
- Architected, design and implemented No SQL based databases like Cassandra and Horton works Hadoop clusters.
- Design and developed Cassandra key spaces, tables.
- Converted Rdbms tables into deformalized Cassandra structure and implemented Cassandra access solutions.
- Did capacity planning for apache Cassandra and Datatec Cassandra for NoSQL based clusters.
- Designed CI build tools and testing strategy to test multiple systems.
- Integrated code base with CI tools for build process using continuous Integration with maven, Jenkins with Code Check plugins like sonar etc.
- Data Migration for dashboard based projects from rdbms and many different sources to Cassandra.
- Architected and implemented Monitoring systems for Cassandra and Java based systems
- Designed dashboard, alerts and reporting for monitoring systems.
Environment: J2EE, Java, Cassandra, Datastax, Hadoop - Horton works, Micro strategy, Hibernate, JPA, spring3.1, Spring security 3.1, AJAX JSON, Tomcat, Weblogic, Oracle11i, Red Hat Linux, Git, Maven, SOA, BPMN, OpenStack, Zookeeper, Kafka, Spark, Astyanax, OpenStack, Zookeeper, Kafka, Spark, Spark ML, Astyanax, Spring Cassandra, Cassandra, Datastax, Mongo DB, Hadoop - Horton works, Micro strategy.
Confidential
Sr. Big Data Architect
Responsibilities:
- High Level Requirements gathering requirements for Impact analysis and developed POC, demonstrated to executive management and continuous development of system until production.
- Performed data cleansing enrichment and mapping tasks.
- Work with customers in gathering business requirements for data migration needs.
- Identified Technologies and Tools that can be addressed specific problems that are with Power and Water business of GE.
- Identified Entities and Designed Data Model for Platform and Solution.
- Architected to Incorporate Several Databases and Historian Time Series Database into Solution.
- Architected JMS that plays the crucial role of the whole system and receive the notifications of Data arrival and Platform and solution can work together to get Data from Different Data Sources based on Message Payload.
- Designed and Developed Clustered Messaging Broker along with Retry, Failover and Error Handling Strategies.
- Designed different layers of systems and developed the strategy to build systems and developed Testing strategy to test multiple systems with several simulators.
- Integrated code base with CI tools for build process using continuous Integration with maven, Hudson and bamboo along with Code Check plugins etc.
- Designed POC for creating BPMN Xml files using Eclipse Plugin and made it work for Activity Engine to Run the Analytics using Orchestrations.
- Architected and designed end to end Analytic Wrapper Interfaces and Core Common classes that can be used for several following Analytics and seamlessly work with Platform.
- Designed abstract spring components data retrieval strategies to get Data from Dynamic Data Sources using Dynamic Strategies and Designed Dynamic Conversion Logic of Unconventional Unstructured Big Data using OSA-CBM format.
- Designed System to Interact with Historian Time series Database using Web service
- Designed and developed a strategy for building the whole system following OSGI standards and deployed into KARAF OSGI container.
- Architected and implemented frame work and monitoring systems for Cassandra database and Java based systems.
- Architected and developed data connectors for several data sources including Horton works, Cassandra, Oracle, REST services.
- Architected Messaging system for ROAST and depending systems using Kafka and RabbitMQ.
- Did Dashboard POC’s using Micro strategy BI tool connecting to several databases like Horton Works, Casandra, and Oracle.
- Deployed analytics into Mongo DB database.
- Developed SOA services in Oracle Fusion Middleware and wrote wslt scripts for automating domain creation and setting up security policies.
- Setting up Oracle Coherence Clusters for in-memory analytics.
- Architected, design and implemented No SQL based databases like Cassandra and Horton works Hadoop clusters.
- Worked on integrating Web logic Server with Maven, Jenkins and Subversion and used some custom plugins.
- Design and developed Cassandra key spaces, tables.
Environment: J2EE (Java1.7, Web service), Hibernate, JPA, OSGI, Spring3.1, Spring security 3.1, AJAX JSON, KARAF OSGI Container, GE Cloud, OSA-CBM, Tomcat, Oracle11i, Oracle Fusion Middleware, Oracle Coherence, Eclipse, Red Hat Linux - Windows 7,SVN, Maven, SOA, BPMN, ESB, Mediator, REST web service, JAX-WS, Apache CXF, Active MQ, Historian Time Series Database, ACTIVITI, BPMN 2.0,Apache Service Mix, Data Nucleus, Spark, Spark ML, Cloud foundry Zookeeper, Kafka, Spark, Astyanax, Spring Cassandra, Cassandra, Datastax, Mongo DB, Hadoop - Horton works.