Senior Big Data Architect Resume
New, YorK
SUMMARY:
- 14 years of experience having 5 yrs in Big Data and 9 yrs in Java/J2EE.
- Possess strong analytical and excellent communication skills. Quick learner and a good team player, with a strong capability of leading teams. Detailed oriented, having excellent problem solving capabilities. High dedication and strong customer support.
TECHNICAL SKILLS:
Operating Systems: Windows XP, Linux.
Tools: CDH Hadoop, Oozie, Flume, Sqoop, Eclipse, RAD7, WAS6, IBM Heap Analyzer, JMeter, Rational Rose, Clear Case, Clear Quest, Synergy, JIRA, SVN.
Languages: Java MR, PIG, Hive, Impala, UML Modelling, UseCase Analysis, Design Patterns (Core & J2EE), OOAD, Java, J2EE (JSP, Servlets, EJB), Web Services, Ant.
Frameworks: Datastax Enterprise, Hadoop (MapReduce/HDFS), Amazon AWS, Spring3.0, Hibernate, Struts, Kerberos.
AWS Services: EMR, IAM, EC2, S3, EBS, Data Pipeline, VPC, Glacier & Redshift.
Databases: Cassandra, MongoDB, HBase, SQL Server, MySql, Oracle 9i/10g.
Data Analytics: Tableau, Mahout, RevolutionR, Pentaho, Talend
Domain: Lifestyle, Banking, Brokerage and Hospitality.
PROFESSIONAL EXPERIENCE:
Confidential
Senior Big Data Architect
Responsibilities:
- Worked on Architecting, Designing and Implementing the GADS (Global Analytic Datastore) on Amazon AWS. This is a Big Data platform implemented using the Hybrid Big Data Architecture to hold 5 - 10 years of historical data from various sources (100s of Terabytes of data), which would provide a customer & product centric view of the data. This would enable the analysts to visualize customer behaviour and his journey across various products, customer retention, customer interactions, etc. This would also provide the Business Intelligence to perform predictive and statistical analysis using Big Data technologies.
- Implemented various Tableau visualizations to identify customer interactions, retention, bookings, engagements, etc. across various dimensions.
- Architected and Implemented the Tableau Server architecture to distribute the Tableau dashboards across the organization.
- Implemented the VPC architecture on Amazon AWS with the infrastructure teams to deploy instances in Dev and Prod environments. This architecture ensures all the security controls were put in place to meet the HIPAA requirements to protect PII and PHI sensitive member information.
- Worked on integration of various datasets both into the Data warehouse and the Big Data platform, bringing in data from, DOTCOM-online data, CHAMP-meeting data, SMV-MDM data, WELLO-Coaching data, Teletech-Chat&Call data, Exact Target-Mail data, Reflexis-Workforce data, ClickTools-Satisfaction data, etc.
- Worked with the BI team to design and implement the star schema for transactional data in the data warehouse for Coaching and Click2Chat products and define tables in the Data Vault as well.
Confidential - New York
Senior Big Data Architect
Responsibilities:
- Working for Fraud Technologies architecting, designing and implementing a big data solution for fraud detection and analytics. This product called HULC is intended to hold 13 months of historical data from various sources (100s of Terabytes of data), which would provide a consolidated view of the customer’s products across the bank. This would provide the business analysts the business intelligence to perform various analytics using various big data technologies.
- The other aspect of this product called ELECTRO is to perform ETL transformation on the raw data before it would be processed for scoring and alert detection in the bank.
- Responsible for designing the Cassandra data model for Venom, DFP & Flash projects and integrating them into the application design. Venom data model holds the monetary & non-monetary transactions, DFP holds the online login transactions & Flash holds the alerts generated by HULC.
- Responsible for Architecting the solution, defining the integration points with the fraud-scoring engine, capacity planning, deciding key technologies and designing and implementing the solutions.
- Responsible for introducing Big Data tools and technologies into the bank, presenting and implementing POCs for Tableau, Mahout, RevolutionR, Impala, Pentaho, etc.
- These above mentioned projects have been implemented using various big data technologies like Hadoop, Java MapReduce, Pig, Hive, Oozie, Flume, Cassandra, Sqoop and Solr.
Confidential - New York
Senior Solutions Architect
Responsibilities:
- SME on MongoDB for the Big Data initiatives, responsible for architecting and designing big data scalable solutions for teams across the organization. Helping reviewing requirements & use cases as suitable candidates for noSql database. Providing the technical guidance and expertise, setting up the scalable infrastructure, participating in schema design and helping out in data migrations and application development.
- Being a part of the architecture group responsible for setting up Standards and Best Practices, building POCs, reviewing program level initiatives, vendor management, etc.
Confidential - New York
Technical Architect
Responsibilities:
- As part of the emerging technology initiative, working on setting up the Hadoop distributed cluster on the Amazon AWS cloud and building POC for implementing Map-Reduce jobs in Java and monitoring the same using the Web UI in fully distributed mode. Also implementing PIG Latin data processing scripts for parallel processing.
- Responsible for driving the Cloud Computing practices at Confidential . Executed a comparative study of Amazon, Azure & MS Private Cloud, building and deploying a Java & .NET application and exploring various cloud features like Elastic Computing, Cloud Storage Services, Identity & Access Management, Load Balancing & Auto Scaling, etc.
- The engagement resulted in deriving the Cloud Whitepaper, Cloud Comparison matrix, Application Assessment metrics, Score Card & Cloud Best Practice. Also in the process of working with the Security groups in defining Security Controls & Cloud Security Blueprint.
- Responsible for Architecture & Design of the Distributed Bridge Adapter using the Spring Messaging Framework. The application provides a framework to allow applications running on the Confidential Infrastructure easy access to existing services to the Confidential Infrastructure. The Bridge Adapter uses the Spring JMS Integration framework, which simplifies the use of Java Messaging Service.
- Responsible for Architecture & Design of the Sales View Desk. The system is a web application targeted to fixed income sales team to provide them an insight into the Bond markets using market data, quotes, positions at the trading desk, enabling them to facilitate FA’s with real time market data across Trading desk, 3rd parties and ECNs.
- The system is a real time system and designed using reverse AJAX and Spring enabled services. This system hooks onto the Content Pub/Sub systems for all trading data and feeds. It also enables users to customize his view into the trading desk and subscribe to alerts. This system uses the Java Concurrency framework for concurrent executions and higher performance. Entitlements are enabled using an in-house Entitlements Engine.
- Responsible for laying down Java/J2EE standards and best practices for Application development teams and creating Architecture, Design & Implementation review templates.
- Evaluating new technologies and recommending products available in the market.
- Building proof of concepts and laying down development standards for the same.
- Evaluating applications against industry standards and recommended solutions & best practices and recommending design solutions & refactoring efforts to meet industry standards.
- Evaluating & approving libraries that could be used by application teams in Confidential .
Confidential - New Jersey
Project Lead
Responsibilities:
- Responsible for Design/Development of the Customer Activation System for on boarding Clients/Users enabling them to use the Confidential group of products and services. This Admin product goes Confidential the client & user on boarding with services such as Admin Agent Management, Service management, Contacts & Reports.
- The application is developed with the UI in .NET, interacting with the Application web services developed in Java and finally being integrated with the End Systems/Applications using the Provisioning product.
- The application has been developed in Technologies like .NET, Web Services, Spring, Hibernate, XML, JMS using tools and products like RAD7, Websphere, TIBCO, TFS, and Oracle10g.
- Working with the architects in tuning the application to meet the performance criteria. Restructuring the product introducing the appropriate layering & design patterns, introducing concepts like Spring Dependency Injection, Java5 Generics & Hibernate named queries, tuning the hibernate relationships for better performance.
- Responsible for leading & working with a team of 25 engineers both onsite & at an offshore location in India, designing the application, clarifying requirements, providing Integration support and debugging post development issues on Solaris servers.
- Responsible for preparing both Low Level & High Level design documents & presenting the design to the client.
Confidential
Project Lead
Responsibilities:
- Responsible for the Design/Development of the Service Request Management (SRM) project whose main goal was to decommission the Remedy and migrate all it’s functionality onto the GOW platform.
- The application was developed on the Struts framework interacting remote services developed with EJB2.1.
- Played a key role in this project in designing & developing the key components and building the initial framework for the offshore team to leverage.
- Responsible for leading a team of 8 engineers offshore, translating the requirements to the team, reviewing the code, doing an in-depth test coverage before delivering to the client.
- Also responsible for doing the load test with the Confidential performance team, and analysing the code using JProfiler, identifying bottlenecks and memory leaks.
- Responsible for preparing both Low Level & High Level design documents & presenting the design to the client.
Technologies involved: Struts, EJB2.1, Oracle9i, WLI server, Eclipse.
Confidential - SFO
Project Lead
Responsibilities:
- Responsible for the Design/Development of the Quarterly Portfolio Profile which is a reporting tool to provide clients with a Quarterly Performance snapshot of assets in their accounts. Also worked with the architects in performance tuning and load testing the tool. Preparation of HLD/LLD documents. Responsible for providing the Impact Analysis, Effort estimation and Sizing.
- Responsible for the Design/Development and leading a team of 9 members both onsite and offshore on the Schwab Advised Managed Services. It is a model more than just a project taken up by Mphasis to provide various services to Schwab.
- Development of major/minor project enhancements, Infrastructure migrations, Bug fixes in 3 month releases, Production Support - meeting SLAs laid down by Schwab. This has been setup as a successful onsite-offshore model for their suite of applications called Advice Suite.
- Successfully completed the development of an enterprise application Portfolio Summary integrated into the Confidential Advice Framework, which gives the Financial Reps an insight into the Clients portfolio, to gauge how it has been laid out, giving the reps the ability to suggest to the clients Advice tools to manage their portfolios better.
Confidential - Florida
Senior Software Engineer
Responsibilities:
- A Web Based System to administrate the Hospitality services of Confidential, USA. This system is basically a Sales and Booking Client for booking hotels/resorts, air tickets, tickets for theme parks etc.
Technology: UML, JSP, EJB, Design Patterns (Core and J2EE), SQL, Websphere, Oracle, Rational Rose, IntelliJ.
Confidential
Senior Software Engineer
Responsibilities:
- This application was the GEPS ( Confidential ) Intranet site which was written using the J2EE architecture. It was developed on CASPER a J2EE framework developed by GE based on the MVC design model.
Technology: Java, JDBC, JSP, XML, HTML, JavaScript, UML, Rational Rose Oracle8i, Weblogic6.0.
Confidential
Senior Executive
Responsibilities:
- The application had been developed to customize the database objects in the database layer and the front-end layer through EJBs in the middle tier. Clients in US and India are provided their own customized version of database objects and front end look and feel in the form of JSPs which create dynamic forms. The product can make customized media management applications very easy to be delivered to clients.
Technology: Java, J2EE, EJB, Weblogic, Jbuilder, Oracle 8, Weblogic 5.1.