We provide IT Staff Augmentation Services!

Big Data Architect Resume

2.00/5 (Submit Your Rating)

St Louis, MO

SUMMARY:

  • Extensive experience in designing and developing software for various applications in leading Investment Banks, Insurance and Healthcare Companies as Lead Architect
  • As Architect, have specialized in enterprise architecture projects, strategy execution, workshops, PoC/PoV’s through to early delivery.
  • Analytics Leader who is well - versed with Data Analytics, Data Science, Big data (Hadoop Ecosystem), data visualization and machine learning techniques.
  • Extensive experience in Data Governance, Data Warehousing, Data Movement
  • Extensive experience in Big Data, Hadoop, Spark, HDFS, Hive, HBase, Kafka, Impala, Spark, RStudio and AWS Stack.
  • Experience in Cloud Computing using Amazon AWS, Azure HDInsight.
  • Extensive knowledge in data science algorithms using R.
  • Extensive knowledge in big data governance and security using LDAP, Kerberos, Apache Knox, Apache Sentry, Apache Ranger.
  • Have worked in the area of Campaign management, CRM, Personalization, Segmentation, Recommendation
  • Expert in developing Business case, Requirements, ROI, Roadmap, Digital processes and Agile Methodologies for complex projects.
  • Successful track record in managing and leading multiple global IT projects.
  • Leadership and hands-on experience in System migration, Capacity Planning, Business Continuity Planning, Disaster Recovery, Auditing & Compliance, Change/Incident Management.
  • Proven track record of improving the performance, work flow and architecture of systems, applications and processes.

SKILL:

Operating Systems: AIX, SunOS, SCO UNIX, HP UNIX, Windows NT/2000, DOS, Linux and Novell

Databases: AWS, Oracle 10.x/8.x / 7.x, Sybase 11.x / 10.x, IBM DB2 UDB, Informix Online, Informix SE, SQL Server, SQL Anywhere, SAS, H2, NO-SQL DB, TimeSeries DB, Cassandra, HBase, Hive, DynamoDB, Redshift

API and Libraries: AWS, Sybase CT-Library, DB-Library, ODBC, ADO, STL, ATL, HL7 and JDBC

Languages: C, C++, Java 8/J2EE/JDK, Perl, Python, XML, XSL, Basic, SQL, ESQL, DSQL, SybPerl, UML, CORBA IDL, UML, JavaScript, EJB, FIXML, PIG, NOSQL, HQL, Python, RStudio, R, Scala.

Project Management: Microsoft Project, Excel

Version Control: Git, Bit Bucket, Clear Case, SCCS/RCS and PVCS

Messaging Queues: Amazon AWS SQS, IBM MQ, Apache KAFKA

Data engineering: ETL, ELT, Nifi, Apache Camel, Apache Sqoop, Apache Flume, JSON, XML,Confluence

Big Data: HDFS, HBase, Hive, TEZ, Data Lake, PIG, Kafka, Spark, Apache Phoenix, Cassandra, Impala, Presto, Athena

Cloud: AWS, Azure and HDInsight

Architecture: TOGAF

AWS: Lambda, EC2, EMR, CloudTrail, CloudWatch, Redshift, Jenkins, DynamoDB

EXPERIENCE:

Confidential, St Louis, MO

Big Data Architect

Responsibilities:

  • Design a POC/POV to replace propriety 1010data analytics tool with AWS bigdata datalake and data mart using Lambda, Apache Presto, Apache Athena, Spark based ETL and redshift based data warehouse, Tableau and other BI tools.
  • Implemented AWS bigdata datalake and data mart using Lambda, Gateway API, Apache Presto, Spark based ETL and storing trillion rows tables in parquet.
  • Implemented AWS Tableau to query parquet/presto data mart, where traders can analyze massive trillion rows tables using presto.

Environment: Java8, Spark 2.0, Parquet, Amazon S3, EC2, EMR, Lambda, gateway API, Pipeline, Presto, Tableau, Jenkins.

Confidential, Portland, OR

Technical Lead

Responsibilities:

  • Provided data strategy involving Data Governance, Data Warehousing and Data Movement.
  • Built time variant HIPAA compliant Data Warehouse using data lakes, PySpark, AWS, Redshift, DynamoDB, EC2, EMR, SNS, Parquet, Avro.
  • Designed and implemented solution by reading data from data lakes, merging various data stream in memory using Spark dataframes and storing facts and dimensions in Amazon Redshift database.
  • Improved spark run time performance in multifolds using various cache algorithms, Yarn UI, Spark UI and Yarn Rest API’s.

Environment: Java8, PySpark, Facets, DB2, Oracle, Spark 2.0, DynamoDB, Redshift, Avro, Parquet, Amazon S3, EC2, EMR, Lambda, Jenkins and Code Commit.

Confidential, NJ

Technical Lead

Responsibilities:

  • Built real time Data Warehouse using Change Data Capture logs.
  • Designed and implemented solution by reading CDC logs from Kafka Queue’s, merging various data stream in memory using Spark streaming and storing in Cassandra database.

Environment: Java8, Scala, SoapUI, Micro Services, DB2, Oracle, Solr, Kafka, Spark 1.5, Cassandra, HDP

Confidential

Solutions Architect, Philadelphia

Responsibilities:

  • Leading a team of Architects and software engineers with clear responsibility to make a change to the application development paradigm by embracing “Big Data”, “Mobile First”, and “Prototype driven development” methodologies,
  • Enable the team to build an enterprise wide Big Data Framework using Open Source Software in Hadoop Framework.
  • Provide end-to-end guidance to delivery teams while ensuring that IT solutions adhere to the firm’s long-term vision.
  • Initiative involved creating an Alerts engine based on the mining of member claims information, click data collected from the portal and mobile channels in data lakes. The Alerts engine has the capability to deliver notifications to members across various channels - Push, Text, Email and Pull.
  • Designed & developed rest based web-services to collect member click data from Amazon AWS SQS and feed into Data Lake.
  • Designed & developed data pipelines using Sqoop, Flume, Pig to collect customer chat data into HDFS, Hive & Hbase for analysis.
  • Defined the job flow sequence and developed UNIX shell scripts to automate the execution of hive and pig scripts.
  • Defined Oozie workflow to run DAGs of various Hive and Pig jobs, which run freely with time and data availability.
  • Developed data load & retrieval solution/procedure on structured/semi-structured data using HDFS, Pig, Hive, HBase & Spark.
  • Designed & developed Hive tables, External tables, dynamic partitions and load/unload data to analyze using HQL, Apache Impala
  • Integrated R-Studio with hive using RHive package. Integrated R with Hadoop using bigR.
  • Designed Apache Lucene based member index search for alerts engine. Moving the project on Elastic Search for Rest based API
  • Moving claims analytics on spark for under and over payment using pyspark and R
  • Implemented splunk for log analysis at enterprise level.
  • Designed a strategy to migrate legacy ImagePlus Document System to IBM Content Manager.
  • Designed over 200 REST/SOAP web services for facilitating merger between IBC and Highmark to share systems across board.
  • Designed and developed Mobile Portal and Member Portal for IBC
  • Designed LDAP interfaces for Member Portal, Mobile Portal and other applications
  • Designed strategy to merge two medical claims engine

Environment: Java 8, C++, Scala, IBM DataPowers, IBM WMB, SOA, JMS, SoapUI, UML, ImagePlus, IBM Content Manager, IBM Records Manager, DB2, Web Services, IBM MQ, DB2, Oracle, SQL Server. HBase, Lucene, Elastic Search, Hive, PIG, Sqoop, Flume, Python, Perl, R, R-Studio, RHive, Panda, Kafka, Impala and Spark 1.6, Apache Phoenix, Tableau.

Confidential

Solutions Architect, Newark, NJ

Responsibilities:

  • Provided firm wide architectural solutions for merging different Document Systems (IBM CM/Ondemand / Documentum/Filenet), Email Systems.
  • Involved in Configuration Management, Change Management, Content Management and Troubleshooting of Systems and implementing best practices for development, documentation and Version Control.
  • Migrated legacy applications to a Service Oriented Application (SOA) framework.

Environment: Java, C++, IBM DataPower, IBM WMB, SOA, JMS, SoapUI, ImagePlus, IBM Content Manager, IBM Records Manager, DB2, Filenet, IBM Case Manager, Web Services, IBM MQ, DB2, AIX, Oracle, Informatica.

Confidential

Vice President, NYC

Responsibilities:

  • Managed a team of 10 developers
  • Responsibilities included building new applications as well as provide key support to existing fixed income and equity derivatives trading systems Summit, Sophis, ACBS and Team in the front and SmartStream Accounting system in the back.
  • Defined key architecture and framework for web-based applications, convert complex old existing financial applications into web-based applications with same feel, and look.
  • Provided project management and business analysis for projects.
  • Provided key analysis and manage merging three major Banking systems into one Banking System.
  • Designed and develop Web based Collateral Management System using MyEclipse framework, Java, JSP and Confidential (Business Intelligence Reporting Tool).
  • Designed and develop Web based P&L Reconciliation and Reporting System to be used by Middle Office, Traders and Accounting department.
  • Implemented Data Synapse Grid Computing to P&L, pricing trades for extracts, and reporting systems in C++.
  • Designed data warehouse for Fixed Income Summit and Equities and Derivatives Sophis systems using Perl objects.
  • Provided key development and support to Summit Fixed Income Trading System, Sophis Equities and Derivatives Trading System, Loanet (Securities Lending system) and develop interfaces around them using C++, java and perl.
  • Provided key Support to Middle Office and Credit Risk systems in analyzing the risks.
  • Developed Hypothetical P&L for Summit Trading system in C++
  • Provided key Support to Accounting SmartStream GEAC and Ledger systems.
  • Migrated MS based bank cash reconciliation system to CORONA cash reconciliation system using SWIFT messages.
  • Built Interfaces for ACBS Lending system.
  • Managed SmartStream Accounting system
  • Implemented open source Confluence, Jira for incident management and monitoring.
  • Using QuickFIX/J API built interface to create trades in Sophis trading system from Barclay order management System.
  • Using RStudio provided data analysis to Front office team.

Environment: Java, C++, Data Synapses Grid, Python, Perl, R

Confidential

Vice President

Responsibilities:

  • Responsibilities included project management and business analysis for team projects. Define key architecture for Private Banking computational needs.
  • Develoedp Client portal in Sybase, Java, JSP, C++ for managing portfolio’s and redemptions.
  • Supported proprietary accounting system
  • Designed and developed a Data Warehouse and Reporting System for accounting department in C++ and perl.
  • Provided end-to-end computer feeds/document/imaging search and retrieval solution.
  • Designed Offshore imaging solutions in Bahamas, Jersey and Geneva and Offshore indexing in Mumbai

Confidential

Technical Lead

Responsibilities:

  • Designed and developed DLL interfaces in MS Visual c++ using MSXML, XPATH, COM, ADO, IBM MQ, DB2 database for Check Adjustment & Processing System. DLL receives search query in XML, parses the query, connects to DB2 database via ADO and returns the results in XML
  • Developed security module for IBM OnDemand 7.1/AIX Check Imaging System in JSP, Java, Servlets with Servlet Exec as Servlet engine and DB2 database
  • Developed application using IBM OnDemand ODWEK API for retrieving Check and Document images in JSP, Java, Servlets with Servlet Exec as Servlet engine
  • Developed an interface using C# in back end and DB2 database to parse word documents and send trade messages via SWIFT and TELEX
  • Developed an interface in Visual Basic and DB2 database to send over trade feeds to existing General Ledger and DDA systems
  • Developed an interface in Visual Basic to update CIF account information from MainFrame System for Check Adjustment System
  • Developed an interface in visual basic, C# for FED Wire feed
  • Installed and configured IBM DB2 database on Windows NT for Check Adjustment System and ATF
  • Installed and configured IBM MQ Server for sending trade messages on Windows NT

Confidential

Technical Lead

Responsibilities:

  • Designed and developed Trading Router in C++, IBM MQ Series and XML to route and process XML trading messages. JP Morgan & Confidential gets trade feeds from various banks, dealers and vendors. These feeds are in XML send via socket or IBM MQ middle ware, needs to be processed, stored in Oracle database and converted to different XML messages pertaining to vendor specific DTD
  • Designed generic purpose DTD using XML authority and Rational Rose for fixed income securities, equities, REPO's, futures, options and fed funds. Rational rose was used to generate C++ and java classes automatically for the DTD's
  • Developed vendor specific adapters for trading router in C++ and XML using IBM MQ Series middle-ware and DOM parser
  • Developed workflow tool in Oracle SqlPlus, SQLJ (java objects in oracle) and Oracle advance queue to monitor work in progress. Developed Workflow application in SQLJ to make application independent of database. Workflow application is working successfully in sybase and oracle database with most of the code written as java objects in oracle
  • Developed workflow front end for trading router in XML, java servlets, JSP, JavaScript and IBM WebSphere using Visual Studio
  • Developed data maintenance front end for static data in JSP, JDBC
  • Developed stored procedures, indexes and constraints for Trading Router in Oracle 8.16
  • Developed utility classes in C++ for IBM MQ and XML parser
  • Administered IBM MQ in creating and maintaining queues, rights, traces and for transaction based processing
  • Developed korn shell and awk scripts to generate test cases and compare results in regression tests

Confidential

Technical Lead

Responsibilities:

  • Designed and developed Turn Around (TAD) System using java servlets, Visual Age, Apache Jserv Servlet Engine running on SUN UNIX Operating System, ORACLE and JDBC. TAD is a custom designed application to create smart online insurance documents, store them digitally once the customer returns them after scanning and indexing using Jetform Merge Engine, FILENET scanning and indexing software and Kodak Scanners. Integrated TAD using CORBA and Java Sockets with Chordiant workflow CRM engine. Designed Functional specifications for the project using UML.
  • Developed front end client application for accessing Servlets in Visual Age and Java Servlets
  • Developed various back-end Java Daemons for sending events to Reporting systems in an integrated environment using Session beans
  • Developed proof of concept and design for integrating various components written in languages like FORTE, Visual basic, Java, Servlets, EJB's and Main Frame GMI using CORBA, Java Sockets, Bridges, Visigenic ORBS and RMI/IIOP
  • Developed interface to send and analyze emails using JAVA Swing, JAVA MAIL API, SMTP server on Sun Sparc and IMAP protocols
  • Developed interface in Java to send Documents to clients via FAX Demand Service
  • Developed various java utilities to generate automatic Servlet and stored procedure code
  • Designed data base structures using ERWIN and develop stored procedures and triggers in PL/SQL for Oracle 8.16
  • Developed POC for XML based Java API using Apache SAX Parser API and IBM MQ
  • Evaluated and configured Various servlet engines and web servers on window NT and SUN Sparcs
  • Enhanced Filenet application using Visual Basic and Visual Studio

Confidential

Technical Lead

Responsibilities:

  • Designed and constructed a highly flexible disbursement module to enable payroll payment processing through EFT, direct deposit, wire and third party payments. This module was responsible to create disbursement instructions that were fed to the ACH interface and Check writing interface
  • Designed and developed the Accounting Rules Module. This served as the core module and used by several other payroll batches. This module enabled the users in the Accounts to define custom accounting rules and the associated Budget Account Classification code.
  • Port IMIS application from UN to UNDP
  • Worked with Unit and System Testers in preparing a comprehensive test plan
  • Enhanced the C/C++ libraries to accommodate new functionality
  • Enhanced front end in C, UNIX, JAM, Sybase for UN/UNDP IMIS system
  • Developed financial modules like General Ledger, Obligations, Travel Advances, Receivables, Financial Institutions, Deposits, Bank Accounts
  • Designed and developed and tuned stored procedures, triggers and indexes for more than 900 table's application in Sybase database Interfaces
  • Developed Payroll interfaces in Perl/Sybase for exchanging data to various software's and Government agencies using EDI and non EDI standards. This involved batch of 7 interfaces in perl to be run in parallel to generate payroll for UN/UNDP employees in multiple currencies, multiple banks and institutes
  • Developed interfaces for foreign exchange using SWIFT Perl and Sybase
  • Developed Time & Attendance interfaces in perl for managing entitlements for UN employees all over the world in Per/Sybase

We'd love your feedback!