We provide IT Staff Augmentation Services!

Principal Big Data Architect Resume

4.00/5 (Submit Your Rating)

NyC

SUMMARY:

  • Over 20 year’s experience as a Hands on Senior Big Data Software Technologist worked at Confidential such as Confidential, Bankers at various capacities for instance Sr. Programmer Analyst in Design, Development, Testing and Maintenance of Major Software systems, Sr. Systems Architect, Systems Manager (DBA), Sr. Database Administrator.
  • Building the New Data Analytics Platform (DAP) for the Confidential - Involved in the Infrastructure & Networking, Security Tokenization, Data Solutions and Architecture specs and Infrastructure Architecture specs - The whole application is being built in AWS, RedShift, Athena, Scala, Spark, EMR.
  • Defining a road map moving data from Netezza into AWS - defining infrastructure architecture, database architecture.
  • Involved in designing the DataLake - integration data from various sources into one place.
  • Involved in the Data Governance - Data quality, MDM, Security and worked with various groups.
  • Built a 16+2 Node Hadoop cluster initially (750TB) and expanding by another 32 Node Cluster - total it will be 48 Node Cluster.
  • Architected BIG DATA Strategy for a Cable Company for their Network Operations Centre (NOC) - Building IBM Netezza Servers, bringing in Hadoop Implementation of Hortonworks. IBM Netezza, MySQL Servers, MongoDB and Hadoop Stack (PIG, Hive, HBase, Zookeeper), Kafka along with Storm.
  • Performed capacity planning - in that process - recommended and subsequently added another 32 Node cluster to the existing environment.
  • Performed the Root Cause Analysis (RCA) - worked the development teams, Linux teams, worked with HortonWorks in resolving the issues - created various tickets to let HortonWorks teams to work on them.
  • Created and published various production metrics relating to the systems reliability, performance to various teams - Development Teams, Systems Owners, Support Teams and the management.
  • Worked with the Hadoop developers and managers in helping them to come with the right development tool - Hive as the development tool and also resolving their issues relating to the development, performance - worked with HortonWorks and Linux teams.
  • Helped the support teams to define the monitoring tools - to address various issues encountered.
  • Mentored, trained new teams worked with them to come up to the speed and also created the Runbooks for the environments - both for Hadoop and Netezza environments.
  • Wrote the RFP and subsequently evaluated the RFP - choose HortonWorks as the primary vendor and worked with HortonWorks - recommended the Hadoop environment and implemented a major application for the operations.
  • Supported more than 50 Terra Byte databases (Financial Databases) and supporting more than 1 Peta Byte installation
  • Experience in the MySQL Server environment, architecting the environment along with Netezza and MongoDB.
  • Worked on Architecture of Sybase, MS SQL Server and Netezza - Data movement and in-bound and outbound of the data flows of both the Client and Internal databases
  • About 10+ years of experience in Sybase, Perl and Shell Scripting.
  • About 5+ years of experience as SQL Server DBA, as Oracle DBA.
  • Install New and /or upgrade Sybase and SQL servers.
  • Database Administration experience in Oracle 11g, 10g, Sybase 15.5, 15.0.3, 12.5.3, Replication Server, MS SQL Server 2008, 2005, 2000 and Sybase IQ.
  • Performed Physical and Logical Data modeling and architecting various applications.
  • Experience in Production, Development and Testing support environment.
  • Performed Performance and tuning to the Sybase servers Replication Server implementation.
  • Supported 24x7 for production, Experienced with Backups and Disaster Recovery.
  • Good knowledge in the Autosys, Visio, ERWin, Remedy and Peregrine Ticketing systems.
  • Excellent troubleshooting and problem resolution skills.
  • Ability to work under tight schedules and Good decision making skills.
  • Excellent communication, oral, written skills and a Good team player.

TECHNICAL SKILLS:

HARDWARE: Sun Systems, IBM RS/6000 Systems.

OPERATING SYSTEMS: Sun Solaris, AIX, Win NT 4.0, UNIX System V, AOS/VS, VAX VMS.

LANGUAGES: C, PERL, JAVA, COBOL.

DATABASES: Sybase ASE, 15.02, 12.5, 11.3, 11.92, 12.0.3, Oracle 11g, 10g, SQL Server 2000, 2005, 2008, 7.0, 6.5 Informix SQL, ESQL, 4GL.

EXPERIENCE:

Principal Big Data Architect

Confidential, NYC

Environment: IBM Netezza Server, Python, AWS, RedShift, Athena, Scala, Spark, EMR, Shell Programming, Agility Netezza Workbench, MySQL Server, MongoDB.

Responsibilities:

  • Building the New Data Analytics Platform (DAP) for the (Client) in AWS - Involved in the Infrastructure & Networking, Security Tokenization, Data Solutions and Architecture specs and Infrastructure Architecutre specs - The whole application is being built in AWS, RedShift, Athena, Spark, EMR.
  • Built a new database in RedShift - moved data from Netezza to S3 to RedShift (AWS) also created the SnowBall.
  • Defining (Client) Group's Netezza & Big Data Support Strategy and Collaborating with customers to build state of the art solutions to address their Netezza & Big Data & Analytics.
  • Define the best practices, Vendor Management for all the platforms under Big Data group (Netezza, AWS & others as get developed), Relationship Management. Guide development teams to resolve issues with the Help of SMEs & Vendor Support. Plan & Manage software upgrades, Application migration efforts, adoption of new technology initiatives etc.
  • Interfaced with senior executives within business and IT organizations to communicate on adoption various Big Data Platform.
  • Perform the root cause analysis (RCA) for various environments. Worked on the Data Governance - data security, Data Quality, Data Storage, NPI Data quality.

Head of Netezza & BigData Strategy (MissionStaff)

Confidential, Philadelphia

Environment: Hadoop, IBM Netezza Server, Perl, Shell Programming, Agility Netezza Workbench, MySQL Server, MongoDB

Responsibilities:

  • Defining Confidential 's Global Netezza & Big Data Support Strategy and Collaborating with customers to build state of the art solutions to address their Netezza & Big Data & Analytics, Netezza Replication and also defining the infrastructure support for all the various Big Data environments.
  • Define the best practices, Vendor Management for all the platforms under Big Data group (Netezza, Hadoop & others as get developed), Relationship Management. Guide development teams to resolve issues with the Help of SMEs & Vendor Support. Plan & Manage software upgrades, Application migration efforts, adoption of new technology initiatives etc.
  • Interfaced with senior executives within business and IT organizations to communicate on adoption various Big Data Platform - Hadoop - Hortonworks implementation.
  • Defining the Backup strategy for the existing Hadoop environment.
  • Do the root cause analysis (RCA) for various environments. Worked on the Data Governance - data security, Data Quality, Data Storage, NPI Data quality.

Principal Big Data Architect

Confidential

Environment: Hadoop, MongoDB, IBM Netezza Server, Perl, Shell Programming, IBM Netezza Admin., Agility Netezza Workbench, MySQL Server, Talend, Vertica

Responsibilities:

  • Architected BIG DATA Strategy for the Cable Company for their Network Operations Centre (NOC) - Building IBM Netezza Servers, bringing in Hadoop Implementation of Hortonworks. IBM Netezza, MySQL Servers, MongoDB and Hadoop Stack (PIG, Hive, HBase, Zookeeper) and Kafka along with Storm.
  • Built a 16+2 Node Hadoop cluster initially (500TB) and we are already expanding by another 32 Node Cluster - total it will be 48 Node Cluster.
  • Using Scoop moving data from Netezza to Hive DB and Ambari and Nagios to monitor the Hadoop Cluster.
  • Consolidated various applications into one MySQL environment and decommissioned other MySQL environments. The server became the major data source for various applications. More than 1 Million Dollars savings.
  • Using MongoDB (NoSQL) getting data from Live systems and loading them in MySQL and Netezza.
  • Also devising a strategy in implementing Kafka and Storm to get the Modem Log data.
  • Supporting more than 30 Terra Byte databases in Netezza environment along with 40TB Data Storage.
  • Developing Netezza to Hadoop Archival System of 40TB - did the POC and subsequently moved partial data to the Hadoop environment.
  • Defined the Backup Strategy for the Netezza environment in Hadoop.
  • Performed the Root Cause Analysis (RCA) - worked the development teams, Linux teams, worked with HortonWorks in resolving the issues - created various tickets to let HortonWorks teams to work on them.
  • Created and published various production metrics relating to the systems reliability, performance to various teams - Development Teams, Systems Owners, Support Teams and the management.
  • Performed capacity planning - in that process - recommended and subsequently added another 16 Node cluster to the existing environment.
  • Worked with the Hadoop developers and managers in helping them to come with the right development tool - Hive as the development tool and also resolving their issues relating to the development, performance - worked with HortonWorks and Linux teams.
  • Helped the support teams to define the monitoring tools - to address various issues encountered.
  • Mentored, trained new teams worked with them to come up to the speed and also created the Runbooks for the environments - both for Hadoop and Netezza environments.
  • Wrote the RFP and subsequently evaluated the RFP - choose HortonWorks as the primary vendor and worked with HortonWorks - recommended the Hadoop environment and implemented a major application for the operations.
  • Installed MySQL Servers in a large environment and managed it.
  • Netezza Performance at Server Management admin level, SPU Maintenance using NZ options
  • Load and Unload data using External Tables (NZLOAD), Backups using nzbackup/nzrestore
  • Netezza User, Group and Database access Provisioning, NZ System Activity Monitoring, Netezza User Security and Authentication/authorization.
  • Worked on the Data Governance - data security, Data Quality, Data Storage, NPI Data quality and also worked with FCC to provide various reports on the performance of the data traffic.
  • Talend is our ETL Tool - which controls all our data movement between all the environments.

Sr. Database Architect

Confidential, Boston, MA.

Environment: IBM Netezza Server, Perl, Shell Programming, IBM Netezza Admin., Agility Netezza Workbench

Responsibilities:

  • Working at a Marketing Analytics Company, as a Sr. Database Architect, managing their various databases - IBM Netezza.
  • Supporting more than 50 Terra Byte databases and supporting more than 1 Peta Byte installation
  • Netezza Performance at Server Management admin level, SPU Maintenance using NZ options
  • Load and Unload data using External Tables (NZLOAD), Backups using nzbackup/nzrestore
  • Netezza User, Group and Database access Provisioning, NZ System Activity Monitoring, Netezza User Security and Authentication/authorization.
  • Architecting various applications and improving them.
  • Looking into the growth strategy - Tables Growth and skew, table distribution
  • Help the user community regarding the queries and resolve inefficient queries and also doing the performance tuning and solving some of the problems.
  • Also worked on installing the Netezza Analytics software.
  • Worked on the Data Governance – data security, Data Quality, Data Storage, NPI Data quality.

Senior Consultant

Confidential, Boston, MA

Environment: Sun, Win NT, SUNOS, Sybase 15.5, 15.0.2, 12.5.3, Perl, Shell Programming, Sybase RAP server, In-Memory Databases and Sybase IQ.

Responsibilities:

  • Working at an Confidential, based in Boston, MA, as a Sr. Consultant, managing their various databases – Sybase.
  • As a Sr. Database Consultant, working on doing performance tuning of their Compliance Systems – both Server level as well at the stored procedure level.
  • Created various data base model's using Erwin's Data modeling tool - Reverse Engineered from various databases.
  • Responsible for tuning as well as database administration.

Senior Consultant, Genesys Consulting

Confidential, Albany, NY.

Environment: Sun, Win NT, SUNOS, Oracle 10.2.0.4, Sybase 12.5.3, 15.0.3, Shell Programming, Oracle 10g, 11g, SQL Server, and Sybase IQ.

Responsibilities:

  • Worked at MVP Insurance, based in Albany, NY as a Sr. Consultant, managing their various databases – Sybase, MSSQL and Oracle.
  • As a Sr. Database Consultant, working at an HealthCare Insurance company in NY, supporting their various distributed databases.
  • High-level support of existing systems utilizing the Remedy ticketing system to resolve various tickets created by users
  • Database administration of various databases including Sybase, MSSQL, and Oracle.
  • Designed, developed and implemented the database management repository for the Enterprise where this database captures database capacity over time also provides all servers information at the patch level. As the design is modular it also has the functionality to include an enterprise password reset application for the database user id’s.
  • Defined database management strategies for enterprise databases and handled application performance and tuning; responsible for tuning stored procedures and servers and managing complex systems.
  • Worked at the Confidential, NY State as a consultant, managing and administering their databases in Sybase as well as in Oracle.
  • Worked on the Performance Tuning using the various tools – Performance Center (Embarcadero’s), ProActive DBA (WhileHall Technology’s) and also extensively used Mon Tables from Sybase.
  • Helped in converting one of the databases from Sybase to Oracle Database and also getting data from other database servers for the application.

Senior Consultant

Confidential, NJ

Environment: Sun, Win NT, SUNOS, Sybase 12.5.3, SQL Server 2005, Shell Programming, Oracle 10g, 11g, Visio, ERWin

Responsibilities:

  • Worked as a free lance consultant for an insurance company, defining the database design, architecture.
  • Responsible for the performance and tuning the application – tuned various stored procedures and also the servers.
  • Working remotely with the application teams from both India and Mexico, helping them having the right processes – (FACETS application)
  • Helped in converting one of the databases from Sybase to SQL server and also getting data from other database servers for the application.
  • Trained in the Oracle Database administration 11g.

Senior Consultant dba

Confidential, SFO

Environment: Sun, Win NT, SUNOS, Sybase 15.0.2, Sybase 12.5.3, SQL Server 2000, 2005, Shell Programming, Perl, Oracle 10g, 11g, SQL Server 2005

Responsibilities:

  • Responsible for Production Support of various databases for different application Groups at the Confidential – this is a 24/7 support env.
  • Participated in a data center migration project
  • Responsible for all the database growth strategy for all the databases across Americas – Infrastructure Group.
  • Responsible for the defining and implementation of database backup and tape backup strategies for whole North Americas - Infrastructure Group.
  • Responsible for the defining and implementation of Autosys (Sybase, Oracle) servers for the North Americas.
  • Responsible for the upgrading of the servers in both Sybase and SQL Server environments.
  • Worked on the Data Governance – data security, Data Quality, Data Storage, NPI Data quality and also worked with FCC to provide various reports on the performance of the data traffic.

Consultant dba

Confidential, VA

Environment: Sun, Win NT 4.0, SUNOS, Sybase 15.02, 12.5.3, Oracle 10g, Perl, Shell Programming

Responsibilities:

  • Responsible for development, QA & Production Support of various databases for different application Groups at the Confidential , performance & tuning of Sybase & SQL Servers & Fine tuning of stored procedures, helping the developers for the design issues from the database perspective.
  • Participated in a data center migration project
  • Responsible for the conversion of an application database from Sybase to Oracle 10g.
  • Responsible for the logical and physical schema implementation and Defining backup and recovery procedures.
  • Responsible for the Autosys Jobs, Remedy Ticketing system and also ClearQuest Enterprise Configuration Management for our applications.
  • Worked on the Data Governance – data security, Data Quality, Data Storage, NPI Data quality.

Chief Architect/VP of Engieering

Confidential, New Jersey

Environment: Win NT 4.0, Pc's, UNIX Solaris 2.8 Servers SW: MySQL Server, Visio, ERWin

Responsibilities:

  • Confidential is a Startup company where they were focused on developing Wealth Management Solutions for High NetWorth Individuals and also for the mass affluent people.
  • Performed physical and logical data modeling and also responsible for the architecture of the product.
  • Responsible for the design, development and prototyping architecture for the Wealth Management Platform “WealthDirector”.
  • Responsible for the thorough understanding of the Wealth Management and various strategies provided by various companies in industry (Banks, Investment Companies, Insurance Companies etc.).
  • Performed comparative trend analysis of the both the businesses and software solutions being provided by various companies. Discussed the requirements and Client experience with the industry experts.

Senior Consultant

Confidential, CO

Environment: Win NT 4.0, Pc's, UNIX Solaris 2.8 Servers, Sybase ASE 12.5

Responsibilities:

  • Worked at Trizetto Corp, who were the developers of the FACETS application, worked with various insurance companies – worked with the developers and project managers of the insurance companies implementing the application and supporting the application.
  • As a Sr. Database Administrator (DBA), accountable for the planning, design, implementation and management of the SYBASE Database Management System (DBMS) running under SUN Solaris.
  • DBA activities for Sybase servers such as: dump, load, performance tuning, create instances, install database servers, develop scripts for database maintenance. Principal support for on call rotation and troubleshooting of the nightly data processing.

Senior Consultant

Confidential

Environment: SUN, Win NT 4.0, SUNOS, Sybase 12.0.0.3, 11.92, Perl, Shell Programming, AutoSys, Informix, Visio, ERWin

Responsibilities:

  • Responsible for Sybase 12 (64 bit) Migration project, upgrading various Sybase servers to 12.0.0.3 (64 bit Architecture). Coordinated the process discussing with the application managers, DBA team, UNIX team and made sure with same version of Sybase running over the world on similar hardware.
  • Responsible for the support of the Informix Software for a small application.

Senior Consultant

Confidential, NY

Environment: SUN, Win NT 4.0, SUNOS, Sybase 11.92, Shell Programming, Perl, AutoSys, Visio, ERWin and Rational Rose

Responsibilities:

  • Responsible for implementing the Confidential 's Consulting engagement in design & development of "EIS Database Architecture" Website, where any developer or any authenticated user could have the access of this website where they could understand about the application its design, architecture, logical & physical database design and also data (partly).
  • Responsible for the design, development of the Security Model for CCW application Worldwide.
  • Responsible for the design, development and Implementation of the web based "Usage Analysis" for the CCW application Worldwide.
  • Responsible for Production Support of the various Feeds to the CCW application all written Perl, AutoSys
  • Responsible for the Performance & Tuning of Sybase Server & Fine tuning of stored procedures, helping the developers for the design issues from the database perspective.
  • Responsible for the Security of the various databases, along with the Systems security and worked closely with the UNIX, NT and other Groups in implementing various security applications.

Systems Manager

Confidential, NJ

Environment: RS/6000, Win NT 4.0, AIX, Sybase 11, SQL Server 6.5, Perl, Shell Programming.

Responsibilities:

  • Responsible for Production Support of various databases for different application Groups at the Confidential, and also working on Replication Server, Performance & Tuning of Sybase & SQL Servers & Fine tuning of stored procedures, helping the developers for the design issues from the database perspective.
  • Responsible for the database design, recommending the database, memory, disk and server requirements.
  • Establishing backup and recovery procedures.
  • Responsible for the Security of the various databases, along with the Systems security and worked closely with the UNIX, NT and other Groups in implementing various security applications.

We'd love your feedback!