Hadoop Bigdata/analytics Sme Resume
Windsor Mill, MD
OBJECTIVE:
- To obtain challenging enterprise infrastructure/network/software/bigdata CTO, SME, project management or architect consulting opportunities and engagements.
SUMMARY:
- Over 18 years of broad technical and management experience in information technology. Experience managing and executing high - visibility projects to success and leading small and medium sized teams including off-shore resources. Very strong architecture design, programming and software development skills with full SDLC experience including structured and OO analysis/design, development, implementation and maintenance on multiple platforms and environments including: Windows NT-2k3, SunOS/Solaris, AIX, Linux, MacOS/OSX and MVS as well as working with cloud and virtualized infrastructures, IaaS and PaaSes. Ability to adapt to highly complex, rapidly changing and evolving environments. Extensive experience with web and web-enabled technologies, SOA/Rest Architectures, portal development, data syndication, integration and orchestration using XML and web services within J2EE and .Net Environments.
- Comprehensive software and hardware integration experience, including networking experience and understanding of client/server, n-tier, and embedded systems. Strong background in OOAD and integration with Relational, Object and NoSQL Database systems using Oracle 7-11g, Sybase 11.x.x/12.x.x, MS SQL Server, DB2, CA Jasmine, Objectstore, GreenPlum, PostgreSQL, and MySQL. Extensive experience in High Availability/Cluster environments configuring Cisco routers and switches, Firewalls (Cisco, McAfee, Netscreen, Checkpoint), Load Balancers and Content Switches (Cisco, Foundry, Alteon) and SAN and NAS equipment from EMC, Dell Compellent, Netapp, Gadzoox, Voltaire, and HP
TECHNICAL SKILLS:
Microsoft Centric Development Tools: Visual Studio 97- .Net 2012, .NET Framework 1.x-4.5, Crystal Reports 8-11, SQL Server 2000/2005/2008/2012 with OLAP Analysis Services and MDX, DTS, Reporting Sservices, IIS, WCF, WWF, WPF, MSXML 3-4, ASP/ASP.Net, ADO/ADO.Net, Visual SourceSafe, AccuRev, PVCS, Photoshop, In2 Design, Acrobat Scripting, Flash, Dundas Components, Corgent, Telerik Components
Java Development Tools/Software: Eclipse 2.x-MARSx, IBM/Rational, Netbeans 5.x-7.x, Jbuilder 3.0-2005, JDK 1.1.x - 8, Together IDE v6.0, Visual Caf, Apache Tomcat 5.x - 8.x, TomcatEE, GlassFish, WebLogic, Struts Framework, JBoss, JUnit/JUnit EE, Ant, Log4J, WebObjects 4.5&5.0, Sonic MQ v3.0-v5.x
Open Source Tools/Software: GCC, G++, Apache Hadoop, MySQL, PostgreSQL, MongoDB, Hibernate, Apache, Tomcat, Maven, CVS, Spring, Globus, Glassfish, Jetty, Jboss, BIRT, Liferay, JQuery, GWT, Python
Other Software Packages: Intel Parallel Studio XE, IBM/Rational RequisitePro, Clearcase, ClearQuest, System Architect 6, Sparx System Architect 6-9.x, Embarcadero ERStudio 6.x-7.5, Adventnet Simulation Toolkit 5, Oracle 11i, BroadVision One-toOne, PowerBuilder, Actuate eReporting Suite 4-5, Cognos 6.5-7, Business Objects 4-5, ErWin 3.x/4.x-7.x, Borland Visibroker 4.5 VMWare 3.x-10, VMWare Infrastructure, ESXi, vSphere, RHEV, Virtualbox, Xen
PROFESSIONAL EXPERIENCE:
Confidential, Windsor Mill, MD
Hadoop BigData/Analytics SME
Responsibilities:
- Built datalake pilots and production deployment with multiple production tiers for first modern datawarehouse migration utilizing Hadoop
- Provide roadmaps and integration guidance for multi-tenancy and multiple streams of data pre-processing and ETL as well as custom processing flows
- Built custom automated provisioning and deployment framework (custom Chef/Puppet), utilizing BASH, Python and a PHP web front-end to deploy a 100 node cluster using Ubuntu and Cloudera CDH3.x - pre Cloudera Enterprise Manager
- Using kickstart preseed scripts with custom DNS, NTP infrastructures
- Incorporating Satellite server and RedHat specific platform tools
- Deployed Hadoop prototypes on Virtual Infrastructures VMWare, RedHat EV, VirtualBox for verification, validation and testing.
- Provided pilots using on-premise and cloud Greenplum and PostgresSQL integration with Hadoop
- Provided cloud-based pilots using Amazon Redshift for cloud-based Postgres MPP architectural validation
- Provided cloud-based pilots using Amazon Aurora for MySQL and Postgres architectural validation for customized queries and workloads
- Developed and integrated automated processes for custom batch and near-real-time streaming data feeds for over 20 data applications
- Created ETL workflow process and scheduling mechanisms as well as scripts and MR jobs to extract and transform a variety of data sources including Raw Text, CSV, LogData, EBCDIC to ASCII, DB2, Oracle CSV dumps and Change Data
- Created architectures for scaling big data/Hadoop infrastructures over numerous tiers to fit within an organizations on premise, hybrid and off-premise pure cloud infrastructures
- Provided key guidance on security assessments and implementations as it relates to data at rest and in motion, as well as encryption and integration with a variety of security vendor tools and infrastructures
- Developed off site disaster recovery (DR) architecture and the implemented scripts, leveraging Hadoop to Hadoop distributed copy mechanism (DistCP) from a secure cluster to secure cluster standpoint without Cloudera Manager.
- Provided development of enterprise DevOps scripts for automating multiple cluster management functions.
- Provided and guidance to multiple areas and team in virtual deployments of various software suites and tools
- Provide key configurations with PostgreSQL 8 and 9.x for enterprise data repositories as well as custom data stores for short and long term storage. Troubleshoot critical production issues with PostgreSQL ODS’s and back-end systems for Hadoop.
- Provide roadmaps for leveraging different storage tiers including how to use flash-based/SAS-based/SATA-based storage technologies
- Successfully helped piloted a Mainframe to Hadoop architecture and application, which served as one of the success stories of legacy modernization within a federal agency.
- Designed and developed a Kerberos implementation using custom Java code
- Implemented custom RESTful integration with Jersey libraries for complete Read/Write/Append of data on HDFS
- Implemented custom security code to enable secure Kerberized integration with Javabatch data uploads from Z/OS systems as well as Webseal integration with Active Directory and secure Hadoop systems
- Helped build custom interfaces and configurations to integrate and troubleshoot technologies such as RedHat FUSE ESB
- Provided guidance, integration and review of emerging/complementary technologies such as Spark, Accumulo
- Developed prototype demo with Federal and Contractor Team members for ACT-IAC Igniting Innovations 2015, which the Team won an Individual Innovation as well as placing 2nd on the overall Innovation .
- Provide security integration and piloting of Cloudera Navigator, Sentry and Java Keystores and Truststores (KMS)
- Developed guidance steps and provided key material to help make Hadoop reach internal audit compliance and security compliance for federal Authority to Operate (ATO)
- Provided architectural guidance and configuration to Tableu 9.x Server and Desktop to integrate with Greenplum and Secure Hadoop CDH 5.3.x utilizing Kerberos
- Key member of 90day fraud initiative using Python and Hive to provide fraud analytics to extract and evaluate data patterns and flags which could trigger fraudulent activities
- Provide Research and Development in developing prototypes using GPU-based computing to evaluate data processing using GPGPU hardware.
- Used NVIDIA Fermi Boards (m2090) and CUDA and Python, Theanos, PyCUDA libraries to evaluate algorithms and programs to process various data streams
- Used Intel Parallel Studio XE 2015 and tested Xeon PHI co-processes
- Piloted Deep Learning mechanisms using NVIDIA Maxwell (Tesla M40) and NVIDIA 1050ti cards
- Provided architectural design and prototype for web-based token mapping and custom security components for Active Directory, IBM Webseal and Oracle Weblogic system for conversion of password to CAC - based conversion for over 70 applications.
- Provide recommendations regarding enterprise hardware and software key management solutions from Gemalto and Vormetric as well as detailing requirements of custom HSM solutions
- Customized and converted Spring 2.x and 3.x applications to utilize password-less authentication
- Provided PingFederate 7.x and 8.x pilots and custom deployments detailing steps and process flows for identity management and integration with AS-IS and TO-BE designs for custom development
- Provided Ansible and Vagrant -based blueprints and road map for deployment of custom DevOps solutions leveraging Akana, IBM Bluemix detailing an on-premise and Hybrid Cloud solution using OAuth2 and OpenID
- Provided detailed analysis and recommendations of Agile processes for managing development/deployment sprints as well as improving the structure and organization of the workflows
- Demonstrated on-premise and cloud pilots utilizing PingFederate on both VMware ESX and Amazon Elastic Cloud instances
Confidential, Dallas, TX
Enterprise Solution SME/Integration Consultant & System Owner
Responsibilities:
- Reviewed and help improve architectural designs and design documents and provided consulting guidance and lead in performance tuning load-balanced multi-instance WebLogic 10.3.x systems
- Served as Consultant/System Owner for Federal Enterprise Archival Project coordinating and managing multiple concurrent deployments to multiple labs and to production facility while coordinating with developers, COTS personnel, Testers and business line managers to execute the necessary pre and post-deployment tasks and activities extensively dealing with clustered Weblogic 10.x, webMethods, Marklogic 4.1, Oracle 10g RAC, Velocity Search Engine
- Provide deployment risk analysis and execution plans for moving between major releases
- Provide analysis and communications to key stakeholders regarding the entire application deployment lifescycle
- Provide guidance and management of automated deployment scripts and modules for complete deployment and logging solutions
- Provide critical system integration and troubleshooting support of lab, staging and production systems
- Coordinate and schedule resources for deployment and product support during phased rollouts
- Provided Oracle RAC and MySQL Enterprise Cluster administration, support and troubleshooting
- Provided troubleshooting and integration support with running Oracle on shared storage NAS (NetApp) filers
- Performs routine dba duties including creating/deleting of databases and objects, manage users, tuning of instances
- Provided support in creating standard and materialized views to support ad-hoc reporting
- Provided staging/production lifecycle support for weekly to bi-weekly rollouts and updates
- Modified/Tuned PL/SQL Sequence Monitoring/ETL scripts and packages
- Provided cluster configuration and troubleshooting on data, mgmt nodes and cluster engine for MySQL Clusters
- Provided RMAN Guidance in Backup/Restore protocol and operations as well as hot backups for operational application deployments
- Provided integration support of Sun One LDAP and OpenLDAP including writing exports to ldif and authoring/modifying LDAP changes as well as with ldif scripts
Enterprise Architect/Software Architect
Confidential
Responsibilities:
- Served as Senior JAVA Architect/Consultant on the Grid Architecture Team in re-engineering portal system utilizing Liferay, portlets conforming to JSR 168 & JSR 286 incorporating Jquery and IceFaces along with custom built components while leveraging and extending the functionality of Globus Grid Toolkit and open source clustering technologies in building next generation grid and cloud infrastructure using HADOOP and MAP/REDUCE framework for a cluster of over 2000 cores connected to an Voltaire infiniband-based SAN with over 1 petabyte of data and towards supporting bioinformatics and biomedical research. Rebuilt security framework using JAAS, GSS-API, Apache Axis, and Kerberos while extending reach and compatibility to legacy infrastructures and security domains incorporating other disparate security mechanisms and realms including service credential delegation, CA cert management, CAS, LDAP. Developed imaging infrastructures with VTK/ITK toolkit, DCM4CHE, as well as ImageJ to address medical imaging workfolws including anonymization, transformation and segmentation of DICOM images and creating a web system to dynamically generate cooperating applications and views to manage and orchestrate the workflows of medical clinicians and technicians.
- Utilized Google Web Toolkit to in corporate AJAX and Javascript for more robust RIA application in re-engineering a Grid dashboard and system monitoring application.
- Built a prototype agent system as an alternative system to the Grid Services mechanism for distributed invocation, communication and messaging using Aglets and ActiveMQ.
- Built and tested OSGI bundles using Pax Construct scripts to package and manage web and web service deployments integrating with OS Workflow for a re-engineered workflow testbed project using Equinox and Apache Felix.
- Provided consulting in architecting, building and deploying a retail backoffice ERP virtualization rollout on Dell PE 2950s using VMWare Server 1.0 and VMWare ESX 3.5 for migrations of systems with VMWare 5.x/6 workstation instances and enterprise Exchange and SQL Server database systems, respectively; remotely managed and configured using VMWare Infrastructure VirtualCenter and Infrastructure Client while integrating with a parallel and legacy systems.
- Implemented Custom Retail ERP and Commerce System
- Implemented Firebird database systems for inventory management control.
Software & Solutions Architect/Satellite Systems & Embedded Software Designer
Confidential
Responsibilities:
- Served as Senior Software Architect in developing system requirements, project plans and resource allocation, implementation schedules as well as infrastructure evaluation and integration in building next generation of Satellite Network Management Systems made of custom service/driver components and incorporating 3rd-party components in providing a framework for M&C (Monitor and Control) of communications assets on and end-to-end basis, from the VSAT (very small arpeture terminal) remotes to the RF Chain to the Terrestial Chain. System serves as a central aggregation point in integrating a diverse heterogeneous environment of equipment and technologies including Vertex, Newpoint, iDirect, Linkway, ZenOss, Nagios, etc.. System initially provided 3 core modules of functionality in the areas of asset management, Service Level Agreement management and reporting, and custom profile configuration management. System also include alpha and beta modules that integrated with GIS applications and geospatial databases, SNMP communications and terrestrial network integration including integration with open source network management systems such as Nagios and ZenOss, customized forward chaining rule engines and automation scheduling.
- Built automated custom help desk ticketing system with SOA features of web services for third party ticket creation and internal process orchestration to manage and help streamline the workflow of a satellite NOC operation.
- Provided data management and analysis through scripting ETL scripts using perl, linux shell scripts, windows batch and vbs(visual basic script), and stored procedures and triggers to feed reporting system which processed communications data and provided performance metric reports for a federal managed network service contract.
- Assist in compiling Asterisk and Trixbox custom builds and modifications and provided 3rd tier support for Cisco Call Manager and Asterisk Server implementations as well as other telephony installations and maintenance.
- Built custom bootstrapper and deployment packages using Microsoft and Macrovision Installshield 11.5 technologies for custom VSAT software deployment and instituted a better CM process to manage and organize software delivery.
Technical Project Manager/Software Architect
Confidential
Responsibilities:
- Served as Lead Architect and IT Manager of large Report Monitoring System in designing and developing additional modules of functionality for production system based on a Microsoft-centric architecture utilizing ASP/Visual Basic/MSMQ/ SQL Server 7 & 2000, while transitioning to a J2EE architecture of Oracle 10g App Server and 9i Database, JSP/JSF/Servlets. Extended reporting and distribution capabilities using Crystal Reports, ActivePDF while adding Web Services to share data with other contract partners. Provided performance tuning and key integration modules to facilitate data integration with an internally developed travel application with backoffice accounting system.
- Worked with Danya VP of Headstart and Director of Headstart to implement scheduling improvements as well as travel expense and data ingestion with Travel agency transactions into the HSRT system as well as dealing with PRISM changes and implementations considerations for upcoming releases; helped provided database query tuning to improve schedule builds and tuning for the monitoring and review process
- Worked with all Region Coordinators in collecting and disseminating data and statistical analysis as it relates to regional review activities and support
- Managed and reviewed contractor SOWs, work schedules and code reviews as well as providing architectural guidance and integration support
- Provided consulting and development services to an ASP.Net and Windows Application with Visual Basic.Net utilizing Web Services to a multi-tiered migration project from TANDEM to Windows 2003. Scripted automation processes while supporting a SQL Server 2000 back-end through building stored procedures and user defined functions. Developed custom queries and XSLT transforms that were utilized within MSMQ Messaging Tiers for processing data transforms from the TANDEM system into SQL Server and with transactions and transaction logs.
- Monitor and updates defect reports in Rational ClearQuest and advises on improvements in SCM process and procedures
- Lead conversion and migration of ASP website pulling together two different sites and a number of internal data sources to ASP.Net utilizing C# Web Forms and ADO.Net . Built administrative application which served as a data dashboard and allowed single view aggregation of internal/external data. Added RSS newsfeed subscribe and publish capabilities using regular expressions to parse data and insert into SQL Server 2000 and extract and modify as XML and created web service to allow interfacing with remote office application Built testing application framework to unit /performance test the functionality of the business logic as well as back-end tier. Provided internal to developers to bring them up to speed on .Net capabilities and provided configuration management guidance and administration using Visual Sourcesafe.
- Provided virtual Architect and virtual CTO guidance and leadership consulting to customers and clients who require high-level architecture guidance as well as mapping out technology vision through strategic engagements
- Lead development team in bringing wireless embedded PDA product from idea conception to prototype to beta testing stage using Appforge (embedded VB) and MS eVB and eVC for Texas Childrens Medical Center. Re-engineered database and application by building server level components using MS Visual Basic 6 as a middle tier to handle wireless connection pools and server as authentication server. Developed stored procedures to implement fast store/retrieve mechanisms for patient entry and to handle ETL of external data.
- Served as primary architect/developer for storage and backup portal utilizing IIS, WebLogic, and Sybase Adaptive Server 11.9.2 backend. Designed and developed extensions to Archived Information Storage and Retrieval (AISR) framework and set up and configured and administered WebLogic 7 server and configured custom adapters for access to legacy systems.
- Directed and lead configuration of new LAMP custom configurations and implementations incorporating Plesk, Cpanel, and Ensim.
- Provided technical guidance on Oracle 11i implementation as teaming partner of federal contractor for Presidio Trust, coordinating Metalink trouble tickets, setting up and configuring servers, provide monitoring, performance tuning, and troubleshooting of local and remote systems
- Provided Oracle development consulting to fix major USDA implementation problem connecting to disparate databases of IBM DB2 (on RS6000 and S/390) and Oracle 7.3 using Developer 2000, perl and batch scripting. Built Installshield and Demoshield packages to deliver custom solutions to implement fix.
- Rewrote Neonatology software porting from Delphi 3 using Paradox to Delphi 7 untilizing MySQL and SQL Server 2000. Used Embarcadero RapidSQL to rebuild tables and tune database.
- Configured and tuned Sendmail and Qmail MTAs to serve as major SMTP gateways for corporate network of over 400 nodes connected to 3 remote offices. Migrated inbound/outbound mail handling processes from internet and extranet applications using Jmail, JavaMail APIs.
- Managed day-to-day operations of 24/7 datacenter setting up and configuring Netscreen and PIX firewall and firewall policies and rules, Cisco routers and switches, and configuring Cisco, Foundry and Alteon load balancers.
- Managed a diverse SAN environment architecting and configuring HA equipment (NetApp NAS appliances and Clariion SANs) and applications which manage over 500GB of data using Veritas Volume Manager and Veritas VM Storage Administrator.
Confidential, Silver Spring, MD
CTO
Responsibilities:
- Provided business as well as technical strategy leadership to improve product line and positioning in growing ASP market. Confidential ultimately became a top 100 ASP company as reported by Gartner in 2000.
- Served as senior architect for Confidential TCMS Middleware product and it’s ASP service offerings.
- Managed all aspects of 24/7 Datacenter operations including security, networking, monitoring, server configurations for true High Availability and Scalability Systems including Compaq, XIOTech Magnitude and Sun Enterprise Systems. Directed network requirements, analysis, impact assessments, design and lead installations and upgrades of network equipment and infrastructure, and isolation and correction of network outages and performance problems.
- Provided technical/engineering leadership to a small team of software developers and network engineers in detailing QA and Production protocols and managing PVCS repositories.
- Provided software configuration, management and maintenance to both QA and Production environments to an electronic permits application startup utilizing IIS, Jrun 3 and Oracle 8i on Windows NT 4.
- Served as Team lead in developing and implementation of prototype applications including MacOS8 client/server application porting from FoxPro to a RealBasic front-end with a PrimeBase backend
- Served as lead developer for a WebObjects 4.5 prototype of video streaming web application utilizing the categorization and displaying and streaming of Apple QuickTime clips
- Managed source trees for development projects with PVCS configuration management tools
Confidential, Silver Spring, MD
Chief Scientist/Lead Architect
Responsibilities:
- Developed prototypes for funding purposes including Arlington National Cemetery prototype which was a web-based application for finding coordinates of burial locations through different prebuilt queries. Built using IIS, ASP, Visual Basic Custom Components, and SQL Server, this application utilized special conversion techniques implemented as an ISAPI application with Visual C++ custom classes and ISAPI extensions to extract information from death s which were on microfiche and converted to .TIF files. Presented demo to former Senators Charles Robb of VA, and the late Senator Paul Wellstone of MN.
- Developed BioTerrorism prototype which was presented to CDC to present different ways of information dissemination utilizing signed java applets which grabbed information off of a central database server that pulled nightly information feeds from a variety of bioterror sites.
Confidential, Sterling, VA
Telecommunications Consultant
Responsibilities:
- Consulted in architecture of Switch Partitioning and Provisioning System (SPSS) utilizing Java client connected to an Oracle 8 backend which communicated with Lucent 5ESS switches in Greenville, SC.
- Developed Perl 5 scripts to retrieve data from Oracle 8 database and formats and sends them to the switch gateway via sockets connections, screen scrapes the data and inserts the status back into the database.
- Provided database design improvements using ErWin 3.5 and database administration and performance tuning of sql queries
- Configured and administered Solaris 2.6, Apache 1.3.1, Samba, Perl 5 on Sun Enterprise Servers
Confidential, Bethesda, MD
Programmer Analyst
Responsibilities:
- Developed ETL scripts to extract data from IBM S/370 mainframe and transforming and loading it into a Visual Foxpro custom application using Perl 5 and Data Junction. Created automated upload/download utilities to perform nightly backup and restores of data for application.
- Wrote console based server application using Visual C++ 5.0 to serve as a simple request broker to handle and delegate requests for a prototype help desk application that interfaced with custom Activestate Perl scripts which served as a request parser and rules engine interface.
- Developed calendar based web component of intranet using Visual Café, dbAnywhere, and MS Access.
- Served as team lead for technical staff of 8, managing a central office and a remote office of over 200 systems. Headed migration efforts from upgrading systems (LanManger to NT3.5/NT4) to applications (MS Mail to Exchange 5.x) . Designed and documented protocols and procedures for large scale roll outs and backup and recovery procedures.
- Built Office 97 Excel add-ins using Visual C++ 4.0 to develop the in process dll’s for loading, parsing and converting legacy data from Lotus files and mainframe datasets, and utilized VBA to handle scripting of routine calculations and functions.
- Built monitoring scripts to monitor and manage a pool of 20+ servers including install scripts with SMS deployment packages.
- Managed roll out of 3-tier Oracle Application, from setting up local Oracle instance to rolling out Oracle Reports Servers and Clients.
- Prototyped data dissemination mechanisms using DB2 Net.Data for web applications and Visual Basic with DB2 CAE and DRDA
- Ported Powerbuilder 4 travel application from 2-tier client/server built with a SQL Anywhere v5 to 3-tier system utilizing Visual Basic, ASP/IIS and SQL Server 6.5.
Confidential, Wheaton, MD
Network/Systems Engineer
Responsibilities:
- Develop and update custom DBIII/DBIV database for managing travel schedules and client relationships
- Wrote DOS batch scripts to automate data sharing and loading between remote offices, built custom script chooser/loader menu app using Turbo C++.
- Develop macros for WordPerfect and Lotus 123 applications
- Setup, configure and manage network running System One on NCR systems
- Provide application support and troubleshooting for local network of Windows 95/WFW systems and remote connections to central office.
Confidential, Silver Spring, MD
Technical Sales Consultant
Responsibilities:
- Provide technical sales information and support to field sales regarding IVC product lines
- Configured, Setup and Troubleshoot IVC Captioning Products for local demos, trade shows and at client locations
- Configured and maintained custom accounting, inventory and sales tracking application