It Solutions Architect/manager And Aws Emr Solutions Architect/big Data Scientist Resume
5.00/5 (Submit Your Rating)
Portland, OR
SUMMARY:
- Confidential is an IT Solutions Architect and Big Data Scientist with Certified Hadoop, Storage, Cloud, Database, OpenStack, and Virtualization experience.
- Experience with BigData, HDFS, Amazon AWS, Amazon S3, Google Cloud Platform, Amazon RedShift (Columnar DataWarehouse), PGBouncer(PostGreSql Connection Pooler), Podium Data(BigData Analytics), Apache AirFlow(CronJobs Scheduler), MicroStrategy (Analytics), Tableau(Reporting), MapReduce, Hive, Spark, PIG, Ceph Object Storage, Ceph Block Storage, Ceph FileSystem, OpenStack (Platform7, RHEL OSP7, Director, Errata), Mirantis (Kilo, Sahara, Kubernetes, Fuel), LXC Containers, Docker.io Containers, Docker Links, Docker Compose, Docker Orchestration (Kubernetes, Swarm), Google Borg(Large scale Clustering), Bamboo for scheduling Docker Builds, Platform9, Cloudstack, Nebula, and Rackspace including architecting for Big Data, Public, Private, and Hybrid Cloud environments.
- Experience with design and automation of Infrastructure as a Service (IaaS) and Platform as a Service (PaaS), and Environment as a Service(EaaS) including virtual networks, virtual machines, cloud services, web sites, and data services.
- Experience using Cloud Foundry OSS, BUSH, Ruby, Go. Experience with Chef, ChefDK, Puppet, Puppet Manifests, and Ruby programing.
- Experience with scripting, developing, and reverse engineering Big Data. Development experience using Hadoop HDFS, Spark Streaming using Cloudera, Data Analytics, Mahout Machine Learning, and code debugging.
- Experience using RESTful APIs, PowerShell, Python, Scala, Perl, Ruby, C, C#, Java, Go, and WFA scripting. As storage expert, heavy experience with Storage Array Clusters, Cloning, Snapshots, Mirroring, and Replicatioin.
- Experience with VMWare Datastores, VMWare VMotion. Experience with Oracle, DB2, Sqlserver, and MySql. Experience with CIFS Administration.
SUMMARY OF QUALIFICATIONS
- Data Center Management
- Chef, ChefDK, Ruby
- Nagios\OpsView
- RedShift, PGBouncer
- Podium Data.
- Ceph Object Storage Clustering, Crush rules, RADOS, LIBRADOS, RADOSGW, RBD, CEPH FS
- EMC ScaleIO Block Storage
- Ruby, RubyOnRails
- Graphte, Grafana scalable realtime graphing
- Cloud Foundry, BUSH, Ruby, Go
- Java, Java Script, C, C++, HTML, HTML5, XML, PowerShell
- NetBeans IDE, Eclipse, Visual Studio
- CI Tools: Electric Commander, LSF, GitLab, GitLab CI
- Hadoop, Hive, HDFS, Hue, Impala, Apache Drill, MapReduce, Cloudera
- Google Big Query (Dremel) experience.
- Hadoop machine learning with Mahout learning algorithms.
- Hadoop MapReduce Unit testing using MRUnit, ApprovalTests.
- Hadoop for Windows Azure using HDInsight and HortonWorks Data Platform for Windows
- Hadoop D3.js for Visualization of MapReduce data including HeatMap and Animated charts/graphs.
- Apache Ranger (Decentralized Data Security)
- Ember.js for Ambiguous Web Applications
- Hadoop Data Scientist: Text Mining, Index Building, Patterns, Graphs, Filtering, Predictions, Risk Analysis, RegExp patterns.
- Hadoop SDK experience.
- Puppet, Puppet Manifests
- Code debugging and log reverse engineering skills
- OpenStack KVM
- OpenStack Cinder, OpenStack Liberty, DevStack
- Platform9 Managed OpenStack
- VMWare,Vcenter,Vsphere,VMotion, VCops
- SolidFire Storage Arrays SF2405, SF4805
- Pure Storage Arrays
- Nimble Storage Arrays
- Storage RESTful APIs, S3, Swift
- Cloudstack RESTful APIs
- RESTful JSON API with Ember.js experience.
- NetApp CDOT and 7Mode experience.
- Storage Clusters, Vservers, VFilers setup.
- Storage Non Disruptive Upgrade.
- Storage OnCommand Unified Manager setup and training.
- Data Center Disaster Recovery Planning.
- Storage Raid and Helix Data Protection
- HDS Storage, HiCommand, HP Data Protector
- Commvault
- IBM DS8000, V9000 All Flash Arrays
- 3PAR StoreSrv 8000 Series, Adaptive Flash Cache, Adaptive Optimization, Storage Federation and Replication.
- Dell Compellent and Equilogic
- Storage Data Storage performance tuning.
- Oracle Disaster Recovery Planning.
- VSphere, VirtualPC, Citrix.
- Database Storage tuning.
- MongoDB, CouchBase, Cassandra
- Data Warehousing, Data Modeling, Erwin
- SAN expertise.
- LUN Design Layout and Architecture expertise.
- Virtualization expertise.
- V - Series expertise.
- Exchange(SME)
- Share-point (SM-sharepoint)
- Virtual Infrastructure(SMVI)
- Escalations engineering expertise.
- SAP Oracle BRTools implementation and production support.
- Veritas LUN Storage Layout and Architecture.
- MySql, MySqlWorkBench, SqlLite, MongoDB, CouchBase, Cassandra
- Oracle data migration.
- Oracle Golden Gate.
- Data Center Architect / Senior Production and Development ORACLE and SQL Server Database Administrator SQL Server to Oracle data migration.
- Data Center migration.
- Oracle RAC (Real Applications Cluster) support.
- Oracle Change Data Capture and Oracle Streams experience.
- Partitioning (Oracle Partitioning and Quest Partition Magic)
- Business Objects (Crystal Reports).
- Setup of FireWire based shared storage on red hat Linux for Oracle RAC 10g.
- Setup storage on Suse Linux for Oracle RAC 10g.
- Programmer (Java, J2EE, C/C++, C#, SQL; T-SQL, PL/SQL, Perl, Scala, Python, Korn, Bash, CMD PowerShell Scripting).
- Oracle SAP, Oracle PeopleSoft, Oracle database installation and support.
- DB2 UDB Database Administration.
- MySql DB Administration and sql scripting.
- OLAP, Data Warehousing, Building data marts and rollups, Data Mining, Data Clustering, Time Series, Sequence Clustering, Association Rules, Neural Networks, Linear Regression, Logistic Regression
- Microsoft Sql Server Analysis Services (SSAS), visual Studio Data Mining Structures, Models, Correlations, Cubes, Dimensions.
- IBM Cognos, Cognos Analytics
- Oracle BPEL - Business Process Execution Language for e-business process integration .
- Content DB Management through BPEL using Oracle.
- Application Server(Web-Sphere, Web-Logic, IIS)
- UNIX (Solaris, AIX, HP-UX, Linux, Ubuntu, CentOS) and WINDOWS system administration, including clustered systems.
- Experience with Amazon EC2 Virtual Server Hosting
- Rational ClearCase.
- 7 years experience in Healthcare Industry
- 8 years experience Telecom Industry
- Experience facilitating large-scale Data Center migration including script conversion, technical innovations, staff development, negotiation and coordination with many diverse people
- Big Data, Cloud Foundry, BUSH, Scale out Clustering
- Palo Alto Networks, Arista, Cisco, Juniper, F5 Load Balancing
TECHNICAL SKILLS:
- Hadoop Big Data 10 MapReduce, Cloudera, HortonWorks
- AmazonWebServices(AWS) 10 EMR, S3, RedShift, PGBouncer, DynamoDB, Glacier, RDS, EC2
- Oracle DBA and MySql DBA 10 ASM, and RAC experience
- NetApp and 3PAR Storage Architect 10 NetApp Cluster Mode, E-Series.
- OCI, RESTful API, WFA 10
- DataCenter Experience 10
- Hadoop, MapReduce, Spark 10 MapReduce Optimization, Spark Streaming
- Data Center Migrations, Replication, 10
- Oracle Golden Gate 8 Oracle. SqlServer, DB2
- DB2 5 IBM AIX
- Sybase 2
- SQL Server DBA 8 (T-SQL Scripting, Replication 64 bit windows 2003 Server) 8
- T-SQL Scripting 7 (SQL Server T-SQL scripting)
- UNIX System Administration 10 (RHEL, CentOS, AIX, Solaris, HP-UX)
- Chef/ChefDK/Ruby Poppet 10 Ruby 5 yrs. Puppet 3 yrs.
- Chef/ChefDK development 5
- SQL Programming 10 (incl. Optimization, Profiling and Trace Analysis)
- PL/SQL Programming 10
- Scala and Python 10
- Perl Scripting 10
- Java/J2EE, HTML, XML, Ruby, RubyOnRail, JavaScript, JSON 7
- (WebSphere managed and container j2EE Programming), JSON, Java Script
- RESTful APIs, 3 SolidFire, NetApp, OCI, 3PAR, OpenStack, CloudStack 3
- Cloud Foundry (Paas) 3 EMC, NetApp, VMWare
- BUSH 2
- Business Objects 5 (Crystal Reports)
- KORN Shell Programming 10
- BASH Shell Programming 10
- C/C++, Eclipse 10
- HTML5 10
- AIX/UNIX/LINUX 10
- Technical Documentation 8
- TCP/IP Networking 10
- PC Hardware 10
WORK EXPERIENCE:
IT Solutions Architect/Manager and AWS EMR Solutions Architect/Big Data Scientist
Confidential
Portland, OR
- Architected and Converted informatica ETL jobs to Spark and SparkSQL scripts to be ran on Amazon Elastic MapReduce Clusters.
- Architected and Migrated Teradata Schema to RedShift and created Master DB on RedShift replacing Teradata and Informatica.
- Architected and Developed Spark and SparkSql scripts to migrate data from Teradata into AWS-RedShift.
- Architected and Developed Sqoop scripts to pool data from Teradata into RedShift.
- Architected and Developed custom Apache AirFlow jobs to schedule ETL jobs written in SparkSql.
- Architected and Developed PGBouncer connection pooling data between PostGresSQL and RedShift.
- Architected and Developed Custom Python Scripts with embedded Sqoop and Spark calls. Used PySpark, Scala, Python-shell.
IT Solutions Architect/Manager and Data Scientist
Confidential
San Jose, CA
- Involved in Pre-sales and Post-sales Data Center Architecting and implementation of storage SaaS arrays including Non-Disruptive upgrade.
- Architected and developed CookBooks using ChefDK for 500 up to 2000 hosts
- Architected and developed Puppet manifests using Puppet Enterprise for over 2000 hosts.
- Certified Instructor/motivator and executive management experience over technical and business resources numbering over hundreds.
- Developed customer relationships and advised customer technical resources on software/hardware purchases, architecture, and future vision drivers.
- As Big Data Architect developed Hadoop MapReduce chaining in Java Programs and deployment using Cloudera Enterprise.
- As Big Data Scientist wrote HDFS and MapReduce programs for Hadoop clusters with near 500 nodes, and used Cloudera environments for deployment and monitoring of clusters.
- Developed resources to setup and administer MySql, Cognos, and Cassandra Databases for NetApp OCI, and 3PAR product lines.
- Developed RFPs, RFQs, and RFIs. Developed and Delivered technical product demonstrations, and Proof of Concept (POC). Setup virtual Storage, Vservers, Snapshots, Clones, Backups, Vaults, Replication, Mirrors, and Syc-Mirrors.
- Worked as Instructor and Implementation Architect on SolidFire, NetApp, EMC, and Pure Storage Arrays. Also, Installed and Setup NetApp, EMC, Pure, SolidFire, and Nimble Storage Arrays.
- Worked on projects for IBM clients as Storage Architect including companies such as Genentech, and Hertz.
- Worked on a clustered Hadoop for Windows Azure using HDInsight and HortonWorks Data Platform for Windows. And, Continuous deployment using GIT in Azure App Service.
- Worked with NetApp customers for migrations and data-layout on NetApp Arrays connecting to Unix, Linux, and Windows Servers.
- Developed Adaptive Quality of Service (QOS) solutions using WFA, REST APIs, Python scripts, Perl scripts, Graphite scalable realtime graphing, and PowerShell scripts.
- As Data Architect, developed Storage for best performance and high availability, and Disaster Recovery. Setup Pure Storage Arrays, Setup SolidFire All Flash Storage Arrays.
- Also, setup HDS HiCommand, and used HDS HiCommand CLI scripts to automate monitoring and automated HDS storage arrays. IBM Cognos experience.
- Developed PaaS Cloud solutions using Cloud Foundry, OSS, Ruby and Go scripting.
IT Solutions Architect Executive and Data Scientist
Confidential
Los Angeles, CA
- Worked with IBM customers and managed Amgen and Hertz accounts for all Data Center Storage Design and Architecture.
- Architected and developed Chef CookBooks and recipies.
- Architected and developed Puppet manifests using Puppet Enterprise for over 500 hosts.
- Managed design and implementation of new production databases on IBM N-series Storage. Managed Volume/LUN Layouts.
- Managed Veritas LUN Layout. Used Database Server monitoring and capacity management (Quest Spot-light, Net-IQ).
- Reverse engineered DB2 databases and convesion of schema to Oracle and allocated LUNs on N-Series Storage.
- Worked MySql DB setup for NetApp OCI. Creation and maintenance of Oracle with Golden Gate and Oracle RAC databases on EMC and NetApp Storage.
- Implementation of Oracle database on IBM AIX, Solaris, and Linux on IBM, Amazon EC2 Virtual Hosting, Ubuntu, CentOS, EMC, and NetApp Storage.
- Design and implemented Oracle to manage business process integration on EMC and NetApp Storage. Design and implemented SAP Oracle BRTools on IBM DS8000, EMC and NetApp Storage Appliance. Design and implemented Oracle Veritas Cluster and wrote shell scripts for NetApp backup/recovery. Managed DB content using Oracle Grid Control NetApp Plug-in and SnapManager for Oracle.
- Oracle and PL/SQL script tuning for NetApp Storage.
Southwest Airlines, Dallas Texas
Senior IT Solutions Architect and Data Scientist
- Worked on Non-Disruptive Upgrades (NDU) of NetApp Storage, and worked on Data Center migrations. Worked on tuning and performance enhancements of two 4 node 4TB production databases.
- Worked on Daily MySql DBA tasks involving management of all production, QA, Dev databases over 38 TB in size.
- Developed scripts for RMAN backups. Developed scripts for MySql backups. Developed GridCntrl jobs to run RMAN backups in place of cron.
- Worked on setup of MySql and Oracle RAC srvctl and CRS, voting disk. Worked on setup of DataGuardBroker to automate fast failover. Worked on setup of DataBuardBroker using GridCntrol to monitor DG performance.
- Worked with the Linux Admin to fine tune OS settings per recommendations on Mysql. Worked extensively on debugging using Oracle Metrics and Policies threshold settings. Worked extensively on debugging Oracle RAC OCR environments and in conjunction with Oracle Golden gate.
Confidential & Confidential, FL
Senior Storage and Database Solutions Architect (Oracle-SAP) and Data Scientist
- Worked on tuning and performance enhancements for a 7TB SAP production database.
- Worked on Non-disruptive upgrades of NetApp OS, and worked on migration of Oracle 1og RAC from Solaris9 and solaris 10 and AIX to Linux Red Hat VM Oracle 11g for development and QA test environments on NetApp Storage.
- Worked extensively with the Storage Architect designing and architecting Oracle 11g Virtualization environment on NetApp Storage.
- Setup and tested Oracle 11g VM on NetApp Storage. Used SAP OSS Notes to verify Oracle settings per SAP recommendations for NetApp storage.
- Worked on Daily DBA tasks involving management of all production, QA, Dev databases of over 28 TB in size. Developed scripts for RMAN backup using cron. Developed GridCntrl jobs to run RMAN backups in place of cron.
- Worked on setup of DataGuardBroker to automate fast failover. Worked on setup of DataBuardBroker using GridCntrol to monitor DG performance.
- Worked extensively with the SAP team on performance tuning, index builds, and SAP recommendations. Worked with both NetApp and IBM DS5300 storage team to fine tune LUNs and file system layouts related to SAP and Oracle.
- Worked with the AIX and Solaris Admins to fine tune OS settings per recommendations on Oracle Metalink and SAP OSS notes.
- Worked on Oracle Streams - Capture - Replicaiton - Propegate to replicate specific tables, tablespaces and whole database.
- Worked on Oracle Golden Gate to replicate data across heterogeneous databases (from Oracle to SqlServer, MySQL). Worked extensively on debugging using Oracle Metrics and Policies threshold settings. Worked extensively on debugging Oracle RAC OCR environments and in conjunction with Oracle Streams usage.
Confidential - Sunnyvale, CA
Senior NetApp Storage Architect / Database Storage Solutions Architect / Data Scientist
- Implemented NetApp Snapshot, SnapMirror, FlexClone, FlexShare, SnapVault for Oracle.
- Worked with NetApp customers for all oracle 10g and 11g migrations from Solarisxx to Linux Oracle VM.
- Worked with NetApp customers for all Oracle 10g migrations from AIX to Oracle 11g Linux VM. Design and implementation of new product databases on Confidential Storage. Design and implement NetApp and 3PAR Volumes/LUNs Layout.
- Design and implement Veritas LUNs over NetApp and 3PAR Storage. Automated error notification on NetApp and 3PAR Storage. Storage tuning on NetApp and 3PAR storage. Storage analysis and allocation on NetApp and 3PAR Arrays. Volume/LUN recovery best practices on NetApp and 3PAR Storage Arrays.