Big Data Specialist/data Architect/solutions Architect Resume
Phoenix, AZ
SUMMARY:
- 15+ years of experience in architecting and developing Big Data, Enterprise Data Warehouse and Business Intelligence solutions that involved setting up Kafka, Hadoop, X15 clusters, designing and developing ETL and ELT for schema on read and schema on write, data modeling and architecture, designing and developing BI Solution.
- Multiyear experience with tools and framework like Informatica, Erwin, Kafka, Hadoop, HIVE, Pig, Map Reduce, Zookeeper, Oozie, Web Services, XML, REST API, Python, Sqoop, Pivotal HAWQ, PL/SQL, Pivotal Hadoop, Hortonworks Hadoop, MicroStrategy, Business Objects, Cognos, Erwin, ER Studio and databases like X15, Teradata, SQL server, Oracle, DB2, Sybase.
- I am a self - starter, fast learner, results driven professional with analytical and problem solving skills that is key to the success of data driven systems.
TECHNICALSKILLS:
Big Data Stack: Apache Kafka 9, X15, Pivotal Hadoop, HAWQ, HIVE, Pig, Sqoop, Map Reduce, Python, XML, JSON
Database: X15, Pivotal HAWQ, SQL Server 2012, Teradata 14.x, Teradata 13.10, Sybase IQ/ASE, UNIX DB2, Oracle 11i/10g/9i/8i/8, UDB DB2 8.x
ETL Tools: Informatica Power Center 9.x/8.x/7.x/6.x/5.x, Power Mart 4.x
Data Profiling/Quality tools: Informatica Data Quality, Informatica Data Explorer, Profiling Option in Informatica PowerCenter, Exeros Discovery, Exeros Validator
BI Tools: Business Objects 6.x/XI, MicroStrategy 8.2, Cognos EP Series 7.x
Data Modeling Tools: Erwin r7/4.x/3.x, Oracle Designer, ER Studio
Scheduling Tools: Cronacle, Autosys, Control M, IDN Event Engine
Programming Languages: UNIX shell Scripts, PL/SQL
Tools: and Utilities XML SPY 2015, JSONLint, Microsoft Project Plan, Clear Case, Clarity, VisioOther Skills Data Analysis, Project Management, scheduling and execution, Resource Optimization, Onsite/Offshore Co-ordination, generation of project and process related metrics (Effort deviation, schedule deviation, job performance and defect density), Communication, Six Sigma Green Belt Trained, CMM trained, executed projects in Agile Methodology
PROFESSIONAL EXPERIENCE:
Confidential, Phoenix, AZ
Big Data Specialist/Data Architect/Solutions Architect
Responsibilities:
- Model data for the Risk and Security Data Lake, data warehouse and datamarts. This involves data modeling in Hadoop and database environments. The data warehouse and datamarts are in multiple databases Teradata, X15, Pivotal HAWQ, SQL Server, Sybase and Sybase IQ. Modeling data in big data environment requires good understanding of Hadoop eco system like HDFS, HIVE, oozie and zookeeper.
- Setup Kafka Cluster and developed kafka consumers and producers to ingest security logs on a real-time basis into Risk and Security data lake (400000 records/sec or 60 mbps)
- Develop HIVE and Python scripts to move the security data into Risk and Security Data Lake. Most of the raw data is in avro format.
- Develop ETL using Informatica, PL/SQL that moved data from REST APIs, Web services, flat files, and semi structured files (XML and JSON) into the Risk and Security Data warehouse and data lake. Data on hdfs is used for exploration with tools like platfora. Behavioral analytics is done using Securonix.
- Develop Sqoop scripts to move data out of HIVE into RDBMS.
- Develop Pig scripts to join card, vpn, proxy logs to user and asset datasets in hdfs. This data is exposed to Pivotal HAWQ using external tables.
- Collect requirements from Business Users, analyze data and develop the specification documents for data model, ETL, BI and analytics solution.
- Manage a pool of resources to deliver projects. This involves resource and project management, effort estimation, effective communication and leadership.
Confidential, Phoenix, AZ
Solutions Architect
Responsibilities:
- Architected the solution for delivery of BIDW projects OPEN Savings, membership Rewards and Relationship Manager Performance. Solution involved modeling of the data marts and architecture of ETL in Informatica, PL/SQL and Reports and Dashboard in MicroStrategy. Data Modeling was done in ER Studio. Models were in Star and Snowflake schemas
- Managed the upgrade of Informatica from 8.1 to 8.6 and MicroStrategy Upgrade from 8.1 to 8.2
Confidential, Irvine and Pleasanton, CA
Technology Manager/Senior Data Architect
Responsibilities:
- Architected and managed the delivery of a Business Intelligence and Data Warehouse solution for Fraud Data Mart and CAPONE.
- ETL solution was designed in Informatica Powercenter and Power Exchange and PL/SQL
- BI solution was developed in Business Objects
- Data Modeling was done in Erwin r7
- Lead and managed a team of 72 Informatica and Business objects resources in an onsite offshore model
Technology Manager/Senior Data Architect
Confidential
Responsibilities:
- Architected a Business Intelligence and Data Warehouse solution for Home Loans Data Warehouse. This involved creation of dimensional data model, ETL, BI and database architecture
- Managed a resource pool of 80+ consultants at onsite and offshore to deliver the Home Loans Data Warehouse. The resource pool included Informatica developers, Business Objects developers, Oracle DBAs, Data Analysts and QA Testers.
- ETL solution was designed in Informatica Powercenter and Power Exchange and PL/SQL
- BI solution was developed in Business Objects
- Data Modeling was done in Erwin r7
Confidential, Houston, TX
Informatica ETL Architect and Technology Lead
Responsibilities:
- Designed the Traditional Credit Products and Data Acquisition Control Data marts.
- Architected and delivered ETL solution in Informatica to load TCP and DAC data marts
Confidential
ETL, Business Intelligence and Database Developer
Responsibilities:
- Developed ETL in Informatica and PL/SQL to load the HR and Power Systems datamarts, Confidential IT and Corporate Data Warehouse
- Created HR Dashboard in Cognos Visualizer and Reports in Cognos Impromptu
- Developed Business Objects Reports for Corporate and Confidential IT Data Warehouse
