Bigdata Architect Resume
EXPERIENCE SUMMARY:
- 21+ years of in IT
- 15+ years of application development in Java/C#/.NET
- 6+ months in SAP HANA
- 2.1 years in Hadoop ecosystem
TECHNICAL SKILLS:
Software/Technology/Platform/Language/Tools/Products/Framework: CDH 4.6.0/5.0.1 , Hadoop 2.0.0/2.3.0 , HDFS 2.0.0/2.3.0 , MapReduce 2.0.0/2.3.0 , Pig 0.11.0/0.12.0 , Hive 0.10.0/0.12.0 , Hbase 0.94.1.5/0.96.1.1 , Sqoop 1.4.3/1.4.4 , Oozie 3.3.2/4.0.0 , Zookeeper 3.4.5, Flume - ng 1.4.0, Hue 2.5.0/3.5.0 , Java 1.7, Linux Ubuntu 12.04/14.04 , GitHub, Tableau 7.2,Hunk 6, MySql 5.5, Impala 1.3, Coudera Manager 4/5, Cloudera Search, JSON, AVRO, Hcatalog 0.5.0 Java, Javascript, J2EE, JSP, JDBC, JPA, EJB, Servlets, JDom, Dom, Sax, XML, XSLT, LDAP, HTML, MQSeries, XML Spy, Web Methods 3.0, Websphere Studio Application Developer, Websphere Application Server 5.0, MQ Series, IBM HTTP Server, Rational Rose, ANT, ChangeMan DS, Visual Age for Java, PGP E-Business Server, Perforce, Excelon Stylus, IBM Secureway Directory SAP HANA, SAP HANA DB 1.5, SAP HANA Studio 1.0.5, SQL, SAP BODS 4.0, SLT IDT, Explorer, Dashboards, WebIntelligence, CMC, Lumira, Analysis for Microsoft Excel 2007 SAP HANA XS Engine, SAP HANA Studio 1.0.5, SQLScript Debugger, SAPUI5, OData Service, XSJS o SAP BI 7.0, ECC6, BEx Designer, BEx Analyzer, Control-M .NET, C#, Web Service, Enterprise Content Management, Microsoft Project, K2 Workflow, ApplicationXtender 6.0, DocumentManager 6.0, Visual Studio 2008/2010, IIS 5.0/6.0/7.0, MS SQL Server 20005/2008, FileNet 4.0, ASP, VB, VBScript Mac OS X, Windows, Windows Server, AIX, Solaris, Linux o Cobol II, DB2, CICS, VSAM, JCL MVC, Struts, Spring, Thin Client Framework
EXPERIENCE:
BigData Architect
Confidential
Responsibilities:
- Working as a consultant in client’s telematics project.
- The telematics program uses wireless technology to collect data related to customer’s driving behavior and use that information to derive pricing model, modify insurance premiums and to provide useful feedbacks to policyholders.
- Customers receive personalized coaching an feedback on their driving performance.
- This provides an opportunity to improve their driving performance/lower their rate.
- Vendors collect data on vehicle usage (speed, distance, time, location, etc.) through a telematics device installed on customer’s vehicle and is sent to client at hourly intervals, which gets ingested into Hive tables using Sqoop.
- Identify/collect data to be used during POC and beyond
- Analyze telematics data (Telematics Trip Report Time Series Data) along with relational data to identify new insights and thus realize a rapid ROI
- Perform analysis on statistical data using Hadoop ecosystem including Pig, Hive, HBase, Oozie, Flume and develop presentation to use for management Replicate DW schema in Hadoop echo system Compare cycle time of algorithms with current queries and ETL
- Involved in installation and configuration of parcels of various Hadoop echo system components including HDFS, Pig, Hive, Sqoop, HBase, Flume
- Involve in designing the solution architecture o Load data from UNIX file system to HDFS Develop pig scripts for transforming/formatting the data as per business rules Write UDFs for custom data processing (clean, edit and format unstructured data) o Import data from RDBS systems into HDFS/Hive using Sqoop Create External/Managed Partitioned Hive tables, load data, write Hive/Impala queries
- Create HBase tables, load summary data Develop MapReduce programs to perform custom Quality Check on ingested data
- Create end-user reports using Tableau Expose summary data through REST API for portal consumption
- Develop Oozie workflows to orchestrate Sqoop/Pig/Hive scripts Setup Flume agent (source, channel, sink) to ingest data into Hadoop
- Monitor/manage data coming in from different sources
- Implement test scripts to support test driven development and continuous integration
- End-to-end testing of scripts and document time taken for initial/delta loads End-User training
- Monitor the system using Cloudera Manager
- Manage/review various log files Document solution architecture HANA Developer
- Creating information models including attribute views, analytic views and graphical calculation views
- Creating level hierarchies, analytic privileges, calculated attributes/measures
- Creating users/roles/privileges Replicating data into SAP HANA using BODS o Importing data into SAP HANA from flat files Creating Universe from information models using IDT Generating reports using WebI and Analysis for Microsoft Excel
Environment: SAP HANA, SAP HANA DB 1.5, SAP HANA Studio 1.0.5, SQL, SAP BODS 4.0, IDT, WebI, Analysis for Microsoft Excel
Team Lead/Application Architect/Sr. Developer
Confidential
Responsibilities:
- Plan, schedule and execute all stages of ECM implementations
- Create cost-benefit analysis and ROI assessments to be used as the basis for decision-making on proposed IT implementation projects
- Articulate project goals and scope, translate business needs into technical terms, prepare detailed work breakdown structures (WBS) and instill shared accountability for achieving project milestones
- Monitor progress during each project phase in terms of deadlines/scope/costs
- Resolve numerous project issues including staffing shortages, technical issues and scope creep
- Work with vendors to deliver projects on a timely and cost effective manner Architect end-to -end solution on all content management applications
- Responsible for designing, coding and testing
- Responsible for creating design documents from requirements
- Involved in change control activities, including creating releases, merging code and version control Involved in code migration to test/model/UAT and production environments, production support activities
Environment: .NET 2.0/3.5, C#, Java 1.5, Eclipse, SQL SERVER 2008, Visual Studio 2008, TXLife, XML, Javascriot, ApplicationXtender 6.0, DocumentManager 6.0
Software Consultant
Confidential, Chicago, IL
Responsibilities:
- Involved in entire SDLC including analysis, design, coding, testing and implementation of various projects.
- The projects included building interactive web applications that act as front-end to legacy data Involved in change control activities, creating frozen releases, merging code and version control
- As a member of the Annuity wing of the IT department, was involved in interacting with the users, finding their needs and problems as far as their use of the system was concerned.
- Translated those needs into technical details and made the necessary changes to the system to meet their needs.
- Involved in making the system Y2K compliant.
- Was part Centralizing Network Billing System team.
- The CNBS project was operated on various releases.
- The system had been developed on ES9000 Mainframe using CICS as TP monitor.
- Involved in developing and testing various online programs and reports for their billing system.
Environment: ES9000, MVS/ESA, Cobol II, CICS, DB2, and VSAM
