Sr. Data/solution Architect/hadoop Lead Resume
SUMMARY
- Solution Architect/Technical Lead/Data Engineer (Vertica/Hadoop - Hive/Teradata/Bigdata/Cloud-Azure/Spark/ETL/Reporting/Database) with overall 15+ years implementation experience
- Expert in E2E data warehousing solution starting from small data set to big data sets.
- Knows the pitfalls of data warehouse design and how to address them.
- Various Technical certification like Oracle/Vertica/Teradata/Hadoop to provide the solution architecture expertise for various data related initiatives.
- Worked on more than 100 PB data warehouse with real time SLA for business.
- Managed team size starting from 5 to 30 team members.
- Hands on experience with Teradata/Vertica/Oracle/Hadoop-Hive/Ab Initio/Oracle/Business Objects/OBI EE/OWB/Microsoft SQL Server/Azure and Informatica
- Expertise on providing various performance recommendation to meet business SLA.
- Good experience with ETL and other data warehousing deployment related project.
- Created many tools to support customer raw data solution.
- Good experience with Service Oriented Architecture through Java/Ab Initio.
- Expertise with setting up security protocol in data exploitation layer.
- Expertise with day to day support and maintenance of overall data warehouse application.
- Expertise on providing solution on various automation and scheduling ETL/Reporting jobs.
- Worked on various methods on migration from Traditional DB to Hadoop-Hive.
- Provided various framework related architecture on reusability of common code.
- Worked with business on BRD and architecture to deliver the requirement.
- Worked on various POC and JAD session with Business/Stakeholders.
- Designed the risk mitigation plan for various requirement.
- Worked on developing automated in-house deployment tool.
- Hands on experience on migration from one DB to new DB.
- Expertise in sizing and configuring various ETL/DB.
- Solid hands-on experience Python, Hadoop, Vertica, Teradata, Azure, OBIEE, Business Objects, Ab Initio and various technical tools.
- Good experience to handle multicultural and multinational teams.
- Well versed with onsite and offshore team management.
- Migration expertise with Business Objects/OBIEE and Vertical DB from one environment/version to other.
- Design and implement the in-house product through Python to support ETL and test cases.
- Extensive hands-on experience in Python an Shell Scripts
TECHNICAL SKILLS
Big Data: Hadoop-Hive, Spark
Relational Databases: Oracle, Teradata, Vertica
ETL: Ab Initio, Oracle Warehouse Builder, BODS, Oracle PL/SQL, Teradata Proc/File Utility, Informatica, Perl, Python, Hive-HQL, Unix Shell Script
BI Tools: Business Objects XI R2, Oracle Business EE 10/11 Tableau
Networking: Windows Active Directory, LDAP, FTP, Putty
Job Scheduling: Autosys, Control-M, Cron-Tab
Versioning: Subversion, GIT
PMO Tool: Omni Plan, Key Note, Microsoft Project
Cloud: Azure
Environment: Windows, Linux & Unix
PROFESSIONAL EXPERIENCE
Confidential
Sr. Data/Solution Architect/Hadoop Lead
Responsibilities:
- Architected the Big Data footprint including Azure cloud to support Point of Sales measures for nextgen platform
- Worked with stakeholder to gather various Point of sales requirement to design new product and enhanced to existing product
- Design ETL and reporting solution in Vertical 8.1.1/Microsoft SQL Server/Big data platform for promotion and store inventory product.
- POC on various performance solution to improve ETL and reporting performance to various analytic product
- Evaluate and implement various ingestion tools like Spark to improve the point of sales data capturing for various ETL and analytic purpose
- Transitioned various IT infrastructure to Azure Cloud including Vertica database.
- Lunching Mobile App to support various analytics for point of sales data to 740 customers across globe
- Implemented automation through python to support rapid integration of various products before lunching to market
- Implemented Machine Learning through Vertica
- Designed the storage and architecture for more than 100 PB data and support nextgen retail stores
- Designed the data extraction product to customers including PepsiCo for various Point of Sales measures
- ETL automation of point of sales data
- Supported more than 4000 external users global wide Vendor Retail data
- Implementation of Unit test framework to support micro service API
- Prepare the project plan to deliver solutions using Scrum Methodology
- Daily/Weekly meeting with Customer as well with Team
- Supported the critical production issue as part of development team
- Loading data in customer premises through Teradata utility and proc
Environment: Vertica, Spark, Azure, Teradata, Microsoft SQL Server, Python, Hadoop
Confidential
Big Data Lead/Hadoop/Teradata Technical Lead/Architect/Hadoop Hive Developer
Responsibilities:
- Design ETL both to Teradata/Hadoop-Hive/Vertica.
- Architected the solution on file processing automation.
- Played significant role in creating the architecture for new data warehouse solution.
- Worked with business to define various business requirements.
- Worked with performance team on various solution provided to improve the performance.
- Prepared the project plan and designed various RFPs.
- Met with customer daily/weekly to architect required solutions to meet business requirements.
- Drafted & implemented various migrations best practices.
- Designed automation tool for Testing.
- Worked with production support on critical P1.
- Worked with various vendor on getting right product and price for new tool.
- Mentored the newly joined team member in the team.
- Worked around ~250 TB datawarehouse for critical application with predefined SLA.
- Support Adhoc request for business.
- Design automation on data sanity check for various environment.
- Evaluate various data warehouse/automation tool.
- Designed Aggregation layer with Enterprise Service Layer as L0 layer.
- Hive-HQL for aggregate layer.
- E2E EDW solution with Teradata Utility and Proc
Environment: Hadoop-Hive, Teradata, Vertica, Informatica, Perl, Python, Autosys.
Confidential
Ab Initio/OBIEE Technical Lead/Solution Architect
Responsibilities:
- Implemented the SOA for Ab Initio for Amdocs/Legacy Ordering system
- Provided strategic and architectural guidance as well as managed both Ab Initio and OBIEE for ETL and Reporting.
- Acted as the SME for OBIEE product suite, provided architectural and strategic direction for the use of OBIEE products for call detail record with Vertica/Oracle as DB.
- Carried out Architecture Assessment Analysis (Sizing Analysis).
- Managed 4 server OBIEE Windows environment used by around 10 users.
- Designed migration path to Oracle to Vertica through ETL code.
- Implemented various dimensional data modeling for RPD.
- Integrated LDAP with OBIEE.
- Mentored OBIEE user community on new features and trained them on use the OBI EE feature.
- Design the projection for Vertica for CDR records to improve the performance
- Worked as onsite lead to deliver the project through onsite-offshore mode
- Performance testing through SOAP-UI and LOAD-UI.
- Worked various proposal on new requirement.
- Teradata Utility and View layer to support adhoc business analytic
Environment: Oracle 10G, OBI-EE, SOA, Ab Initio, Vertica, Teradata, Microsoft project Plan, Cron
Confidential
Ab Initio/Technical Lead/OBIEE-BO Lead
Responsibilities:
- Gathered information and successfully ETL/Reporting requirement.
- Installed, configured, performance tuned, supported and administer of BOXIR2 on 1 Production server, Test server and Dev server.
- Worked with resolving issues related to Scheduling/OWB code.
- Created different users and associated them with Site Minder.
- Migration from BO6.5.1 to BOXIR1 and from BOXI R2 to OBI EE
- Managed the ETL and Reporting Team.
- Managed daily standup meeting in agile process
- Gather the Business requirement in bi-weekly business meeting.
- Provided the architecture for Customer Experience Project as well BT-Global Service.
Environment: Business Objects 6.5.1, BOXIR2, Oracle Warehouse Builder, Oracle PL/SQL, Agile process.
Confidential
Software Developer
Responsibilities:
- Worked on various domestic project in Visual Basic/Crystal Report and Oracle.
- Designed the VB Form.
- Design and implement Crystal report for monthly and daily report.
- Tested various GUI Screen.
- Programmed the Oracle PL/SQL package for Aggregate tables.
- Developed various complex reports as per the business need of various business units.
Environment: Visual Basic, Oracle PL/SQL, Crystal Report 8.0,