We provide IT Staff Augmentation Services!

Big Data & Bi Solution Architect Resume

0/5 (Submit Your Rating)

Houston, TX

SUMMARY

  • 16+ years of experience in software development, Architecture decisions and leading projects from concept through the release process
  • Cloudera Certified Developer for Apache Hadoop
  • Good understanding and experience wif Cloudera Hadoop stack
  • Knowledge in NoSQL databases like Hbase
  • Good working knowledge on Distributed data processing systems
  • Expertise in Hadoop Lambda Architecture
  • Capable of Designing and Architecting Hadoop Applications and recommending the right solutions and technologies for the application
  • Proficient in all Phases of SDLC (Analysis, Design, Development, Testing and Deployment) and gathering user requirements and converting them into software requirement specifications
  • Work closely wif Business clients
  • Worked as liaison between the Customer and the Off - shore & On-shore team
  • Excellent Analytical, Programming and Logical skills
  • Very good exposure in OLAP
  • Capable of handling multiple projects & teams at the same time
  • Good Experience as a Tech / Project Lead

TECHNICAL SKILLS

Big Data Eco System: Cloudera Distribution for Hadoop (CDH), MapReduce, HDFS, YARN, Hive, Pig, Sqoop, Storm, Impala, Elastic search, Scala, Spark, Kibana, Parquet, Flume, AWS, Snappy, Avro, HBase

Programming Languages: Core Java, Python

Scripting Languages: Shell Scripting, PowerShell

Operating Systems: LINUX, UNIX, Windows

Database: ORACLE, MySQL, Teradata, SQL DW

Tools: Eclipse, Toad, ER Studio, Ranger

Other Technologies: MS Azure, SSAS, SSRS, PowerBI, Blob, ADF, Amazon Web Services S3, KMS

Methodologies: Waterfall, Agile

PROFESSIONAL EXPERIENCE

Confidential, Houston, Tx

Big Data & BI Solution Architect

Responsibilities:

  • Interact wif all the different stakeholders to get the requirement to bring the data into Enterprise Data Warehouse (EDL - HDP 2.4)
  • Translatethe requirements into architecture
  • Architecture & Data Governance processes
  • Interact wif the various management team Directors, VP for different approvals
  • Interact wif the Risk assessment team for the Cyber Security approval for the Confidential LLC data
  • Produce application architecture diagrams, application interaction diagrams, application blueprints, roadmaps, etc.,
  • Manage the off-shore team to get the requirement done in Hadoop and MS Azure
  • Preparing the Data Model
  • Provide design recommendations and thought leadership to sponsors /stakeholders that improve review processes and resolve technical problems.
  • Perform historical and incremental loading of data into Hive Partitioned tables using Sqoop
  • Recommend and decide technology solutions and perform mapping of the business requirements to systems/technical requirements to ensure they are in line wif the enterprise architectural plan.
  • Lead in designing, specifying and selecting information system solutions
  • Considering functionality, data, security, integration, infrastructure and performance.
  • Understand the software architecture design and support development team in developing solutions accordingly
  • Review, interpret and respond to detailed business requirements specifications (BRS) to ensure alignment between customer expectations and current or future ICT capability
  • Develop, test and implement technology solutions and report on delivery commitments to ensure solutions are implemented as expected and to agreed timeframes

Confidential, Bellevue, WA

Big Data Architect

Responsibilities:

  • Manage the BEAM Ingestion team for different tracks
  • Provided design recommendations and thought leadership to sponsors /stakeholders that improved review processes and resolved technical problems.
  • Co-coordinate between the Business and the Off-shore team
  • Requirement gathering and prepare the Design
  • Work wif different Business and stake holders for each track
  • Export and Import data into HDFS- HBase and Hive . creating Hive tables, loading wif data and writing Hive queries
  • Bulk loading HBase using Pig
  • Initial load and incremental load data into HBase thru BEAM via GG
  • Implemented solutions using Hadoop, HBase, Hive, Sqoop, Java API, etc.
  • Work closely wif the business and analytics team in gathering the system requirements
  • Load and transform large sets of structured and semi structured data.
  • Loading data into HBase tables using Java MapReduce
  • Loading data into Hive partitioned tables

Confidential, Greenville, SC

Big Data Architect

Responsibilities:

  • Provided design recommendations and thought leadership to sponsors /stakeholders that improved review processes and resolved technical problems.
  • Co-coordinate between the Business and the Off-shore team
  • Requirement gathering and prepare the Design
  • Export and Import data into HDFS, HBase and Hive using Sqoop.
  • Involved in creating Hive tables, loading wif data and writing Hive queries
  • Bulk loading HBase using Pig
  • Implemented solutions using Hadoop, HBase, Hive, Sqoop, Java API, etc.
  • Work closely wif the business and analytics team in gathering the system requirements
  • Load and transform large sets of structured and semi structured data.
  • Loading data into HBase tables using Java MapReduce
  • Loading data into Hive partitioned tables

Confidential, Greenville, SC

Big Data Architect

Responsibilities:

  • Worked on a Hadoop Cluster wif current size of 56 Nodes and 896 Terabytes capacity.
  • Written Map Reduce Jobs, HIVEQL, Pig.
  • Imported data using Sqoop into Hive and Hbase from existing SQL Server.
  • Supported code/design analysis, strategy development and project planning.
  • Created reports for the BI team using Sqoop to export data into HDFS and Hive.
  • Developed multiple MapReduce jobs in Java for data cleaning and preprocessing.
  • Involved in Requirement Analysis, Design, and Development.
  • Export and Import data into HDFS, HBase and Hive using Sqoop.
  • Involved in creating Hive tables, loading wif data and writing Hive queries which will run internally in Map Reduce way.
  • Work closely wif the business and analytics team in gathering the system requirements
  • Load and transform large sets of structured and semi structured data.
  • Loading data into HBase tables using Java MapReduce
  • Loading data into Hive partitioned tables

Confidential, Greenville, SC

Big Data Architect

Responsibilities:

  • Imported data using Sqoop into Hive and Hbase from existing SQL Server.
  • Supported code/design analysis, strategy development and project planning.
  • Created reports for the BI team using Sqoop to export data into HDFS and Hive.
  • Involved in Requirement Analysis, Design, and Development.
  • Export and Import data into HDFS, HBase and Hive using Sqoop.
  • Involved in creating Hive tables, loading wif data and writing Hive queries which will run internally in Map Reduce way.
  • Load and transform large sets of structured and semi structured data.
  • Loading data into Hive partitioned tables

Confidential, Greenville, SC

Big Data Architect

Responsibilities:

  • Supported code/design analysis, strategy development and project planning.
  • Created reports for the BI team using Sqoop to export data into HDFS and Hive.
  • Involved in Requirement Analysis, Design, and Development.
  • Export and Import data into HDFS, HBase and Hive using Sqoop.
  • Involved in creating Hive tables, loading wif data and writing Hive queries which will run internally in Map Reduce way.
  • Work closely wif the business and analytics team in gathering the system requirements
  • Load and transform large sets of structured and semi structured data.
  • Loading data into Hive partitioned tables

Confidential, Greenville, SC

Architect

Responsibilities:

  • Understanding the ETL Specification Documents for mapping requirements.
  • Extract Data from multiple sources like Flat files/Oracle/FTP site into staging database.
  • Extensively worked on Informatica tools such as Source Analyzer, Data Warehouse Designer, Transformation Designer, Mapplet Designer and Mapping Designer to design, develop and test complex mappings and Mapplets to load data from external flat files and RDBMS
  • Created mappings using the transformations such as the Source qualifier, Aggregator, Expression, lookup, Router, Filter, Joiner, Union, Sequence Generator, Rank, Normalizer, Transactional Control, Stored Procedure and Update Strategy.
  • Involved in performance tuning of mappings, identifying source and target bottlenecks and worked wif the sessions and workflow properties to improve the performance.

Confidential, Greenville, SC

Architect

Responsibilities:

  • Strong interpersonal skills, team oriented, and highly motivated, Counseling/ motivating team and addressing their concerns.
  • Track record of customer satisfaction.
  • Exposure to Software Development methodologies, Quality Assurance and Security & Control procedures.
  • Lead Development, Testing & Production Support team wif the max team size 35
  • Worked wif customers to gather business requirements and develop unit & system test plans.
  • Creating FRD documents based on the request from business
  • Knowledge of configuration management tools
  • Leading a project team which is assigned module/ activity/ tasks/ deliverables.
  • Work on estimates and allocate tasks to resources
  • To prepare schedule for tracking of the tasks. Conduct regular/periodic team meetings to provide project specific plan and status update.
  • To review work of team members, ensure that it is as per the laid down specifications by project/client, and meets the desired quality standards.
  • Provide technical know-how, support, mentoring & coaching team members on technology, business & other project specific aspects.
  • Provide project specific performance feedback to the team members.
  • Work on training needs identification for the team members.
  • To maintain different database such as of resource allocation sheet, checklist for testing and coding and prepare monthly Metrics.
  • Responsible for project review, escalations, quality assurance, tasks completion, delivery of the tasks, customer interface & project status reporting for the project.
  • Interpersonal skills, Counseling/ motivating team and addressing their concerns.
  • To consult and review wif the delivery manager to determine project deliverables, project plan, project staffing, scheduling, project time frame,
  • Identification of risks, contingency plans, resource availability, quality process for accomplishing the project milestones during various phases of the project, if the project involved development or is a major enhancement. For other Support projects determine project deliverables, identification of risks, contingency plans, resource availability, and quality process.
  • Coaching, mentoring team on technical/business specific aspects & Motivating team members to continuously deliver quality deliverables.
  • To conduct regular/periodic team meetings to review project status and project specific plans.
  • Provide continuous feedback to team members and plan appropriate training programs for their growth in terms of role/technology/domain expertise keeping project/client/organization specific requirements.
  • Ensure basic project specific infrastructure is organized/arranged for its team members working on the project.
  • Minimize exposure and risk across multiple projects.
  • Ensure project documents are complete, current and stored appropriately.
  • Coordinating wif other departments for requirements.
  • Good understanding of domain, executed several medium to large sized projects, and handled multiple projects/teams in onsite/offshore execution model including contracts and project specific service level agreements (SLAs).
  • Liaison wif Onsite Engagement Managers for Customer Relationship Management.
  • Build strong client relationships and appropriately manage client expectations
  • Responsible for meeting the current business plans as well as utilizing resources for meeting the challenges of the future.
  • Share knowledge and best practices wif team; facilitates project review sessions at the close of each project.
  • Responsible for interviewing and approving candidates to be staffed on team.
  • Escalation point of contact for the customers for various projects for immediate attention and resolution.
  • Client meetings, employee retention, HR issues, performance management, customer satisfaction reviews,
  • Handling production support activities
  • Experience in Incident/Problem and Knowledge Management process areas.
  • Working wif global distributed teams
  • Excellent oral and written communication skills, flexibility to accommodate working across different time zones and sensitivity to cultural and geographical differences.
  • Experience in providing IT support in an onshore/offshore model is preferred

Confidential

Senior Technical Lead

Responsibilities:

  • Requirements Analysis
  • Estimation
  • Scheduling
  • Preparing Business Requirement Document
  • Preparing Business Design Document
  • Preparing Work Break Structure
  • Preparing Technical Design Document
  • Estimation
  • Provide Week-end support
  • Preparing Abend report
  • Review the deliverables
  • Communicating wif the clients
  • Testing (Unit & Integration)
  • UAT Support
  • Implementation Support.
  • Production support activities.

We'd love your feedback!