Data Engineer / Architect Resume
New, JerseY
SUMMARY:
- Around 15+ years of diverse and extensive experience in IT Industry
- Technical Architect with demonstrated success in the design and implementation of end - to-end DW/BI Projects, ETL d Confidential processing, master d Confidential management, d Confidential migration and big d Confidential projects
- D Confidential Engineer - analyze, develop, maintain, test and evaluate big d Confidential solutions
- Delivery Manager - Adept at leading/managing cross-functional programs and team of 40+ resources
- Capable of leading high performing teams under tough deadlines, to meet expectations of multiple customers and executing projects across multiple geographical locations.
- Excellent working knowledge on handling big d Confidential using Hadoop architecture, HDFS and ecosystem tools like Spark, Hive, HBase, Sqoop, Flume, Kafka, Spot, Logstash
- Successfully delivered multiple projects and worked in various roles like Solution Architect, Technical Project Manager, D Confidential Architect, Delivery Manager, Agile Scrum Master, Big d Confidential engineer, ETL designer/developer
- Experienced with d Confidential analysis, d Confidential modeling, application architecture, component design (ETL, BI & Operational Reporting, Master D Confidential Management), Project management
- Capable of processing large sets of structured, semi-structured and unstructured d Confidential and supporting systems application architecture
- Actively involved in multiple small and large RFI/RFP responses
- Experience in coordinating with cross functional team to follow up on project delivery, process oriented, audits,, deployments, administrators etc.
- Good analytical, problem solving, communication and interpersonal skills ability to interact with individuals at all levels.
- Experience in Telecom, Information and Insurance industries.
- Expert in D Confidential Architecture and ETL design and development
- Instrumental in setting up Pentaho COE within the organization and trained various teams in Pentaho PDI
- Experience in Managing scalable Hadoop clusters including Cluster designing, provisioning, custom configurations, monitoring and maintaining using Cloudera CDH distributions
SKILL SET:
Big d Confidential Tools: Hadoop, HDFS, HBase, Hive, Sqoop, Flume, Spark, Kafka, Spot, Logstash
ETL & BI Tools: Informatica Power center, Pentaho PDI, Tableau 9.x
D Confidential bases: Oracle, Terad Confidential, SQL Server
Scripting: Unix Scripting, Python
Version Control: Tortoise SVN, GitHub
Tools: & Utilities
PROFESSIONAL EXPERIENCE:
Confidential, New Jersey
Regional Service Owner
Project Specific Skills: Informatica, Cloudera HDFS, Spark, Kafka, Python, Sqoop, Flume, Tableau
Responsibilities:
- Responsible for delivery of D Confidential and Analytics Services for Confidential and Medical devices supply chain and work with product line leaders to identify new business needs & opportunities
- Drive global Application Maintenance Transformations and capabilities to maximize value and efficiency.
- Execute and govern global support strategy, vendor performance, innovations and Application Support Optimization for the supply chain pods
- Ensure application teams are following the JnJ standards, ceremonies, automate the redundant processes, SLT tracking per needs.
- Responsible for Business Requirements Gathering, work with BUIT and App Dev team on any new initiatives, applications and major enhancements.
- Liaise with Vendor management team for resource ramp up/down planning to meet the project requirements.
Confidential, New Jersey
Engineer / Architect
Project Specific Skills : Cloudera HDFS, Spark, Kafka, Python, Apache Spot, Sqoop, Flume, Logstash, Arcadia d Confidential
Responsibilities:
- Responsible for Overall Hadoop D Confidential lake cluster Administration uptime, upgrades
- Set up of Cloudera D Confidential Science Workbench for D Confidential scientists
- Capacity Planning and reallocate resources, storage, memory based on the project needs
- Ingest different infra structure logs such as DNS, Web Proxy, Net flow, ipcontrol, unix, active directory from Kafka into the Hadoop d Confidential lake
- Implemented ETL transformations by developing necessary Pyspark scripts and high-speed querying using Spark SQL, Hive
- Capacity Planning and reallocate resources, storage, memory based on the project needs
- Rebuild the old Confidential servers to be Hadoop ready and utilized as D Confidential and Edge nodes
- Developed Purging process and Alert mechanism to send emails during any streaming and batch jobs failures
Confidential
Sr. Architect
Project Specific Skills : Hive, Sqoop, Pentaho PDI, Tableau, Oracle, Unix Shell scripting, Terad Confidential, SQL Server, Salesforce
Responsibilities:
- Responsible for designing the end to end architecture solution to integrate d Confidential from different systems within Confidential into the specified relational model
- Responsible for the designing of the Logical d Confidential model for the BI platform which will then be converted to Physical d Confidential model as per the implementation needs.
- Analyze the d Confidential source systems in conjunction with the Epics / Business User Stories, and prepare high level solution design to be able to be played back to the business owners
- Interact with client SMEs periodically and breakdown the business requirement in details to furnish more details to development and integration team in the form of detailed design documents
- Provide suitable d Confidential warehouse and ETL Architectural solutions for the system to project development and implementation team. Participate in system architecture and design related discussions with client, SME, and the development team.
Confidential
Technical Delivery Manager, Solution Architect
Project Specific Skills : Pentaho PDI, Informatica Power center, Tableau, Oracle, Fact, co-sort, Unix Shell scripting, Terad Confidential, SQL Server, Salesforce
Responsibilities:
- Participated in discovery sessions to understand the client’s business, objectives and their needs
- Responsible for designing the end to end architecture solution to integrate d Confidential from different systems within Confidential into the specified relational model
- Responsible for the designing of the Logical d Confidential model for the BI platform which will then be converted to Physical d Confidential model as per the implementation needs.
- Analyze the d Confidential source systems in conjunction with the Epics / Business User Stories, and prepare high level solution design to be able to be played back to the business owners
- Interact with client SMEs periodically and breakdown the business requirement in details in order to furnish more details to development and integration team in the form of detailed design documents
- Provide suitable d Confidential warehouse and ETL Architectural solutions for the system to project development and implementation team. Participate in system architecture and design related discussions with client, SME, and the development team.
- As a Scrum Master, responsible for management of the Agile methodology within the projects and make sure to have any impediments to the progress of the Sprints to be handled with appropriate attention and priority
- Ensure project team is following Agile ceremonies like Daily stand ups, Story grooming, Sprint planning, Release planning, Capacity planning, estimating the velocity with story points, Sprint review and retrospection
- Responsible for Business Requirements Gathering, High Level Design Approach/Solution and documentation.
- Owner of the HLD, Reviewer and approver of detailed design.
- Onshore-Offshore co-ordination of activities and review of both Onshore and offshore deliverables.
- Liaise with client management team for resource ramp up/down planning to meet the project requirements.
Confidential
Technical Lead / ETL Designer / Sr. Developer
Project Specific Skills: Informatica 7.2, 8.6, Oracle PL/ SQL, Shell Scripting
Responsibilities:
- Accountable for the execution of the individual tracks and assigning and tracking tasks in each track, reviewing deliverables and technical leadership.
- Design ETL mapping sheet, develop necessary mappings, Unix Scripts, D Confidential base tables wherever required following the Client Coding standards based on the requirements.
- Handling change requests, fixing defects and work on the enhancements of the existing ETL code.
- Updates the Quality Documents and make sure that assignments are delivered on time with high quality. Analyze the Requirement Specifications for all the applications and preparation of the Functional Specification Document and Design Document
- Document the changes / technical modifications that need to be done as per the Change Requests.
- Provide the metrics and monthly status reports to the client manager.
- Involved in Performance Tuning of ETL mappings which were taking longer time
- Co-ordinate with Offshore team and get the work done from them.
- Involved in Performance Tuning of ETL mappings which were taking longer time
Confidential
Team Lead, Sr. Developer
Project Specific Skills: Informatica 7.2, 8.6, Oracle 9i, Shell Scripting, Sales Force
Responsibilities:
- Design and development of mappings based on the Business requirements and following the Coding standards.
- Prepare D Confidential flow diagrams and presentations during Knowledge transition phase.
- Provide effective Support of the GHM application and analyze and work on the Business or customer queries.
- Monitoring jobs and timely support activities.
- Analysis Business needs by gathering information, documented and also responsible for creating the mappings, reusable transformation and the corresponding workflows.
- Handling change requests. Involved in d Confidential analysis and handling bug fixes.
- Analyze the existing ETL code for the Change Requests coming in and make necessary changes and enhancements.
- Provide suggestions and tuning tips to improve the performance of the existing jobs wherever required in Production
Confidential
ETL Developer
Project Specific Skills: Informatica 8.6, Oracle 9i, Graphtalk - OOPS based tool
Responsibilities:
- Preparation of Flow plan and flow procedure.
- Design and development of mappings based on the Business requirements.
- Building Applications from the design options to meet the requirements.
- Involved in preparing Impact Analysis document.
- Program analysis, Functional Specification and design document preparation, Unit Test plan preparation, Review and Testing.
- Produce deliverables according to Client requirements.
- Update Quality documents and make sure that assignments are delivered on time with high quality
- Participate in Team meetings and discussions of detailed assignments to achieve end results.