Cloud Data Pipeline Engineer Resume
SUMMARY:
- Over all 15+ years of extensive experience in IT Industry software life cycle (Development/Support/ Build/Release Management /Maintenance) especially in the area of Middleware/SOA, Cloud technologies.
- Experience in defining architectural patterns and best practices documents for AWS.
- Expertise in Amazon AWS Cloud Administration which includes services: EC2,Cloudwatch, S3, EBS, VPC, ELB, Route 53,lambda, Auto Scaling, Security Groups, RDS,EFS and Cloud Formation.
- Implementation experience in designing and architecting Amazon Web Services (S3,SNS,Lambda,EC2,ELB,auto - scaling groups, Cloud Watch, Cloud Formation Templates, IAM) for developing applications
- Expertise on LINUX system administration and support of various applications.
- Good experience on Amazon AWS IAM Service: IAM Policies, Roles, Users, Groups, AWS Access Keys.
- Used AWS as to maintain model and manage the entire application.
- Having experience in configuration and Migration of Informatica Data Quality /Big data management products and Tableau Server Configuration.
- Having experience in configuration & migration of Seeburger Products: BIS - Business Integration Suite, Message Tracker/Portal, Bislink.
- Having experience in upgrading TIBCO, products like bw, rv, tra, mft&tibcoadministrator.
- Microsoft Certified Professional with experience as a developer, in developing and implementing, database driven n-tier web and client server applications using .NET Framework 1.1/2.0.
- AWS Certified professional with experience in implementing Migration of Middle ware technologies like SEEBURGER, TIBCO & Informatica tools.
- Ability in managing all aspects of the software configuration management process including code compilation, packaging / deployment / release methodology, and application configurations.
- Experience in maintaining and executing build scripts to automate development and production builds.
- Implemented ELK stack (ElasticSearch, LogStash and Kibana) for log indexing.
- Participated in performance tuning, unit test case preparation and execution.
- Experience in supporting various applications, which are deployed in production.
- Strong problem analysis skills with the ability to follow project standards and procedures as per client specifications.
- Knowledge on IP Networking VPN’s, DNS, load balancing.
- Exceptional ability to quickly master new concepts and applications.
- A Good team player with strong communication, leadership and interpersonal skills
- Having Experience in domains like Finance, Health care, Transport.
TECHNICAL SKILLS:
Cloud Technologies: Amazon web services, Azure, IBM Cloud computing
Enterprise Integration Tools: TIB/Rendezvous, TIB/Hawk, TIBCO Administrator 7.x, TIB/EMS, TIB/BusinessWorks,TIB/Active DB Adapter, TIB/File Adapter,Tibco Command Center,Tibco Platform Server,TibcoBussiness Events, Seeburger BIS 6.5.2, 6.3.5, Seeburger MT 6.5.2 (Message Tracker/Portal),Seeburger MFT(Managed File Transfer),Seeburger BISLINK PLUS, Hadoop, Hive, Distcp
Languages: .Net 1.1/2.0, C#, VB.Net, ASP.Net, PL/SQL,Java,Java Script, VB Script, COBOL
Databases: SQL Server 2000/2005, Oracle 12, MS-Access
Reporting Tools: Crystal Reports, Business Objects Xi
ETL Tool s: Power center Informatica 7.1
Others: Visual Source Safe 2005, MS-Office, Toad,Microsoft Visual Studio.Net 2003, BizTalk server 2004,Tandem Server,PeregrineService,HP Quality Center 10.0,Shell Scripting, Splunk, Datadog, Apache Airflow
Operating Systems: Windows 95/NT/2000/XP, UNIX- Sun Solaris,Red hat Linux
PROFESSIONAL EXPERIENCE:
Cloud Data Pipeline Engineer
Confidential
Responsibilities:
- Manage and Provision infrastructure which includes VPC, RDS, EKS, Security Groups, DNS Records for Hive Meta-store Service in AWS using Pulumi for Cloud Data Ocean team.
- Responsible for Onboarding Datasets for different customersinData transfer and export modules.
- Create DAG’s in airflow to schedule data transfer and export workflows for various modules, from on-prem server to AWS S3.
- Worked on infrastructure for providing high availability of applications and horizontal scaling of EC2 instances based on a load of applications.
- Worked on cloud watch to monitor the resources such as EC2 instances CPU memory, Amazon to design high availability applications on AWS across availability zones.
- Creating AWS S3 buckets according AIS complaint, enabling replication. Managing policies for S3 buckets.
- Create Datadog metrics Dashboard for HMS and Data transfer / export jobs.
- Create Splunk Alerts for HMS and Data copy for any errors in the application logs.
- Automation of deployment of HMS using CI/CD -Pulumi, Rio Pipeline, Github Repository tools.
- Participating in daily scrum meetings teams to ensure that project is moving as per the schedule.
- Provide assistance and respond to PagerDuty Alerts as per on-call schedule.
- Improving documentation by including user guides, escalation policies for HMS and Data transfer Services.
- Creating PR’s for all the changes in the YAML config for Governance, Data Copy, Export and Cloud core Infrastructure changes.
Environment: Amazon Cloud Instances - Amazon Linux, Amazon Web Services - EC2, RDS, CloudWatch, VPC, IAM, Route 53, bashscripting, Hadoop, Hive, Distcp, Docker, Python 3.5, Github, Pulumi, Splunk, Apache Airflow, Data Dog, Spark, Presto.
Sr Cloud Specialist
Confidential
Responsibilities:
- Responsible for END - END implementation of Infrastructure-platform setup for Informatica and Tableau applications
- Build & manage scalable systems on load balancers, Clusters & other AWS services.
- Responsible for Setup and maintain theAWSCLOUD infrastructure according to the standards and guidelines set forth. Use AWS Services VPC, EC2, RDS, S3, EFS, IAM, WAF, ALB, Route 53, EMR, Workspaces using terraform.
- Worked closely with the cross-functional teams to understand the requirements for setting up the servers according to the scale and volume of data.
- Worked on EFS, FSX services widely mounting the endpoints on Linux, Windows Servers.
- Install & setup Informatica 10.2, Tableau 2019.2 components on EC2 instances for NON-PROD and PROD environments.
- Responsible for migrating Informatica components from 10.2 HF 01 to 10.4.1 SP3.
- Worked on upgradation for Informatica applications Quarterly Patch releases in High Availability and Fault Tolerant environments.
- Provide support to any system or interface failures to meet SLA for Integration and reporting systems.
- Worked with Informatica&tableau supportteam’s for application licensing.
- Work on COST optimization of the AWS resources to meet the requirements of Confidential .
- Schedule and Monitor jobs INFORMATICA Workflows.
- Configure connection’s for SFDC, Marketo, Tableau, Workday, Anaplan, Oracle Cloud applications from informatica Services.
- Worked on POC environment for DELL Boomi setup.
- Planned major software upgrades for Informatica and AWS RDS, Coordinating with Application, and Infrastructure teams.
- Build python scripts for permission automation& Data source monitoring for tableau user management.
- Automation of deployment of informatica application code using informatica command line tools& CI/CD - Jenkins, Git Repository.
- Deployed scripts for process monitoring, server monitoring across Prod and Non Prod environments.
- Automated installation for informatica and tableau applications using terraform and bash scripting.
- Deployed informatica applications across environments.
- Responsible for Application, Server and User management for SDS team.
- On-board new team members to integrations and reporting system team, providing team members with required access for the console’s, AWS Services such as Workspaces,SES .
- Managed change management for integrations & reporting systems team for release of different informatica modules.
- Participating in daily scrum meetings teams to ensure that project is moving as per the schedule.
- Design& configure data archiving strategies for informatica/tableau on AWS services - Glacier, S3.
Environment: Informatica Data Quality 10.2/10.4, Tableau 2019.3, Amazon Cloud Instances - Ubuntu Linux, Amazon Web Services - EC2, RDS, CloudWatch, SES, SNS, VPC, IAM, Route 53, EFS, FSX, Athena, EMR, Lambda, bashscripting, Terraform, Docker, Python 3.5, JIRA, Google Forms, GIT,Ansible, Splunk.
Wipro Tech
Technical Lead
Responsibilities:
- Architect and design the HP Inc. new B2B (Business to Business) and MFT (Managed File Transfer) system in AWS CLOUD infrastructure and using SEEBURGER BIS (Business Integration Suite).
- Install & Configure Seeburger BIS & MFT components in EC2 Instances.
- Optimize Seeburger and MFT applications to best-fit performance of the services used in AWS cloud.
- Configuring Seeburger applications to adhere Security Standards of HP Inc Cybersecurity team.
- Build & manage scalable production systems on load balancers, Clusters & other AWS services.
- Work with HP Inc. partners (vendors and B2B customers) to test and migrate to new HPI B2B/MFT system.
- Work with vendor Amazon to debug and fix any infrastructure related issues.
- Responsible for monitoring and backup HP-AWS instances/Services.
- Work on upgradation for MFT & B2B applications Quarterly Patch releases in High Availability and Fault Tolerant environments.
- Work on Cost optimization of the AWS resources for best fit for HP Inc. strategies.
- Provide support to any system or interface failures to meet the HP Inc. SLA and best serve the HP Inc. business and partners.
- Work on SSL management for the B2B & MFT Applications.
- Worked with Seeburger on licensing and apply the renewed licenses in Seeburger Application Servers.
- Setup and manage Apache Proxy, PING ID on HPI-MFT application Server’s.
- Responsible for Access Management for Seeburger Applications.
- On boarded New B2B & MFT Partners into Seeburger platform.
- Patch Management for all the PROD &NON PROD servers for both MFT & B2B Servers been applied as part of agreed support Process for Vulnerability Patching.
- Lead the Wipro team to the completion of the project activities in time and budget approved.
Environment:, Amazon Cloud Instances - Redhat Linux, Amazon Web Services - EC2, RDS, Cloudwatch, SES, SNS, VPC, IAM, Route 53, EFS, WAF Shield, AWS Manager, Unix Scripting, Apache - Proxy Setup, Seeburger BIS (Business Integration Suite) 6.5.2 & 6.3.5, BIS Message Tracker, Seeburger MFT
Confidential
Responsibilities:
- Creating VPCs, Subnets, Security Groups and NACL on AWS.
- Creating the Instances and troubleshooting the access issues inside the VPC and EC2-Classic.
- Creating AMIs, snapshots and read replica in RDS.
- Configuring route-53, Elastic Cache, Auto scaling and ELB on AWS.
- Configured RDS (MySQL, Oracle) on AWS.
- Deploying EC2 instances (Windows & Linux), ELBs in AWS Cloud infrastructure.
- Managing S3 buckets and bucket policies for storage.
- Whitelisting Ports &IP’s at security group layer for confined access to partners. Managing Linux and Windows instances in AWS.
- Taking regular snapshots for EBS volumes and configuring backups for RDS instances.
- Managing IAM accounts and IAM policies to meet security audit & compliance requirements.
- Configure and work with various components like EC2, S3, ELB, RDS, IAM, Cloud Watch and VPC.
- Created of Domains for BAS modules in DEV, TEST & PROD.
- Installation & Configuration of Tibco products - RV, TRA, Administrator, Business works, Business Connect, EMS, Plugins (Ezcomm, SFTP for BC).
Environment: Amazon Cloud Instances - RedhatLinux, CentOS -7, Amazon Web Services, Microsoft Azure, TIB/BW 5.12 & 5.10, TIB/Hawk 4.9,TIB/Administrator 5.9.0, TIB/EMS 8.0,TIBCO Business connect 6.1, Tibco MFT-Platform server 7.2,Tibco Command Center 7.2.3
Confidential
Responsibilities:
- Installation & Configuration of Tibco products - RV, TRA, Administrator, Business works, Business Connect, EMS, Plugins (Ezcomm, SFTP for BC).
- Installation MFT Platform server 7.2, Command center 7.2.1 & Internet server 7.2.1
- Deployment of TIBCO applications in Development, Test and Production systems.
- Deployed EAR files within various environments using scripted deployment.
- Debug, fix and validate deployment issues in all environments by analyzing the logs using Log Viewer and coordinating with different application teams.
- Configure the TIBCO admin, create the different user for different group and give the rights to the users.
- Create the JMS Queue, Bridges and monitor in Dev, QA, and PRODUCTION.
- Configure Rendezvous Routing Daemons (RVRD) to facilitate TIBRV Communications among various network Segments.
Confidential
Responsibilities:
- Worked closely with Pre Sales team to close the RFP’ s for major clients .
- Worked on PEN testing with external vendor Deloitte.
- Gave a seminar on the projects deployed in AWS to AWS India Team.
- Installation MFT Platform server 7.2, Command center 7.2.1 & Internet server 7.2.1
- Deployment of TIBCO applications in Development, Test and Production systems.
- Worked on MFT & B2B POC’s for various clients in B2B for Confidential .
- Worked on Serverless Architecture for AWS involving API gateway, Lambda, DynamoDB, S3 .
- Worked on Microsoft azure to manage Confidential in Azure Resource manager.
- Setup Azure Infrastructure in Cloud.
- Hand on experience on Windows PowerShell
- Experience on Windows System center
Confidential
Sr Engineer SystemAdministration,Tech Lead
Responsibilities:
- Creating MFT users on Windows Servers with valid credentials
- Creating templates, Initiation Directories, Templates for File Transfer for SEIP, SRS, and TPTPC projects.
- Installation MFT Platform server 7.0 and command center 7.1.1 on test and prod machines.
- Trouble shooting issues if we have failures in file transfers of files.
- Raised POB tickets for issues during Business hours for trouble shooting by other teams.
- Checking the health of the MFT applications once there is server maintenance & patching activities scheduled.
- Applying s to MFT Platform Server on Expiry.
- Providing Clients PQF, Log files of MFT when required.
- Deployed applications in Development, Test and Production as whenever a GCAR (Global Change request) been raised to perform the change.
- Worked on FPS (Flight Planning System) and SAIS (SAS Amadeus Integration System) modules.
- Involved in Installation, configuration and maintenenance of MFT IS and PS
- Migrated Tibco applications on around 100+ Servers in Test and Prod Environments.
- Upgraded TIBCO products on PROD-PREPROD-TEST environments.
- Applying TIBCO Hotfixes of Tibco products in all environments.
- Supported 200+ applications with 400+ Services running across different domains.
- Creating Topics, Queues and Bridges in ACT and Production environments.
- Created custom rule bases for Test and Prod environments in HAWK.
- Provided 24/7 on call support.
- Raising SR’s & coordinating TIBCO support team on issues that are highly critical & unknown.
- Attended CAB (Change Advisory Board) meetings for the different changes scheduled.
- Prepared troubleshooting documents, weekly reports for the team.
- Resource and Billing management for the team.
- Creation of Domains in test & Prod
- Upgradation of TIBCO products(TRA, BW, Smartmapper, SAP & ADB Adapters, Admin) in Dev Test and PROD Environments.
- Applying Hotfixes of Tibco products in all Environments.
- Prepared troubleshooting documents, weekly reports for the team
- Worked on P2 & P3 tickets raised in Remedy.
Environment: TIB/BW 5.10, TIB/Administrator 5.7.1, TIB/RV 5.8, Remedy Ticketing System.
Confidential
Tibco Admin, Tech Lead
Responsibilities:
- Deploying the archives on TIBCO Administrator and handling various activities including monitoring and parameters configuration.
- Deployed EAR files within various environments using scripted deployment.
- Debug, fix and validate deployment issues in all environments by analyzing the logs using Log Viewer and coordinating with different application teams.
- Configure the TIBCO admin, create the different user for different group and give the rights to the users.
- Create the JMS Queue, Bridges and monitor in Dev, QA, and PRODUCTION.
- Configure Rendezvous Routing Daemons (RVRD) to facilitate TIBRV Communications among various network Segments.
- Bringing up the all the tibco, BW and adapter services after server patching.
- Created various TIBCO HAWK Rule Bases to monitor using Hawk Accelerator.
- Configured Load Balancing (LB) and Fault Tolerance (FT) for BW Engines and Adapters
- QC defects are raised for respective application’s team after investigation when required using Team Track, Virtual Tech, etc.
- To onboard newly joined team members and to held KT sessions on different applications.
- Take part daily SCRUM meetings to update the status on various issues/things
- Update documents to reflect changes for any opened defects/requirements when required.
- Worked as a Lead and Shift- coordinator for the team of 15 members.
- Prepared weekly, monthly status reports for the team for presentation to the client.
- Provided resource and time management reports to the Management.
Environment: TIB/Rendezvous 8.1, TIB/Hawk 4.8.1,TIB/Administrator 5.6.0, TIB/EMS, HP Quality Center 10.0, Windows XP, Solaris, Red hat Linux, Shell Scripting.
Confidential
Tibco Admin
Responsibilities:
- Involved in Business and Technical discussions for integrating various systems.
- Involved in preparing the Design and Data mapping documents.
- Designed and developed various TIBCO HAWK Rule Bases, Syswatch Rule bases to monitor 6000+ production systems in Whippany, New York, London, Hong Kong data centers. to monitor the EAI system, start/stop components, and provide 24/7 support on the client’s Production system in addition to the SW development
- Monitor TIBCO environment using Administrator, Hawk and other tools.
- Infrastrucuture package Installation of Tibco Hawk over Linux Servers, system watch 2.6.1 on Solaris servers and Swatch on windows based Servers
- Configuring Routing on the RVRD(Rendezvous Routing Daemons) Agent Host’s and hubs and Configuring the Hawk Display for the Agent’s
- System utilizes RVRD to cross networks, subnets and firewalls. Created/used Hawk Rule bases
- Configuration of Ping Probe for Solaris,Linux machines
- Resolved tickets opened in Peregrine Service Center and alerts in Enterprise Webtop alerting system, tickets opened by Global Infrastructure Operations Center (IOC).
- Involved in removal of Tibco Hawk, syswatch, Ping probe monitoring from the servers in process of decommission.
- Involved in Tivoli management agent End point configurations, Push Monitors and configure netview for hosts.
- Worked and opened Enterprise Change Management (ECMS) request’s by different line of business (LOB’s) for monitoring changes.
- Validate and Fix the defect’s raised by the Testing team
- Involved in 24x7 production support, on call support.
Environment: TIB/Rendezvous 7.5.1, TIB/Hawk 4.6.1, TIB/EMS,Tivoli 4.1.1, System watch 2.6.1,Swatch 1.3, Netcool/OMNIbus 7.0.1 Ping Probe, Peregrine Service Center 6.1.5, IBM Tivoli Net cool /WebTop, Windows XP, Solaris, Red hat Linux, Exceed.
Confidential
.Net Developer
Responsibilities:
- Worked with the end users in understanding the Business Requirements
- Implemented the Use cases and state Diagrams for the designed SRS
- Worked with Service oriented architecture and MVC patterns to lay out the modules of the application
- Configured the IIS to have a separate Application pools for the 1.1 & 2.0 framework applications
- Designed the Data Access, Business logic components
- Worked with the Database developers to build the initial schemas and co ordinate.
- Worked with the Dot net developers to complete the needed modules to reach the deadlines
- Worked with the reports team to develop the custom reports
- Co ordinate and associated with the QA team in Converting the SRS to test cases and test plans
- Troubles shoot the applications and worked with all the teams at times of need.
Environment: /Tools: Visual Studio .Net 2005, Framework 2.0, Web Service, C#, ASP. Net, Visual Source safe, Oracle/Pl Sql
Confidential
Team Member
Responsibilities:
- Developed and designed web forms using ASP.Net.
- Developed Coding in C#
- Involved in creating the backend database tables using Oracle.
- Involved in unit testing and also extensively involved in bug fixing.
- Documented user documentation and technical documentation
Environment: .Net 2.0, C#.Net, ASP.Net, ADO.NET, Visual Source Safe, MS Visio, Oracle
Confidential
Team Member
Responsibilities:
- Designing forms, Coding and Unit Testing
- Analyzing the program to trace the problem (Bug Fixing).
- Developed reports using Crystal Reports
- Maintaining Database for Reports.
- Designed and developed the database and wrote stored procedures for SQL Server
- Developed Views and indexing them at database level.
- Imported the database tables from other data sources like MS Access, flat files to SQL Server 2000 using Import/Export of DTS
- Taking daily backups, testing backups new users and deploying the application on the machines
- Involved in unit level testing and integration of the application
- Providing online support for the team in onsite
- Involved in developing user documentation and technical documentation
Environment: C#.Net, ASP.net,WinForms, Java ADO.NET, Visual Studio 2003,Visual Source Safe, Windows XP,MS Visio, Oracle,Tandem,Crystalreports,MS Access.
Confidential
Trainee
Responsibilities:
- Designing forms using ASP
- Designing and Coding in VB.Net
- Designing the Data Base in SQL Server
- Involved in enhancing the application with the latest requirements.
- Involved in unit testing and also extensively involved in bug fixing.
Environment: .Net 1.1, ASP.Net, C#, ADO.Net, SQL Server 2000, MS Visual source safe