Sr. Iis/confluent Kafka Administrator Resume
Rocklin, CA
SUMMARY
- Around 10 years of total IT Experience in Kafka, Data Warehousing and Data integration and conversion processes, including Software Architecture, Design.
- Hands - on experience in designing and working with Confluent Kafka 5.x/6.x (Apache kafka 0.x/1.x/2.x, Schema-registry, KSQL, Rest-Proxy, Kafka-Connect, Control-Center).
- Experience on Data Integration and migration for Data Warehouses including Data Quality and Data Transformation using IBM/Ascential DataStage EE 7.5/8.0/8.1/8.5/8.7//9.1/11.3. x /11.5.x/11.7.x (DataStage Manager, DataStage Designer, DataStage Director, DataStage Administrator) and Parallel Extender/Orchestrate.
- Expertise in Confluent Kafka 5.5.x/6.x environment Setup on Azure Cloud and on-prem with hands-on multiple implementations including products install experience.
- Experience in all aspects of Confluent Kafka 5.5.x/6.x systems administration.
- Experience in Confluent Kafka 5.5.x/6.x Install using ansible and individual product installs.
- Experience in Security implementation using mutualTLS and RBAC/ACLs on Kafka-cluster (kafka Broker, schema-registry, Rest Proxy, KSQL, Kafka Connect and Control Center).
- Experience in Kafka API implantation on schema-registry and Rest-proxy.
- Experience in Confluent Kafka 5.5.x/6.x control-center UI setup
- Experience in Confluent Kaka Upgrade from 5.5.0 to 6.x on Azure.
- Experience in applying maintenance and rolling restarts.
- Experience in installation of InfoSphere Information Server Versions 8.0/8.1/8.5/ 8.7/9.1/11.3. x/11.5.x/11.7.x
- Expertise in Administration and Installation of IBM InfoSphere Information Server Tools likeData Stage, QualityStage, ProfileStage (IA), Information Governance catalogue, Information Governance Dashboard, Business Glossary and Metadata workbench.
- Hands on Experience in Design and Development of DataStage Server, Parallel and Sequence Jobs.
- Experience in integration of various data sources(Oracle 8i/9i/10g/11g/12c, SQL Server, DB2, Flat Files, XML files, and various File systems) into staging area and target data warehouse.
- Experience in Design, Installation and Upgrade of MDM (Master Data Management) Environment with DataStage Architectures.
- Expertise in Administration Standardization QualityStage Console an IBM Information Tool with AVI (Address Verification Tool).
- Strong Experience and knowledge in installing, configuring and upgrade AVI (Address Verification Interface) tool on DataStage 11.7.x/11.5.x
- Experience in configuring TLSv1.2 with secure port on DataStage 11.5.x/11.7.x (All Tiers) and MDM 11.5.x/11.6.x Environments.
- Experience in Automation on Linux Server DS start/stop, Healthcheck, clean- Confidential and backups on DataStage and MDM Environments.
- Experience in Automation on Linux Server DataStage and MDM Server build checks on Environments.
- Experience in operational database setup and continues monitoring of Operational console.
- Experience in Setting up Work Load Manager (WLM) on the Environment.
- Strong design experience on Technical Metadata, Project Metadata, Business Metadata and Operational Metadata using InfoSphere Information Server suite in various versions.
- Defined and implemented the various components of a data warehouse such as Operational source systems, Data staging, Data presentation and Data access tools. Participated in discussions with Project Manager, Business Analysts and Team Members on any technical and/or Business Requirement issues
- Experience in design ofhigh level and low-leveldocs based on the business and functional requirements.
- Experience in Installation, configuration, and administration of the Talend 6.x/ 5.x
- Experience in IBM MDM 11.0.x/11.5.x/11.6.x Installation and integration with InfoSphere Information Server.
- Experience in applying patches, fixpacks to IBM MDM environment 11.0.x/11.5.x/11.6.x.
- Experience in Converting theBusiness Logic into Technical Specifications.
- Extensively worked on processing stages likejoin, merge, lookup, funnel, transformer, change capture etc. to design server jobs, parallel jobs and complex sequence jobs.
- Involved inmigration of DataStage projects and jobs from previous versions into 8.0/8.1/8.5/ 8.7/9.1/11.3. x/11.5.x/11.7.x
- Fixed errors, issues and bottlenecks in design, compilation and execution of server jobs, parallel jobs and complex sequence jobs.
- Performed administration tasks like role setup, connectivity, security, configuration of projects, user registries, DSNs, parallel, compiler, reporting, operator and user-defined environment variables, backup DataStage and restart of services etc.
- Worked with IBM Technical Support on the configuration of xmeta repository, Node Agents, DS Engine and WebSphere Application Server.
- Identified the fixes via patches, fix pack1 and rollup patch 1 for DataStage Engine, Parallel Engine, Node Agents, Connectivity and xmeta components.
- Worked closelywithIBM using ESR (PMR) tool for any product, server performance and design related issues.
- Experience integration and Supporting WebSphere MQ on DataStage Environment 8.7/9.1/11.3. x/11.5.x/11.7.x.
- Hands on Experience in configuration, and administration of the Big Data with DataStage.
- Hands on experience in Batch Processes, IMPORT, EXPORT, BACKUP, BCP (DR Testing)
- Experience in High Availability testing on DataStage and MDM.
- Experience building Servers and installing DataStage on AWS POC using Terraform.
- Leading offshore team and manage projects.
- Knowledge of software development life cycle, database design, RDBMS, data warehousing and data modelling concepts.
- Good team player, Strong communication skills and Interpersonal with self-motivation and 24/7 on call production support.
TECHNICAL SKILLS
ETL: IBM DataStage 11.7.x/11.5.x/11.3.x/9.x/8.x/7.5.x EE & SE, IBM IIS 11.7/11.5/11.3/9.1/8.5/8.1.1/8.0, InfoSphere Information Analyzer ProfileStage, QualityStage, Address Verification Interface (AVI) Metadata Work bench, IBM MDM 11.0.x,Talend 7.x/ 6.0.1/ 5.6.2 Confluent Kafka 5.5.x/6.x Install, RBAC Security, Schema-registry, Rest-proxy, KSQL, Connect, Control-Center
Databases: Oracle 19c/12c/11g/10g/9i, Teradata v13.10/2R5/R6, DB2 11.x/10.x/9.x/7.x, Informix 5.0/6.0.
Programming: Ansible, Terraform, Python, PL/SQL, Shell Scripting, XML, JSON, GIT
Operating System: Red Hat Linux 5.x/6.x/7.x, AIX, HP-UX, Solaris, Windows NT/ 7/10/2000/2003/2008/2008 R2/2012 server.
Scheduling: Crontab Utility, ESP, Control-M, Autosys, CA7, D-Series.
Connectivity: Secure CRT, Citrix, Putty, Sales force V1.5.0, SAP R3 V6.5.0.1,HDP 1.3.x/2.3, WinSCP, Exceed, Edit++
Cloud: AWS, Azure, OCI
PROFESSIONAL EXPERIENCE
Confidential, Rocklin, CA
Sr. IIS/Confluent Kafka Administrator
Responsibilities:
- Expertise in Confluent Kafka 5.5.x/6.x environment Setup on Azure Cloud and on-prem with hands-on multiple implementations including products install experience.
- Experience in all aspects of Confluent Kafka 5.5.x/6.x systems administration.
- Experience in Confluent Kafka 5.5.x/6.x Install using ansible and manual installs.
- Experience in Security implementation using mutualTLS and RBAC/ACLs on all kafka Components and Users.
- Experience in Confluent Kafka 5.5.x/6.x control-center UI setup
- Experience in Kafka Upgrade from 5.x to 6.x.
- Experience ins scaleup and scaledown the kafka cluster as per requirement.
- Experience in using post-man to delete / update / create schema on kafka topics.
- Experience in using kafka API on schema-registry and Rest-proxy.
- Experience in Enabling JMX metrics and Log management.
- Experience in setting up alerts for application consumer lag. New relic implementation on production monitoring.
- Experience in automation on create kafka topics, providing rolebindings.
- Expertise in Promoted KSQL streams from lower to higher environments.
- Experience in application setup and onboarding new applications.
- Expertise in IBM’s IIS DataStage version 7.1/7.5.x/ 8.5/8.7/8.7.2/11.3/11.3.1/11.5. 1/11.5.2/11.7/11.7.1/11.7.2 products with hands-on multiple implementations experience
- IBM IIS DataStage Server Product 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x upgrade experience
- Experience in all aspects of IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x systems administration
- Administer IBM Datastage 7.5, 8.5, 9.1, & 11.3 environments, Snaplogic, Talend, and SeeBeyond products.
- Experience in Confluent Kafka 5.5.x/6.x troubleshooting and Performance Tuning
- Experience in Confluent Kafka 5.5.x/6.x High availability.
- Implemented Client quotas on shared kafka-cluster.
- Experience in Confluent Kafka 5.5.x/6.x providing general support on onboarding application, Monitoring cluster Health, Automation process.
- Provide additional administration support for various integration technologies, such as: IBM MQ, IBM IIB, Kafka, RabbitMQ, and other legacy platforms (SeeBeyond, Oracle Retail RIB, EME, MLINK, XCOM, & Tuxedo).
- Implement and administer new Integration servers and projects (both cloud and on prem), working with delivery teams to ensure success.
- Experience in IBM IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x troubleshooting and Performance Tuning
- Experience in IBM IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x High availability and backup and recovery
- Experience with large and complex data management projects, delivering IT Services and Consulting projects within the organization
- Familiarity with all support processes and best practices related to IBM the IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x products
- Familiarity with organizational support structure related to IBM IIS 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x DataStage products
- Strong RedHat Linux systems administration skills
- Experience in Linux RedHat clustering
- Experience in setting up MDM (Master Data Management) v11.0/11.0.x/11.5.x/11.6.x Environment with DataStage.
- Experience in configuring TLSv1.2 with secure port on DataStage 11.5.x/11.7.x (All Tiers) and MDM 11.5.x/11.6.x Environments.
- Experience in new install of MDM and Applying Fixpacks to MDM.
- Experience in installing AVI (Address Verification interface) tool on DataStage.
- Experience in IBM MDM v11.0.x/11.5.x/11.6.x troubleshooting and Performance Tuning.
- Experience in IBM MDM v11.0.x/11.5.x/11.6.x High availability and backup and recovery.
- Apply fixes, patches and Service Packs to keep the environment in sync.
- Updated and Configured ODBC 7.1.6/7.1.5/7.6. x/6.1.x drivers and connections, maximum no. of processes per node and Paging space.
- Experience in operational database setup and continues monitoring of Operational console.
- Experience in Setting up Work Load Manager (WLM) on the Environment.
- Created PMRs with IBM for interim fixes, refresh packs, patches and fix packs.
- Configured. odbc.ini, dsenv, uvconfig, DSParams, uvodbc.config files at both engine and project levels.
- Unlocked jobs. Set up Configuration Files, Job Parameters, Environment Variables and Data Connections across jobs in a project
- Project Creation/Setup access/environment to developers/project teams etc.,
- Job maintenance/hot fix on PRD environment (correct job variables, unlock jobs, recompile jobs)
- Failover activities Standard Admin activities (recycle, shutdown and startup on demand)
- Support yearly DR activities.
- Experience in Automation of healthcheck and cleanups on MDM (Master Data Management) and DataStage Linux Environments.
- Experience in password changes as part of security cadence DataStage and MDM (Master Data Management) Linux Environments.
- Support code migration/deployment activities into Production.
- Experience implementing IBM IIS 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x11.7.x and MDM v11.5.x/11.6.x DataStage/MDM in a virtual environment.
- Experience Supporting WebSphere and DB2 on DataStage Environment.
- Worked closely with WebSphere v9.x upgrade and Db2 v11.x upgrade and configuring TLSv1.2.
- Experience Hadoop POC Integration with DataStage 11.5.x/11.7.x.
- Experience building Servers and installing DataStage on AWS POC using Terraform.
- Experience integration and Supporting WebSphere MQ on DataStage Environment.
- Experience in High Availability testing on DataStage and MDM.
- Leading offshore team and manage projects.
- Experience with IBM IIS/MDM Installation, Apply Patches fixpacks and Support.
- Involved in 24/7 production Support.
Environment: IBM InfoSphere Information Server V11.3.x, 11.5.x & 11.7.x Suite DataStage, Quality Stage, AVI & Information Governance catalogue, Confluent Kafka 5.x/6.x Zookeeper, Broker, Control center, schema-registry, ksql, Connect, Rest Proxy, IBM Master Data Management v11.0.x, Oracle 12c/11g/10gR2, DB2LUW 10.1, Teradata V13.10, WAS9.1.x/ 8.5.5.1/8.5.5.8/8.5.5.12/8.5.5.13, HDP 2.4.2/2.3/1.3. x, SQL, PL/SQL, CA7, Shell Scripts, WebSphere MQ, Linux System Administration, Red Hat Linux RHEL 5.x/6.x/7.x,Azure Cloud, TLSv1.2
Confidential, Mahwah, NJ
Sr. IIS/MDM Administrator
Responsibilities:
- Expertise in IBM’s IIS DataStage version 8.5/8.7/8.7.2/11.3/11.3.1/11.5. 1/11.5.2/11.7/11.7.1/11.7.2 products with hands-on multiple implementations experience
- IBM IIS DataStage Server Product 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x upgrade experience
- Experience in all aspects of IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x systems administration
- Experience in IBM IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x troubleshooting and Performance Tuning
- Experience in IBM IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x High availability and backup and recovery
- Experience with large and complex data management projects, delivering IT Services and Consulting projects within the organization
- Familiarity with all support processes and best practices related to IBM the IIS DataStage 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x products
- Familiarity with organizational support structure related to IBM IIS 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x/11.7.x DataStage products
- Strong RedHat Linux systems administration skills
- Experience in Linux RedHat clustering
- Experience in setting up MDM (Master Data Management) v11.0/11.0.x/11.5.x/11.6.x Environment with DataStage.
- Experience in configuring TLSv1.2 with secure port on DataStage 11.5.x/11.7.x (All Tiers) and MDM 11.5.x/11.6.x Environments.
- Experience in new install of MDM and Applying Fixpacks to MDM.
- Experience in installing AVI (Address Verification interface) tool on DataStage.
- Experience in IBM MDM v11.0.x/11.5.x/11.6.x troubleshooting and Performance Tuning.
- Experience in IBM MDM v11.0.x/11.5.x/11.6.x High availability and backup and recovery.
- Apply fixes, patches and Service Packs to keep the environment in sync.
- Updated and Configured ODBC 7.1.6/7.1.5/7.6. x/6.1.x drivers and connections, maximum no. of processes per node and Paging space.
- Experience in operational database setup and continues monitoring of Operational console.
- Experience in Setting up Work Load Manager (WLM) on the Environment.
- Created PMRs with IBM for interim fixes, refresh packs, patches and fix packs.
- Configured. odbc.ini, dsenv, uvconfig, DSParams, uvodbc.config files at both engine and project levels.
- Unlocked jobs. Set up Configuration Files, Job Parameters, Environment Variables and Data Connections across jobs in a project
- Project Creation/Setup access/environment to developers/project teams etc.,
- Job maintenance/hot fix on PRD environment (correct job variables, unlock jobs, recompile jobs)
- Failover activities Standard Admin activities (recycle, shutdown and startup on demand)
- Support yearly DR activities.
- Experience in Automation of healthcheck and cleanups on MDM (Master Data Management) and DataStage Linux Environments.
- Experience in password changes as part of security cadence DataStage and MDM (Master Data Management) Linux Environments.
- Support code migration/deployment activities into Production.
- Experience implementing IBM IIS 8.5/8.7/8.7.2/11.3/11.3.1/11.5. x11.7.x and MDM v11.5.x/11.6.x DataStage/MDM in a virtual environment.
- Experience Supporting WebSphere and DB2 on DataStage Environment.
- Worked closely with WebSphere v9.x upgrade and Db2 v11.x upgrade and configuring TLSv1.2.
- Experience Hadoop POC Integration with DataStage 11.5.x/11.7.x.
- Experience building Servers and installing DataStage on AWS POC using Terraform.
- Experience integration and Supporting WebSphere MQ on DataStage Environment.
- Experience in High Availability testing on DataStage and MDM.
- Leading offshore team and manage projects.
- Experience with IBM IIS/MDM Installation, Apply Patches fixpacks and Support.
- Involved in 24/7 production Support.
Environment: IBM InfoSphere Information Server V11.3.x, 11.5.x & 11.7.x Suite DataStage, Quality Stage, AVI & Information Governance catalogue, IBM Master Data Management v11.0.x, Oracle 12c/11g/10gR2, DB2LUW 10.1, Teradata V13.10, WAS9.1.x/ 8.5.5.1/8.5.5.8/8.5.5.12/8.5.5.13, HDP 2.4.2/2.3/1.3. x, SQL, PL/SQL, CA7, Shell Scripts, WebSphere MQ, Linux System Administration, Red Hat Linux RHEL 5.x/6.x/7.x, TLSv1.2
Confidential, RICHFIELD, MN
Sr. IIS Administrator
Responsibilities:
- Installed, Configured and Administered DataStage & QualityStage, InfoSphere Information Analyzer, Information Governance Catalogue, IS Manager of InfoSphere Information Server 11.3.1 & 11.5 suites in UAT, Training and Prod Phases.
- Stopped and started DataStage Engine, WebSphere Application Server and Information Server and managed logs.
- Installed fix packs. Applying patching/roll-upsand upgrades regularly with IBM recommendation.
- Assigned suite roles and suite components roles for the users in Information Server Web Console.
- Updated and Configured ODBC 7.1.5/7.1.4 drivers and connections, maximum no. of processes per node and Paging space.
- Unlocked jobs. Set up Configuration Files, Job Parameters, Environment Variables and Data Connections across jobs in a project.
- Involved in migration of DataStage and QualityStage projects and jobs from earlier versions to 11.5 Version
- Determined Distinguished Names DN and Configured IBM IS tools to use LDAP user registry with Active Directory and also configured the PAM.
- DataStage disk usage - projects, system files, datasets & scratch.
- Installed and Configured fix pack 2 on IIS 11.3 and resolved errors.
- Created PMRs with IBM for interim fixes, refresh packs, patches and fix packs.
- Configured. odbc.ini, dsenv, uvconfig, DSParams, uvodbc.config files at both engine and project levels.
- Apply fixes, patches and Service Packs to keep the Talend environment up-to-date.
- Configured parallel engine, database connectivity in parallel environment and access to ODBC sources.
- Managed ASBAgent, Logging Agent, DSRPC, Telnet and Engine Resource services.
- Setting up the SSH (Secure Shell) for DSADM & Userids.
- Involved in Configuring IBM IS tools to use LDAP user registry with Active Directory.
- Created and maintained WebSphere cluster environment
- Stopped and started WebSphere Manager and Nodes.
- InfoSphere Information Server In-Place Upgrade from 11.3.1 to 11.5.
- Assets import and export using iisadmin.sh tool.
- Configured Hive Connectivity.
Environment: IBM InfoSphere Information Server v9.1, 11.3 & 11.5 Suite DataStage & QualityStage, ProfileStage/Information Analyzer/Information Governance catalogue/Dashboard, IS Manager, Informix 6.0, Oracle 12c/11g/10gR2, DB2LUW 10.1,Teradata V13.10, WAS 8.5.5.1/8.5.5.5, HDP 2.3/1.3.x, SQL, PL/SQL, CA7, Shell Scripts, Windows XP, Red Hat Linux RHEL 6.7
Confidential
DataStage Administrator
Responsibilities:
- Installed, Configured and Administered DataStage & QualityStage, InfoSphere Information Analyzer, IS Manager of InfoSphere Information Server 9.1 & 11.3 suite in Dev, UAT and Prod Phases.
- Configured High-Availability to ensure reliable operation, and automatically monitors available compute resources to ensure that no jobs are scheduled to failed machines.
- Stopped and started DataStage Engine, WebSphere Application Server and Information Server and managed logs.
- Installed Patches & fix packs regularly with IBM recommendation.
- Assigned suite roles and suite components roles for the users in Information Server Web Console.
- Configured ODBC connections, maximum no. of processes per node and Paging space.
- Validated and debugged the developed jobs.
- Setting up the SSH (Secure Shell) for DSADM & Userids.
- Involved in Configuring IBM IS tools to use LDAP user registry with Active Directory.
- Unlocked jobs and also releases Xmeta locks. Set up Configuration Files, Job Parameters, Environment variables and Data Connections across jobs in a project.
- Involved in migration of DataStage and QualityStage projects and jobs from earlier versions to 11.3 versions.
- Worked with Administrator Client to manage projects and set their properties.
- Worked with Director Client to schedule, run and view the logs of jobs.
- Configured. odbc.ini, dsenv, uvconfig, DSParams, uvodbc.config files at both engine and Project levels.
- Worked on performance tuning of ETL jobs using SQL queries, data connections, Configuration files, parameter sets and environment variables.
- Used DataStage Designer/Manager/Director to design and run jobs to implement the Import and Export Interfaces.
- Extensively used DataStage Designer components to design various Server and Parallel jobs.
- Imported table definitions from ODBC/Plug-in table definitions available.
- Used CA7 for auto scheduling of DataStage jobs in Production environment.
- Used ISTOOL to migrate job objects between different environments in IS Manager.
- DataStage disk usage - projects, system files, datasets & scratch. Used Orchadmin command for deleting datasets.
- Backup and Restore of IIS 11.3 Suite. Migrate code into production on daily basis.
- 24x7 DataStage ETL support and resolution of errors.
Environment: IBM InfoSphere Information Server V9.1 & 11.3 Suite DataStage & QualityStage, ProfileStage/Information Analyzer, IS Manager, Informix 6.0, Oracle 11g/10gR2, DB2 9.5, 4.2,Teradata V13.10, WAS7.0.0.11, HDP 1.3, SQL, PL/SQL, CA7, Shell Scripts, Windows 7, Red Hat Linux RHEL 6.5.