TECHNICAL SKILLS:

Software: Apache Spark, Hadoop HA/Federation clusters, HDP 2.3/2.5, CDH4/5, Hive, Pig, Kafka, zookeeper, oozie, ETL, EDW, Talend, Microsoft Power BI, SQL, Hadoop Security, Ranger, Knox, Kerberos, LDAP, Ambari, AWS Cloud, RHEL, Ansible, HBase, MongoDB, Solaris, Java Programming, Shell scripting, Vmware, Linux.

Hardware: HP DL380e Gen9, DL360P Gen9, Oracle(sun)Sparc, HP ProLiant BL460 Gen7/8/9,HP Proliant DL380 Gen7/8/9.IBM x3650 m4/m3, Sun E15/25K, Sun E450/250, Emulex HBA, Qlogic HBA, CNA, SATA, SAS. Cloud (AWS, Azure, IBM Pure)

PROFESSIONAL EXPERIENCE:

Confidential, Chicago, IL

Hadoop Administrator

Responsibilities:

• Build and Support Hadoop Based EDW platform to support ETL process. Streamline data ingestion from multiple source systems into Datalake. Transform data. Create and support workflow in Talend TAC and Oozie, develop Pig, Hive QL, Spark QL, Spark Streaming scripts. Build Master Data Management (MDM) data sourcing data from datalake. Create data lineage using Talend TMM.
• Install and configure and manage hdp2.3.2/hdp2.5.2 hortonworks hadoop on premise cluster in Lower Level and Production, Disaster Recovery environments. Use Ambari, zookeeper, oozie, Falcon to manage the cluster. Stabilize Bigdata/Hadoop cluster with regular patch updates and cluster upgrades. Build Operational process to manage Bigdata/hadoop clusters with agreed Service Level Agreements.
• Secure Bigdata/Hadoop cluster with robust security architecture using Kerberos, Active Directory, Ranger, Knox, Centrify. Automate hadoop cluster access controls through Ranger policies for the uptodate security. Provide granula security upto column level. Datagovernance from the TMM data lineage and Ranger based access controls on HDFS and Hive Metadata. End user security through Kerberos CLI tools, beeline and ambari views.
• Prepare and execute contingency plan by building Disaster Recovery hadoop cluster and automate replication from Production with regular interval. Oozie, Falcon based replication.
• Build interactive web interface to the developers and end users of hadoop with Ambari view to run Pig jobs, hive jobs, View Tez jobs.

Confidential, Chicago, IL

Hadoop Administrator

Responsibilities:

• POC environment created on Hadoop to test flume and storm based streaming.
• Design and deployment of a Security using Kerberos with Active Directory Integration and Sentry. Installation of a local MIT KDC, OpenLDAP integration. Ensure server security with centralized user authentication (controlSA, Active Directory), Create user profiles based on the roles through power broker, sudo and ACLs. Evaluate server security through ESM reports generated against corporate security policies. Server hardening as per the OS hardening documents provided by Engineering Team.
• Hadoop clusters Installation, configuration, tuning of full stacks (Linux, Hadoop (through 2.x, Hortonworks HDP, and Cloudera) with multiple 40+ node servers (Physical and AWS cloud). Preparation of the Operating System Linux(Redhat/CentOS/Ubuntu. Installed OS and Hadoop updates, patches, version upgrades. Planned and managed HDFS storage capacity.
• Hadoop security configuration on Hortonworks HDP cluster. Implementing KNOX and Ranger on hadoop systems for security. Coordinated enforcement across Hadoop workloads from batch, interactive SQL and real - time IN Hadoop using Apache Ranger. Perimeter security to extend Hadoop access to more of those new users while also maintaining compliance with enterprise security policies through KNOX gateway setup.
• Programming using Ansible, shell scripts to automate server build process, do quality checks on newly build servers.

Confidential, Lansing, MI

Infrastructure/Middleware Engineer

Responsibilities:

• ITIL based Operational production support in L3 team, which involves Incident management, change management, problem management and request management.
• Creating and Managing the Nodes, Application Servers and Clusters.
• Installation, Configuration and Administration of IBM Middleware Servers on AIX/LINUX platforms. Installation, Creation of VM environments in Dev and Test using Vagrant and automation of configuration and Administration of Enterprise Applications on WAS and Jboss Servers.
• Administration of IBM HTTP Server 6.0 on different nodes and configured them by generating the plug-in. Deploying J2EE applications on WebSphere managed environments such as Dev, System, Performance, Implementation and Production. Setting up the environment for Dev, System, Perf, Imp and Production. Troubleshooting the issues related to the deployed Applications. Applied Fix Packs and Cumulative Fixes to Server.

Confidential, Bloomington,IL

Sr Systems Analyst

Responsibilities:

• Involved in Java, J2EE, Hibernate in a fast-paced development environment.
• Followed agile methodology, interacted directly with the client provide/take feedback on the features, suggest/implement optimal solutions, and tailor application to customer needs.
• Developed UI of Web Service using Struts MVC Framework. Designed UI forms for different size devices.
• Involved in design, development, and testing phases of software development life cycle.
• Developed use case diagrams, class diagrams, database tables, and provided mapping between relational database tables and object oriented java objects using Hibernate.
• Created and deployed web pages using HTML, JSP, JavaScript, CSS and Angular JS framework.
• Developed web tier components of web stores using Spring Web MVC framework that leverages Model View Controller (MVC) architecture and used spring tool Suite.
• Implemented SOA based web services, designed and built SOAP web service interface.
• Used MVC-Struts framework in the front-end to develop the User Interface.
• Involved in the implementation of business logic in struts Framework and Hibernate in the back-end.

Confidential, Chicago, IL

Java Developer

Responsibilities:

• Developed UI of Web Service using Struts MVC Framework. Involved in design, development, and testing phases of software development life cycle. Developed use case diagrams, class diagrams, database tables, and provided mapping between relational database tables and object oriented java objects using Hibernate.
• Created and deployed web pages using HTML, JSP, JavaScript, CSS and Angular JS framework.
• Developed web tier components of web stores using Spring Web MVC framework that leverages Implemented JDBC to connect with the database and read/write the data. Bug fixing and 24/7production support and worked on bug fixing and enhancements on change requests.
• Created the database roles, users, tables, views, procedures, packages, functions and triggers in Oracle using Toad. Developed test cases and performed unit testing using JUnit. Involved in Sprint meetings and followed agile software development methodologies. Designed database and created tables, written the complex SQL Queries and stored procedures as per the requirements. Involved in build and deployment process using Hudson and ANT for building java/J2EE applications.