Hadoop Administrator Resume
Chicago, IllinoiS
CAREER PROFILE:
- Good professional track record in reporting, programming and stakeholder relationship.
- Working knowledge of Hadoop, traditional DBMS, reporting and analysis tools
- Ability to manage development projects through all life cycle phases to completion
- Worked as developer and system administrator, managing projects and service support.
- Excellent Analytical, problem solving and troubleshooting skills in a 24/7, 10K + user environment.
TECHNICAL SKILLS:
Reporting Tools: Tableau 8.3/8.2, Tableau Server 8.3.11/9.2.0 , Cognos 10.2 / 10.1 /8. x / Reportnet, SQL 2005 Reporting and Analysis Services, Business Objects 5i, Crystal Reports
Packages: Cognos Framework Manager, Adobe Captivate, ASG Zena, MS - Visio, MS-Office, MS-Project, Macromedia Fireworks, Goldmine, Web-intelligence
RDBMS/DBA: Teradata v13, dB2 (Unix & Mainframe), Microsoft SQL Sever 2000/05/08/12 , Microsoft Access, Oracle 9i
Languages: Pig, HiveQL, Spark, Java, SQL, VBA, Perl, C#, ASP.NET, C, Web-service REST
GUI: C#, Visual Basic
Platforms: Hadoop HDP 2.6.0.3-8, Windows - NT, XP, 2003, 2000, 98, 95, UNIX, Linux.
Web design: HTML, Microsoft FrontPage, Macromedia Suite, IIS 6.0, Tomcat, Apache
Network Administration: 2003 Active Directory, DNS, Systems Mgmt Server, Remote Desktop
PROFESSIONAL EXPERIENCE:
Confidential, Chicago, Illinois
Hadoop Administrator
Responsibilities:
- Strong understanding of tools in the Hadoop Ecosystem and their utilization within Confidential .
- Designed & Developed Hadoop Monitoring tool from scratch tapping into Apache Native REST endpoints and parsing several log files for actionable insight.
- Developed Historical and Real time dashboards for visualizing Hadoop cluster utilization.
- Installed and configured various components in the Kerberized Hadoop Cluster.
- Planned and executed Ambari Upgrade without any cluster downtime.
- Debugging code issues and optimizing code from performance improvement standpoint.
- Parsed through system logs & yarn application logs for drawing actionable insights regarding system utilization.
- Well-versed with features / functionality and Confidential Utilization of HDFS, Hive, HBase, Phoenix, Kafka, Knox, Ranger, Spark 2, Sqoop, Pig, Tez, MapReduce, Yarn and Zookeeper.
- Played lead role in several proactive tech bridges from identifying technical issues to resolution and RCA.
- Engaged Hortonworks Support and Engineering team to develop test and deploy Hotfix / patches for software bugs.
- Worked on numerous Service-Now incidents and change orders.
- Well-versed with querying Application DB / Tables for Ranger, HiveMetastore, HBase, Phoenix etc. for config details.
- Captured and analyzed J-Stacks to troubleshoot issues with specific service in Hadoop Ecosystem.
- Updated several service config via Ambari and verified the update in xml files percolated to nodes.
- Utilized Service level UIs like NameNode UI, HBase Master UI, Grafana, Resource Manager UI, Ranger Admin UI etc for troubleshooting issues.
- Worked on integration with third-party applications like IBM’s Information Analyzer, Talend, Datameer, DataIKU etc.
- Implemented Hive HA via Knox Gateway. Also implemented Knox HA via external load-balancer.
- Worked with several top-notch engineers and support staff in Hortonworks to help resolve chronic / sporadic cluster issues.
- Built Hadoop usage dashboards in Tableau by storing aggregated usage metrics parsed through logs.
Confidential, Chicago, Illinois
Business Intelligence ARCHITECT CONSULTANT
Responsibilities:
- Strong understanding of the health insurance data warehouse elements and their inter-relationships. Also well-versed with life insurance data and its utilization.
- Designed and developed SDK Java programs for Tableau and Cognos.
- Worked on integrating Tableau Server with Sales force using SAML with Siteminder IdP.
- Chalked Governance rules for shared server resource utilization based on pain points identified from detailed Audit Analysis.
- Resurrected Tableau Server instance with corrupt PostgreSQL without backup
- Experience with Tableau Server Administration and Configurations.
- Well-versed with Tabadmin commands for server administration tasks.
- Worked through Tableau Server version upgrade to 8.3.11, 9.2.0, 10.2.1 and 2018.1.1.
- Trained in Tableau Desktop 8.2 and conducted training sessions for business users.
- Developer numerous dashboards in Tableau Desktop and published to server.
- Performed Unit Testing or Peer Review for Tableau Dashboards.
- Validated dashboard metrics via straight SQL from data warehouse.
- Created multiple interactive data-driven visual storyboards in Tableau.
- Designed Tableau Data Extract (TDE) from different DBMS based on user requirements.
- Interacted with other Tableau Desktop developers and provided development support as necessary.
- Provided workarounds or short term fixes for developer issues as appropriate.
- Worked on the Cognos 10.1 and 10.2 upgrade projects in capacity of administrator, modeler and report developer.
- Built views, stored procedures, macros and functions in the database to support reporting requirements and improve performance.
- Constructed numerous summary tables in the database that churn through millions of records to compute and store key performance indicators
- Managed monthly data loads for these summary tables following the monthly loads of the enterprise data warehouse.
- Worked closely with the Business / Actuary / Statisticians to certify and/or fine-tune calculations for outlier, high-dollar cut-offs, provider KPIs, peer KPIs etc.
- Wrote numerous Excel VBA macro modules to run batch files, SQL commands and format data pivots & charts in MS Excel.
- Utilized custom database functions in reports by passing defined arguments and displaying the returned results.
- Gathered requirements by reverse engineering obsolete reporting from independent and disconnected source systems.
- Translated business requirements into technical specifications
- Construction Cognos reports that print claims data on CMS approved forms namely CMS-1500 & UB-92. There reports are used as facsimiles are used by the Corporate Reimbursement Subrogation department (CRS) for recovery of out-of-state claim cases.
- Adept at writing, understanding and troubleshooting large SQL scripts in multiple RDBMS platforms.
- Effectively managed projects from initiation to completion within scope and timeline.
- Followed Solution Delivery Methodology (SDM) for project management.
- Prepared project solution template, design documents, test plans, test cases etc.
- Built strong working relationship with various stakeholders in each project including business, dbas, data owners, data modelers, business leads and managers.
Confidential, Oakbrook Terrace, Illinois
BI ANALYST
Responsibilities:
- Developed reports from their marketing datamarts using Cognos 8.2 Report Studio.
- Identified their business driver and KPIs. Translated their business requirements into technical requirements.
- Their marketing database contains prospective student data. The students who request for information from the institution are called leads. Qualified leads are referred to as Net Prospects. The net prospects who file an application with the institution move to applicant category and the student who start the academic program are classified as Starts.
- Ran queries in Toad against the datamarts. Updated queries in PL-SQL for the Summary Views in the datamart.
- Made requisite changes to the Framework Manager model.
- Developed javascript code for formatting the report during execution.
- Tracked and implemented UAT defects in the reports.
Confidential, Chicago, Illinois
BI ANALYST / Software engineer
Responsibilities:
- Deployed the company’s home-grown ASP.NET application called iRMAR (Interactive Risk Manangement Analysis and Reporting), a web-based Risk Analysis Tool for P&C insurance.
- Coded and implemented iRMAR enhancement requests from clients.
- Developed a C# and ASP.NET application for the Staff Augmentation Team. The application automated the process of working on job requirements. An ASP.NET application constantly monitors an email id for new requirements and notifies the team. Another ASP.NET application logs on to the job portal and downloads resumes that suit the given requirement. A C# service parses through the downloaded pdf files and enters requisite information into the database and emails the job description to the candidates.
- Designed the underlying SQL Database for this application.
- Acted as a single point of contact for issues with both the applications.
- Maintained the web-server (IIS 6.0) used for hosting both the applications and an FTP site.
- Maintained the company website as advised.
- Installed Cognos 8.x suite components including Framework Manager.
- Installed and configured SQL 2005 database and reporting (MSRS) and analysis services (MSAS).
- Worked with Cognos Connection to manipulate the service name, port numbers and URLs for Gateway, Dispatcher and Controller URIs. Migrated reports from Cognos Reportnet 1.1 to Cognos 8.1.
- Developed a prototype for the company’s product in Cognos. Created a welcome page and dashboard for the prototype.
- Developed OLAP cubes and analyses from both Cognos and MSAS. Developed reports on both Cognos and MSRS.
- Configured the SMTP mail client to send automated emails of the reports to the users.
Confidential, Chicago, Illinois
Graduate assistant
Responsibilities:
- IT Help Desk GA for the College of Business
- Created Windows 2003 active directory domain with 3 domain controllers.
- Maintained active directory domain with 75 computers and 115 users.
- Configured Systems Management Server for monitoring the domain.
- Configured and managed secure web-server (IIS 6.0) for hosting websites and FTP sites.
- Installed file server, created file shares and maintained access permissions.
- Created network diagrams in MS-Visio.
- Configured Cisco Catalyst 3750G-48TS
- Coded logon scripts (Batch files) for automatic virus updates at startup and AD logon.
- Configured Veritas Back-up Exec 9.0 for server and database backups.
- Established ODBC Connection with Enterprise Data Warehouse (EDW) and designed MS-Access forms for generating Finance reports.
- Used SPSS for statistical analysis of financial data.
- Generated payroll reports for HR department using Business Objects 5i.
- Installed and configured Goldmine for maintaining databases of Current and Prospective students. Created custom fields in both front-end and back-end
- Installed MS SQL 2000 database and configured it for Goldmine.
- Involved in maintenance of departmental websites.
- Documented meeting minutes