Bigdata Solution Architect Resume
SUMMARY:
- Total 11 years of IT experience.
- Specialized in building and supporting Business Intelligence, Data Warehousing, Highly Scalable and Big Data systems.
- 3 Years on Cloudera Hadoop CDH cluster Administration.
- Cloudera Certified Administrator for Apache Hadoop.
- In - depth knowledge of Hadoop Architecture - HDFS, Yarn, MapReduce, Hive, Spark, Hue, Oozie, Sentry, Ranger, Kafka and Zookeeper.
- Experience on Cloudera Manager and Ambari for management of Hadoop cluster.
- Expertize on setting up Hadoop security, data encryption and authorization using Kerberos, TLS/SSL and Apache Sentry.
- Experience on working on Cloud Infrastructure - AWS and IBM Softlayer.
- Prior experience on SAP BusinessObjects and Oracle DB Administration.
- Hands on experience on writing automation programs using Core Java, Python and UNIX Shell Scripts.
- Outstanding troubleshooting skills.
- Prior experience on leading/mentoring technical teams.
- Good Communication and Documentation Skills.
- Focused on customer satisfaction and best suited for customer facing roles.
TECHNICAL SKILLS:
Hadoop ComponentsOther Tools: Cloudera Manager Kafka Linux Networking Ambari Sqoop Windows AD/LDAP Core Java HDFS Hue Oracle JVM Tuning Hive Sentry MySQL UNIX Shell Scripting Yarn Ranger Amazon Web Services Ansible Spark Zookeeper SAP BusinessObjects.
PROFESSIONAL EXPERIENCE:
Confidential
BigData Solution Architect
Responsibilities:
- Working as Solutions Architect/Administrator on Cloudera 5.7.2 environment for Confidential Big Data IT Delivery Team.
- Architected and installed the Production and Cloudera EDH Hadoop clusters from scratch (10 nodes CDH and 5 node dedicated Kafka clusters)
- Designed the HDFS directory structure to suite business requirements.
- Configured security using Kerberos, SSL/TLS, HDFS Extended ACLs and Sentry.
- Performed LDAP Integration with Cloudera Manager, Navigator and Hue.
- Worked with the security teams to provide cluster access for external applications through firewall. Applications used were Oracle Database, Attunity Replicate and Java/Akka Consumer hosted on AWS.
- Implemented HDFS and Resource Manager High Availability
- Planned and performed periodic upgrades to the cluster.
- Added 7 new nodes to the existing DEV cluster and migrated roles as per best practices.
- Proposed and implemented naming standards for service accounts used by third party applications.
- Performed daily cluster health checks, log analysis and disc maintenance.
Environment: Cloudera CDH5.7.2, RedHat Enterprise Linux Server 6.7.
Confidential
Hadoop Administrator
Responsibilities:
- Worked as Administrator for Confidential ’s Hadoop Cluster (36 nodes).
- Tested and Benchmarked Cloudera and Hortonworks distributions for efficiency.
- Suggested and implemented best practices to optimize performance and user experience.
- Build Flume and Kafka setup to stream webserver log data into HDFS.
- Wrote Sqoop jobs to ingest Oracle data into Hive and vice-versa.
- Developed Java based tools to push semi structured txt, csv and json data into Hive.
- Planned and performed periodic upgrades to the cluster.
- Performed daily cluster health checks, log analysis and disc maintenance.
- Tuned the cluster services periodically to optimize performance.
- Wrote UNIX shell/java based tools to automate the hadoop cluster administration procedure.
- Provided support to end customers during unplanned outages.
Environment: Cloudera CDH5.5, RedHat Enterprise Linux Server 6.6.
Confidential
BO Administrator
Responsibilities:
- Worked as Administrator for SAP BusinessObjects BI Platform 4.1 cluster (4 nodes).
- Performed upgrades from SAP BusinessObjects XI 3.1 to SAP BusinessObjects BI Platform 4.1.
- Implemented the web application cluster using mod jk between Apache and Tomcat servers.
- Migrated Groups, Users, Reports and Universes from old version to new version using Upgrade Management Tool.
- Performed testing and sever performance tuning on the new environment.
- Provided support during content promotions between Dev, Test and Production environments.
- Performed server maintenance using CCM, CMC and vendor provided scripts.
- Wrote custom java code to report users’ access to the critical folders within the system.
- Daily activities included server health checks and technical support to the end users.
- Worked as DBA for a locally installed Oracle 11g database.
Environment: SAP BusinessObjects 4.1, Oracle 11g, RedHat Enterprise Linux Server 6.0.
Confidential
Sr. BO Administrator
Responsibilities:
- Managed and supported SAP BOE 3.1 Infrastructure.
- Designed and implemented the newer SAP BusinessObjects BI Platform 4.0.
- Migrated Security, Reports, Universe and Connections to the newer environment.
- Worked with developers and other vendors to convert Desktop Intelligence into Web Intelligence Reports.
- Developed a fully automated System Health Check application using Java SDK for SAP Business Objects.
- Developed a custom Universe Documenter tool using VBA Macros and Universe Designer SDK to document all the Universes on an MS Excel file.
- Performed POC on Apache Hadoop.
Environment: SAP BO 3.1, Apache Hadoop 1.0, Oracle 10g, Windows Server 2008.
Accenture
Sr. Software Engineer
Responsibilities:
- Managed the SAP BO 3.1 infrastructure.
- Provided support to customers via tickets.
- Setup and manage recurring report schedules.
- Performed promotion of reports, universes and connections based on user requests.
- Managed access to users as per instructions of their team leads/managers.
- Generated weekly audit reports about usage and send to respective teams.
- Developed custom VBA macro based ETL tool to move data between MS Excel and Oracle database.
- Developed custom java code about the used security model.
Environment: SAP Business Objects XI 3.1, Oracle 10g, Windows Server 2003.
Confidential
Sr. Software Engineer
Responsibilities:
- Worked as a Web Intelligence and Desktop Intelligence Report Developer.
- Developed new Web Intelligence reports over a Universe based off Teradata.
- Migrated older Desktop Intelligence Reports to the new system and redevelop, if necessary.
- Tested the reports on the new environment.
- Worked with the Universe Designers and DBA for SQL performance tuning.
Environment: BO XI R2, 3.1, Windows Server 2000, 2003, Oracle 10g, TeraData V2R6
