We provide IT Staff Augmentation Services!

Bigdata Solution Architect Resume

5.00/5 (Submit Your Rating)

SUMMARY:

  • Total 11 years of IT experience.
  • Specialized in building and supporting Business Intelligence, Data Warehousing, Highly Scalable and Big Data systems.
  • 3 Years on Cloudera Hadoop CDH cluster Administration.
  • Cloudera Certified Administrator for Apache Hadoop.
  • In - depth knowledge of Hadoop Architecture - HDFS, Yarn, MapReduce, Hive, Spark, Hue, Oozie, Sentry, Ranger, Kafka and Zookeeper.
  • Experience on Cloudera Manager and Ambari for management of Hadoop cluster.
  • Expertize on setting up Hadoop security, data encryption and authorization using Kerberos, TLS/SSL and Apache Sentry.
  • Experience on working on Cloud Infrastructure - AWS and IBM Softlayer.
  • Prior experience on SAP BusinessObjects and Oracle DB Administration.
  • Hands on experience on writing automation programs using Core Java, Python and UNIX Shell Scripts.
  • Outstanding troubleshooting skills.
  • Prior experience on leading/mentoring technical teams.
  • Good Communication and Documentation Skills.
  • Focused on customer satisfaction and best suited for customer facing roles.

TECHNICAL SKILLS:

Hadoop ComponentsOther Tools: Cloudera Manager Kafka Linux Networking Ambari Sqoop Windows AD/LDAP Core Java HDFS Hue Oracle JVM Tuning Hive Sentry MySQL UNIX Shell Scripting Yarn Ranger Amazon Web Services Ansible Spark Zookeeper SAP BusinessObjects.  

PROFESSIONAL EXPERIENCE: 

Confidential

BigData Solution Architect

Responsibilities: 

  • Working as Solutions Architect/Administrator on Cloudera 5.7.2 environment for Confidential Big Data IT Delivery Team.
  • Architected and installed the Production and Cloudera EDH Hadoop clusters from scratch (10 nodes CDH and 5 node dedicated Kafka clusters)
  • Designed the HDFS directory structure to suite business requirements.
  • Configured security using Kerberos, SSL/TLS, HDFS Extended ACLs and Sentry.
  • Performed LDAP Integration with Cloudera Manager, Navigator and Hue.
  • Worked with the security teams to provide cluster access for external applications through firewall. Applications used were Oracle Database, Attunity Replicate and Java/Akka Consumer hosted on AWS.
  • Implemented HDFS and Resource Manager High Availability
  • Planned and performed periodic upgrades to the cluster.
  • Added 7 new nodes to the existing DEV cluster and migrated roles as per best practices.
  • Proposed and implemented naming standards for service accounts used by third party applications.
  • Performed daily cluster health checks, log analysis and disc maintenance.

Environment: Cloudera CDH5.7.2, RedHat Enterprise Linux Server 6.7.

Confidential

Hadoop Administrator 

Responsibilities:

  • Worked as Administrator for Confidential ’s Hadoop Cluster (36 nodes).
  • Tested and Benchmarked Cloudera and Hortonworks distributions for efficiency.
  • Suggested and implemented best practices to optimize performance and user experience.
  • Build Flume and Kafka setup to stream webserver log data into HDFS.
  • Wrote Sqoop jobs to ingest Oracle data into Hive and vice-versa.
  • Developed Java based tools to push semi structured txt, csv and json data into Hive.
  • Planned and performed periodic upgrades to the cluster.
  • Performed daily cluster health checks, log analysis and disc maintenance.
  • Tuned the cluster services periodically to optimize performance.
  • Wrote UNIX shell/java based tools to automate the hadoop cluster administration procedure.
  • Provided support to end customers during unplanned outages.

Environment: Cloudera CDH5.5, RedHat Enterprise Linux Server 6.6.

Confidential

BO Administrator

Responsibilities:

  • Worked as Administrator for SAP BusinessObjects BI Platform 4.1 cluster (4 nodes).
  • Performed upgrades from SAP BusinessObjects XI 3.1 to SAP BusinessObjects BI Platform 4.1.
  • Implemented the web application cluster using mod jk between Apache and Tomcat servers.
  • Migrated Groups, Users, Reports and Universes from old version to new version using Upgrade Management Tool.
  • Performed testing and sever performance tuning on the new environment.
  • Provided support during content promotions between Dev, Test and Production environments.
  • Performed server maintenance using CCM, CMC and vendor provided scripts.
  • Wrote custom java code to report users’ access to the critical folders within the system.
  • Daily activities included server health checks and technical support to the end users.
  • Worked as DBA for a locally installed Oracle 11g database.

Environment: SAP BusinessObjects 4.1, Oracle 11g, RedHat Enterprise Linux Server 6.0.

Confidential

Sr. BO Administrator

 Responsibilities:

  • Managed and supported SAP BOE 3.1 Infrastructure.
  • Designed and implemented the newer SAP BusinessObjects BI Platform 4.0.
  • Migrated Security, Reports, Universe and Connections to the newer environment.
  • Worked with developers and other vendors to convert Desktop Intelligence into Web Intelligence Reports.
  • Developed a fully automated System Health Check application using Java SDK for SAP Business Objects.
  • Developed a custom Universe Documenter tool using VBA Macros and Universe Designer SDK to document all the Universes on an MS Excel file.
  • Performed POC on Apache Hadoop.

Environment: SAP BO 3.1, Apache Hadoop 1.0, Oracle 10g, Windows Server 2008.

Accenture 

Sr. Software Engineer

Responsibilities:

  • Managed the SAP BO 3.1 infrastructure.
  • Provided support to customers via tickets.
  • Setup and manage recurring report schedules.
  • Performed promotion of reports, universes and connections based on user requests.
  • Managed access to users as per instructions of their team leads/managers.
  • Generated weekly audit reports about usage and send to respective teams.
  • Developed custom VBA macro based ETL tool to move data between MS Excel and Oracle database.
  • Developed custom java code about the used security model.

Environment: SAP Business Objects XI 3.1, Oracle 10g, Windows Server 2003.

Confidential

Sr. Software Engineer

Responsibilities:

  • Worked as a Web Intelligence and Desktop Intelligence Report Developer.
  • Developed new Web Intelligence reports over a Universe based off Teradata.
  • Migrated older Desktop Intelligence Reports to the new system and redevelop, if necessary.
  • Tested the reports on the new environment.
  • Worked with the Universe Designers and DBA for SQL performance tuning.

Environment: BO XI R2, 3.1, Windows Server 2000, 2003, Oracle 10g, TeraData V2R6 

We'd love your feedback!