We provide IT Staff Augmentation Services!

Big Data Lead/architect Resume

3.00/5 (Submit Your Rating)

Plano, TX

SUMMARY

  • Big Data Architect/Lead with Overall 12 + years of IT experience in Solution & Technical Architecture, Project
  • Management, Designing, Developing and implementing solutions across Infrastructure, Auto and CRM Domains.
  • Expertise in Big Data Hadoop Map Reduce framework using Hadoop with YARN, Hive, Pig, Flume, Sqoop, Core Java, HTML, Oracle SQL/PLSQL, UNIX Shell script .
  • Proficiency in Big Data Apache Spark with Scala (Spark core - RDD, SPARK Data Frames and Spark Streaming APIs.
  • Good conceptual knowledge and hands on experience with streaming Apache KAFKA APIs.
  • Hands on experience in Web Application development using Java Springs Framework with AngularJs
  • Proficient in complex query design and tuning; database integration with middleware and web applications.
  • Good knowledge of Hadoop ecosystems and capable of processing large sets of structured, semi-structured data and supporting systems application architecture.
  • Expertise in business reporting using Tableau 9.x
  • Hands on experience in working with AWS, PostgreSQL DB.
  • Diverse experience in working with variety of Databases/DWH systems like Teradata, Oracle, PostgreSQL.
  • Experienced in using IDEs and Tools like Eclipse, GitHub, Jenkins
  • Design and implementation of Web application (s): Using Java Spring Framework, Apache Tomcat Server, AWS & Postgres DB.
  • Solid Analytical and Problem-Solving skills; Solid management skills, capable of leading & motivating individuals to maximize levels of productivity.
  • Adept in end-to-end development from requirement analysis to system study, designing, coding, testing, documentation and maintenance.
  • Productive self starter with a strong work ethic; consistently achieve goals.
  • Deft at mapping the requirements, custom designing solutions & troubleshooting for application problems.
  • Extensively worked in process improvement within and across the team

TECHNICAL SKILLS

Big Data Technologies: Hadoop, MapReduce, HDFS, Apache PIG, Hive, Impala, Flume, Sqoop, Spark,KAFKA.

BI Tools: Tableau 9.x

Cloud: AWS

Other Front-End Tools: Version One, JIRA

Programming & Query Languages: Core Java, Scala, JavaScript, UNIX Shell Scripting, SQL

Database: Oracle, Teradata, PostgreSQL

Database tools: PL/SQL Developer, Toad, SQL Developer, pgAdmin4

Tools: Eclipse, Jenkins

Version Control: GitHub

Methodologies: Agile, SDLC

PROFESSIONAL EXPERIENCE

Big Data Lead/Architect

Confidential, Plano TX

Responsibilities:

  • Implemented Data Quality Framework using Java Drools running on MapReduce and subsequently on Spark execution engine.
  • Implemented data streaming with Apache KAFKA and Java from On-Prem servers to Confidential EC2 and subsequently to S3.
  • Papalism achieved using java multithreading running multiple consumers on each thread.
  • Implemented web based Live Dashboards using Apache KAFKA and Web Socket Programming in Java.
  • Developed a Web Interface to run various Spark Jobs on Demand basis using the SparkLauncher APIs in Java
  • Developed Web interface QS Validation Services to execute multiple spark jobs from front end on-demand basis using Spark-Launcher APIs
  • Designed, developed Unix Shell script to automate the Spark job execution.
  • Designed/Implemented the architecture for Integration of Web Application using AngularJs, Java-Springs with PostgresSql DB.
  • Worked on building internal Portal to track cloud migration journey; Responsible for developing and designing Database for this web application.
  • Designed End to End Solution to migrate existing Confidential to Hadoop/streaming with
  • Confidential having a Speed and Batch layers resulting into Live dashboards and batch analysis reports in Hadoop.
  • Worked on creating/modifying Tableau Reports connecting to Impala tables.
  • Developed mission-critical support tool for internal Network Infrastructure support.
  • Designed and developed robust database code to enable middleware and Java application access for web-based customer portal and tools.
  • Responsible to deploy Application on AWS infrastructure.

Technical Lead

Confidential

Responsibilities:

  • Architecture and designs for independent modules.
  • Involved in Core Java based development modules for development, enhancement and bux fixing activities.
  • Worked extensively in Production Support activities in Level 3 support giving technical solutions for critical business problems across 
  • Mentored technically to a team of 5 offshore junior members
  • End-to-end responsibility for releases including coordination with various teams within organization.
  • Supported DWH reports built in Cognos Impromptu which used the data from ORACLE databases.
  • Standard reports have been published on web for every subsidiary.

Technical Associate

Confidential

Responsibilities:

  • Worked as a Technical Associate and was involved in various development activities for web based portal for Confidential Healthcare.
  • Involved in development activities for independent modules of the Web Application.
  • Developed modules in core java using Inheritance, Collections, multithreading etc.
  • Actively involved in regression testing and deployment phases.

We'd love your feedback!