Big Data Lead/architect Resume
3.00/5 (Submit Your Rating)
Plano, TX
SUMMARY
- Big Data Architect/Lead with Overall 12 + years of IT experience in Solution & Technical Architecture, Project
- Management, Designing, Developing and implementing solutions across Infrastructure, Auto and CRM Domains.
- Expertise in Big Data Hadoop Map Reduce framework using Hadoop with YARN, Hive, Pig, Flume, Sqoop, Core Java, HTML, Oracle SQL/PLSQL, UNIX Shell script .
- Proficiency in Big Data Apache Spark with Scala (Spark core - RDD, SPARK Data Frames and Spark Streaming APIs.
- Good conceptual knowledge and hands on experience with streaming Apache KAFKA APIs.
- Hands on experience in Web Application development using Java Springs Framework with AngularJs
- Proficient in complex query design and tuning; database integration with middleware and web applications.
- Good knowledge of Hadoop ecosystems and capable of processing large sets of structured, semi-structured data and supporting systems application architecture.
- Expertise in business reporting using Tableau 9.x
- Hands on experience in working with AWS, PostgreSQL DB.
- Diverse experience in working with variety of Databases/DWH systems like Teradata, Oracle, PostgreSQL.
- Experienced in using IDEs and Tools like Eclipse, GitHub, Jenkins
- Design and implementation of Web application (s): Using Java Spring Framework, Apache Tomcat Server, AWS & Postgres DB.
- Solid Analytical and Problem-Solving skills; Solid management skills, capable of leading & motivating individuals to maximize levels of productivity.
- Adept in end-to-end development from requirement analysis to system study, designing, coding, testing, documentation and maintenance.
- Productive self starter with a strong work ethic; consistently achieve goals.
- Deft at mapping the requirements, custom designing solutions & troubleshooting for application problems.
- Extensively worked in process improvement within and across the team
TECHNICAL SKILLS
Big Data Technologies: Hadoop, MapReduce, HDFS, Apache PIG, Hive, Impala, Flume, Sqoop, Spark,KAFKA.
BI Tools: Tableau 9.x
Cloud: AWS
Other Front-End Tools: Version One, JIRA
Programming & Query Languages: Core Java, Scala, JavaScript, UNIX Shell Scripting, SQL
Database: Oracle, Teradata, PostgreSQL
Database tools: PL/SQL Developer, Toad, SQL Developer, pgAdmin4
Tools: Eclipse, Jenkins
Version Control: GitHub
Methodologies: Agile, SDLC
PROFESSIONAL EXPERIENCE
Big Data Lead/Architect
Confidential, Plano TX
Responsibilities:
- Implemented Data Quality Framework using Java Drools running on MapReduce and subsequently on Spark execution engine.
- Implemented data streaming with Apache KAFKA and Java from On-Prem servers to Confidential EC2 and subsequently to S3.
- Papalism achieved using java multithreading running multiple consumers on each thread.
- Implemented web based Live Dashboards using Apache KAFKA and Web Socket Programming in Java.
- Developed a Web Interface to run various Spark Jobs on Demand basis using the SparkLauncher APIs in Java
- Developed Web interface QS Validation Services to execute multiple spark jobs from front end on-demand basis using Spark-Launcher APIs
- Designed, developed Unix Shell script to automate the Spark job execution.
- Designed/Implemented the architecture for Integration of Web Application using AngularJs, Java-Springs with PostgresSql DB.
- Worked on building internal Portal to track cloud migration journey; Responsible for developing and designing Database for this web application.
- Designed End to End Solution to migrate existing Confidential to Hadoop/streaming with
- Confidential having a Speed and Batch layers resulting into Live dashboards and batch analysis reports in Hadoop.
- Worked on creating/modifying Tableau Reports connecting to Impala tables.
- Developed mission-critical support tool for internal Network Infrastructure support.
- Designed and developed robust database code to enable middleware and Java application access for web-based customer portal and tools.
- Responsible to deploy Application on AWS infrastructure.
Technical Lead
Confidential
Responsibilities:
- Architecture and designs for independent modules.
- Involved in Core Java based development modules for development, enhancement and bux fixing activities.
- Worked extensively in Production Support activities in Level 3 support giving technical solutions for critical business problems across
- Mentored technically to a team of 5 offshore junior members
- End-to-end responsibility for releases including coordination with various teams within organization.
- Supported DWH reports built in Cognos Impromptu which used the data from ORACLE databases.
- Standard reports have been published on web for every subsidiary.
Technical Associate
Confidential
Responsibilities:
- Worked as a Technical Associate and was involved in various development activities for web based portal for Confidential Healthcare.
- Involved in development activities for independent modules of the Web Application.
- Developed modules in core java using Inheritance, Collections, multithreading etc.
- Actively involved in regression testing and deployment phases.
