Sr. Big Data Architect / Developer Resume
2.00/5 (Submit Your Rating)
NY
SUMMARY:
- 11 Years of delivering IT solutions, implementations and technology deployments with global organizations in various architect, analyst & developer roles, ability to undertake and implement large scale implementations independently with fortune 500 companies and big 4 consulting firms. With over 4 years of Big Data, Hadoop, Spark and 7 years of JAVA experience, responsible in brining value to the customer with analytics, timely recommendations and with acquisition of extensive business domain knowledge.
- Expertise in Hadoop ecosystem, Spark, Scala, Spark - Streaming, Map Reduce, Yarn, Machine Learning, Unix Shell Commands and expertise with Data Warehousing infrastructure like Hive, HDFS, Cassandra, NoSQL & MySQL
PROFESSIONAL EXPERIENCE:
Sr. Big Data Architect / Developer
Confidential, NY
- Implemented Big Data stack and tools to capture, transform, parse, analyze and store terabytes of structured and unstructured data.
- Extensive experience with Spark, Scala, Spark-streaming, Spark-SQL for data transformation and analytics with supply chain, financial, ecommerce and sales data
- Hive partitioning and bucketing of large tables. Hive queries that helped market analysts spot emerging trends by comparing fresh data with reference tables and historical metrics to get customer insights and retail experiences. Use of Map side joins for optimizations, Java UDF Functions & creation of external tables
- Extensive experience with Map Reduce Java programs for skewed datasets, Joins, custom partitioners, combiners and Job configurations for order management and warehouse data like cleaning of sell in / sell through data, parsing of raw order management data & creation of Order Management historical data.
- Rich experience with business critical analytics projects such as inventory data, financial data, warehouse data, ecommerce data, creation of data lakes, sales data analytics, analytics of sales impact by IT rollouts, base price modeling, using various big data tools
- Market sentiment analysis in accordance with quarterly financial data using machine learning, Flume and web API’s. Applied machine learning algorithms like KNN in order to identify the most significant features across different datasets.
- Kafka and Flume data ingestion along with interceptors for triggering events and jobs to filter data before moving to Hadoop, Hive or HBase. Facilitated insightful and frequent analysis of data collected by external sources like spooling data, streaming data, web API’s by flume agents and data loading sequences on to hive.
- Set up of Oozie workflows with DAG of tasks and managed collection of coordinators for data pipelines. Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System to pre-process the data.
- Implemented job scheduling in Yarn. Installed and configured HDFS, Map Reduce, Hive, Spark, Scala environments and shared responsibility for administration of Hadoop, Hive and implemented Hadoop cluster with Yarn. Assisted with performance, capacity planning, tuning and monitoring. Managed and reviewed Hadoop log files and executed performance scripts.
- Sqoop to import historical order management sales data into HDFS and Hive
- Created and Managed Hive and HDFS data in Parquet storage format to load large sets of structured, semi-structured and unstructured data coming from a variety of portfolios.
- Presenting Proof of Concepts to Stakeholders, illustrating how these data integration techniques can meet specific business intelligence requirements
- Prior to Big Data, lead team through development and delivery of JAVA implementations & roadmaps that facilitated understanding of future business impacts and full project lifecycle development of JAVA solutions including multi-threading in JAVA, JAVA Frameworks like swing, MVC and newer framework like JAVA FX.
Java Architect
Confidential, St Louis
- Architected, prototyped and implemented employee self-service and manager self-service applications for 5000 users, JAVA such as benefits enrollment (ESS), bank/w4/address change applications (ESS), compensation planning and approval (MSS), talent management and expense request submission/approval (MSS) via adobe forms. Used JAVA Swing and MVC.
- Successful Demonstrations of portal prototypes, models and Demos with its advantages to the client.
- JAVA Development: Created Compensation Communication Process, Expense Request Approval (with workflow), Compensation Statement
- Generation of Merit Letters and Annual Incentive Letter for employees via ADLC
- Created an Exhaustive Bonus Program to calculate Bonus for employees using JAVA
Java Developer
Confidential, Wisconsin
- Architected and developed BI Portal applications such as BI Dashboards with report accuracy indicators using JAVA Script, HTML
Java Developer
Confidential, Chicago
- Implementation of Benefits Enrollment for Confidential Employees, covering all aspects of project including architecture, Development and Implementation using JAVA Script
Masters Student & Teaching Assistant
Confidential, SD
- Teaching assistant for Network security and telecommunications while pursuing Master of Science in information systems. Website architecture and development as MS Project with focus on UX and DB
JAVA / J2EE Developer
Confidential
- Web development using JAVA/ J2EE and development of JAVA based network security based monitoring applications for identifying and tracking unknown data packets in a network for a Japan based client
