Hadoop / Spark Developer Resume
4.00/5 (Submit Your Rating)
SUMMARY:
- Completed M.Sc. Information Technology from Confidential .
- Competent and result - oriented professional with around 12.5 years of experience across
- Finance/Operations/MIS division; currently working as a Associate (Project Manager) with Confidential .
- Around 2 years of experience in Confidential Technologies
- Creating and Managing Confidential (version 12.10) Reports & Dashboards.
- Strong exposure of handling global projects.
- Possess a very strong understanding of the specific business processes being addressed, along with the ability to bridge the gap between business & technical worlds.
TECHNOLOGY SKILLS
Data Analytics: Alteryx
Languages: SCALA, Core Java, J2EE, VBA, ABAP/4
Big Data Hadoop Technologies: HDFS, YARN, MapReduce, Hive, Pig, Impala, Sqoop, Flume, Spark, Kafka and Oozie
Database: SQL Server, My-SQL, Ms-Access, Oracle8i
Operating System: Windows, Linux.
Reporting Tool: Confidential 12.10, Tableau 8, Excel
PROFESSIONAL EXPERIENCE:
Confidential
Hadoop / SPARK developer
Responsibilities:
- Installation of various Hadoop Ecosystem Components and Hadoop Daemons on single node.
- Hands on experience of 2+ years in Big Data Analytics and development.
- Expertise with the tools in Hadoop Ecosystem including Pig, Hive, HDFS, MapReduce, Sqoop, Spark, Yarn, Oozie etc.
- Excellent knowledge on Hadoop ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm
- Experience in designing and developing applications in SPARK using SCALA to compare the performance of SPARK with Hive and SQL/Oracle.
- Involved in converting Hive/SQL queries into SPARK transformations using SPARK RDDs and SCALA.
- Developed multiple POCs using SCALA and deployed on the Yarn cluster, compared the performance of SPARK, with Hive and SQL/Teradata.
- Experience in manipulating/analyzing large datasets and finding patterns and insights within structured and unstructured data.
- Strong experience on Hadoop distributions like Cloudera and Hortonworks.
- Good understanding of NoSQL databases and hands on work experience in writing applications on NoSQL databases like Confidential, MongoDB.
- Experience in writing complex MapReduce programs that work with different file formats like Text, Sequence, Xml, parquet and Avro.
- Extensive Experience in migrating the data using Sqoop from HDFS to Relational Database System and vice-versa according to client's requirement.
- Strong Experience of Data Warehousing ETL concepts using SQL Server.
- Experience in database design using SQL Server to write Stored Procedures, Functions, Triggers and strong experience in writing complex queries.
- Experienced in working with Amazon Web Services (AWS) using EC2 for computing and S3 as storage mechanism.
- Excellent ability to interact with end users and craft clear technical requirements from business language.
- Involved in Requirement gathering & designing Confidential Applications.
- Creating and Managing Confidential Reports & Dashboards.
Confidential
Team Leader
Responsibilities:
- Involved in Requirement gathering & designing Confidential Applications.
- Creating and Managing Confidential Reports & Dashboards.
- Writing SQL Scripts to load the relevant data in Confidential Applications(QVD).
- Writing Confidential dashboard deployment plans ( Confidential ).
- Designing Data Modeling and Loading data from Multiple Data sources (Oracle, SQL Server, Sybase, Excel). Incremental reloading is implemented.
- Performance tuning by analyzing and comparing the turnaround times between SQL and Confidential .
- Publishing and Deploying the Dashboards based on business requirements.
- Developed Location Strategy, HeadCount, Travel expenses MIS reports in Confidential .
- Managing Efficiency (Manual Process Automation) Projects as a part of Global DPC team supporting Mumbai, Confidential, Delaware and Singapore locations.
- Cloudera Hadoop arranged by JP Morgan. Familiar with concepts like HDFS, Pig, Hive, MapReduce, Confidential, SPARK, Scala, Oozie, Sqoop etc.
- Strong exposure of cost save analysis projects like shared/personal drive rationalization project, analyze cost involved in unused applications within firm and raise the request to technology team to take necessary actions, Shared mailbox rationalization, VDI implementation across India Markets Business.
- Keeping track of automation projects (User Tools) in centralized pool (UWAT) as per firm’s guidelines.
- Implemented centralized SharePoint tracker for Headcount and Taxonomy details. Also developed online interactive user interface using SharePoint & MS Access connectivity.
- Developed a SharePoint site and user interactive forms to track Top initiatives/projects running across CIB.
- Successfully migrated many processes as a team work which not only helped management to achieve their
- FTE save target (20 FTE) but also we have taken care of client satisfaction, better controls for the developed tools, process improvement, knowledge transfer, tech support etc.
- Conduct the MS Access / MS Excel within the team.
- Developed new and improved reporting suite for IBOD out of DCPP using MS access VBA technology.
- Providing support to MIS team in turning around complex, time bound & critical ad hoc MIS reports.
- Migrated databases from MS-Access to SQL Server 2008.
- Migrated Derivatives Settlement process from Confidential Drive to Confidential .
- Familiar of the Investment Banking products and process - Collateral Cash Netting, Trade life cycle,
- Wash Account Management system, Portfolio Reconciliation, Derivatives & Settlement MIS, Fixed Income.
Confidential
Analyst
Responsibilities:
- Developed website using Net Beans JAVA, J2EE & MySql for Confidential, Confidential Mumbai & Singapore employees to track their blotter details.
- Utilized technical capabilities to create projects to minimize the workload using VBA and MS Access.
- Providing support to core investment-banking operations to automate their work (using Excel-Macro).
- Analyzed team requirements to create daily, weekly and monthly management reports.
- Generating reports for employee attendance from access card system.
- Worked on Travel Tracker, Business Continuity Plan, Inventory Management, Customer Satisfaction Survey (CSAT) report.
Software Engineer
Confidential
Responsibilities:
- Developed various applications in Visual Basic - 6.0 and Core JAVA to handle the RFID readers through PC.
- Tested various parameters of RFID readers like “Alarm ON/OFF, Checking validity of Employee Card, Employee
- Confidential, Configuring RFID reader IP Address, Counting of records stored in RFID reader, Setting RFID reader timing, Erase database from RFID reader etc.” through Applications.
- Onsite technical support to clients.
- Developed and tested Java applications with various database systems like Oracle 8/9i, My SQL, SQL Server, MS Access.
- Assemble RFID reader parts.
