SUMMARY

• Over 7 years of IT experience working as a Data Analyst/Engineer. Experience in interpreting and analyzing data.
• Experience in ETL’S using Spark - in memory processing, Spark streaming using Kafka distributed messaging system, and Spark SQL.
• Good understanding of various Hadoop distribution platforms like Cloudera, Hortonworks, and cloud platforms like Amazon AWS.
• Proficient in Job Orchestration tools like Airflow, Oozie, & Zookeeper.
• Knowledge of structured data sets, ETL tools, data pipelines/reduction, transformation, and aggregation technique.
• Very capable at using Amazon Web Services utilities such as EMR, S3 and CloudWatch to run and monitor Hadoop/Spark jobs on AWS.
• Written PySpark jobs in AWS Glue to merge data from multiple tables and in Utilizing Crawler to populate AWS Glue data Catalog with metadata table definitions.
• Generated a script in AWS Glue to transfer the data and utilized AWS Glue to run ETL jobs and run aggregation on PySpark code.
• Excellent understanding ofUNIX shell scripting, job scheduling on multiple platforms, experience with UNIX/ LINUX command line.
• Experience in preparingETLdesign documentations. Experience of working on onsite - offshore modules.
• Experience in Text Analytics, generating data visualizations using R, Python and creating dashboards using tools like Tableau.
• Developed reports and ad-hoc reports using SSRS and Excel.
• Experience in Data Modeling & Data Analysis, Data Mapping, Logical Modeling, As-Is, and To-Be Mapping, Feasibility- studies, vision-scope documents.
• Experience in aggregating data and configuring reports from different data sources using data blending.
• Proficient in creating various data visualization techniques such as: Bars, Lines, Pies, Maps, Scatter plots, Gantts, Bubbles, Histograms, Heat maps, and Highlight tables.
• Experience in designing and deploying rich Graphic visualizations with Drill Down and Drop-down menu options and Parameterized using Tableau.
• Created and customized Dashboards using Tableau.
• Advanced knowledge of Tableau BI application creation and server-side functionalities.
• Analyzed and Generated reports and dashboards for various management and business unit personnel to provide detail information on key performance indicators.
• Knowledge of various python libraries such as NumPy, SciPy for mathematical calculations, Pandas for data processing/wrangling.
• Proven ability to understand business problems and able to apply technologies to formulate workable solutions with an excellent interpersonal and communication skills.
• Good knowledge on Standard object, Sales process, Validations, Workflows, Process Builders, Reports and Dashboard.
• A quick learner who can absorb new ideas and can communicate clearly and effectively.

TECHNICAL SKILLS

Programming: R, Python, Java, HTML/CSS/JavaScript, C, C++, PySpark, Scala, Shell script, SQL

Databases: MySQL, SQL Server, Oracle, DynamoDB

Big Data Technologies: Spark, Hadoop, MapReduce, Hive, HDFS, Sqoop, HBase, Kafka, PIG

Servers: Application Servers (WAS, Tomcat), Web Servers (IIS, HIS, Apache).

Tools: & Platforms: Tableau, Power BI, Amazon Web Services (AWS), Google Cloud Platform (GCP), Azure OLTP, OLAP, SSRS, Microsoft office, Databricks

Operating Systems: Windows 7/8/2000/ME/NT/XP/VISTA, Unix, Linux, MacOS

Methodologies: OOAD, UML, RUP (Rational Unified Process), RAD (Rapid application Development), Agile Scrum, Waterfall, Business and Data Modeling

PROFESSIONAL EXPERIENCE

Confidential, Dallas, TX

Data Engineer

Responsibilities:

• Designed and setup Enterprise Data Lake to provide support for various use cases including analytics, processing, storing, and reporting of voluminous, rapidly changing data.
• Responsible for ensuring the quality of reference data in source by performing operations such as cleaning, transformation, and ensuring integrity in relational environment in collaboration with stakeholders and solution architects.
• Designed and built a security framework to allow fine grained access to objects in AWS S3 using AWS Lambda and DynamoDB.
• Knowledge in Creating, Debugging, Scheduling and Monitoring jobs for ETL batch processing to load into Snowflake for analytical processes using Airflow.
• Worked in building ETL pipeline for data ingestion, data transformation, data validation on cloud services AWS, working along with data steward under data compliance.
• Set up and worked on Kerberos authentication principals to establish secure network communication on cluster and testing of HDFS, Hive, Pig and MapReduce to access cluster for new users.
• Developed ETL’s using PySpark. Used both Dataframe API and Spark SQL API.
• Performed end to end architecture and implementation assessment of various AWS services like Amazon EMR, Redshift, S3.
• Implemented the machine learning algorithms in python to predict the quantity a user might want to order, so that we can suggest it automatically using kinesis firehose and S3 data lake.
• Used AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as Amazon Simple Storage Services (Amazon S3) and Amazon DynamoDB.
• Import the data from different sources like HDFS/HBase into Spark RDD and perform computations using PySpark to generate the output response.
• Creating Lambda functions with Boto3 to deregister unused AMIs in all application regions to reduce the cost for EC2 resources.
• Importing and exporting database using SQL Servers Integration Services (SSIS) and Data Transformation Services (DTS Packages).
• Used Scala to store streaming data to HDFS and to implement Spark for faster processing of data.
• Conducted Data blending, Data preparation using Alteryx and SQL for Tableau consumption and publishing data sources to Tableau server.
• Integrated Apache Airflow with AWS to monitor multi-stage ML workflows with the tasks running on Amazon SageMaker.

Confidential, Dallas, TX

Data Analyst

Responsibilities:

• Have extensively worked in the AGILE environment by participating in daily stand-up meetings, and Sprint planning at the end of every Sprint.
• Collected data, text standardization, and performing text mining using different python libraries to create clusters and classify to compare the results and improve the search of the platform.
• Analyzed industry trends and produce research on individual companies in the online spice vertical.
• Worked on data cleaning and ensured data quality, consistency, integrity using Pandas, NumPy.
• Worked on miss value imputation, outliers’ identification with statistical methodologies using Pandas, and NumPy.
• Performed multivariate analysis, predictive modelling, cluster, market basket analysis using statistical techniques in Python.
• Developed and managed reports, dashboards using Excel (pivot table, pivot charts, vlookup) and Tableau for yearly, quarterly, and monthly sales, inventory management, seasonal trends, and search keywords.
• Implemented ETL process in centralized Database Data Lake and Data warehouses.
• Used show me functionality, to create Tableau scorecards, Dashboards, bar graphs, stack bars, scattered plots, Gantt charts.
• Performed statistical analysis using SQL, Python Programming and Excel.
• Developed Data Mapping, Data Governance, Transformation, and cleansing rules for the Master Data Management Architecture involving OLTP and OLAP.
• Generated multiple ad-hocPythontools and scripts to facilitate map generation anddatamanipulation.
• Participated in requirement gathering, database design, and implementation of star-schema, snowflake schema, and dimensional data warehouse using Erwin.
• Design visualizations and reports for specific themes.
• Studied the existing OLTP systems, analyzed and created Facts, dimension tables Modelled the Data Warehousing, data marts in Star join schema and Snowflakes Schema.
• Created new database objects like Procedures, Functions, Packages, Triggers, Indexes, and Views using SQL in SQL Server.
• Involved in formal requirements gathering methodologies, and developed reports based on specifications.
• Ensured all technical artifacts complied with corporate SDLC Policies and guidelines.
• Built financial models to accurately develop volume and net sales forecasts, measure performance against targets, identifying risks and opportunities to publish forecasts.
• Managed and processed accounts receivable, accounts payable entry and payments, balance sheet reconciliations and all financial transactions in QuickBooks Enterprise
• Collected large financial data sets in Microsoft Excel and Access and created reporting for senior management.
• Worked on internal projects to improve the standards of routine data processing.
• Responsible for defining the key identifiers for each mapping anddatamodeling process.
• Responsible for conversion ofdatainDataMapping and writing transformation rules.
• Analyzed current state SQL queries that generates current reports, documented those logic in pseudo codes to make better understanding to technical folks for their technical requirement documentation
• Performed gap analysis, impact analysis,dataprofiling,dataanalysis, identifyingdatasources, identifying, and resolvingdataquality issues.
• Involved in relational and dimensionalDataModelingfor creating Logical and Physical design of the database and ER diagrams usingdatamodelinglike Erwin.
• Extracted, interpreted, and analyzeddatato identify key metrics and transform rawdatainto meaningful, actionable information.
• Created various types of charts such as Heat Maps, Geocoding, Symbol Maps, Pie Charts, Bar Charts, Tree Maps, Gantts, Circle Views, Line Charts, Area Charts, Scatter Plots, Bullet Graphs and Histograms in Table Desktop, Power BI, and Excel to provide better data visualization.
• UsedSQLto execute queries against the Oracle databases towards data analysis and data extraction into, among others, MS Access, MS Excel, and Text files. WroteSQLstatements to extractdatafrom the tables to validatedataflow.
• Analyzed User Stories, concepts, translatingdatarequirements into Conceptual, Logical and PhysicalData Model, updating existingDataFlow, ER diagrams. Designed the Fact and Dimension table forDataMarts using ER/Studio.
• Created System Development Methodology documents and ensureddatawarehousestandards were followed.
• UsedTableauto analyze and converted raw data into data visualizations. DevelopedTableauvisualizations and dashboards usingTableauDesktop.
• Conducted theproject meetingssuccessfully by coordinating all users, technical staff, and support personnel.

Confidential, Framingham, MA

Business Data Analyst Intern

Responsibilities:

• Created an enterprise workflow application for customer data based on CRUD rules that would allow for future integration of data infrastructure across multiple business areas into single UI.
• The prepared logical data model in the form of a Business Context diagram to include various entities and attributes to facilitate the design of the Data model in the form of ER Diagrams. Studied current information structures and data models of the current databases to better understand the design of target data sources.
• Used Rational Rose to model the process using UML to create behavioral and structural diagrams.
• Designed workflows and allocated permissions within MS share point.
• Modeled Business requirements into workflows to depict various scenarios of the system.
• Designed and developed Use Cases, Activity Diagrams, Sequence Diagrams using UML and Business Process Modeling.
• Designed Tableau and Powe BI dashboard which gives a visual representation for the users on MTD sales growth, Visual analytics on injuries, dealer location map, etc.,
• Provided continued maintenance and development of bug fixes for the existing and new Power BI Reports.
• Provided analysis on financial data using Power BI charts.
• Intricately involved in Business Process Flow development, Business Process Modeling, and ad hoc Analysis
• Performed detailed comparative analysis of response to RFPs of vendors and Graphically Represented the recommended solutions in PowerPoint to Senior Management
• Conducted Requirements walk-through with the Business Team to ensure that all their needs are met and gathered sign-off on the requirements for SOX compliance after the requirements were baselined.
• Prepared and maintain Business Rules Spreadsheets (BRS) identifying Rules, Triggers, and corresponding data fields from Legacy to target CRM application.
• Collaborate withdatamodelers,ETLdevelopers in the creating theDataFunctional Design documents.
• Tested the ETL process for both before data validation and after data validation process.
• Followed a methodical Change Management Process and documented any Change Requests into Clear Case for any changes in the requirements after the requirements were baselined.
• Prepared training materials in the form of User manuals by preparing a step-by-step guide to all screen flows in CMS.

Confidential

Data Analyst

Responsibilities:

• Worked as a team member providing advanced business solutions to the company.
• Gathered business requirements and designed technical requirements documentation.
• Designed, developed, and implemented new functionality to analyze large amounts of data and wrote SQL scripts to manipulate data.
• Performed data queries to develop reports on a daily, weekly, monthly, and quarterly basis to support management decisions.
• Performed data acquisition, mapping, integration, and transformation.
• Worked on the ETL Informatica mappings and other ETL processes.
• Identified, analyzed, and interpreted trends using data analysis techniques.
• Developed visualized data outputs using R, Tableau, and Excel. Interpreted data and analyzed results using statistical techniques.
• Was responsible for event discovery, event management, incident resolution and automating routine tasks.
• Ad-hoc Reporting based on user requirements and creating data model for tableau.
• Delivered Enterprise Data Governance, Data Quality, Metadata, and ETL informatica solution.
• Conducted JAD sessions to allow different stakeholders to communicate their perspectives, resolve issues, and reach agreements.
• Performed extensive Gap analysis to determine the risks and assist the PM in budget and resource planning.
• Created Work Breakdown Structure (WBS), Business Process Workflows, GUIs, Use Cases, and UML diagrams, and created Swim Lane process flow diagram for various cargo business processes.
• Conducted walkthroughs with the different department heads to have a deeper understanding of the requirements.
• Delivered Enterprise Data Governance, Data Quality, Metadata, and ETL solution.
• Analyzed and documented the business requirements and generated reports for key stakeholders.
• Developed flow diagrams for the Business process of the company, UI Wireframes, and Mockups using MS Visio.
• Created and maintained data mapping documents.
• Follow up with the end-users and developers for user satisfaction and change management if necessary.
• Worked extensively with the QA team for designing Test Plan and Test Cases for the Involved in weekly meetings with the development team to resolve a technical issue.
• Participated in creating user manuals.
• Documented the data mappings used in ETL processes.
• Develop standard operating procedures, business workflow processes, and training manuals.
• Assisted in the production of Change Management deliverables (testing documentation, training documents, and business process flow).
• Helped in writing training manuals, scheduled, and trained junior BA’s using PowerPoint, got it reviewed and approved by the project team and clients.
• Assisted offshore team in understanding requirements through daily scrum calls as per customers’ needs.
• GAP analysis by identifying existing technologies, documenting the enhancements.
• Used MS Visio to develop Use Cases to meet the end state requirements.
• Performed extensive data analysis using SQL in both Oracle and SQL Server databases.