Senior Data Analyst Resume
Detroit, MI
SUMMARY
- Having 8+ Years of IT Industry experience and Expertise in Data analysis and ETL Processing, worked in various industries as a Data Analyst Specialization in assessment and deep - dive analysis of the business and operational challenges by applying statistical, analytical techniques and visualization tool Expertise wif Power BI and Tableau
- Experience in working closely wif the Development Team, Business Analysts, Client and Project Managers during all phases of the Product Life Cycle.
- Very strong experience in Tableau dashboard design, development, testing and deployment.
- Experience in understanding business requirements and translating them into technical requirements.
- Rich Data processing experience in Extraction, Transformation and Loading.
- Generating the BI Visualization layer on top of the ETL layer and generating the reports wif Spot fire
- Developed Oozie workflows to automate ETL process by scheduling multiple Sqoop, Hive and Spark jobs
- Have been working wif various data sources such as Oracle, My SQL, ODBC and flat file sources.
- Expert in creating, maintaining and executing automated test scripts using Selenium IDE, web driver and Selenium grid.
- Experience in designing star schema, Snowflake schema for Data Warehouse, ODS architecture
- Experience wif Cloud Technologies like AWS (Amazon Web Services) and Microsoft Azure.
- Performed data validation, data integrity and database testing using SQL Queries wif multiple Databases Oracle, SQL Server, and MySQL.
- Strong Experience in Data gathering, Analysis, Processing and Data Validation.
- Expert in developing visualization dashboards using calculations, Filters, Charts, parameters, calculated fields, groups, sets and hierarchies.
- Strong experience inData Analysis, Data Migration, Data Cleansing, Transformation, Integration, Data Import, andData Exportthrough the use of multiple ETL tools such as Ab Initio and Informatica PowerCenter Experience in testing and writingSQL and PL/SQLstatements - Stored Procedures, Functions, Triggers and packages.
- Excellent in creating various artifacts for projects which includespecification documents, data mappingand data analysis documents.
- Well versed wif the concepts of Forward Engineering and Reverse Engineering for the existing databases for Physical models using Erwin tool.
- Defined best practices for Tableau data visualization drilldown/up design and development processes.
- Involved in Troubleshooting, Performance tuning of reports and resolving issues wifin Tableau Server and Reports.
- Working Knowledge on BIG DATA using HADOOP framework and related technologies such as HDFS, HBASE, MapReduce, Spark, HBase, Hive, Pig, Flume, Oozie, Sqoop, and Zookeeper.
- Involved in Tableau Server configuration, creating Users, Groups, Projects and assign Privileges etc.,
- Experience in Tableau Server administration tasks including Tableau server optimization and performance tuning.
- ExtensiveETL testing experience using Informatica(Power Center/ Power Mart) (Designer, Workflow Manager, Workflow Monitor and Server Manager)
TECHNICAL SKILLS
Operating Systems: Microsoft Windows 9x / NT / 2000/XP / Vista/7/8/10 and Unix.
Languages: SQL, PL/SQL, XML, Python, JAVA, UNIX shell scripting, PERL
Data Modeling Tools: Erwin, ER/Studio, Star-Schema Modeling, Snowflake Schema Modeling, FACT and dimension tables, Pivot Tables.
BI Tools: Tableau, Tableau server, Tableau Reader, SAP Business Objects, Crystal Reports
Applications: Toad for Oracle, Oracle SQL Developer, MS Word, MS Excel, MS Power Point, Teradata
Database: Oracle 12c, MS Access, SQL Server, Sybase and DB2, Teradata, Hive
Big Data: Hadoop, Spark, Hive, Cassandra, MongoDB, MapReduce, Sqoop.
Data Science tool: R, Python, MATLAB
Machine Learning: Linear regression, Logistic regression, Decision tree, Random Forest, K mean, Avro, MLbase
Methodologies: Agile, RAD, JAD, RUP, UML, System Development Life Cycle (SDLC), Ralph Kimball and Bill Inmon, Waterfall Model.
Operating System: Windows, Unix, Sun Solaris
PROFESSIONAL EXPERIENCE
Confidential, Detroit, MI
Senior Data Analyst
Responsibilities:
- Assisted in defining business requirements for the IT team and createdBRD and functional specificationsdocuments along wif mapping documents to assist the developers in their coding.
- Identify & record defects wif required information for issue to be reproduced by development team.
- Designed and developed database models for the operational data store, data warehouse, and federated databases to support client enterprise Information Management Strategy.
- Worked wif SQL*Loader to load data from flat files obtained from various facilities.
- Involved in documentation of Data Mapping & ETL specifications for development from source to target.
- Worked on claims data and extracted data from various sources such as flat files, Oracle and Mainframes.
- Worked wif data investigation, discovery and mapping tools to scan every single data record from many sources.
- Developing Tableau Reports to Build YTD and Month End Reporting
- Worked wif end users to gain an understanding of information andcore dataconcepts behind their business.
- Used Snowflake functions to perform semi structures data parsing entirely wif SQL statements.
- Metrics reporting, data mining and trends in halpdesk environment usingAccess
- Performing data management projects and fulfilling ad-hoc requests according to user specifications by utilizing data management software programs and tools like Perl, Toad, MSAccess,Exceland SQL
- WrittenSQLscripts to test themappingsand Developed Traceability Matrix of Business Requirements mapped to Test Scripts to ensure any Change Control in requirements leads to test case update. categorized data elements fordata profilingand mapping from source to target data environment.
- Developed working documents to support findings and assign specific tasks
- Performeddata analysisanddata profilingusing complexSQLon various sources systems including Oracle andTeradata.
- Generated graphs for business decision-making using python matplotlib library
- Performed bulk load of JSON data from s3 bucket to snowflake.
- Written several shell scripts usingUNIXKorn shell for file transfers, error logging, data archiving, checking the log files and cleanup process.
- Identify & record defects wif required information for issue to be reproduced by development team.
- Designed and developed database models for the operational data store, data warehouse, and federated databases to support client enterprise Information Management Strategy.
- Validated already developed python reports. Fixed the identified bugs and re-deployed the same.
- Actively halped in migrating on-prem services to AWS cloud
- Involved in extensive DATA validation by writing several complexSQLqueries and Involved in back-end testing and worked wif data quality issues.
- Experience in working wif AWS services including EC2, Auto-Scaling in launching EC2 instances, Elastic Load Balancer, Elastic Beanstalk, S3, Cloud Front, RDS, DynamoDB, VPC, Route53, Cloud Watch, Cloud Formation, IAM and SNS.
- Developed Informatica Mappings and Reusable Transformations to facilitate timely Loading of Data of a star schema.
- Communicating wif Data entry resources and participate in Data Governance to ensure any Data errors are fixed at the source
Environment: Tableau, Data Governance, Snowflake, AWS, EC2, S3, Lambda, Auto Scaling, Cloud Watch, IAM, Python, MS SQL Server, MS office, Legacy - Mainframes, Titanium, Rational Clear Quest, Clear Case.
Confidential, NY
Data Analyst
Responsibilities:
- Analysisof functional andnon-functionalcategorized data elements for data profiling andmapping from source to target data environment. Developed working documents to support findings and assign specific tasks
- Involved wifdataprofilingfor multiple sources and answeredcomplex business questions by providing data to business users.
- Involved in all the steps and scope of the project reference data approach to MDM, have created a Data Dictionary and Mapping from Sources to the Target in MDM Data Model.
- Writing UNIX shell scripts to automate the jobs and scheduling cron jobs for job automation using commands wif Crontab.
- Utilized Power BI to create various analytical dashboards that halps business users to get quick insight of the data
- Write research reports describing the experiment conducted, results, and findings and make strategic recommendations to technology, product, and senior management. Worked closely wif regulatory
- Prepared an ETL technical document maintaining the naming standards.
- Used SQL Server Integrations Services (SSIS) for extraction, transformation, and loading data into target system from multiple sources
- Involved inUnit Testingthe code and provided the feedback to the developers. PerformedUnit Testingof the application by usingNUnit.
- Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate wif other Azure Services. Knowledge of USQL
- Automated the processes from existing Manual processes.
- Worked wif Reporting Team UsingTableau.
- Worked wif datainvestigation, discoveryand mapping tools to scan every single data record from many sources
- Creating Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
- Performed all necessary day-to-day GIT support for different projects, Responsible for design and maintenance of the GIT Repositories, and the access control strategies.
- Involved in extensiveDATAvalidation by writing several complex SQL queriesand Involved in back-end testing and worked wif data quality issues.
- Developedregression test scripts for the applicationand Involved in metrics gathering, analysis and reporting to concerned team and Tested the testing programs
- Identify & record defects wif required information for issue to be reproduced by development team
- Wrote production level Machine Learning classification models and ensemble classification models from scratch using Python and PySpark to predict binary values for certain attributes in certain time frame.
- Made Power BI reports more interact and activate by using storytelling features such as bookmarks, selection panes, drill through filters also created custom visualizations using “R-Programming Language”.
- Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the SQL Activity. Build an ETL which utilizes spark jar inside which executes the business analytical model.
- Work on data that was a combination of unstructured and structured data from multiple sources and automate the cleaning usingPython scripts.
- Preparing dashboards using calculated fields, parameters, calculations, groups, sets and hierarchies in Tableau.
- Prepared technical specification to load data into various tables in Data Marts.
- Created deployment groups in one environment for theWorkflows, Worklets, Sessions, Mappings, Source Definitions, Targetdefinitions and imported them to other environments.
- Published and maintained workspaces in Power BI Service, allotted the time refresh for the data, maintained the apps and workbooks.
- Created and maintained SQL Server scheduled jobs, executing stored procedures for the purpose of extracting data from Oracle into SQL Server. Extensively used Tableau for customer marketing data visualization.
Environment: Power BI, NoSQL, Data Lake, Zookeeper Python, Tableau, Azure, ADF, Unix/Linux Shell Scripting, PyCharm, Informatica PowerCenter, Linux Shell Scripting
Confidential, Suffern, NY
Data Analyst
Responsibilities:
- Involved in Data analysis and quality check.
- Data sources are extracted, transformed and loaded to generate CSV data files wif Python programming and SQL queries.
- Stored and retrieved data from data-warehouses using Amazon Redshift.
- Created the source to target mapping spreadsheet detailing the source, target data structure and transformation rule around it.
- Wrote Python scripts to parse files and load the data in database, used Python to extract weekly information from the files, Developed Python scripts to clean the raw data.
- Worked extensively wif Tableau Business Intelligence tool to develop various dashboards.
- Worked on datasets of various file types including HTML, Excel, PDF, Word and its conversions.
- Mine and analyze data from company databases to drive optimization and improvement of product development, marketing techniques and business strategies
- Effectively led multiple client projects. These projects contained a heavy Python, SQL, Tableau and data modelling.
- Deployed and implemented information management systems which collected data from over 4,700 participants.
- Performed data merging, cleaning, and quality control procedures by programming data object rules into a database management system.
- Development of BI data lake POCs using AWS Services including Athena, S3, Ec2, Glue and Quick Sight.
- Reported daily on returned survey data and thoroughly communicated survey progress statistics, data issues, and their resolution.
- Develop a master data flowchart which was used to measure the completion of study objectives.
- Served as primary contact for the acceptance or rejection of surveys where unique or rare issues were involved.
- Performed Database and ETL development per new requirements as well as actively involved in improving overall system performance by optimizing slow running/resource intensive queries.
- Developed data mapping documentation to establish relationships between source and target tables including transformation processes using SQL.
- Participated in data modeling discussion and provided inputs on both logical and physical data modelling.
- Reviewed the Performance Test results to ensure all the test results meet requirement needs.
- Opened Risks or Issues that the current project is facing and worked towards resolving them.
- Created master Data workbook which represents the ETL requirements such as mapping rules, physical Data element structure and their description.
Environment: Teradata, UNIX Shell Scripts, Quick Sight, MS Excel, MS Power Point, Python, SQL, AWS
Confidential
Data Analyst
Responsibilities:
- Identified and addressed the key issues that organization was facing from the customer side in terms of lack of feedback, sudden inactivity and friction while accessing the services.
- Balanced the dataset through under and over sampling techniques, by using theRplatform.
- Partitioned the data set into and testing sets and executed on each model.
- Used Python Matplotlib packages to visualize and graphically analyses the data.
- Performed the extraction fromOLAP Cubeinto thePythonenvironment. By using thePycharmplatform, and using theODBCdrivers, created the connections betweenOLAPandPYcharm.
- Performed the data profiling usingk-means clusteringto make the clusters of the population and checked the anomalies in it and did the cleansing of the data by usingSPSS.
- Performed the Comparative analysis of churning and non-churning profiles to generalize the model.
- Performed thepredictive analysisof the extracted data by usingmachine learning algorithmslikeRegression analysis, Support vector machines, decision treeandneural networksto predict the churn.
- Work wif team of developers on python applications for RISK management.
- Visualizing the results of the analysis over theTableauby making theHistograms, pie charts, box plots and bubble chartsand other charts. Created theDashboardand deployed it on the servers.
- Measured the performance of the models through aconfusion matrix, classification accuracy, sensitivity, specificity, precision, AUC, ROC, AUKand used it for the best model selection.
- Wrote Python modules to extract/load asset data from the MySQL source database.
- Making theData framesof the extracted data through thePandaslibrary.
- Visualized analysis ontableauand createdDashboardhaving key indicators of customer retention analysis
Environment: OLAP, Python, Pycharm, Pandas, SPSS, Oracle, My SQL, MS Office, Windows
Confidential
Data Analyst
Responsibilities:
- Involved in analysis, design and documenting business requirements and data specifications. Supported data warehousing extraction programs, end-user reports and queries
- Worked on numerous ad-hoc data pulls for business analysis and monitoring by writing SQL scripts.
- Created monthly and quarterly business monitoring reports by writing Teradata SQL queries includes System Calendars, Inner Joins and Outer Joins to retrieve data from multiple tables.
- Performed verification and validation for accuracy of data in the monthly/quarterly reports.
- Created reports, charts by querying data using Hive Query Language and reported the gaps in lake data loaded.
- Created multi-set tables and volatile tables using existing tables and collected statistics on table to improve the performance.
- Developed Teradata SQL scripts using RANK functions to improve the query performance while pulling the data from large tables.
Environment: SQL, Teradata, MS Office, HQL, Unix
