Data Engineer/sql Developer Resume
Dallas, TX
SUMMARY
- 7 years of experience in SQL Development /Administration and 4+ years of exp as a Data Engineer/Analyst.
- Data Science Technology enthusiast with a knack for solving complex business problem utilizing machine learning, Spark, Hive, and Hadoop.
- Very strong with applying statistical models using various libraries such as pandas, numpy, scikit - learn, keras, tensorflow, pytorch, and matplotlib.
- Comfortable with administering Linux/OS command line tools, and using version control GIT platform.
- Expert on scripting and visualization tools such as SQL, Python, R, and Tableau
- Strong understanding of SDLC, Scrum/Agile app development, and XTreme Programming paradigms
- Experience in all phases of software development life cycle including knowledge of manual and automated testings.
- Strong Experience in developing SSIS packages for ETL & data warehousing projects.
- Experience in Business Analysis product development of the OLTP and OLAP data systems. Creating cube and dimension using SSAS.
- Experience in designing Reports (ad-hoc reports, report models, drill-down, drill-through, parameterized) using SSRS.
- Strong knowledge of cloud computing including Microsoft Azure, and AWS
- Experience working with Production and Development Environments.
- Experienced in writing T-SQL stored procedures, triggers, constraints, and indexes using various DDL and DML commands.
- Developed T-SQL scripts for automating repeat tasks, performed and reviewed stored procedures, user defined functions and sql queries
- Using N-tier architecture for presentation layer, the business and the data access layers; versed in Agile methodology for application development using C#, and python programming languages.
- Generated ad-hoc reports in Excel Power Pivot and shared them using Power BI to the decision makers for strategic planning.
- Proficient in creating, configuring, performance tuning the workflows designed in MS SQL Server Integration Services (SSIS)
- Designed and scheduled complex SSIS Packages for transferring data from multiple data sources and integrated data based on business logic
- Designed ETL using SSIS packages to reprocess any data using Reprocess Logic
- Developed sample reporting web applications using C# scripts and MVC frameworks using MS Visual Studio
- Developed Power BI tools to create variety of analytical dashboards depicting critical KPIs for healthcare, and legal use cases, provided enhanced visualizations using slicers and dicers enabling end-users to make filters
- Experience in designing and developing SSRS reports using data from ETL loads, SSAS Cubes and various heterogeneous data sources.
- Used SQL Profiler to monitor the server by running traces on various events.
- Migrated from Access, Text Files, Excel file, Oracle 8, SQL Server 2000 to SQL Server 2005.
- Worked with up to 72 databases of size ranging from 1 GB to 500 GB.
- Experience in Performance Tuning, Query Optimization, Client/Server Connectivity, and Database Consistency Checks using DBCC Utilities.
- Excellent analytical, communication, and interpersonal skills
- Proficient in technical writing and presentations and a exceptional team player
- Strong investigative and troubleshooting skills with a knack for finding root cause of problems
TECHNICAL SKILLS
Databases: MS SQL Server 2016/2014, Oracle 11g, MS Access, MySQL, Cassandra, MongoDB, AWS DynamoDB
ETL Tools: SQL Server Integration Services(SSIS), Data Transformation Services(DTS), Import/Export Wizard, Bulk Insert, SSBI Development Studio
Database Tools: SQL Server Management Studio, MySQL Workbench, Visual Studio, MS Excel, SQL Profiler, SQL Query Analyzer, Performance Monitor
Reporting Tools: SQL Server Reporting Services(SSRS), Report Builder, PivotTable, PivotChart, Excel, PowerView, PowerPivot
Visualization Tools: Tableau, Microsoft Visio
Operating systems: Microsoft Windows XP/2007/2010, Windows 2000 Advanced Server, Windows 2003Server, RedHat Enterprise Linux, Ubuntu, GNU Linux, Mac OS X
Virtualization: VMware, Virtualbox, Parallels Desktop, Microsoft Virtual Server
Programming/Scripting: Python, R, C, C#, Java, Javascript, Scikit-learn, Tensorflow, Keras, H2O, Perl, Unix/Linux, Visual Basic, ASP.NET, T-SQL, PostGreSQL, PL/SQL, HTML/CSS
Big Data Analytics: HDFS, MapReduce, Apache Spark, Kafka, Flume, Pig, Oozie, Solr, Sqoop, Impala, Tez, Hive
Statistics: Regression, Multilevel Modeling, Structural Equation Modeling, Bayesian Statistics, Stata, SPSS, SAS
Cloud Computing: Amazon Web Services S3, EMR, EC2, SageMaker, Lambda, Kinesis, DynamoDB, Microsoft Azure
PROFESSIONAL EXPERIENCE
Confidential, Dallas, TX
Data Engineer/SQL Developer
Responsibilities:
- Designed, developed, and maintained multiple databases in different data servers and generated routine reports based on business requirements, functional and technical specifications, and development standards for assigned projects/applications.
- Developed Power BI reports and dashboards from multiple data sources using data blending.
- Developed SQL queries/scripts to validate the data such as checking duplicates, null values, truncated values and ensuring correct data aggregations.
- Performed data quality analysis using advanced SQL skills. Performed Count Validation, Dimensional Analysis, Statistical Analysis and Data Quality Validation in Data Migration. Extensive SQL querying on Staging, Data Warehouse and Data Mart.
- Performed multiple visualization techniques using Power BI, and Tableau. Explored strategic expertise in design of experiments, data collection, analysis and visualization.
- Troubleshoot, resolved, and escalated data related issues to higher tier, and validated data to improve data quality
- Assisted in process of change control documentation, and in the development of knowledge transfer documentation
- Designed Power BI data visualization utilizing crosstabs, maps, scatter plots, pie, bar and density charts.
- Experience in providing Logging, Error handling by using Event Handler, and Custom Logging for SSIS packages
- Experienced in SDLC life cycle for Design, Development and Staging phases for the projects with support of Data-Flow, Process Models, and E-R diagrams.
- Maintained log information in Text file to tracking Errors and recording package execution status. Created Configurations, Checkpoints and Breakpoints
- Designed ad-hoc reports in excel power pivot and shared them using Power BI to the decision makers
- Performed different test scenarios for unit testing, integration testing, and regression testing and fixed any bugs found
- Presented on upgraded version of EMR applications, and demos to end users for added functionalities
Environment: SQL Server 2012, Tableau, Access, Excel, SSIS, Windows Server 2012
Confidential, Dallas, TX
SQL Server DBA
Responsibilities:
- Wrote DTS packages to automate periodic activities.
- Created and maintained different virtual server for different version of the application.
- Migrated SQL Server 2005 to SQL Server 2008R2.
- Wrote SSIS package to perform periodic data load.
- Created many Ad hoc Reports for different requirement using SSRS.
- Created cubes and dimensions using SSAS.
- Created table, stored procedures, functions, views and other database objects.
- Created and modified procedures, triggers and functions.
- Created Schema and database users.
- Created schema objects, rules and granted roles to the users.
- Assisted developers in writing and tuning new procedures.
- Used MDX queries with multidimensional cubes.
- Extensively Used SQL Profiler, Query optimizer and Index tuning wizard for query performance enhancement.
- Tuned Stored Procedures, Queries and Triggers for Performance.
- Performed daily backups and developed recovery procedures.
- Monitored growth of Database Objects for Capacity Planning.
- Involved with Transact SQL (T-SQL) Coding, writing queries, stored procedures, functions, views, & triggers.
- Automated the deployment of Production, Testing and development Database.
- Monitoring daily job activity.
Environment: SQL Server 2000, SQL server 2005, Excel, SSIS, Windows Server 2003
Confidential, Jacksonville, Fl
SQL Server DBA
Responsibilities:
- SQL Server 2005/2000 Database Administration.
- Involved in the migration of SQL Server 2000 databases to SQL Server 2005.
- Created new database objects like Tables, Procedures, Functions, Indexes and Views using T-SQL in Development and Production environment for SQL Server 2005.
- Implemented the disaster recovery models like clustering, mirroring, log shipping and transactional replication.
- Monitoring clustering environment. Designed and implemented comprehensive Backup plan and disaster recovery strategies Implemented and Scheduled Replication process for updating our parallel servers
- Involved in troubleshooting and fine-tuning of databases for its performance and concurrency
- Maintaining the database consistency with DBCC, DMV and DMF’s at regular intervals
- Implemented new T-SQL features added in SQL Server 2005 that are Data partitioning, Error handling through TRY-CATCH statement, Common Table Expression (CTE), Data Partitioning, Snapshot Isolation
- Installed SQL Server 2000/2005 on windows 2003 advanced servers, applied services packs and security fixes.
- Extensively worked on Dynamic Management Views in SQL Server 2005
- Installed, authored, and managed reports using SQL Server 2005 Reporting Services.
- To analyze long running slow queries and tune the same to optimize application and system performance.
- To set up SQL Server configuration settings.
- Experience in maintaining development, test and production database environments.
- Working knowledge of Linked Servers and ad-hoc Queries.
- Created DTS and SSIS Packages in which records were loaded
- Working knowledge in Database capacity planning: processing capacity, storage capacity and back-up capacity
- Experience in Database security and integrity planning.
- Experience in Reviewing and developing data models and database designs with development teams; entity-relationship models are used with relational databases, normalizing, de-normalizing, indexing, and defining views
- Created Maintenance Plans for Regular Backups and Rebuilding of Indexes
- Tuning queries which are running slow using Profiler and Statistics by using different Methods in terms of evaluating joins, indexes, updating Statistics and code modifications
- Used DTA for index, statistics Recommendations and made appropriate Changes necessary for building New Indexes
- Involved in Disaster Recovery Model for database Backups and Recovery Strategies
- Validated change requests and made appropriate recommendations
- Modified database structures as directed by developers for test/develop environments and Assist with coding, design and performance tuning
Environment: SQL Server 2005, SQL Server 2000, T-SQL, SSIS, SSAS,SSRS, DTS, ETL, MS-Excel, Windows 2000/2003/NT/XP.