We provide IT Staff Augmentation Services!

Sr Big Data Developer Resume

0/5 (Submit Your Rating)

Atlanta, GA

SUMMARY

  • A creative, hands - on technical leader specializing in Big Data, SSIS, SSRS, Microsoft SQL Server applications and highly scalable systems.
  • Lead Architecture consulting & design activities for offerings covering Information Management, Data Warehouse Transformations and Big Data initiatives.
  • Overall experience of 10 years, covering all the facets of Consulting, Architecture, Development and Sustenance programs and 3+ years of experience in Big Data Applications.
  • Have played a key role in conceptualizing and proactively pursuing domain centric solution offerings with dedicated focus on Banking, Finance, Insurance and supply chain domains.
  • As a key technology contributor for the Big Data practice, I have been actively involved in competency building for Hadoop, refining frameworks for ETL based data migrations and capacity planning for Hadoop, DW platform and ETL tools.
  • Lead effort to select next-generation technology stack for real-time processing and analytics.
  • Evaluate the end-to-end data flow of legacy system and provide the recommendation for technology stack and target architecture within the Big Data system.
  • Extensive experience in design and implementation of Big Data applications involving various technologies like MapReduce, Spark, Flume, Sqoop, Hive, Pig, Oozie, Kafka, Hbase etc.
  • Experience in designing architecture solutions with Hortonworks and Cloudera distribution.
  • Extensive knowledge and experience in dealing with Relational Database Management Systems including Normalization, Stored Procedures, Constraints, Querying, Joins, Keys, Indexes, Data Import/Export, Triggers, cursors, CTE using SQL.
  • Extensive knowledge and experience in Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) database designs.
  • Extensively used ETL methodology for performing Data Migration, Extraction, Transformation and Loading using SSIS and designed data conversions from wide variety of source systems.
  • Expertise in working on all activities related to the development, implementation, administration and support of ETL processes for large-scale Data Warehouses using SSIS with MS SQL 2005/2008/2012.
  • Experience in using tools like Bulk Copy (BCP), Data Transformation Services (DTS).
  • Working knowledge in Agile/Scrum Environment and used TFS team foundation server/SVN for source control.
  • Highly motivated with an ability to learn new systems and business processes.
  • Excellent verbal and written communication skills combined with interpersonal and conflict resolution skills and possesses strong analytical skills

TECHNICAL SKILLS

Databases: Hbase, MSSQL Server 2016/2012/2008 R2/2005/2000

Big Data Tools/Technologies: Hadoop, Hive, Sqoop, Flume, Spark, Kafka, MapReduce

Business Intelligence Tools: SSIS, SSRS

Database Tools: SQL Server Management Studio (SSMS), SQL Server Configuration Manager, SQL Profiler, Foglight

Programming/Scripting Languages: Java, Unix, Power Shell, C#,T-SQL, ASP.net, HTML, XML

Data Modeling: ERwin, MS Visio, Star, Snow flake schemas

Scheduler: Autosys, Oozie

PROFESSIONAL EXPERIENCE

Confidential, Atlanta, GA

Sr Big Data Developer

Responsibilities:

  • Lead the solution architecture to setup a data analytics platform in Hadoop by enabling Lambda Architecture.
  • Design the Batch Flow of Confidential Billing process and implement the same through development of Sqoop scripts, Pig UDF, Hive scripts, Spark-Sql jobs.
  • Design and Develop Real-time route optimization process through Kafka, Spark Streaming and Hbase integration.
  • Design the Web services to build a Rest API to consume the Delivery status from Hbase.
  • Design and Develop Spark-Sql queries to perform the curation on Ingested data to create a model dataset for Predictive Analytics consumption.
  • Design the workflow management for automated scheduling of jobs in through Oozie Scheduler.

Confidential, Denver, CO

Sr Big Data Developer

Responsibilities:

  • Lead the Solution Architecture and Design activities in setting up of Integrated Analytics platform in Hadoop to support Data Ingestion, Processing, Persistence, Analytics and Reporting of voluminous, rapidly changing, structured, semi-structured and un-structured data.
  • Design and Develop Sqoop scripts to ingest the data from RDBMS sources.
  • Design and Develop the Flume Configuration script and processor to ingest the real time events from Message Queue to HDFS.
  • Design and Develop PIG UDF to perform the data profiling, data quality checks and data cleansing on raw ingested data.
  • Design and Develop Hive UDF to perform data anonymization of PII data.
  • Design of Spark-SQL Jobs for compute operations involving iterative processing.
  • Design and implement Technical and Business Audit Reconciliation framework.
  • Design CDC and SCD-Type 2 implementation on Incremental Data Ingestion.
  • Design solution for Schema Evolution through Avro and Parquet file format implementation.
  • Design Pig UDF to parse complex XML and Json data.
  • Design and Develop Hive Queries to curate the ingested data for Predictive Model consumption.
  • Design and implementation of Data Lineage capability through Apache Atlas.
  • Design and Develop workflow management by automated scheduling of jobs through Autosys.

Confidential, Denver, CO

Technology Lead

Responsibilities:

  • Extensive experience in developing Stored Procedures, Views, Cursors, Triggers, Scripts and Complex Queries in MS SQL Server.
  • Developed SQL Queries to fetch complex data using joins, sub-queries, CTE accommodating complex filters and database links.
  • Optimized the performance of queries in TSQL queries, normalized tables, established joins and created indexes wherever necessary.
  • Database and Transaction log backups & restoration, backup strategies, scheduling the backups. Backing up system & user databases and restoring them.
  • Performing fine Tuning of Database Application. Cleansing and solving Database troubles.
  • Extensively used BI tools like Integration service, Reporting Services and Analysis services in MS SQL server 2008 and 2012.
  • Developed SSIS packages and SSRS reports in SQL Server 2008/2012.
  • Filtered and cleansed bad data from legacy system using complex Transact- SQL statements in staging area, and implemented various constraints for data consistency.
  • Developed Packages using most of the Tasks, Containers, Transformations and Implemented Error Logging using SSIS.
  • Strong background in Data Warehousing principles and methodologies.
  • Designed different kinds of reports like Linked, parameterized reports and Worked on Drill Down and Drill-through Reports with different data regions like Tabular, Matrix etc.
  • Created Report Models for building Ad hoc reports using SSRS and deployed reports into SharePoint.
  • Created and managed roles for security in SSRS Reports.
  • Worked in AGILE methodology in development of Database Objects in SQL Server 2008/2012.
  • Worked very closely with Business Customers, End Users and resolved any business process related issues.

Environment: SQL Server 2012/2008, Visual Studio 2012/2010, SSIS, SSRS, T-SQL, Windows server 2010, MS Access.

Confidential

Technology Analyst

Responsibilities:

  • Responsible for logical and physical design of SQL Server databases.
  • Developed T-SQL queries, triggers, functions, cursors and stored procedures.
  • Created various schema, logins, users, application and database roles for the required objects.
  • Performed ETL operations to support the incremental, historical data loads and transformations using SSIS.
  • Designed SSIS packages for synchronizing the data between two different servers.
  • Involved in building and maintainingSSIS Packagesto import and export the data from various data sources usingBIDSbased on the design data models.
  • Created Ad-hoc reports and cascading reports, Pivot Tables for historical data using SSRS.
  • Generated Enterprise reports using SSRS from SQL Server Database (OLTP) and SQL Server Analysis Services Database (OLAP) and included various reporting features such as group by, drilldowns, drill through, sub-reports etc.
  • Used Publishing Report Parts feature of newly released SQL Server 2008 R2 and deployed the various report items like charts, maps, images, graphs, tables etc. to the report server along with the reports.
  • Worked with various Delivery mechanisms of Reports including Email /PDF/Schedules.
  • Created subscriptions to provide a daily basis reports. Managed and troubleshoot report server related issues.
  • Experience in writing PowerShell scripts.
  • Performed day to day Database Maintenance tasks - Database Backups, Space Management, and Resource Utilization, responsible for performing object Migration.
  • Worked under Team Foundation Server (TFS).
  • Created and scheduled jobs for various tasks and also was responsible for maintaining jobs
  • Provided on-call support to production system to resolve any issues.
  • Involved actively as a part of team for collecting and analyzing the needs of end user requirement.

Environment: SQL Server 2010/2008, Visual Studio 2010/2008, SSIS, SSRS, T-SQL, Windows server 2010, MS Access.

Confidential

Technology Analyst

Responsibilities:

  • Involved in installation and configuration of SQL Server with latest Service Packs.
  • Developed various T-SQL stored procedures, triggers, views, functions and adding/changing tables for data extraction, data loads and transformations.
  • Created various database objects such as schema, logins, users, roles, tables and indexes based on the requirements.
  • Responsible for the architecture, design, development and implementation of SSIS templates and packages.
  • Designed and created user based reports, admin level reports against the SSIS logs and report server to monitor the SSIS packages and the reports for the execution time using SSRS.
  • Optimized SSIS packages for the performance as the high volume data flows were taking more than the desired time to execute.
  • Created different kinds of Reports using SSRS which gives all the details as per business requirements. Designed and implemented stylish report layouts.
  • Generated various Report models on Views (due to security issues) and deployed them on to the production reporting server and generated various Report models and ad-hoc reports.
  • Experience in administrating the created reports and assigning permission to the valid users for executing the reports.
  • Designed the data models to meet the requirements of each report.
  • Created weekly database backup jobs and schedules using SQL Agent.
  • Responsibilities include meeting with users to define business rules and requirements and ensuring proper documentation for all phases of the project.

Environment: SQL Server 2008/2005, Visual Studio 2008/2005, SSIS, SSRS, T-SQL, Windows server 2008, MS Access.

Confidential

Software Developer

Responsibilities:

  • Responsible for understanding the business requirements and preparing technical specification documents.
  • Created complex stored procedures, functions and triggers for data extraction and transformation according to the business requirements.
  • Responsible for creating appropriate loaders and relational writes to load the Data using SSIS.
  • Involved in migration of DTS packages to SSIS.
  • Used different transformations like excel source, data conversions, lookup, Merge, Merge Join, OLEDB command, derived columns, OLEDB destination, etc.,
  • Designed dynamic SSIS with C#.Net to transfer data crossing different platforms, validate data and data clearing during transferring, and archived data files for different DBMS.
  • Designed multiple reports such as linked, sub, drill through and drill down reports depending up on the client’s need.
  • Participated in report deployment, report authoring. Used conditional formatting to make the reports more users friendly.
  • Involved in trouble shooting and fine-tuning of databases for its performance and concurrency.
  • Used various report items like tables, charts and Graphs to develop the reports in SSRS.
  • Multilingual SSRS reports are built based on client specifications
  • Fine-tuned the complex database stored procedures, created proper indexes to increase performance.

Environment: SQL Server 2005, Visual Studio 2005, SSIS, SSRS, T-SQL, Windows server 2003/2000.

We'd love your feedback!