Big Data Architect Resume
TECHNICAL SKILLS:
Operating Systems: Windows Platform(10,7, XP)
Databases: MS SQL Server 2005,2008,2012,2014
OLAP and Reporting Tools: SSRS, SSAS, MS - Excel, Power BI, Power pivot, Tableau, Crystal Report and Xcelcious
ETL Tools: SQL server Integration Services 2005,2008,2012,2014
Programming languages: TSQL, C#, Python
Client tools: BIDS, TFS, SSMS
Big Data framework /tools: Azure HDInsight, Pig, Hive, Spark, ADLA, USQL, Databricks, Azure data factory, Azure keyvault
ERP: Syteline 7.0
Cloud: Azure
PROFESSIONAL EXPERIENCE:
Confidential
Big data Architect
Responsibilities:
- Interact with business team to understand the source systems, fields and the data definitions required to integrate with new platform.
- Involve in meeting with customer Architects, Microsoft architects to come up with best suitable application, security and information architecture.
- Design the best big data framework to orchestrate the data integration from source systems to the dashboard layer using azure data factory and databricks.
- Set up the security layer using azure key vault and connect this with azure data factory, databricks and all the source systems such as FTP, web API, Amazon S3.
- Mount the Azure data lake store with databricks as the data repository
- Guide the junior developers to implement the data integration framework and do the code review of the program created by them.
- Develop the complex pipelines and databricks transformation script using hive, Scala or python.
- Develop best possible methods to handle the errors, restart, recovery etc.
- Find out solution for all the bottlenecks based on the requirement in terms of ADF, vault, databricks, SQL layer, power BI etc. in advance before the development and pass to the developers.
- Meeting with all the source systems and provide the expected timelines for the data ingestion and schedule the pipelines.
- Find the product bugs in advance and set up meeting with Microsoft technical support team to solve the issue or to find the work around.
- Test the entire system before the deployment and back up the programs regularly.
- Participate in the daily scrum call and provide the status
- Document all the functional and technical details and hand over to the maintenance team.
Confidential
Data integration Architect
Responsibilities:
- Interact with business team to understand the legacy systems and corresponding salesforce details.
- Involve in meeting with customer Architects to come up with best suitable application, security and information architecture.
- Complete the interface agreement document with collected details and seek sign off from the concerned parties.
- Complete the ETL mapping document with the help of data modelers and seek sign off from the concerned parties.
- Make sure all the developers are following the defined standards in development, documentation and version controlling.
- Design ETL framework to control and execute all the SSIS packages and schedule the same based on the dependency.
- Design the ETL packages based on the best practices and standards to integrate the data into salesforce and get back the updated data from salesforce to the integrated data store. IDS will be the source for the downstream applications and push the records based on the downstream requirements.
- Develop complex ETL packages such as the pull from Restful API and load multiple tables in one shot using the c# script.
- Performance tuning of the SQL stored procedures and the sql query inside the SSIS packages
- Do the code review of the junior developers and improve the performance of the packages.
- Test the entire system before the deployment and back up the programs regularly.
- Set up the environment for testing and provide necessary guidance to the QA team.
- Participate in the daily scrum call and provide the status
- Document all the functional and technical details and hand over to the maintenance team.
- Provide demo at the end of the sprint
- Prepare the checklist for the deployment and make sure all the programs deployed in production environment
- Production deployment of the entire system and load the historical records
Confidential
Data integration architect
Responsibilities:
- Complete the ETL mapping document with the help of data modelers and seek sign off from the concerned parties.
- Make sure all the developers are following the defined standards in development, documentation and version controlling.
- Design ETL framework to control and execute all the SSIS packages and schedule the same based on the dependency.
- Performance tuning of the SQL stored procedures and the sql query inside the SSIS packages
- Develop the necessary ETL packages to integrate the data.
- Integrate the data into SSAS cube for report and dashboard consumption.
- Do the code review of the junior developers and improve the performance of the packages.
- Test the entire system before the deployment and back up the programs regularly.
- Participate in the daily scrum call and provide the status
- Document all the functional and technical details and hand over to the maintenance team.
- Provide demo at the end of the sprint
Senior developer/Project Lead
Confidential
Responsibilities:
- Leading a team of 5 members to implement this project
- Recruited all the 5 members by carefully screened number of profiles.
- Provide all the knowledge required to the recruited members to complete the project in time.
- Interaction with business users to identify their requirement and propose new method of presenting data in more easy and visual methods
- Developed the project plan and make sure the associates work finish within the planned time.
- Provided Design and architecture for Self-service BI design and architecting cube using SSAS
- Managing and controlling development of BI reports using SSRS
- Managing and controlling development of BI dashboards using MS-Excel and Power BI
- Managing and controlling Production deployment of all the BI objects
- Developed release process to release the program to QA and production
- Version control of the project
- Manage the knowledge base of GF business for the successful execution of the project
- Weekly and monthly project status report to higher management
- Technical documentation
- Co-ordination between the developers
- Code review of the associates and approval of the same.
- Understanding the risk and creating mitigation plan
- Address the issues and escalation management
- Understand the knowledge gap of the associates and make sure that all are trained in the required skills leave authorization, approving vacations, time sheets, expense reports etc. apart from supervising the daily activities of the associates
- Yearend appraisal process of the associates
Project Lead
Confidential
Responsibilities:
- Recruitment of right candidate for the projects
- Led a team of 4 people to implement this project
- Developed the project plan and made sure the associates work finish within the planned time
- Provided Design and architecture for Self-service BI design and architecting cube using SSAS
- Managing and controlling development activities
- Business requirement gathering and analysis and provide necessary information to the associates to equip them with project specific knowledge
- Involved in database and ETL load design
- Creation of tables, SSIS packages, SSAS cubes and database queries
- Code review of the associates and approval of the same
- Developed release process to release the program to QA and production
- QA and Production deployment
- Preparation of analysis report using MS-Excel
- Co-ordination with team for smooth execution of the project
- Technical documentation
- Understanding the risk and creating mitigation plan
- Address the issues and escalation management
- Weekly and monthly status reports to higher management
- Helped CTS business development team by highlighting the team work in NetApp
Confidential
Data Analyst
Responsibilities:
- Managed a team of two members
- Requirement gathering and analysis
- Work estimation and planning
- Design of Extraction strategy of AdCenter business data from COSMOS, SSAS Cubes or SQL Databases
- Development of SCOPE(USQL) scripts to extract the data from big data repository.
- Business analysis on extracted data using MS-Excel or TSQL
- Creation of various Excel analysis reports using power pivot, charts, graphs etc.
- Developed complex stored procedures, views, functions and TSQL queries
- Design ETL packages to populate ROLAP databases
- Performance optimization of database objects, ETL and reports
- Automation using Windows Powershell
- Escalation management, Issue resolution, reviews of client deliverables
- Version control of the automation scripts and analysis scripts
- Team co-ordination and work management
- Status reporting
Confidential
Senior ETL Developer
Responsibilities:
- Manage team of 3 members which includes 2 report developers and 1 ETL developer.
- Business requirement analysis.
- Project Planning and estimation.
- Designing of ETL environment.
- Worked closely with data modeler to come up with the EDW Design.
- Manage Development activities.
- Develop and guide team for ETL Mappings.
- Code reviews of stored procedures, views, functions and TSQL.
- Performance tuning of the database objects.
- Unit testing.
- Documentation (ETL technical spec, Unit test case, data dictionary, Release Note).
- Development of advanced graphical end user report using Tableau & SSRS.
- Project status report.
- Training to the end users on self-service BI capabilities.
Confidential
Reporting analyst
Responsibilities:
- Requirement analysis
- Database design
- ETL Design
- Developed ETL Mappings
- Developed Materialized views
- Developed Reports using SSRS
- Performance tuning of the database objects
- Unit testing
Confidential
Developer
Responsibilities:
- Analyze the requirement
- Analyze the impact of database changes
- Document the database changes and maintenance of the same in VSS.
- Customization Syteline 7.0 ERP program as per the requirements.
- Design of Database and creation of database objects.
- Performance tuning of the database objects. preparation of unit test case
- Preparation of low level design
- Development of reports