Big Data Consultant Resume
0/5 (Submit Your Rating)
Reston, VA
SUMMARY
- Over 5 years of experience in database development (SQL, Stored Procedures, Indexes, ETL Development) with experience in MS BI tools such as SSMS/SSIS/SSRS.
- Proficient in creating T - SQL (DDL, DML, and DCL), Views, Table Variables, Stored Procedures, User defined functions to facilitate efficient data manipulation and consistent data storage.
- Proficient in data migration from multiple data source to single coded database destination.
- Created SSIS Packages using Various Transformation like Lookup, Derived Columns, Condition Split, Data Conversion, Aggregate, Merge Join, Sort, ExecuteSQLTask, Data Flow Task, and Execute Package Task etc. to generate underlying data for the reports and to export cleaned data from Excel Spreadsheets, Text file, MS Access and CSV files to data warehouse.
- Strong experience in creating various reports like Drill through, Drill down and Ad-hoc according to the user requirement usingSQLServer Reporting Services (SSRS).
- Experienced in using global variables, expressions and functions for the reports.
- Knowing the Infrastructure of hadoop cluster.
- Understanding the process of MapReduce job.
- Knowing Hadoop daemons and how they function both in data storage and processing.
- Knowing the lifecycle of a Mapper and the lifecycle of a Reducer.
- Knowing how partitioners and combiners function, and recognizing appropriate use cases for each.
- Experiencing with Hadoop ecosystem, such as: Sqoop, Hive, Pig, Oozie.
- Knowledge of Agile development and TOGAF.
- Organized professional with excellent oral and written communication skills, excellent presentation, interpersonal skills, problem solving skills, fast learner and also adept quickly to new technology with ability to take new roles in minimum time and little training.
PROFESSIONAL EXPERIENCE
Confidential, Reston, VA
Big Data Consultant
Responsibilities:
- Designed and deployed full SDLC of local/AWS Hadoop cluster based on client’s business need.
- Linux system configuration for preparation of Hadoop installation.
- Daily monitoring status and health of Hadoop cluster through cloudera Hadoop management system, including Name Node, Data Node, Job Tracker, Task Tracker and replicated blocks.
- Helped to design Kerberos security environment under Hadoop.
- Experienced with configuring and installing HBase onto Hadoop as well as manipulating data in HBase.
- Participated in evaluating and designing big data models in HBase.
- Created HBase tables to store data in column format from different data sources.
- Fetched the data into HDFS and analyze it with the help of MapReduce, Hive and Pig.
- Wrote HiveQL to analyze the data and then export table to HBase.
- Interacted with the clients, business analysts and BI developer for collecting, understanding and evaluating the business requirements.
- Developed MapReduce application on HDFS platform to explore customers' critical product buying reasons by analyzing client's web logs.
- Cooperated with relational data analyst to combine unstructured data analytical results and structured data analytical results to make complete data analytics.
- Used Machine learning tool, Mahout, to predict customer’s preference in order to expand client’s business market. .
- Experienced with Hive on Spark.
Environment: Linux (Red Hat), Hadoop cluster, Hadoop ecosystem, Mahout, Eclipse, MySQL.
Confidential, Richmond, VA
BI/ETL Developer
Responsibilities:
- Responsible for extractingand reviewing data from heterogeneous sources like (.csv, flat file, MS Access, text format data) usingSQLserver Integration Services (SSIS).
- Created SSIS packages using various data transformations like fuzzy lookup, Sort, Multicasting, Conditional Split and derived column transformation etc. to migrate data from different functional databases intoSQLServer 2012.
- Continuously interacted with users to gather the business requirements and generating different reports based on those requirements.
- Used complex expressions to calculate, group, filter, parameterize, and format the contents of a report.
- Created complicated reports by SSRS and Tableau, like Parameter based Reports, Graphical Reports, Excel Reports, Drill-Down Reports, Matrix Reports, Chart and Tabular Reports.
- Deployed and uploaded the SSRS reports to SharePoint Server for the end users to look at them.
- Creating Star and Snow Flake Schema design for database, defining relations between tables.
- Developed and evaluated source to target mapping documents, data profiling, data quality and data cleansing.
- Participated in designing conceptual, logical and physical data models.
- Experienced with Teradata database management system.
- Modified existing database by adding tables and relationships. Designed and Created additional databases, tables,views, stored procedures and triggers based on business requirements.
Environment: MS SQL Server 2012 SSRS/SSIS, T-SQL, Windows 7
Confidential
MS SQL Server Developer/BI
Responsibilities:
- Gathered business requirements, definition and design of data sourcing and data flows.
- Performed server installation and configuration usingSQLServer 2005.
- Created Database Objects like Tables, Indexes, Views, Stored Procedures, triggers and User defined functions according to the requirements of the project.
- Developed backup restore scripts forSQLServer as needed.
- Database planning in relation to physical and logical data architecture.
- Analyzed business requirements and build logical data models that describe all the data and relationships between the data.
- Used SSIS to populate data from various data sources, creating packages for different data loading operations for applications.
- Applied various data transformations like Lookup, Sort, Multicasting, Conditional Split, Derived column etc.
- Involved in generating high level reports for executives and clients, i.e. parameterized report.
- Created Drill down, Drill through, Snapshot, Sub-reports, Matrix reports using SSRS.
- Deployed reports in the report server.
Environment: SQLServer 2005 Enterprise Edition, SQL, SSAS, SSIS, T-SQL, Windows XP